S8.12 - Paper-code_separation
S8.12 ? Paper-code separation
flowchart LR
A[Overloaded manuscripts and weak technical transparency] --> B[RAIDT - run-level evidence framework]
B --> C[[Paper-code separation]]
C --> D[Readable governance argument in the paper]
C --> E[Linked technical artefacts in repository and appendices]
D --> F[Evidence pack]
E --> F
E --> G[RAIDT score profile]
F --> H[Reviewer reconstruction]
G --> I[Governance readiness]
J[Healthcare, public services, enterprise productivity, cybersecurity] --> C? Star S8 - Implementation and Operations
Star context: Shows how RAIDT can be adopted manually, semi-automatically or through orchestration, and how it becomes part of real governance routines. Within this star, paper-code separation explains how RAIDT is documented rigorously without collapsing academic argument, operational evidence, and executable implementation into one unreadable artefact.
Academic picture
Definition / background
Paper-code separation is the practice of keeping the main manuscript focused on the academic argument while locating executable code, repository structure, functions, configuration details, and related artefacts in appendices, linked repositories, or structured supplementary materials. It does not imply a separation between reasoning and evidence. Rather, it creates a disciplined relationship between them: the paper explains what was done, why it matters, and how it should be interpreted, while the technical artefacts provide the operational detail required for reconstruction and scrutiny.
Conceptually, this sits at the intersection of reproducible research, software documentation, and governance transparency. In a general research context, authors often separate prose from implementation to preserve readability. In a RAIDT context, the reason is stronger. RAIDT treats the run as the unit of governance, so each governance claim should be capable of being tied back to run-level evidence. That evidence may include prompts, model settings, wrappers, scripts, evaluation routines, approval checkpoints, or log schemas. If all of that is pushed into the paper body, the conceptual argument becomes hard to follow; if it is omitted entirely, governance claims become difficult to verify.
Paper-code separation therefore belongs inside RAIDT because RAIDT depends on both interpretive clarity and evidential traceability. The paper can explain the governance model, the meaning of the five pillars, and the logic of evidence collection. The linked technical artefacts can then show how particular runs were configured, logged, checked, and scored. This supports the run-level evidence pack and makes the score profile more defensible because the scoring logic is not left as an unsupported textual claim.
This item differs from generic supplementary material practices. A normal appendix may simply provide extra detail. Paper-code separation in RAIDT is more structured: it establishes a boundary between the narrative account and the executable substrate while preserving explicit links between the two. In that sense, it is an implementation and operations concept, not just an editorial convention.
Why this concept matters
Paper-code separation solves a practical governance communication problem. Organisations and researchers working with generative AI need to explain how a system was used, what controls were in place, what evidence was collected, and how conclusions were reached. If the academic paper attempts to carry every code fragment, schema, and operational detail, it becomes inaccessible to readers and weak as an argument. If the paper contains only high-level claims, it becomes difficult to audit.
The concept therefore avoids two common failures at once: evidence hidden inside unreadable prose, and prose unsupported by inspectable artefacts. In organisational settings, that distinction matters because governance is rarely judged only by principles. It is judged by whether a reviewer, supervisor, auditor, or regulator can reconstruct what happened in a specific run and assess whether the controls were proportionate.
In RAIDT, this matters because the framework is explicitly trying to move GenAI governance from principles and assertions toward evidence, reviewability, contestability, audit readiness, and continuous improvement. Paper-code separation helps that move by making sure the governance narrative remains intelligible while the underlying technical evidence remains organised, linkable, and reviewable.
Key idea: Paper-code separation matters because RAIDT needs governance claims to be readable in the paper and reconstructable in the evidence base.
What this item enables
- A clear boundary between conceptual argument and executable implementation.
- Cleaner academic writing without loss of technical transparency.
- Explicit linking from manuscript claims to repositories, scripts, appendices, and artefacts.
- Better reviewer reconstruction of how a RAIDT-governed run was configured and assessed.
- More credible evidence packs because code references can be versioned, indexed, and audited.
- More defensible score profiles because scoring logic can be tied to inspectable implementation details.
- Easier organisational reuse, because methods and artefacts can be maintained operationally without rewriting the paper.
Practical example / likely audience question
Audience question
Why not just place the key code directly in the paper so that everything is visible in one place?
Answer
The concern behind that question is understandable: if governance depends on evidence, then placing code in the paper may look more transparent. The problem is that visibility is not the same as usability. Long code blocks rarely provide a good basis for conceptual understanding, and they often obscure the very governance logic a paper is trying to explain.
In RAIDT, the direct answer is that separation improves both readability and scrutiny when the links are explicit. A paper can explain the governance model, the role of the run, the evidence criteria, and the meaning of the five-pillar profile. The appendix or repository can then expose the scripts, prompts, configuration files, validators, and artefact schemas used to generate or assess that evidence. For example, a paper may state that Dependability scoring included repeatability checks across controlled runs. The repository can then contain the actual evaluation script, the parameter file, and the run log identifiers.
This is better than a generic AI governance approach because RAIDT is not satisfied with a broad statement that code exists somewhere. It requires operational linkage between narrative claims and run-level evidence. Separation is therefore not concealment; it is disciplined presentation with traceable technical support.
Practical example in RAIDT terms
Consider a healthcare trust using a GenAI assistant to draft discharge-summary templates for clinicians. A RAIDT-governed run is defined for one specific task, with a named model, a prompt template, a safety wrapper, date-stamped configuration settings, and human review checkpoints. The governance challenge is to publish or present the method in a way that clinicians, supervisors, and reviewers can understand without reading a full software repository inside the paper.
With paper-code separation, the manuscript explains the use case, the governance rationale, the risk controls, and the resulting RAIDT score profile. The linked evidence pack points to the repository commit, the prompt file, the redaction check, the validation script for output format, and the reviewer form used for post-run assessment. The run-level issue is whether a reviewer can reconstruct how one discharge-summary run was produced and evaluated. The needed evidence includes run identifiers, repository version, function names, configuration values, approval records, and output review results.
The most affected RAIDT pillars are Auditability and Traceability, with secondary effects on Responsibility and Dependability. Governance readiness improves because a supervisor or auditor can read the paper for the argument and inspect the evidence pack for the implementation detail, rather than being forced to infer both from a single overloaded document.
Detailed link to RAIDT
Paper-code separation links to RAIDT in four ways.
First, it supports RAIDT's core idea that governance should be grounded in evidence rather than broad assurance statements.
Second, it helps preserve the run as the unit of analysis by linking each textual claim to run-level artefacts rather than to abstract descriptions of a system.
Third, it strengthens the evidence pack and score profile because implementation details can be referenced, versioned, and reviewed without overwhelming the main argument.
Fourth, it improves reviewability, contestability, audit readiness, and organisational learning because different audiences can inspect the layer of detail appropriate to their task.
Paper-code separation ? Run-level evidence ? Evidence pack ? RAIDT score profile ? Governance readiness
This chain matters because RAIDT does not treat documentation as a cosmetic add-on. Documentation structure shapes whether governance evidence can actually be inspected, challenged, and improved.
Link to the five RAIDT pillars
Responsibility
Paper-code separation supports Responsibility by making it clearer who designed the governance logic, who implemented the controls, and where the operational artefacts sit. It reduces the chance that accountability is obscured inside a mixture of prose and code fragments.
Example evidence / implication:
- Named repository owners, reviewers, or maintainers linked from the evidence pack.
- Clear separation between policy rationale in the paper and implementation responsibility in the technical artefacts.
Auditability
This item has a strong effect on Auditability. Auditors need a readable account of the governance method and a structured route to the underlying implementation. Separation makes the audit trail easier to navigate.
Example evidence / implication:
- Repository links, commit hashes, appendix references, or artefact indices attached to a run record.
- Mapping between manuscript claims and the scripts or checks that generated supporting evidence.
Interpretability
Paper-code separation also supports Interpretability because readers can understand the governance model without being overwhelmed by implementation detail. At the same time, technical specialists can still inspect the underlying logic when needed.
Example evidence / implication:
- Plain-language explanation of the scoring logic in the paper, with technical routines placed in linked materials.
- Distinct treatment of conceptual interpretation and executable workflow.
Dependability
The effect on Dependability is supportive rather than primary. Separation does not make a system dependable by itself, but it helps dependable procedures remain inspectable and maintainable.
Example evidence / implication:
- Stable references to test scripts or validation routines used across repeated runs.
- Cleaner maintenance of operational code without repeatedly altering the explanatory manuscript.
Traceability
This item has a strong effect on Traceability because it makes it easier to follow a path from a published claim to the exact artefact, function, or repository state that supports it.
Example evidence / implication:
- Run identifiers linked to code versions, prompts, artefact files, and reviewer forms.
- Structured appendices showing where each evidential component can be found and reconstructed.
Paper-code separation most strongly affects Auditability and Traceability, while still improving Responsibility, Interpretability, and the maintainability conditions that support Dependability.
Why this item is more than a generic concept
In general AI governance, paper-code separation may simply mean that technical details are moved into supplementary files or a repository. In RAIDT, it means something more operational: the separation must still preserve an evidential chain back to a specific run, its controls, and its resulting assessment. The RAIDT meaning is therefore more disciplined because it is tied to run-level evidence rather than to a general norm of reproducibility.
That distinction matters. A generic governance document may say that code is available on request or stored elsewhere. RAIDT requires a clearer structure: what claim is made in the paper, what evidence supports it, where that evidence sits, and how a reviewer can inspect it. The concept becomes operational because the separation is designed around evidence packs, scoring logic, and governance readiness.
Common misunderstanding
Misunderstanding
Paper-code separation means hiding technical detail or making verification harder.
Correction
The opposite is true when the practice is implemented properly. Separation does not remove technical detail; it places that detail in a better evidential location. For example, a paper can state that a safety filter was applied before model output was accepted. The linked repository and evidence pack can then show the filter logic, the wrapper behaviour, the run log entry, and the reviewer outcome. That arrangement is more verifiable than burying a partial code fragment in the middle of the manuscript, where it is difficult to interpret and impossible to execute in context.
Boundary and limitation
Paper-code separation does not prove that the code is correct, that the repository is complete, or that the documented process was actually followed in practice. It also does not replace the need for accessible repositories, stable versioning, clear artefact naming, or disciplined evidence capture. If the repository is poorly maintained, the separation may create distance without clarity.
The concept also has limits in highly sensitive settings where code or prompts cannot be fully disclosed because of privacy, security, or contractual restrictions. In those cases, RAIDT still benefits from separation, but the evidence pack may need controlled access, redacted artefacts, or structured summaries rather than full public release. RAIDT handles this limitation by making the evidential chain explicit even when access conditions differ across audiences.
Implementation levels
Manual implementation
A researcher or small team can apply paper-code separation manually by keeping the manuscript free of long code blocks, maintaining a clearly named repository, and adding appendix references to scripts, prompts, functions, and artefacts relevant to each claimed RAIDT output.
Semi-automated implementation
A semi-automated approach can use templates, metadata tables, repository manifests, or structured evidence-pack forms that automatically record repository locations, commit identifiers, appendix numbers, artefact names, and run references.
Fully automated implementation
At scale, a governance platform or orchestration layer can automatically generate links between runs, repositories, commit hashes, prompt assets, evaluation scripts, reviewer forms, and score-profile outputs. In that model, paper-code separation becomes a managed documentation architecture rather than an authoring habit.
Practical use in the RAIDT project
In the RAIDT project, this item is useful across several outputs. In Paper 08 Foundations, it helps distinguish the conceptual contribution of RAIDT from the executable assets that illustrate implementation. In Paper 09 Empirical Validation, it allows empirical procedures, scoring scripts, reviewer forms, and run artefacts to be documented transparently without overwhelming the results narrative. In Paper 10 Policy Pathways, it helps explain how policy-facing claims can remain concise while still linking to inspectable technical evidence.
The same logic is useful for sector playbooks, evidence-pack design, scoring rubrics, influence methods, and governance interventions. It is also valuable in supervision and viva settings, because it gives a clear answer to a common challenge: how can a governance framework be both academically coherent and operationally inspectable? Paper-code separation is one practical part of that answer.
Key audience questions to prepare for
Q1. Is paper-code separation just a writing preference?
No. In RAIDT it is a governance-enabling documentation practice. It determines whether readers can move cleanly from the conceptual account to the underlying run-level artefacts.
Q2. Does separation reduce transparency?
Not if the links are explicit. It improves transparency by placing technical detail where it can be versioned, maintained, and inspected properly rather than fragmenting it across the paper.
Q3. Why is this especially relevant for GenAI governance?
GenAI systems often involve prompts, wrappers, model settings, evaluators, and logs that change over time. Separation helps keep those moving parts inspectable without destabilising the explanatory narrative.
Q4. Which RAIDT pillars are most affected?
Auditability and Traceability are affected most directly because the practice improves the path from claim to artefact. Responsibility and Interpretability also benefit, and Dependability benefits indirectly through better maintenance of evidence-linked implementation.
Q5. What happens if the code cannot be shared publicly?
The principle still applies. RAIDT can use restricted repositories, redacted artefacts, or controlled-access appendices, provided the evidence chain remains clear to authorised reviewers.
Suggested citation concepts to support this item
- reproducible research software documentation practices
- computational reproducibility in AI governance
- code availability statements in academic publishing
- supplementary materials standards for software-intensive research
- audit trails for machine learning and generative AI systems
- traceability between research claims and code artefacts
- documentation architecture for responsible AI deployment
- software repository versioning for empirical research transparency
- reviewability and contestability in AI governance evidence
- research compendia and executable scholarship
Short explanation for presentation
Paper-code separation means that the RAIDT paper carries the argument, while the linked repository, appendices, and artefacts carry the executable detail. That matters because RAIDT is trying to make GenAI governance reviewable at the level of a specific run. If everything is forced into the manuscript, the paper becomes cluttered and the governance logic becomes harder to explain. If the technical detail is omitted, the claims become difficult to verify. Separation solves that problem by keeping the narrative readable and the evidence inspectable. In practice, it helps supervisors, reviewers, and auditors move from a governance claim to the actual scripts, prompts, configurations, and artefacts that support it. In RAIDT terms, that strengthens the evidence pack, improves traceability, and makes the score profile more defensible.
One-line takeaway
Paper-code separation is the disciplined separation of narrative argument from executable artefacts because RAIDT needs governance claims to remain readable, traceable, and tied to run-level evidence.
Related items in implementation and operations
Anchored questions
Audience question: Why separate? Answer: it preserves paper readability while keeping technical transparency and auditability.