S4.17 - Retention_and_access_control

S4.17 ? Retention and access control

flowchart LR
    A[Evidence is needed for review and audit] --> B[RAIDT
run-level evidence framework] A2[Traditional limitation:
keep records securely, but without run-specific retention or access rules] --> B B --> C[[S4.17 Retention and access control
governs what evidence is kept, who may access it, and for how long]] C --> D[Evidence pack
proportionate retained artefacts] C --> E[RAIDT score profile
stronger Responsibility, Auditability, Traceability] C --> F[Governance outcomes
reviewability, contestability, audit readiness] D --> G[Reviewer reconstruction] E --> H[Governance readiness] F --> I[Organisational learning and policy alignment] J[Retention period / review date] --> C K[Authorised roles / approvals] --> C L[Sensitivity label / minimisation] --> C M[Redaction status / storage form] --> C N[Deletion trigger / exception log] --> C

Star S4 - Evidence Architecture and Artefacts

Star context: Specifies the concrete fields and artefacts that make a run record inspectable, governable, and safe to retain over time.


Academic picture
Definition / background

Retention and access control refers to the rules that govern how long RAIDT evidence is kept, which people or roles may inspect it, what protections apply while it is stored, and when it should be restricted, deleted, redacted, or reviewed. Conceptually, it draws from records management, information governance, privacy protection, security control, and audit trail design. In a governance setting, it answers a simple but consequential question: once evidence about a GenAI run has been created, how is that evidence itself governed?

This item matters because RAIDT is explicitly evidence-led. A framework that asks organisations to preserve run-level evidence without specifying retention and access conditions would create a secondary governance failure: the evidence pack would improve accountability while potentially increasing privacy, confidentiality, and operational risk. Retention and access control is therefore not an optional administrative add-on. It is part of the architecture that makes evidence proportionate, defensible, and usable.

It is also distinct from a generic enterprise retention policy. A general policy may define how long classes of documents are kept across the organisation, but RAIDT asks how the evidence of a specific GenAI run should be handled. That means the focus is narrower, more operational, and directly linked to the run record, evidence pack, and score profile. In RAIDT, this item sits inside the evidence architecture because it determines whether evidence can be retained in a way that remains inspectable without becoming an unmanaged liability.

Why this concept matters

Retention and access control solves a core governance tension in GenAI oversight: organisations need enough evidence to reconstruct, review, and contest a run, but they should not retain sensitive material indefinitely or expose it to inappropriate access. Without this item, evidence collection can become indiscriminate, roles may be unclear, deletion may be ad hoc, and audit readiness may come at the cost of data protection and trust.

In practice, this concept avoids two common failures. The first is over-retention, where teams keep everything "just in case" and create unnecessary privacy, confidentiality, or cyber risk. The second is under-governed access, where evidence exists but is visible to staff who do not need it, or cannot be accessed by legitimate reviewers when a run must be investigated. RAIDT makes these issues explicit at the run level so governance moves from broad principles to operational controls.

Key idea: retention and access control matters because RAIDT evidence is only governance-ready when it is both reviewable and proportionately protected.

What this item controls
Practical example / likely audience question

Audience question

If RAIDT encourages organisations to keep richer evidence about GenAI runs, does it not simply create a larger privacy and security problem?

Answer

That concern is valid, and it reflects a common misconception that better evidence always means keeping more raw material for longer. The direct answer is no: RAIDT does not require indiscriminate retention. It requires governed retention. The point of this item is to make the evidence layer itself subject to minimisation, access restriction, and retention discipline.

Consider a run that supports internal HR drafting. The prompt, retrieved documents, and output may contain personal or commercially sensitive information. A generic governance approach might say only that records should be stored securely. RAIDT goes further by asking what evidence is necessary for later review, what can be hashed or summarised instead of stored in full, who can inspect the evidence pack, and when parts of that record should be deleted or restricted. That distinction is important because it turns a vague policy aspiration into an inspectable run-level control.

This is one of the ways RAIDT handles the issue better than generic AI governance. Rather than assuming that evidence collection is inherently good, it treats evidence as something that must itself be governed. That allows organisations to preserve accountability while reducing the risk that governance artefacts become a new source of harm.

Practical example in RAIDT terms

In a healthcare setting, a hospital uses a GenAI assistant to draft discharge-summary language from clinician notes and approved template material. The run-level issue is that evidence is needed to review what the model was asked to do, what content informed the answer, and why the output looked reasonable at the time. However, the same evidence may contain patient-identifiable or clinically sensitive information.

In RAIDT terms, the organisation should not merely log the run and keep everything indefinitely. It should specify what evidence is retained in the run record, whether patient-linked content is redacted or stored by reference, which reviewer roles may access the material, what retention period applies, and what deletion or review trigger closes the record. Evidence might include a retention rule identifier, an access-role list, a sensitivity label, a redaction status, and a disposal or review date alongside the normal run metadata.

The most affected RAIDT pillars here are Responsibility, Auditability, and Traceability, with Dependability also relevant because poor retention practice can undermine reliable review and incident response. By making retention and access control explicit, RAIDT improves governance readiness: a reviewer can see not only the evidence that exists, but also why that evidence was retained in that form and under those access conditions.

Detailed link to RAIDT

Retention and access control links to RAIDT in four ways.

First, it supports RAIDT's core idea that GenAI governance should be grounded in inspectable evidence rather than organisational assertion.
Second, it operates at the level of the individual run, specifying how the evidence produced by one configured use of a system should be retained, restricted, reviewed, or deleted.
Third, it shapes both the evidence pack and the score profile, because evidence that is retained without proportionate safeguards should not be treated as fully governance-ready.
Fourth, it strengthens reviewability, contestability, audit readiness, and organisational learning by ensuring that evidence remains available to the right reviewers without becoming uncontrolled or unsafe.

Retention and access control ? Run-level evidence ? Evidence pack ? RAIDT score profile ? Governance readiness

Link to the five RAIDT pillars

Responsibility

This item supports responsibility by showing that evidence collection is bounded by proportionality, privacy protection, and role accountability rather than by unchecked logging.

Example evidence / implication:

Auditability

This item strongly affects auditability because reviewers need evidence to remain available long enough, and in a controlled enough form, to reconstruct what happened.

Example evidence / implication:

Interpretability

The effect on interpretability is indirect but still important. Access-controlled evidence allows authorised reviewers to inspect the context needed to interpret a model output without exposing that context unnecessarily.

Example evidence / implication:

Dependability

This item contributes to dependability by making the evidence layer stable and governable over time. Poor retention practice can make later investigation inconsistent or impossible.

Example evidence / implication:

Traceability

This item has a strong traceability role because it governs whether the chain from run to evidence to review remains accessible, attributable, and appropriately protected.

Example evidence / implication:

Why this item is more than a generic concept

In general AI governance, retention and access control may simply mean that records should be kept securely and deleted according to policy. In RAIDT, it means something more operational: the run record should show how the evidence of that specific GenAI use is governed, what level of access is permitted, what minimisation has occurred, and how long the evidence remains available for review.

The RAIDT meaning is therefore more concrete. It is tied to run-level evidence, evidence-pack design, scoring implications, and governance readiness. The question is not merely whether a policy exists somewhere in the organisation; it is whether the governance status of the evidence for this run can be inspected and justified.

Common misunderstanding

Misunderstanding

If evidence may be useful later, the safest option is to retain as much of it as possible for as long as possible.

Correction

Over-retention is not automatically safer. It can increase privacy exposure, expand insider-access risk, complicate legal or policy compliance, and make governance harder rather than easier. In RAIDT, the aim is evidence sufficiency with proportional control. For example, a team may need to retain a prompt hash, tool trace, retention rule, and reviewer-access conditions, while storing only a redacted version of sensitive input content. That produces a more governable record than keeping all raw material indefinitely.

Boundary and limitation

Retention and access control does not prove that a GenAI run was lawful, fair, accurate, or ethically acceptable. It also does not guarantee that policy has been enforced in practice. An organisation may document a sound retention rule while failing to implement deletion, access restriction, or redaction reliably.

The item therefore depends on surrounding controls such as identity and access management, records management processes, deletion workflows, data classification, and internal assurance. RAIDT handles this limitation by treating the item as part of an evidence architecture rather than as a complete compliance solution. It improves inspectability and governance discipline, but it does not replace legal interpretation, technical enforcement, or sector-specific obligations.

Implementation levels

Manual implementation

A researcher or small team can apply this item manually by adding a retention note to each run record, stating who may inspect the evidence, how long it should be kept, and whether any sensitive elements have been redacted or stored by reference. Even a simple template can improve consistency if the rule is recorded every time.

Semi-automated implementation

A semi-automated approach can use structured metadata fields, review forms, sensitivity tags, and standard evidence-pack templates. This allows staff to choose from approved retention classes and access roles while still adding context-specific notes where needed.

Fully automated implementation

At scale, a governance wrapper, orchestration layer, or evidence pipeline can assign retention classes automatically, attach access-control metadata, trigger review or deletion dates, enforce role-based visibility, and log exceptions. In this form, the item becomes part of the platform logic that keeps RAIDT evidence usable for oversight without turning it into unmanaged data accumulation.

Practical use in the RAIDT project

Within the RAIDT project, this item helps explain why evidence architecture is not only about capture but also about stewardship. In Paper 08 Foundations, it clarifies that run-level evidence must be designed to remain reviewable without creating an uncontrolled archive. In Paper 09 Empirical Validation, it can be used to assess whether real deployments record evidence in a proportionate and inspectable way. In Paper 10 Policy Pathways, it translates broad policy language about record keeping, accountability, and privacy into concrete operational expectations.

It also supports sector playbooks by showing how different contexts may require different retention windows, access roles, and minimisation practices while still following the same RAIDT logic. For supervision, viva defence, and journal positioning, this item is useful because it demonstrates that RAIDT is not naively "pro-logging"; it is evidence-led and governance-aware at the same time.

Key audience questions to prepare for

Q1. Why is retention policy part of a run record rather than only an organisational policy?

Because RAIDT evaluates governance at the level of the specific run. A general policy may exist, but reviewers still need to know how the evidence for this run is being handled, for how long, and under what access conditions.

Q2. Does this item require organisations to store sensitive prompts and outputs in full?

No. RAIDT supports proportionate evidence design. Depending on the use case, a team may retain hashes, summaries, redacted versions, or controlled references instead of full raw content.

Q3. How does this item affect the RAIDT score profile?

It affects whether evidence is genuinely governable. Evidence that exists but is retained indefinitely, poorly restricted, or impossible to review proportionately should not be treated as fully governance-ready.

Q4. What if a reviewer needs evidence after the normal retention window has expired?

That risk should be handled through explicit review windows, exception rules, and escalation procedures, not by keeping everything permanently. RAIDT encourages organisations to make those trade-offs visible.

Q5. Is access control mainly a security issue rather than a governance issue?

It is both. In RAIDT, access control is a governance issue because the legitimacy of evidence depends not only on its existence, but also on whether the right people can inspect it and the wrong people cannot.

Suggested citation concepts to support this item
Short explanation for presentation

Retention and access control is the part of RAIDT that governs the evidence itself. RAIDT asks organisations to preserve run-level evidence so that GenAI use can be reviewed, challenged, and audited, but that only works if the evidence is kept proportionately and accessed appropriately. This item therefore records what evidence is retained, who may inspect it, what safeguards apply, and when deletion or review should occur. Its value is that it prevents RAIDT from becoming a simple logging exercise. Instead, it makes evidence architecture governance-aware. For supervision or viva discussion, the key point is that accountable AI use depends not only on capturing evidence, but also on controlling the lifecycle and visibility of that evidence in an inspectable way.

One-line takeaway

Retention and access control is the governance of RAIDT evidence after capture, because run-level accountability only works when evidence remains available to the right reviewers under proportionate safeguards.

Related items in evidence architecture and artefacts
Anchored questions
Powered by Forestry.md