S3.03 - Proof_object

S3.03 ? Proof object

flowchart LR
    A[Fragmented documentation and weak governance claims] --> B[RAIDT - run-level evidence framework]
    B --> C[[Proof object - structured reviewable object for one run]]
    C --> D[Run-level evidence pack]
    C --> E[Five-pillar score profile]
    C --> F[Reviewer reconstruction and challenge]
    D --> G[Audit readiness]
    E --> H[Governance readiness]
    I[Healthcare, finance, education, public services, enterprise use] --> C

Star S3 - Run-Level Evidence Logic

Star context: Places the proof object inside RAIDT's run-level evidence logic. It explains how evidence from a single run is assembled into a reviewable object that supports reconstruction, comparison, challenge, and governance judgement.


Academic picture
Definition / background

A proof object in RAIDT is the structured evidence object that shows how a specific run occurred and on what basis governance claims about that run can be examined. It is best understood as the reviewable form of a run-level evidence pack: evidence is gathered, organised, and presented so that another party can reconstruct the run, inspect whether relevant controls were present, and challenge weak or unsupported claims.

The term matters because governance often fails at the point where an organisation must move from saying that safeguards exist to showing how those safeguards operated in a real use episode. In that sense, a proof object is not the same as a raw log, a single evidence file, or a policy statement. A raw log may be too technical, fragmented, or incomplete. A policy statement may declare intent without demonstrating execution. A proof object brings together the evidential components required for review at the level of one run.

Within RAIDT, this concept belongs inside run-level evidence logic because RAIDT treats the run as the unit of governance. The proof object therefore ties governance assessment to a concrete run in a concrete context, rather than to generic claims about a model, vendor, or organisational principle. It supports both of RAIDT's practical outputs: the run-level evidence pack itself and the five-pillar score profile derived from that evidence.

The concept also helps distinguish between related items in Star S3. An evidence object may be any individual evidential element. A proof object is the assembled, review-ready evidential whole. It exists so that reviewers can move from isolated artefacts to a coherent basis for judgement about responsibility, auditability, interpretability, dependability, and traceability.

Why this concept matters

The proof object solves a central operational problem in generative AI governance: even when evidence exists, it is often not assembled in a form that supports scrutiny. Without a proof object, an organisation may have prompts in one place, outputs in another, policy references elsewhere, and no stable way to show how the run should be interpreted. Review then becomes slow, inconsistent, and vulnerable to selective disclosure.

This concept also avoids a common confusion between having documentation and having reviewable proof. Documentation may describe a process in general terms. A proof object shows what happened in one run and how that run can be assessed. That distinction matters in high-stakes organisational settings, because governance failures often emerge from the difference between intended control and control in actual use.

If the proof object is missing, the organisation struggles to defend claims, compare runs, investigate incidents, or improve practice over time. It becomes difficult to challenge decisions, difficult to support an audit trail, and difficult to show why a score profile was justified. RAIDT uses the proof object to turn governance into something inspectable, contestable, and operational.

Key idea: A proof object matters because it converts dispersed run evidence into a reviewable governance object that can justify, challenge, and improve decisions about GenAI use.

What this item captures
Practical example / likely audience question

Audience question

Does proof object mean legal proof, or a claim that RAIDT can conclusively prove that a system was compliant or correct?

Answer

The concern behind that question is understandable, because the word 'proof' can imply certainty, legal sufficiency, or mathematical demonstration. In RAIDT, that is not the meaning. A proof object is a governance proof object: a structured, reviewable evidential object that allows a run to be examined and governance claims about that run to be tested.

The direct answer is no. RAIDT does not claim that a proof object automatically proves legality, truth, or ethical adequacy in an absolute sense. Instead, it provides the evidence needed for accountable review. For example, if a team uses a large language model to draft a policy briefing, the proof object may contain the prompt, output, model identifier, time stamp, user role, task purpose, review notes, and control metadata. That does not guarantee the briefing is correct. It does allow a reviewer to see how the run happened, whether safeguards were applied, and whether the governance judgement is defensible.

RAIDT handles this better than generic AI governance approaches because it ties the object to one run rather than relying on broad claims such as 'the system is governed' or 'the vendor is compliant'. The proof object therefore supports practical scrutiny, not abstract reassurance.

Practical example in RAIDT terms

Consider a healthcare setting in which a clinician uses a generative AI assistant to draft a discharge summary from structured notes. The run-level issue is not simply whether the model is approved in principle, but whether this specific run was conducted under the right controls for a clinically sensitive task.

The proof object for that run would include the prompt template, the contextual data supplied, the model and version used, the time and user role, any policy restrictions, the generated draft, the clinician's amendments, and evidence of human review before release. Additional metadata might record whether patient identifiers were masked, whether the task was marked as high risk, and whether the model's output triggered any warning or escalation rule.

The affected RAIDT pillars are Responsibility, because role allocation and human sign-off matter; Auditability, because the run must be reviewable; Dependability, because the output must be reliable enough for clinical use; and Traceability, because the origin and handling of the output must be reconstructable. Interpretability may also be relevant where reviewers need to understand why the model was used and how the output was assessed. In this setting, the proof object improves governance readiness because it gives supervisors, auditors, and clinical governance leads a concrete basis for checking whether the run was controlled appropriately.

Detailed link to RAIDT

Proof object links to RAIDT in four ways.

First, it operationalises RAIDT's core idea that governance should be based on evidence rather than assertion.
Second, it ties that evidence to the run as the unit of governance, so review is grounded in a specific use event.
Third, it provides the structured basis from which the evidence pack is assembled and the score profile is justified.
Fourth, it enables reviewability, contestability, audit readiness, and organisational learning because the evidential basis of judgement is visible to others.

Proof object -> Run-level evidence -> Evidence pack -> RAIDT score profile -> Governance readiness

In practice, the proof object is the point at which raw artefacts become governable evidence. Without that intermediate object, RAIDT would have data but a weaker basis for assessment and institutional learning.

Link to the five RAIDT pillars

Responsibility

The proof object supports Responsibility by showing who initiated the run, for what purpose, under which role, and with what human oversight or approval expectation.

Example evidence / implication:

Auditability

This is one of the strongest links. The proof object is a central mechanism for making the run auditable because it assembles evidence into a form a reviewer can inspect.

Example evidence / implication:

Interpretability

The proof object supports Interpretability when it clarifies the task context, the reason the model was used, and the basis on which the output was interpreted or accepted.

Example evidence / implication:

Dependability

The proof object supports Dependability by capturing whether required checks, validation steps, and fallback controls were applied during the run.

Example evidence / implication:

Traceability

This is another strong link. The proof object makes the run traceable by connecting the task, context, model, inputs, outputs, and governance actions.

Example evidence / implication:

The proof object affects all five pillars, but it is especially important for Auditability and Traceability because those pillars depend directly on the existence of structured reviewable evidence.

Why this item is more than a generic concept

In general AI governance, 'proof' may refer loosely to assurance documents, compliance claims, or supporting records. In RAIDT, a proof object is more specific and more operational: it is the structured evidential object for one run, designed to support reconstruction, scoring, challenge, and review.

That RAIDT meaning is stronger because it is tied to run-level evidence rather than to abstract organisational claims. The concept therefore does real governance work. It helps determine whether evidence is sufficient, whether controls can be examined, and whether a score profile is defensible in practice.

Common misunderstanding

Misunderstanding

If an organisation has logs or screenshots, it already has a proof object.

Correction

Not necessarily. Logs and screenshots may be ingredients, but a proof object is the organised evidential form that makes those ingredients reviewable in relation to one run. For example, a screenshot of a model output does not by itself show the prompt context, the task purpose, the model version, the reviewer, or the control process. RAIDT requires those evidential elements to be assembled into an object that can support governance judgement, not merely retained as disconnected artefacts.

Boundary and limitation

A proof object does not prove that the model output is true, safe, lawful, or ethically acceptable in every respect. It also does not replace domain expertise, legal review, or substantive evaluation of the output itself. If underlying evidence is weak, missing, manipulated, or captured too late, the proof object will also be weak.

The concept therefore works only when evidence capture is timely, relevant, and sufficiently complete. RAIDT handles this limitation by linking the proof object to minimum metadata, evidence readiness, audit trail quality, and run-level review practices. In other words, the proof object is necessary for governance assessment, but it is only as strong as the evidential discipline behind it.

Implementation levels

Manual implementation

A researcher or small team can create a proof object manually by using a structured template for each run. The template can combine prompt text, output, screenshots, role information, timestamps, review notes, and a brief explanation of what controls were applied.

Semi-automated implementation

A semi-automated approach can pull metadata from run logs, insert standard fields automatically, and prompt reviewers to complete missing governance details. Templates, forms, and evidence checklists help standardise the proof object so that review quality is more consistent.

Fully automated implementation

At scale, a platform or orchestration layer can generate proof objects automatically by capturing run metadata, prompts, outputs, human-review events, policy flags, model identifiers, and workflow decisions into a structured governance record. Dashboards and governance pipelines can then use those proof objects to populate evidence packs, trigger scoring workflows, and support audit-ready reporting.

Practical use in the RAIDT project

In Paper 08 Foundations, the proof object helps explain the theoretical move from principle-based AI governance to run-level evidential governance. In Paper 09 Empirical Validation, it provides a concrete unit for examining whether reviewers can assess runs consistently when structured evidence is available. In Paper 10 Policy Pathways, it supports translation from framework language into implementation expectations for institutions and regulators.

Across sector playbooks, the proof object can be adapted to domain-specific evidence needs while keeping the same RAIDT logic. Within the evidence pack and scoring rubric, it provides the evidential basis for assigning and defending scores. In influence methods and governance interventions, it offers a practical mechanism for improving organisational review practices. For supervision meetings, viva defence, and journal positioning, it gives a precise answer to the question, 'What does RAIDT actually produce that ordinary governance frameworks do not?'

Key audience questions to prepare for

Q1. Why not just call this an evidence pack?

Because the proof object emphasises the structured evidential logic of the pack. It highlights that RAIDT is not merely collecting files; it is constructing a reviewable object that can support judgement, challenge, and scoring for one run.

Q2. Is the proof object the same for every domain?

Its core logic is the same, but its evidential content varies by context. A healthcare proof object may need clinical review markers and privacy controls, while a finance proof object may need approval, escalation, and record-retention evidence.

Q3. Can a proof object exist if some data are missing?

Yes, but it may be a weak proof object. Missing evidence becomes visible and affects confidence, scoring, and governance readiness. RAIDT is useful partly because it exposes those gaps rather than hiding them.

Q4. Does a proof object replace human judgement?

No. It supports human judgement by giving reviewers a defensible evidential basis. It makes review better structured, more transparent, and easier to challenge, but it does not remove the need for expert interpretation.

Q5. Why is this important for viva or policy discussion?

Because it gives a concrete answer to the question of how abstract governance principles become inspectable practice. The proof object is a tangible mechanism that connects RAIDT's theory to implementable governance operations.

Suggested citation concepts to support this item
Short explanation for presentation

A proof object is RAIDT's structured evidential form for one GenAI run. Instead of asking reviewers to trust general claims that a system is governed well, RAIDT asks what can actually be shown about a specific use event. The proof object brings together the prompt, output, model details, task context, metadata, review actions, and control markers needed to inspect that run properly. This matters because governance fails when evidence is fragmented, partial, or only described after the fact. By turning run evidence into a reviewable object, RAIDT makes scoring more defensible, challenge more meaningful, and audit readiness more practical. In short, the proof object is how RAIDT converts scattered artefacts into operational governance evidence.

One-line takeaway

Proof object is the structured, reviewable evidential form of a run because RAIDT turns governance claims into run-level evidence that can be inspected, challenged, and scored.

Related items in run-level evidence logic
Anchored questions

The original note did not contain a separate anchored-questions list to preserve.

Powered by Forestry.md