Q168 - How_does_RAIDT_support_procurement

Q168 — How does RAIDT support procurement?

← RAIDT · Star S9 - Policy, Standards and Assurance · primary item: S9.07 · Procurement

Appears in sources
Answer

RAIDT supports procurement by giving buyers, risk teams, auditors, and operational users a common evidence object. The policy motivation paper argues that procurement teams comparing vendors need more than generic trust assurances, because governance obligations now arise simultaneously from law, standards, audit, and internal oversight. RAIDT answers this demand with a bounded, reviewable artefact: the run-level evidence pack, interpreted through a score profile. This enables supplier assurance in environments where organisations do not own the model directly and must rely on external providers or embedded platforms.

An additional strength is that RAIDT does not freeze procurement at model level. The audit and accountability paper explains that influence methods as governance interventions matter because structured prompting, retrieval augmentation, PEFT or LoRA, and preference-based alignment can change behaviour and the evidence that can be captured. Procurement therefore assesses configured use, not marketing claims about a base model. Because RAIDT uses the run as the unit of governance, buyers can compare workflows, teams, or providers on like-for-like evidence and can revisit those comparisons through audit sampling, exception handling, and post-incident review. In practice, RAIDT supports pre-award evaluation, contract design, and ongoing supplier monitoring by making governance readiness observable rather than merely asserted.

Practical example

A public hospital procures a summarisation service from two platform vendors that both use the same foundation model. Vendor X couples the model with retrieval against versioned clinical guideline snapshots and preserves clinician override logs. Vendor Y uses the same base model but does not preserve retrieval snapshots and has inconsistent prompt version control.

Because influence methods as governance interventions materially change the evidence profile, the hospital does not assume the two offerings are equivalent. It requests matched run-level evidence packs, compares the resulting score profile, and chooses the service with stronger Auditability and Traceability. After award, monthly sample runs are reviewed to confirm that the promised governance quality still holds in live use.

Sources in RAIDT papers
Powered by Forestry.md