Skip to main content
Worked examples

Collect and check compliance evidence

The assurance pattern that every regulated industry shares, worked through for hospital accreditation against the NSQHS Standards. The systems by layer, the work today, the same work with one agent, and the utility and energy variants.

By Murali SidLinkedInPublished Updated

A standard asks for proof by a date. Someone must collect records from many teams, check each one, and show which requirement it meets. Then a named person attests. The pattern is the same in hospitals, water and power utilities, and generators. This page works it through for a hospital network preparing for accreditation. Today a quality manager runs the work with spreadsheets and email. With an agent, collecting and checking move to the agent. A named person still attests, and a person still submits.

The pattern in any industry

Five moves repeat in every industry.

  1. Keep each requirement with its version and its original clause.
  2. Map shared checks, without losing any single obligation.
  3. Ask the team that owns each record for one specific item.
  4. Check the issuer, date, scope and completeness of what comes back.
  5. Give a reviewer a pack with every item linked to its source, and the gaps listed.
Five stages. Requirement: keep the clause and version. Shared check: preserve each obligation. Collect: ask the responsible teams, such as operations, IT and legal. Validate: check scope, date and source. Review: show coverage and unresolved gaps. A banner says collected documents do not automatically prove compliance.
From a requirement to evidence a reviewer can checkThe same five moves apply in every industry. Collecting a document does not show the requirement is met.Open image at full size ↗

The systems involved

The hospital case touches these layers. The healthcare page shows the full hospital estate.

How it runs today

Australian hospitals are assessed against the eight National Safety and Quality Health Service (NSQHS) Standards. They cover clinical governance, partnering with consumers, infection control and medication safety. They also cover comprehensive care, communicating for safety, blood management, and acute deterioration. Since 1 July 2023, assessments come at short notice, with at least 24 hours' warning (the Commission). A secondary summary says hospitals are reaccredited at least every three years. Internal audits, mock surveys and board reporting run between visits. In New Zealand, services are audited against Nga Paerewa, NZS 8134:2021.

Swimlanes for the quality team, the evidence owners, the accrediting agency and the systems. Step 1: the quality manager keeps the evidence register by hand. Step 2: owners are assigned for each standard. Step 3: owners export records from the learning, maintenance and incident systems, audits, policies and indicators. Step 4: the quality team checks by eye and chases gaps by email. Step 5: the quality manager uploads the self-assessment. Step 6: assessors visit and judge Met or Not Met. Step 7: owners fix gaps. Step 8: the quality unit reports to the board. A blue box under each step names the system it uses.
Hospital accreditation evidence todayThe register is kept by hand. Short notice means it must always be current.Open image at full size ↗

Handoffs. The quality team hands requests to every evidence owner and gets records back. Committees report to the quality team. The health service deals with the accrediting agency. The agency reports to the state health department and the Commission.

Where reporting comes in. Clinical indicator dashboards come from the data warehouse. Incident and risk reports come from the incident system. Board and committee papers carry the status. The agency reports the accreditation outcome.

Volumes and cycle time. There are eight standards. A large network holds many hundreds of evidence items (typical, unsourced). Before short notice, the big push came in the months before a planned visit. Now readiness must be continuous (typical, unsourced). Recent short notice assessments include Albury Wodonga Health in November 2025 and Cohuna District Hospital on 2 December 2025.

Pain points.

  • Evidence goes stale, and owners change.
  • One document serves several requirements, but its scope differs for each.
  • Screenshots have no date.
  • A policy on paper does not show the policy was followed.
  • Short notice means the register must always be current.
  • Training records name staff, so they are personal data.

How agents run it

One agent runs fixed steps. It collects and checks. It never marks a requirement Met.

Swimlanes for the agent, the quality manager, the standard leads, fixed rules, the systems and the evidence store. Step 1: the quality manager maps the register, with agent help, and approves every mapping. Step 2: the agent collects evidence on a schedule with read-only access. Step 3: fixed rules check each item, and the quality manager approves the rules. Step 4: the agent asks owners for gaps from approved templates. Step 5: it builds the pack. Step 6: the standard lead and executive sponsor review and attest. Step 7: the quality manager submits to the agency. Step 8: the agent builds a short notice evidence index, and the quality manager reviews it. Step 9: it tracks fixes, and action owners close their own actions. The evidence store keeps each pack, register history, request history and traces. A diamond marks each approval.
Hospital accreditation evidence with an agentA diamond marks each approval. A named person attests. The agent never files or signs.Open image at full size ↗

What stays with a person, and why.

  • Met or Not Met. That is the assessor's judgement.
  • Attesting the pack. It is a formal record a regulator relies on.
  • How to fix a gap. That is a management decision.
  • Anything about one staff member's performance. That is a decision about a person.
  • Submitting to the agency. It is a formal regulatory record.

Where the evidence is kept. The pack keeps a link to every source. The register history shows who mapped what, and when. Request history stays in ServiceNow, Teams or email. Agent traces sit outside the agent.

What changes in the systems.

  • The register becomes a structured store with status fields, in a risk and compliance tool or a SharePoint list.
  • Read-only connectors to the learning system, maintenance system, incident system and policy library.
  • Scheduled collection runs.
  • Requests tracked as tasks.
  • Training data used at ward level, unless a named record is needed.

What does not change. The accreditation scheme and its rules stay. The assessor still judges. The incident system stays the record of incidents. The committee structure stays.

Who does this today

No agent was found collecting NSQHS or Nga Paerewa evidence in an Australian or New Zealand health service.

The utility and energy variants

Water and power utilities. The obligations are many and specific. Examples are life support registration, hardship policies, guaranteed service level payments, vegetation clearance and drinking water quality. Most sit in an obligations register in a risk and compliance tool (ServiceNow IRM, Archer, Protecht). Few are linked to the system steps that meet them. Reporting runs from the data warehouse to the regulators. Energy retailers send quarterly data on hardship, payment plans and disconnections to the Australian Energy Regulator. Water utilities report to the state economic regulator, the health regulator and the environment regulator. In Victoria, water service levels sit in the Essential Services Commission's Water Industry Standard. The agent's steps are the same as above, with records from the billing, asset and work systems. No compliance agent was found at any named utility (line of business and OT findings, August 2026). An agent that reads protected system information may itself fall inside critical infrastructure rules. Confirm that before building.

Generators and resources. A generator keeps a performance standards compliance program under the National Electricity Rules. It also files environmental licence returns and National Greenhouse and Energy Reporting emissions reports. US generators keep evidence for the NERC reliability standards. Miners have licence conditions, statutory inspections, and tailings conformance under the Global Industry Standard on Tailings Management. A compliance coordinator keeps the obligations in a risk tool (SAI360, Enablon, ServiceNow IRM) or in Excel. Owners email PDFs from the asset system, the laboratory system and emissions monitoring. The coordinator checks dates, scope and signatures by eye. With an agent, the same five moves apply. A named person attests in the risk tool or the regulator portal. No deployment was found. AVEVA's PI Audit Reporter (May 2026) reviews audit trails. It is a report tool, not an agent [vendor].

Where this sits

The four questions place this agent.

  • Role. It coordinates. The domain is compliance and assurance.
  • Permissions. These are what its own credentials let it do. It reads, through read-only accounts, from the learning, maintenance and incident systems, the policy library and SharePoint. It writes evidence items, statuses, packs and requests. It sends requests inside the organisation only. Certificates from outside issuers are untrusted input. The highest data class is personal, since training records name staff.
  • Autonomy. It is designed and permitted for delegated tasks (A2) on the autonomy contract. The quality manager reviews every pack. Deciding how to close a gap drops to assisted (A1), where the owner decides.
  • Impact. It sits in the formal regulatory records zone of the deterministic zones. The agent drafts and assembles. A named person attests. The agent never files, signs or alters a record. The rule for decisions about people applies to anything about one staff member's performance.

It is Tier 3 (strict), because its pack feeds work a regulator relies on. It sends requests inside the organisation only. So it holds two parts of the Rule of Two, not three.

Its learning level is curated learning (L1). People choose which past reviews it learns from, and review each change before release. Changes go through the agent lifecycle.

It has its own identity (ID2) on the delegation chain. Policy is enforced outside the model: its accounts are read-only, and the register refuses an attestation from the agent. Of the seven capabilities, observability and audit trail does the most work. Every pack links to its sources, and the history sits where the agent cannot touch it.

Measure the result

Compare with the current register and the last cycle's evidence. Measure these:

  • Requirements with current, checked evidence.
  • Stale or wrong-scope evidence caught before review.
  • How often reviewers agree with the agent's status.
  • Duplicate requests to owners.
  • Hours of collection and review.
  • Time to produce the short notice index.

Do not count a collected document as a met requirement.

Start with a trial

Pick one standard at one hospital, such as medication safety. Use last cycle's register and the reviewers' own findings as the reference. Run the agent with no live requests first. Then let it send requests from approved templates, with the quality manager reviewing every pack. Register the agent with a named sponsor and owner before go-live.

Evidence and limits

No agent was found collecting compliance evidence in any of the three industries. The design is a proposal.

Three accreditation facts were not verified. They are the current NSQHS version, its number of actions, and the period to fix a Not Met action. The Commission's site timed out during research. The number of days a service can exclude comes from a search summary. Nga Paerewa audits were not checked.

The National Electricity Rules clause for the generator program was not re-checked. The utility obligations are examples from the obligations register, not a full list.

Next step

See the hospital estate these systems sit in. Or choose where to start.

Explore this topic

Research for this page was done on 15 October 2026.

Accreditation facts. The eight NSQHS Standards are Clinical Governance; Partnering with Consumers; Preventing and Controlling Infections; and Medication Safety. The others are Comprehensive Care; Communicating for Safety; Blood Management; and Recognising and Responding to Acute Deterioration. The names were checked against a secondary summary on 15 October 2026. A service can exclude up to 20 business days per cycle from short notice assessment. That figure comes from a search summary of the Commission's page. The Commission lists the approved accrediting agencies.

Sources.

Cite this page

Written by Murali Sid, Founder and AI Systems Architect, last updated 15 October 2026. Licensed CC BY-SA 4.0, so quote it freely with attribution.

Murali Sid (2026). Collect and check compliance evidence. Agentic Architecture Skills. https://www.agenticarchitectureskills.com/use-cases/compliance-evidence

Machine-readable version of this page: /use-cases/compliance-evidence.md

On this page