PIGENAI Live products·Verifiable artifacts·Founder-direct engagement
Founder’s notes

Evidence Over Attestation, Part Three: The Standard in Five Rules

The minimum a CEO should require of anyone, employee or partner, who builds with agents on the company's behalf. None of the five rules is technical. Each is a habit of responsibility toward the customer. Part Three of a four-part operating essay for CEOs, boards and founders.

Many thin white lines enter from the left and only one gold line reaches the centre of five concentric verification rings graduated from white to gold, ending at a solid gold seal. Attestation enters; evidence survives.

How to read this. Each rule opens with the rule itself. Behind the expander: what it protects the customer from, and how a CEO knows it is actually in force rather than on a poster.

The standard, in five lines

Key concept. Rules are how a standard survives the person who wrote it. These five are the floor, not the ceiling, for anyone who says “done” on your customers’ behalf, and a board can ask for evidence of each of them at the next review.

Read the five rules together
  1. Count before you conclude. The obvious narrative is a hypothesis, never a finding.
  2. Define “done” before the first instruction. In the customer’s terms, and before the work begins.
  3. Close only on outside-in proof. Internal tests inform; the artifact from the customer’s vantage point closes the case.
  4. Make courteous failures loud. A silent fallback converts your problem into your customer’s discovery.
  5. No artifact, no closure. Attestation is a claim; evidence is an artifact.

Rule 1. Count before you conclude

Key concept. The obvious narrative is a hypothesis, never a finding. When an agent, or a person, reports an incident, require the counts, the records and the timestamps before authorizing remediation. The customer is not helped by a fast answer to the wrong question.

Open the rule

What it protects the customer from. The bigger server bought to fix a traffic spike that was one open microphone. The restart applied to a service that was busy serving a customer. The remediation that treats the symptom the dashboard named and leaves the cause the customer is living with.

What it asks of your people. The discipline to pause at the moment of most pressure, when the story is plausible and the fix is one click away, and ask for the number. On the recorded day that pause took a minute and saved an evening, three times.

Boardroom mandate. Before approving any agentic deployment, the CEO or audit committee instructs the team to show the counts behind every claim in the proposal: the customers affected, the requests measured, the failures observed and their timestamps. A proposal that arrives with a narrative and no numbers goes back.

How you know it is in force. Your incident reviews begin with the counts, not the narrative. Nobody in the room is embarrassed to ask “how many,” and the person who asks is thanked rather than tolerated.

Rule 2. Define “done” before the first instruction

Key concept. Establish the external, independent proof of completion before the work begins, in terms of what the customer will experience. If an agent defines its own acceptance criteria, it will certify its own flaws, and so will a team that is allowed to.

Open the rule

What it protects the customer from. The feature that “works” in every test and fails the first stranger who lets go of a button to read a dialog. The report that “saves” but cannot reproduce itself. The gate that was written after the work, to fit the work.

What it asks of your people. To write the proof first, when it is cheap and uncomfortable, and to describe it from the customer’s side: what she will see, what she will be able to do, what will be true from outside the building. Drucker’s question applies here as everywhere: what does the customer consider value?

Boardroom mandate. No agentic initiative is funded without a written definition of done, in the customer’s terms, that a non-technical director could read, and that definition is dated before the first line of work. The committee keeps the definition and audits the close-out against it, not against the team’s summary.

How you know it is in force. Every piece of work your teams start has a written definition of done that a non-technical executive could read and a customer would recognize, and the definition predates the first line of work.

Rule 3. Close only on outside-in proof

Key concept. Internal unit tests, integration tests, telemetry and model evaluations are valuable. None of them gets to close the case. Only the externally observable production artifact does: validate against the live, running system, from the customer’s vantage point, against the version that is actually serving, not the one you proved last time.

Open the rule

What it protects the customer from. Nine hundred green tests that never met a stranger. A proof run against yesterday’s version. A health check that passes in the harness and times out in production because the harness never asked a slow question while the check was running.

What it asks of your people. To time the health check while the slowest request is in flight. To fetch the deployed page from outside and compare it to what was committed. To diff the saved report against the live one. To measure while the failure is happening, not after the system has cleaned up.

Boardroom mandate. Every production approval requires evidence gathered from outside the system: the customer-facing check, the timing taken during the slowest real request, the comparison of what is serving against what was approved. Internal test results and agent status reports are received as context, never as proof.

How you know it is in force. “Done” in your organization comes with an external artifact, not a status message: the fetch, the timing, the diff. Your leaders can produce it on request, and they are uneasy when a close-out arrives without one.

Rule 4. Make courteous failures loud

Key concept. Any silent fallback, unmonitored retry or polite error-swallowing mechanism that reports success is a defect, because it converts a problem you could have fixed into a problem your customer discovers. Treat internal fallbacks as hard operational failures.

Open the rule

What it protects the customer from. The channel that posted the same message three times while the dashboard smiled. The daily job that quarantined its own output and sent an email that read like a normal day. The rescue that worked so well nobody noticed what it was rescuing.

What it asks of your people. To distrust their own safety nets. A rescue path is a courtesy to the customer only if someone is told it fired. Every fallback exits loudly, every retry is counted, and the third identical retry is treated as a finding rather than a feature.

Boardroom mandate. The team inventories every fallback, retry and quarantine path in the agentic system and shows, for each, the alert that fires and the person who is paged. A path that fails quietly is treated as an open defect, and the committee asks when the last one fired and whether the customer was told.

How you know it is in force. You can list the fallbacks in your systems, each one has an alert attached, and the last time one fired, a person was paged and a customer was told before they noticed.

Rule 5. No artifact, no closure

Key concept. Attestation is a claim; evidence is an artifact. “Done” is not a status message or a verbal reassurance. It is an externally verifiable state, documented in live production, that an independent observer could verify.

Open the rule

What it protects the customer from. Everything above, compounded. An organization that closes work on a claim will, at machine speed, accumulate a portfolio of claims, and the customer is the one who eventually audits it.

What it asks of your people. A definition of “done” that does not bend to fatigue, deadline or an agent’s confidence. The identifier of the thing that is serving. The record of the check that was made against it. The willingness to say “not done” to a colleague, a partner, or a machine that has already said “done” three times.

Boardroom mandate. Nothing is reported to the board as complete without the artifact: the identifier of the version that is serving, the external check made against it, and the record of who verified it. A status of “done” without those three is recorded as “claimed,” and the distinction appears in the minutes.

How you know it is in force. Nothing in your company is marked complete without the artifact attached, and your leaders would rather delay a launch than close on a promise. The people you want feel physically uncomfortable typing “done” without it.

A standard is only a standard if it costs you something to uphold. The people you want are the ones who pay that cost before the customer does.

— Lindsay Hiebert, Founder, PIGENAI LLC · AI governance, security, AEO and networking

Continue to Part Four: Where the Real Moat Lives.

Lindsay Hiebert, Founder, PIGENAI LLC · AI governance, security, AEO and networking. PIGENAI LLC, in Kansas City, builds and operates products for AI governance, AI visibility and AI trust, alongside a family of story, verse and card products for people who want to become better. The products are at pigenai.com/products. The day this essay draws on is recorded in full in the companion founder’s note, “A Day in the Life of a Claude Code Maverick Founder.”

Evidence Over Attestation: The Executive Standard for Agentic AI
  1. The attestation trap
  2. The twelve disciplines
  3. The five operating rules (this part)
  4. Where the real moat lives
  5. The twenty-one-point standard

← Part 2: The twelve disciplines·Series overview·Part 4: Where the real moat lives →