Aipom data readiness audit

AIPOM Data Readiness Audit

What Is It

Assess whether named data is fit for a specific AI behavior and decision. Examine provenance, quality, coverage, representativeness, consent, privacy, access, freshness, change, and operational stewardship without collapsing critical gaps into an average score.

Why Use It

“We have the data” says nothing about whether it is lawful, representative, current, usable, or capable of supporting the intended behavior. Readiness is purpose-specific and must constrain the next decision.

When to Use It

Use before training, retrieval, evaluation, launch, or expanded use when data materially shapes behavior. This is not a legal, privacy, or security approval and should route those decisions to accountable specialists.

What It Produces

• Data-use boundary and readiness profile
• Evidence, assumptions, and critical gaps
• Allowed, constrained, prohibited, or deferred uses
• Remediation actions, owners, tests, and review date

Who Should Participate

Include the Product Manager, data owner and steward, engineering, domain experts, affected-user representation, and privacy, security, legal, or governance partners proportionate to the use.

Evidence to Bring

Bring behavior requirements, source maps, samples, lineage, collection purpose, consent or permission records, quality reports, subgroup coverage, freshness, transformations, access controls, incidents, and maintenance ownership.

How to Do It

1. Define the exact behavior, decision, population, environment, and consequence.
2. Inventory data sources, derivations, owners, permissions, and intended uses.
3. Examine completeness, accuracy, consistency, timeliness, duplication, and label quality.
4. Examine representativeness, affected groups, historical bias, missingness, and edge cases.
5. Verify provenance, collection context, consent, privacy, security, access, retention, and deletion obligations with accountable partners.
6. Assess drift, refresh, lineage, versioning, correction, and operational stewardship.
7. Identify critical gaps and specify which decisions they constrain.
8. Choose allowed, constrained, prohibited, or deferred use; avoid compensating averages.
9. Define remediation, evidence tests, owners, and re-audit triggers.

Key Concepts

• Readiness is fitness for a named purpose, not a reusable score.
• Missingness may encode who the system fails to see.
• Permission to access is not automatically permission for every AI use.
• Operational ownership matters after the first audit.

Organizational Applications

Use for retrieval, evaluation datasets, model adaptation, decision support, personalization, automation, and vendor data transfers.

Common Pitfalls

• Auditing a dataset without the intended behavior
• Using one readiness average
• Treating volume as representativeness
• Assuming historical labels are ground truth
• Omitting consent, deletion, or downstream use
• Writing remediation with no owner or decision consequence

Combine With

Use authoritative-source-map for trust and ownership, aipom-golden-dataset-builder for representative evaluation sets, and aipom-initiative-readiness-review for cross-category launch decisions.

Assets and Templates

• Data readiness audit template
• Synthetic worked example
• Weak example

Sources

• NIST, AI Risk Management Framework 1.0, January 26, 2023. Supports lifecycle data quality, representativeness, privacy, documentation, and risk-management considerations. Accessed July 16, 2026.

Completing this audit does not establish legal, privacy, security, or regulatory compliance.