2.2 — Identifying Hallucinations, Inconsistencies and Bias

CCAO-F Domain 2 · Task 2.2

What You Need to Know

Three failure types, each with a different response:

Failure	Shape	Response
Hallucination	Fluent, specific, fabricated content not grounded in fact	Verify against an authoritative source
Inconsistency	Output disagrees with itself (prose vs table, recommendation vs findings)	Re-verify the whole output against its source
Bias	Skewed framing, assumptions or language (pattern across descriptions of people)	Rework the pattern, not a single word

Hallucination Risk Concentrates Where Grounding Is Thinnest

• Private internal systems/documents Claude was never given
• Very recent events
• Precise figures not in the source material
• Highest-risk shape: confident numbered instructions for an internal tool Claude has never seen

Claude can also hallucinate its own capabilities (claiming to have sent an email or produced an external file).

Bias

Most consequential in outputs about people. Read across descriptions rather than sentence by sentence. Apply the read-aloud test.

Exam Traps

• Trusting confident, step-by-step instructions for a private internal system
• Believing Claude’s claim to have sent an email or produced an external file
• Fixing the one contradiction you spotted and sending the rest
• Treating bias as one bad word to delete