4.6 — Multi-Instance and Multi-Pass Review

CCAR-F Domain 4 · Task 4.6

What You Need to Know

The Self-Review Limitation

Same-session self-review retains the original reasoning chain and tends to confirm its own decisions. Use an independent instance (fresh session, no prior context) for review.

Multi-Pass Review Architecture

Large reviews suffer from attention dilution in a single pass (uneven depth, missed bugs, contradictory findings).

1. Pass 1 – Per-file local analysis: each file gets a focused independent review
2. Pass 2 – Cross-file integration: separate pass checks data flow, consistency, contradictions

Larger context windows do not fix attention quality.

Confidence-Based Routing

• High confidence → report directly
• Low confidence → human review
• Calibrate thresholds on labelled validation sets before automated routing

Key Concept: Independent instances for review. Split large reviews into per-file + cross-file passes. Calibrate confidence on labelled sets.

Production Architecture

1. Generation (instance A)
2. Per-file review (independent instances)
3. Integration review (separate instance)
4. Confidence routing
5. Calibration loop

Exam Traps

• Self-review in the same session
• Single pass for large multi-file reviews
• Switching to a larger context window to fix attention dilution
• Using uncalibrated confidence scores for automated routing