Exam CCA-F Topic 1 Question 37 Discussion

Actual exam question for Anthropic's CCA-F exam
Question #: 37
Topic #: 1
An automated extraction pipeline reports 96% aggregate accuracy, but downstream users complain about frequent errors on complex contracts. What monitoring methodology resolves this visibility gap?

Suggested Answer: B Vote an answer

Aggregate accuracy metrics can mask severe per-document-type failures (e.g., contracts failing frequently while simple receipts succeed nearly 100% of the time). Tracking accuracy using stratified metrics (per document type and field) reveals these hidden failures.

by Wendell at Sep 13, 2026, 12:22 PM

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Nick name: Submit Cancel
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

0
0
0
10