Exam CCA-F Topic 1 Question 37 Discussion
Actual exam question for Anthropic's CCA-F exam
Question #: 37
Topic #: 1
Question #: 37
Topic #: 1
An automated extraction pipeline reports 96% aggregate accuracy, but downstream users complain about frequent errors on complex contracts. What monitoring methodology resolves this visibility gap?
Suggested Answer: B Vote an answer
Aggregate accuracy metrics can mask severe per-document-type failures (e.g., contracts failing frequently while simple receipts succeed nearly 100% of the time). Tracking accuracy using stratified metrics (per document type and field) reveals these hidden failures.
by Wendell at Sep 13, 2026, 12:22 PM
0
0
0
10
Comments
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
Report Comment
Commenting
You can sign-up / login (it's free).