Label a claim as supported, unresolved, or contradicted and choose the next verification step.
Recognize three different signals
Fluent wording tells you how an answer reads. It does not establish whether a claim matches the available evidence.
Stated confidence is what the system says about certainty. A percentage written in an answer is not automatically a measured probability of correctness.
Verified support comes from checking the relevant evidence. Therefore, ask what supports the claim before deciding how convincing it sounds.
Understand calibration carefully
Calibration concerns how confidence aligns with correctness across many assessed predictions. It cannot be established from one persuasive answer.
A hypothetical group of one hundred predictions all assigned eighty percent confidence would have about eighty correct outcomes under good calibration. Real assessments need sufficient data and a defined scoring method.
Research on calibration shows that confidence can require deliberate measurement and training. Results from one task or model do not guarantee trustworthy confidence elsewhere.
Identify the kind of uncertainty
Missing evidence means the needed fact is unavailable. The useful next step is to find an authoritative source or say the answer remains unknown.
Ambiguous instructions mean the task has more than one plausible interpretation. Ask a clarifying question before choosing one silently.
Conflicting sources require an authority or version decision. Averaging incompatible statements does not create a supported answer.
Read a fictional deadline claim
A fictional assistant says, “The application closes on Friday; I am ninety-five percent confident.” Its supplied notice gives no closing date.
The evidence status is unresolved because the provided source does not establish the deadline. The confidence statement adds no independent support.
A useful response identifies the missing date and requests the current application notice. Meanwhile, avoid turning the guessed deadline into published guidance.
| Evidence supplied | Label | Next step |
|---|---|---|
| Current notice explicitly says Friday | Supported by this source | Check the notice applies to this application |
| Notice contains no date | Unresolved | Find the authoritative deadline |
| Current notice explicitly says Thursday | Contradicted | Correct the Friday claim |
| Two current notices disagree | Conflicted | Ask the source owner to resolve authority |
Choose a proportionate response
The consequence helps determine how much checking is needed. A brainstorming suggestion and a published deadline require different evidence.
Useful abstention names the specific missing information. “The notice does not provide a date” gives the reader a clear next action.
Repeated agreement is not necessarily independent confirmation. Several generated answers may repeat the same unsupported assumption or underlying source error.
Practice: rewrite the uncertain answer
Your exercise rewrites the deadline response without inventing a date. Include the evidence status, missing information, and next check.
A second version uses a notice that explicitly states Thursday. Explain why the original claim should now be corrected rather than merely qualified.
A strong response separates confidence language from source support. Do not replace the original percentage with another unsupported number.
Compare with the worked answer
Worked answer: With no date in the notice: “The supplied notice does not state a deadline. Check the current application page or ask its owner.” With Thursday stated: “The notice says Thursday, so the earlier Friday claim is incorrect.” Confirm that the notice covers the same application.
What to carry forward
Label a claim as supported, unresolved, or contradicted and choose the next verification step.
Show your reasoning with the exercise above. Keep the evidence, the decision, and the remaining uncertainty together.