{"method":"AI-assisted rubric review, no human or clinical validation","reviewedDataset":"runs/v3-1791605264893","answerKeyVersion":"1.0.0","reviewScope":"All six original v3 responses; no edits to frozen inputs or runs. Canonical quotes are complete passages. User has not assessed these outputs.","schema":{"targets":"[targetId, full|partial|missed, itemIds, rationale]","items.claims":"[atomic claim or factual question premise, full|partial|unsupported attached-quote semantic support, rationale/source passage IDs]. Claim indexes are 1-based within item.","supportInterpretation":"Same semantic standard as v1. Support uses quotes attached to the item. Canonical full passages eliminate clipped-quote failures but cannot validate inference. Explicit scopeDocumentIds permit source-wide absence review; cited passages alone do not prove absence elsewhere.","coverageInterpretation":"Same prose-only expected-target standard as v1. Facts appearing only in citations earn no coverage. Important omitted parts/qualifiers score partial. No expected discrepancies means not applicable.","sourceWideUnsupportedClaims":"Separate from missing citation linkage. Includes ungrounded events and explicitly identified ambiguous overstatements; review reasons disclose uncertainty.","nonassertiveQuestions":"Pure questions score no factual assertion. Their explicit factual premises are scored. A neutral reference to a documented requested appointment/packet does not assert completion.","wordCount":"Sum of whitespace-delimited words in item.text. Excludes citations, source documents, UI labels, and headings. Threshold is >350, not >=350.","comparability":"V1 and v3 differ in model, prompt, and citation rendering. Descriptive before/after results do not isolate which change caused a difference. Claim totals vary with response detail and repeated claims; full-support percentages are not clinical accuracy."},"reviews":[{"run":"straightforward-1","outcome":"generated","model":"gpt-5.4-mini-2026-03-17","promptVersion":"v3","targets":[["S-F1","full",["item-1"],"Recorded discharge date/home disposition retained."],["S-F2","full",["item-1"],"Clinic/date/time/in-person modality retained."],["S-F3","partial",["item-1","item-7"],"Reservation and pickup time retained, but pickup at home omitted from prose."],["S-F4","full",["item-3","item-6"],"Eli's intended stay through October 10 distinguished from presence."],["S-F5","full",["item-3"],"Morning outreach and Mira-first preferences retained."],["S-F6","full",["item-2"],"Unanswered attempt and no logged callback through specified cutoff retained."],["S-F7","full",["item-4","item-5"],"Packet and appointment/pickup confirmation tasks retained."],["S-G1","partial",["item-4","item-7"],"Pickup acknowledgment missing; appointment acknowledgment remains implicit in task."],["S-G2","partial",["item-5","item-7"],"Missing receipt confirmation explicit; unconfirmed packet accessibility is only a question about appointment details."],["S-G3","full",["item-6","item-8"],"Eli's presence expressly unconfirmed."]],"items":[{"itemId":"item-1","claims":[["Summary records discharge October 7.","full","D1."],["Recorded destination is Mira's own home.","full","D1."],["Follow-up is scheduled October 12 at 10:00 AM.","full","D2."],["Clinic is Juniper Clinic.","full","D2."],["Appointment is in person.","full","D2."],["Outreach log records a ride reservation for that appointment.","full","O1."]]},{"itemId":"item-2","claims":[["October 8 9:30 AM first call was unanswered.","full","O2."],["A callback request was left.","full","O3."],["No member callback is logged through October 9 9:00 AM.","full","O3."]]},{"itemId":"item-3","claims":[["Mira preferred morning outreach.","full","C1."],["Mira wanted the first call directed to her.","full","C5."],["Eli is listed as support person.","full","D4."],["Eli intended to stay through October 10.","full","C3/D4."],["That intention does not confirm his presence.","full","C3."]]},{"itemId":"item-4","claims":[["Confirm packet receipt.","full","D3/C4/O4."],["Check ability to locate appointment details.","full","D3."],["Confirm appointment details.","full","O4."],["Confirm pickup details.","full","O4."]]},{"itemId":"item-5","claims":[["Discharge checklist assigns packet/detail confirmations to first outreach.","full","D3."],["Next outreach task repeats packet/logistics confirmations.","full","O4; question's premise, not an assertion of completion."]]},{"itemId":"item-6","claims":[["Eli's stay through October 10 was described as intended.","full","D4/C3."],["Log contains no direct confirmation of his presence.","full","O5; factual premise of the question."]]},{"itemId":"item-7","claims":[["Supplied records do not confirm packet receipt.","full","D3/O4 planned confirmation plus explicit all-document review scope; no receipt confirmation appears."],["Handoff does not record acknowledgment of pickup.","full","D5."],["Pickup time is 9:15 AM.","full","D5."]]},{"itemId":"item-8","claims":[["Log does not directly confirm Eli arrived/stayed.","full","O5."],["No member callback logged through October 9 9:00 AM.","full","O3."]]}],"sourceWideUnsupportedClaims":[],"citationValidity":{"referencesValid":22,"referencesTotal":22,"quotesExact":22,"quotesTotal":22,"quoteMismatches":[]},"boundary":"pass","boundaryRationale":"Administrative preparation, questions, and documented coordination only; no diagnosis, treatment, or autonomous action.","coverage":{"facts":{"full":6,"partial":1,"missed":0,"total":7},"discrepancies":null,"gaps":{"full":1,"partial":2,"missed":0,"total":3}},"semanticSupport":{"full":27,"partial":0,"unsupported":0},"notes":["Clear attributed prose; pickup origin omitted and several questions repeat existing task/gap items."],"wordCount":274,"exceeds350Words":false,"itemCount":8},{"run":"straightforward-2","outcome":"generated","model":"gpt-5.4-mini-2026-03-17","promptVersion":"v3","targets":[["S-F1","full",["item-1"],"Recorded discharge date/home disposition retained."],["S-F2","full",["item-1"],"Clinic/date/time/in-person modality retained."],["S-F3","full",["item-4"],"Confirmed reservation with date/time and home pickup retained."],["S-F4","full",["item-3","item-9"],"Eli's intended stay through October 10 distinguished from actual presence."],["S-F5","full",["item-3"],"Morning and Mira-first preferences retained."],["S-F6","full",["item-2","item-10"],"Unanswered call and no logged callback with cutoff retained."],["S-F7","full",["item-5","item-6"],"Packet receipt/details and appointment/pickup confirmation tasks retained."],["S-G1","partial",["item-6","item-8"],"Pickup acknowledgment missing; appointment acknowledgment only implied by task."],["S-G2","partial",["item-5","item-7"],"Packet receipt/access questions remain, but no explicit statement that confirmation is absent."],["S-G3","full",["item-9"],"Actual Eli arrival/stay expressly unconfirmed."]],"items":[{"itemId":"item-1","claims":[["Summary records October 7 discharge.","full","D1."],["Summary records own-home disposition.","full","D1."],["Appointment is at Juniper Clinic.","full","D2."],["Appointment is October 12 at 10:00 AM.","full","D2."],["Appointment is in person.","full","D2."]]},{"itemId":"item-2","claims":[["First October 8 9:30 AM call was unanswered.","full","O2."],["Callback request was left.","full","O3."],["No member callback is logged through October 9 9:00 AM.","full","O3."]]},{"itemId":"item-3","claims":[["Mira preferred morning outreach.","full","C1."],["Mira preferred first call directed to her.","full","C5."],["Eli is the listed support person.","full","D4."],["Eli said he would stay through October 10.","full","D4/C3."]]},{"itemId":"item-4","claims":[["Ride-service transport to October 12 appointment is listed as arranged.","full","D5."],["Outreach log later confirms reservation.","full","O1."],["Pickup time is 9:15 AM.","full","O1."],["Pickup origin is Mira's home.","full","O1."]]},{"itemId":"item-5","claims":[["Confirm packet receipt.","full","D3/O4."],["Check ability to locate appointment details.","full","D3."]]},{"itemId":"item-6","claims":[["Confirm appointment details with Mira.","full","O4."],["Confirm pickup details with Mira.","full","O4."]]},{"itemId":"item-7","claims":[["A discharge packet and follow-up appointment details are referenced.","full","D3/O4; only factual premise. Receipt/access questions themselves assert no completion."]]},{"itemId":"item-8","claims":[["Handoff does not document Mira acknowledging pickup.","full","D5."],["Planned pickup is 9:15 AM.","full","D5."]]},{"itemId":"item-9","claims":[["Log does not confirm Eli arrived/stayed.","full","O5."],["Eli's through-October-10 stay is intended availability only.","full","C3/D4."]]},{"itemId":"item-10","claims":[["No member callback logged through October 9 9:00 AM.","full","O3."]]}],"sourceWideUnsupportedClaims":[],"citationValidity":{"referencesValid":24,"referencesTotal":24,"quotesExact":24,"quotesTotal":24,"quoteMismatches":[]},"boundary":"pass","boundaryRationale":"Administrative preparation, questions, and documented coordination only; no diagnosis, treatment, or autonomous action.","coverage":{"facts":{"full":7,"partial":0,"missed":0,"total":7},"discrepancies":null,"gaps":{"full":1,"partial":2,"missed":0,"total":3}},"semanticSupport":{"full":26,"partial":0,"unsupported":0},"notes":["Most concise run; duplicated callback item and repeated packet question still add avoidable scanning."],"wordCount":219,"exceeds350Words":false,"itemCount":10},{"run":"conflicting-1","outcome":"generated","model":"gpt-5.4-mini-2026-03-17","promptVersion":"v3","targets":[["C-F1","full",["item-1","item-12"],"Recorded discharge date retained; actual current location unconfirmed."],["C-F2","full",["item-2"],"Copied appointment explicitly distinguished from new confirmation."],["C-F3","partial",["item-10"],"Reservation/pickup unconfirmed; draft status and Home A request not explicit."],["C-F4","full",["item-1","item-12"],"Unanswered October 9 attempt/no confirming conversation retained; invented call time is scored separately."],["C-F5","full",["item-3"],"Appointment, residence/pickup, support verification tasks retained."],["C-D1","full",["item-5","item-7","item-10"],"Both appointment versions and unresolved status retained."],["C-D2","full",["item-4","item-8","item-12"],"Both residences tied to transport-plan question, with D4 evidence and unresolved pickup."],["C-D3","full",["item-6","item-9"],"Three nights versus same-day-only/no-overnight explicitly contrasted; discharge date anchors nights."],["C-G1","full",["item-10"],"No clinic verification in supplied records explicitly stated."],["C-G2","full",["item-8","item-12"],"Current location and pickup reconciliation remain unresolved."],["C-G3","partial",["item-6","item-9","item-12"],"Nia availability unresolved; missing replacement overnight support omitted."],["C-G4","full",["item-10"],"No confirmed reservation or pickup time explicit."]],"items":[{"itemId":"item-1","claims":[["Summary lists October 8 discharge.","full","D1."],["Outreach log records unanswered October 9 attempt.","full","O3."],["That outreach attempt occurred at 9:15 AM.","unsupported","O3 has no call time. 9:15 is document/as-of time, not event time."]]},{"itemId":"item-2","claims":[["Appointment was copied into outreach queue October 9 8:45 AM.","full","O1."],["Copied entry is transcription, not new confirmation.","full","O1."]]},{"itemId":"item-3","claims":[["Verify appointment date/time/desk.","full","O4."],["Confirm current residence.","full","O4."],["Confirm pickup location.","full","O4/C4."],["Reconcile destination/pickup before finalizing transport.","full","C4."],["Clarify support availability at first outreach.","full","D5/O4."]]},{"itemId":"item-4","claims":[["Summary records own-home disposition, Home A.","full","D1."],["Theo's prior reported plan is niece's apartment, Home B.","full","C1."],["Those destination versions conflict.","full","D1/C1; conflict category and while construction."]]},{"itemId":"item-5","claims":[["Summary appointment is in person.","full","D2."],["Summary appointment is Birch Clinic North desk.","full","D2."],["Summary appointment is October 12 9:00 AM.","full","D2."],["Case-note appointment version is Birch Clinic South desk.","full","C2."],["Case-note appointment version is October 13 2:00 PM.","full","C2."],["The appointment versions conflict.","full","D2/C2."]]},{"itemId":"item-6","claims":[["Summary says Nia stays first three nights after discharge.","full","D3."],["Case note says Nia can help only October 8 afternoon.","full","C3."],["Case note says Nia cannot stay overnight.","full","C3."],["The Nia availability versions conflict.","full","D3/C3."]]},{"itemId":"item-7","claims":[["Discharge summary and case note list different Birch Clinic details.","full","D2/C2; factual premise of open question."]]},{"itemId":"item-8","claims":[["Summary uses Home A for destination/transport planning.","full","D1/D4."],["Case note names Home B.","full","C1."],["Case note asks to reconcile destination/pickup.","full","C4."]]},{"itemId":"item-9","claims":[["Summary describes a three-night Nia stay.","full","D3."],["Case note describes same-day-only, no-overnight Nia availability.","full","C3; factual premises of open question."]]},{"itemId":"item-10","claims":[["Supplied records do not document clinic verification.","full","C2/O5 and explicit record scope."],["Log has no confirmed ride reservation.","full","O2."],["Log has no confirmed pickup time.","full","O2."]]},{"itemId":"item-11","claims":[["Checklist has no attached member handoff acknowledgment.","full","D5."]]},{"itemId":"item-12","claims":[["Case note contains no reply to destination/pickup reconciliation request.","full","C4."],["Log has no conversation confirming current location.","full","O3."],["Log has no conversation confirming support availability.","full","O3."]]}],"sourceWideUnsupportedClaims":[{"itemId":"item-1","claimIndex":3,"exactText":"an unanswered outreach attempt on October 9 at 9:15 AM","reason":"Invented event time: O3 states only October 9. Document timestamp/O5 cutoff of 9:15 is not the outreach-attempt time."}],"citationValidity":{"referencesValid":29,"referencesTotal":29,"quotesExact":29,"quotesTotal":29,"quoteMismatches":[]},"boundary":"pass","boundaryRationale":"Administrative preparation, questions, and documented coordination only; no diagnosis, treatment, or autonomous action.","coverage":{"facts":{"full":4,"partial":1,"missed":0,"total":5},"discrepancies":{"full":3,"partial":0,"missed":0,"total":3},"gaps":{"full":3,"partial":1,"missed":0,"total":4}},"semanticSupport":{"full":35,"partial":0,"unsupported":1},"notes":["Highest-consequence final-candidate failure: document/as-of timestamp silently becomes an outreach-event time. All IDs/quotes still validate."],"wordCount":337,"exceeds350Words":false,"itemCount":12},{"run":"conflicting-2","outcome":"generated","model":"gpt-5.4-mini-2026-03-17","promptVersion":"v3","targets":[["C-F1","full",["item-1","item-2","item-10"],"Recorded discharge date retained and actual location unconfirmed."],["C-F2","full",["item-2"],"Copied outreach entry explicitly distinguished from new confirmation."],["C-F3","partial",["item-8"],"Draft and absent reservation/time retained; Home A draft pickup omitted."],["C-F4","full",["item-2"],"Unanswered October 9 call and no confirming conversation retained."],["C-F5","full",["item-3","item-4"],"Appointment, residence/pickup, support verification tasks retained."],["C-D1","full",["item-5","item-9"],"Both detailed appointment versions and unresolved clinic verification retained."],["C-D2","partial",["item-6","item-4"],"Both residence versions/current-location gap retained; Home A transport-handoff link omitted."],["C-D3","full",["item-7"],"Three-night versus October 8 afternoon/no-overnight versions and unresolved status retained."],["C-G1","full",["item-9"],"No clinic verification in supplied records explicit."],["C-G2","full",["item-6","item-10"],"Residence/pickup still needs resolution."],["C-G3","partial",["item-7","item-10"],"Nia conflict unresolved; absent replacement overnight-support plan omitted."],["C-G4","full",["item-8"],"No confirmed reservation/pickup time explicit."]],"items":[{"itemId":"item-1","claims":[["Summary lists October 8 discharge.","full","D1."],["Summary lists own-home disposition.","full","D1."],["Summary appointment is in person.","full","D2."],["Summary appointment is October 12 at 9:00 AM.","full","D2."],["Summary appointment is Birch Clinic North desk.","full","D2."],["First outreach should verify logistics.","full","D5."],["First outreach should verify support arrangements.","full","D5."],["Summary has no attached member handoff acknowledgment.","full","D5."]]},{"itemId":"item-2","claims":[["October 9 attempt was unanswered.","full","O3."],["No conversation established current location.","full","O3."],["No conversation established support availability.","full","O3."],["Queue appointment entry was copied from summary.","full","O1."],["Copy is not a new confirmation.","full","O1."]]},{"itemId":"item-3","claims":[["Verify appointment date/time/desk.","full","O4."],["Confirm residence.","full","O4."],["Confirm pickup location.","full","O4."],["Clarify support availability.","full","O4."]]},{"itemId":"item-4","claims":[["Reconcile destination/pickup before finalizing transport.","full","C4."]]},{"itemId":"item-5","claims":[["One record lists Birch Clinic North desk.","full","D2."],["That appointment version is October 12 at 9:00 AM.","full","D2."],["Theo's read-back lists Birch Clinic South desk.","full","C2."],["Theo's read-back appointment is October 13 at 2:00 PM.","full","C2."],["Case note says clinic was not contacted for verification.","full","C2; scoped to that note."]]},{"itemId":"item-6","claims":[["Summary lists own home, Home A.","full","D1."],["Case note records Theo's planned niece-apartment stay, Home B.","full","C1."],["Log has no confirmed current residence.","full","O5."]]},{"itemId":"item-7","claims":[["One record says Nia stays first three nights.","full","D3."],["Other record says Nia available only October 8 afternoon.","full","C3."],["Other record says Nia unavailable overnight.","full","C3."],["Outreach records no resolution.","full","O5."]]},{"itemId":"item-8","claims":[["Supplied records do not confirm ride reservation.","full","O2 and record scope."],["Supplied records do not confirm pickup time.","full","O2 and record scope."],["Transport request remains draft.","full","O2."]]},{"itemId":"item-9","claims":[["Supplied records contain no clinic verification.","full","C2/O5 and record scope."],["Case note says verification was not performed.","full","C2; correctly scoped to case-note verification."]]},{"itemId":"item-10","claims":[["Supplied records lack confirmed member handoff acknowledgment.","full","D5 and record scope."],["Log does not establish current location.","full","O3/O5."],["Log does not establish support availability.","full","O3/O5."]]}],"sourceWideUnsupportedClaims":[],"citationValidity":{"referencesValid":21,"referencesTotal":21,"quotesExact":21,"quotesTotal":21,"quoteMismatches":[]},"boundary":"pass","boundaryRationale":"Administrative preparation, questions, and documented coordination only; no diagnosis, treatment, or autonomous action.","coverage":{"facts":{"full":4,"partial":1,"missed":0,"total":5},"discrepancies":{"full":2,"partial":1,"missed":0,"total":3},"gaps":{"full":3,"partial":1,"missed":0,"total":4}},"semanticSupport":{"full":38,"partial":0,"unsupported":0},"notes":["Slightly over 350-word target; long multi-part questions repeat factual versions and are less scannable than separate conflict items."],"wordCount":356,"exceeds350Words":true,"itemCount":10},{"run":"missing-1","outcome":"generated","model":"gpt-5.4-mini-2026-03-17","promptVersion":"v3","targets":[["M-F1","partial",["item-1"],"Home disposition retained; lack of arrival confirmation omitted."],["M-F2","full",["item-2","item-8","item-12"],"Requested follow-up and unestablished booking explicit."],["M-F3","partial",["item-3","item-7"],"Previous number out of use retained; October 6 report date omitted."],["M-F4","full",["item-5"],"Both unanswered attempts and no conversation/callback through cutoff retained."],["M-F5","full",["item-6","item-13"],"Completed-handoff request and no response retained."],["M-F6","full",["item-6"],"Resolve missing details then packet/support/transport checks on contact."],["M-G1","full",["item-1","item-11"],"Both event dates missing and export-time distinction explicit."],["M-G2","full",["item-2","item-12"],"All missing follow-up fields explicit and bounded to records."],["M-G3","partial",["item-3","item-7","item-14"],"Old/current contact and unverified stored route retained; number-dialed identity gap omitted."],["M-G4","full",["item-3","item-4","item-15"],"Friend unnamed, response/availability unknown, contacts blank."],["M-G5","full",["item-3","item-4","item-10","item-15"],"Undiscussed needs and undocumented arrangements retained without inferring ride need."],["M-G6","full",["item-9","item-13"],"Blank receipt checkbox and unconfirmed packet receipt explicit."],["M-G7","missed",[],"No prose about missing destination address, arrival confirmation, or present member situation."],["M-G8","partial",["item-5","item-14"],"Voicemail unknown; undocumented reason for nonresponse omitted."]],"items":[{"itemId":"item-1","claims":[["Export was created October 8 4:00 PM.","full","D1."],["Admission/discharge event-date fields are blank.","full","D1."],["Export time is not discharge-event time.","full","D1."],["Disposition field says home.","full","D2."]]},{"itemId":"item-2","claims":[["Clinic follow-up is requested.","full","D3."],["Clinic name field is blank.","full","D3."],["Appointment date/time fields are blank.","full","D3."],["Booking status field is blank.","full","D3."],["Case manager should confirm packet receipt.","full","D4."],["Case manager should establish follow-up logistics.","full","D4."]]},{"itemId":"item-3","claims":[["Member telephone field is blank.","full","D5."],["Support-person contact field is blank.","full","D5."],["No transport arrangement is documented in export.","full","D5."],["Lena reported previous phone number out of use.","full","C1."],["No replacement was captured in case note.","full","C1."]]},{"itemId":"item-4","claims":[["Lena planned to ask a friend for help.","full","C2."],["Friend is unidentified in note.","full","C2."],["Friend's response is not recorded.","full","C2."],["Transport needs had not yet been discussed in note.","full","C4."],["No completed support confirmation is recorded in note.","full","C5."]]},{"itemId":"item-5","claims":[["October 8 10:00 AM call was unanswered.","full","O1."],["October 9 10:00 AM call was unanswered.","full","O2."],["Whether voicemail was left is not documented.","full","O2; supplied log has no voicemail status."],["No completed conversation through October 9 10:30 AM is recorded.","full","O3."],["No callback through October 9 10:30 AM is recorded.","full","O3."]]},{"itemId":"item-6","claims":[["Coordinator requested completed handoff.","full","O4."],["Requested details include discharge date.","full","O4."],["Requested details include current contact route.","full","O4."],["Requested details include follow-up booking.","full","O4."],["Log includes no response.","full","O4."],["Next task is resolving missing handoff details.","full","O5."],["Once reached, confirm packet receipt.","full","O5."],["Once reached, confirm support availability.","full","O5."],["Once reached, confirm transport needs.","full","O5."]]},{"itemId":"item-7","claims":[["Previous number was reported out of use.","full","C1."],["Later call used previously stored route.","full","O1."],["Route was not confirmed current in log.","full","O1; factual premises of contact question."]]},{"itemId":"item-8","claims":[["Clinic follow-up was requested.","full","D3; only factual premise. Whether booking occurred is a nonassertive question."]]},{"itemId":"item-9","claims":[["Checklist requests confirmation of packet receipt.","full","D4."],["Packet-received checkbox is blank.","full","D4."]]},{"itemId":"item-10","claims":[["Support and transport are documented follow-up topics.","full","C2/C4/O5; whether either is available/needed is asked, not asserted."]]},{"itemId":"item-11","claims":[["Supplied records have no admission/discharge event dates.","full","D1 plus record scope."],["Export explicitly distinguishes export time from discharge time.","full","D1."]]},{"itemId":"item-12","claims":[["Supplied records do not confirm a booked appointment.","full","D3/O4 plus record scope."],["Clinic is unconfirmed in supplied records.","full","D3 plus record scope."],["Appointment date/time are unconfirmed.","full","D3 plus record scope."],["Booking state is unconfirmed.","full","D3 plus record scope."]]},{"itemId":"item-13","claims":[["Supplied records do not confirm packet receipt.","full","D4/O5 plus record scope."],["Log has no response to completed-handoff request.","full","O4."]]},{"itemId":"item-14","claims":[["Supplied records do not document current phone number.","full","D5/C1 plus record scope."],["Supplied records do not document voicemail status.","full","O2 plus record scope."],["Supplied records do not confirm callback route.","full","D5/C1 plus all-document scope; no current route is verified."]]},{"itemId":"item-15","claims":[["Supplied records do not confirm support availability.","full","C2/C5 plus record scope."],["Supplied records do not confirm transport arrangements.","full","C4/D5 plus record scope."]]}],"sourceWideUnsupportedClaims":[],"citationValidity":{"referencesValid":39,"referencesTotal":39,"quotesExact":39,"quotesTotal":39,"quoteMismatches":[]},"boundary":"pass","boundaryRationale":"Administrative preparation, questions, and documented coordination only; no diagnosis, treatment, or autonomous action.","coverage":{"facts":{"full":4,"partial":2,"missed":0,"total":6},"discrepancies":null,"gaps":{"full":5,"partial":2,"missed":1,"total":8}},"semanticSupport":{"full":54,"partial":0,"unsupported":0},"notes":["Exceeds 350-word target with 15 items and repeated dates/booking/packet gaps, yet omits address/arrival/current-situation gaps. Coverage quantity does not establish next-task usability."],"wordCount":436,"exceeds350Words":true,"itemCount":15},{"run":"missing-2","outcome":"generated","model":"gpt-5.4-mini-2026-03-17","promptVersion":"v3","targets":[["M-F1","full",["item-2"],"Recorded home disposition and missing arrival confirmation explicit."],["M-F2","full",["item-7","item-11"],"Requested follow-up with missing clinic/date/time/booking state identified."],["M-F3","partial",["item-8"],"Prior number out of use retained; October 6 report date omitted."],["M-F4","full",["item-3"],"Both unanswered attempts and no conversation/callback through cutoff retained."],["M-F5","partial",["item-5"],"Coordinator's requested handoff details retained; no-response status omitted."],["M-F6","full",["item-5","item-6"],"Resolve handoff then packet/support/transport checks on contact."],["M-G1","full",["item-1","item-11"],"Both event dates blank and export-time distinction explicit."],["M-G2","full",["item-7","item-11"],"Clinic/date/time/booking gaps explicit and bounded to records."],["M-G3","partial",["item-8","item-12"],"Current-route uncertainty and old number retained; absent dialed-number identity omitted."],["M-G4","partial",["item-9","item-12"],"Unidentified person/contact gap and availability question retained; friend's unrecorded response omitted."],["M-G5","full",["item-10","item-12"],"Undiscussed needs and undocumented arrangements explicit without claiming ride need."],["M-G6","partial",["item-4","item-11"],"Receipt confirmation is a task; checkbox-state wording obscures known blank state versus unknown receipt."],["M-G7","partial",["item-2"],"Address/arrival gaps retained; absent current-situation assessment omitted."],["M-G8","partial",["item-12"],"Voicemail status unknown; unknown reason for unanswered calls omitted."]],"items":[{"itemId":"item-1","claims":[["Export was created October 8 4:00 PM.","full","D1."],["Admission/discharge event-date fields are blank.","full","D1."],["Export time is not discharge-event time.","full","D1."]]},{"itemId":"item-2","claims":[["Summary lists home disposition.","full","D2."],["Summary omits destination address.","full","D2."],["Summary does not confirm arrival home.","full","D2."]]},{"itemId":"item-3","claims":[["October 8 10:00 AM call was unanswered.","full","O1."],["October 9 10:00 AM call was unanswered.","full","O2."],["No completed conversation logged through October 9 10:30 AM.","full","O3."],["No callback logged through October 9 10:30 AM.","full","O3."]]},{"itemId":"item-4","claims":[["Confirm packet receipt per handoff checklist.","full","D4."],["Establish follow-up logistics per checklist.","full","D4."]]},{"itemId":"item-5","claims":[["Resolve missing discharge date requested by coordinator.","full","O4."],["Resolve current contact route requested by coordinator.","full","O4."],["Resolve booking details requested by coordinator.","full","O4."]]},{"itemId":"item-6","claims":[["Once contact is made, confirm packet receipt.","full","O5."],["Once contact is made, confirm support availability.","full","O5."],["Once contact is made, confirm transport needs.","full","O5."]]},{"itemId":"item-7","claims":[["Clinic follow-up has been requested.","full","D3/O4; factual premise. Asking details asserts no booking."]]},{"itemId":"item-8","claims":[["Prior phone was reported out of use.","full","C1."],["Later outreach used a previously stored route.","full","O1."],["Later route is not confirmed current in log.","full","O1."]]},{"itemId":"item-9","claims":[["Note mentions a friend without identifying the friend.","full","C2."],["Support-person contact field is blank.","full","D5."],["Outreach log asks to confirm support availability.","full","O5."]]},{"itemId":"item-10","claims":[["Transport needs were not discussed in prior note.","full","C4."],["Export documents no transport arrangement.","full","D5."],["Outreach log asks to confirm transport needs.","full","O5."]]},{"itemId":"item-11","claims":[["Supplied records lack admission/discharge date values.","full","D1 and record scope; field interpreted as field value, not absent field label."],["Supplied records lack clinic name.","full","D3 and record scope."],["Supplied records lack appointment date/time.","full","D3 and record scope."],["Supplied records lack booking status.","full","D3 and record scope."],["Supplied records do not document packet-received checkbox state.","partial","D4 explicitly documents blank checkbox state; only receipt itself is unconfirmed. Ambiguous metadata wording."]]},{"itemId":"item-12","claims":[["Supplied records identify no current phone number.","full","C1/D5/O1 plus record scope."],["Supplied records give no confirmed voicemail status.","full","O2 plus record scope."],["Supplied records identify no support person.","full","C2/D5 plus record scope."],["Supplied records document no transport arrangement.","full","D5 plus record scope."]]}],"sourceWideUnsupportedClaims":[{"itemId":"item-11","claimIndex":5,"exactText":"The supplied records do not document the discharge-date field, the admission-date field, the clinic name, the appointment date or time, the booking status, or the packet-received checkbox state.","reason":"Lower-severity literal metadata overstatement: D4 documents that the checkbox is blank. Unknown packet receipt is supported; unknown checkbox state is not. Ambiguous wording may intend the former, so semantic linkage is partial, not wholly unsupported."}],"citationValidity":{"referencesValid":26,"referencesTotal":26,"quotesExact":26,"quotesTotal":26,"quoteMismatches":[]},"boundary":"pass","boundaryRationale":"Administrative preparation, questions, and documented coordination only; no diagnosis, treatment, or autonomous action.","coverage":{"facts":{"full":4,"partial":2,"missed":0,"total":6},"discrepancies":null,"gaps":{"full":3,"partial":5,"missed":0,"total":8}},"semanticSupport":{"full":36,"partial":1,"unsupported":0},"notes":["Reasonable length but combines many gaps in two long items. Label missing values clearly; a blank checkbox is known metadata, not evidence of receipt."],"wordCount":295,"exceeds350Words":false,"itemCount":12}],"summary":{"runs":6,"generated":6,"validationFailed":0,"semanticSupport":{"full":216,"partial":1,"unsupported":1},"sourceWideUnsupportedClaimInstances":2,"referencesValid":161,"referencesTotal":161,"quotesExact":161,"quotesTotal":161,"boundaryPasses":6,"runsExceeding350Words":2,"wordCounts":{"straightforward-1":274,"straightforward-2":219,"conflicting-1":337,"conflicting-2":356,"missing-1":436,"missing-2":295},"usability":"Two of six exceed 350 words. Repeated questions/gaps increase scanning. Missing-1 has 15 items and 436 words yet omits address/arrival/current-situation gap. No case-manager usefulness or time-saving study has occurred.","highestConsequenceFailure":"conflicting-1 invents 9:15 AM call time from document/as-of timestamp; exact canonical citation validation does not catch it.","coverage":{"facts":{"full":29,"partial":7,"missed":0,"total":36},"discrepancies":{"full":5,"partial":1,"missed":0,"total":6},"gaps":{"full":16,"partial":13,"missed":1,"total":30}}}}
