Ahmadreza SamadiThe form was perfect. The answer was wrong.
A tidy shape and a true statement are different checks.
Original English animated explainer with synthetic-voice narration, English captions and the AS+a-samadi.com watermark. Noor, the studio, the supplier quote and the unsupported delivery date are fictional teaching devices, not a product demonstration or a measured model failure. Schema adherence is not a guarantee of factual accuracy; source and business-rule checks remain separate. Features, refusals and incomplete outputs require handling in the actual system.
Read the English film transcript
Noor runs a fictional design studio. She asks an AI to turn a supplier quote into a neat form: supplier, item, quantity and delivery date. The form comes back perfect. Every field is filled, and every value has the right format. But the delivery date
isn’t in the quote at all. That’s the difference between shape and truth. Some AI services offer structured outputs. OpenAI’s documentation says the feature ensures responses adhere to the schema you supply. A schema is the shape: which fields exist, and what kind of value
each one holds. The same documentation says structured outputs can still contain mistakes. In Noor’s atelier, every card fits its slot. But each slot also has a source lamp. The delivery date fits perfectly, and its lamp stays red. So run three separate checks. First,
is the format valid? Second, does each value match the source? Third, does it follow your business rules? If the information isn’t there, the right answer is unknown, not a guess. Leave room in the form for unknown, and send it to a person. Also
plan for the times an AI declines, or stops early. The documentation says refusals can be detected. Your system still has to handle them. And features differ between models and services, so check what your own setup actually supports. Noor checks the date against the
quote, marks it unknown, and asks the supplier. A tidy form is easier to check. It isn’t proof. Check the shape, the source, and the rules. Ahmadreza Samadi. More at a-samadi.com