Cost efficient structured outputs: - Near frontier quality structured extraction - Up to 99% cheaper - Up to 3x faster
We've been using it under the hood at Pacific. Today we're releasing it broadly as a research experiment.
It also bundles in a bunch of nice features to make the structured outputs more useful. You get citations with optional hosted citation urls with highlights, calibrated confidence values, and the option for zero data retention.
Time to build with structured outputs at scale!