OpenAI: The new update and why the best way to use large language models is not what you think

Latency.

It’s a measure of how long it takes for an input to deliver an output. It may sound technical, but it is something that makes or breaks our interaction with new technologies like Artificial Intelligence. This is why OpenAI’s Spring Update was, at its core, all about reducing the gap between action and reaction.