GPT-4o AI Model by OpenAI

Introduction

What is GPT-4o?

GPT-4o is a step towards much more natural human-computer interaction—it accepts as input any combination of text, audio, image, and video and generates any combination of text, audio, and image outputs.

How does GPT-4o work?

GPT-4o is a single new model trained end-to-end across text, vision, and audio, meaning that all inputs and outputs are processed by the same neural network.

Features of GPT-4o

• Responds to audio inputs in as little as 232 milliseconds, with an average of 320 milliseconds, which is similar to human response time in a conversation.
• Matches GPT-4 Turbo performance on text in English and code, with significant improvement on text in non-English languages.
• Much faster and 50% cheaper in the API compared to GPT-4 Turbo.
• Especially better at vision and audio understanding compared to existing models.

Model Evaluations

GPT-4o achieves GPT-4 Turbo-level performance on text, reasoning, and coding intelligence, while setting new high watermarks on multilingual, audio, and vision capabilities.

Model Safety and Limitations

GPT-4o has safety built-in by design across modalities, through techniques such as filtering training data and refining the model’s behavior through post-training. We have also created new safety systems to provide guardrails on voice outputs.

Model Availability

GPT-4o is our latest step in pushing the boundaries of deep learning, this time in the direction of practical usability. We spent a lot of effort over the last two years working on efficiency improvements at every layer of the stack. As a first fruit of this research, we’re able to make a GPT-4 level model available much more broadly.