OpenAI has announced a new update to its ChatGPT AI model, introducing new function calling capability in the Chat Completions API, updated and more steerable versions of gpt4 and gpt3.5turbo, and a 16k context version of gpt3.5turbo, which is 4 times longer than the standard 4k version. In addition, there is a 75% cost reduction on the state-of-the-art embeddings model and a 25% cost reduction on input tokens for gpt3.5turbo. OpenAI has also announced the deprecation timelines for the older models gpt3.5turbo0301 and gpt40314.
Developers can now describe functions to gpt-4-0613 and gpt-3.5-turbo-0613. The model then chooses to output a JSON object containing arguments to call those functions, a new way to more reliably connect GPT’s capabilities with external tools and APIs. Among the updates, gpt-4-0613 has an improved model with function calling, while gpt-4-32k-0613 has the same improvements as gpt-4-0613, along with an extended context length for better comprehension of larger texts.
OpenAI will invite many more people from the waitlist to try GPT-4 over the coming weeks. The waitlist will be removed entirely with this model. Gpt-3.5-turbo-0613 also comes with function calling as well as more reliable steerability via the system message. Its 16k context offers the model’s support for 20 pages of text in a single request.
OpenAI offers data privacy and security guarantees to customers. They own all outputs generated from their requests and the API data will not be used for training. They have reduced the cost of gpt-3.5-turbo’s input tokens by 25%, which developers can now use for just $0.0015 per 1K input tokens and $0.002 per 1K output tokens. Gpt-3.5-turbo-16k is priced at $0.003 per 1K input tokens and $0.004 per 1K output tokens.
OpenAI is reducing the cost of its most popular embeddings model, text-embedding-ada-002, by 75%, to $0.0001 per 1K tokens. OpenAI says customers could protect their applications by consuming information from trusted tools and adding user confirmation steps before performing real-world actions like sending an email, posting online, or making a purchase.
