OpenAI Unveils GPT 53h3l 4 Turbo With Vision Capabilities in API and ChatGPT

OpenAI claims the improved vision capabilities will allow JSON mode and function calling. 5f4a3q

Written by Siddharth Suvarna | Updated: 10 April 2024 19:41 IST

OpenAI Unveils GPT-4 Turbo With Vision Capabilities in API and ChatGPT

Photo Credit: Unsplash/Levart_Photographer y696a

GPT-4 Turbo with Vision allows the model to take in images and answer questions about them

Highlights

The GPT-4 Turbo with Vision has a context window of 1,28,000 tokens
The OpenAI AI model has a knowledge cut-off of December 2023
AI coding assistant Devin is powered by GPT-4 Turbo Vision

ment

introduced a new feature that would allow s to edit DALL-E 3 generated images within ChatGPT.

The announcement was made by the official of OpenAI Developers, which said in an X (formerly known as Twitter) post, “GPT-4 Turbo with Vision is now generally available in the API. Vision requests can now also use JSON mode and function calling.” Later, the X of OpenAI also revealed that the feature is now available in API and it is being rolled out in ChatGPT.

GPT-4 Turbo with Vision is essentially the GPT-4 foundation model with the higher token outputs introduced with the Turbo model, and it now comes with improved computer vision to analyse multimedia files. The vision capabilities can be used in a variety of methods. The end , for instance, can use this capability by ing an image of the Taj Mahal on ChatGPT, and asking it to explain what material the building is made up of. Developers can take this a step ahead and fine-tune the capability in their tools for specific purposes.

OpenAI Used Data From YouTube Videos to Train GPT-4 AI Model: Report

OpenAI highlighted some of these use cases in the post. Cognition AI's Devin assistant, uses GPT-4 Turbo with Vision to see the complex coding tasks and its sandbox environment to create programmes.

Similarly, the Indian calorie tracking and nutrition platform Healthify has a feature called Snap where s can click a picture of a food item or a cuisine, and the platform reveals the possible calories in it. With GPT-4 Turbo with Vision's capabilities, it now also recommends what the should do to burn the extra calories or ways to reduce calories in the meal.

Notably, this AI model has a context window of 1,28,000 tokens and its training data runs up to December 2023.

Is the Samsung Galaxy Z Flip 5 the best foldable phone you can buy in India right now? We discuss the company's new clamshell-style foldable handset on the latest episode of Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

links may be automatically generated - see our ethics statement for details.

Comments

For the latest reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: AI

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen ing his favourite football club - Chelsea, watching movies and anime, and sharing ionate opinions on food. More