ChatGPT Advanced Voice Mode With Vision Rolling Out to Paid Subscribers k6b25 Technology News

The real-time video feature in ChatGPT will let the AI access a smartphone’s camera to process the visual information. 3d1i1m

Written by Siddharth Suvarna | Updated: 13 December 2024 15:52 IST

ChatGPT Advanced Voice Mode With Vision Rolling Out to Paid Subscribers

Photo Credit: OpenAI 4j2q64

ChatGPT s can use the new Screenshare feature to send on their experience

Highlights

The vision feature is available to ChatGPT Plus, Team, and Pro s
ChatGPT vision is only available via the mobile apps
The feature will be rolled out to Enterprise and Edu s in early 2025

ment

unveiled in May during the company's Spring Updates event.

ChatGPT Gets Vision Capabilities 3k5h51

The new ChatGPT feature was rolled out on day six of OpenAI's 12-day feature release schedule. The AI firm has so far released the full version of the o1 model, the video generation Sora model, and a new Canvas tool. Now, with the Advanced Voice mode with Vision, s can let the AI see their surroundings and ask questions based on them.

Just in time for the holidays, video and screensharing are now starting to roll out in Advanced Voice in the ChatGPT mobile app. pic.twitter.com/HFHX2E33S8
— OpenAI (@OpenAI) December 12, 2024

In a demonstration, the OpenAI team interacted with the chatbot with the camera on, and introduced several people. After that, the AI could answer a quiz on those people even when they were not actively on the screen. This highlights that the vision mode also comes with memory, although the company did not specify how long the memory lasts.

s can use the ChatGPT vision feature to show the AI their fridge and ask for recipes or by showing their wardrobe and asking for outfit recommendations. They can also show the AI a landmark outside and ask questions about it. This feature is paired with the chatbot's low latency and emotive Advanced Voice mode, making it easier for s to interact in natural language.

Once the feature rolls out to s, they can go to the mobile app of ChatGPT and tap on the Advanced Voice icon. In the new interface, they will now see a video option, tapping which will give the AI access to the 's camera feed. Additionally, a Screenshare feature is also available which can be accessed by tapping the three dot menu.

Screenshare feature will enable the AI to see the 's device and any app or screen they go to. This way, the chatbot can also help s with smartphone-related issues and queries. Notably, OpenAI said that all Team subscribers will get access to the feature within the next week in the latest version of the ChatGPT mobile app.

Most Plus and Pro s will also get the feature, however, s in the European Union region, Switzerland, Iceland, Norway, and Liechtenstein will not get it at present. On the other hand, Enterprise and Edu s will get access to ChatGPT's Advanced Voice with Vision in eary 2025.

Comments

For the latest reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: App

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen ing his favourite football club - Chelsea, watching movies and anime, and sharing ionate opinions on food. More