NEWSLETTER
OpenAI has launched a Christmas miracle on day 6 of its “12 Days of OpenAI” series by giving vision to ChatGPT! Yes, OpenAI has introduced vision capabilities to ChatGPT, upgrading the existing voice chat feature to “advanced voice mode with vision.” This viewing feature allows users to have a video chat with ChatGPT and even share their screens while in voice chat. These new features expand ChatGPT's range of use cases, especially for getting real-time help on the go. In this article, we will first learn how to access these new features in ChatGPT and then explore some of its various applications.
Also read: 12 days of OpenAI: bring ai to your vacation
How to access ChatGPT advanced voice mode with Vision
This is how you can access the advanced voice mode with vision in ChatGPT.
- Log in to ChatGPT
Open ChatGPT and sign in to your Pro or Plus account.
- Start a voice chat
Now click on the voice chat icon next to the microphone icon in the bottom right corner to start a voice chat.
- Start a video chat
a) To start a video chat, click the camera icon in the lower left corner of the voice chat window.
b) To share your screen with ChatGPT, click on the 3 dots and choose the 'Share screen' option.
Now that we've all had access to ChatGPT's advanced voice mode with vision, let's find out what we can do with it.
Applications of the latest ChatGPT features
1. Everyday tasks made simple
ChatGPT is now just a video chat away to help you with any of your daily activities. Do you need to fix your printer? Need guidance cooking something? Do you want to remove that coffee stain from your shirt? ChatGPT can help you with all that! It can tell you how to do it and guide you every step of the way, using its advanced voice with vision mode.
It can even help you with more complex things and difficult situations. Imagine your car breaks down in the middle of nowhere and you can't find help. It can start a video chat with ChatGPT, show you your flat tire or open hood of your car, and it can help you find the problem and fix it! Likewise, if you need help assembling a new IKEA piece of furniture, ChatGPT can guide you with tutorials and instructions via video chat.
Also Read: 7 Out-of-the-Box ChatGPT Messages You Can Try Today
2. Your new best friend
ChatGPT is growing into a daily and always-available companion for people of all ages and backgrounds. Now, with screen sharing, you can ask it for suggestions before you do almost anything on your phone. Plus, the advanced voice mode with vision makes you feel like you're video calling your friend, ChatGPT. So, can ChatGPT be your new best friend? Probably! Imagine having a friend who you know will always take your call and help you, no matter what time it is or what mess you're in. Isn't it just wonderful?
3. Role play with ChatGPT
ChatGPT, which until now was only dedicated to preparing meeting agendas and taking notes, has now become a useful colleague. Using advanced voice mode with vision, you can now virtually join your office meetings and be a part of their brainstorming activities. Once you introduce all members in the meeting, ChatGPT can communicate like one person in the room, taking the names of your colleagues and evaluating the ideas being discussed.
The advanced voice mode with vision function also helps ChatGPT role-playing in other situations. Now you can coach and help you prepare for a job interview, a debate, or even a spelling bee, just like a friend or coach. You can be your quiz or interviewer and ask them questions, grade your answers, guide you to the correct answer when you get it wrong, and help you with tips to improve. A few such practice rounds in video chat with ChatGPT and you'll be ready to ace any interview!
4. Virtual Teaching Assistant
ChatGPT's advanced vision-based speech mode can be a great help for both students and teachers. ChatGPT can now help you solve a math or science problem in real time as you try to solve it in video chat, guiding you through each step of the calculation. It's like having a personal tutor who is always available to you and can explain things to you based on your needs and level of understanding. Isn't it great?
5. Personal stylist
Not sure what to wear today? ChatGPT can be your personal stylist, helping you dress and accessorize yourself! Simply open ChatGPT's advanced voice mode with vision and take a look at your wardrobe. The chatbot will see what you have, analyze all the possible combination options, and suggest some of the best options. Voila! A simple video chat and you'll probably be set for the whole week!
With this new feature, ChatGPT on your mobile phone can now act as a smart virtual mirror, offering you makeup and hair styling suggestions. It can help you choose the right look, choose the right shade of makeup, and even guide you on how to apply it. It can also send you links to makeup and hair tutorials and guide you through them. The seamless interface makes video chatting like looking into a selfie camera and talking to a friend!
6. Personal trainer
With the New Year just around the corner, I'm sure at least some of you are planning to hit the gym starting in January. But how many of you are sure that you will be consistent in it? Finding time, getting dressed, and going to the gym to exercise can be difficult for some of us, given our busy schedules. How about having a virtual personal trainer who trains you at home and at your convenience? Sounds like the perfect fitness mantra to me!
Well, thanks to the new advanced voice mode with vision, ChatGPT can be your personal fitness trainer at home. It can tell you what exercises to do and guide you in real time, while you do them via video chat. It can watch your movements, correct your mistakes, customize your exercise regimen to your ability, and even motivate you to keep going when you feel like giving up.
Also read: 5 ChatGPT prompts to help achieve New Year's resolutions
7. Design your houses using ChatGPT
Interior design and home decoration are now a piece of cake, thanks to ChatGPT's advanced voice mode with vision. All you have to do is enter a room with the camera on, while in ChatGPT voice chat, and ask the chatbot to design the space for you. ChatGPT, now with vision capabilities, will observe the room, analyze spaces and suggest interior decorating ideas. It can tell you which furniture and accessories go well with which floors and walls. It can also tell you which stores (both online and offline) to buy the suggested decor items from.
8. Social media guide
ChatGPT's new screen sharing feature in voice chat is really useful for receiving suggestions and performing everyday tasks on your mobile phone. Let me show you a very simple everyday use case. I often find it difficult to write captions for the images I post on social media. Now, with ChatGPT's vision-powered advanced voice mode, I can share the image on my screen with the chatbot, and it can tell me a suitable title, with all the right hashtags and jazz!
This way, you can share your screen while voice chatting with ChatGPT and get help replying to messages, writing emails, commenting on social media, troubleshooting, and more. You can even open an image on your screen, share it with ChatGPT, and ask for editing suggestions. The chatbot can tell you exactly what changes to make and guide you through each step, while creating the perfect image!
Also Read: Using ChatGPT to Create YouTube Video Titles and Descriptions
Final thoughts
OpenAI has really upped its game with the new ChatGPT-enabled advanced voice mode. From helping with homework and designing clothes to designing houses and solving everyday problems, it seems like there's almost nothing she can't do. These updates make ChatGPT more than just a chatbot: it's like having a helpful and trustworthy virtual friend!
That said, while it's exciting to see how easy life can be with these features, it's also important to be vigilant. Sharing too much information or completely relying on a chatbot for everything may not be the best idea. Do we really need a chatbot to tell us how to text a friend or decide what to eat? After all, as amazing as ChatGPT is, it's still a virtual assistant, not a real person. So enjoy these new features, but use them wisely and let ChatGPT be the useful help you need, not the one you can't live without!
Frequently asked questions
A. No, Advanced Voice Mode comes with ChatGPT paid plans: Plus and Pro.
A. Yes, with its latest update, you can now chat with ChatGPT over video and get help with a variety of tasks.
A. No, it can only help you write your emails and messages; you still have to press the send button.
A. No, it cannot. You have to change the advanced voice mode with Vision to allow chatGPT to “see” things around you. To allow chatGPT to read your messages, you will need to use its “screen sharing” feature.
A. You can use chatGPT's advanced voice mode to select your outfit for the day, guide you through a recipe, assemble a new piece of furniture, help you prepare for an interview, and more.
A. To access advanced voice mode in ChatGPT, make sure you have an active paid subscription. Simply log into your account and select the voice feature to get started. If you already have a subscription but can't access the feature yet, don't worry: OpenAI has announced that it will be rolling out to all paid subscribers in the coming days. However, for business accounts, this feature is planned to be available starting in 2025.
Sabreena Basheer is an architect turned writer who is passionate about documenting anything that interests her. He is currently exploring the world of artificial intelligence and data science as a content manager at Analytics Vidhya.
