Like other ChatGPT features, the vision is to help you with your daily life. He does better when he can see what you see.
This approach has drawn directly from our work with Be My Eyes, a free mobile app for blind and low vision people, to understand the uses and limitations. Users have told us that they find value in having general conversations about images that contain people in the background, such as someone appearing on the TV while you’re trying to figure out remote control settings.
We have also taken technical steps to significantly limit ChatGPT’s ability to analyze and make direct statements about people, as ChatGPT is not always accurate and these systems must respect people’s privacy.
Real-world usage and feedback will help us further improve these security measures while keeping the tool useful.