ChatGPT has received a big upgrade to make it even more useful. Now this AI chatbot supports voice commands and image-based queries. Users will be able to have a voice conversation with the Au chatbot on Android and iOS apps. They can also upload images for asking questions.
The voice conversation feature uses the state-of-the-art text-to-speech model and whisper speech recognition system. This model helps the app to provide lifelike audio and it can also transcribe your words into text. The company has also collaborated with professional voice actors to offer an improved voice conversation feature.
To use the voice conversation on ChatGPT apps, you can go to Settings → New Features. Here select a voice from five options.
For image query, it lets users upload an image and then draw something in the image to highlight parts of an image. You can upload multiple images and guide the chatbot using the drawing tool.
For this feature, it uses multimodal GPT-3.5 and GPT-4 models to apply language reasoning.
The company also acknowledges challenges like misinterpretations. So, you need to be careful while using this feature.
The voice and image features of chatGPT will be available to Plus and Enterprise users in the next two weeks. Images feature will be available on all platforms while the voice conversation feature will be available on Android and iOS apps.
