ChatGPT on WhatsApp Can Now Interpret Images and Audio Messages

OpenAI has enhanced ChatGPT on WhatsApp by adding support for text, image, and audio inputs. This update allows users to interact with the chatbot using various media forms. The feature is now accessible worldwide, enabling a more versatile user experience.

Initially launched in December 2024, the ChatGPT number for WhatsApp allowed users to engage with the AI using only text messages. However, with the recent update, users can now send images and voice messages to receive responses from the chatbot. Despite these new input methods, replies are still provided in text format.

Global Availability of New Features

The global rollout of this update was first reported by Android Authority. It highlights that the AI can now interpret images and audio files shared by users. This advancement enables the chatbot to respond based on these inputs, although it continues to reply solely through text messages.

To utilise ChatGPT on WhatsApp with these new features, users should save the official ChatGPT number (+1-800-242-8478) on their phones. After saving the number, they need to relaunch WhatsApp, search for the saved contact, and initiate a conversation. Users can then interact via text, images, or voice messages.

User Experience and Performance

In practical use, ChatGPT accurately transcribed Hindi voice messages and analysed image details effectively. For instance, when asked about an image's content, it scanned and provided detailed information about it. However, some lag issues were noted during testing; when switching conversations, at times mixing up responses from previous interactions.

Despite these minor glitches, the chatbot remains user-friendly and efficiently processes queries made through different media types. OpenAI is also planning further enhancements for ChatGPT on WhatsApp. According to Android Authority, there may soon be an option for users to log into their dedicated ChatGPT accounts via WhatsApp.

Future Enhancements

This potential feature would allow seamless conversation continuity and data synchronisation from the ChatGPT app. However, it's uncertain if additional functionalities will accompany this update. Meanwhile, OpenAI has introduced a 'Deep Research' mode in ChatGPT for complex web-based tasks.

This new mode facilitates multi-step research processes online for intricate tasks like comprehensive competitive analysis or personalised reports. Users can attach images or files to provide context for their questions. "Whether it's a comprehensive competitive analysis or a personalized report on the best commuter bike that meets your specific requirements," OpenAI states.

The 'Deep Research' mode is OpenAI's second AI agent after Operator AI's launch. Operator AI can autonomously perform browser-related tasks online without human intervention. According to OpenAI, this agent uses its own browser to view webpages and interact by typing or clicking.