- Google AI mode now allows users to load images and photos to go with text consultations
- The feature combines Google Gemini and Lens
- AI mode can understand complete scenes, not just objects
Google is adding a new dimension to its experimental mode connecting the visual skills of Google Lens with Gemini.
AI mode is part of Google Search that can break down complex issues, compare options and suggest follow -ups. Now, that search includes loaded images and photos taken on your smartphone.
The result is a way to search the images in the way I would send text messages, but with much more complex and detailed answers than simply put an image in the search for reverse images.
Literally, you can take a photo of a strange -looking kitchen tool and ask: “What is this and how I use it?” And get a useful, complete response with YouTube purchase and demonstrations links.
AI eyes
If you take a photo of a shelf, a plate of food or the chaotic interior of your garbage drawer, the AI will not only recognize individual objects; You will also explain your relationship with each other.
You can get a suggestion of other dishes you can do with the same ingredients, whether your old phone charger is in the drawer or in which order you should read those books on the shelf. You can see how it works above.
Essentially, the function triggers multiple related questions in the background about the entire scene and each individual object. So, when you upload a photo of your living room and ask how to redecorate it, you not only get a generic response. You are receiving a group of answers from Mini AI agents that they ask especially in the room.
Google is not unique in this search. Chatgpt includes image recognition, for example. However, Google’s advantage is decades of search data, visual indexation and other data storage and organization data.
If you are a premium subscriber of Google One AI or is approved to test it through search laboratories, you can test the function in the Google Mobile application.