Last Updated:
Google AI is getting new powers and Gemini will use your phone’s camera to help you identify places, cafes and even solve complex problems.
Google’s Project Astra AI assistant will work through the Gemini Live feature
While Apple struggles to make its AI better for iPhone users, Google continues to flaunt its Gemini AI prowess and add new ability. The company had demoed its Project Astra feature at the I/O 2024 and now Gemini AI is getting these tools packed into the same app that is available on smartphones.
Astra is a new-gen AI assistant that is now giving Gemini the power to read and see everything through your phone’s camera. The feature is gradually coming to all Gemini users and some of them have even tried out the new Gemini ability for Android users.
Gemini AI Can See Using Your Phone’s Camera: Here’s How
Google is using the camera on your phone to guide the AI assistant to help you understand the things near you. It can even read a code written on a PC and help you determine its purpose or solve the complex code as well.
That’s not all, you can point the camera to the street and ask the AI assistant to tell you where you are located and get more localised details if indeed. It is obvious that Gemini Live will be the carrier of these new abilities and you will need a Pixel phone to try out the see-through camera AI tool from the company.
Google is calling it “Share -screen with live” and the demos available on the internet this month give us a clear idea about how the AI feature will work on mobile devices. The Gemini Live camera option will surely bring privacy concerns for users but it seems Google is making it reliable, even though the technology will need further guardrails to prevent it from going rogue or falling into the wrong hands.
OpenAI has a similar tool available that works on ChatGPT 4o version but Google’s AI feature will be widely available, that too for free with some limits. Some of the high-end features on Gemini needs the Google One AI Premium plan that costs Rs 1,950 per month but you can get it for free with select Pixel models and other brands available in the market.
Project Astra was expected to roll out for the end users around March this year and it seems Google is close to matching the deadline. This new AI tool feels ideal for devices like smart glasses, something that Google had in its armoury much before the market was ready for it. In fact, Sergey Brin, Google Co-founder has previously mentioned that AI is the “perfect hardware” for the glasses, referring to the applications that the technology offers for the smart wearable and Astra could be the gateway for its growth in this space.
- Location :
Delhi, India, India