AI-generated graphics can be dropped, specific questions about YouTube videos can be asked, and more.
As part of the company’s I/O 2024 event, Google has just unveiled some cool enhancements to its Gemini AI chatbot, which is designed for use on phones and tablets running Android. The artificial intelligence is now a component of the Android operating system, which enables it to integrate in a manner that is more thorough.
If such integration with the underlying operating system were not present, the most exciting new feature would not be attainable. Gemini is now far more capable of comprehending context when it comes to controlling applications on the smartphone. What does this entail in its entirety? As soon as the feature is released officially as part of Android 15, you will have the ability to bring up a Gemini overlay that sits on top of the application that you are now utilizing. This will make it possible to perform actions and queries that are specific to the context.
Google provides an example of rapidly importing created photographs into Gmail and Google Messages; however, it is recommended that you avoid using historical images for the time being. The business also hinted at the existence of a feature known as “Ask This Video,” which will enable users to ask questions regarding a specific YouTube video and the chatbot will be able to provide answers to those inquiries. You should be able to use this with “billions” of videos, according to Google. There will soon be a tool that is comparable for PDFs.
It’s not hard to imagine where this technology is headed. Gemini should be able to truly deliver on some of those lofty claims made by competing artificial intelligence businesses like as Humane and Rabbit once it has access to the majority of your app library. The fact that Google is “just getting started with how on-device AI can change what your phone can do” leads us to believe that the company will eventually integrate its technology with applications such as Uber and Doordash, at the very least.
In addition, Circle to Search is receiving a boost as a result of the incorporation of AI. Users will have the ability to circle virtually anything on their mobile device and receive information that is pertinent to the circle. According to Google, users will be able to get this done without having to switch between different apps. This also extends to difficulties in mathematics and physics; all you have to do is circle the answer, which is likely to make students happy although it is likely to upset teachers.