New AI-powered experiences for Android devices at Google I/O 2024 announced. In particular, it can be seen that the Android 15 mobile operating system now works closely with Gemini artificial intelligence. The company underlines that they aim to redesign how you can interact with your Android phone.
Android 15 and Gemini Will Offer a New Experience
According to Google, Android was designed with artificial intelligence at its core, and Gemini is a core part of the Android experience working at the system level. The system includes an AI-powered search bar that can be used to answer questions and search for information, and starting today, to solve math and physics problems or get homework help. The Circle to Search feature will be available.
Gemini acts as an artificial intelligence assistant on Android instead of Google Assistant, and Gemini artificial intelligence can be displayed as a layer on top of any application in use. Gemini will be aware of the context and will be able to predict what the smartphone user is doing and provide context in the moment. Gemini will be able to create images for texts and social media or answer questions about a watched video. Additionally, it will be able to parse PDFs, websites, and other content by providing summaries and translating.
Ships will allow you to ask questions about the other applications, to ask questions about the other applications, and to ask questions about the other practices in any application. Google says these features will be available on “hundreds of millions of devices” within the next few months.
The native on-device Gemini Nano model will soon become multimodal. This means Gemini Nano can process not only text but also sounds, spoken language, images and more. Gemini Nano’s multimodal features will be available to Pixel users later this year.
In addition, Gemini Nano will power TalkBack to help visually impaired users understand their surroundings more clearly and better. Since the language model runs on-device, the results will appear much faster, without needing an active internet connection.
Finally, Gemini Nano will get better at detecting fraud by providing you with real-time alerts while searching. Google says the model can detect fraud patterns while keeping all your conversations and related data only on your device.
