Google is prepping Gemini to take motion inside apps

Google launched the primary Android 16 developer preview earlier this week and keen-eyed observers are already uncovering attention-grabbing tidbits, together with one which hints about a way more helpful future for Google’s AI assistant. In Android Authority, Mishaal Rahman writes about a mysterious new API in Android 16 known as “app capabilities,” which seems to provide Gemini Assistant agentic-like talents to take motion in apps. It sounds awfully much like the upgraded “app intents” Apple helps in iOS 18, and it’s precisely the form of factor that would make AI assistants rather more helpful than they’re of their present state.

A web page on Google’s developer website describes an app perform as “a selected piece of performance that an app presents to the system. These functionalities could be built-in into varied system options.” Actually clears issues up. However Rahman factors to a selected instance buried within the documentation that sheds some extra mild. It particulars how an app developer might use app capabilities to reveal sure actions to the system — on this case, ordering meals. With this perform out there to Gemini, you may be capable of place an order along with your neighborhood Thai restaurant with out having to open the DoorDash app. Kinda neat.

Apple’s engaged on an identical strategy to a wiser assistant. One in all its guarantees for the smarter Siri we’ll supposedly get in iOS 18 is that it is going to be capable of take motion in apps for you. By updating its app intents framework, Apple has created a manner for builders to reveal “order meals”-type capabilities to Siri. In keeping with rumors, we most likely gained’t see that replace till spring of 2025, although.

“Doing issues for you” was form of the entire promise of sensible assistants from the start, however that hasn’t began materializing till very lately. Gemini can entry data in sure apps along with your permission, however at present it’s principally restricted to looking issues like Gmail and Google Maps. And Siri’s largest replace in iOS 18 up to now added a ChatGPT extension so you possibly can ask extra difficult questions, however it nonetheless falls quick on “taking motion.” Now, each platforms look like laying the groundwork for higher assistants — and 2025 may very well be a really attention-grabbing 12 months for AI on smartphones.