Gemini now handles tasks like scheduling and shopping
Gemini has expanded its capabilities to manage various tasks including making calls, paying bills, and completing chores. Users can now rely on Gemini for more complex activities such as scheduling appointments, managing bills, and grocery shopping. By integrating with your emails, calendar, and payment methods, Gemini ensures that your data remains secure in isolated environments. To access these new features, switch the app from Chat to Task mode, send a text on Android or iOS, or forward emails to [email protected].
Introducing new task capabilities
Josh Woodward, Vice President of Labs for the Gemini app and AI Studio, announced that Gemini is now equipped to take on daily responsibilities like scheduling and bill analysis. This is achieved through connections with Google apps, enabling secure completion of tasks using your existing data. Activate these features by switching the Gemini app to task mode, texting, or forwarding emails. This update is designed to save time by handling calendar management, shopping, and household organization.
Enhanced personal assistant features
The update is available at no cost to users across the U.S., Japan, Korea, Canada, Australia, and India, powered by the new Gemini 4 Hydrogen model. Advanced features are initially being rolled out in the U.S. If your Google account already contains emails, calendars, passwords, photos, files, and payment cards, Gemini provides a convenient personal assistant option, as this information is securely stored within Google.
Gemini can also perform specific tasks such as scheduling car service appointments. For example, when a check-engine light turned on, Gemini was instructed to find an appointment with nearby dealerships and update the Google Calendar. The AI handled the task efficiently, confirming appointments without the need to tolerate hold music. Additionally, Gemini recently identified an unexpected increase in an electricity bill by analyzing past billing statements, pinpointing the cause to a heat pump activating during peak pricing.
Shopping and meal planning made easy
Gemini is also useful for smaller tasks like shopping. When planning a trip to Oklahoma, it helped find and purchase a USB-C charger, including applying a discount code for savings. Purchases are kept secure through the Agent Payments Protocol, with integration with major credit card providers for added security. The upcoming Universal Commerce Protocol aims to further enhance the shopping experience.
For meal planning, Gemini can assist by adding grocery items to orders via text, and it connects with over 60 popular apps for this purpose. Users can also utilize Gemini to manage medical bills, insurance renewals, and family schedules by forwarding emails to the app.
Security and flexibility
Gemini’s operations are secured using Google Cloud’s Agent Compute Engine, with tasks performed in a hardware-isolated virtual machine. This setup ensures that Gemini works in a secure environment without sharing data with other users. The system includes prompt-injection filters and other security measures to prevent unauthorized access.
Users can interact with Gemini at any point during a task to give additional instructions, and the app is designed to pause and confirm before critical actions. Settings are available to adjust task preferences, disconnect apps, or erase chat history as needed.
Despite rigorous testing, some tasks may not complete successfully. Users are encouraged to provide feedback on such instances. Gemini is collaborating with websites and security providers to improve how personal assistants navigate the web. The aim is to establish open standards that benefit all stakeholders.
To start using Gemini’s task features, switch the app to Task mode or send an email or text. Discover what tasks Gemini can help you accomplish today.
