Fitterfly, Google Cloud launch meal tracking app using computer vision

Fitterfly, an India-based digital therapeutics company, announced it is launching an AI feature dubbed Fitterfly Klik in partnership with Google Cloud, which allows individuals with diabetes to track their meals using computer vision powered by Gemini 1.5 Flash on Google Cloud’s Vertex AI platform.

Through Fitterfly Klik, people with diabetes or other non-communicable diseases can take or upload a picture of their meal. The AI-enabled app will scan its database, which includes 37,000+ Indian foods, to recognize and analyze the food. 

The algorithm will determine portion size and provide a detailed breakdown of calorie count and micronutrient and macronutrient distribution. 

The AI can identify Indian and international dishes, and users can keep track of their food intake via a meal-tracking food diary within the app.

“With Gemini 1.5 Flash on Vertex AI connected with the Fitterfly Food Database, Klik makes meal logging possible in a few seconds, even with multiple dishes on a plate. Multimodal models today are surpassing traditional image classification methods in accuracy, even on a complex problem like food. Klik will reduce friction and help our users take another step in building healthier lifestyles,” Ammar Jagirdar, head of Fitterfly X-Labs, said in a statement.

THE LARGER TREND

At HIMSS24, Google Cloud announced new genAI advancements, including the launch of Vertex AI Search for Healthcare. The tool aims to help developers build better assistive technology for clinicians and other health system workers to alleviate administrative burdens. 

The tech giant has also announced numerous partnerships within the healthcare space. 

On Monday, C3.ai announced the launch of C3 Generative AI for Government Programs in collaboration with Google Cloud. The genAI application helps federal, state and local governments relay information to the public about government programs, including healthcare programs. 

Last week, Google Cloud announced it was partnering with Oracle. Through the new offering, Oracle Interconnect for Google Cloud, customers can combine Oracle Cloud Infrastructure with Google Cloud’s technologies to speed up their application modernization and migrations. 

In April, the cloud computing service company announced a partnership with multinational pharmaceutical and biotechnology company Bayer to develop AI applications aimed at reducing radiologist burnout and increasing efficiencies in diagnoses.  

In 2022, Rite Aid and Google Cloud announced a multiyear partnership. Google Cloud would provide Rite Aid with technological insight to make its pharmacies more data-driven and personalized.