Google has introduced Project Gameface, an open-source, hands-free, AI-powered mouse, designed to enhance accessibility for individuals with disabilities. Developed in collaboration with Incluzza, a Bengaluru-based social enterprise, Gameface allows users to control a cursor on their devices using facial expressions and head movements captured through a webcam.
Project Gameface offers a new way to interact with technology. By raising eyebrows to click and drag or opening their mouth to move the cursor, users can control their devices without traditional input methods, aiming to make digital interfaces more accessible for those with limited mobility.
As reported by The Sun, the project was inspired by Lance Carr, a quadriplegic video game streamer who can only move his head and thumbs due to muscular dystrophy. Carr’s need for a more affordable and accessible alternative to expensive head-tracking systems motivated Google to create Project Gameface.
Announced at last year’s Google I/O conference for desktop applications, the technology uses the camera and MediaPipe’s Face Landmarks Detection API to interpret facial movements as cursor commands. This year, on May 14, Google released the code as open source on GitHub, inviting Android developers to integrate the technology into their apps.
“Through the device’s camera, it seamlessly tracks facial expressions and head movements, translating them into intuitive and personalized control,” stated Google’s announcement. Project Gameface allows users to customize their experience by adjusting gesture sizes, cursor speed, and other settings.
During an international press briefing and demo on May 14 in Mountain View, California, Avneet Singh, Product Manager at Google Partner Innovation, highlighted the broader applications of Project Gameface. “We collaborated with Incluzza to learn how Project Gameface can be expanded to educational, work, and other settings, like being able to type messages to family or searching for new jobs,” Singh said.
Incluzza’s involvement has been important in refining Gameface. “Our association with Google for Gameface started in mid-February this year,” said Shristi G, Account Manager at Incluzza. “The team reached out asking for feedback from various users of Gameface. Based on that feedback, the product was improved.”
Vinaya Chinnappa, CEO of Enable India Solutions, which includes Incluzza, emphasized the importance of Gameface in encouraging inclusivity. “We work with persons with disabilities to prepare them for livelihoods and with companies to make workplaces an inclusive ecosystem,” Chinnappa told ET. “Gameface is aimed at improving accessibility not at an individual application level, but at a broader system level like a personal computer or mobile phone for enhanced usage.”
With the Project Gameface code available on GitHub, Google aims to help developers create more accessible Android applications, improving the digital experience for users with disabilities. This initiative marks a step towards inclusivity in the tech world, making technology more accessible to everyone.