Android users will soon have Apps Archivesaccess to a revolutionarily accessible form of device control: Completely hands-free navigation, using the power of Google AI and facial tracking.
Part of the company's long list of updates and announcements rolling out at its developer keynote event today, the new feature is a mobile version of Google's desktop offering known as Project Gameface. The new virtual cursor uses Android accessibility services and a database of facial expressions from MediaPipe’s Face Landmarks Detection API to allow for broader customization and manipulation of hands-free tech for both users and developers.
SEE ALSO: Everything announced at Google I/O, including AI Agents, Ask Photos, and more"Through the device's camera, it seamlessly tracks facial expressions and head movements, translating them into intuitive and personalized control. Developers can now build applications where their users can configure their experience by customizing facial expressions, gesture sizes, cursor speed, and more," Google explained in its announcement.
Google partnered with international accessibility solutions group Incluzza to test the Gameface expansion in broader, non-gaming contexts, including work and social tasks.
Project Gameface first launched in 2023 as an open-source, hands-free gaming mouse allowing users to operate computer cursors with just head and facial movements. The technology was designed in collaboration with viral video game streamer Lance Carr, who is quadriplegic, as a more accessible option to expensive head-tracking systems. It also introduced the option of gesture size, allowing more customizability for users of different mobility.
"We’ve been delighted to see companies like playAbility utilize Project Gameface building blocks, like MediaPipe Blendshapes, in their inclusive software," Google wrote. "Now, we’re open sourcing more code for Project Gameface to help developers build Android applications to make every Android device more accessible."
Google also announced new AI features for its screenreader technology, TalkBack, which will provide more detailed descriptions and fill in information for unlabeled images on the web to help users who are blind or have low vision.
Project Gameface is now available for developers on GitHub.
Topics Android Google Social Good Accessibility
Syllabus: Unexpected Dramaturgy by Lynn NottageWe’re More Ghosts Than People by Hanif AbdurraqibAgainst Remembrance: On Louise Glück by Elisa GonzalezMaking of a Poem: Farid Matuk on “Crease” by Farid MatukThe Cat Book by James Frankie ThomasIn Remembrance of Louise Glück by Srikanth ReddyCitroën Cactus by Holly ConnollyAt Miu Miu, in Paris by Sophie KempAngels by Cynthia ZarinCaps for Sale by B.J. NovakThe Sofa by Cynthia ZarinThe Review Wins the 2024 National Magazine Award for Fiction by The Paris ReviewThe Language of Lava Lamps by Nora Claire MillerPhilistines by Nancy LemannWriting about Understanding by Yiyun LiJ. G. Ballard’s Brilliant, Not “Good” Writing by Tom McCarthyYoung, Slender, Blond, BlueTwo Strip Clubs, Paris and New Hampshire by Lisa CarverDare to Leave a Trace: On A City of Sadness by Michelle KuoThe Secrets of Beauty by Jean Cocteau The women of Congress stole the show during Trump's State of the Union address 25 good tweets for people who hate Valentine's Day Facebook is full of anti Pixel Watch prices and colors leak before Oct. 6 Made by Google event Most watched TV and movies of the week (Sept 17): Fantasy rules Someone is trolling a senator with mean fortune cookies Nancy Pelosi literally 'claps back' at Trump's State of the Union My terrible online dates live on as zombies on Instagram World record egg big reveal brings attention to mental health 'Quordle' today: See each 'Quordle' answer and hints for September 21 So it snowed in Seattle, and the dogs are loving it 11 good dogs FaceTiming with their humans Richard E. Grant's star iOS 16's lock screen is terrible for iPhone notifications 'Pearl' needs more Mia Goth dancing at the farm Mithril gets an origin story in 'The Lord of the Rings: The Rings of Power' Amazon announces new Fire HD 8 tablets with 'Tap to Alexa' accessibility feature A decade of dicks: How NSFW internet pics changed the world for the worse Teen hacker behind Uber security breach announced hack in the company's own Slack. 'Quantum Leap': reboot vs original
2.0688s , 8201.421875 kb
Copyright © 2025 Powered by 【Apps Archives】,Unobstructed Information Network