PopSignAI Preview app for iPhone and iPad

PopSignAI is in preview mode! The first seven levels are available.

Teaching an infant sign language accelerates their language skills, whether they are hearing or deaf. PopSign is an educational bubble shooter game developed by Georgia Tech and RIT/NTID’s Center on Access Technology. The game teaches American Sign Language (ASL) signs based on the MacArthur-Bates Communicative Development Inventories, which are the first concepts used to teach a language to a child. PopSign is focused on helping hearing parents of deaf infants learn sign, though it can help anyone who wants to learn ASL.

PopSignAI combines the gameplay of PopSign with sign language recognition, being developed from over 220,000 total examples of 250 signs collected by the Deaf Professional Arts Network from 47 Deaf signers for whom ASL is their first language. Recognition is supported by Google during a Kaggle machine learning competition that completed in May 2023. We are now incorporating Googles Mediapipe hand tracking and sign language recognition models made using Googles TensorFlow Lite into the PopSign game.

95% of deaf infants are born to hearing parents, who often do not know sign. Without access to naturally occurring language acquisition during their critical language-learning years, these children are at risk for Language Deprivation Syndrome (LDS) which can have a serious impact on many aspects of these childrens lives, such as relationships, education, and employment.

PopSignAI is a "bubble shooter" game where the player tries to match three or more bubbles of the same type to burst them. PopsignAI uses a smartphones selfie camera to recognize the player signing one of five signs while they aim at the bubbles they want to shoot. More levels will be added as the recognition system is incorporated.

If you are interested in providing examples of your signing to help us create the game, please email us at [email protected]