Motor skills are an important facilitator for quality of life. As many as 87% of autistic individuals experience difficulties associated with motor skills, but only 32-13% of children with autism received movement therapies such as physical and recreational therapies. Because of this, we began research on a video game-based intervention to encourage intrinsic motivation for autistic children in physical therapy. We began by interviewing 9 clinicians, then we did co-design with 5 clinicians and 3 autistic children and their families, and next, we are testing our ideas with our first demo at the Hozoni event!

Hypertension, which disproportionately affects older adults, continues to pose a critical health challenge among Indigenous communities , where systemic healthcare inequities and cultural mis-matches in medical interventions contribute to high rates of undiagnosed and unmanaged cases. This paper explores the co-design of culturally relevant mobile health games to support hypertension management among Indigenous Peoples in Northern Arizona. Drawing from participatory design methodologies, we conducted a workshop with 14 participants to conceptualize and prototype mobile applications focused on five key factors of hypertension care: medication adherence, nutrition, exercise, education, and blood pressure monitoring. The workshops revealed that culturally rooted play and storytelling may significantly enhance user engagement and acceptance of digital health tools. Using insights from these sessions, we developed five medium-fidelity prototypes that reflect diverse game and play strategies, from traditional gami-fication techniques to reappropriations of existing games infused with Indigenous cultural elements. Our findings highlight how participatory and culturally grounded design approaches can produce mobile health interventions that may resonate more deeply with Indigenous worldviews and healthcare practices. This study contributes empirical design artifacts and knowledge to the field of accessible health technologies, emphasizing the importance of Indigenous-led co-design in addressing chronic disease disparities. We conclude by outlining future directions for iterative prototyp-ing and playtesting, with implications for broader applications in culturally responsive digital health innovation.

Crowdsourced data collection is a scalable approach to collecting mobile broadband performance data across space.  However, existing platforms for crowdsourced mobile broadband measurements are not designed to engage workers over time or space, which can lead to spatial misrepresentation, stale data, and, ultimately, internet access inequity. With the insight that games and play offer naturally engaging frameworks for users, we held five iterative, participatory design sessions with 11 participants to co-design a catalog of 11 game concepts that could be used to create more spatially representative mobile broadband data sets. Importantly, we found that while games varied substantially with respect to theme, all used a few common game mechanics to incorporate mobile broadband data collection into play. This indicates that a designed prototype might focus on offering a customizable gaming structure that would allow communities and individuals to create thematic content that could overlay onto a set of common mechanics that could support more representative geospatial data collection.

Empathy-building, the first stage in human-centered design, often involves methods that inadvertently reinforce negative stereotypes and biases toward disabled communities. In this work, we introduce a new method: Disability-Related Empathy from Existing Media (DREEM). This method focuses on enculturation rather than traditional ideas of empathy. DREEM leverages media created by disabled individuals to facilitate a deeper, culturally informed understanding. Cultural content is rich with authentic perspectives and tacit design knowledge from people with disabilities. Our four-step process includes (1) discovering relevant media, (2) close reading, (3) reflective journaling, and (4) aggregation of insights. In this article, we present our process of creating DREEM using research through design in multiple research and education contexts. Our findings show that DREEM can be applied in both design classrooms and research contexts to foster a more nuanced understanding of disability for newcomers to the space.

The paramount measure of success for a machine learning model has historically been predictive power and accuracy, but even a gold-standard accuracy benchmark fails when it inappropriately misrepresents a disabled or minority body. In this work, we reframe the role of machine learning as a provocation through a case study of participatory work co-creating exergames by employing machine learning and its training as a source of play and motivation rather than an accurate diagnostic tool for children with and without Sensory Based Motor Disorder. We created a design probe, Cirkus, that supports nearly any aminal locomotion exergame while collecting movement data for training a bespoke machine learning model. During 5 participatory workshops with a total of 30 children using Cirkus, we co-created a catalog of 17 exergames and a resulting machine-learning model. We discuss the potential implications of reframing machine learning’s role in Assistive Technology for values other than accuracy, share the challenges of using “messy” movement data from children with disabilities in an ever-changing co-creation context for training machine learning, and present broader implications of using machine learning in therapy games.

Robomoji is the lab's emerging research thread on playful interactions for assistive robot arms. The goal is an AI-assisted authoring interface plus a behavior library spanning low-risk activities of daily living and emoji-like expressive gestures  so the robot is useful for tasks and available for creative expression and social connection. The project hypothesizes that enabling people to author their own playful, semantically meaningful robot behaviors will increase perceived utility, acceptance, and STEM identity.

Spellcasters is an entertainment virtual reality game turned therapy game for stroke rehabilitation. In the original game, teams of 5 wizards with various roles such as support, attack, and tank battle in a magical duel by drawing gestures with their magical wand to cast a spell before aiming and shooting at the target. The first team to run out of a pool of lives loses. This research explored how translating a game developed purely for entertainment could be reimagined for therapy—the gesture drawing mechanic seemed like a great opportunity for physical rehabilitation if the spells required therapeutic gestures to cast. We collaborated with medical professionals, including physical therapists and occupational therapists, on a sandbox that allows custom gestures to be created for the idiosyncratic needs of stroke survivors, as well as a design for a companion app that allows medical professionals to track progress and edit in-game goals. 

Social media is rife with tacit design knowlege—including content from creators with disabilities. In this work, we chased play potentials on TikTok from creators with disabilities to inspire accessible and playful everyday technology. We design better technology for everyone when we include the perspectives of people with disabilities early and often in the design process. This project was led by Jared Duval and co-authored with Ferran Altarriba Bertran, SIP High School Interns, and Katherine Isbister.

SpokeIt addresses the needs of a large community of people who receive, do not receive, or provide speech therapy. SpokeIt is a Serious Game for Health designed to provide at-home speech therapy and engaging activities. Speech practice at home is usually hindered by a lack of intrinsic motivation due to the tedious and repetitive idiosyncratic nature of speech therapy curriculums. Parents and caretakers experience major difficulties prompting individuals to complete speech exercises at home, especially when young. They often lack the expertise of a speech therapist and report a general low sense of competence in facilitating curriculum. Medical professionals have little insight into the (lack of) progress outside of their practice and would benefit from reports. SpokeIt is intended to be used by children aged 4-10 with cleft speech, as well by parents, caretakers, and medical professionals for curriculum customization, progress reports, and integrated at-home play. 

Privacy Policy