Work on inclusive EMG gesture recognition featured on the Meta Quest Blog

Our lab’s work on inclusive EMG gesture recognition for individuals with motor disabilities was features on the Meta Quest Blog. The work was funded by a Meta gift in 2022 (Framework for Diverse EMG Gesture Recognition) which was renewed in 2023 for an extension project (Closing the Loop on Personalized EMG Gesture Recognition).

2024 Summer REU present at Rice Undergraduate Research Symposium

Congratulations to our 2024 summer REU students, Tony Martinez (Rice University, Computer Science) and Steven Chen (National Taiwan University, Biomechatronics Engineering) for finishing up their REU programs. They presented at the Rice Summer Undergraduate Research Symposium.

  • Tony Martinez: Developing a Virtual Reality Platform to Assess VIsual and Motor Attention
  • Steven Chen: Development of a Biosignal Gesture Recognizer Web Demo

Stay tuned for the web demo, which will be available this fall on the website!

Yamagami lab participates in first Health Equity Workshop

The Yamagami lab participated in the first Health Equity Workshop hosted by the Digital Health Initiative at Rice University. Momona Yamagami presented on “Accessible and Inclusive Digital Health Technologies for Ubiquitous Rehabilitation“. We also had poster presentations from Kai Malcolm and Mikayla Deehring:

  • Kai Malcolm: Towards Health Equity: Model Personalization for Fairer Outcomes and Privacy Protection
  • Mikayla Deehring: Predicting Adherence to At-Home Rehabilitation Using Biosignals

Yamagami lab receives funding to develop novel digital health technology to support at-home prehabilitation

Our lab has received funding on “Enabling Access to Prehab for Kidney Transplant Candidates who are Frail” through seed funding from the 2023 Digital Health Workshop hosted by the PATHS-UP ERC. We are looking forward to working with Drs. Atiya Dhala (Houston Methodist), Farzan Sasangohar (Texas A&M University), and Elizabeth Lorenz (Baylor College of Medicine) to develop a mobile health platform to support at-home prehabilitation for individuals with end-stage kidney disease. See other winners and more information on Rice News.

Dr. Yamagami presents at ASSETS 2023 on “How do people with limited movement personalize upper-body gestures? Considerations for the design of personalized and accessible gesture interfaces”

“Personalized upper-body gestures
that enable input from various body parts, according to the abilities
of each user, could be useful for ensuring that gesture systems are
accessible. However, we do not know what types of gestures
(or gesture sets) people with upper-body motor impairments would
want to use, or whether wearable sensors can diferentiate between
an individual’s chosen gestures.”

Dr. Yamagami presented her postdoctoral work, “How do people with limited movement personalize upper-body gestures? Considerations for the design of personalized and accessible gesture interfaces” at ASSETS 2023 [ DOI ] (the 25th International ACM SIGACCESS Conference on Computers and Accessibility) in New York City.

Momona, a woman with dark hair, stands at a podium in front of a large screen with multiple gesture icons. An ASL interpreter stands next to her gesturing.

Goal: To understand what types of gestures people with upper-body motor impairments would want to use, or whether wearable sensors can differentiate between an individual’s chosen gestures.

Method: We characterize the personalized gesture sets designed by 25 participants with upper-body motor impairments and develop design recommendations for upper-body personalized gesture interfaces.

Result:

We found that the personalized gesture sets that participants designed were highly ability-specifc. Even within a specifc type
of disability, there were signifcant diferences in what muscles participants used to perform upper-body gestures, with some predominantly using shoulder and upper-arm muscles, and others solely using their finger muscles.

Implications: Personalized upper-body gesture interfaces that take advantage of each person’s abilities are critical for enabling accessible upper-body gestures for people with
upper-body motor impairments

Dr. Yamagami presents her poster in front of two attendees.

She also presented her TACCESS (ACM Transactions on Accessible Computing Journal) 2022 and 2023 papers, titled:

  • Two-In-One: A Design Space for Mapping Unimanual Input into Bimanual Interactions in VR for Users with Limited Movement [ DOI ]
  • “I’m Just Overwhelmed”: Investigating Physical Therapy Accessibility and Technology Interventions for People with Disabilities and/or Chronic Conditions [ DOI ]

Kai Malcolm presents posters in the AI in Healthcare Conference and the Texas Colloquium on Distributed Learning

The Yamagami lab participated in the October 2023 AI in Healthcare Conference [https://events.rice.edu/event/347482-2023-ai-in-health-conference] as well as the September 2023 Texas Colloquium on Distributed Learning [https://sites.google.com/view/tldr2023], both hosted by the Ken Kennedy Institute at Rice University. Kai Malcolm presented his recent work as a poster at both venues: Protecting Sensitive Biosignal Data in Model Training: Federated Learning for Healthcare Applications. Great job Kai!

Congratulations Kai for being selected to participate in the Bioelectronics NRT Program!

Headshot of Kai Malcolm, a man in suit and tie standing in front of Rice University building

Kai was selected to join the Bioelectronics NSF Research Traineeship program, which focuses on training PhD students to collaborate across different disciplines. Kai will be collaborating with other students to design new brain/body-machine interfaces to augment human capabilities for people with and without disabilities.

Congratulations Lauren for being awarded the Dean’s Prize bonus award!

Lauren was selected for the Dean’s Prize bonus award from Rice ECE and GPS. This award will help Lauren transition to her graduate studies and support her research on developing data-driven models to improve health and accessibility. She will be starting as a PhD student at Rice University in Fall 2023. Congratulations Lauren!