SAWSense: Using Surface Acoustic Waves for Surface-bound Event Recognition
Yasha Iravantchi, Yi Zhao, Kenrick Kin, Alanson P. Sample
CHI 2023: The ACM CHI Conference on Human Factors in Computing Systems
Session: Interactive Surfaces
Enabling computing systems to understand user interactions with everyday surfaces and objects can drive a wide range of applications. However, existing vibration-based sensors (e.g., accelerometers) lack the sensitivity to detect light touch gestures or the bandwidth to recognize activity containing high-frequency components. Conversely, microphones are highly susceptible to environmental noise, degrading performance. Each time an object impacts a surface, Surface Acoustic Waves (SAWs) are generated that propagate along the air-to-surface boundary. This work repurposes a Voice PickUp Unit (VPU) to capture SAWs on surfaces (including smooth surfaces, odd geometries, and fabrics) over long distances and in noisy environments. Our custom-designed signal acquisition, processing, and machine learning pipeline demonstrates utility in both interactive and activity recognition applications, such as classifying trackpad-style gestures on a desk and recognizing 16 cooking-related activities, all with 97% accuracy. Ultimately, SAWs offer a unique signal that can enable robust recognition of user touch and on-surface events.
Web:: [ Ссылка ]
Video teasers for papers at CHI 2023
