Article ; Online: Wi-AM: Enabling Cross-Domain Gesture Recognition with Commodity Wi-Fi.
2024 Volume 24, Issue 5
Abstract: RF-based gesture recognition systems outperform computer vision-based systems in terms of user privacy. The integration of Wi-Fi sensing and deep learning has opened new application areas for intelligent multimedia technology. Although promising, ... ...
| Abstract | RF-based gesture recognition systems outperform computer vision-based systems in terms of user privacy. The integration of Wi-Fi sensing and deep learning has opened new application areas for intelligent multimedia technology. Although promising, existing systems have multiple limitations: (1) they only work well in a fixed domain; (2) when working in a new domain, they require the recollection of a large amount of data. These limitations either lead to a subpar cross-domain performance or require a huge amount of human effort, impeding their widespread adoption in practical scenarios. We propose Wi-AM, a privacy-preserving gesture recognition framework, to address the above limitations. Wi-AM can accurately recognize gestures in a new domain with only one sample. To remove irrelevant disturbances induced by interfering domain factors, we design a multi-domain adversarial scheme to reduce the differences in data distribution between different domains and extract the maximum amount of transferable features related to gestures. Moreover, to quickly adapt to an unseen domain with only a few samples, Wi-AM adopts a meta-learning framework to fine-tune the trained model into a new domain with a one-sample-per-gesture manner while achieving an accurate cross-domain performance. Extensive experiments in a real-world dataset demonstrate that Wi-AM can recognize gestures in an unseen domain with average accuracy of 82.13% and 86.76% for 1 and 3 data samples. |
|---|---|
| MeSH term(s) | Humans ; Gestures ; Pattern Recognition, Automated ; Recognition, Psychology ; Information Technology ; Intelligence ; Algorithms |
| Language | English |
| Publishing date | 2024-02-20 |
| Publishing country | Switzerland |
| Document type | Journal Article |
| ZDB-ID | 2052857-7 |
| ISSN | 1424-8220 ; 1424-8220 |
| ISSN (online) | 1424-8220 |
| ISSN | 1424-8220 |
| DOI | 10.3390/s24051354 |
| Database | MEDical Literature Analysis and Retrieval System OnLINE |
More links
Kategorien
Order via subito
This service is chargeable due to the Delivery terms set by subito. Orders including an article and supplementary material will be classified as separate orders. In these cases, fees will be demanded for each order.