"I know my data doesn't leave my phone, but still feel like being wiretapped": Understanding (Mis)Perceptions of On-Device AI Vishing Detection Apps
Abstract
Vishing, or voice phishing, is a growing global threat exploiting calls to steal sensitive information or money. While on-device AI apps offer promising solutions for real-time vishing detection by analyzing the content of phone conversations, little is known about user perspectives on these tools. To address this gap, we conducted a study with 30 participants using a prototype app featuring on-device AI for speech recognition and vishing detection. We found negligible impacts of on-device AI vishing detection models on smartphone usage satisfaction, but user interviews revealed persistent privacy concerns. Despite the system’s use of on-device AI to ensure data security, some participants reported feeling “being wiretapped.” These findings highlight the need to design privacy-preserving on-device AI solutions and improve user understanding to encourage widespread adoption.
Publications
"I know my data doesn't leave my phone, but still feel like being wiretapped": Understanding (Mis)Perceptions of On-Device AI Vishing Detection Apps
Subin Park, Hyungjun Yoon, Janu Kim, Hyoungshick Kim, and Sung-Ju Lee
ACM Conference on Human Factors in Computing Systems (CHI) 2025 Extended Abstracts.
PDF
