Hands-Free Eyes-Free Word Processing On The Go
Conversational User Interface Design
Background: HCI research at NUS-HCI Lab
When pursuing my bachelor's degree at National University of Singapore, I worked as a research intern at NUS-HCI Lab, under the supervision of A.Prof Shengdong Zhao and Debjyoti Ghosh.
The research project was about developing an effective way of doing word processing eyes free and hands free. Listed as the co-author of the paper, I worked on multiple stages of the research, from literature review to prototype building and user testing.
The paper "EDITalk: Towards Designing Eyes-free Interactions for Mobile Word Processing" is accepted and presented during ACM Conference on Human Factors in Computing Systems (CHI) 2018 at Montréal, Canada.
Problem: Word processing while walking?
There are cases where people are walking or busy with hand work but need to do word processing. Under those circumstances, the interface needs to be designed eyes free & hands free.
EDITalk: a novel Conversational-User-Interface
We used a Wizard-of-Oz elicitation study to investigate the viability of eyes-free word processing in the mobile context and to elicit user requirements for such scenarios. Results showed that meta-level operations like highlight and comment, and core operations like insert, delete and replace are desired by users. However, users were challenged by the lack of visual feedback and the cognitive load of remembering text while editing it.
We then studied a commercial-grade dictation application and discovered serious limitations that preclude comfortable speak-to-edit interactions. We address these limitations through EDITalk's closed-loop interaction design, enabling eyes-free operation of both meta-level and core word processing operations in the mobile context. Finally, we discuss implications for the design of future mobile, voice-based, eyes-free word processing interface.
Demo of Work
The demo shows how EDITalk can facilitate user doing work processing through a natural style conversational interface.