Title: Extending the Capabilities of Smartphone Sensors for Applications in Interaction and Health
Advisors: Shwetak Patel and Gaetano Borriello
Supervisory Committee: Shwetak Patel (Chair), Sean Munson (GSR, HCDE), James Fogarty, and Maya Cakmak
Abstract: Computing devices continually evolve and in a relatively short time, have morphed from a room-sized machine to something much smaller. Today, a mobile computer can be kept in our pocket, or worn as a wristwatch or a glass. These devices are sufficiently powerful for majority of tasks a typical user performs on a computer. While these devices are slowly catching up with the desktops in raw computation power, they already have much richer sensing capabilities. The on-device sensors provide mobile devices with an unprecedented opportunity to not only provide richer interactions, but also enrich the quality of life.
Acknowledging that the mobile devices cannot be loaded with every possible sensor, I believe a big chunk of sensing responsibility will lie with the generic sensors on our devices, such as camera, microphone, motion sensors, touchscreen, etc. In this dissertation, I provide support for my thesis statement:
The capabilities of generic sensors on mobile devices can be extended to enable applications that traditionally require dedicated sensors. These multiple generic sensors can come together to enable robust and deployable user-facing sensing systems.
In this thesis, I discuss:
1. How to extend the capabilities of the on-device sensors,
2. Some of the challenges the developer and the user might face while using these generic sensors,
3. Discuss how some of the challenges can be countered by combining multiple generic sensors, and
4. Provide some direction how these sensors should evolve in future.
In terms of application area, there are many domains where the smartphone sensors can prove useful, but this thesis focuses on applications in two domains: interaction and health sensing.