"If you can't measure it, you can't claim it." ~Terry Fong, August 2010
In addition to my research projects, I have spent a lot of time focusing on how their success can be measured. This means 1.) formulating hypotheses, 2.) finding the appropriate performance measures to uphold or disprove the hypotheses, 3.) developing and running human-subjects experiments, and 4.) performing statistical analysis of the data to understand if the hypotheses are upheld.
I presented a quick tutorial of the tips and techniques that this computer scientist has learned about social sciences. See my tutorial presentation given at Robotics: Science and Systems 2011 Workshop on Human-Robot Interaction, Perspectives and Contributions to Robotics from the Human Sciences on July 1, 2011; [CLICK TO DOWNLOAD PRESENTATION]
I've also accumulated a growing list of tools pertaining to statistical analysis et cetera, that I periodically update.
Katherine M. Tsui and Holly Yanco. Towards Establishing Clinical Credibility for Rehabilitation and Assistive Robots Through Experimental Design. In Proceedings of the Robotics: Science and Systems Workshop on Good Experimental Methodology in Robotics. June 28, 2009.
Katherine M. Tsui, Holly Yanco, David Kontak, and Linda Beliveau. Experimental Design for Human-Robot Interaction with Assistive Technology. Human-Robot Interaction Conference Workshop on Robotic Helpers: User Interaction, Interfaces and Companions in Assistive and Therapy Robotics, March 12, 2008.
Katherine M. Tsui, Munjal Desai, and Holly A. Yanco. Towards Measuring the Quality of Interaction: Communication through Telepresence Robots. Proceedings of the Performance Metrics for Intelligent Systems Workshop (PerMIS), College Park, Maryland, March 20-22, 2012. [PRESENTATION]
Katherine M. Tsui, Munjal Desai, Holly A. Yanco, Henriette Cramer, and Nicander Kemper. Measuring Attitudes Towards Telepresence Robots. International Journal of Intelligent Control and Systems, Special Issue on Quantifying the Performance of Intelligent Systems. Volume 16, Number 2, June 2011.
Katherine M. Tsui, Munjal Desai, Holly A. Yanco, Henriette Cramer, and Nicander Kemper. Using the "Negative Attitudes Toward Robots Scale" with Telepresence Robots. Proceedings of the Performance Metrics for Intelligent Systems Workshop (PerMIS). September 2010.
Katherine M. Tsui, Kareem Abu-Zahra, Renato Casipe, Jason M'Sadoques, and Jill L. Drury. Developing Heuristics for Assistive Robotics. Late-breaking paper at the 5th Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI), Osaka, Japan, March 3-5, 2010.
Katherine M. Tsui, Kareem Abu-Zahra, Renato Casipe, Jason M'Sadoques, and Jill L. Drury. A Process for Developing Specialized Heuristics: Case Study in Assistive Robotics. University of Massachusetts Lowell, Technical Report #2009-11, December 2009.
Katherine M. Tsui, Holly Yanco, David Feil-Seifer, and Maja Mataric. Methods for Evaluating Assistive Robotic Technology. Chapter 3 of Performance Evaluation and Benchmarking of Intelligent Systems, pp 41-56. Edited by Raj Madhavan, Edward Tunstel, and Elena Messina. Springer, 2009.
Katherine M. Tsui, Holly Yanco, David Feil-Seifer, and Maja Mataric. Survey of Domain-Specific Performance Measures in Assistive Robotic Technology. Proceedings of the Performance Metrics for Intelligent Systems Workshop (PerMIS), R. Madhavan and E. Messina (eds.), NIST Special Publication 1090, pages 116-123, August 2008.