Short Course: Evaluating Human-Robot Interaction
Holly Yanco, UMass Lowell
Wednesday, September 18, 2013
In this short course, you will learn methods and metrics for the evaluation of human-robot interaction. Experimental design and methodologies will be discussed. Case studies for a variety of robot applications will be presented. Requirements for human subjects studies approval related to human subjects protection will also be covered.
Topics to be covered:
Brief introduction of human-robot interaction
- Situation awareness
- Robot performance (e.g., time to traverse a course (if robot is autonomous), number of collisions)
- Operator performance (e.g., number of items found, time to traverse a course (if robot is teleoperated), workload, trust of the system)
Types of evaluation, including sample studies for each
- Heuristic evaluations
- Videos of robot behaviors using MTurk to collect survey data
- Lab studies
- Robots “in the wild"
Human subjects testing
- How to select the right type of participants (e.g., actual end users, college students, etc.)
- The IRB process
Designing a study
- Goals of the evaluation
- Metrics to be collected
- Within subjects vs. between subjects
- Counterbalancing to eliminate learning effects
Attendees can park in the extended parking lot on the east side of the building, facing the blue COBHAM logo. This area is noted as "Day Event Parking" on this page: http://nerve.uml.edu/location.php. Attendees can then walk around to the back of the building and enter through the NERVE Center's main entrance. There will be signs directing attendees from the parking lot to the entrance.