DC8 - Evaluation of Robot Capabilities Beyond Technology-Based Metrics

Objectives

1. To develop a conceptual framework for reliably evaluating capabilities of cognitive robotic systems using psychometrics.
2. To develop a tool to facilitate using the developed test items and analyzing the impact of this alternative view on ranking of capabilities and dependability in evaluations.

Expected Results

1. A framework based on psychological methods to evaluate the capabilities of cognitive robots and to predict their performance for novel tasks and environments.
2. A tool for applying the developed framework and results of its application in domestic robotics settings.
3. A benchmark including simulation scenarios for evaluating cognitive robot capabilities in domestic environment.

Planned Secondment(s)

S15: UBremen, Prof. Hochgeschwender, 2 months in M14-15
S16: LNE, Dr. Mahtani, 2 months in M26-27

Required Skills

Essential

• Master Degree in Computer Science, Computational Social Systems or a related topic
• Solid programming skills

Desirable

• Knowledge in robotics, ROS and robotics simulation
• Experience in the evaluation of capabilities/skills and test theory