Summer School on Experimental Methodology, Performance Evaluation and Benchmarking in Robotics - Registration Open

The 2015 IEEE RAS Summer School on Experimental Methodology, Performance Evaluation and Benchmarking in Robotics being held in Benicasim, Spain on 14-18 September is open for registration.  

For more visit: http://ieee-raspebras2015.org/

The IEEE-RAS Technical Committee on Performance Evaluation & Benchmarking of Robotic and Automation Systems (TC PEBRAS) has organized a Summer School as part of the IEEE RAS Technical Education Program. As the complexity of robotic and intelligent systems grows, it is more and more necessary to adhere to sound experimental approaches and benchmarking procedures. It is of fundamental importance that the next generation learns good experimental, performance evaluation and benchmarking methods as part of their technical education.

IEEE graduate students will have a unique training opportunity in these important topics. Students will closely interact for one week with some of the top-level researchers in the world relevant to this domain. They will also have the opportunity to discuss their research work with them.

Aims and scope

Participants will learn how to implement approaches with exhaustive experimental methodology and apply appropriate benchmarking procedures to compare the actual practical results with reference to standard accepted procedures; how experimental results can be replicable and refutable on the one hand, and quantitatively comparable according to community-endorsed metrics, on the other hand. At the end, a student should be able to provide an educated response tob the following questions:
- How research should be performed and reported in order to allow result replications
- How should competitions be designed in order to maximize their contribution to robotics research and the industrial exploitation of results
- To which extent and for measuring which functionalities and capabilities are benchmarks useful and possible
- Which balance of result replication, benchmarking, challenges and competitions would allow a more objective evaluation of results and consequent objective assessment of the state of the art in the various subfields of their domain of research

Posted 15 July 2015

 

---