Paolo

Robotics in the 5th Framework Programme: Overview: 

Robotics in the 5th Framework Programme: Overview Total EC Funding 48 ~126 M Euro ~82 M Euro

Robotics in IST-FP5:Areas of Activities: 

Health Monitoring Aid to Persons with Special Needs Risk Management (Demining) Transport and Tourism Systems and services for the citizen Cognitive Vision Systems Software Systems Simulation and Interfaces Micro- and Nano-Systems Essential technologies and infrastructures Multimedia content and tools Cultural Heritage Future & Emerging Technologies FET general Neuro-informatics Life-like Perception Systems Robotics in IST-FP5: Areas of Activities

IST 2000“Humanitarian Demining”: 

IST 2000 “Humanitarian Demining” IST Action Line “Data fusion and smart sensor technologies for Humanitarian Demining” Objective The work aims at new and enhancement of existing IST solutions, to improve significantly and at affordable costs the speed, safety and efficiency of humanitarian de-mining (e.g. surveying, detection, clearance and post clearance). The most promising emerging sensor technologies are to be investigated, addressing the needs of humanitarian demining. Results of the Call 8 projects, ~16 million Euro EC funding Examples of projects 25044 SMART (a multisensor minefield survey system) 25300 ARC (helicopter UAV for minefield area detection) 26419 BULRUSH (a vehicle-based sensor system for demining in water)

IST 2000“Neuro-informatics”: 

IST 2000 “Neuro-informatics” IST Action Line “Neuroinformatics for living artefacts Objective To explore new synergies between Neurosciences and Information Technologies in order to enable the construction of hardware/software “artefacts that live and grow”, i.e. artefacts that self-adapt and evolve beyond pure programming Results of the Call 9 projects, ~14 million Euro EC funding Examples of projects 28127 AMOUSE (robotic system with an artificial mouse-like tactile system ) 28159 MIRROR (robotic system with body gesture communications and with human visuomotor inspired representation and learning of manipulation acts) 29689 ARTESIMIT (an artificial hand learning complex action sequences)

IST 2001“Life-like perception systems”: 

IST 2001 “Life-like perception systems” IST Action Line “Life-like perception systems” Objective To create integrated perception-action systems that are inspired by the sophistication of solutions adopted by living systems. “Perception is meant to include sensorial, cognitive, and control aspects, whether it refers to vision or hearing, or to any other element of interaction with the environment by a biological organism. Such systems would extend the capabilities of machines or be used to augment the human senses Call results 6 projects, ~10 million Euro EC funding Examples of projects 34181 BIOLOCH (understanding motion and perception systems of lower animal forms and conceiving bio-inspired micro machines) 35282 MIRRORBOT (biomimetic multimodal learning using a mirror-neuron-based robot to investigate the task of foraging for objects) 33564 NEUROBIT (connecting portions of living nervous tissue with a robot for teaching the biological component how to process information)

IST 2002“Cognitive Vision Systems”: 

IST 2002 “Cognitive Vision Systems” IST Action Line “Cognitive Vision systems” Objective To develop robust cognitive vision systems acquiring and using knowledge for decision making. The focus is on adaptive systems, real-time platforms and vision architectures permitting the development of novel computational frameworks, integrating multiple cues for scene modelling and capable of recognising large numbers of different objects. Approaches to achieving cognition such as temporal reasoning and incremental learning should be addressed Call results 8 projects, ~17 million Euro EC funding Examples of projects 29375 COGVIS (task-oriented categorisation and recognition of objects and events in the context of an embodied agent) 29404 COGVISYS (a virtual commentator able to translate visual information into a textual description)

Slide8: 

The 6th Framework Programme (2003-2006) - 16.3 Billion Euro Nanotechnologies, intelligent materials, production processes

Robotics in IST-FP6Beyond Robotics Initiative in FET: 

Robotics in IST-FP6 Beyond Robotics Initiative in FET Objectives Cognitive robots: ‘assistants’ or ‘companions’ to humans open-ended conceptual learning of new skills and tasks in constant interaction and co-operation with humans Hybrid bionic systems augmenting human interaction and perception of the environment smooth integration with human perception-action systems Autonomous microrobot groups (‘robot ecologies’) heterogeneous members with collective behaviour and intelligence attain a global objective (self-organise, adapt, co-operate and evolve) Proposals evaluated in May - June 2003 Projects to start early 2004

Robotics in IST-FP6  Beyond Robotics Initiative in FET: 

Robotics in IST-FP6 Beyond Robotics Initiative in FET Call results (provisional) three integrated projects and one network of excellence, ~22 M€ EC funding COGNIRON (IP) The Cognitive Robot Companion. To study the perceptual, representational, reasoning and learning capabilities of embodied robots in human centred environments NEUROBOTICS (IP) The Fusion of Neuroscience and Robotics for Augmenting Human Capabilities. To develop new integrated robotic artefacts interfaced with human body and brain. I-SWARM (IP) Intelligent Small World Autonomous Robots for Micro Micro-Manipulation. To build a swarm consisting of a huge number of heterogeneous robots, differing in the type of sensors, manipulators and computational power. EURON (NoE) European Robotics Network. The objectives are fivefold: (1) Research Coordination, (2) Joint Programme of Research, (3) Education & Training, (4) Industrial Links, (5) Dissemination

Slide11: 

COGNIRON - The Cognitive Robot Companion Participants: Centre National de la Recherche Scientifique - Délégation Midi-Pyrénées France Ecole Polytechnique Fédérale de Lausanne Switzerland Fraunhofer Gesellschaft zur Förderung der Angewandten Forschung E.V. Germany Kungl Tekniska Högskolan Sweden University of Amsterdam Netherlands University of Bielefeld Germany University of Hertfordshire United Kingdom University of Karlsruhe Germany Vrije Universiteit Brussel Belgium Gesellschaft für Produktionssysteme Germany

Slide12: 

COGNIRON The overall objectives of this project are to study the perceptual, representational, reasoning and learning capabilities of embodied robots in human centred environments. The project will develop methods and technologies for the construction of such cognitive robots able to evolve and grow their capacities in close interaction with humans in an open -ended fashion. In the focus of this research endeavour is the development of a robot whose ultimate task is to serve humans as a companion in their daily life. The design of the cognitive functions of this artificial creature and the study and development of the continuous learning, training and education process in the course of which it will mature to a true companion, are the central research themes of the proposed project.

Slide13: 

I-SWARM - Intelligent Small World Autonomous Robots for Micro Micro-Manipulation Participants: University of Karlsruhe Institute for Process, Control and Robotics Germany Uppsala University Sweden Swiss Federal Institute of Technology, Lausanne Switzerland Frauhhofer Gesellschaft zur Förderung Der Angewandten Forschung E.V. Germany Karl-Franzens University Austria National Technical University of Athens Greece Sheffield Hallam University United Kingdom Scuola Superiore Sant'Anna Italy Barcelona University Spain University of Stuttgart Germany

Slide14: 

I-SWARM The project aims to take a leap forward in robotics research by combining experts in the fields of microrobotics and distributed multiagent systems. The project goal is to develop techniques for mass production of micro-robots which can then be employed as a "real" swarm consisting of up to 1,000 robot clients. These clients will all be equipped with limited, pre-rational on on-board intelligence. The swarm will consist of a huge number of heterogeneous robots, differing in the type of sensors, manipulators and computational power. Such a robot swarm is expected to perform a variety of applications, including microassembly, biological, medical or cleaning tasks. The project results will enable humans to further understand the microworld, bridge the gap between micro- and nanotechnologies and be the stepping stone to a "real artificial ant".

Slide15: 

EURON II (European Robotics Network) Coordinator: Kungl Tekniska Högskolan Sweden Europe is currently the leading region in industrial robotics. Moreover, as the European population demographics continue to shift toward a society with a significant proportion of elderly folk, there will be a shift in European demands on industry, lifestyle, entertainment and infrastructure. Robotics technology, in its broadest sense, will be a key contributor toward meeting these needs, particularly in the form of aids for everyday life at home and at work. To ensure that Europe remains in the forefront of this technological revolution, EURON – with more than 120 members – will provide a representative body for the European Robotics Community that promotes integrated research, development and dissemination of knowledge across the whole EU. Its work in robotics education and training, aimed at sharing educational resources and achieving commonality across EU robotics educational programmes, will help provide the necessary human capital to take part in and drive a vigorous programme of research, innovation and deployment of robotic technology. It will build bridges with EU industries to facilitate transfer of technology between academia and end-users. In addition, EURON will help integrate and publicise efforts in the IST-FET “Beyond Robotics” work programme, to maximise achievement within that programme and synergy with complementary national programmes and other funding opportunities.

Slide16: 

List of participants 1. SSSA: Scuola Superiore Sant'Anna, Pisa, Italy (prof. Paolo Dario) – Project Coordinator 2. CDF: Collège de France, CNRS, Paris, France (prof. Alain Berthoz) 3. DLR: Deutsches Zentrum fur Luft und Raumfahrt, Oberpfaffenhofen, Germany (prof. Gerd Hirzinger) 4. IBMT: Fraunhofer Institute for Biomedical Engineering, St. Ingbert, Germany (Dr. Thomas Stieglitz) 5. KI: Karolinska Institutet, Stockholm, Sweden (prof. Sten Grillner) 6. KUL: KU Leuven, Belgium (prof. Guy Orban) 7. KTH: Kungl Tekniska Högskolan, Stockholm, Sweden (prof. Henrik Christensen) 8. NTUA: National Technical University of Athens, Greece (prof. Kostas Kyriakopoulos) 9. UMEA: Umea Universitet, Sweden (prof. Roland Johansson) 10. UAB: Universitat Autònoma de Barcelona, Spain (prof. Xavier Navarro) 11. UGDIST: University of Genova, Italy (prof. Giulio Sandini) 12. UNIPR: University of Parma, Italy (prof. Giacomo Rizzolatti) 13. UPMC: Université P. et M. Curie / INSERM U483, Paris, France (prof. Yves Burnod) International Partners: Brown University, Providence, RI, USA (Prof. John Donoghue) Waseda University, Tokyo, Japan (Prof. Atsuo Takanishi) NEUROBOTICS The fusion of NEUROscience and RoBOTICS for augmenting human capabilities

Neuro-Robotics: using robots to investigate the brain: 

Neuro-Robotics: using robots to investigate the brain Retina-like Vision system: 2 cameras Anthropomorphic robot arm: 8 d.o.f. 16 (8+8) proprioceptive sensors Biomechatronic hand: 10 d.o.f 16 proprioceptive sensors 135 tactile sensors Anthropomorphic neck & head: 7 d.o.f 7 proprioceptive sensors Validating a step-wise learning theory for grasping and manipulation EU IST-FET PALOMA Project

Slide18: 

NEUROBOTICS The fusion of NEUROscience and RoBOTICS for augmenting human capabilities Objectives: To create a new scientific community through the deep cooperation of neuroscience and robotics To educate a new generation of robotics researchers Integrated Project (IP) Duration: 4 Years (possibly 7 years)

Slide19: 

NEUROBOTICS The fusion of NEUROscience and RoBOTICS for augmenting human capabilities Objectives: To investigate new frontiers of knowledge on the human brain, by developing 3 hybrid bionic systems: “Beyond Tele-operation”: robotic aliases for explorations in hostile environments “Beyond Ortheses”: a smart exoskeleton for improving accuracy, endurance and strength of human arm and hand movements “Beyond Prostheses”: a novel highly anthropomorphic arm/hand system, for limb substitution or for adoption of additional limbs

3D representation of the domain of NEUROBOTICS: 

Type of interface Level of Hybridness Level of human augmentation Exoskeletons Prostheses / Additional body parts Indirect / Multimodal Direct to CNS Direct to PNS Only perceptive or motor Both perceptive and motor Scalable robotic aliases 3D representation of the domain of NEUROBOTICS

Slide21: 

Type of interface Level of Hybridness Level of human augmentation Exoskeletons Prostheses / Additional body parts Indirect / Multimodal Direct to CNS Direct to PNS Only perceptive or motor Both perceptive and motor Scalable robotic aliases

Slide22: 

Type of interface Level of Hybridness Level of human augmentation Exoskeletons Prostheses / Additional body parts Indirect / Multimodal Direct to CNS Direct to PNS Only perceptive or motor Both perceptive and motor Scalable robotic aliases

Slide23: 

Type of interface Level of Hybridness Level of human augmentation Exoskeletons Prostheses / Additional body parts Indirect / Multimodal Direct to CNS Direct to PNS Only perceptive or motor Both perceptive and motor Scalable robotic aliases

Robotics in IST-FP6Cognitive Systems: 

Robotics in IST-FP6 Cognitive Systems Objective: To construct physically instantiated or embodied systems that can perceive, understand (the semantics of information conveyed through their perceptual input) and interact with their environment, and evolve in order to achieve human-like performance in activities requiring context- (situation and task) specific knowledge. Focus: Methodologies and construction of robust and adaptive cognitive systems Estimated funding: 25 M€ Main target: interdisciplinarity! Proposals evaluated in November 2003 Projects to start summer 2004

Future Calls: 

Future Calls New FET Proactive initiative: Bio-inspired Intelligent Information Systems (2004) Draft objective: to explore new avenues in designing intelligent information systems that are capable of extracting meaning associated to complex patterns of sensor stimuli and of generating well co-ordinated sequences of elementary actions complying with a set of higher-level goals. Consultation process until end of October see http://fp6.cordis.lu/ist/fet/fetid-proplist.cfm

Information sources: 

Information sources Future and Emerging Technologies http://www.cordis.lu/ist/fet/home http://www.cordis.lu/ist/fet/ro.htm (robotics) http://www.euron.org http://www.neuro-it.net