INTEROB

Project
Context
Objectives
Presentation
Justification
Diagram
Results
Impact
Management
Resources
Team
Final Report
Dissemination

Project Title:

GESTURES BASED INTERACTION WITH INFORMATION AND ROBOTICS SYSTEMS

Acronym:

INTEROB

Module:

1

Type of project:

P-CD

Thematic Fields:

Robotic systems: advanced autonomous szstems; cognition, control, action skills, natural interactions; miniaturisation
Technological Platform
PT 3 – Embedded systems

Contract:

131-CEEX-II03/02.10.2006

Natural interaction is an aspect that becomes more and more important in the dialog human – informatics / robotics systems. Gestures represent such an intuitive and natural way of interaction and communication. Fundamental and applicative research is targeted for this project in what concerns the achievement of high technological models for the recognition and interpretation of human gestures having as final aim the natural interaction with:

    § information systems such as virtual reality applications (interaction and navigation inside a virtual environment) 
    § information systems such as augmented reality applications (interaction with virtual and real objects)
    § robotics systems (natural gestural commands for mobile and static robots)

The focus is mainly on video processing using techniques and methods that are specific to image processing, pattern recognition and computer vision. We propose the following attainable objectives:

    § real time acquisition and interpretation of hand and head gestures using a stereoscopic view
    § embedded system for the recognition and interpretation of human gestures
    § apply the interaction system for a 3D virtual reality application at Laboratoire d'Informatique Fondamentale de Lille as well as for an augmented reality system for a smart desk application
    § experiment the proposed technology with robotics systems: Hercules, a static arm type robot and Centaure, a mobile robot prototype developed in colboration with Polytech'Lille

Fundamental and applicative original research is also targeting the development of an embedded device that will allow for a fast hardware based solution of video-preprocessing in what concerns color and motion detection. The project is part of the thematic area 3.2.3 on natural interactions using human gestures and under the technological platform PT 3 – embedded system by developing a smart device using the System on Chip technology. The project also contains original research as part of 4 PhD thesis of which one is codirected in collaboration with prof. Christophe Chaillou from Universitate des Sciences et Technologies of Lille.

The proposal is sustained by international partners (by means of written collaboration agreements attached as appendixes): Laboratoire d'Informatique Fondamentale de Lille, Franşa; Polytech'Lille, Franşa; Institute for Work and Technology Gelsenkirchen, Germania; University of Gent, KAHO Gent, Belgia.

[Project] [Context] [Objectives] [Presentation] [Justification] [Diagram] [Results] [Impact] [Management] [Resources] [Team] [Final Report] [Dissemination]