Joint-Action Science and Technology mce-anchor News The website...

Joint-Action Science and Technology


mce-anchor News

• The website ICT results features the JAST project and shows research results
• JAST is listed as one of the research highlights on the TUM informatics website.

mce-anchor Project overview

The success of the human species critically depends on our extraordinary ability to engage in joint action. Our perceptions, decisions and behaviour are tuned to those of others with whom we share beliefs, intentions and goals and thus form a group.
These insights underlie the motivation of the JAST project to develop jointly-acting autonomous systems that communicate and work intelligently on mutual tasks in dynamic unstructured environments. A goal that is far-reaching beyond studying individual cognitive systems and that will expand the concept of "group" to "human plus artificial agent(s)".

​

JAST will build cognitive systems that will be "socially aware", which will build trust and confidence in technology and finally, the ultimate tools that will result from the project will be applicable in industry and society.
Intelligent, autonomous agents will be developed, that cooperate and communicate with their peers and with humans while working on a mutual task. Each will be endowed with a vision system, a gripper and a speech recognition/production system, that in cooperative configurations can carry out complex construction tasks. Perceptual modules will be implemented for object recognition and recognition of gestures and actions of the partner (human or robot).

​

The construction of a "Baufix" toy airplane has been selected as a sample task for this purpose.
This work is supported by the EU FP6 IST Cognitive Systems Integrated Project "JAST" (FP6-003747-IP).

​

mce-anchor Videos


mce-anchor Overview video

This is a short sample video (unfortunately without sound) intended to give you an impression of our current work in the JAST project.


mce-anchor Robot Vision

This video shows a short capture of the output from the robot vision system. In other words, what the robot sees with its top view camera and what information is passed to the cognitive layer.

​