BioStruct

While traditional automation is suitable for repetitive executions, it reaches its limits when robots need to act in a Human-Robot Collaboration (HRC) environment. Here challenges like high product and variant diversity, low lot sizes and especially low setup times make it necessary to develop new ways to interact with robots.

The focus of this project is to learn activities by observing the worker. Based on the results of the previous project, methods will be researched how to align visual infor­mation of objects with robotic motion.

For this purpose, powerful 2D image processing algorithms based on “deep learning” are synergistically combined with current developments in the field of “reinforcement learning”.

The main research goals of the project are:

*  Visual understanding of a demonstrated process through deep neural networks supported by instrumented tools.

* Generalization of process knowledge through deep reinforcement learning.

* Synthesis of movements for new parts using movement primitives.

Project name:
LERN4MRKII: Extended modelling, learning and abstraction of processes for human-robot cooperation.

Funding:
AIT Strategy Research Programme

Duration
01.01.2019 – 31.12.2019

The aim of the project is to enable non-experts with the opportunity to easily teach robots a complex assembly process using natural communication methods. In order for robot systems to learn from a non-expert user, the robot system should first understand the user’s intention. In this project, human intentions are understood both through verbal communication and by observing human actions. In order to recognize human intentions through voice communication, PROFACTOR will work together with LIFEtool on the development of a new communication interface for robots. LIFEtool, with its extensive knowledge of online and offline speech recognition technologies, will support PROFACTOR in developing an interface to communicate human intentions with the robot. PROFACTOR will develop a “portable” activity detection system capable of detecting human actions using low-cost sensors. A feasibility study will also be conducted in the process to partially validate the applicability of such activity/gesture recognition system to other domains (health care). The advantage of such a module would be its applicability to different scenarios requiring the understanding of human intentions.

The strategy to achieve the goal that non-experts can easily teach robot systems is twofold. First, a ‘learning by interaction’ framework is developed in which the robot provides the user with a set of intelligent suggestions during the learning process. The robot uses its knowledge modeling and argumentation skills and takes into account the “current situation” (detected with the activity detection system) of the assembly environment to make these suggestions. A ‘learning by instruction’ framework is then developed that allows the use of ‘Natural Language’ as a communication mode between the user and the robot. Both frameworks are then combined into a bidirectional communication channel between the user and the robot in order to provide feedback or to re-learn (in whole or in part) the assembly process.

Project name:
BRIDGE – HUMAN ROBOT INTERACTION (TEACHBOTS)

Industrial Project

Duration:
04.2019 – 12.2020

Partners:

Profactor GmbH

LIFEtool GmbH

Keywords: Human Robot Collaboration; Programming by Interaction; Programming by Instruction; Artificial Intelligence

SYNERGY aims at strengthening currently underdeveloped linkages, cooperation and synergies between companies, industry, research, intermediaries and policy makers in central Europe.  The project will analyse funded and finalised innovation projects and cluster institutions involved in projects into three key areas covering the most promising modern industrial technologies.

These areas include

• additive manufacturing and 3D printing,
• micro- and nanotechnology-related processes and materials, as well as
• the industry 4.0 sector.

Institutions and clusters included in each area will form ‘synergic networks’ based on a novel projects assessment methodology and a ‘synergic consortia matchmaking’ IT online tool. Moreover, the project will define new crowd innovation services and test them in different types of pilot actions. As a result, project activities will boost the creation of innovative services and facilitate transnational cooperation in the industrial sector.

Project name:
Synergy – SYnergic Networking for innovativeness Enhancement of central european actoRs focused on hiGh-tech industrY

Funding:

Interreg – Central Europe Programme

Duration:  
01.08.2017 – 31.07.2020

Website:
http://www.interreg-central.eu/Content.Node/SYNERGY.html

Collaborative lightweight robots are a trend in industry. They are comparatively cheap. Developments in the field of machine learning make them increasingly flexible and easier to use. The challenges for research are obvious. The machines must be equipped with cognitive intelligence in order to adapt to a changed environment and understand new tasks. The aims of the project go far beyond the state of the art of research.

The focus is on “transfer learning”: from manual human activities to the robot and from a product or process variant to a similar one.

The main research objectives of the project are

1. mapping of human motion to the robot
2. the “understanding” of temporal task correlations and process parameters by the robot
3. adaptability to similar processes with as few new examples as possible

No external cooperation is envisaged for the implementation of the project.

Project name:
LERN4MRK: Modellieren, Erlernen und Abstrahieren von Prozessen für die Mensch-Roboter Kooperation

Funding:
bmvit

Duration:  
01.07.2017 – 30.06.2021