Two Fellow researcher positions on: Learning by demonstration and foundation models for robot programming and control in in dynamic and unpredictable environments
- (2400007H)

Project: Horizon Europe - HORIZON-RIA - Acronym: TORNADO - Project number: 101189557
Commitment & contract: collaborator, 1-year, temporary contract, extendable
Location: IIT - Center for Robotics and Intelligent Systems, Via S. Quirico, 19d, 16163 Genova
JOB DESCRIPTION
The advent of foundation models, particularly large language models (LLMs) and vision-language models (VLMs), has revolutionized the field of artificial intelligence, enabling unprecedented levels of understanding and interaction. This research theme explores the integration of these cutting-edge technologies into the control systems of collaborative robots (cobots), focusing on achieving full autonomy and enhancing human-robot collaboration.
By leveraging foundation models, this research aims to develop innovative frameworks that allow cobots to understand and respond to human commands in natural language, interpret visual cues, and make autonomous decisions based on real-time data.
The selected candidates will investigate the application of LLMs to enable natural language understanding, allowing cobots to interact seamlessly with human operators. This includes designing systems that can interpret context, engage in multi-turn dialogues, and provide actionable feedback. In parallel, the use of VLMs will be explored to enhance the robots' visual perception capabilities, enabling them to comprehend and react to visual stimuli in their surroundings.
The proposed research will involve developing hybrid control architectures that combine the strengths of LLMs and VLMs with advanced control strategies, such as model predictive control (MPC) and reinforcement learning (RL). The selected candidates will have the opportunity to create adaptive algorithms that empower cobots to learn from their interactions, improving their performance and safety in real-world applications.
This theme not only promises to advance the theoretical understanding of AI in robotics but also emphasizes practical implementation, targeting industries such as healthcare, logistics, and manufacturing. By participating in this research, the fellows will contribute to pioneering work that bridges the gap between AI and robotics, ultimately leading to the next generation of intelligent, collaborative systems.
We are seeking motivated and innovative candidates who are passionate about robotics and AI. Join us in shaping the future of human-robot interaction, where cobots will work alongside humans, enhancing productivity and safety in various environments. With guidance from leading experts in the field, you will gain hands-on experience and contribute to cutting-edge research that has the potential to transform industries.
WHO WE ARE
At IIT we work enthusiastically to develop human-centered Science and Technology to tackle some of the most pressing societal challenges of our times and transfer these technologies to the production system and society. Our Genoa headquarter is strictly inter-connected with our 11 centers around Italy and two outer-stations based in the US for a truly interdisciplinary experience.
YOUR TEAM
You will be working in a multicultural and multi-disciplinary group, where biomedical, robotics, mechanical, electrical, and computer science engineers collaborate, each with their own expertise, to carry out common research.
The Human- Robot interfaces and Interaction (HRI²) Research Unit is coordinated by Dr. Arash Ajoudani, who has extensive experience in physical human-robot interaction, applied machine learning, mobile manipulation, robust and adaptive control, assistive robotics, and tele-robotics.
WHAT WOULD MAKE YOU SHINE

• A master’s degree in Machine Learning, robotics, or similar disciplines
• Strong skills in Python and C++
• Experience on frameworks like Pytorch or Tensor Flow
• Experience with ROS
• Confidence with version control tools (specifically git)
• Publications are a plus
• The ability to properly report, organize and publish research data
• Good command in spoken and written English

EXTRA AWESOME

• Good communication skills
• Strong problem solving attitude
• High motivation to learn
• Spirit of innovation and creativity
• Good in time and priority management
• Ability to work in a challenging and international environment
• Ability to work independently and collaboratively in a highly interdisciplinary environment

COMPENSATION & BENEFITS

• Competitive salary for international standards
• Private health care coverage
• Wide range of staff discounts

WHAT’S IN FOR YOU?

• An equal, inclusive and multicultural environment ready to welcome you with open arms. Discrimination is a big NO for us!
• We like contamination and encourage you to mingle and discover what other people are up to in our labs!
• If paperwork is not your piece of cake, we got you! There’s a specialized team working to help you with that, especially during your relocation!
• If you are a startupper or a business-minded person, you will find some exceptionally gifted professionals ready to nurture and guide your attitude and aspirations.
• If you want your work to have a real impact, in IIT you will find an innovative and stimulating culture that drives our mission to contribute to the improvement and well-being of society!
• We stick to our values! Integrity, courage, societal responsibility and inclusivity are the values we believe in! They define us and our actions in our everyday life. They guide us to accomplish IIT mission!

If you feel this tickles your appetite for change, do not hesitate and apply!
Please submit your application using the online form and including a detailed CV, university transcripts, cover letter (outlining motivation, experience and qualifications) and contact details of 2 references.
The position will be filled in as soon as a suitable candidate will be found.
Please note that this position is pending agreement signature
We inform you that the information you provide will be used solely for the purposes of evaluating and selecting professional profiles in order to meet the requirements of Istituto Italiano di Tecnologia.
Your data will be processed by Istituto Italiano di Tecnologia, based in Genoa, Via Morego 30, acting as Data Controller, in compliance with the rules on protection of personal data, including those related to data security.
Please also note that, pursuant to articles 15 et. seq. of European Regulation no. 679/2016 (General Data Protection Regulation), you may exercise your rights at any time by contacting the Data Protection Officer (phone Tel: +39 010 28961 - email: dpo@iit.it ).

Primary Location GENOVA

Job Fellow

Organization Human-Robot Interfaces and Interaction

Job Posting Oct 25, 2024, 10:06:45 AM