TWO FELLOW RESEARCHER POSITIONS ON: LEARNING BY DEMONSTRATION AND FOUNDATION MODELS FOR ROBOT P[...]

Two Fellow researcher positions on: Learning by demonstration and foundation models for robot programming and control in dynamic and unpredictable environments - (2400007H) Project: Horizon Europe - HORIZON-RIA - Acronym: TORNADO - Project number: ... Commitment & contract: collaborator, 1-year, temporary contract, extendable Location: IIT - Center for Robotics and Intelligent Systems, Via S. Quirico, 19d, 16163 Genova JOB DESCRIPTION The advent of foundation models, particularly large language models (LLMs) and vision-language models (VLMs), has revolutionized the field of artificial intelligence, enabling unprecedented levels of understanding and interaction. This research theme explores the integration of these cutting-edge technologies into the control systems of collaborative robots (cobots), focusing on achieving full autonomy and enhancing human-robot collaboration. By leveraging foundation models, this research aims to develop innovative frameworks that allow cobots to understand and respond to human commands in natural language, interpret visual cues, and make autonomous decisions based on real-time data. The selected candidates will investigate the application of LLMs to enable natural language understanding, allowing cobots to interact seamlessly with human operators. This includes designing systems that can interpret context, engage in multi-turn dialogues, and provide actionable feedback. In parallel, the use of VLMs will be explored to enhance the robots' visual perception capabilities, enabling them to comprehend and react to visual stimuli in their surroundings. The proposed research will involve developing hybrid control architectures that combine the strengths of LLMs and VLMs with advanced control strategies, such as model predictive control (MPC) and reinforcement learning (RL). The selected candidates will have the opportunity to create adaptive algorithms that empower cobots to learn from their interactions, improving their performance and safety in real-world applications. This theme not only promises to advance the theoretical understanding of AI in robotics but also emphasizes practical implementation, targeting industries such as healthcare, logistics, and manufacturing. By participating in this research, the fellows will contribute to pioneering work that bridges the gap between AI and robotics, ultimately leading to the next generation of intelligent, collaborative systems. WHO WE ARE At IIT we work enthusiastically to develop human-centered Science and Technology to tackle some of the most pressing societal challenges of our times and transfer these technologies to the production system and society. Our Genoa headquarter is strictly inter-connected with our 11 centers around Italy and two outer-stations based in the US for a truly interdisciplinary experience. YOUR TEAM You will be working in a multicultural and multi-disciplinary group, where biomedical, robotics, mechanical, electrical, and computer science engineers collaborate, each with their own expertise, to carry out common research. The Human-Robot interfaces and Interaction (HRI²) Research Unit is coordinated by Dr. Arash Ajoudani, who has extensive experience in physical human-robot interaction, applied machine learning, mobile manipulation, robust and adaptive control, assistive robotics, and tele-robotics. WHAT WOULD MAKE YOU SHINE A master’s degree in Machine Learning, robotics, or similar disciplines Strong skills in Python and C++ Experience on frameworks like Pytorch or TensorFlow Experience with ROS Confidence with version control tools (specifically git) Publications are a plus The ability to properly report, organize and publish research data Good command in spoken and written English EXTRA AWESOME Good communication skills Strong problem solving attitude High motivation to learn Spirit of innovation and creativity Good in time and priority management Ability to work in a challenging and international environment Ability to work independently and collaboratively in a highly interdisciplinary environment COMPENSATION & BENEFITS Competitive salary for international standards Private health care coverage Wide range of staff discounts WHAT’S IN FOR YOU? An equal, inclusive and multicultural environment ready to welcome you with open arms. Discrimination is a big NO for us! We like contamination and encourage you to mingle and discover what other people are up to in our labs! If paperwork is not your piece of cake, we got you! There’s a specialized team working to help you with that, especially during your relocation! If you are a startupper or a business-minded person, you will find some exceptionally gifted professionals ready to nurture and guide your attitude and aspirations. If you want your work to have a real impact, in IIT you will find an innovative and stimulating culture that drives our mission to contribute to the improvement and well-being of society! We stick to our values! Integrity, courage, societal responsibility and inclusivity are the values we believe in! They define us and our actions in our everyday life. They guide us to accomplish IIT mission! If you feel this tickles your appetite for change, do not hesitate and apply! Please submit your application using the online form and including a detailed CV, university transcripts, cover letter (outlining motivation, experience and qualifications) and contact details of 2 references. The position will be filled in as soon as a suitable candidate will be found. Please note that this position is pending agreement signature. We inform you that the information you provide will be used solely for the purposes of evaluating and selecting professional profiles in order to meet the requirements of Istituto Italiano di Tecnologia. Your data will be processed by Istituto Italiano di Tecnologia, based in Genoa, Via Morego 30, acting as Data Controller, in compliance with the rules on protection of personal data, including those related to data security. Please also note that, pursuant to articles 15 et. seq. of European Regulation no. 679/2016 (General Data Protection Regulation), you may exercise your rights at any time by contacting the Data Protection Officer (phone Tel: +39 010 28961 - email: ...). Primary Location : GENOVA Job : Fellow Organization : Human-Robot Interfaces and Interaction Job Posting : Oct 25, 2024, 10:06:45 AM #J-18808-Ljbffr