Internship Openings

MERL is looking for a self-motivated intern to work on problems at the intersection of multimodal large language models and embodied AI in dynamic indoor environments. The ideal candidate would be a PhD student with a strong background in machine learning and computer vision, as demonstrated by top-tier publications. The candidate must have prior experience in designing synthetic scenes (e.g., 3D games) using popular graphics software, embodied AI, large language models, reinforcement learning, and the use of simulators such as Habitat/SoundSpaces. Hands on experience in using animated 3D human shape models (e.g., SMPL and variants) is desired. The intern is expected to collaborate with researchers in computer vision at MERL to develop algorithms and prepare manuscripts for scientific publications.

Required Specific Experience

• Experience in designing 3D interactive scenes
• Experience with vision based embodied AI using simulators (implementation on real robotic hardware would be a plus).
• Experience training large language models on multimodal data
• Experience with training reinforcement learning algorithms
• Strong foundations in machine learning and programming
• Strong track record of publications in top-tier computer vision and machine learning venues (such as CVPR, NeurIPS, etc.).

MERL is looking for a self-motivated graduate student to work on Visual Simultaneous Localization and Mapping (V-SLAM). Based on the candidate’s interests, the intern can work on a variety of topics such as (but not limited to): camera pose estimation, feature detection and matching, visual-LiDAR data fusion, pose-graph optimization, loop closure detection, and image-based camera relocalization. The ideal candidate would be a PhD student with a strong background in 3D computer vision and good programming skills in C/C++ and/or Python. The candidate must have published at least one paper in a top-tier computer vision, machine learning, or robotics venue, such as CVPR, ECCV, ICCV, NeurIPS, ICRA, or IROS. The intern will collaborate with MERL researchers to derive and implement new algorithms for V-SLAM, conduct experiments, and report findings. A submission to a top-tier conference is expected. The duration of the internship and start date are flexible.

Required Specific Experience

• Experience with 3D Computer Vision and Simultaneous Localization & Mapping.

MERL is seeking interns passionate about robotics to contribute to the development of an Active Simultaneous Localization and Mapping (Active SLAM) framework guided by Large Language Models (LLM). The core objective is to achieve autonomous behavior for mobile robots. The methods will be implemented and evaluated in high performance simulators and (time-permitting) in actual robotic platforms, such as legged and wheeled robots. The expectation at the end of the internship is a publication at a top-tier robotic or computer vision conference and/or journal.

The internship has a flexible start date (Spring/Summer 2025), with a duration of 3-6 months depending on agreed scope and intermediate progress.

Required Specific Experience

• Current/Past Enrollment in a PhD Program in Computer Engineering, Computer Science, Electrical Engineering, Mechanical Engineering, or related field
• Experience with employing and fine-tuning LLM and/or Visual Language Models (VLM) for high-level context-aware planning and navigation
• 2+ years experience with 3D computer vision (e.g., point cloud, voxels, camera pose estimation) and mapping, filter-based methods (e.g., EKF), and in at least some of: motion planning algorithms, factor graphs, control, and optimization
• Excellent programming skills in Python and/or C/C++, with prior knowledge in ROS2 and high-fidelity simulators such as Gazebo, Isaac Lab, and/or Mujoco

Additional Desired Experience

• Prior experience with implementation and/or development of SLAM algorithms on robotic hardware, including acquisition, processing, and fusion of multimodal sensor data such as proprioceptive and exteroceptive sensors

MERL is seeking an outstanding intern to collaborate in the development of motion planning and control for autonomous articulated vehicles. The ideal candidate is expected to be working towards a PhD in electrical, mechanical, aerospace engineering, robotics, control or related areas, with a strong emphasis on motion planning and control, possibly with applications to ground vehicles, to have experience in at least some of path/motion planning algorithms (A*, D*, graph-search) and optimization-based control (e.g., model predictive control), to have excellent coding skills in MATLAB/Simulink and a strong publication record. The expected start date is the Spring/Early Summer 2025 and the expected duration is 6-9 months, depending on candidate availability and interests.

Required Specific Experience

• Path/motion planning algorithms (A*, D*, graph-search)
• Nonlinear model predictive control
• Programming in Matlab/Simulink
• Applications to mobile robots or vehicles

Additional Useful Experience

• Nonlinear MPC Design in CasADi
• Code generation tools and dSPACE
• Applications to autonomous vehicles and articulated vehicles

MERL is seeking a graduate student to develop a scalable optimization-based framework for feedforward-feedback co-design for nonlinear dynamical systems subject to path constraints. The framework will 1) support modeling and operational uncertainties, and 2) guarantee static and dynamic feasibility in closed-loop. The solution approach will leverage the state-of-the-art in sequential convex programming, contraction analysis, and first-order methods for semidefinite programming. The methods will be evaluated on high-dimensional motion planning problems in robotics. The results of the internship are expected to be published in top-tier conferences and/or journal in robotics, control systems, and optimization.

The internship is expected to start in Spring or Summer 2025 with an expected duration of 3-6 months depending on the agreed scope and intermediate progress.

Required Specific Experience

• Current/Past enrollment in a Ph.D. program in Mechanical, Aerospace, Electrical Engineering, Computer Science, or Applied Mathematics.
• 2+ years of research in at least some of: first-order algorithms for SDPs, contraction analysis, nonconvex trajectory optimization.
• Strong programming skills in Python and/or C/C++.

MERL is looking for a highly motivated individual to work on whole-body dexterous manipulation. The research will develop robot motor skills for whole-body, dexterous manipulation using optimization and/or learning algorithms. The ideal candidate should have experience in either one or multiple of the following topics: Optimization Algorithms for contact systems, Reinforcement Learning, control through contacts, and Behavioral cloning. Senior PhD students in robotics and engineering with a focus on contact-rich manipulation are encouraged to apply. Prior experience working with physical robotic systems (and vision and tactile sensors) is required as results need to be implemented on a physical hardware. Good coding skills in Python ML libraries like PyTorch etc. and/or relevant Optimization packages is required. A successful internship will result in submission of results to a peer-reviewed robotics journal in collaboration with MERL researchers. The expected duration of internship is 4-5 months with start date in May/June 2025. This internship is preferred to be onsite at MERL.

Required Specific Experience

• Prior experience working with physical hardware system is required.
• Prior publication experience in robotics venues like ICRA,RSS, CoRL.

MERL is looking for a highly motivated and qualified intern to work on deep learning methods for detection and pose estimation of objects using vision and tactile sensing, in manufacturing and assembly environments. This role involves developing, fine-tuning and deploying models on existing hardware. The method will be applied for robotic manipulation where the knowledge of accurate position and orientation of objects within the scene would allow the robot to interact with the objects. The ideal candidate would be a Ph.D. student familiar with the state-of-the-art methods for pose estimation and tracking of objects. The successful candidate will work closely with MERL researchers to develop and implement novel algorithms, conduct experiments, and publish research findings at a top-tier conference. Start date and expected duration of the internship is flexible. Interested candidates are encouraged to apply with their updated CV and list of relevant publications.

Required Specific Experience

• Prior experience in Computer Vision and Robotic Manipulation.
• Experience with ROS and deep learning frameworks such as PyTorch are essential.
• Strong programming skills in Python.
• Experience with simulation tools, such as PyBullet, Issac Lab, or MuJoCo.

MERL is looking for a highly motivated individual to work on designing robot motor skills for contact-rich dexterous manipulation such as tool manipulation using visuotactile sensing. Through the internship, we develop closed-loop controller for dexterous manipulation that can stabilize manipulation even under unexpected contact events. A successful internship will result in the submission of results to a peer-reviewed robotics conference papers (e.g., RSS, ICRA, CoRL) or journal in collaboration with MERL researchers.

The expected duration of this internship is around 3 months with a start date in the Summer/Fall of 2025. This internship will be onsite at MERL.

Required Specific Experience

• Senior PhD students in robotics and engineering related field.

• Either (1) experience in machine learning for robotic manipulation such as reinforcement, representation, and imitation learning, with an emphasis on real-world deployments, or (2) experience in model-based optimization for contact-rich robotic manipulation such as trajectory optimization, MPC, and estimators.

• Experience in visuotactile sensors (e.g., GelSight, GelSlim, DIGIT)

• Familiarity with related frameworks in either (1) Machine Learning (e.g., PyTorch), or (2) model-based optimization (e.g., IPOPT, Gurobi).

• Experience working with physical hardware systems is required.

• Prior publication experience in robotics venues such as ICRA, RSS, IROS, and CoRL.

Additional Desired Experience

• Experience in computer vision.

• Experience in dexterous manipulation such as bimanual manipulation, tool manipulation, and whole-body manipulation.

• Familiarity with robotic simulators (e.g., MuJoCo).

• Experience in scalable software development (e.g., CI, unittests, OOP) in Python or C++.

MERL is offering a research internship opportunity in the field of loco-manipulation using legged robots. The position requires a robotics background, excellent programming skills and experience with Deep RL, locomotion and robotic manipulation and Computer Vision. The position is open to graduate students on a PhD track only, and the length of the internship is three months with the possibility of extending if required. The intern is expected to disseminate this research in top tier scientific conferences such as RSS, IROS, ICRA etc., and if applicable, help with filing associated patents. Start and end dates are flexible.

Required Specific Experience

• Experience in at least one programming language, preferably C++ or Python
• Experience in at least one physics simulator
• Familiarity with topics in robotic manipulation
• Familiarity with legged robots, preferably Unitree Go2
• Experience in Deep RL and corresponding training in simulation (Isaac Gym, Mujoco, etc)