Robotics

MERL is looking for a highly motivated and qualified intern to work on deep learning methods for detection and pose estimation of objects using vision and tactile sensing, in manufacturing and assembly environments. This role involves developing, fine-tuning and deploying models on existing hardware. The method will be applied for robotic manipulation where the knowledge of accurate position and orientation of objects within the scene would allow the robot to interact with the objects. The ideal candidate would be a Ph.D. student familiar with the state-of-the-art methods for pose estimation and tracking of objects. The successful candidate will work closely with MERL researchers to develop and implement novel algorithms, conduct experiments, and publish research findings at a top-tier conference. Start date and expected duration of the internship is flexible. Interested candidates are encouraged to apply with their updated CV and list of relevant publications.

Required Specific Experience

• Prior experience in Computer Vision and Robotic Manipulation.
• Experience with ROS and deep learning frameworks such as PyTorch are essential.
• Strong programming skills in Python.
• Experience with simulation tools, such as PyBullet, Issac Lab, or MuJoCo.

MERL is seeking an outstanding intern to collaborate with the Control for Autonomy team in the development of trajectory generation for mobile robots, e.g., drones, equipped with controllable sensors, for information acquisition tasks. The project objective is to optimize drone trajectories and the control of on board sensors (e.g., field of view, pointing angle, etc.) to maximize the amount of information acquired about specified monitored targets while reducing the mission duration. The ideal candidate is expected to be working towards a PhD with a strong emphasis on trajectory generation and control, optimization-based control and planning algorithms and constrained control. Strong programming skills in at least one among Matlab, Python, Julia, C/C++ are required. Experience with experimental drone platforms such as crazyflie, and related software frameworks, such as ROS, are desired. The expected start date is in the late Spring/Early Summer 2025, for a duration of 3-6 months.

Required Specific Experience

• Currently enrolled in a PhD program in Aerospace, Electrical, Mechanical Engineering, Computer Science, Applied Math or a related field
• 2+ years of research in at least some of: optimization-based trajectory generation, convex and non-convex optimization, sensor modeling, information-aware planning
• Strong programming skills in at least one among Matlab, Python, Julia, or C/C++
• Validation of drone planning and control in simulations. Experience with drone experiments is a plus.

MERL is looking for a self-motivated intern to work on problems at the intersection of multimodal large language models and embodied AI in dynamic indoor environments. The ideal candidate would be a PhD student with a strong background in machine learning and computer vision, as demonstrated by top-tier publications. The candidate must have prior experience in designing synthetic scenes (e.g., 3D games) using popular graphics software, embodied AI, large language models, reinforcement learning, and the use of simulators such as Habitat/SoundSpaces. Hands on experience in using animated 3D human shape models (e.g., SMPL and variants) is desired. The intern is expected to collaborate with researchers in computer vision at MERL to develop algorithms and prepare manuscripts for scientific publications.

Required Specific Experience

• Experience in designing 3D interactive scenes
• Experience with vision based embodied AI using simulators (implementation on real robotic hardware would be a plus).
• Experience training large language models on multimodal data
• Experience with training reinforcement learning algorithms
• Strong foundations in machine learning and programming
• Strong track record of publications in top-tier computer vision and machine learning venues (such as CVPR, NeurIPS, etc.).