TALK    [MERL Seminar Series 2023] Dr. Tanmay Gupta presents talk titled Visual Programming - A compositional approach to building General Purpose Vision Systems

Date & Time:

Tuesday, October 31, 2023; 2:00 PM

Abstract:

Building General Purpose Vision Systems (GPVs) that can perform a huge variety of tasks has been a long-standing goal for the computer vision community. However, end-to-end training of these systems to handle different modalities and tasks has proven to be extremely challenging. In this talk, I will describe a lucrative neuro-symbolic alternative to the common end-to-end learning paradigm called Visual Programming. Visual Programming is a general framework that leverages the code-generation abilities of LLMs, existing neural models, and non-differentiable programs to enable powerful applications. Some of these applications continue to remain elusive for the current generation of end-to-end trained GPVs.

Speaker:

Tanmay Gupta
Allen Institute for Artificial Intelligence

Tanmay Gupta is a research scientist in the PRIOR team at the Allen Institute for Artificial Intelligence (AI2). Tanmay received his PhD from UIUC where he was advised by Prof. Derek Hoiem and closely collaborated with Prof. Alex Schwing. Tanmay has received the CVPR 2023 Best Paper Award for his work on Visual Programming; Outstanding Reviewer Awards at ICCV 2023, CVPR 2021, and ECCV 2020; and served as an Area Chair for CVPR 2023 and NeurIPS 2023.

MERL Host:

Moitreya Chatterjee

Research Areas:

Artificial Intelligence, Computer Vision, Machine Learning