I am a PhD student at Mila, University of Montreal, I am supervised by Prof. Christopher Pal. I am currently a Visiting Researcher with Prof. Graham Taylor at the University of Guelph. I also work as an AI Advisor to Blue Lion Labs.

My main research interests are in computer vision and deep learning. My projects span multi-scale image generation; self-supervised video predition using dynamical modelling; neural rendering; multi-modal GANs; unsupervised physics estimation from video using differentiable 3D simulation.

In Fall 2019, I was a Research Intern at Google, Mountain View in the Google AI Perception team. In 2019 and 2020, I was an AI Scientist in Residence at NextAI.

Previously, I worked as a Research Fellow with Prof. C. V. Jawahar at IIIT-Hyderabad on automated lip synthesis for translation of a video into a different languages. I was a Mentor for the first Foundations of AI/ML certificate program for industry professionals by IIIT-H Machine Learning Lab.

Prior to that, I worked at GreyOrange Robotics on real time embedded vision in videos for warehouse automation, and autonomous robots; and at Airbus, India on software development and integration.

I graduated from the Indian Institute of Technology (IIT), Kharagpur, India, in 2014 with a Dual Degree (B.Tech. (H) + M.Tech.) in Electrical Engineering, my Master’s specialization is Instrumentation and Signal Processing.

News

April 7, 2021 Released gradSim on arXiv! Visit our wesite - gradsim.github.io! Released video for gradSim!
February 15, 2021 Presented "Score-based Generative Models using Neural SDEs" at Mila, Montreal, Canada [slides]
Jan 18, 2021 Paper accepted at MLSys 2021! "Accounting for Variance in Machine Learning Benchmarks"
Jan 13, 2021 Paper accepted at ICLR 2021! "gradSim - Differentiable simulation for system identification and visuomotor control" [OpenReview]
Dec 10-11, 2020 Organized GRAPHQUON 2020 (formerly MOTOGRAPH)
Dec 6-12, 2020 Attended NeurIPS 2020 (virtually)
October 1, 2020 Started working as an AI Advisor to Blue Lion Labs
September 1, 2020 Presented "Continuous Normalizing Flows" at Mila, Montreal, Canada [slides]
September 11, 2020 Short paper "Introducing GradSim - Differentiable Simulation for Self-Supervised Parameter Estimation from Video" accepted at the Montreal AI Symposium 2020, Canada    [pdf]
August 28, 2020 Passed my PhD qualifiers! Onto the thesis stage!
July 25, 2020 Presented "GANs - the story so far" at the Summer Symposium on AI Research, India [slides] [video]
July 10, 2020 Presented "A brief tutorial on Neural ODEs" at Mila, Montreal, Canada [slides] [video]
June 14-19, 2020 Attended CVPR 2020 (virtually)
June 2, 2020 Paper accepted at ICML 2020! Sarthak Mittal, Alex Lamb, Anirudh Goyal, Vikram Voleti, Murray Shanahan, Guillaume Lajoie, Michael Mozer, Yoshua Bengio, "Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules" [arxiv]
Apr 26 - May 1, 2020 Attended ICLR 2020 (virtually)
April 2, 2020 Gave a tutorial on the "Mathematics of Neural ODEs" at the University of Guelph, Canada [slides]
March 24, 2020 - September 30, 2020 AI Scientist in Residence at NextAI, Toronto, Canada; consultant for multiple startups
January 7, 2020 Gave a talk on "Simple Video Generation using Neural ODEs" at IIIT Hyderabad, India    [pdf]
December 15, 2019 Joined Prof. Graham Taylor's lab as a Visiting Researcher at the University of Guelph, Canada.
December 9-14, 2019 Attended NeurIPS 2019, Vancouver, Canada; presented "Simple Video Generation using Neural ODEs" in the Workshop on Learning with Rich Experience! [paper, poster]
December 9, 2019 Attended AICan 2019, the second annual meeting of the Pan-Canadian AI Strategy; presented "Simple Video Generation using Neural ODEs" [paper]
September 16, 2019 - December 6, 2019 Research Intern at Google, Mountain View in the Google AI Perception team, with Bryan Seybold and Sourish Chaudhuri. Worked on Semi-supervised Active Speaker Detection in videos.
September 9-13, 2019 Teaching Assistant at the 4th IVADO / Mila Deep Learning School, Montreal, Canada
September, 2019 Teaching Assistant for the Fundamentals of Machine Learning (IFT 6390) course by Ioannis Mitliagkas at the University of Montreal, Montreal, Canada
July 7-10, 2019 Attended RLDM 2019, Montreal, Canada
June 16-20, 2019 Attended CVPR 2019, Long Beach, California
June 9-15, 2019 Attended ICML 2019, Long Beach, California; presented "Comparing normalization in conditional computation tasks" in the Workshop on Understanding and Improving Generalization in Deep Learning! [paper, poster]
May 31, 2019 Paper accepted at ICML 2019 Workshop on Understanding and Improving Generalization in Deep Learning! Paper title - "Comparing normalization in conditional computation tasks" [pdf]
May 30, 2019 Gave a tutorial on "GANs" at the AI for Social Good Summer Lab (AI4Good)! Followed these excellent slides (not mine) - [pdf]
May 12-17, 2019 Attended ICASSP 2019, Brighton, UK; presented "Cross-Language Speech Dependent Lip-Synchronization"; [IEEE, paper, poster]
April 2019 - Aug 2019 Worked as an AI Scientist in Residence at NextAI, Montreal, Canada; consulted for 6 startups at NextAI
February 01, 2019 Paper accepted at ICASSP 2019! "Cross-Language Speech Dependent Lip-Synchronization" - Abhishek Jha, Vikram Voleti, Vinay P. Namboodiri, C. V. Jawahar    [pdf]
January 16, 2019 Released code of Self-Attention GAN in PyTorch on GitHub [url]
December 02-08, 2018 Attended NeurIPS 2018, Montreal, Canada
October 30, 2018 Presented "(BigGAN) Large Scale GAN Training for High Fidelity Natural Image Synthesis" at Mila, University of Montreal, Canada    [pdf]
September 24, 2018 Presented "Visualizing the Loss Landscapes of Neural Nets" at Mila, University of Montreal, Canada    [pdf]
September 4, 2018 Joined Mila as a PhD student at the Department of Computer Science and Operations Research, University of Montreal [url]
June 6, 2018 Presented "Linear Algebra - Groups, Vector Spaces, Matrix Transformations" at CVIT, IIIT Hyderabad, India, as part of the Linear Algebra course by Lovish Chum    [pdf]
May 25, 2018 Short paper accepted at CVPR 2018 Workshop (FIVER)! "Lip-Synchronization for Dubbed Instructional Videos"    [pdf] [url]
April 26, 2018 Presented "Lipreading in the Wild" at CVIT, IIIT Hyderabad, India    [pdf]
February 26, 2018 Presented "Image de-fencing using RGB-D data" at Max Planck Institute for Informatics, Saarbrücken, Germany    [pdf]
February 18, 2018 Presented "Mathematics in Sanskrit Poetry" at CVIT, IIIT Hyderabad, India    [pdf]
February 2, 2018 Presented "Intuition behind LSTMs" at CVIT, IIIT Hyderabad, India    [pdf]
January 10, 2018 Presented "A Multimodal Approach for Image De-fencing and Depth Inpainting" at CVIT, IIIT Hyderabad, India [url]
January 5, 2017 Started work as "Mentor" for Foundations of Artificial Intelligence and Machine Learning by TalentSprint
December 29-31, 2017 Attended conference ICIDE 2017, Dubai; presented "Simple Real-Time Pattern Recognition for Industrial Automation"    [pdf]
November 11-12, 2017 Won the SMS Classification challenge, participated in the Video Action Recognition challenge at Hack2Innovate hackathon in Bangalore, India
August 9, 2017 Presented "Mathematics behind Back-propagation" at CVIT, IIIT Hyderabad, India [url]
July 10-15, 2017 Attended IIIT Hyderabad's Summer School on Machine Learning; ranked 4th among all participants [notes]
July 3-8, 2017 Attended IIIT Hyderabad's Summer School on Computer Vision; ranked 3rd among all participants [notes]
May 15, 2017 Joined CVIT, IIIT Hyderabad, India as a researcher under Prof. C. V. Jawahar
April 9, 2017 Presented "Mathematics behind Back-propagation" at GreyOrange Robotics, India [url]