Applied science · Efficient AI
Deepak K. Gupta
I lead a team of ML scientists working on efficient AI, connecting machine-learning research with systems that can be deployed in practice.
I am an Applied Science Manager at Amazon, where I lead a team of 10+ ML scientists across India, Europe and the US working on model compression. I previously served as adjunct faculty at IIT (ISM) Dhanbad.
Previously, I founded Transmute AI Lab at IIT (ISM) Dhanbad and co-founded Nyun AI, which was acqui-hired by Amazon in 2025. I have also worked at AIQ, the University of Amsterdam’s QUVA Lab, and Shell Technology Centre. My work connects academic research with applications in industry, including healthcare, energy and subsurface modelling.
I earned my PhD in Computational Engineering at TU Delft. Before that, I completed an integrated B.Sc. and M.Sc. in Geophysics at IIT (ISM) Dhanbad in 2013, receiving the Director’s Gold Medal.
Research & publications
My research focuses on making machine-learning models more efficient, particularly through model compression and efficient inference for foundation models. I also work on computer vision and visual tracking, with earlier research in computational optimisation. My applied work spans healthcare, energy and subsurface modelling.
Selected publications
Selected work through 2025 is listed below. See Google Scholar for the complete publication record.
2024
- Surgical Feature-Space Decomposition of LLMs: Why, When and How?
Arnav Chavan, Nahush Lele, Deepak Gupta
ACL 2024 · Paper
- Partial Binarization of Neural Networks for Budget-Aware Efficient Learning
Udbhav Bamba, Neeraj Anand, Saksham Aggarwal, Dilip K. Prasad, Deepak K. Gupta
WACV 2024 · Paper
- Rethinking Compression: Reduced Order Modelling of Latent Features in Large Language Models
Arnav Chavan, Nahush Lele, Deepak Gupta
ICLR 2024 · Tiny Papers · Paper
- Parameter Efficient Fine-Tuning for Deep Learning-Based Full-Waveform Inversion
Koustav Ghosal, Abhranta Panigrahi, Arnav Chavan, Arun Singh, Deepak Gupta
arXiv preprint · 2024 · Paper
Academic service
- Lead organiser, AdaptFM workshop, ICML 2026: resource-adaptive foundation model inference.
- Lead organiser, Resource-Efficient Deep Learning for Computer Vision workshop, ICCV 2023.
- Reviewer for IJCV, NeurIPS, ICML, ICLR and CVPR.
Software & applied research
Nyuntam is an open-source PyTorch library for pruning, quantisation, distillation and low-rank decomposition. At Nyun AI, my team also developed Zero, a commercial model-optimisation platform. My patent portfolio includes 2 granted, 1 filed and 3 provisional patents.