I am a final year PhD candidate in the Electrical and Computer Engineering department at the University of Washington, Seattle. I am a part of MELODI (MachinE Learning, Optimization, and Data Interpretation) Lab, where I am fortunate to be advised by Prof. Jeff Bilmes.
My research focuses on developing novel data-centric approaches to enhance the efficiency and effectiveness of machine learning models, particularly large language models (LLMs) and their applications.
Long-range Context Modeling for Infinite-Context Transformers: I explored submodular optimization to dynamically summarize and manage the key-value (KV) cache in LLMs, enabling infinite-context language modeling (BumbleBee, COLM 2024). This approach allows LLMs to process arbitrarily long input sequences without proportional memory increase, balancing diversity and importance in context selection while maintaining model performance.
Data-efficient Few-shot Learning & RAG: I developed frameworks utilizing submodar optimization for various low-data scenarios. I proposed a novel Submodular Span Summarization (S3, AAAI 2021) method for query-focused multimodal summarization and utilized this along with a diversity-objective focused retrieval for label-efficient in-context learning using LLMs (Div-S3, NAACL 2024). I studied the use of submodular functions for retrieving diverse and relevant details from historial context for persona-based conversational agents (RAG-DM, ENLSP@NeurIPS 2023) as well as for efficient few-shot learning using Vision-Language Models (VLMs) (COBRA, DMLR@ICML 2024).
Data Augmentation for Continual Learning: I explored an adversarial data augmentation method (RAR, NeurIPS 2022) for continual (lifelong) learning, synthesizing adversarial samples near the forgetting boundary. This approach helps refine the boundary between previous and current tasks, combating forgetting and reducing bias towards the current task.
Prior to joining UW, I worked as a ML engineer in Intelligent Services team of Adobe Sensei at Adobe Systems, Bangalore.
I completed my Bachelors in Electrical Engineering from Indian Institute of Technology, Roorkee, where I graduated as a Silver Medalist.
Get my resume in PDF format here.