Here are a selection of projects that I have worked on.
QuaCer-C is a framework for quantitatively certifying the knowledge comprehension capabilities of Large Language Models (LLMs). Using the structured nature of knowledge graphs, we are able to derive specifications for reasoning over unstructured data like text providing a way to formally understanding reasoning using exact confidence intervals. Authors: Isha Chaudhary, Vedaant Jain, Gagandeep Singh
HumorDB is a novel image-only dataset designed to advance visual humor understanding in AI systems. It consists of carefully curated image pairs with contrasting humor ratings, emphasizing subtle visual cues that trigger humor while mitigating potential biases. The dataset enables evaluation through binary classification, range regression, and pairwise comparison tasks. Authors: Vedaant Jain, Felipe Feitosa, Gabriel Kreiman
This project addresses limitations in Parkinson’s Disease (PD) research by creating synthetic data that aims to simulate changes in facial features associated with PD progression. Using diffusion models and inpainting techniques, we developed a pipeline to generate realistic image pairs representing the transition from healthy to PD-affected facial states. Additionally, we utilized evaluations based on training classification models on the synthetic data. We also explored Model generalization using subset of FFHQ dataset and saw improvement by 5% over previous model baseline.
This project explores the application of Curriculum Learning to improve the performance of GPT-2 models in Embodied Natural Language Processing tasks using the ALFWorld dataset. We developed curricula for both Action Modeling and Reinforcement Learning stages, demonstrating significant improvements in task success rates and action efficiency. Authors: Bohan Liu, Vedaant Jain, Aarohi Gupta
This project explores the potential of Large Language Models (LLMs) to accurately simulate user behavior in Reddit communities. We investigate if LLMs can effectively mimic the communication patterns of specific users when provided with their comment history as context, focusing on the r/science subreddit. Authors: Vedaant Jain*, Yoshee Jain∗, Ishq Gupta, Aditi Shrivastava, Koustuv Saha, Eshwar Chandrasekharan
