I'm an AI researcher at UC Berkeley, where I work on generative models. My work includes diffusion models, text-to-3D with NeRFs, and scalable ML systems.
Previously, I was at Google Brain, NVIDIA Research, Uber ATG, and Facebook AI. I graduated from MIT with an S.B. in Computer Science and was a director of the nonprofit Machine Intelligence Community. At MIT, I did research at CSAIL and the Media Lab. My research is supported by the NSF Graduate Research Fellowship.
Email: ajayj at berkeley dot edu
News
New!July 2022: Dream Fields wins the Best Poster award at AI4CC
New!May 2022: AdaCat accepted to UAI 2022
March 2022: Dream Fields accepted to CVPR 2022
Aug 2021: ContraCode accepted to EMNLP 2021
July 2021: DietNeRF accepted to ICCV 2021
Featured Publications * indicates equal contribution
VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Models
Ajay Jain*, Amber Xie*, Pieter Abbeel
arXiv 2022
Generate vector graphics (SVGs), pixel art and sketches from text using the pretrained Stable Diffusion model.
Zero-Shot Text-Guided Object Generation with Dream Fields
Ajay Jain, Ben Mildenhall, Jon Barron, Pieter Abbeel, Ben Poole
CVPR 2022 Conference on Computer Vision and Pattern Recognition
We combine neural rendering with multi-modal image and text representations to synthesize diverse 3D objects solely from natural language descriptions.
Paras Jain*, Ajay Jain*, Tianjun Zhang, Pieter Abbeel, Joseph E. Gonzalez, Ion Stoica
EMNLP 2021 Empirical Methods in Natural Language Processing
Learn to represent software functionality for automated software engineering tasks like type inference, clone detection and summarization. Improving robustness of ML4Code.
Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis
Ajay Jain, Matthew Tancik, Pieter Abbeel
ICCV 2021 International Conference on Computer Vision
CLIP + NeRF: Given only a few images of an object or scene, we reconstruct its 3D structure & render novel views using prior knowledge contained in large image encoders.
C. Mirabito, D.N. Subramani, T. Lolla, J. P.J. Haley, A. Jain, P.F.J. Lermusiaux, C. Li, D. Yue, Y. Liu, F. Hover, N. Pulsone, J. Edwards, K. Railey, and G. Shaw