| CARVIEW |
Amit Raj
I am a Research Scientist at Google Research. I graduated with a PhD in Machine Learning working with Prof. James Hays in the College of Computing at Georgia Tech. My research interests lie in the intersection of Computer Vision, Graphics and Machine Learning. Particularly, I am interested in exploring generative models for images conditioned on sparse user guidance to allow 2D or 3D content authoring. I am also interested in exploring the use of 3d information for more controllable and interprettable neural image synthesis.
I did my Masters in ECE with a specialization in Signal processing and Controls at Georgia Tech. Before that, I did my Bachelors at National Institute of Technology, Karnataka (NITK).
I also enjoy hiking, photography, making music and speed cubing
News
- [March 2022] Our work "DRaCoN -- Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars" is now out on arxiv
- [May 2021] Interning at Nvidia Research with Dr. Umar Iqbal, Dr. Koki Nagano, Dr. Sameh Khamis, Dr. Pavlo Molchanov and Dr. Jan Kautz
- [Feb 2021] 2 Papers accepted to CVPR 2021
- [May 2020] Interning at FRL, Pittsburgh with Dr. Stephen Lombardi, Dr. Michael Zollhoefer, Dr. Tomas Simon and, Dr. Shunsuke Saito
- [July 2019] Presenting our work on Learning to texture meshes at the 3D-WiDGET workshop at CVPR 2019
- [July 2019] Our work on Kernel Mean Matching for Content Addressability of GANs has been accepted to ICML 2019
- [May 2019] Interning at FRL, Sausalito with Dr. Carsten Stoll, Dr. Minh Vo and Dr. Christoph Lassner
- [Dec 2018] Our work on Variational inpainting presented at the Bayesian Deep Learning Workshop at NeurIPS 2018
- [Sept 2018] Presenting our work on SwapNet at ECCV2018
- [May 2018] I am interning at Adobe Research, Seattle with Dr. Connelly Barnes
-
DRaCoN -- Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars
Amit Raj, Umar Iqbal, Koki Nagano, Sameh Khamis, Pavlo Molchanov, James Hays, Jan Kautz
arXiv:2203.15798 -
PVA: Pixel-aligned Volumetric Avatars
Amit Raj, Michael Zollhoefer, Tomas Simon, Jason Saragih, Shunsuke Saito, James Hays, Stephen Lombardi
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021 -
ANR: Articulated Neural Rendering for Virtual Avatars
Amit Raj, Julian Tanke, James Hays, Minh Vo, Carsten Stoll, Christoph Lassner
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021 -
Learning to Generate Texture on 3D Meshes
Amit Raj, Connelly Barnes, Vladimir Kim, Jingwan Lu, James Hays
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019 - 3D WiDGET workshop (Best Paper Award) -
Kernal Mean Matching for Content Adressability of GANs
Wittawatt Jittkritum*, Patsorn Sangkloy*, Muhammad Waleed Gondal, Amit Raj, James Hays, Bernard Scholkopf
International Conference on Machine Learning (ICML) 2019 -
Variational Image inpainting
Amit Raj, Cusuh Ham, Vincent Cartillier, Irfan Essa
Neural Information processing Systems (NeurIPS) workshop on Bayesian Deep Learning 2018 -
SwapNet: Image based garment transfer
Amit Raj, Patsorn Sangkloy, Huiwen Chang, James Hays, Duygu Ceylan, Cynthia Lu
European Conference on Computer Vision (ECCV) 2018 -
TextureGAN: Controlling Deep Image Synthesis with Texture Patches
Wenxi Xian*, Patsorn Sangkloy*, Varun Agarwal, Amit Raj, Jingwan Lu, Chen Fang, Fisher Yu, James Hays
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018 -
Deep Forward and Inverse Perceptual Models for Tracking and Prediction
Alexander Lambert, Amirreza Shaban, Amit Raj, Zhen Liu, Byron Boots
International Conference on Robotics and Automation (ICRA) 2018 -
CompositionalGAN
Amit Raj, Cusuh Ham, Vincent Cartillier, Huda Alamri, Stefan Lee, James Hays
Neural Information Processing Systems (NIPS) workshop on Visually Grounded Interaction and Language (ViGIL) 2017 - CS 6476 Computer Vision TA with Prof. James Hays
- CS 6475 Computational Photography TA with Prof. Irfan Essa