| CARVIEW |
Select Language
HTTP/2 200
server: GitHub.com
content-type: text/html; charset=utf-8
last-modified: Wed, 24 Dec 2025 10:38:06 GMT
access-control-allow-origin: *
etag: W/"694bc28e-2b458"
expires: Sun, 28 Dec 2025 17:24:08 GMT
cache-control: max-age=600
content-encoding: gzip
x-proxy-cache: MISS
x-github-request-id: 9693:15317B:7DA3C7:8CDB88:69516560
accept-ranges: bytes
age: 0
date: Sun, 28 Dec 2025 17:14:08 GMT
via: 1.1 varnish
x-served-by: cache-bom-vanm7210051-BOM
x-cache: MISS
x-cache-hits: 0
x-timer: S1766942049.746599,VS0,VE208
vary: Accept-Encoding
x-fastly-request-id: 323e2966832a6079c7e3daa1a2ba6afb8109e00d
content-length: 22407
Ning Yu's Homepage
I am the lead research scientist at Netflix Eyeline, leading efforts in visual and multimodal generative AI. My research aspirations lie in controllable and customizable recreation of the world via generative AI, based on representations of multimodal contents and interactions between users and models.
I hold a joint Ph.D. from the University of Maryland and Max Planck Institute for Informatics where I was supervised by Larry Davis and Mario Fritz. I previously worked with Salesforce, NVIDIA, and Adobe.
My selected works include MAViS, VChain, Virtually Being, DEGS, FlashDepth, Go-with-the-Flow, Lux Post Facto, UniControl, X-InstructBLIP, ULIP-2, LayoutDETR, GlueGen, HIVE, Contrast and Attention GANs, Scalable GAN Fingerprints, Artificial GAN Fingerprints, GAN Fingerprints, Inclusive GAN, and Texture Mixer. My research was featured in media press such as Salesforce Newsletter, AlmostHuman, AIera, JiangMen, QbitAI, innovations report, and FoodPlus.
I am constantly dedicated to academic services, such as serving as (Lead) Area Chair for CVPR, ICCV, ECCV, NeurIPS, ICLR, ICML, AAAI, AISTATS, WACV, and BMVC.
I am a recipient of the CSAW Europe Best Paper Finalist, Twitch (Amazon) Research Fellowship, Microsoft Young Fellowship, Qualcomm Innovation Fellowship Finalist x2, and SPIE Best Student Paper Finalist.
About me
I am the lead research scientist at Netflix Eyeline, leading efforts in visual and multimodal generative AI. My research aspirations lie in controllable and customizable recreation of the world via generative AI, based on representations of multimodal contents and interactions between users and models.
I hold a joint Ph.D. from the University of Maryland and Max Planck Institute for Informatics where I was supervised by Larry Davis and Mario Fritz. I previously worked with Salesforce, NVIDIA, and Adobe.
My selected works include MAViS, VChain, Virtually Being, DEGS, FlashDepth, Go-with-the-Flow, Lux Post Facto, UniControl, X-InstructBLIP, ULIP-2, LayoutDETR, GlueGen, HIVE, Contrast and Attention GANs, Scalable GAN Fingerprints, Artificial GAN Fingerprints, GAN Fingerprints, Inclusive GAN, and Texture Mixer. My research was featured in media press such as Salesforce Newsletter, AlmostHuman, AIera, JiangMen, QbitAI, innovations report, and FoodPlus.
I am constantly dedicated to academic services, such as serving as (Lead) Area Chair for CVPR, ICCV, ECCV, NeurIPS, ICLR, ICML, AAAI, AISTATS, WACV, and BMVC.
I am a recipient of the CSAW Europe Best Paper Finalist, Twitch (Amazon) Research Fellowship, Microsoft Young Fellowship, Qualcomm Innovation Fellowship Finalist x2, and SPIE Best Student Paper Finalist.
News
[2025/09] Virtually Being and DEGS (as Journal Track) are accepted to SIGGRAPH Asia 2025.
[2025/09] AUGUSTUS is accepted to NeurIPS Workshop on LAW 2025.
[2025/09] MAViS is accepted to ICCV Workshop on HiGen 2025.
[2025/09] VChain is accepted to ICCV Workshop on KnowledgeMR 2025 as the Outstanding Paper Award.
[2025/08] Survey of Video Diffusion Models is accepted to TMLR 2025. The paper compilation repository is released.
[2024/07] xGen-MM (BLIP-3) is accepted to ICCV 2025 Findings and to ECCV Workshop on EVAL-FoMo 2024. The code, model cards, and data cards are released.
[2025/06] FlashDepth is accepted to ICCV 2025 as Highlight. The code is released.
[2025/03] JailFuzzer is accepted to S&P 2025. The code is released.
[2025/03] AntifakePrompt is accepted to ICLR Workshop on BuildingTrust 2025.
[2025/02] Go-with-the-Flow (as Oral), Lux Post Facto, Triplane Edit (as Spotlight), and PFD are accepted to CVPR 2025.
[2025/01] PromptBackdoor and HatefulMemes are accepted to USENIX 2025. Their code is released.
[2025/01] DREAM is accepted to NAACL 2025.
[2025/01] InfRes is accepted to ICLR 2025.
[2024/12] Text2Data is accepted to AAAI 2025. The code is released.
[2024/09] T2Vs Meet VLMs is accepted to NeurIPS 2024. The code and data card are released.
[2024/09] Shadowcast is accepted to NeurIPS 2024. The code is released.
[2024/09] FastTrack is accepted to EMNLP 2024.
[2024/08] Inside the Black Box is accepted to ECAI 2024.
[2024/07] DifFRelight is accepted to SIGGRAPH Asia 2024.
[2024/07] Vision-Language Models for Food Nutrient Screening is accepted to Advanced Science 2024.
[2024/07] LayoutDETR and X-InstructBLIP are accepted to ECCV 2024.
[2024/05] RigorLLM and C-RAG are accepted to ICML 2024.
[2024/04] LLMs in Food Science is accepted to Trends in Food Science & Technology 2024.
[2024/03] SimSCOOD is accepted to NAACL 2024. The code is released.
[2024/02] HIVE and ULIP-2 are accepted to CVPR 2024.
[2024/01] Model-Agnostic Hierarchical Attention for 3D Object Detection is accepted to ICRA 2024.
[2023/11] AnchMark is accepted to NeurIPS Workshop on Regulatable ML 2023.
[2023/09] UniControl is accepted to NeurIPS 2023. The code is released.
[2023/07] GlueGen is accepted to ICCV 2023. The code is released.
[2023/05] DE-FAKE is accepted to CCS 2023 as in the CSAW Europe best paper finalist. The code is released.
[2023/04] Generated Graph Detection is accepted to ICML 2023. The code is released.
[2023/04] SPAD and Prototype LTR are accepted to IJCAI 2023.
[2023/04] RoSteALS is accepted to CVPR Workshop on Media Forensics 2023. The code is released.
[2023/02] Mask-free OVIS and Cont-Steal are accepted to CVPR 2023.
[2022/10] UnGANable is accepted to USENIX 2023. The code is released.
[2022/08] FcF Image Inpainting is accepted to WACV 2023. The code is released.
[2022/07] I am one of the top reviewers and serve as a session chair for ICML 2022.
[2022/07] RepMix is accepted to ECCV 2022. The code is released.
[2022/05] Deep Learning for Food Nutrient Estimation is accepted to Food Chemistry 2022.
[2022/04] Multi-Exit Privacy is accepted to CCS 2022. The code is released.
[2022/04] The code for RelaxLoss is released.
[2022/01] The code for Scalable GAN Fingerprints is released.
[2022/01] Scalable GAN Fingerprints and RelaxLoss are accepted to ICLR 2022 as Spotlight.
[2021/10] VIDNet is accepted to BMVC 2021. The code is released.
[2021/08] I defended my Ph.D. The dissertation about Human-Centric Deep Generative Models is online.
[2021/08] Computer Vision for Food Nutrient Estimation is accepted to Food Chemistry 2021.
[2021/07] Artificial GAN Fingerprints is accepted to ICCV 2021 as Oral. The code is released.
[2021/07] Dual Contrastive Loss and Attention for GANs is accepted to ICCV 2021.
[2021/05] Computer Vision for Food Nutrient Prediction is accepted to Food Research International 2021.
[2021/04] Re-Synthesis for Deepfake Detection is accepted to IJCAI 2021. The code is released.
[2021/03] AI for Food Nutrient Estimation is accepted to Journal of Food Composition and Analysis 2021.
[2021/02] Hijack-GAN is accepted to CVPR 2021. The code is released.
[2020/08] Class Balanced Experts for Long-Tailed Recognition is accepted to GCPR 2020. The code is released.
[2020/06] Inclusive GAN is accepted to ECCV 2020. The code is released.
[2020/03] GAN-Leaks is accepted to CCS 2020. The code is released.
[2025/09] AUGUSTUS is accepted to NeurIPS Workshop on LAW 2025.
[2025/09] MAViS is accepted to ICCV Workshop on HiGen 2025.
[2025/09] VChain is accepted to ICCV Workshop on KnowledgeMR 2025 as the Outstanding Paper Award.
[2025/08] Survey of Video Diffusion Models is accepted to TMLR 2025. The paper compilation repository is released.
[2024/07] xGen-MM (BLIP-3) is accepted to ICCV 2025 Findings and to ECCV Workshop on EVAL-FoMo 2024. The code, model cards, and data cards are released.
[2025/06] FlashDepth is accepted to ICCV 2025 as Highlight. The code is released.
[2025/03] JailFuzzer is accepted to S&P 2025. The code is released.
[2025/03] AntifakePrompt is accepted to ICLR Workshop on BuildingTrust 2025.
[2025/02] Go-with-the-Flow (as Oral), Lux Post Facto, Triplane Edit (as Spotlight), and PFD are accepted to CVPR 2025.
[2025/01] PromptBackdoor and HatefulMemes are accepted to USENIX 2025. Their code is released.
[2025/01] DREAM is accepted to NAACL 2025.
[2025/01] InfRes is accepted to ICLR 2025.
[2024/12] Text2Data is accepted to AAAI 2025. The code is released.
[2024/09] T2Vs Meet VLMs is accepted to NeurIPS 2024. The code and data card are released.
[2024/09] Shadowcast is accepted to NeurIPS 2024. The code is released.
[2024/09] FastTrack is accepted to EMNLP 2024.
[2024/08] Inside the Black Box is accepted to ECAI 2024.
[2024/07] DifFRelight is accepted to SIGGRAPH Asia 2024.
[2024/07] Vision-Language Models for Food Nutrient Screening is accepted to Advanced Science 2024.
[2024/07] LayoutDETR and X-InstructBLIP are accepted to ECCV 2024.
[2024/05] RigorLLM and C-RAG are accepted to ICML 2024.
[2024/04] LLMs in Food Science is accepted to Trends in Food Science & Technology 2024.
[2024/03] SimSCOOD is accepted to NAACL 2024. The code is released.
[2024/02] HIVE and ULIP-2 are accepted to CVPR 2024.
[2024/01] Model-Agnostic Hierarchical Attention for 3D Object Detection is accepted to ICRA 2024.
[2023/11] AnchMark is accepted to NeurIPS Workshop on Regulatable ML 2023.
[2023/09] UniControl is accepted to NeurIPS 2023. The code is released.
[2023/07] GlueGen is accepted to ICCV 2023. The code is released.
[2023/05] DE-FAKE is accepted to CCS 2023 as in the CSAW Europe best paper finalist. The code is released.
[2023/04] Generated Graph Detection is accepted to ICML 2023. The code is released.
[2023/04] SPAD and Prototype LTR are accepted to IJCAI 2023.
[2023/04] RoSteALS is accepted to CVPR Workshop on Media Forensics 2023. The code is released.
[2023/02] Mask-free OVIS and Cont-Steal are accepted to CVPR 2023.
[2022/10] UnGANable is accepted to USENIX 2023. The code is released.
[2022/08] FcF Image Inpainting is accepted to WACV 2023. The code is released.
[2022/07] I am one of the top reviewers and serve as a session chair for ICML 2022.
[2022/07] RepMix is accepted to ECCV 2022. The code is released.
[2022/05] Deep Learning for Food Nutrient Estimation is accepted to Food Chemistry 2022.
[2022/04] Multi-Exit Privacy is accepted to CCS 2022. The code is released.
[2022/04] The code for RelaxLoss is released.
[2022/01] The code for Scalable GAN Fingerprints is released.
[2022/01] Scalable GAN Fingerprints and RelaxLoss are accepted to ICLR 2022 as Spotlight.
[2021/10] VIDNet is accepted to BMVC 2021. The code is released.
[2021/08] I defended my Ph.D. The dissertation about Human-Centric Deep Generative Models is online.
[2021/08] Computer Vision for Food Nutrient Estimation is accepted to Food Chemistry 2021.
[2021/07] Artificial GAN Fingerprints is accepted to ICCV 2021 as Oral. The code is released.
[2021/07] Dual Contrastive Loss and Attention for GANs is accepted to ICCV 2021.
[2021/05] Computer Vision for Food Nutrient Prediction is accepted to Food Research International 2021.
[2021/04] Re-Synthesis for Deepfake Detection is accepted to IJCAI 2021. The code is released.
[2021/03] AI for Food Nutrient Estimation is accepted to Journal of Food Composition and Analysis 2021.
[2021/02] Hijack-GAN is accepted to CVPR 2021. The code is released.
[2020/08] Class Balanced Experts for Long-Tailed Recognition is accepted to GCPR 2020. The code is released.
[2020/06] Inclusive GAN is accepted to ECCV 2020. The code is released.
[2020/03] GAN-Leaks is accepted to CCS 2020. The code is released.
Publications
|
Video4Spatial: Towards Visuospatial Intelligence with Context-Guided Video Generation
Zeqi Xiao, Yiwei Zhao, Lingxiao Li, Yushi Lan, Ning Yu, Rahul Garg, Roshni Cooper, Mohammad H. Taghavi, Xingang Pan arXiv 2025 pdf project |
|
Safe-Control: A Safety Patch for Mitigating Unsafe Content in Text-to-Image Generation Models
Xiangtao Meng, Yingkai Dong, Ning Yu, Li Wang, Zheng Li, Shanqing Guo arXiv 2025 |
|
CineScale: Free Lunch in High-Resolution Cinematic Visual Generation
Haonan Qiu, Ning Yu, Ziqi Huang, Paul Debevec, Ziwei Liu arXiv 2025 pdf project code |
|
Virtually Being: Customizing Camera-Controllable Video Diffusion Models with Multi-View Performance Captures
Yuancheng Xu, Wenqi Xian, Li Ma, Julien Philip, Ahmet Levent Taşel, Yiwei Zhao, Ryan Burgert, Mingming He, Oliver Hermann, Oliver Pilarski, Rahul Garg, Paul Debevec, Ning Yu SIGGRAPH Asia 2025 pdf project |
|
Detail Enhanced Gaussian Splatting for Large-Scale Volumetric Capture
Julien Philip*, Li Ma*, Pascal Clausen*, Wenqi Xian*, Ahmet Levent Taşel, Mingming He, Xueming Yu, David George, Ning Yu, Oliver Pilarski, Paul Debevec SIGGRAPH Asia and ToG 2025 pdf supp project |
|
AUGUSTUS: An LLM-Driven Multimodal Agent System with Contextualized User Memory
Jitesh Jain*, Shubham Maheshwari*, Ning Yu, Wen-mei Hwu, Humphrey Shi NeurIPS Workshop on LAW 2025 |
|
Survey of Video Diffusion Models: Foundations, Implementations, and Applications
Yimu Wang*, Xuye Liu*, Wei Pang*, Li Ma*, Shuai Yuan*, Paul Debevec, Ning Yu TMLR 2025 pdf repo |
|
FlashDepth: Real-time Streaming Video Depth Estimation at 2K Resolution
Gene Chou, Wenqi Xian, Guandao Yang, Mohamed Abdelfattah, Bharath Hariharan, Noah Snavely, Ning Yu, Paul Debevec ICCV 2025 Highlight pdf project code |
|
VChain: Chain-of-Visual-Thought for Reasoning in Video Generation
Ziqi Huang, Ning Yu, Gordon Chen, Haonan Qiu, Paul Debevec, Ziwei Liu ICCV Workshop on KnowledgeMR 2025 Outstanding Paper Award pdf project code video |
|
MAViS: A Multi-Agent Framework for Long-Sequence Video Storytelling
Qian Wang, Ziqi Huang, Ruoxi Jia, Paul Debevec, Ning Yu ICCV Workshop on HiGen 2025 pdf poster |
|
On the Proactive Generation of Unsafe Images From Text-To-Image Models Using Benign Prompts
Yixin Wu, Ning Yu, Michael Backes, Yun Shen, Yang Zhang USENIX 2025 pdf code slides |
|
From Meme to Threat: On the Hateful Meme Understanding and Induced Hateful Content Generation in Open-Source Vision Language Models
Yihan Ma, Xinyue Shen, Yiting Qu, Ning Yu, Michael Backes, Savvas Zannettou, Yang Zhang USENIX 2025 pdf code slides |
|
Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise
Ryan Burgert, Yuancheng Xu, Wenqi Xian, Oliver Pilarski, Pascal Clausen, Mingming He, Li Ma, Yitong Deng, Lingxiao Li, Mohsen Mousavi, Michael Ryoo, Paul Debevec, Ning Yu CVPR 2025 Oral pdf project code UI video poster slides |
|
Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset
Yiqun Mei, Mingming He, Li Ma, Julien Philip, Wenqi Xian, David George, Xueming Yu, Gabriel Dedic, Ahmet Levent Tacsel, Ning Yu, Vishal Patel, Paul Debevec CVPR 2025 pdf project video poster |
|
Reference-Based 3D-Aware Image Editing with Triplane
Bahri Batuhan Bilecen, Yigit Yalin, Ning Yu, Aysegul Dundar CVPR 2025 Spotlight pdf project code poster |
|
Detecting Adversarial Data via Perturbation Forgery
Qian Wang, Chen Li, Yuchen Luo, Hefei Ling, Ping Li, Jiazhong Chen, Shijuan Huang, Ning Yu CVPR 2025 pdf code poster |
|
Fuzz-Testing Meets LLM-Based Agents: An Automated and Efficient Framework for Jailbreaking Text-to-Image Generation Models
Yingkai Dong, Xiangtao Meng, Ning Yu, Zheng Li, Shanqing Guo S&P 2025 pdf code poster slides |
|
DREAM: Improving Video-Text Retrieval Through Relevance-Based Augmentation Using Large Foundation Models
Yimu Wang, Shuai Yuan, Xiangru Jian, Wei Pang, Mushi Wang, Ning Yu NAACL 2025 |
|
Infinite-Resolution Integral Noise Warping for Diffusion Models
Yitong Deng, Winnie Lin, Lingxiao Li, Dmitriy Smirnov, Ryan Burgert, Ning Yu, Vincent Dedun, Mohammad H. Taghavi ICLR 2025 pdf project code video |
|
AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectors
You-Ming Chang*, Chen Yeh*, Wei-Chen Chiu, Ning Yu ICLR Workshop on BuildingTrust 2025 pdf code |
|
Text2Data: Low-Resource Data Generation with Textual Control
Shiyu Wang, Yihao Feng, Tian Lan, Ning Yu, Yu Bai, Ran Xu, Huan Wang, Caiming Xiong, Silvio Savarese AAAI 2025 pdf code poster press |
|
Membership Inference Attack Against Masked Image Modeling
Zheng Li, Xinlei He, Ning Yu, Yang Zhang arXiv 2024 |
|
JigMark: A Black-Box Approach for Enhancing Image Watermarks against Diffusion Model Edits
Minzhou Pan*, Yi Zeng*, Ning Yu, Cho-Jui Hsieh, Peter Henderson, Ruoxi Jia, Xue Lin arXiv 2024 pdf code |
|
T2Vs Meet VLMs: A Scalable Multimodal Dataset for Visual Harmfulness Recognition
Chen Yeh*, You-Ming Chang*, Wei-Chen Chiu, Ning Yu NeurIPS 2024 pdf project code data card poster video |
|
Shadowcast: Stealthy Data Poisoning Attacks Against Vision-language Models
Yuancheng Xu, Jiarui Yao, Manli Shu, Yanchao Sun, Zichu Wu, Ning Yu, Tom Goldstein, Furong Huang NeurIPS 2024 pdf project code poster |
|
DifFRelight: Diffusion-Based Facial Performance Relighting
Mingming He*, Pascal Clausen*, Ahmet Levent Tacsel*, Li Ma*, Oliver Pilarski*, Wenqi Xian, Laszlo Rikker, Xueming Yu, Ryan Burgert, Ning Yu, Paul Debevec SIGGRAPH Asia 2024 pdf project |
|
FastTrack: Fast and Accurate Fact Tracing for LLMs
Si Chen, Feiyang Kang, Ning Yu, Ruoxi Jia EMNLP 2024 pdf poster |
|
Inside the Black Box: Detecting Data Leakage in Pre-trained Language Encoders
Yuan Xin, Zheng Li, Ning Yu, Dingfan Chen, Mario Fritz, Michael Backes, Yang Zhang ECAI 2024 |
|
Integrating Vision-Language Models for Accelerated High-Throughput Nutrition Screening
Peihua Ma*, Yixin Wu*, Ning Yu, Xiaoxue Jia, Yiyang He, Yang Zhang, Michael Backes, Qin Wang, Cheng-I Wei Advanced Science 2024 |
|
LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer
Ning Yu, Chia-Chih Chen, Zeyuan Chen, Rui Meng, Gang Wu, Paul Josel, Juan Carlos Niebles, Caiming Xiong, Ran Xu ECCV 2024 pdf project code BannerGen lib poster video blog |
|
X-InstructBLIP: A Framework for aligning X-Modal instruction-aware representations to LLMs and Emergent Cross-modal Reasoning
Artemis Panagopoulou, Le Xue*, Ning Yu*, Junnan Li, Dongxu Li, Shafiq Joty, Ran Xu, Silvio Savarese, Caiming Xiong, Juan Carlos Niebles ECCV 2024 pdf project code poster press |
|
xGen-MM (BLIP-3): A Family of Open Large Multimodal Models
Le Xue*, Manli Shu*, Anas Awadalla, Jun Wang, An Yan, Senthil Purushwalkam, Honglu Zhou, Viraj Prabhu, Yutong Dai, Michael S Ryoo, Shrikant Kendre, Jieyu Zhang, Can Qin, Shu Zhang, Chia-Chih Chen, Ning Yu, Juntao Tan, Tulika Manoj Awalgaonkar, Shelby Heinecke, Huan Wang, Yejin Choi, Ludwig Schmidt, Zeyuan Chen, Silvio Savarese, Juan Carlos Niebles, Caiming Xiong, Ran Xu ICCV 2025 Findings ECCV Workshop on EVAL-FoMo 2024 pdf project code model cards data cards |
|
RigorLLM: Resilient Guardrails for Large Language Models against Undesired Content
Zhuowen Yuan, Zidi Xiong, Yi Zeng, Ning Yu, Ruoxi Jia, Dawn Song, Bo Li ICML 2024 |
|
C-RAG: Certified Conformal Risks for Retrieval-Augmented Language Models
Mintong Kang, Nezihe Merve Gürel, Ning Yu, Dawn Song, Bo Li ICML 2024 pdf code |
|
AugTriever: Unsupervised Dense Retrieval and Domain Adaptation by Scalable Data Augmentation
Rui Meng, Ye Liu, Semih Yavuz, Divyansh Agarwal, Lifu Tu, Ning Yu, Jianguo Zhang, Meghana Bhat, Yingbo Zhou DCAI 2024 pdf code |
|
HIVE: Harnessing Human Feedback for Instructional Visual Editing
Shu Zhang*, Xinyi Yang*, Yihao Feng*, Can Qin, Chia-Chih Chen, Ning Yu, Zeyuan Chen, Huan Wang, Silvio Savarese, Stefano Ermon, Caiming Xiong, Ran Xu CVPR 2024 pdf project code poster |
|
ULIP-2: Towards Scalable Multimodal Pre-training For 3D Understanding
Le Xue, Ning Yu, Shu Zhang, Junnan Li, Roberto Martín-Martín, Jiajun Wu, Caiming Xiong, Ran Xu, Juan Carlos Niebles, Silvio Savarese CVPR 2024 pdf code poster blog press |
|
SimSCOOD: Systematic Analysis of Out-of-Distribution Behavior of Source Code Models
Hossein Hajipour, Ning Yu, Cristian-Alexandru Staicu, Mario Fritz NAACL 2024 pdf code poster slides |
|
Model-Agnostic Hierarchical Attention for 3D Object Detection
Manli Shu, Le Xue, Ning Yu, Roberto Martín-Martín, Juan Carlos Niebles, Caiming Xiong, Ran Xu ICRA 2024 pdf slides |
|
Large Language Models in Food Science: Innovations, Applications, and Future
Peihua Ma, Shawn Tsai, Yiyang He, Xiaoxue Jia, Dongyang Zhen, Ning Yu, Qin Wang, Jaspreet Ahuja, Cheng-I Wei Trends in Food Science & Technology 2024 |
|
Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Models
Minxing Zhang, Ning Yu, Rui Wen, Michael Backes, Yang Zhang WACV 2024 pdf code |
|
Continual Adversarial Defense
Qian Wang, Yaoyao Liu, Hefei Ling, Yingwei Li, Qihao Liu, Ping Li, Jiazhong Chen, Alan Yuille, Ning Yu arXiv 2023 pdf code |
|
UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild
Can Qin, Shu Zhang, Ning Yu, Yihao Feng, Xinyi Yang, Yingbo Zhou, Huan Wang, Juan Carlos Niebles, Caiming Xiong, Silvio Savarese, Stefano Ermon, Yun Fu, Ran Xu NeurIPS 2023 pdf project code Huggingface space poster blog press |
|
AnchMark: Anchor-contrastive Watermarking against Generative Image Modifications
Minzhou Pan*, Yi Zeng*, Xue Lin, Ning Yu, Cho-Jui Hsieh, Ruoxi Jia NeurIPS Workshop on Regulatable ML 2023 |
|
GlueGen: Plug and Play Multi-modal Encoders for X-to-image Generation
Can Qin, Ning Yu, Chen Xing, Shu Zhang, Zeyuan Chen, Stefano Ermon, Yun Fu, Caiming Xiong, Ran Xu ICCV 2023 pdf project code poster blog |
|
DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Diffusion Models
Zeyang Sha, Zheng Li, Ning Yu, Yang Zhang CCS 2023 CSAW Europe best paper finalist pdf code |
|
Generated Graph Detection
Yihan Ma, Zhikun Zhang, Ning Yu, Xinlei He, Michael Backes, Yun Shen, Yang Zhang ICML 2023 pdf code |
|
Detecting Adversarial Faces Using Only Real Face Self-Perturbations
Qian Wang, Yongqin Xian, Hefei Ling, Jinyuan Zhang, Xiaorui Lin, Ping Li, Jiazhong Chen, Ning Yu IJCAI 2023 pdf code slides video |
|
Learning Prototype Classifiers for Long-Tailed Recognition
Saurabh Sharma, Yongqin Xian, Ning Yu, Ambuj Singh IJCAI 2023 pdf code slides video |
|
Mask-free OVIS: Open-Vocabulary Instance Segmentation without Manual Mask Annotations
Vibashan VS, Ning Yu, Chen Xing, Can Qin, Mingfei Gao, Juan Carlos Niebles, Vishal Patel, Ran Xu CVPR 2023 pdf project code poster blog |
|
Can’t Steal? Cont-Steal! Contrastive Stealing Attacks Against Image Encoders
Zeyang Sha, Xinlei He, Ning Yu, Michael Backes, Yang Zhang CVPR 2023 pdf code poster video slides |
|
RoSteALS: Robust Steganography using Autoencoder Latent Space
Tu Bui, Shruti Agarwal, Ning Yu, John Collomosse CVPR Workshop on Media Forensics 2023 pdf code Huggingface space poster |
|
UnGANable: Defending Against GAN-based Face Manipulation
Zheng Li, Ning Yu, Ahmed Salem, Michael Backes, Mario Fritz, Yang Zhang USENIX 2023 pdf code poster press |
|
Keys to Better Image Inpainting: Structure and Texture Go Hand in Hand
Jitesh Jain*, Yuqian Zhou*, Ning Yu, Humphrey Shi WACV 2023 pdf project code demo Huggingface space poster slides tech transfer: Photoshop 24.5 Remove Tool |
|
Membership Inference Attacks Against Text-to-image Generation Models
Yixin Wu, Ning Yu, Zheng Li, Michael Backes, Yang Zhang arXiv 2022 |
|
Auditing Membership Leakages of Multi-Exit Networks
Zheng Li, Yiyong Liu, Xinlei He, Ning Yu, Michael Backes, Yang Zhang CCS 2022 pdf code slides |
|
RepMix: Representation Mixing for Robust Attribution of Synthesized Images
Tu Bui, Ning Yu, John Collomosse ECCV 2022 pdf code poster video |
|
Deep Learning Accurately Predicts Food Categories and Nutrients Based on Ingredient Statements
Peihua Ma, Zhikun Zhang, Ying Li, Ning Yu, Jiping Sheng, Hande Küçük McGinty, Qin Wang, Jaspreet Ahuja Food Chemistry 2022 |
|
Responsible Disclosure of Generative Models Using Scalable Fingerprinting
Ning Yu*, Vladislav Skripniuk*, Dingfan Chen, Larry Davis, Mario Fritz ICLR 2022 Spotlight pdf project code poster video press |
|
RelaxLoss: Defending Membership Inference Attacks without Losing Utility
Dingfan Chen, Ning Yu, Mario Fritz ICLR 2022 Spotlight pdf code poster video press |
|
Human-Centric Deep Generative Models: The Blessing and The Curse
Ning Yu Ph.D. Dissertation 2021, University of Maryland and Max Planck Institute for Informatics |
|
Deep Video Inpainting Detection
Peng Zhou, Ning Yu, Zuxuan Wu, Larry Davis, Abhinav Shrivastava, Ser-Nam Lim BMVC 2021 pdf code video |
|
Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data
Ning Yu*, Vladislav Skripniuk*, Sahar Abdelnabi, Mario Fritz ICCV 2021 Oral pdf project code poster video press |
|
Dual Contrastive Loss and Attention for GANs
Ning Yu, Guilin Liu, Aysegul Dundar, Andrew Tao, Bryan Catanzaro, Larry Davis, Mario Fritz ICCV 2021 pdf project code poster video press |
|
Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis
Yang He, Ning Yu, Margret Keuper, Mario Fritz IJCAI 2021 pdf project code video press |
|
Hijack-GAN: Unintended-Use of Pretrained, Black-Box GANs
Hui-Po Wang, Ning Yu, Mario Fritz CVPR 2021 pdf project code poster video press |
|
Application of Deep Learning for Image-based Chinese Market Food Nutrients Estimation
Peihua Ma, Chun Pong Lau, Ning Yu, An Li, Jiping Sheng Food Chemistry 2021 |
|
Image-based Nutrient Estimation for Chinese Dishes Using Deep Learning
Peihua Ma, Chun Pong Lau, Ning Yu, An Li, Ping Liu, Qin Wang, Jiping Sheng Food Research International 2021 pdf press |
|
Application of Machine Learning for Predicting Label Nutrients Using USDA Global Branded Food Products Database (BFPD)
Peihua Ma, An Li, Ning Yu, Ying Li, Rahul Bahadur, Qin Wang, Jaspreet Ahuja Journal of Food Composition and Analysis 2021 pdf press |
|
Long-Tailed Recognition Using Class-Balanced Experts
Saurabh Sharma, Ning Yu, Mario Fritz, Bernt Schiele GCPR 2020 pdf code video |
|
GAN-Leaks: A Taxonomy of Membership Inference Attacks against GANs
Dingfan Chen, Ning Yu, Yang Zhang, Mario Fritz CCS 2020 pdf code poster video (short) video (full) |
|
Inclusive GAN: Improving Data and Minority Coverage in Generative Models
Ning Yu, Ke Li, Peng Zhou, Jitendra Malik, Larry Davis, Mario Fritz ECCV 2020 pdf project code video (short) video (full) press |
|
Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints
Ning Yu, Larry Davis, Mario Fritz ICCV 2019 pdf project code poster press |
|
Texture Mixer: A Network for Controllable Synthesis and Interpolation of Texture
Ning Yu, Connelly Barnes, Eli Shechtman, Sohrab Amirghodsi, Michal Lukáč CVPR 2019 pdf project code poster press |
|
Learning to Detect Multiple Photographic Defects
Ning Yu, Xiaohui Shen, Zhe Lin, Radomír Měch, Connelly Barnes WACV 2018 pdf supp project code poster slides |
|
Supervoxel-Based Hierarchical Markov Random Field Framework for Multi-Atlas Segmentation
Ning Yu, Hongzhi Wang, Paul Yushkevich MICCAI Workshop on Patch MI 2016 pdf project slides |
|
A Superpixel-Based Framework for Automatic Tumor Segmentation on Breast DCE-MRI
Ning Yu, Jia Wu, Susan Weinstein, Bilwaj Gaonkar, Brad Keller, Ahmed Ashraf, YunQing Jiang, Christos Davatzikos, Emily Conant, Despina Kontos SPIE Medical Imaging 2015 Oral, best student paper finalist pdf project slides press |
|
Quantification of Tumor Changes during Neoadjuvant Chemotherapy with Longitudinal Breast DCE-MRI Registration
Jia Wu, Yangming Ou, Susan Weinstein, Emily Conant, Ning Yu, Vahid Hoshmand, Brad Keller, Ahmed Ashraf, Mark Rosen, Angela DeMichele, Christos Davatzikos, Despina Kontos SPIE Medical Imaging 2015 pdf 、 |
|
Tumor Heterogeneity Patterns of DCE-MRI Parametric Response Maps May Augment Early Assessment of Neoadjuvant Chemotherapy: A Pilot Study of ACRIN 6657/I-SPY 1
Jia Wu, Susan Weinstein, Andrew Oustimov, Lauren Pantalone, Ning Yu, Yangming Ou, Mark Rosen, Angela DeMichele, Christos Davatzikos, Despina Kontos RSNA 2015 |
|
A Feasibility Study Investigating the Use of Quantitative Measures of Spatio-Temporal Tumor Heterogeneity Derived from 4D Breast DCE-MRI Registration as a Biomarker of Response to Neoadjuvant Chemotherapy
Jia Wu, Yangming Ou, Susan Weinstein, Emily Conant, Ning Yu, Vahid Hoshmand, Brad Keller, Ahmed Ashraf, Mark Rosen, Angela DeMichele, Christos Davatzikos, Despina Kontos ISMRM 2014 |
|
Robust Feature Points Correspondences for Visual Object Tracking
Ning Yu Undergraduate Thesis 2013, Huazhong University of Science and Technology pdf project slides |
Patents
Systems And Methods For Controllable Data Generation From Text
Shiyu Wang, Yihao Feng, Tian Lan, Ning Yu, Yu Bai, Ran Xu, Huan Wang, Caiming Xiong, Silvio Savarese
US Application No. 18,423,081
application
Shiyu Wang, Yihao Feng, Tian Lan, Ning Yu, Yu Bai, Ran Xu, Huan Wang, Caiming Xiong, Silvio Savarese
US Application No. 18,423,081
application
Systems and Methods for Zero-shot Cross-modal Reasoning via Uni-modal Projections to Large Language Models
Artemis Panagopoulou, Le Xue, Ning Yu, Junnan Li, Dongxu Li, Silvio Savarese, Shafiq Joty, Ran Xu, Caiming Xiong, Juan Carlos Niebles
US Application No. 18,400,477
application
Artemis Panagopoulou, Le Xue, Ning Yu, Junnan Li, Dongxu Li, Silvio Savarese, Shafiq Joty, Ran Xu, Caiming Xiong, Juan Carlos Niebles
US Application No. 18,400,477
application
Systems and Methods for Multimodal Pretraining for Three-Dimensional Understanding Models
Le Xue, Ning Yu, Shu Zhang, Junnan Li, Caiming Xiong, Silvio Savarese, Juan Carlos Niebles, Ran Xu
US Patent No. 12,430,849
patent application
Le Xue, Ning Yu, Shu Zhang, Junnan Li, Caiming Xiong, Silvio Savarese, Juan Carlos Niebles, Ran Xu
US Patent No. 12,430,849
patent application
Systems and Methods for Controllable Image Generation
Ning Yu, Can Qin, Shu Zhang, Yihao Feng, Xinyi Yang, Ran Xu
US Application No. 18,477,764
application
Ning Yu, Can Qin, Shu Zhang, Yihao Feng, Xinyi Yang, Ran Xu
US Application No. 18,477,764
application
Systems and Methods for Feedback Based Instructional Visual Editing
Shu Zhang, Xinyi Yang, Yihao Feng, Chia-Chih Chen, Ning Yu, Ran Xu
US Application No. 18,350,876
application
Shu Zhang, Xinyi Yang, Yihao Feng, Chia-Chih Chen, Ning Yu, Ran Xu
US Application No. 18,350,876
application
Systems and Methods for Unsupervised Training in Text Retrieval Tasks
Rui Meng, Yingbo Zhou, Ye Liu, Semih Yavuz, Ning Yu
US Application No. 18,303,313
application
Rui Meng, Yingbo Zhou, Ye Liu, Semih Yavuz, Ning Yu
US Application No. 18,303,313
application
Systems and Methods for Text-to-Image Generation Using Language Models
Ning Yu, Can Qin, Chen Xing, Shu Zhang, Stefano Ermon, Caiming Xiong, Ran Xu
US Application No. 18,162,535
application
Ning Yu, Can Qin, Chen Xing, Shu Zhang, Stefano Ermon, Caiming Xiong, Ran Xu
US Application No. 18,162,535
application
Systems and Methods for Attention Mechanism in Three-Dimensional Object Detection
Manli Shu, Le Xue, Ning Yu, Roberto Martín-Martín, Juan Carlos Niebles, Caiming Xiong, Ran Xu
US Patent No. 12,394,220
patent application
Manli Shu, Le Xue, Ning Yu, Roberto Martín-Martín, Juan Carlos Niebles, Caiming Xiong, Ran Xu
US Patent No. 12,394,220
patent application
Systems and Methods for Multimodal Layout Designs of Digital Publications
Ning Yu, Chia-Chih Chen, Zeyuan Chen, Caiming Xiong, Ran Xu, Juan Carlos Niebles, Rui Meng
US Application No. 18,161,680
application
Ning Yu, Chia-Chih Chen, Zeyuan Chen, Caiming Xiong, Ran Xu, Juan Carlos Niebles, Rui Meng
US Application No. 18,161,680
application
Systems and Methods for Open-Vocabulary Instance Segmentation in Unannotated Images
Ning Yu, Vibashan VS, Chen Xing, Juan Carlos Niebles, Ran Xu
US Patent No. 12,387,340
patent application
Ning Yu, Vibashan VS, Chen Xing, Juan Carlos Niebles, Ran Xu
US Patent No. 12,387,340
patent application
Neural Network Training Technique
Guilin Liu, Ning Yu, Aysegul Dundar, Andrew Tao, Bryan Catanzaro
US Application No. 17,165,745
Guilin Liu, Ning Yu, Aysegul Dundar, Andrew Tao, Bryan Catanzaro
US Application No. 17,165,745
Texture Interpolation Using Neural Networks
Connelly Barnes, Sohrab Amirghodsi, Michal Lukáč, Eli Shechtman, Ning Yu
US Patent No. 10,818,043
patent
Connelly Barnes, Sohrab Amirghodsi, Michal Lukáč, Eli Shechtman, Ning Yu
US Patent No. 10,818,043
patent
Digital Image Defect Identification and Correction
Radomír Měch, Ning Yu, Xiaohui Shen, Zhe Lin
US Patent No. 10,810,721
patent
Radomír Měch, Ning Yu, Xiaohui Shen, Zhe Lin
US Patent No. 10,810,721
patent
Selected Awards
[2024] CSAW Europe Best Paper Finalist
[2022] ICML'22 Top Reviewer
[2021] Twitch (Amazon) Research Fellowship
[2020] Qualcomm Innovation Fellowship Finalist
[2019] Qualcomm Innovation Fellowship Finalist
[2015] SPIE Best Student Paper Finalist
[2015] SPIE Travel Scholarship
[2012] Chinese National Fellowship
[2012] Microsoft Young Fellowship
[2012] Meritorious Winner of the Mathematical Contest in Modeling
[2011] 2nd Prize of the Chinese Mathematical Contest in Modeling
[2022] ICML'22 Top Reviewer
[2021] Twitch (Amazon) Research Fellowship
[2020] Qualcomm Innovation Fellowship Finalist
[2019] Qualcomm Innovation Fellowship Finalist
[2015] SPIE Best Student Paper Finalist
[2015] SPIE Travel Scholarship
[2012] Chinese National Fellowship
[2012] Microsoft Young Fellowship
[2012] Meritorious Winner of the Mathematical Contest in Modeling
[2011] 2nd Prize of the Chinese Mathematical Contest in Modeling
Mentoring
Zeqi Xiao @NTU
Pablo Salamanca @UPenn
Zhengming Yu @TAMU
Zhizheng Liu @UCLA
Koichi Namekata @Oxford
Kuan Heng Lin @Columbia
Ziqi Huang @NTU
Haonan Qiu @NTU
Gene Chou @Cornell
Libing Zeng @TAMU
Yiqun Mei @JHU
Ryan Burgert @StonyBrook
Xiangtao Meng @SDU
Yingkai Dong @SDU
Yimu Wang @UWaterloo
Yuancheng Xu @UMD
Bahri Batuhan Bilecen @Bilkent
Shiyu Wang @Emory
Artemis Panagopoulou @UPenn
You-Ming Chang @NCTU
Chen Yeh @NCTU
Qian Wang @HUST
Minxing Zhang @CISPA
Manli Shu @UMD
Vibashan VS @JHU
Can Qin @NEU
Yuan Xin @CISPA
Yixin Wu @CISPA
Zeyang Sha @CISPA
Yihan Ma @CISPA
Jitesh Jain @IIT
Zheng Li @CISPA
Vladislav Skripniuk @Audatic
Hui-Po Wang @CISPA
Dingfan Chen @CISPA
Saurabh Sharma @UCSB
Pablo Salamanca @UPenn
Zhengming Yu @TAMU
Zhizheng Liu @UCLA
Koichi Namekata @Oxford
Kuan Heng Lin @Columbia
Ziqi Huang @NTU
Haonan Qiu @NTU
Gene Chou @Cornell
Libing Zeng @TAMU
Yiqun Mei @JHU
Ryan Burgert @StonyBrook
Xiangtao Meng @SDU
Yingkai Dong @SDU
Yimu Wang @UWaterloo
Yuancheng Xu @UMD
Bahri Batuhan Bilecen @Bilkent
Shiyu Wang @Emory
Artemis Panagopoulou @UPenn
You-Ming Chang @NCTU
Chen Yeh @NCTU
Qian Wang @HUST
Minxing Zhang @CISPA
Manli Shu @UMD
Vibashan VS @JHU
Can Qin @NEU
Yuan Xin @CISPA
Yixin Wu @CISPA
Zeyang Sha @CISPA
Yihan Ma @CISPA
Jitesh Jain @IIT
Zheng Li @CISPA
Vladislav Skripniuk @Audatic
Hui-Po Wang @CISPA
Dingfan Chen @CISPA
Saurabh Sharma @UCSB
Chairing
| CVPR Lead Area Chair | since 2025 |
| CVPR Area Chair | since 2023 |
| ICCV Area Chair | since 2023 |
| ECCV Area Chair | since 2024 |
| NeurIPS Area Chair | since 2023 |
| ICLR Area Chair | since 2024 |
| ICML Area Chair | since 2025 |
| ICML Session Chair | 2022 |
| TMLR Action Editor | 2025 |
| AAAI Senior Program Committee | since 2023 |
| AISTATS Area Chair | since 2023 |
| BMVC Area Chair | since 2022 |
| WACV Area Chair | since 2023 |
Reviewing
| CVPR | since 2020 |
| ICCV | since 2019 |
| ECCV | since 2020 |
| NeurIPS | since 2021 |
| ICML | since 2021 |
| ICLR | since 2022 |
| AAAI | since 2020 |
| IJCAI | since 2020 |
| SIGGRAPH | since 2021 |
| Eurographics | since 2020 |
| ICRA | since 2020 |
| TPAMI | since 2019 |
| IJCV | since 2021 |
| TOG | since 2020 |
| PR Letters | since 2020 |
| Neurocomputing | since 2019 |
| TVCJ | since 2018 |