This is the official repository for the following paper:

Shadow Generation Using Diffusion Model with Geometry Prior [pdf] [supp]

Haonan Zhao, Qingyang Liu, Xinhao Tao, Li Niu, Guangtao Zhai
Accepted by CVPR 2025.

Object shadow generation aims to generate plausible shadow for the inserted object in the composite image. We propose Geometry Prior guided Shadow generation Diffusion model (GPSDifffusion), which significantly improves the shadow geometry. The visual comparision between SGDiffusion and our GPSDiffusion is shown below. From left to right, we show the composite image, foreground mask, the result of SGDiffusion, the result of our GPSDiffusion, and ground-truth.

We also provide the visual comparison with other baselines below.

GPSDiffusion has been integrated into our image composition toolbox libcom. Note that the performance of GPSDiffusion is unstable, so you need to generate multiple results and pick the most satisfactory one.

[2025/7/02] GPSDiffusion-SDXL is available now!

• Clone this repo: git clone https://github.com/bcmi/GPSDiffusion-Object-Shadow-Generation.git
• Download the DESOBAv2 dataset from [Baidu Cloud] (access code: bcmi) or [Dropbox]. Unzip desobav2-256x256.rar to ./data/, and rename it to desobav2.
• Download the checkpoints from [Baidu Cloud] (access code: bcmi) or [Dropbox]. Unzip pretrained_models.zip to ./models/.

conda create -n GPSDiffusion python=3.8
conda activate GPSDiffusion
pip install -r requirements.txt

python train_GPSDiffusion.py

python infer_GPSDiffusion.py

python post_processing.py

python eval.py

• Awesome-Object-Shadow-Generation
• Awesome-Image-Composition