HTTP/2 301 server: GitHub.com content-type: text/html location: https://daveredrum.github.io/Text2Tex/ x-github-request-id: EDF6:2D64E0:95834B:A7EC57:69530E59 accept-ranges: bytes age: 0 date: Mon, 29 Dec 2025 23:27:22 GMT via: 1.1 varnish x-served-by: cache-bom-vanm7210025-BOM x-cache: MISS x-cache-hits: 0 x-timer: S1767050842.430986,VS0,VE196 vary: Accept-Encoding x-fastly-request-id: 271b39635f2eac3e4a617786b6c2c8188831cd9c content-length: 162 HTTP/2 200 server: GitHub.com content-type: text/html; charset=utf-8 last-modified: Mon, 19 Feb 2024 10:55:00 GMT access-control-allow-origin: * strict-transport-security: max-age=31556952 etag: W/"65d33384-7f3c" expires: Mon, 29 Dec 2025 23:37:22 GMT cache-control: max-age=600 content-encoding: gzip x-proxy-cache: MISS x-github-request-id: 93AB:2685F2:94FC62:A76717:69530E59 accept-ranges: bytes age: 0 date: Mon, 29 Dec 2025 23:27:22 GMT via: 1.1 varnish x-served-by: cache-bom-vanm7210025-BOM x-cache: MISS x-cache-hits: 0 x-timer: S1767050843.640334,VS0,VE226 vary: Accept-Encoding x-fastly-request-id: dcc39e63c22f7c91ec296c9c2d932092b53d9f28 content-length: 6189

Text2Tex: Text-driven Texture Synthesis via Diffusion Models

Dave Zhenyu Chen¹, Yawar Siddiqui¹, Hsin-Ying Lee², Sergey Tulyakov², Matthias Nießner¹,

¹Technical University of Munich, ²Snap Research

Paper arXiv Video Code

Text2Tex generates high-quality textures for 3D meshes from the given text prompts. Our method incorporates inpainting into a pre-trained depth-aware image diffusion model to progressively synthesize high resolution partial textures from multiple viewpoints. To avoid artifacts, we propose an automatic view sequence generation scheme to determine the next best view for updating the partial texture. Extensive experiments demonstrate that our method significantly outperforms the existing text-driven approaches and GAN-based methods.

Video

Method Overview

In Text2Tex, we progressively generate the texture via a generate-then-refine scheme

In progressive texture generation, we start by rendering the object from an initial preset viewpoint. We generate a new appearance according to the input prompt via a depth-to-image diffusion model, and project the generated image back to the partial texture. Then, we repeat this process until the last preset viewpoint to output the initial textured mesh.

In the subsequent texture refinement, we update the initial texture from a sequence of automatically selected viewpoints to refine the stretched and blurry artifacts.

Textured Objaverse Objects

Geometry

CLIPMesh

Latent-Paint

Ours

"a compass"

Geometry

CLIPMesh

Latent-Paint

Ours

"an ambulance"

Creative Texture Synthesis

"baroque Porsche"

"wooden Porsche"

"cyberpunk Porsche"

"Lego Porsche"

Porsche in different styles

"airplane

"crocodile"

"hippo"

"sheep"

Porsche as other objects

BibTeX

@article{chen2023text2tex,
    title={Text2Tex: Text-driven Texture Synthesis via Diffusion Models},
    author={Chen, Dave Zhenyu and Siddiqui, Yawar and Lee, Hsin-Ying and Tulyakov, Sergey and Nie{\ss}ner, Matthias},
    journal={arXiv preprint arXiv:2303.11396},
    year={2023},
}