Add model card for Light-X

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +52 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: image-to-video
4
+ library_name: diffusers
5
+ ---
6
+
7
+ # Light-X: Generative 4D Video Rendering with Camera and Illumination Control
8
+
9
+ This repository contains the official model for the paper [Light-X: Generative 4D Video Rendering with Camera and Illumination Control](https://huggingface.co/papers/2512.05115).
10
+
11
+ Light-X is a video generation framework that enables controllable rendering from monocular videos with both viewpoint and illumination control. It proposes a disentangled design that decouples geometry and lighting signals, and introduces Light-Syn, a degradation-based pipeline, to synthesize training pairs from in-the-wild monocular footage.
12
+
13
+ Project Page: https://lightx-ai.github.io/
14
+ Code: https://github.com/TQTQliu/Light-X
15
+
16
+ <div align="center">
17
+ <img src="https://github.com/user-attachments/assets/2211979f-4910-4a88-bf19-19711fa07182" width="100%"/>
18
+ </div>
19
+
20
+ ## Abstract Summary
21
+ Light-X is a video generation framework that enables controllable rendering from monocular videos with both viewpoint and illumination control. It tackles the trade-off between lighting fidelity and temporal consistency by proposing a disentangled design for geometry and lighting signals, and addresses the lack of paired multi-view and multi-illumination videos through a degradation-based pipeline called Light-Syn.
22
+
23
+ ## Installation
24
+ To get started with Light-X, clone the repository and set up the environment:
25
+
26
+ ```bash
27
+ git clone https://github.com/TQTQliu/Light-X.git
28
+ cd Light-X
29
+ conda create -n lightx python=3.10
30
+ conda activate lightx
31
+ pip install -r requirements.txt
32
+ ```
33
+
34
+ ## Inference
35
+ You can run inference using the provided `run.sh` script. All required models will be downloaded automatically.
36
+
37
+ ```bash
38
+ bash run.sh
39
+ ```
40
+ For more detailed arguments and examples on camera and relighting control, please refer to the [official GitHub repository's inference section](https://github.com/TQTQliu/Light-X#%EF%B8%8F-inference).
41
+
42
+ ## Citation
43
+ If you find our work useful for your research, please consider citing our paper:
44
+
45
+ ```bibtex
46
+ @article{lightx,
47
+ title = {Light-X: Generative 4D Video Rendering with Camera and Illumination Control},
48
+ author = {Liu, Tianqi and Chen, Zhaoxi and Huang, Zihao and Xu, Shaocong and Zhang, Saining and Ye, Chongjie and Li, Bohan and Cao, Zhiguo and Li, Wei and Zhao, Hao and Liu, Ziwei},
49
+ journal = {arXiv preprint arXiv:2512.05115},
50
+ year = {2025}
51
+ }
52
+ ```