Add model card for Light-X
Browse filesThis PR adds a comprehensive model card for the Light-X model. It includes:
- A link to the paper: [Light-X: Generative 4D Video Rendering with Camera and Illumination Control](https://huggingface.co/papers/2512.05115)
- Links to the project page and the GitHub repository for further details and code.
- Essential metadata such as `pipeline_tag: image-to-video` for better discoverability on the Hub.
- The `library_name: diffusers`, enabling an automated code snippet for usage, as evidenced by `_diffusers_version` in `config.json` and acknowledgements in the project.
- The `license: apache-2.0`, based on common practice for similar open-source projects.
- Sample installation and inference instructions with code snippets directly from the GitHub README.
Please review and merge if everything looks good!
|
@@ -0,0 +1,52 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
pipeline_tag: image-to-video
|
| 4 |
+
library_name: diffusers
|
| 5 |
+
---
|
| 6 |
+
|
| 7 |
+
# Light-X: Generative 4D Video Rendering with Camera and Illumination Control
|
| 8 |
+
|
| 9 |
+
This repository contains the official model for the paper [Light-X: Generative 4D Video Rendering with Camera and Illumination Control](https://huggingface.co/papers/2512.05115).
|
| 10 |
+
|
| 11 |
+
Light-X is a video generation framework that enables controllable rendering from monocular videos with both viewpoint and illumination control. It proposes a disentangled design that decouples geometry and lighting signals, and introduces Light-Syn, a degradation-based pipeline, to synthesize training pairs from in-the-wild monocular footage.
|
| 12 |
+
|
| 13 |
+
Project Page: https://lightx-ai.github.io/
|
| 14 |
+
Code: https://github.com/TQTQliu/Light-X
|
| 15 |
+
|
| 16 |
+
<div align="center">
|
| 17 |
+
<img src="https://github.com/user-attachments/assets/2211979f-4910-4a88-bf19-19711fa07182" width="100%"/>
|
| 18 |
+
</div>
|
| 19 |
+
|
| 20 |
+
## Abstract Summary
|
| 21 |
+
Light-X is a video generation framework that enables controllable rendering from monocular videos with both viewpoint and illumination control. It tackles the trade-off between lighting fidelity and temporal consistency by proposing a disentangled design for geometry and lighting signals, and addresses the lack of paired multi-view and multi-illumination videos through a degradation-based pipeline called Light-Syn.
|
| 22 |
+
|
| 23 |
+
## Installation
|
| 24 |
+
To get started with Light-X, clone the repository and set up the environment:
|
| 25 |
+
|
| 26 |
+
```bash
|
| 27 |
+
git clone https://github.com/TQTQliu/Light-X.git
|
| 28 |
+
cd Light-X
|
| 29 |
+
conda create -n lightx python=3.10
|
| 30 |
+
conda activate lightx
|
| 31 |
+
pip install -r requirements.txt
|
| 32 |
+
```
|
| 33 |
+
|
| 34 |
+
## Inference
|
| 35 |
+
You can run inference using the provided `run.sh` script. All required models will be downloaded automatically.
|
| 36 |
+
|
| 37 |
+
```bash
|
| 38 |
+
bash run.sh
|
| 39 |
+
```
|
| 40 |
+
For more detailed arguments and examples on camera and relighting control, please refer to the [official GitHub repository's inference section](https://github.com/TQTQliu/Light-X#%EF%B8%8F-inference).
|
| 41 |
+
|
| 42 |
+
## Citation
|
| 43 |
+
If you find our work useful for your research, please consider citing our paper:
|
| 44 |
+
|
| 45 |
+
```bibtex
|
| 46 |
+
@article{lightx,
|
| 47 |
+
title = {Light-X: Generative 4D Video Rendering with Camera and Illumination Control},
|
| 48 |
+
author = {Liu, Tianqi and Chen, Zhaoxi and Huang, Zihao and Xu, Shaocong and Zhang, Saining and Ye, Chongjie and Li, Bohan and Cao, Zhiguo and Li, Wei and Zhao, Hao and Liu, Ziwei},
|
| 49 |
+
journal = {arXiv preprint arXiv:2512.05115},
|
| 50 |
+
year = {2025}
|
| 51 |
+
}
|
| 52 |
+
```
|