Publications

Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Models

Xuanchi Ren*, Yifan Lu*, Tianshi Cao*, Ruiyuan Gao*, Shengyu Huang, Amirmojtaba Sabour, Tianchang Shen, Tobias Pfaff, Jay Zhangjie Wu, Runjian Chen, Seung Wook Kim, Jun Gao, Laura Leal-Taixe, Mike Chen, Sanja Fidler, Huan Ling

GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Control

Xuanchi Ren*, Tianchang Shen*, Jiahui Huang, Huan Ling, Yifan Lu, Merlin Nimier-David, Thomas Müller, Alexander Keller, Sanja Fidler, Jun Gao

Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models

Jay Zhangjie Wu*, Yuxuan Zhang*, Haithem Turki, Xuanchi Ren, Jun Gao, Mike Zheng Shou, Sanja Fidler, Zan Gojcic†, Huan Ling†

Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Control

InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Models

Yifan Lu*, Xuanchi Ren*, Jiawei Yang, Tianchang Shen, Zhangjie Wu, Jun Gao, Yue Wang, Siheng Chen, Mike Chen, Sanja Fidler, Jiahui Huang

SCube: Instant Large-Scale Scene Reconstruction using VoxSplats

Xuanchi Ren*, Yifan Lu*, Hanxue Liang, Jay Zhangjie Wu, Huan Ling, Mike Chen, Sanja Fidler, Francis Williams, Jiahui Huang

XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchies

Xuanchi Ren, Jiahui Huang, Xiaohui Zeng, Ken Museth, Sanja Fidler, Francis Williams

Blind Deflickering by Neural Filtering with a Flawed Atlas

Chenyang Lei*, Xuanchi Ren*, Zhaoxiang Zhang, Qifeng Chen

Look Outside the Room: Synthesizing A Consistent Long-Term 3D Scene Video from A Single Image

Xuanchi Ren, Xiaolong Wang

Towards Building A Group-based Unsupervised Representation Disentanglement Framework

Tao Yang, Xuanchi Ren, Yuwang Wang, Wenjun Zeng

Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph

Dacheng Yin*, Xuanchi Ren*, Chong Luo, Yuwang Wang, Zhiwei Xiong, Wenjun Zeng

Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View

Xuanchi Ren*, Tao Yang*, Yuwang Wang, Wenjun Zeng

Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Driving

Xuanchi Ren*, Tao Yang*, Li Erran Li, Alexandre Alahi, Qifeng Chen

Rethinking Content and Style: Exploring Bias for Unsupervised Disentanglement

Xuanchi Ren, Tao Yang, Yuwang Wang, Wenjun Zeng

Video Deblurring by Fitting to Test Data

Xuanchi Ren*, Zian Qian*, Qifeng Chen

PDF Code Website

Self-supervised Dance Video Synthesis Conditioned on Music

Xuanchi Ren, Haoran Li, Zijian Huang, Qifeng Chen