ObjCtrl-2.5D: Training-free Object Control with Camera Pose

Zhouxia Wang   Yushi Lan   Shangchen Zhou   Chen Change Loy

S-Lab, NTU Singapore

     

---

---

This repo is an official implementation of ObjCtrl-2.5D: Training-free Object Control with Camera Pose. ObjCtrl-2.5D models a 3D trajectory, extended from a 2D trajectory with depth information, as a sequence of camera poses, enabling object motion control using an existing camera motion control I2V generation model without training. Dynamic results achieved by our ObjCtrl-2.5D are provided in our .

📝 Changelog

• 202412: Release both code and demo (🤗 ) of ObjCtrl-2.5D.

⚙️ Environment

conda create -n objctrl2.5d python=3.10
conda activate objctrl2.5d
pip install -r requirements.txt

💫 Running Gradio Demo

python -m app

📚 Citation

If you make use of our work, please cite our paper.

@inproceedings{objctrl2.5d,
  title={{ObjCtrl-2.5D}: Training-free Object Control with Camera Poses},
  author={Wang, Zhouxia and Lan, Yushi and Zhou, Shangchen and Loy, Chen Change},
  booktitle={arXiv preprint arXiv:2412.07721},
  year={2024}
}

🤗 Acknowledgment

We appreciate the authors of SVD, CameraCtrl, SAM2, and ZoeDepth for their awesome works.

❓ Contact

For any question, feel free to email [email protected].