FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting
By Rui Liu, Hanming Deng, Yangyi Huang, Xiaoyu Shi, Lewei Lu, Wenxiu Sun, Xiaogang Wang, Jifeng Dai, Hongsheng Li.
This repo is the official Pytorch implementation of FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting.
Introduction
Usage
Prerequisites
Install
git clone https://github.com/ruiliu-ai/FuseFormer.git
cd FuseFormer
pip install -r requirements.txt
Training
Dataset preparation
Download datasets (YouTube-VOS and DAVIS) into the data folder.
mkdir data
Training script
python train.py -c configs/youtube-vos.json
Test
Download pre-trained model into checkpoints folder.
mkdir checkpoints
Test script
python test.py -c checkpoints/fuseformer.pth -v data/DAVIS/JPEGImages/blackswan -m data/DAVIS/Annotations/blackswan
Citing FuseFormer
If you find FuseFormer useful in your research, please consider citing:
@InProceedings{Liu_2021_FuseFormer,
title={FuseFormer: Fusing Fine-Grained Information in Transformers