Sign Language Transformers (CVPR’20)
Sign Language Transformers (CVPR’20)
This repo contains the training and evaluation code for the paper Sign Language Transformers: Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation.
This code is based on Joey NMT but modified to realize joint continuous sign language recognition and translation. For text-to-text translation experiments, you can use the original Joey NMT framework.
Requirements
-
Download the feature files using the
data/download.shscript. -
[Optional] Create a conda or python virtual environment.
-
Install required packages using the
requirements.txtfile.pip install -r requirements.txt
Usage
python -m signjoey train configs/sign.yaml
! Note that the default data directory is ./data. If you download them to somewhere else, you need to update the data_path