GLevT

Code for "Gloss Matters: Unlocking the Potential of Non-Autoregressive Sign Language Translation" (ACM MM 2025)

Requirement

The source code is based on fairseq1.0.0.

• python==3.8
• fairseq==1.0.0

Please run the following shell, before run this project.

pip install --editable ./

Training and Testing

Training includes two phrase:

1. extract gloss-based visual features SMKD on https://github.com/VIPL-SLP/VAC_CSLR or gloss-free features SignCl on https://github.com/JinhuiYE/SignCL.git;
2. prepare dictionary using fairseq preprocess, run myscript/build_dict.py
3. train and test GLevT model, run myscript/trainLev.sh