Skip to content

Latest commit

 

History

History
51 lines (42 loc) · 1.19 KB

README.md

File metadata and controls

51 lines (42 loc) · 1.19 KB

Leveraging Grammar Induction for Language Understanding and Generation

Code for the paper Leveraging Grammar Induction for Language Understanding and Generation.

This repo is build upon fairseq toolkit.

Environment setup

git clone https://github.com/LUMIA-Group/Leveraging-Grammar-Induction
cd Leveraging-Grammar-Induction
pip install --editable ./

Example experiments

cd data_prepare # prepare and prepocess the data
bash prepare-iwslt14.sh
bash preprocess-iwslt14.sh
  • Training and evalutaion
cd ../experiments
  • Baseline: Transformer
bash run-transformer.sh
  • Grammar-enhanced Transformer
bash bpe.sh
bash run-grammarformer.sh

Citation

If you find this work helpful, please cite our paper:

@misc{kai2024leveraginggrammarinductionlanguage,
      title={Leveraging Grammar Induction for Language Understanding and Generation}, 
      author={Jushi Kai and Shengyuan Hou and Yusheng Huang and Zhouhan Lin},
      year={2024},
      eprint={2410.04878},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2410.04878}, 
}