https://github.com/hailiang-wang/transformer-pytorch-get-started
Setup Transformer Project with annotated-transformer by upgrading library, etc.
pip install -r requirements.txt
*Required torch==2.3.1+cu121 and torchtext==0.18.0.
We can begin by trying out a simple copy-task. Given a random set of input symbols from a small vocabulary, the goal is to generate back those same symbols.
./scripts/002.run_example_001.sh
First, run
./scripts/002.train_example_002.sh
By the first time, it comes to error, UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 37: invalid start byte, then, use this solution https://blog.csdn.net/samurais/article/details/147311770
cd C:\Users\Administrator\AppData\Local\Temp\tarchtext\datasets\Multi30k
tar -zxvf mmt16_task1_test.tar.gz
Further, run the previous script again.
./scripts/002.train_example_002.sh
Later, get result
