Support of new option offset to ignore token score of special tokens #2612

Job	Run time
build-and-test-cpp-aarch64 (openblas)	4m 6s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	5m 45s
build-and-push-docker-images	23m 8s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	5m 54s
build-python-wheels (ubuntu-20.04, auto64)	26m 23s
build-and-test-cpp-x86_64 (macos-11, mkl)	9m 47s
check-python-style	9s
build-python-wheels (macos-11, auto64)	34m 44s
build-and-test-cpp-x86_64 (macos-11, dnnl)	9m 10s
build-python-wheels (windows-2019, auto64)	42m 18s
build-python-wheels (ubuntu-20.04, aarch64)	1h 11m 55s
build-python-wheels (macos-11, arm64)	11m 12s
build-and-deploy-docs	29s
test-python-wheels (ubuntu-20.04)	9m 13s
test-python-wheels (macos-11)	5m 50s
test-python-wheels (windows-2019)	3m 39s
publish-python-wheels-on-pypi	0s
	4h 23m 42s

Provide feedback