Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create preprocess.py #2295

Merged
merged 3 commits into from
Aug 24, 2022
Merged

Create preprocess.py #2295

merged 3 commits into from
Aug 24, 2022

Conversation

THUzyt21
Copy link
Contributor

If there are no spaces between sentences in your text file, use this file to generate a new file, which adds spaces between each token.

PR types

PR changes

Describe

If there are no spaces between sentences in your text file, use this file to generate a new file, which adds spaces between each token.
@CLAassistant
Copy link

CLAassistant commented Aug 24, 2022

CLA assistant check
All committers have signed the CLA.

@yt605155624
Copy link
Collaborator

挪到 local 文件夹里面吧

If there are no spaces between sentences in your text file, use this file to generate a new file, which adds spaces between each token.
Copy link
Collaborator

@yt605155624 yt605155624 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@THUzyt21 THUzyt21 merged commit aa4c9ec into PaddlePaddle:develop Aug 24, 2022
@THUzyt21 THUzyt21 deleted the test branch August 24, 2022 08:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants