Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

don't read file into a string buffer to parse #9

Merged
merged 9 commits into from
Jun 13, 2022
Merged

don't read file into a string buffer to parse #9

merged 9 commits into from
Jun 13, 2022

Conversation

MaxOhn
Copy link
Owner

@MaxOhn MaxOhn commented Jun 13, 2022

Now loading the input bytes into a raw Vec<u8> instead of a String and only perform the UTF-8 validation for the necessary sections.
Improves parsing performance by ~13% and fixes #8 i.e. parsing UTF-16 and ANSI encoded files.
All ~130k ranked maps are now parsed without error'ing or panicking.

@MaxOhn MaxOhn merged commit bfe61f0 into next Jun 13, 2022
@MaxOhn MaxOhn deleted the vec-parsing branch June 13, 2022 20:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant