Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[YouTube] Improve comments extraction performance #573

Merged
merged 2 commits into from
Mar 5, 2021

Conversation

B0pol
Copy link
Member

@B0pol B0pol commented Mar 5, 2021

  • I carefully read the contribution guidelines and agree to them.
  • I have tested the API against NewPipe.
  • I agree to create a pull request for NewPipe as soon as possible to make it compatible with the changed API.

no need

  • do not parse responseBody twice for continuation
    instead try to get commentsTokenInside with the new pattern ("sectionListRenderer")
    and try again with the old pattern ("commentSectionRenderer") on failure
  • do not unescape responseBody multiple times
    -> parse responseBody less times

- do not parse responseBody twice for continuation
instead try to get commentsTokenInside with the new pattern ("sectionListRenderer")
and try again with the old pattern ("commentSectionRenderer") on failure
- do not unescape responseBody multiple times
   -> parse responseBody less times
@B0pol B0pol added enhancement New feature or request ASAP Issue needs to be fixed as soon as possible youtube service, https://www.youtube.com/ labels Mar 5, 2021
Copy link
Contributor

@TobiGr TobiGr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One small thing

…youtube/extractors/YoutubeCommentsExtractor.java

Co-authored-by: Tobi <[email protected]>
@TobiGr TobiGr merged commit a3c6fce into TeamNewPipe:dev Mar 5, 2021
@B0pol B0pol deleted the comments-performance branch March 5, 2021 13:51
@AudricV AudricV changed the title [youtube] improve comments extraction performance [YouTube] Improve comments extraction performance Mar 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ASAP Issue needs to be fixed as soon as possible enhancement New feature or request youtube service, https://www.youtube.com/
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants