Skip to content

Commit

Permalink
Add notes about pagination authentication methods
Browse files Browse the repository at this point in the history
  • Loading branch information
sultaniman authored May 13, 2024
1 parent 4df3d04 commit 8cb13c8
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions docs/website/docs/walkthroughs/create-a-pipeline.md
Original file line number Diff line number Diff line change
Expand Up @@ -103,6 +103,11 @@ def githubapi_resource(api_secret_key: str = dlt.secrets.value):
yield page
```

Since we're using a personal access token, it's necessary to use `BearerTokenAuth` for passing the correct authentication details.
GitHub returns the next page link through the header parameter `link`.
Consequently, our `HeaderLinkPaginator` pagination strategy enables the rest client to seamlessly navigate through the pages and retrieve data.
For additional details, consult https://docs.github.com/en/rest/using-the-rest-api/using-pagination-in-the-rest-api?apiVersion=2022-11-28

## 4. Load the data

Uncomment the commented out code in `main` function in `githubapi.py`, so that running the
Expand Down

0 comments on commit 8cb13c8

Please sign in to comment.