Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 0.3.2 #115

Merged
merged 13 commits into from
Sep 2, 2024
Merged

Release 0.3.2 #115

merged 13 commits into from
Sep 2, 2024

Conversation

dombean
Copy link
Member

@dombean dombean commented Sep 2, 2024

For a detailed list of changes included in this release, please refer to the CHANGELOG.md.

dombean added 11 commits August 1, 2024 15:01
…py-version

GitHub Workflow Fix: Pin numpy version in setup.cfg
* Add function truncate_external_hive_table

* Add function truncate_external_hive_table

* Add unit tests for function truncate_external_hive_table

* Add unit tests for function truncate_external_hive_table

* Modify docstring

* Remove type-hints from unit tests
* load_csv() function

* Move csv fixture outside class

* Fix TestLoadCSV unit tests

* Cleaner docstring

* Cleaner docstring

* Cleaner docstring

* Add function rename_columns()

* fix pre-commit

* remove rename_columns already have function called map_column_names
* add more params to load_and_validate_table()

* add unit tests

* update docstring in load_csv
* Docs: Update to ons-mkdocs-theme

* fix typo

* deploy_mkdocs.yaml: Update from Python 3.10 to 3.11

* Better Navigation

* remove doc dependency for unit tests

* pin numpy version

* pin numpy version
…#114)

* Add load_csv() in cdp/helpers/s3_utils.py

* add unit tests

* standardise param names and fix docstring

* remove whitespace docstring
* Fix create_spark_session() shuffle service

* add more optimisation params
* load_csv() add encoding parameter

* add kwargs parameter

* add kwargs parameter

* add kwargs parameter unit tests

* add kwargs parameter unit tests

* fix kwargs parameter unit tests

* modify docstring with notes section
@dombean dombean requested a review from diego-ons as a code owner September 2, 2024 07:51
@dombean dombean merged commit b0dc331 into main Sep 2, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant