All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
- Add support for external browser authentication in
SnowflakeDeserializer
. - Add GitHub actions workflow for creating GitHub releases.
- Use
pyproject.toml
for setuptools config.
- Go back 4 hours in the calculation of minimum record timestamp to avoid issues in concurrent loads.
- Add extra filter on the effectivity satellite's query to reduce the number of scanned records on the parent link.
- Add method
sql_load_scripts_by_group
toDataVaultLoad
.
- Add filter to
MERGE
clauses to reduce the number of scanned records. DML queries now consist of two statements, aSET
and aMERGE
, instead of just aMERGE
query.
- Add validation for driving keys (#41)
- Exclude more recent records from satellites based on hashkey or driving key (#42)
- Add support for python 3.10 (#37)
- Update
snowflake-connector-python
to~=3.0
(#37)
- Add
StagingTable
class (#30). - Add the pre-commit tool (#34).
- Changed CI/CD from Travis to Github Actions (#33).
- Apply LISTAGG to r_source in link/hub DML (#23).
- Force CAST to in hash generation when the target field is TEXT (#21).
- Add
CHANGELOG.md
(#16).
- Merge similar DML queries (#15).
- Make hashkey and hashdiff generation deterministic (#17).
- Add DISTINCT to filtered_staging in satellite MERGE statement (#18).
- Change link/hub DML to apply a DISTINCT instead of a MIN (#19).
- Remove deduplication based on hashdiffs (#14).
- Grammar issue in documentation.
- Graphviz installation in Travis for documentation website.
- Correct URLs for the Pypi page.
- Serving of all files in Github pages.
- Deprecated documentation page
introduction.rst
. - Bash script to release package (now done through tox).
- Bash script to build and upload Python package.
- Travis pipeline for CI.
py.typed
for Mypy.- CD pipeline for documentation website.
README.md
.- CD pipeline for Pypi artifacts.
- This Python package is now called
diepvries
(previouslypicnic-data-vault
).