Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move to keyset pagination #220

Merged
merged 27 commits into from
Aug 26, 2024
Merged

Move to keyset pagination #220

Show file tree
Hide file tree
Changes from 16 commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
67d774f
move to keyset pagination
d33bs Jul 30, 2024
1a4c6ed
linting
d33bs Jul 30, 2024
df1f7a5
adjustments for further data integration
d33bs Jul 31, 2024
23e8f0b
test adjustments
d33bs Jul 31, 2024
0d82ecb
linting corrections
d33bs Aug 1, 2024
e8e9565
run dev workflow
d33bs Aug 1, 2024
b809695
fix docs
d33bs Aug 1, 2024
c3bfea5
remove custom sql join for large data test
d33bs Aug 1, 2024
1e391c2
test with rowcount update
d33bs Aug 1, 2024
c2aaadb
linting, docs, cleanup
d33bs Aug 1, 2024
df677f4
cleanup
d33bs Aug 1, 2024
0501350
remove test branch
d33bs Aug 1, 2024
6fbf1b2
rework pageset generation
d33bs Aug 2, 2024
2517df6
linting
d33bs Aug 2, 2024
9001152
fix types and docstring
d33bs Aug 2, 2024
2deef1e
docs and types
d33bs Aug 2, 2024
73f9ac4
update to use pageset instead of chunk fxn names
d33bs Aug 8, 2024
b59aac5
update variable names
d33bs Aug 26, 2024
c04ebf3
better exception docs
d33bs Aug 26, 2024
d0c6892
better docstring parameter description
d33bs Aug 26, 2024
e9681f7
better documentation and exception msg
d33bs Aug 26, 2024
85678e2
remove exception
d33bs Aug 26, 2024
178149c
point to the example in docs
d33bs Aug 26, 2024
e33de20
add further notes about when/why to customize
d33bs Aug 26, 2024
22c326b
linting
d33bs Aug 26, 2024
f3a671d
remove test raise
d33bs Aug 26, 2024
c41796e
sorted results from concatenation by natural sort
d33bs Aug 26, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 0 additions & 7 deletions cytotable/constants.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,13 +68,6 @@
],
}

# metadata column names and types for internal use within CytoTable
CYOTABLE_META_COLUMN_TYPES = {
"cytotable_meta_source_path": "VARCHAR",
"cytotable_meta_offset": "BIGINT",
"cytotable_meta_rownum": "BIGINT",
}
d33bs marked this conversation as resolved.
Show resolved Hide resolved

CYTOTABLE_DEFAULT_PARQUET_METADATA = {
"data-producer": "https://github.com/cytomining/CytoTable",
"data-producer-version": str(_get_cytotable_version()),
Expand Down
Loading
Loading