Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add AnnData as format #2974

Merged
merged 31 commits into from
Apr 6, 2023
Merged

Conversation

flying-sheep
Copy link
Collaborator

@flying-sheep flying-sheep commented Aug 8, 2022

Description

Add AnnData as supported format

TODO

  • Check if AnnData can interact with buffers
  • Add to optional feature dependencies (extras)
  • Sample h5ad file
  • Unit tests
  • Documentation
  • Changelog entry

@akarve akarve requested review from sir-sigurd and eode August 9, 2022 00:55
Copy link
Member

@sir-sigurd sir-sigurd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This needs tests and changelog entry.

Might makes to add anndata as extra dependency, see

extras_require={
.

Also it would be useful if you provide sample .h5ad file.

@flying-sheep flying-sheep marked this pull request as ready for review August 19, 2022 11:22
@flying-sheep
Copy link
Collaborator Author

I think this looks good. I can’t run gendocs though, I get

Starting pydocmd_main...
Started generating documentation...
Traceback (most recent call last):
  File "/home/phil/Dev/Python/Misc/Quilt/gendocs/build.py", line 90, in <module>
    pydocmd_main()
  File "/home/phil/Dev/Python/Misc/Quilt/.venv/lib/python3.10/site-packages/pydocmd/__main__.py", line 251, in main
    loader.load_section(section)
  File "/home/phil/Dev/Python/Misc/Quilt/.venv/lib/python3.10/site-packages/pydocmd/loader.py", line 87, in load_section
    sig = get_function_signature(obj, scope if inspect.isclass(scope) else None)
  File "/home/phil/Dev/Python/Misc/Quilt/.venv/lib/python3.10/site-packages/pydocmd/loader.py", line 138, in get_function_signature
    sig = str(inspect.signature(function))
  File "/usr/lib/python3.10/inspect.py", line 3247, in signature
    return Signature.from_callable(obj, follow_wrapped=follow_wrapped,
  File "/usr/lib/python3.10/inspect.py", line 2995, in from_callable
    return _signature_from_callable(obj, sigcls=cls,
  File "/usr/lib/python3.10/inspect.py", line 2392, in _signature_from_callable
    raise TypeError('{!r} is not a callable object'.format(obj))
TypeError: <classmethod(<function Package.install at 0x7f29436355a0>)> is not a callable object

@sir-sigurd sir-sigurd self-requested a review August 19, 2022 19:13
@codecov
Copy link

codecov bot commented Sep 9, 2022

Codecov Report

Merging #2974 (ab5c024) into master (2313e3a) will increase coverage by 0.12%.
The diff coverage is 90.38%.

@@            Coverage Diff             @@
##           master    #2974      +/-   ##
==========================================
+ Coverage   35.14%   35.27%   +0.12%     
==========================================
  Files         679      679              
  Lines       29616    29658      +42     
  Branches     4400     4400              
==========================================
+ Hits        10410    10462      +52     
+ Misses      18013    18003      -10     
  Partials     1193     1193              
Flag Coverage Δ
api-python 91.17% <90.38%> (+0.23%) ⬆️
catalog 8.87% <ø> (ø)
lambda 86.07% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
api/python/setup.py 0.00% <ø> (ø)
api/python/quilt3/formats.py 85.20% <86.48%> (+3.34%) ⬆️
api/python/tests/test_formats.py 100.00% <100.00%> (ø)

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@flying-sheep
Copy link
Collaborator Author

flying-sheep commented Sep 9, 2022

OK, done!

@flying-sheep flying-sheep requested review from sir-sigurd and removed request for eode September 12, 2022 08:35
@flying-sheep
Copy link
Collaborator Author

those tests are pretty flaky, I didn’t touch lambda and now it fails …

api/python/quilt3/formats.py Outdated Show resolved Hide resolved
api/python/quilt3/formats.py Outdated Show resolved Hide resolved
@robnewman
Copy link
Contributor

@sir-sigurd Can you please review the PR?

api/python/quilt3/formats.py Outdated Show resolved Hide resolved
api/python/quilt3/formats.py Outdated Show resolved Hide resolved
api/python/quilt3/formats.py Outdated Show resolved Hide resolved
api/python/quilt3/formats.py Outdated Show resolved Hide resolved
api/python/quilt3/formats.py Outdated Show resolved Hide resolved
flying-sheep and others added 2 commits February 9, 2023 21:55
@akarve akarve requested a review from sir-sigurd March 16, 2023 00:01
@sir-sigurd sir-sigurd merged commit 3d4d22c into quiltdata:master Apr 6, 2023
nl0 added a commit that referenced this pull request Apr 6, 2023
* master:
  Add AnnData as format (#2974)
  Add unit tests for selector_fn (#3394)
  Quilt3 v5.2.1 (#3399)
  Render status report if no `bucketConfig` (#3396)
  Fix CSV serialization with pandas 2 (#3395)
@flying-sheep flying-sheep deleted the format-anndata branch April 6, 2023 10:40
robnewman pushed a commit that referenced this pull request Apr 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants