Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BlobStorage: Possibility of downloading a batch of blobs #554

Open
casparjespersen opened this issue Feb 12, 2019 · 5 comments
Open

BlobStorage: Possibility of downloading a batch of blobs #554

casparjespersen opened this issue Feb 12, 2019 · 5 comments

Comments

@casparjespersen
Copy link

Which service(blob, file, queue) does this issue concern?

blob

Which version of the SDK was used? Please provide the output of pip freeze.

azure-storage-blob==1.4.0
azure-storage-common==1.4.0

What problem was encountered?

I am missing the possibility of downloading/reading a batch of blobs (specifically a "folder") -- a functionality which is already present in the Azure CLI (az storage blob download-batch). I am currently using the service.get_blob_to_text(container: str, path: str), and I imagine the syntax being service.get_blobs_to_text(container: str, paths: iterable).

Have you found a mitigation/solution?

Currently I am reading the files one-by-one, which generates a performance overhead.

@zezha-msft
Copy link
Contributor

Hi @casparjespersen, thanks for reaching out!

We already have this feature on our roadmap, but I unfortunately do not have a timeline to share yet.

@dreamflasher
Copy link

@zezha-msft Any progress update on this?

@zezha-msft
Copy link
Contributor

Sorry @dreamflasher, there is no update for now, as we've been working on a new version of the SDK.

@erfannariman
Copy link

erfannariman commented Dec 10, 2020

I created a Python wrapper for the Azure CLI to do downloads / uploads in batches, see here for more details:

Installation:

pip install azurebatchload

See the GitHub repo for usage examples.

@ilayn
Copy link

ilayn commented Apr 26, 2021

Other than @erfannariman 's noble attempt, is there any update for this getting support from the offical sdk?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants