Skip to content

Release 2019-07-29: new command: locatefiles

Pre-release
Pre-release
Compare
Choose a tag to compare
@steveloughran steveloughran released this 29 Jul 16:03
· 56 commits to master since this release
tag_2019-07-29_release
9798dd2
This commit was signed with the committer’s verified signature.
steveloughran Steve Loughran
GPG key ID: D22CF846DBB162A0
Learn about vigilant mode.

Release: 2019-07-29, adds a new command: locatefiles

This command replicates the process used in directory tree scanning in FileInputFormat, so can be used to measure/tune performance as well as debug any problems surfacing there.

Example:

hadoop jar cloudstore-0.1-SNAPSHOT.jar locatefiles -threads 8 -verbose s3a://landsat-pds/L8/001/002/LC80010022016230LGN00/
Assets 3
Loading