[Remote Store] Support to emit multiple streams for a file content each responsible for processing a specific part of the file #6980
Labels
enhancement
Enhancement or improvement to existing feature or request
Reference: #6703
InputStream
extensions to emit stream from a specific part of a file, which starts reading from a specific position and ensures that maximum length of content read doesn't exceed a specified limit.OffsetRangeFileInputStream
achieves this for File objects, whileOffsetRangeIndexInputStream
achieves this for lucene's IndexInput constructRemoteTransferContainer
has utilities to open streams to specific parts of the file based on the type as mentioned in the previous point. It also manages post upload tasks by implementing anUploadFinalizer
.ResettableCheckedInputStream
allows for individual parts to be reset through mark and reset in the event of upload failuresThe text was updated successfully, but these errors were encountered: