Use Seek() and Read() APIs for index/data files instead of mmap + share expensive seeker resources among seekers#1421

Merged

richardartoul merged 69 commits intomasterfrom ra/no-mmap-files-v2

Mar 26, 2019

+1,019-407

Commits on Mar 22, 2019

wip
Richard Artoul
committed
refactor interfaces
Richard Artoul
committed
dont duplicate interfaces
Richard Artoul
committed
fix waitgroup.Done() bug
Richard Artoul
committed
delete commented out code
Richard Artoul
committed
clean up buffer
Richard Artoul
committed
re-enable test
Richard Artoul
committed
improve comment
Richard Artoul
committed
undo unrelated change
Richard Artoul
committed
Refactor checked bytes usage
Richard Artoul
committed
dec ref before finalize
Richard Artoul
committed
return error if call decodeBytes without byte decoder stream
Richard Artoul
committed
Add comment for error
Richard Artoul
committed
use constants for seek calls
Richard Artoul
committed
fix bug
Richard Artoul
committed
reorder initialization code
Richard Artoul
committed
fix nil id check
Richard Artoul
committed
clarify comments
Richard Artoul
committed
reorder functions
Richard Artoul
committed
reduce per-seeker pointers
Richard Artoul
committed
fix clone bug
Richard Artoul
committed
pass resources to seeker constructor, pool them in manager, and fix tsts
Richard Artoul
committed
dont alloc msgpack decoder in readInfo
Richard Artoul
committed
use resources for index lookup
Richard Artoul
committed
refactor interfaces
Richard Artoul
committed
Finalize tags
Richard Artoul
committed
add tags to conc test
Richard Artoul
committed
improve retriever concurrency test
Richard Artoul
committed
fix compilation issues
Richard Artoul
committed
rename
Richard Artoul
committed
remove broken test
Richard Artoul
committed
fix bug
Richard Artoul
committed
propagate seek reader buffer size
Richard Artoul
committed
return tags to pool
Richard Artoul
committed
add todo
Richard Artoul
committed
remove unused type and methods
Richard Artoul
committed
mark retriever test as big
Richard Artoul
committed
reduce test memory usage
Richard Artoul
committed
make sure to read full
Richard Artoul
committed
fix panic
Richard Artoul
committed
add simple bytes pool
Richard Artoul
committed
improve comment
Richard Artoul
committed
add test for bytes pool path
Richard Artoul
committed
improve comment and rename var
Richard Artoul
committed
shift code around
Richard Artoul
committed
remove unused field in struct
Richard Artoul
committed
remove newline
Richard Artoul
committed
clarify comment
Richard Artoul
committed
fix comment
Richard Artoul
committed
remove comment
Richard Artoul
committed
add periods
Richard Artoul
committed
fix brkoen test
Richard Artoul
committed
dont call getResources twice
Richard Artoul
committed
remove unneeded var
Richard Artoul
committed
check if bytesPool == nil
Richard Artoul
committed
use standard object pool
Richard Artoul
committed
handle reqs with errors in retriever
Richard Artoul
committed
Add unit tests and fix retreiver when seeke error
Richard Artoul
committed
add better comment
Richard Artoul
committed
refactor code to have less branching
Richard Artoul
committed
reuse decoder stream from resources instead of allocating in constructor
Richard Artoul
committed
fix broken test
Richard Artoul
committed
regen mocks
Richard Artoul
committed
fix compilation issue
Richard Artoul
committed
remove unneeded errors
Richard Artoul
committed
remove unneeded syscall
Richard Artoul
committed
add comment
Richard Artoul
committed

Commits on Mar 26, 2019