Adding --long support for --patch-from#1959

Merged

bimbashrestha merged 34 commits intofacebook:devfrom bimbashrestha:bimba-diff-long1

Apr 17, 2020

+339-104

Commits on Apr 7, 2020

adding long support for patch-from
Bimba Shrestha
committed
adding refPrefix to dictionary_decompress
Bimba Shrestha
committed
adding refPrefix to dictionary_loader
Bimba Shrestha
committed
conversion nit
Bimba Shrestha
committed
triggering log mode on chainLog < fileLog and removing old threshold
Bimba Shrestha
committed
adding refPrefix to dictionary_round_trip
Bimba Shrestha
committed
adding docs
Bimba Shrestha
committed

Commits on Apr 8, 2020

adding enableldm + forceWindow test for dict
Bimba Shrestha
committed
separate patch-from logic into FIO_adjustParamsForPatchFromMode
Bimba Shrestha
committed
moving memLimit adjustment to outside ifdefs (need for decomp)
Bimba Shrestha
committed
removing refPrefix gate on dictionary_round_trip
Bimba Shrestha
committed
rebase on top of dev refPrefix change
Bimba Shrestha
committed
making sure refPrefx + ldm is < 1% of srcSize
Bimba Shrestha
committed
combining notes for patch-from
Bimba Shrestha
committed
moving memlimit logic inside fileio.c
Bimba Shrestha
committed
adding display for optimal parser and long mode trigger
Bimba Shrestha
committed
conversion nit
Bimba Shrestha
committed

Commits on Apr 9, 2020

fuzzer found heap-overflow fix
Bimba Shrestha
committed
another conversion nit
Bimba Shrestha
committed
moving FIO_adjustMemLimitForPatchFromMode outside ifndef
Bimba Shrestha
committed
making params immutable
Bimba Shrestha
committed
moving memLimit update before createDictBuffer call
Bimba Shrestha
committed
making maxSrcSize unsigned long long
Bimba Shrestha
committed
making dictSize and maxSrcSize params unsigned long long
Bimba Shrestha
committed
error on files larger than 4gb
Bimba Shrestha
committed
extend refPrefix test to include round trip
Bimba Shrestha
committed
conversion to size_t
Bimba Shrestha
committed

Commits on Apr 15, 2020

making sure ldm is at least 10x better
Bimba Shrestha
committed
removing break
Bimba Shrestha
committed

Commits on Apr 16, 2020

including zstd_compress_internal and removing redundant macros
Bimba Shrestha
committed
exposing ZSTD_cycleLog()
Bimba Shrestha
committed
using cycleLog instead of chainLog
Bimba Shrestha
committed

Commits on Apr 17, 2020

add some more docs about user optimizations
Bimba Shrestha
committed
formatting
Bimba Shrestha
committed