Code

Recovery#397

Code

Draft

cassyunknown wants to merge 75 commits intotwitter:mastertwitter/pelikan:masterfrom cassyunknown:recoverycassyunknown/pelikan:recoveryCopy head branch name to clipboard

+1,479-82

Commits

Commits on Feb 12, 2022

• recovery files added

  cassyunknown

  committed
  7ca757c

  Copy full SHA for 7ca757c

• removed workflows

  cassyunknown

  committed
  7e32771

  Copy full SHA for 7e32771

• added back workflows

  cassyunknown

  committed
  26b55b5

  Copy full SHA for 26b55b5

Commits on Feb 14, 2022

• removed newline from .gitignore

  cassyunknown

  committed
  356e4fd

  Copy full SHA for 356e4fd

• added descriptions for restore() and graceful_shutdown()

  cassyunknown

  committed
  0503216

  Copy full SHA for 0503216

Commits on Feb 15, 2022

• added full tempfile version

  cassyunknown

  committed
  5ea5667

  Copy full SHA for 5ea5667

• changed derive traits to be in order

  cassyunknown

  committed
  4ccf01f

  Copy full SHA for 4ccf01f

• new function that generates hash_builder, to remove repeated code

  cassyunknown

  committed
  592a823

  Copy full SHA for 592a823

• removed ccc comments

  cassyunknown

  committed
  67d5aa5

  Copy full SHA for 67d5aa5

• changed will_resore to restore. Moved hash_builder() so it is in scope

  cassyunknown

  committed
  9caeec5

  Copy full SHA for 9caeec5

• changed will_resore to restore

  cassyunknown

  committed
  b4bed3a

  Copy full SHA for b4bed3a

• took out of a Boxed struct so I can use helper function store() to copy bytes to it

  cassyunknown

  committed
  d2966d2

  Copy full SHA for d2966d2

• created store() and now will integreate into all demolish() functions

  cassyunknown

  committed
  deaaa91

  Copy full SHA for deaaa91

• all of HashTable::demolish() uses store(). Will make similar changes for TtlBuckets and Segments

  cassyunknown

  committed
  677200b

  Copy full SHA for 677200b

• updated store() so it also returns new offset

  cassyunknown

  committed
  3603c1b

  Copy full SHA for 3603c1b

• updated store() so it also returns new offset

  cassyunknown

  committed
  09a1f65

  Copy full SHA for 09a1f65

• added helper function total_buckets() to reduce repeated code

  cassyunknown

  committed
  21ba045

  Copy full SHA for 21ba045

• integrated store_bytes_and_update_offset() into Segments

  cassyunknown

  committed
  7dc7d73

  Copy full SHA for 7dc7d73

• reduced number of variables from Segments::restore()

  cassyunknown

  committed
  45aa5b1

  Copy full SHA for 45aa5b1

• added store_bytes_and_update_offset() usage to TtlBuckets::demolish() and neatened up TtlBuckets::restore()

  cassyunknown

  committed
  7c15eb8

  Copy full SHA for 7c15eb8

• moved store_bytes_and_update_offset() to store.rs so there is only 1 copy of the function

  cassyunknown

  committed
  5d0e633

  Copy full SHA for 5d0e633

• changed back to only having from_builder() to build . This function decides whether to build a new segments or not

  cassyunknown

  committed
  aeb62de

  Copy full SHA for aeb62de

• fixed ordering of derive traits for TtlBucket

  cassyunknown

  committed
  49c06e3

  Copy full SHA for 49c06e3

• removed unnecessary comments

  cassyunknown

  committed
  1606340

  Copy full SHA for 1606340

• removed newline

  cassyunknown

  committed
  1caaf22

  Copy full SHA for 1caaf22

• removed newline

  cassyunknown

  committed
  83e428a

  Copy full SHA for 83e428a

Commits on Feb 16, 2022

• added TODOs to implement Drop trait for TtlBuckets

  cassyunknown

  committed
  2df8f22

  Copy full SHA for 2df8f22

• Added Brian's File::create() changes

  cassyunknown

  committed
  7be8f07

  Copy full SHA for 7be8f07

• implemented PartialEq for HashTable

  cassyunknown

  committed
  19385a4

  Copy full SHA for 19385a4

• implemented PartialEq trait for TtlBuckets, Segments and Seg

  cassyunknown

  committed
  f7e9468

  Copy full SHA for f7e9468

• removed _restored field from Seg and replaced it with a restored() function

  cassyunknown

  committed
  710674d

  Copy full SHA for 710674d

• Clone trait now implemented for Segments and Seg can now derive Clone. Also changed derivation so that only Clone is derived for testign

  cassyunknown

  committed
  a73aa63

  Copy full SHA for a73aa63

Commits on Feb 17, 2022

• changed implementation of PartialEq to be less awkward for Segments, HashTable and TtlBuckets

  cassyunknown

  committed
  7334b3f

  Copy full SHA for 7334b3f

• ran cargo fmt

  cassyunknown

  committed
  9e9dd5c

  Copy full SHA for 9e9dd5c

• update File::create() documentation

  cassyunknown

  committed
  de08656

  Copy full SHA for de08656

• update File::create() documentation

  cassyunknown

  committed
  6d77a73

  Copy full SHA for 6d77a73

• removed conditional derivations in Seg, Segments, HashTable and TtlBuckets

  cassyunknown

  committed
  d7692ef

  Copy full SHA for d7692ef

• cannot reproduce failing of test new_file_backed_cache_changed_and_restored

  cassyunknown

  committed
  8d72b48

  Copy full SHA for 8d72b48

• implemented From<Box<[u8]>> trait for Memory

  cassyunknown

  committed
  5b6dd2f

  Copy full SHA for 5b6dd2f

• Merge branch 'master' into recovery

  cassyunknown

  authored
  f1ed123

  Copy full SHA for f1ed123

• moved merged non-recovery tests to above recovery section

  cassyunknown

  committed
  bdd17b6

  Copy full SHA for bdd17b6

• fixed mismatched bracket introduced by merge

  cassyunknown

  committed
  f47db51

  Copy full SHA for f47db51

• fixed mismatched bracket introduced by merge

  cassyunknown

  committed
  739365e

  Copy full SHA for 739365e

• added a Seg.flush() functio

  cassyunknown

  committed
  186b9b4

  Copy full SHA for 186b9b4

• completed flush() for Segments

  cassyunknown

  committed
  ed43a6d

  Copy full SHA for ed43a6d

• added flush() to TtlBuckets and HashTable. Next step: changes tests.rs so that they call flush() instead of demolish()

  cassyunknown

  committed
  917855e

  Copy full SHA for 917855e

• replaced demolish() with flush() in tests.rs. Deleted all traces of Demolisher

  cassyunknown

  committed
  995544a

  Copy full SHA for 995544a

• replaced demolish() with flush() in tests.rs. Deleted all traces of Demolisher

  cassyunknown

  committed
  43eef14

  Copy full SHA for 43eef14

• ran cargo fmt

  cassyunknown

  committed
  d62bfb0

  Copy full SHA for d62bfb0

• ran cargo fmt

  cassyunknown

  committed
  92e1f24

  Copy full SHA for 92e1f24

Commits on Feb 24, 2022

• deleted tests that are attempting recovery from files that don't exist yet, as this doesn't make sense

  cassyunknown

  committed
  dc85b30

  Copy full SHA for dc85b30

• uncommented File::create() check of expected size of file as there is not point in keeping this until there is a nice way to determine expected file size

  cassyunknown

  committed
  cefb4b9

  Copy full SHA for cefb4b9

• Changed code so that HashTable and TtlBuckets share same file. Now will change code so that Segments use same file. Also need to tidy code up

  cassyunknown

  committed
  6197220

  Copy full SHA for 6197220

• refactored code to remove now unnecessary fields from HashTable and TtlBuckets

  cassyunknown

  committed
  154549b

  Copy full SHA for 154549b

• neatened up comments for HashTable and TtlBuckets

  cassyunknown

  committed
  eb671d0

  Copy full SHA for eb671d0

• all of Segments, HashTable and ttlBuckets restored from same file

  cassyunknown

  committed
  62c953e

  Copy full SHA for 62c953e

• ran cargo fmt

  cassyunknown

  committed
  8816e11

  Copy full SHA for 8816e11

Commits on Mar 3, 2022

• added a quit() function to be called when a Quit request is received

  cassyunknown

  committed
  396e704

  Copy full SHA for 396e704

• removed quit() as this is not what we want (termination of connection). What we want is shutdown of entire cache

  cassyunknown

  committed
  ea1e114

  Copy full SHA for ea1e114

• added stop() function to be called when he request is Stop

  cassyunknown

  committed
  85531a3

  Copy full SHA for 85531a3

• added stop() function to be called when he request is Stop

  cassyunknown

  committed
  2396be8

  Copy full SHA for 2396be8

• fixed seg tests so graceful shutdown was part of configuration

  cassyunknown

  committed
  c641d8f

  Copy full SHA for c641d8f

• added test config file

  cassyunknown

  committed
  b1ed33c

  Copy full SHA for b1ed33c

• ran cargo fmt

  cassyunknown

  committed
  466a4c1

  Copy full SHA for 466a4c1

• fixed bug in config file

  cassyunknown

  committed
  7d7e952

  Copy full SHA for 7d7e952

Commits on Mar 7, 2022

• Added the Stop command wherever FlushAll command was implemented

  cassyunknown

  committed
  e8c0b6e

  Copy full SHA for e8c0b6e

Commits on Mar 8, 2022

• stop signal sent to admin stops cache from processing events and should flush the cache

  cassyunknown

  committed
  85ab29a

  Copy full SHA for 85ab29a

Commits on Mar 9, 2022

• listener, admin and multi now return upon Stop

  cassyunknown

  committed
  7dc5c48

  Copy full SHA for 7dc5c48

• attempted to add admin's own QueuePair to its signal_queue so it can receive its broadcast to its signal_queue

  cassyunknown

  committed
  9d46425

  Copy full SHA for 9d46425

• changed back to id=0 when admin receiving signals

  cassyunknown

  committed
  2318a47

  Copy full SHA for 2318a47

Commits on Mar 15, 2022

• undid Stop responsse through non-admin port

  cassyunknown

  committed
  be9a15a

  Copy full SHA for be9a15a

• removed non-admin parsing of Stop command

  cassyunknown

  committed
  ae713b7

  Copy full SHA for ae713b7

Commits on Mar 16, 2022

• updated config

  cassyunknown

  committed
  553b333

  Copy full SHA for 553b333

• ran cargo fmt

  cassyunknown

  committed
  befab11

  Copy full SHA for befab11

Commits on Mar 23, 2022

• removed unnecessary adding to admin queue

  cassyunknown

  committed
  19e0147

  Copy full SHA for 19e0147