Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

initial version of shared memcached #329

Open
wants to merge 44 commits into
base: master
Choose a base branch
from
Open

initial version of shared memcached #329

wants to merge 44 commits into from

Conversation

achreto
Copy link
Collaborator

@achreto achreto commented Aug 3, 2023

This brings a benchmark that uses a configuration of a sharded memcached to the CI. This is a baseline for the rackscale version of the same benchmark.

@vmwclabot
Copy link

@achreto, you must sign our contributor license agreement before your changes are merged. Click here to sign the agreement. If you are a VMware employee, read this for further instruction.

@achreto achreto changed the title initiali version of shared memcached initial version of shared memcached Aug 3, 2023
hunhoffe
hunhoffe reviewed Aug 4, 2023
View reviewed changes
kernel/tests/s11_rackscale_benchmarks.rs Outdated Show resolved Hide resolved
kernel/tests/s11_rackscale_benchmarks.rs Outdated Show resolved Hide resolved
kernel/tests/s11_rackscale_benchmarks.rs Outdated Show resolved Hide resolved
@achreto achreto force-pushed the bench/shardedmemcache branch from e428d1f to 21d03f1 Compare August 14, 2023 16:54
@achreto achreto force-pushed the bench/shardedmemcache branch 4 times, most recently from 1b31d6d to 16432cb Compare August 24, 2023 16:56
@achreto achreto force-pushed the bench/shardedmemcache branch from 46dedc0 to dbf5331 Compare September 11, 2023 17:39
@achreto achreto force-pushed the bench/shardedmemcache branch 2 times, most recently from aa35275 to d847eaa Compare October 11, 2023 15:53
@achreto achreto force-pushed the bench/shardedmemcache branch from 51ae645 to 1455f41 Compare October 17, 2023 23:45
@achreto achreto force-pushed the bench/shardedmemcache branch from dbdcd6e to b1fbc29 Compare November 1, 2023 20:53
@achreto achreto force-pushed the bench/shardedmemcache branch from 6fee31f to 2e4352c Compare November 13, 2023 18:37
@hunhoffe hunhoffe force-pushed the bench/shardedmemcache branch from 966a4c1 to 79b8193 Compare November 20, 2023 06:43
achreto added 15 commits November 27, 2023 10:20
@achreto
lib/vibrio: adding a hack that sends some network packets
f3ad0b2 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests/dhcp: statically configure all dhcp entries for the VMs
26a0525 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests: tweak the sleep times in the benchmarks
1bfdc00 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
usr/rkapps: bump librettos version
7012327 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests: adding support for multinode test in rackscale runner
1189be5 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests: adding sharded memcached benchmark
5a0826a 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
run.py: handle features of the usr & libs properly
c37ea63 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
run.py: always create a bridge and run dhcp on the bridge
cdc9f73 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests: adding sharded memcached to the CI pipeline
04620ac 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
run.py: adding --mid argument to set the machine id explicitly
8c15421 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests: set the machine id to 0 for the sharded tests
ff265f0 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests: increase the core count for internal memcached benchmark
ddd3fbb 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests: unify memcached memory/query config
ee7323d 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests: update memcached memory configuration
16c5d8e 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests: fix compilation
7cec4ea 
Signed-off-by: Reto Achermann <[email protected]>
achreto and others added 19 commits November 27, 2023 10:32
@achreto
tests: increase timeout for sharded nros
c183b39 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
lib/lineup: don't assert the lock owner
9d99c70 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests: fixing a few things in the sharded nros case
1d9860d 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
tests: reduce the memory size for memcached to see if the tests runs
862b52c 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
bench: disable the sharded nros benchmark
1f3f186 
Signed-off-by: Reto Achermann <[email protected]>
@hunhoffe @achreto
Fixed formatting errors
e15d8e7
@hunhoffe @achreto
Update memcache-bench git hash, detect memory allocation failures in …
fc31a02 
…memcached output, clean up compilation warnings
@hunhoffe @achreto
Add additional memcached benchmark memory for sharded linux
19f5544
@hunhoffe @achreto
Start to consolidate memcached helper functions
b0c21f8
@hunhoffe @achreto
Make memcached naming convention and output csv files consistent
296b78a
@hunhoffe @achreto
Update ci with new file names
8c59e8e
@achreto
unify the clients/cores for the nr sharded with the rackscale version
ac20b6d 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
benchmarks: apply formatter
a98a3f8 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
bench: use 4G/10M configuration for memcached
3ca169c 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
memcached: 64G memory and 10M queries
f2ed2b1 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
fix compilation
3b5ec98 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
increase timeout
f7e3f71 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
some fixes after rebasing on the large-shmem branch
6085529 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
memcached: increase memory size to avoid running out of memory
82c757d 
Signed-off-by: Reto Achermann <[email protected]>
@achreto achreto force-pushed the bench/shardedmemcache branch from c86d6c0 to 6085529 Compare November 27, 2023 20:27
achreto and others added 10 commits November 27, 2023 19:23
@achreto
correctly set timeout in rackscale runner
bf776d4 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
committing the working memcached benchmark
a80b98c 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
bump memcached versions
9f03c7d 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
some more tweaks in the memcachd benchmark
1c552bc 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
memcached: setting the number of threads propery
d06f171 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
memcached: match on multiple things to account for reordering
bdcf45e 
Signed-off-by: Reto Achermann <[email protected]>
@achreto
update librettors
a486aec 
Signed-off-by: Reto Achermann <[email protected]>
@zmckevitt
updated memcached hashes to updated version, updated parse_memcached_…
481ead0 
…output to fit new version
@zmckevitt
ignoring s10 memcached test
fce5f9a
@zmckevitt
increased timeout for benchmarks on CI runner and ignoring leveldb be…
4cdaace 
…nchmark for now
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@hunhoffe hunhoffe hunhoffe left review comments

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@achreto @vmwclabot @hunhoffe @zmckevitt