You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Sometimes we want to perform benchmark on a filled cluster. Filling it with gRPC is fast, but not enough: we are talking about weeks, not hours. Writing a separate utility for this is a dead-end scenario IMO: it has only 1 use-case, maintenance costs are non-negligible, users need to learn yet another CLI interface (and, of course, inevitable bugs in the implementation).
The proposal is to use implement local client:
Use engine from frostfs-node.
Execute k6 on a target hardware using new local.js scenario.
Policer/tree service sync will do the rest.
Pros:
The results can be compared with gRPC results to see the overhead we have.
Easily automated to test for regressions. Local benchmarks in the frostfs-node are not suitable for this: they are usually not long/big enough.
S3 is also easily supported: engine exports all necessary machinery.
Cons:
Harder to maintain compatibility: we need to update k6 each time engine is updated. However, it isn't impossible: the engine interface changes very rarely.
Importing frostfs-node here is not aestethically pleasing IMO.
Yes. Tree service is just a wrapper over the engine, we can work with pilorama directly.
The only difficulty is knowing the tree structure for a bucket, but our bench is simple enough (flat structure, single version).
Sometimes we want to perform benchmark on a filled cluster. Filling it with gRPC is fast, but not enough: we are talking about weeks, not hours. Writing a separate utility for this is a dead-end scenario IMO: it has only 1 use-case, maintenance costs are non-negligible, users need to learn yet another CLI interface (and, of course, inevitable bugs in the implementation).
The proposal is to use implement local client:
engine
fromfrostfs-node
.local.js
scenario.Pros:
frostfs-node
are not suitable for this: they are usually not long/big enough.Cons:
frostfs-node
here is not aestethically pleasing IMO.cc @anikeev-yadro @realloc @carpawell @alexvanin
The text was updated successfully, but these errors were encountered: