Home

Welcome to the benchmarkVis wiki!

Description

The purpose of the package is to provide a flexible and simple to use framework to visualize benchmark results.

Benchmarking is a good way to compare the performances of different algorithms. To evaluate the results often the same procedures are used. But even though different benchmarks normally contain similar information, the structure can differ significantly. This increases the effort to visualize and analyze them. You have to do the same creation steps over and over again with just a few little changes. At this point the benchmarkVis package comes into play. It aims to convert various formats into a default data table which can be visualized in multiple ways.

The package offers several differant plots which range from simple bar charts to complex parallel coordinates plots. All the functionalities are also provided from an interactive shiny application to simplify the workflow even more. This includes comprehensive methods to manipulate the input benchmark data.

The benchmarks themselves are not generated with this package. They have to be imported from other tools. But no problem, the benchmarkVis package offers several easy ways to integrate benchmark results from your favorite software. Therefore a clearly structured input data format has been defined which is combinable with csv and json files, R data.table or directly with R benchmark packages like mlr, microbenchmark or rbenchmark through different wrappers.

Tutorial

The easiest way to get started with benchmarkVis is with our Tutorial.

Tutorial

• 1. Data Structure
• 2. R Shell
  • 2.1. Load Benchmark
  • 2.2. Create Plots
• 3. Shiny Application
  • 3.1. Load Benchmark
  • 3.2. Manipulate Table
  • 3.3. Create Plots
• 4. Implemented Plots
• 5. Example Use Cases
• 6. Contribute to benchmarkVis

Just click the link below and learn all about the package features:

==> Start Tutorial <==