This repository implements multicalibration algorithms.
MIT License Copyright (c) 2023 Eric Zhao. Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
This repository contains the following files:
hedge.py
: Contains the implementation of the Hedge algorithm.multicalibration.py
: Contains the implementation of the multicalibration algorithm.benchmark.py
: Runs the multicalibration algorithm on a set of generated data.calibration.py
: Contains utility functions for calibration.dataset.py
: Contains dataset wrappers.analysis.py
: Analyze the results of runningbenchmark.py
.
- Clone the repository.
- Install the necessary dependencies.
- Run
benchmark.py
to execute the experiment. - Run
analysis.py
.
Warning: This script regularly dumps Pickle checkpoints. It can quickly fill up your disk with hundreds of GBs of these small checkpoint files.