Create a manifest file for training an LLM on some corpus

[jmcook1186]

Story

As a user I want to calculate the environmental impact of GPT-style model training

Rationale

LLMs have exploded in popularity in 2023 and it is therefore desirable to have them represented in the IF universe. This idea is to generate a manifest file that could be used to calculate the energy and carbon consumed by LLm training. The actual models/calculations are not requirements here - it is enough to create a manifest file that could run as this will expose gaps in the current stack.

Scope

This is a manifest file. See here for examples and here for a manifest writing tutorial.

Implementation guidelines

• The manifest MUST be a single .yaml file
• The manifest file MUST have all the required fields described here
• The manifest MUST define the necessary inputs required for the calculation
• The manifest MUST include all necessary models in a pipeline
• The manifest MUST define the expected outputs and their units
• The manifest SHOULD include comments showing which models are necessary but currently unavailable
• The manifest SHOULD include some documentation in a separate README explaining the execution flow, any known problems or missing components.

Difficulty

2/5

Impact

2/5

Examples and resources

IMPL writing guide