Create a model plugin to calculate the energy and carbon consumed during LLM inference #34
navveenb
started this conversation in
Develop an Idea
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Story
As a user, I want to calculate the environmental impact during LLM inference
Rationale
This idea is to generate a model that could be used to calculate the energy and carbon consumed during LLM inference
Scope
This is a Model implementation.
Implementation guidelines
This model MUST conform to the
ModelPlugininterface*Difficulty
4/5
Impact
4/5
Examples and resources
IMPL writing guide
Beta Was this translation helpful? Give feedback.
All reactions