Skip to content

Commit

Permalink
fix: re pushing aws instances remaining to be fixed in aws.csv
Browse files Browse the repository at this point in the history
docs: improving results.md

docs: improved results.md
  • Loading branch information
bpetit committed Apr 17, 2024
1 parent 84db477 commit 44e2f4b
Show file tree
Hide file tree
Showing 2 changed files with 68 additions and 1 deletion.
27 changes: 27 additions & 0 deletions boaviztapi/data/archetypes/cloud/aws.csv
Original file line number Diff line number Diff line change
Expand Up @@ -214,6 +214,10 @@ f1.4xlarge,16,244,940,0,0,platform_aws_f1,https://aws.amazon.com/fr/ec2/instance
f1.16xlarge,64,976,3760,0,0,platform_aws_f1,https://aws.amazon.com/fr/ec2/instance-types/f1/
g2.2xlarge,8,15,60,0,1,g2.8xlarge,
g2.8xlarge,32,60,240,0,4,g2.8xlarge,https://aws.amazon.com/blogs/aws/new-g2-instance-type-with-4x-more-gpu-power/
g3.4xlarge,16,122,0,0,1,platform_aws_g3,https://aws.amazon.com/fr/ec2/instance-types/g3/
g3.8xlarge,32,244,0,0,2,platform_aws_g3,https://aws.amazon.com/fr/ec2/instance-types/g3/
g3.16xlarge,64,488,0,0,4,platform_aws_g3,https://aws.amazon.com/fr/ec2/instance-types/g3/
g3s.xlarge,4,30.5,0,0,1,platform_aws_g3,https://aws.amazon.com/fr/ec2/instance-types/g3/
g4ad.xlarge,4,16,150,0,1,platform_aws_g4ad,https://aws.amazon.com/fr/ec2/instance-types/g4/
g4ad.2xlarge,8,32,300,0,1,platform_aws_g4ad,https://aws.amazon.com/fr/ec2/instance-types/g4/
g4ad.4xlarge,16,64,600,0,1,platform_aws_g4ad,https://aws.amazon.com/fr/ec2/instance-types/g4/
Expand Down Expand Up @@ -304,6 +308,20 @@ inf2.xlarge,4,16,0,0,1,inf2.48xlarge,
inf2.8xlarge,32,128,0,0,1,inf2.48xlarge,
inf2.24xlarge,96,384,0,0,6,inf2.48xlarge,
inf2.48xlarge,192,768,0,0,12,inf2.48xlarge,
is4gen.medium,1,6,937,0,0,is4gen.8xlarge,
is4gen.large,2,12,1875,0,0,is4gen.8xlarge,
is4gen.xlarge,4,24,3750,0,0,is4gen.8xlarge,
is4gen.2xlarge,8,48,7500,0,0,is4gen.8xlarge,
is4gen.4xlarge,16,96,15000,0,0,is4gen.8xlarge,
is4gen.8xlarge,32,192,30000,0,0,is4gen.8xlarge,
db.m1.medium,1,3.75,0,0,0,platform_aws_m1,https://aws.amazon.com/ec2/previous-generation/
m1.medium,1,3.75,410,0,0,platform_aws_m1,https://aws.amazon.com/ec2/previous-generation/
db.m1.small,1,1.7,0,0,0,platform_aws_m1,https://aws.amazon.com/ec2/previous-generation/
m1.small,1,1.7,160,0,0,platform_aws_m1,https://aws.amazon.com/ec2/previous-generation/
db.m1.large,2,7.5,0,0,0,platform_aws_m1,https://aws.amazon.com/ec2/previous-generation/
m1.large,2,7.5,840,0,0,platform_aws_m1,https://aws.amazon.com/ec2/previous-generation/
db.m1.xlarge,4,15,0,0,0,platform_aws_m1,https://aws.amazon.com/ec2/previous-generation/
m1.xlarge,4,15,1680,0,0,platform_aws_m1,https://aws.amazon.com/ec2/previous-generation/
db.m2.xlarge,2,17,0,0,0,platform_aws_m2,
m2.xlarge,2,17,420,0,0,platform_aws_m2,
db.m2.2xlarge,4,34,0,0,0,platform_aws_m2,
Expand Down Expand Up @@ -533,6 +551,14 @@ m7g.8xlarge,32,128,0,0,0,m7g.metal,
m7g.12xlarge,48,192,0,0,0,m7g.metal,
m7g.16xlarge,64,256,0,0,0,m7g.metal,
m7g.metal,64,256,0,0,0,m7g.metal,
m7gd.medium,1,4,59,0,0,m7gd.metal,
m7gd.large,2,8,118,0,0,m7gd.metal,
m7gd.xlarge,4,16,237,0,0,m7gd.metal,
m7gd.2xlarge,8,32,474,0,0,m7gd.metal,
m7gd.4xlarge,16,64,950,0,0,m7gd.metal,
m7gd.8xlarge,32,128,1900,0,0,m7gd.metal,
m7gd.12xlarge,48,192,2850,0,0,m7gd.metal,
m7gd.16xlarge,64,256,3800,0,0,m7gd.metal,
m7i.large,2,8,0,0,0,m7i.48xlarge,
m7i.xlarge,4,16,0,0,0,m7i.48xlarge,
m7i.2xlarge,8,32,0,0,0,m7i.48xlarge,
Expand All @@ -548,6 +574,7 @@ m7i-flex.2xlarge,8,32,0,0,0,m7i.48xlarge,
m7i-flex.4xlarge,16,64,0,0,0,m7i.48xlarge,
m7i-flex.8xlarge,32,128,0,0,0,m7i.48xlarge,
mac1.metal,12,32,0,0,0,mac1.metal,
mac2.metal,12,16,0,0,0,mac2.metal,
p2.xlarge,4,61,0,0,1,platform_aws_p2,https://aws.amazon.com/fr/ec2/instance-types/p2/
p2.8xlarge,32,488,0,0,8,platform_aws_p2,https://aws.amazon.com/fr/ec2/instance-types/p2/
p2.16xlarge,64,732,0,0,16,platform_aws_p2,https://aws.amazon.com/fr/ec2/instance-types/p2/
Expand Down
42 changes: 41 additions & 1 deletion boaviztapi/data/utils/complete_Azure_VMs/RESULTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,12 +4,16 @@ This is the documentation regarding the data in `results.csv`, generated by the

In this document the word "phase" as in "lifecycle phase" regarding the lifecycle of a digital product or service, following the ISO 14040. Those phases are : raw material extraction, manufacturing, transport, use and end of life.

**Warning: this document details the perimeter covered by BoavitAPI's calculations, this is true at the moment this file it written, it should be updated when the API gets updated with new features !**

## Columns reference

`gwp_manufacturing_1h_impact`: **G**lobal **W**arming **P**otential footprint estimated by the API, with an allocation of the impact for 1h runtime, considering the ratio `duration` / `server_lifetime` (see the[API's documentation](https://doc.api.boavizta.org/Explanations/embedded_methodology/)), in **kgC02eq**
`gwp_manufacturing_1h_impact`: **G**lobal **W**arming **P**otential footprint, for the manufacturing and raw materials extraction phases, estimated by the API, with an allocation of the impact for 1h runtime, considering the ratio `duration` / `server_lifetime` (see the[API's documentation](https://doc.api.boavizta.org/Explanations/embedded_methodology/)), in **kgC02eq**

Embedded impacts returned per instance are a sub allocation of the bare metal server embedded impacts. The formulas used for this allocation are described [in the API documentation](https://doc.api.boavizta.org/Explanations/services/cloud/#method).

`gwp_manufacturing_total_impact`: GWP "embedded" footprint (raw materials extraction and manufacturing phases), estimated for a given instance, assuming that this instance is up and running for the full lifetime of the bare metal platform.

Use phase energy consumption and GWP footprint are calculated, depending on the CPU load percentage hypothesis and the usage location.

Energy consumption columns follow the naming convention `energy_1h_loadX`, **X** being the CPU time usage percentage hypothesis.
Expand All @@ -26,8 +30,44 @@ For example:
- `gwp_use_1h_load0_FRA`: reports the estimated greenhouse gas emissions attributed to a given instance, in an IDLE state / CPU time usage being close to 0%, in France
- `gwp_use_1h_load0_GBR`: reports the estimated greenhouse gas emissions attributed to a given instance, in an IDLE state / CPU time usage being close to 0%, in the United Kingdom

## Perimeter covered

### Infrastructure accounted for

BoaviztAPI, as of now, only accounts for the share of impacts related to the underlying hardware platform, dedicated to the service (in our case the bare metal hosts supporting the cloud instances).

In a life cycle approach, a share of the mutualized infrastructure, necessary for this service to be proposed, should be accounted for as well.

The drawing below shows what parts of the perimeter are included in the API calculation (in black and plain lines) and what parts are not (in grey and dotted lines). Those parts should be implemented in the API in near to middle future, stay tuned and update the generate_azure_impacts scritp if needed, as well as this documentaiton.

![Perimeter covered by BoaviztAPI's cloud/instance route](../../../../docs/docs/assets/boaviztapi_cloud_instance_perimeter.webp)

### GPUs

The data gathered for cloud provider do include GPUs, as it is intended to provide both embedded and operational impacts for those components in BoaviztAPI.

However, those features are not merged yet, so the results found in results.csv won't include them.

You can follow those ongoing isses on Github to keep track of the evolution regarding those features: for [use phase](https://github.com/Boavizta/boaviztapi/issues/150), for [embedded impacts](https://github.com/Boavizta/boaviztapi/issues/65).

### Storage

BoaviztAPI doesn't provide calculations for "remote" storage (storage services accessed through network, like block storage "EBS" at AWS).

This is in the roadmap and [should be implemented in the following months](https://github.com/Boavizta/boaviztapi/issues/143).

For now, the instances storage amount you will find in [azure.csv]() are made of : SSD storage space bundled in the instance bill line (when announced as such in the documentation) + directly and locally attached NVMe storage (especially L instances families, optimized for storage).

For the SSD storage space bundled with the instance, this is probably underestimated, as we don't properly model the storage service, that includes most probably much more than just hard drives.

Instances that only rely on remote storage (as described in the documentation) are accounted with a storage space of 0. You can identify those instances looking at the verbose part of BoaviztAPI's responses, there shouldn't be any SSD-1 or HDD-1 key in the verbose dictionnary.

## Impact criterias and life cyccle phases covered

Here are the environmental impact categories presented in result.csv and the life cycle steps accounted for.

Increasing this list only requires to edit the generate_azure_impacts.py script to fill the file with more impact categories (16 are available).

- Green House Gaz emissions / Global Warming Potential (see GHG protocol as a reference)
- resources extraction (LCA) / scope 3 (GHG protocol) ✔️
- use (LCA) / scope 2 (GHG protocol) ✔️
Expand Down

0 comments on commit 44e2f4b

Please sign in to comment.