Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🎲 Provide GPU enabled Airflow containers #4755

Closed
5 tasks
jacobwoffenden opened this issue Jul 24, 2024 · 1 comment · Fixed by moj-analytical-services/user-guidance#440
Closed
5 tasks
Assignees
Labels

Comments

@jacobwoffenden
Copy link
Member

User Story

As an Analytical Platform engineer
I want to provide base images for our Airflow service that container NVIDIA drivers
So that DAGs can make use of the GPU compute capability we've enabled

Value / Purpose

Migration of Airflow to APC EKS has unlocked the ability to consume GPU enabled compute in a simpler fashion, however the base containers we provider do not include the NVIDIA drivers

Useful Contacts

@jacobwoffenden

User Types

Analytical Platform engineering

Hypothesis

If we add NVIDIA drivers to Airflow base images
Then engineers can properly consume the GPU enabled compute

Proposal

Add NVIDIA drivers to Airflow base images

Additional Information

No response

Definition of Done

  • NVIDIA drivers added to Airflow base images
  • Base images published and test
  • User docs have been updated
  • Another team member has reviewed
  • Tests are green
@jacobwoffenden
Copy link
Member Author

Customer demand #4907

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

2 participants