Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Codegen][GPU] Add kernel config for LLVMGPUTileAndFuse for targeting mma #18105

Merged
merged 3 commits into from
Aug 6, 2024

Conversation

qedawkins
Copy link
Contributor

This patch adds kernel configuration logic for contraction like
operations to use mma instructions with the LLVMGPUTileAndFusePipeline.
This directly leverages the configuration logic already present and in
use for existing matmul based pipelines, instead generating a config for
TileAndFuse.

@qedawkins qedawkins force-pushed the mfma_kernel_config branch from 2923149 to aa40e0f Compare August 5, 2024 23:24
@qedawkins qedawkins requested a review from Max191 August 6, 2024 13:15
@qedawkins qedawkins force-pushed the mfma_kernel_config branch from aa40e0f to 0b9028d Compare August 6, 2024 15:16
@qedawkins qedawkins marked this pull request as ready for review August 6, 2024 15:18
Copy link
Contributor

@Max191 Max191 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall, looks good. Main comment is that I think the configuration logic should exclude unsupported intrinsic types.

@@ -0,0 +1,112 @@
// Copyright 2024 The IREE Authors
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Commenting for other reviewers, since it may not be clear. The contents of this file were moved from TargetUtils/ConfigUtils.cpp (which has been replaced with new logic in that file).

This patch adds kernel configuration logic for contraction like
operations to use mma instructions with the LLVMGPUTileAndFusePipeline.
This directly leverages the configuration logic already present and in
use for existing matmul based pipelines, instead generating a config for
TileAndFuse.
@qedawkins qedawkins force-pushed the mfma_kernel_config branch from 85588aa to 2eed5f5 Compare August 6, 2024 18:30
@qedawkins qedawkins requested review from Max191 and kuhar August 6, 2024 18:30
@qedawkins qedawkins enabled auto-merge (squash) August 6, 2024 19:04
@qedawkins qedawkins merged commit 5d8362c into iree-org:main Aug 6, 2024
44 checks passed
@qedawkins qedawkins deleted the mfma_kernel_config branch August 6, 2024 19:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants