Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[XLA:GPU][Indexing] Add documentation about tile analysis. #8810

Closed
wants to merge 3 commits into from

Conversation

pifon2a
Copy link
Member

@pifon2a pifon2a commented Jan 25, 2024

Indexing analysis is implemented for most of the HLO ops. This document describes, how it works.

@github-actions github-actions bot added the kokoro:force-run Forces CI to rerun label Jan 25, 2024
@kokoro-team kokoro-team removed the kokoro:force-run Forces CI to rerun label Jan 25, 2024
@github-actions github-actions bot added the kokoro:force-run Forces CI to rerun label Jan 25, 2024
@kokoro-team kokoro-team removed the kokoro:force-run Forces CI to rerun label Jan 25, 2024
@github-actions github-actions bot added the kokoro:force-run Forces CI to rerun label Jan 25, 2024
@kokoro-team kokoro-team removed the kokoro:force-run Forces CI to rerun label Jan 25, 2024
Copy link
Member

@thomasjoerg thomasjoerg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you, Alex. This was a great read!

docs/indexing.md Outdated Show resolved Hide resolved
docs/indexing.md Outdated Show resolved Hide resolved
docs/indexing.md Outdated Show resolved Hide resolved
docs/indexing.md Outdated Show resolved Hide resolved
docs/indexing.md Outdated Show resolved Hide resolved
docs/indexing.md Outdated Show resolved Hide resolved
docs/indexing.md Outdated Show resolved Hide resolved
docs/indexing.md Outdated Show resolved Hide resolved

### Softmax

![img](./images/indexing_analysis_softmax.png)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The HLO fusion seems to contain duplicate code - is this before DCE?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i think it is after.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The reduce-broadcast-subtract-exponential looks identical. We could use the output of exponential1 as input for divide instead, right?

docs/indexing.md Outdated Show resolved Hide resolved
@github-actions github-actions bot added the kokoro:force-run Forces CI to rerun label Jan 28, 2024
@kokoro-team kokoro-team removed the kokoro:force-run Forces CI to rerun label Jan 28, 2024
@github-actions github-actions bot added the kokoro:force-run Forces CI to rerun label Jan 28, 2024
@kokoro-team kokoro-team removed the kokoro:force-run Forces CI to rerun label Jan 28, 2024
@pifon2a pifon2a requested a review from thomasjoerg January 28, 2024 17:35
Copy link
Member

@thomasjoerg thomasjoerg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are a few unresolved comments regarding rendering issues in the preview, you may want to take another look at. Other than that, this looks good to me. Thank you, Alex!

copybara-service bot pushed a commit to tensorflow/tensorflow that referenced this pull request Jan 29, 2024
Imported from GitHub PR openxla/xla#8810

Indexing analysis is implemented for most of the HLO ops. This document describes, how it works.
Copybara import of the project:

--
fbd61ef93e8613c54a0273d14e78ff46aca99edf by Alexander Belyaev <[email protected]>:

[XLA:GPU][Indexing] Add documentation about tile analysis.

--
787090adafa3b61ef03a5684652e8772d31d7d9e by Alexander Belyaev <[email protected]>:

Address the comments

--
720c60c4b5d6ea62e45af42b575b8b8d9dd0fc2e by Alexander Belyaev <[email protected]>:

replace % with mod

Merging this change closes #8810

PiperOrigin-RevId: 602312874
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants