Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ROCm: sgl-kernel enablement starting with sgl_moe_align_block #3285

Closed
wants to merge 3 commits into from

Conversation

HaiShaw
Copy link
Collaborator

@HaiShaw HaiShaw commented Feb 4, 2025

Motivation

  1. Enable sgl-kernel on ROCm, make it easy to add individual kernels
  2. Use sgl_moe_align_block kernel for fused_moe for performance

Modifications

As they are.

Checklist

@HaiShaw
Copy link
Collaborator Author

HaiShaw commented Feb 4, 2025

Pls no review until I fixed docker build ....

@HaiShaw HaiShaw closed this Feb 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants