Skip to content

Add Tier 1 infrastructure documentation guides#5

Merged
sunway513 merged 1 commit into
mainfrom
docs/tier1-infrastructure-guides
Feb 8, 2026
Merged

Add Tier 1 infrastructure documentation guides#5
sunway513 merged 1 commit into
mainfrom
docs/tier1-infrastructure-guides

Conversation

@sunway513
Copy link
Copy Markdown
Owner

Summary

  • Add JIT Compilation System guide — @compile_ops decorator, module config, build flow, cache, GPU detection
  • Add Distributed Infrastructure guide — tensor parallelism, custom/quick all-reduce, Iris comms, shared memory broadcast
  • Add Sampling Operators guide — logit-level fused (greedy/random/mixed), probability-level (top-k/top-p)
  • Add Top-K Operators guide — MOE routing (grouped, biased), general-purpose adaptive, per-row radix sort
  • Add GEMM Tuning & Gradlib guide — CSV-based kernel dispatch, hipBLASLt/ASM tuning, tuner workflow
  • Update README with new operator rows (Sampling, Top-K, Communication) and Infrastructure & Tuning section

Test plan

  • Verify all markdown links resolve correctly
  • Verify API examples match current source code
  • Verify source file and test file paths are accurate

🤖 Generated with Claude Code

Add five new documentation guides covering AITER's core infrastructure:
- JIT compilation system (@compile_ops, module config, build flow, cache)
- Distributed infrastructure (all-reduce variants, TP/PP/DP/EP, Iris comms)
- Sampling operators (logit-level fused, probability-level top-k/top-p)
- Top-K operators (MOE routing, grouped/biased topk, adaptive strategies)
- GEMM tuning & gradlib (CSV dispatch, hipBLASLt/ASM tuning, tuner workflow)

Update README with new operator rows (Sampling, Top-K, Communication) and
Infrastructure & Tuning section linking to the new guides.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@sunway513 sunway513 merged commit 34b2d68 into main Feb 8, 2026
11 of 15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant