README.md

Kernel Development for Deep Learning

Tutorials & Resources for Kernel Development for GPUs

Video Resources:

Deep Learning:

• Andrej Karpathy: Neural Networks: Zero to Hero

Kernel Development:

• Jeremy Howard: Getting Started With CUDA for Python Programmers
• freeCodeCamp: CUDA Programming Repo
• Lightning AI: The Thunder Sessions

JIT:

• Just In Time (JIT) Compilers
• Compiler,Interpreter,JIT

Study Materials:

Blog:

• Part 1
• Part 2

Documentation:

• Triton(OpenAI) Documentation
• torch.compile

Handbook:

• Programming Massively Parallel Processors: A Hands-on Approach

Reddit:

• Discussion 1

GPU Glossary

Temp:

• Podcast
• 0MEAN1SIGMA - How to Program a GPU