Code

Autotuner for int mm Triton kernels#41

Code

Merged

cpuhrsch merged 38 commits intomainpytorch/ao:mainfrom

intmmbenchmarks1pytorch/ao:intmmbenchmarks1Copy head branch name to clipboard

Mar 21, 2024

Commits

Commits on Feb 29, 2024

• int_mm benchmarks

  cpuhrsch

  committed
  ba24af7

  Copy full SHA for ba24af7

• Baseline results

  cpuhrsch

  committed
  1f5a811

  Copy full SHA for 1f5a811

• Running shapes over night

  cpuhrsch

  committed
  b8bcf27

  Copy full SHA for b8bcf27

• Rerun result 1 with empty cache

  cpuhrsch

  committed
  44c97a6

  Copy full SHA for 44c97a6

• Filter results_2

  cpuhrsch

  committed
  579fc5e

  Copy full SHA for 579fc5e

• Triton matmul

  cpuhrsch

  committed
  8251780

  Copy full SHA for 8251780

Commits on Mar 2, 2024

• Store best configs

  cpuhrsch

  committed
  434b92f

  Copy full SHA for 434b92f

• Faster autotuner

  cpuhrsch

  committed
  e3dcf6d

  Copy full SHA for e3dcf6d

• Inject intmm triton

  cpuhrsch

  committed
  cacef6b

  Copy full SHA for cacef6b

Commits on Mar 3, 2024

• Scaled int mm

  cpuhrsch

  committed
  0f2a706

  Copy full SHA for 0f2a706

• More scaled matmul

  cpuhrsch

  committed
  395b93c

  Copy full SHA for 395b93c

Commits on Mar 5, 2024

• evict_last

  cpuhrsch

  committed
  f2bf0fd

  Copy full SHA for f2bf0fd

Commits on Mar 6, 2024

• Only 1 scales and better Triton code

  cpuhrsch

  committed
  ea635ed

  Copy full SHA for ea635ed

• a100 specific configs based on all configs

  cpuhrsch

  committed
  ffd0d66

  Copy full SHA for ffd0d66

• data pkl based on regular configs

  cpuhrsch

  committed
  75ef774

  Copy full SHA for 75ef774

• Enable all configs

  cpuhrsch

  committed
  404814f

  Copy full SHA for 404814f

Commits on Mar 12, 2024

• Move configs to torchao

  cpuhrsch

  committed
  145a498

  Copy full SHA for 145a498

• Read configs from library package

  cpuhrsch

  committed
  016a839

  Copy full SHA for 016a839

Commits on Mar 13, 2024

• More environment variables

  cpuhrsch

  committed
  36bfe59

  Copy full SHA for 36bfe59

• Benchmark for sam shapes

  cpuhrsch

  committed
  62bc110

  Copy full SHA for 62bc110

• More A100 configs

  cpuhrsch

  committed
  8ce5707

  Copy full SHA for 8ce5707

• Revert quant primitives

  cpuhrsch

  committed
  2797cf3

  Copy full SHA for 2797cf3

• Merge remote-tracking branch 'origin/main' into intmmbenchmarks1

  cpuhrsch

  committed
  73f6671

  Copy full SHA for 73f6671

Commits on Mar 14, 2024

• Make autotuner work with compile

  cpuhrsch

  committed
  20333cf

  Copy full SHA for 20333cf

• Merge branch 'main' of github.com:pytorch-labs/ao into intmmbenchmarks1

  cpuhrsch

  committed
  3f6ddb4

  Copy full SHA for 3f6ddb4

• Make benchmark output a bit more clear

  cpuhrsch

  committed
  c846b70

  Copy full SHA for c846b70

• Make benchmark output a bit more clear

  cpuhrsch

  committed
  8f4d6cc

  Copy full SHA for 8f4d6cc

Commits on Mar 18, 2024

• Merge branch 'main' of github.com:pytorch-labs/ao into intmmbenchmarks1

  cpuhrsch

  committed
  54976d4

  Copy full SHA for 54976d4

• Basic test harness

  cpuhrsch

  committed
  e590bce

  Copy full SHA for e590bce

• Basic test harness

  cpuhrsch

  committed
  b376dae

  Copy full SHA for b376dae

Commits on Mar 19, 2024

• scaled int mm tests

  cpuhrsch

  committed
  171c491

  Copy full SHA for 171c491

• dev requirements

  cpuhrsch

  committed
  5437476

  Copy full SHA for 5437476

• Address comments

  cpuhrsch

  committed
  ef26555

  Copy full SHA for ef26555

• Merge branch 'main' of github.com:pytorch-labs/ao into intmmbenchmarks1

  cpuhrsch

  committed
  f4e6b7f

  Copy full SHA for f4e6b7f

• lintrunner.toml

  cpuhrsch

  committed
  bc6d23f

  Copy full SHA for bc6d23f

• Much lint, so wow

  cpuhrsch

  committed
  9c45710

  Copy full SHA for 9c45710

Commits on Mar 20, 2024

• Merge branch 'main' of github.com:pytorch-labs/ao into intmmbenchmarks1

  cpuhrsch

  committed
  b4ddebc

  Copy full SHA for b4ddebc

Commits on Mar 21, 2024

• Merge branch 'main' of github.com:pytorch-labs/ao into intmmbenchmarks1

  cpuhrsch

  committed
  771fadd

  Copy full SHA for 771fadd