File tree Expand file tree Collapse file tree 6 files changed +13505
-11
lines changed Expand file tree Collapse file tree 6 files changed +13505
-11
lines changed Original file line number Diff line number Diff line change 1+ name : Update Operations Documentation 
2+ 
3+ on :
4+     push :
5+         paths :
6+             - ' docs/ops/**' 
7+             - ' scripts/create_ops_docs.py' 
8+     pull_request :
9+         paths :
10+             - ' docs/ops/**' 
11+             - ' scripts/create_ops_docs.py' 
12+ 
13+ jobs :
14+     update-ops-docs :
15+         runs-on : ubuntu-latest 
16+ 
17+         steps :
18+         - name : Checkout repository 
19+           uses : actions/checkout@v4 
20+ 
21+         - name : Set up Python 
22+           uses : actions/setup-python@v5 
23+           with :
24+               python-version : ' 3.x' 
25+ 
26+         - name : Generate operations documentation 
27+           run : ./scripts/create_ops_docs.py 
28+ 
29+         - name : Check if docs/ops.md was updated 
30+           id : check_changes 
31+           run : | 
32+               if git diff --quiet docs/ops.md; then 
33+                   echo "changed=false" >> $GITHUB_OUTPUT 
34+               else 
35+                   echo "changed=true" >> $GITHUB_OUTPUT 
36+               fi 
37+ 
38+ name : Commit updated documentation 
39+           if : steps.check_changes.outputs.changed == 'true' && github.event_name == 'push' 
40+           run : | 
41+               git config --local user.email "[email protected] " 42+               git config --local user.name "GitHub Action" 
43+               git add docs/ops.md 
44+               git commit -m "Update operations documentation from CSV files" 
45+               git push 
Original file line number Diff line number Diff line change 1+ # GGML Operations  
2+ 
3+ List of GGML operations and backend support status.
4+ 
5+ Legend:
6+ -  ✅ Fully supported by this backend
7+ -  🟡 Partially supported by this backend
8+ -  ❌ Not supported by this backend
9+ 
10+ |  Operation |  CPU |  CUDA | 
11+ | -----------| ------| ------| 
12+ |                               ABS |  ✅ |  🟡 | 
13+ |                               ACC |  ✅ |  ✅ | 
14+ |                               ADD |  ✅ |  ✅ | 
15+ |                              ADD1 |  ✅ |  ✅ | 
16+ |                            ARANGE |  ✅ |  ✅ | 
17+ |                            ARGMAX |  ✅ |  ✅ | 
18+ |                           ARGSORT |  ✅ |  ✅ | 
19+ |                             CLAMP |  ✅ |  ✅ | 
20+ |                            CONCAT |  ✅ |  🟡 | 
21+ |                              CONT |  ✅ |  🟡 | 
22+ |                        CONV_2D_DW |  ✅ |  ✅ | 
23+ |                 CONV_TRANSPOSE_1D |  ✅ |  ✅ | 
24+ |                 CONV_TRANSPOSE_2D |  ✅ |  ✅ | 
25+ |                               COS |  ✅ |  ✅ | 
26+ |                       COUNT_EQUAL |  ✅ |  ✅ | 
27+ |                               CPY |  🟡 |  🟡 | 
28+ |                CROSS_ENTROPY_LOSS |  ✅ |  ✅ | 
29+ |           CROSS_ENTROPY_LOSS_BACK |  ✅ |  ✅ | 
30+ |                     DIAG_MASK_INF |  ✅ |  ✅ | 
31+ |                               DIV |  ✅ |  ✅ | 
32+ |                               DUP |  ✅ |  🟡 | 
33+ |                               ELU |  ✅ |  ❌ | 
34+ |                               EXP |  ✅ |  🟡 | 
35+ |                    FLASH_ATTN_EXT |  ✅ |  🟡 | 
36+ |                 GATED_LINEAR_ATTN |  ✅ |  ✅ | 
37+ |                             GEGLU |  ✅ |  ✅ | 
38+ |                         GEGLU_ERF |  ✅ |  ✅ | 
39+ |                       GEGLU_QUICK |  ✅ |  ✅ | 
40+ |                              GELU |  ✅ |  🟡 | 
41+ |                          GELU_ERF |  ✅ |  🟡 | 
42+ |                        GELU_QUICK |  ✅ |  🟡 | 
43+ |                          GET_ROWS |  ✅ |  🟡 | 
44+ |                     GET_ROWS_BACK |  🟡 |  🟡 | 
45+ |                        GROUP_NORM |  ✅ |  ✅ | 
46+ |                       HARDSIGMOID |  ✅ |  🟡 | 
47+ |                         HARDSWISH |  ✅ |  🟡 | 
48+ |                            IM2COL |  ✅ |  ✅ | 
49+ |                           L2_NORM |  ✅ |  ✅ | 
50+ |                        LEAKY_RELU |  ✅ |  ✅ | 
51+ |                               LOG |  ✅ |  ✅ | 
52+ |                              MEAN |  ✅ |  ✅ | 
53+ |                               MUL |  ✅ |  ✅ | 
54+ |                           MUL_MAT |  🟡 |  🟡 | 
55+ |                        MUL_MAT_ID |  ✅ |  ✅ | 
56+ |                               NEG |  ✅ |  🟡 | 
57+ |                              NORM |  ✅ |  ✅ | 
58+ |                    OPT_STEP_ADAMW |  ✅ |  ✅ | 
59+ |                          OUT_PROD |  🟡 |  🟡 | 
60+ |                               PAD |  ✅ |  ✅ | 
61+ |                    PAD_REFLECT_1D |  ✅ |  ❌ | 
62+ |                           POOL_2D |  ✅ |  ✅ | 
63+ |                             REGLU |  ✅ |  ✅ | 
64+ |                              RELU |  ✅ |  🟡 | 
65+ |                            REPEAT |  ✅ |  🟡 | 
66+ |                       REPEAT_BACK |  ✅ |  ✅ | 
67+ |                          RMS_NORM |  ✅ |  ✅ | 
68+ |                     RMS_NORM_BACK |  ✅ |  ✅ | 
69+ |                      RMS_NORM_MUL |  ✅ |  ✅ | 
70+ |                              ROPE |  ✅ |  ✅ | 
71+ |                         ROPE_BACK |  ✅ |  ✅ | 
72+ |                         RWKV_WKV6 |  ✅ |  ✅ | 
73+ |                         RWKV_WKV7 |  ✅ |  ✅ | 
74+ |                             SCALE |  ✅ |  ✅ | 
75+ |                               SET |  ✅ |  ❌ | 
76+ |                          SET_ROWS |  🟡 |  ❌ | 
77+ |                               SGN |  ✅ |  🟡 | 
78+ |                           SIGMOID |  ✅ |  🟡 | 
79+ |                              SILU |  ✅ |  🟡 | 
80+ |                         SILU_BACK |  ✅ |  ✅ | 
81+ |                               SIN |  ✅ |  ✅ | 
82+ |                          SOFT_MAX |  ✅ |  ✅ | 
83+ |                     SOFT_MAX_BACK |  🟡 |  🟡 | 
84+ |                               SQR |  ✅ |  ✅ | 
85+ |                              SQRT |  ✅ |  ✅ | 
86+ |                          SSM_CONV |  ✅ |  ✅ | 
87+ |                          SSM_SCAN |  ✅ |  ✅ | 
88+ |                              STEP |  ✅ |  🟡 | 
89+ |                               SUB |  ✅ |  ✅ | 
90+ |                               SUM |  ✅ |  ✅ | 
91+ |                          SUM_ROWS |  ✅ |  ✅ | 
92+ |                            SWIGLU |  ✅ |  ✅ | 
93+ |                              TANH |  ✅ |  🟡 | 
94+ |                TIMESTEP_EMBEDDING |  ✅ |  ✅ | 
95+ |                           UPSCALE |  ✅ |  ✅ | 
 
 
   
 
     
   
   
          
    
    
     
    
      
     
     
    You can’t perform that action at this time.
  
 
    
  
    
      
        
     
       
      
     
   
 
    
    
  
 
  
 
     
    
0 commit comments