- 
                Notifications
    You must be signed in to change notification settings 
- Fork 587
Pull requests: pytorch/torchtitan
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
      remove scatter_add in MoE implementation
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
      
  
        
          #1974
            opened Oct 31, 2025  by
            garrett361
            
        
        
            
    •
    
      Draft
    
  
        
        
      
    
      [Compiler Toolkit] Enable nested_compile_region on TransformerBlock
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
        
          #1973
            opened Oct 31, 2025  by
            SherlockNoMad
            
        
        
            
    •
    
      Draft
    
  
        
        
      
    
      [simplefsdp] fix region ac in zero2-style FSDP
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
        
          #1970
            opened Oct 30, 2025  by
            ruisizhang123
            
        
        
            
    •
    
      Draft
    
  
        
        
      
    
      [FLUX] Add single prompt mode for FLUX inference and inference CI test
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
      
  
        
          #1969
            opened Oct 30, 2025  by
            wwwjn
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      Fix bugs in initial_load_in_hf when enable_weight_tying=true in Qwen3
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
      
  
        
          #1964
            opened Oct 29, 2025  by
            Achazwl
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [Compiler Toolkit] Assert compile.enable=False 
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
      
  
        
          #1947
            opened Oct 28, 2025  by
            SherlockNoMad
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [mxfp8 moe training] add mxfp8 all to all impl
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
      
  
        
          #1912
            opened Oct 17, 2025  by
            danielvegamyhre
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      set pg names
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
        
          #1910
            opened Oct 17, 2025  by
            tushar00jain
            
        
        
            
    •
    
      Draft
    
  
        
        
      
    
      [llama3-8B] add flex_attention model flavor
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
    
      [RFC][WIP][CP] Enable FlexAttention CP for llama3
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
    
      [RFC] Lift freqs_cis as an input of models
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
    
      [SimpleFSDP] add manual bucketing pass
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
      
  
        
          #1881
            opened Oct 15, 2025  by
            ruisizhang123
            
        
        
            
    
  
    Loading…
 
        
          
   
        
      
    
      
        
      
      
  
    4 tasks
  
      [NOT for land] cleaner workaround for moe + compile + ac graph break issue
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
        
          #1875
            opened Oct 14, 2025  by
            danielvegamyhre
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      Add shims for PyTorch stable
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
        
          #1862
            opened Oct 13, 2025  by
            bwasti
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [RFC][WIP][CP] Enable FlexAttention CP for llama3
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
      
  
        
          #1857
            opened Oct 12, 2025  by
            fegin
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      repro profiler bug on abort
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
        
          #1856
            opened Oct 11, 2025  by
            tushar00jain
            
        
        
            
    •
    
      Draft
    
  
        
        
      
    
      example schedule csv
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
      
  
        
          #1846
            opened Oct 9, 2025  by
            H-Huang
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      fix imports in components/checkpoint.py
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
      
  
        
          #1844
            opened Oct 9, 2025  by
            saforem2
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      Add joint graph runner deepseek_v3 experiment
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
        
          #1841
            opened Oct 8, 2025  by
            yiming0416
            
        
        
            
    •
    
      Draft
    
  
        
        
      
    
      [autoparallel] Add experimental configs for inductor aten overlap/bucketing, autoparallel_asynctp
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
        
          #1838
            opened Oct 8, 2025  by
            IvanKobzarev
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [WIP] Integrate autoparallel into torchtitan
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
        
          #1814
            opened Oct 8, 2025  by
            IvanKobzarev
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      trigger profiling on abort
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
        
          #1811
            opened Oct 7, 2025  by
            tushar00jain
            
        
        
            
    •
    
      Draft
    
  
        
        
      
    
      [VLM] Refactor special tokens by subclassing Tokenizer
        
              
                CLA Signed
  This label is managed by the Meta Open Source bot. 
        
      
    
      
  
        
          #1802
            opened Oct 6, 2025  by
            lkhphuc
            
        
        
            
    
  
    Loading…
 
        
        
      
    Previous Next
  
  
  ProTip!
  Adding no:label will show everything without a label.