Skip to content
Change the repository type filter

All

    Repositories list

    • MoonEP

      Public
      MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts
      Python
      MIT License
      77000Updated Jul 28, 2026Jul 28, 2026
    • 26SC-Maze

      Public
      A distributed framework for LLM agents
      Python
      MIT License
      25000Updated Jul 24, 2026Jul 24, 2026
    • UltraEP

      Public
      Production-ready expert load balancing library
      Cuda
      MIT License
      8000Updated Jul 17, 2026Jul 17, 2026
    • High-Throughput Batch Inference
      C++
      Apache License 2.0
      1000Updated Jul 14, 2026Jul 14, 2026
    • labs-molt

      Public
      Python
      Apache License 2.0
      62000Updated Jul 14, 2026Jul 14, 2026
    • Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)
      Python
      1000Updated Jul 12, 2026Jul 12, 2026
    • [OSDI' 26] Efficient LLM Serving on Commodity GPU Clusters with Data-Reduced Cross-Instance Orchestration
      Python
      Apache License 2.0
      1000Updated Jul 5, 2026Jul 5, 2026
    • dmuon

      Public
      Python
      Other
      2000Updated Jun 24, 2026Jun 24, 2026
    • TraceLab

      Public
      An open toolkit and public dataset hub for collecting, sanitizing, analyzing, and visualizing agent traces.
      Python
      Apache License 2.0
      10000Updated Jun 21, 2026Jun 21, 2026
    • Python
      2000Updated Jun 14, 2026Jun 14, 2026
    • uw-piper

      Public
      A programmable distributed training system for PyTorch
      Python
      MIT License
      3000Updated Jun 10, 2026Jun 10, 2026
    • Python
      Other
      1100Updated Jun 4, 2026Jun 4, 2026
    • An ultra-fast, distributed Safetensors loader
      C++
      Apache License 2.0
      11000Updated May 27, 2026May 27, 2026
    • BlitzScale Router - Distributed LLM Inference Router (Rust)
      Rust
      1000Updated May 25, 2026May 25, 2026
    • Python
      MIT License
      1000Updated May 17, 2026May 17, 2026
    • OpenTela is a decentralized compute fabric for running machine learning applications.
      Jupyter Notebook
      Apache License 2.0
      12000Updated May 14, 2026May 14, 2026
    • Python
      Apache License 2.0
      3000Updated May 13, 2026May 13, 2026
    • Python
      1000Updated May 12, 2026May 12, 2026
    • Artifact Evaluation for OSDI'26 paper CoPilotIO: CPU as a Co-pilot for GPU I/O to Free GPU Compute
      C++
      3000Updated May 9, 2026May 9, 2026
    • Python
      1000Updated May 8, 2026May 8, 2026
    • vdcores

      Public
      Virtual Decoupled Cores: Composable Programming Framework and Runtime for Async GPUs
      Python
      6000Updated May 6, 2026May 6, 2026
    • Apache License 2.0
      15000Updated Apr 23, 2026Apr 23, 2026
    • Accepted to MLSys 2026
      Python
      Other
      8000Updated Apr 19, 2026Apr 19, 2026
    • Python
      Apache License 2.0
      7000Updated Mar 17, 2026Mar 17, 2026
    • Research prototype of PRISM — a cost-efficient multi-LLM serving system with flexible time- and space-based GPU sharing.
      Python
      Apache License 2.0
      4000Updated Mar 17, 2026Mar 17, 2026
    • Python
      2000Updated Mar 14, 2026Mar 14, 2026
    • A unified framework for easy reinforcement learning in Flow-Matching models
      Python
      Apache License 2.0
      51000Updated Mar 13, 2026Mar 13, 2026
    • ssd

      Public
      A lightweight inference engine supporting speculative speculative decoding (SSD).
      Python
      MIT License
      76000Updated Mar 4, 2026Mar 4, 2026
    • RollPacker: Taming Long-Tail Rollouts for RL Post-Training with Tail Batching
      Python
      Apache License 2.0
      1000Updated Mar 2, 2026Mar 2, 2026
    • [CVPR 2026] ForeAct: Steering Your VLA with Efficient Visual Foresight Planning
      Python
      5100Updated Feb 25, 2026Feb 25, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.