Skip to content

@hao-ai-lab Hao AI Lab

Change the repository type filter

All

    Repositories list

    14 repositories

    • cse234-w25

      Public
      Website for CSE 234, Winter 2025
      SCSS
      •
      Other
      •47•7•0•1•Updated Mar 13, 2025Mar 13, 2025

    • FastVideo

      Public
      FastVideo is a lightweight framework for accelerating large video diffusion models.
      Python
      •
      Apache License 2.0
      •73•1.2k•29•7•Updated Mar 13, 2025Mar 13, 2025

    • llmutils

      Public
      LLM Utils
      Python
      •0•0•0•0•Updated Mar 13, 2025Mar 13, 2025

    • cse234-w25-PA

      Public
      Python
      •38•24•0•0•Updated Mar 13, 2025Mar 13, 2025

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •6.2k•0•0•1•Updated Mar 9, 2025Mar 9, 2025

    • Dynasor

      Public
      Simple extension on vLLM to help you speed up reasoning model without training.
      llmreasoning-modelsdeepseek-r1
      Python
      •
      MIT License
      •18•128•6•1•Updated Mar 8, 2025Mar 8, 2025

    • LookaheadDecoding

      Public
      [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
      Python
      •
      Apache License 2.0
      •74•1.2k•32•1•Updated Mar 6, 2025Mar 6, 2025

    • hao-ai-lab.github.io

      Public
      HTML
      •8•1•1•0•Updated Feb 22, 2025Feb 22, 2025

    • Consistency_LLM

      Public
      [ICML 2024] CLLMs: Consistency Large Language Models
      large-language-modelsefficient-llmefficient-llm-inference
      Python
      •
      Apache License 2.0
      •18•385•7•0•Updated Nov 16, 2024Nov 16, 2024

    • vllm-ltr

      Public
      [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
      Python
      •
      Apache License 2.0
      •9•41•0•0•Updated Nov 4, 2024Nov 4, 2024

    • MuxServe

      Public
      Jupyter Notebook
      •4•52•2•0•Updated Jun 13, 2024Jun 13, 2024

    • dsc291-PA

      Public
      Jupyter Notebook
      •3•3•0•0•Updated Jun 6, 2024Jun 6, 2024

    • dsc291-s24

      Public
      Website for DSC 291, Spring 2024
      SCSS
      •
      Other
      •47•0•0•0•Updated Jun 5, 2024Jun 5, 2024

    • dsc204a-w24

      Public
      Website for DSC 204a, Winter 2024
      SCSS
      •
      Other
      •47•8•0•1•Updated Mar 24, 2024Mar 24, 2024