Skip to content

@hao-ai-lab Hao AI Lab

Change the repository type filter

All

    Repositories list

    11 repositories

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •5.1k•0•0•1•Updated Jan 9, 2025Jan 9, 2025

    • cse234-w25

      Public
      Website for CSE 234, Winter 2025
      SCSS
      •
      Other
      •28•1•0•0•Updated Jan 9, 2025Jan 9, 2025

    • FastVideo

      Public
      FastVideo is an open-source framework for accelerating large video diffusion model.
      Python
      •
      Apache License 2.0
      •47•814•12•1•Updated Jan 8, 2025Jan 8, 2025

    • hao-ai-lab.github.io

      Public
      HTML
      •7•0•1•0•Updated Jan 4, 2025Jan 4, 2025

    • Consistency_LLM

      Public
      [ICML 2024] CLLMs: Consistency Large Language Models
      large-language-modelsefficient-llmefficient-llm-inference
      Python
      •
      Apache License 2.0
      •18•365•7•0•Updated Nov 16, 2024Nov 16, 2024

    • vllm-ltr

      Public
      [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
      Python
      •
      Apache License 2.0
      •6•23•0•0•Updated Nov 4, 2024Nov 4, 2024

    • LookaheadDecoding

      Public
      [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
      Python
      •
      Apache License 2.0
      •70•1.2k•33•1•Updated Oct 14, 2024Oct 14, 2024

    • MuxServe

      Public
      Jupyter Notebook
      •4•47•2•0•Updated Jun 13, 2024Jun 13, 2024

    • dsc291-PA

      Public
      Jupyter Notebook
      •2•2•0•0•Updated Jun 6, 2024Jun 6, 2024

    • dsc291-s24

      Public
      Website for DSC 291, Spring 2024
      SCSS
      •
      Other
      •28•0•0•0•Updated Jun 5, 2024Jun 5, 2024

    • dsc204a-w24

      Public
      Website for DSC 204a, Winter 2024
      SCSS
      •
      Other
      •28•8•0•1•Updated Mar 24, 2024Mar 24, 2024