---
title: "DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference"
excerpt: ""
link: https://github.com/deepspeedai/DeepSpeed/tree/master/blogs/deepspeed-fastgen
date: 2023-11-06 00:00:00
tags: inference English
---