liguodongiot--llm-action
212 B
212 B
大模型推理张量并行的4种模式: https://zhuanlan.zhihu.com/p/12302566679
Tensor Parallel LLM Inferencing:https://medium.com/tr-labs-ml-engineering-blog/tensor-parallel-llm-inferencing-09138daf0ba7