大模型推理张量并行的4种模式: https://zhuanlan.zhihu.com/p/12302566679

Tensor Parallel LLM Inferencing：https://medium.com/tr-labs-ml-engineering-blog/tensor-parallel-llm-inferencing-09138daf0ba7