xorbitsai/inference: Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
开源的多模态模型推理平台,支持语言、视觉、嵌入、重排序、图像、音频和视频模型。可在不同硬件上部署,从笔记本电脑到分布式集群。通过OpenAI兼容的API服务模型。星标:9666,语言:Python。
来自GitHub AI Trending的《xorbitsai/inference: Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.》。重点看模型能力与工程、产品发布。摘要提到:这条英文动态主要涉及模型能力与工程、产品发布。原文要点:Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.。Sta
本站只提供摘要与原文入口。完整内容请阅读原文。
来源:GitHub AI Trending · github.com