{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"ModelScope 魔搭社区","iconImg":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","contentLink":"https://modelscope.cn","title":"ModelScope 魔搭社区","des":"为实现“模型即服务”理念，魔搭社区提供最新最热、开放开源的多领域预训练模型和优质数据集，让广大开发者无需写代码就能快速体验模型效果；同时提供抽象编程接口及SDK，对模型进行二次开发，真正让模型应用到不同的场景中。","link1":"https://modelscope.cn","btn1":"社区详情","link2":"https://modelscope.cn/docs","btn2":"文档中心","btn3":"","link3":"","infoGroup":[{"infoName":"立即体验","infoContent":{"firstContentName":"模型库","firstContentLink":"https://modelscope.cn/models","lastContentName":"数据集","lastContentLink":"https://modelscope.cn/datasets"}},{"infoName":"热门活动","infoContent":{"firstContentName":"社区 VIP 招募激励计划","firstContentLink":"https://modelscope.cn/activitys/kol"}}]}],"card":[],"search":[],"infoCard":[{"bannerUrl":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","bannerTitle":"智能计算灵骏","bannerContent":"智能计算灵骏是阿里云自主研发的新一代智能计算产品，提供深度优化的异构计算融合集群实例，满足人工智能、大数据、高性能计算等多种应用场景。","liveButtonName":"查看详情","liveButtonLink":"https://www.aliyun.com/product/ai/lingjun","contentTitle":"","homePageLink":"https://help.aliyun.com/document_detail/444430.html","homePageName":"产品文档","linkGroup":[]}],"title":{"mainTitle":"","subtitle":"","linkUrl":"","btnText":""},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","textColor":"dark"},"dataList":[],"sceneCard":[],"txt":[]}

{"$env":{"JSON":{}},"$page":{"env":"production"},"$context":{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"ModelScope 魔搭社区","iconImg":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","contentLink":"https://modelscope.cn","title":"ModelScope 魔搭社区","des":"为实现“模型即服务”理念，魔搭社区提供最新最热、开放开源的多领域预训练模型和优质数据集，让广大开发者无需写代码就能快速体验模型效果；同时提供抽象编程接口及SDK，对模型进行二次开发，真正让模型应用到不同的场景中。","link1":"https://modelscope.cn","btn1":"社区详情","link2":"https://modelscope.cn/docs","btn2":"文档中心","btn3":"","link3":"","infoGroup":[{"infoName":"立即体验","infoContent":{"firstContentName":"模型库","firstContentLink":"https://modelscope.cn/models","lastContentName":"数据集","lastContentLink":"https://modelscope.cn/datasets"}},{"infoName":"热门活动","infoContent":{"firstContentName":"社区 VIP 招募激励计划","firstContentLink":"https://modelscope.cn/activitys/kol"}}]}],"card":[],"search":[],"infoCard":[{"bannerUrl":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","bannerTitle":"智能计算灵骏","bannerContent":"智能计算灵骏是阿里云自主研发的新一代智能计算产品，提供深度优化的异构计算融合集群实例，满足人工智能、大数据、高性能计算等多种应用场景。","liveButtonName":"查看详情","liveButtonLink":"https://www.aliyun.com/product/ai/lingjun","contentTitle":"","homePageLink":"https://help.aliyun.com/document_detail/444430.html","homePageName":"产品文档","linkGroup":[]}],"title":{"mainTitle":"","subtitle":"","linkUrl":"","btnText":""},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","textColor":"dark"},"dataList":[],"sceneCard":[],"txt":[]}}

ModelScope 魔搭社区

为实现“模型即服务”理念，魔搭社区提供最新最热、开放开源的多领域预训练模型和优质数据集，让广大开发者无需写代码就能快速体验模型效果；同时提供抽象编程接口及SDK，对模型进行二次开发，真正让模型应用到不同的场景中。

社区详情

文档中心

立即体验

模型库

数据集

热门活动

社区 VIP 招募激励计划

在ACK中快速体验大语言模型推理服务

ModelScope中，关于不同参数量大模型部署推理的硬件配比指标，有参考吗？

ModelScope有部署qwen2-72b的么，正常推理需要多大的显存？

想问一下ModelScope多卡部署后，使用了多张卡的显存。是使用多张卡的GPU进行推理吗？

modelscope-funasr部署后模型的推理结果，识别效果会下降，有什么改善方式吗？

ModelScope部署的Qwen1.5-110B-Chat-GPTQ-Int4，为啥推理异常慢？

modelscope中vllm部署怎么批量推理？

qwen-72b量级的大模型，ModelScope部署推理都怎么更快加速？

在ModelScope中，ms-agent本地部署之后，推理速度有点慢，能给点优化建议吗？

modelscope部署相关内容

modelscope更多部署相关

modelscope您可能感兴趣

产品推荐