容器服务模型的相关内容

阿里云文档 2025-04-01

在ACK中使用KTransformers部署DeepSeek-R1模型

KTransformers框架实现了多种LLM推理优化，进一步减少了推理阶段的显存占用，从而提高推理性能和降低GPU资源成本。本文介绍如何在阿里云容器服务 Kubernetes 版中通过KTransformers实现高效部署671B参数的DeepSeek-R1-Q4_K_M量化模型推理服务。

文章 2025-03-08 来自：开发者社区

使用容器服务ACK快速部署QwQ-32B模型并实现推理智能路由

【阅读原文】戳：使用容器服务ACK快速部署QwQ-32B模型并实现推理智能路由背景介绍 1. QwQ-32B模型阿里云最新发布的QwQ-32B模型，通过强化学习大幅度提升了模型推理能力。QwQ-32B模型拥有320亿参数，其性能可以与DeepSeek-R1 671B媲美。模型数学代码等核心指标（...

阿里云文档 2024-10-09

安全责任共担模型

安全合规在ACK集群托管架构下遵循责任共担原则，其中容器服务ACK负责集群控制面组件（包括Kubernetes控制平面组件和etcd）以及集群服务相关阿里云基础设施的默认安全性。本文介绍阿里云容器服务ACK的安全责任共担模型。

阿里云文档 2024-08-13

在ACK中快速体验大语言模型

部署模型时，您可以根据自身需求选择模型来源以及部署模型的平台。本文以Qwen1.5-4B-Chat模型、GPU类型为T4卡为例，演示如何在ACK中快速部署ModelScope模型、HuggingFace模型及本地模型。

阿里云文档 2024-07-12

使用Arena进行模型微调和模型管理

本文以大语言模型Qwen-7B-Chat为例，并结合Arena工具，演示如何在提交模型微调作业的同时，对模型微调作业所产生的模型进行管理。

阿里云文档 2024-06-12

基于KServe使用Fluid实现模型加速

随着技术的发展，AI应用的模型数据越来越大，但是通过存储服务（如OSS、NAS等）拉取这些大文件时可能会出现长时间的延迟和冷启动问题。您可以利用Fluid显著提升模型加载速度，从而优化推理服务的性能，特别是对于基于KServe的推理服务而言。本文以Qwen-7B-Chat-Int8模型、GPU类型为V100卡为例，演示如何在KServe中使用Fluid实现模型加速。

问答 2022-02-15 来自：开发者社区

容器服务的网络模型，如何做到容器跨主机互联？

共有8条

< 1 >

跳转至： GO

更新时间 2025-03-09 13:33:26

本页面内关键词为智能算法引擎基于机器学习所生成，如有任何问题，可在页面下方点击"联系我们"与我们沟通。

容器服务您可能感兴趣

产品推荐

{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"","iconImg":"https://img.alicdn.com/tfs/TB1n0rM2uL2gK0jSZPhXXahvXXa-200-200.png","contentLink":"https://www.aliyun.com/product/cs/ask","title":"Serverless 容器服务","des":"Serverless Kubernetes 服务基于阿里云弹性计算基础架构，同时完全兼容 Kubernetes  生态的容器产品。可快速创建 Kubernetes 容器应用，根据应用实际使用的 CPU 和内存资源量进行按需付费，使您更专注于应用本身。","link1":"https://cs.console.aliyun.com/#/k8s/cluster/list","btn1":"产品控制台","link2":"https://help.aliyun.com/document_detail/86366.html?spm=5176.14885429.J_4076397450.3.64f73ad0xdzSr0","btn2":"产品文档","btn3":"","link3":"","infoGroup":[{"infoName":"精选推荐","infoContent":{"firstContentName":"云资源成本节省方案","firstContentLink":"https://www.aliyun.com/daily-act/ecs/savingplan?spm=5176.14885429.J_4076397450.1.64f73ad0xdzSr0","lastContentLink":"","lastContentName":""}},{"infoName":"产品入门","infoContent":{"firstContentName":"用户指南","lastContentName":"快速入门指导","firstContentLink":"https://help.aliyun.com/document_detail/86366.html?spm=a2c4g.11186623.6.1037.6e422459dourDU","lastContentLink":"https://help.aliyun.com/document_detail/86377.html?spm=a2c4g.11186623.6.1040.6e422459dourDU"}},{"infoName":"最佳实践","infoContent":{"firstContentLink":"https://help.aliyun.com/document_detail/186533.html?spm=a2c4g.11186623.6.1176.6e422459dourDU","firstContentName":"ASK弹性低成本CI/CD","lastContentName":"WordPress应用","lastContentLink":"https://help.aliyun.com/document_detail/186543.html?spm=a2c4g.11186623.6.1180.6e422459dourDU"}}]}],"card":[],"search":[],"infoCard":[{"bannerUrl":"https://img.alicdn.com/tfs/TB1Xf81a3gP7K4jSZFqXXamhVXa-5169-974.jpg","bannerTitle":"mPaaS 小程序","bannerContent":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。<br>不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","liveButtonName":"查看详情","liveButtonLink":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","contentTitle":"提供即开即用的端上体验","homePageLink":"https://common-buy.aliyun.com/?spm=5176.14673561.J_8751524360.2.56702709BussF3&commodityCode=mpaas_beta#/open","homePageName":"免费试用","linkGroup":[{"linkContent":"发布包大小极致优化，节省流量和存储。"},{"linkContent":"服务迭代不再受发版限制，快速发布，快速迭代。"},{"linkContent":"业务开发效率更加优秀，一次开发，多端运行。"}]}],"title":{"mainTitle":"mPaaS","subtitle":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","linkUrl":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","btnText":"查看详情"},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}

{"$env":{"JSON":{}},"$page":{"env":"production"},"$context":{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"","iconImg":"https://img.alicdn.com/tfs/TB1n0rM2uL2gK0jSZPhXXahvXXa-200-200.png","contentLink":"https://www.aliyun.com/product/cs/ask","title":"Serverless 容器服务","des":"Serverless Kubernetes 服务基于阿里云弹性计算基础架构，同时完全兼容 Kubernetes  生态的容器产品。可快速创建 Kubernetes 容器应用，根据应用实际使用的 CPU 和内存资源量进行按需付费，使您更专注于应用本身。","link1":"https://cs.console.aliyun.com/#/k8s/cluster/list","btn1":"产品控制台","link2":"https://help.aliyun.com/document_detail/86366.html?spm=5176.14885429.J_4076397450.3.64f73ad0xdzSr0","btn2":"产品文档","btn3":"","link3":"","infoGroup":[{"infoName":"精选推荐","infoContent":{"firstContentName":"云资源成本节省方案","firstContentLink":"https://www.aliyun.com/daily-act/ecs/savingplan?spm=5176.14885429.J_4076397450.1.64f73ad0xdzSr0","lastContentLink":"","lastContentName":""}},{"infoName":"产品入门","infoContent":{"firstContentName":"用户指南","lastContentName":"快速入门指导","firstContentLink":"https://help.aliyun.com/document_detail/86366.html?spm=a2c4g.11186623.6.1037.6e422459dourDU","lastContentLink":"https://help.aliyun.com/document_detail/86377.html?spm=a2c4g.11186623.6.1040.6e422459dourDU"}},{"infoName":"最佳实践","infoContent":{"firstContentLink":"https://help.aliyun.com/document_detail/186533.html?spm=a2c4g.11186623.6.1176.6e422459dourDU","firstContentName":"ASK弹性低成本CI/CD","lastContentName":"WordPress应用","lastContentLink":"https://help.aliyun.com/document_detail/186543.html?spm=a2c4g.11186623.6.1180.6e422459dourDU"}}]}],"card":[],"search":[],"infoCard":[{"bannerUrl":"https://img.alicdn.com/tfs/TB1Xf81a3gP7K4jSZFqXXamhVXa-5169-974.jpg","bannerTitle":"mPaaS 小程序","bannerContent":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。<br>不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","liveButtonName":"查看详情","liveButtonLink":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","contentTitle":"提供即开即用的端上体验","homePageLink":"https://common-buy.aliyun.com/?spm=5176.14673561.J_8751524360.2.56702709BussF3&commodityCode=mpaas_beta#/open","homePageName":"免费试用","linkGroup":[{"linkContent":"发布包大小极致优化，节省流量和存储。"},{"linkContent":"服务迭代不再受发版限制，快速发布，快速迭代。"},{"linkContent":"业务开发效率更加优秀，一次开发，多端运行。"}]}],"title":{"mainTitle":"mPaaS","subtitle":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","linkUrl":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","btnText":"查看详情"},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}}