阿里云文档 2026-08-11

使用Gateway with Inference Extension为SGLang PD分离服务配置推理路由

Prefill/Decode分离架构(PD分离),是当前主流的LLM推理优化技术,通过将LLM推理中的两个核心阶段解耦并分开部署在不同GPU上,避免资源争抢,从而显著降低TPOT,提升系统吞吐。本文以Qwen3-32B模型为例,演示如何通过Gateway with Inference Extension为部署在ACK中的SGLang PD分离架构模型推理服务配置推理路由。

阿里云文档 2026-04-27

为Agent API配置策略与插件-API 网关-阿里云

AI 网关支持对Agent API进行添加策略和配置插件,提高API的安全性、性能和可维护性。

阿里云文档 2026-04-13

配置Livy Gateway以启用Ranger鉴权,实现细粒度访问控制和安全策略管理。

Apache Ranger提供了集中式的权限管理框架。通过与Spark结合使用的Ranger Plugin,可以对Spark SQL访问数据库、表和列等进行细粒度的权限控制,从而增强数据访问的安全性。Livy Gateway支持配置Ranger Plugin来启用数据访问的权限控制。

阿里云文档 2025-08-08

自定义Gateway配置

Gateway with Inference Extension基于Envoy Gateway实现,您可以通过调整EnvoyProxy资源配置来调整实际的Gateway参数,如Service类型、Deployment副本数以及Resources等。本文介绍如何为不同范围的Gateway配置副本数和资源用量。

问答 2024-07-31 来自:开发者社区

higress修改全局配置必须重启gateway才生效么? 比开启压缩,配置h2参数 之类的,

higress修改全局配置必须重启gateway才生效么? 比开启压缩,配置h2参数 之类的,

问答 2023-05-19 来自:开发者社区

spring cloud gateway在nacos 配置启动参数无法在 dashboard中看到

在nacos 中配置如下 spring.yml 文件中关键配置如下 project: name: gateway-sentinel-name -Dcsp.sentinel.app.type=1 -Dcsp.sentinel.dashboard.server=localhost:8080 csp: sentinel: app: type: 1 #网关应用 dashboard: server: l.....

本页面内关键词为智能算法引擎基于机器学习所生成,如有任何问题,可在页面下方点击"联系我们"与我们沟通。

产品推荐

{"cardStyle":"productCardStyle","productCardInfo":{"productTitle":"AI 网关","productDescription":"Agent 构建必备,让 LLM 和 MCP 调用更可控、更安全、更经济。","productContentLink":"https://www.aliyun.com/product/api-gateway/ai-gateway","isDisplayProductIcon":true,"productButton1":{"productButtonText":"产品详情","productButtonLink":"https://www.aliyun.com/product/api-gateway/ai-gateway"},"productButton2":{"productButtonText":"文档","productButtonLink":"https://help.aliyun.com/zh/api-gateway/ai-gateway/product-overview/what-is-an-ai-gateway?spm=5176.43410590.J__YK4tzIcbUfim9u-kxySN.1.192be72dRbBzqR"},"productButton3":{"productButtonText":"控制台","productButtonLink":"https://apig.console.aliyun.com/?spm=5176.43410590.J__YK4tzIcbUfim9u-kxySN.2.192be72dRbBzqR&region=cn-beijing#/ai-gateway-overview"},"productPromotionInfoBlock":[{"$id":"0","productPromotionGroupingTitle":"产品入门","productPromotionInfoFirstText":"教程学习","productPromotionInfoFirstLink":"https://help.aliyun.com/zh/api-gateway/ai-gateway/getting-started/manage-the-ai-api?spm=5176.43410590.J_hTE1CWiP9s-wmffHdCffK.1.192be72dh8dQob","productPromotionInfoSecondText":"","productPromotionInfoSecondLink":""},{"$id":"1","productPromotionGroupingTitle":"产品选型","productPromotionInfoFirstText":"免费试用","productPromotionInfoFirstLink":"https://free.aliyun.com/?spm=5176.43410590.J_dFy_JybRm6Ym7bLCi5DYE.2.6e1c7bf87bf8T6&searchKey=AI%E7%BD%91%E5%85%B3","productPromotionInfoSecondText":"","productPromotionInfoSecondLink":""},{"$id":"2","productPromotionGroupingTitle":"产品功能","productPromotionInfoFirstText":"管理 Model API","productPromotionInfoFirstLink":"https://help.aliyun.com/zh/api-gateway/ai-gateway/user-guide/managing-the-model-api","productPromotionInfoSecondText":"","productPromotionInfoSecondLink":""},{"$id":"3","productPromotionGroupingTitle":"产品动态","productPromotionInfoFirstText":"新功能","productPromotionInfoFirstLink":"https://help.aliyun.com/zh/api-gateway/ai-gateway/product-overview/new-feature-release-notes-ai-gateway","productPromotionInfoSecondText":"","productPromotionInfoSecondLink":""}],"isOfficialLogo":false},"activityCardInfo":{"activityTitle":"","activityDescription":"","cardContentBackgroundMode":"LightMode","activityContentBackgroundImageLink":"","activityCardBottomInfoSelect":"activityPromotionInfoBlock"}}

开发与运维

集结各类场景实战经验,助你开发运维畅行无忧

+关注