消息队列Kafka版解决方案-阿里云

【大数据开发运维解决方案】Kylin消费Kafka数据流式构建cube 文章开始之前先说明环境情况，这里kylin消费的kafka数据是从Oracle 数据库用Ogg For Bigdata以json格式将数据投递到kafka topic的，投递的时候，关于insert和update 之前的数据投递到名为 ZTVOUCHER_INS 的topic，而delete和upd...

「视频小课堂」ELK和Kafka是怎么就玩在一起成了日志采集解决方案文字版视频地址：B站视频地址：ELK和Kafka是怎么就玩在一起成了日志采集解决方案公众号视频地址：ELK和Kafka是怎么就玩在一起成了日志采集解决方案知乎视频地址：ELK和Kafka是怎么就玩在一起成了日志采集解决方案视频文字版今天呢我就带来了一期视频，主要就是讲ELK和Kafka之间的通讯关系通过对...

消息队列Kafka入门课程

4 课时 |

2999 人已学 |

加入学习

文章-统一观测｜Prometheus 监测 Kafka

1 课时 |

132 人已学 |

加入学习

分布式消息系统 Kafka 快速入门

24 课时 |

529 人已学 |

加入学习

一站式Kafka平台解决方案——KafkaCenter KafkaCenter是什么KafkaCenter是一个针对Kafka的一站式，解决方案。用于Kafka集群的维护与管理，生产者和消费者的监控，以及Kafka部分生态组件的使用。对于Kafka的平台化，一直缺少一个成熟的解决方案，之前比较流行的kafka监控方案，如kafka-manager提供了...

基于Kafka connect+函数计算的轻量计算解决方案 kafka ETL架构解析基于Kafka connect+函数计算的轻量计算解决方案——竹恩消息队列Kafka产品研发专家Kafka ETL基于kafka connect加函数计算，为云上用户提供了一套数据流转加数据计算的一站式解决方案。一、问题背景在大数据云计算时代，一个复杂的大型系统一般都是由许...

【实战】kafka删除Topic常见异常排查思路及解决方案有人报案最近技术群里面有几个同学碰到了删除Topic的问题, 怎么样也删除不掉,然后我协助排查之后,就做个记录,写篇文章,大家在碰到这类型的问题的时候应该怎么去排查收集线索报not retrying deletion 异常版本:kafka_2.11-2.0.0删除前在执行重分配,但是失败了,强制停...

【kafka实战】生产环境删除Topic碰到的一些问题和解决方案有人报案最近技术群里面有几个同学碰到了删除Topic的问题, 怎么样也删除不掉,然后我协助排查之后,就做个记录,写篇文章,大家在碰到这类型的问题的时候应该怎么去排查【领取kafka大全PDF】【进滴滴技术交流群】: https://www.szzdzhp.com/szzInfo.html收集线索报...

SparkStreaming与Kafka整合遇到的问题及解决方案前言最近工作中是做日志分析的平台，采用了sparkstreaming+kafka，采用kafka主要是看中了它对大数据量处理的高性能，处理日志类应用再好不过了，采用了sparkstreaming的流处理框架主要是考虑到它本身是基于spark核心的，以后的批处理可以一站式服务，并且可以提供准实时服...

共有7条

< 1 >

跳转至： GO

本页面内关键词为智能算法引擎基于机器学习所生成，如有任何问题，可在页面下方点击"联系我们"与我们沟通。

产品推荐

{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"","iconImg":"https://img.alicdn.com/tfs/TB1u50Gn9slXu8jSZFuXXXg7FXa-200-200.png","contentLink":"https://www.aliyun.com/product/kafka","title":"消息队列 Kafka 版 ","des":"消息队列 Kafka 版是阿里云基于 Apache Kafka 构建的高吞吐量、高可扩展性的分布式消息队列服务，广泛用于日志收集、监控数据聚合、流式数据处理、在线和离线分析等，是大数据生态中不可或缺的产品之一，用户无需部署运维。","link1":"https://kafka.console.aliyun.com/?spm=5176.14468259.nav-right.1.21017341mrNdLP&accounttraceid=df9cf3d9982b43119e13a0f0315a4e77zpbo#/?instanceId=&regionId=mq-internet-access","btn1":"产品控制台","link2":"https://common-buy.aliyun.com/?spm=5176.167616.1288903.btn1.25a15a1ch94kIK&commodityCode=alikafka_pre","btn2":"立即购买","btn3":"产品文档","link3":"https://help.aliyun.com/document_detail/68151.html?spm=5176.167616.1288903.btn3.25a15a1ch94kIK","infoGroup":[{"infoName":"用户指南","infoContent":{"firstContentName":"产品快速入门","lastContentName":"常见问题","firstContentLink":"https://help.aliyun.com/document_detail/99949.html?spm=a2c4g.11186623.6.558.2ca149bfPQdZn4","lastContentLink":"https://help.aliyun.com/knowledge_detail/171530.html?spm=a2c4g.11186623.6.754.2ca149bfPQdZn4"}},{"infoName":"最佳实践","infoContent":{"firstContentLink":"https://help.aliyun.com/document_detail/68165.html?spm=a2c4g.11186623.6.748.2ca149bfPQdZn4","firstContentName":"发布者最佳实践","lastContentName":"订阅者最佳实践","lastContentLink":"https://help.aliyun.com/document_detail/68166.html?spm=a2c4g.11186623.6.749.69fa181eLEqmk4"}},{"infoName":"产品推荐","infoContent":{"firstContentName":"消息队列 RocketMQ 版","firstContentLink":"https://www.aliyun.com/product/rocketmq?spm=5176.167616.J_8058803260.333.25a15a1ch94kIK","lastContentLink":"https://www.aliyun.com/product/amqp?spm=5176.167616.J_8058803260.336.25a15a1ch94kIK","lastContentName":"消息队列 RabbitMQ 版"}}]}],"card":[],"search":[],"infoCard":[{"bannerUrl":"https://img.alicdn.com/tfs/TB1Xf81a3gP7K4jSZFqXXamhVXa-5169-974.jpg","bannerTitle":"mPaaS 小程序","bannerContent":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。<br>不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","liveButtonName":"查看详情","liveButtonLink":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","contentTitle":"提供即开即用的端上体验","homePageLink":"https://common-buy.aliyun.com/?spm=5176.14673561.J_8751524360.2.56702709BussF3&commodityCode=mpaas_beta#/open","homePageName":"免费试用","linkGroup":[{"linkContent":"发布包大小极致优化，节省流量和存储。"},{"linkContent":"服务迭代不再受发版限制，快速发布，快速迭代。"},{"linkContent":"业务开发效率更加优秀，一次开发，多端运行。"}]}],"title":{"mainTitle":"mPaaS","subtitle":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","linkUrl":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","btnText":"查看详情"},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}

{"$env":{"JSON":{}},"$page":{"env":"production"},"$context":{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"","iconImg":"https://img.alicdn.com/tfs/TB1u50Gn9slXu8jSZFuXXXg7FXa-200-200.png","contentLink":"https://www.aliyun.com/product/kafka","title":"消息队列 Kafka 版 ","des":"消息队列 Kafka 版是阿里云基于 Apache Kafka 构建的高吞吐量、高可扩展性的分布式消息队列服务，广泛用于日志收集、监控数据聚合、流式数据处理、在线和离线分析等，是大数据生态中不可或缺的产品之一，用户无需部署运维。","link1":"https://kafka.console.aliyun.com/?spm=5176.14468259.nav-right.1.21017341mrNdLP&accounttraceid=df9cf3d9982b43119e13a0f0315a4e77zpbo#/?instanceId=&regionId=mq-internet-access","btn1":"产品控制台","link2":"https://common-buy.aliyun.com/?spm=5176.167616.1288903.btn1.25a15a1ch94kIK&commodityCode=alikafka_pre","btn2":"立即购买","btn3":"产品文档","link3":"https://help.aliyun.com/document_detail/68151.html?spm=5176.167616.1288903.btn3.25a15a1ch94kIK","infoGroup":[{"infoName":"用户指南","infoContent":{"firstContentName":"产品快速入门","lastContentName":"常见问题","firstContentLink":"https://help.aliyun.com/document_detail/99949.html?spm=a2c4g.11186623.6.558.2ca149bfPQdZn4","lastContentLink":"https://help.aliyun.com/knowledge_detail/171530.html?spm=a2c4g.11186623.6.754.2ca149bfPQdZn4"}},{"infoName":"最佳实践","infoContent":{"firstContentLink":"https://help.aliyun.com/document_detail/68165.html?spm=a2c4g.11186623.6.748.2ca149bfPQdZn4","firstContentName":"发布者最佳实践","lastContentName":"订阅者最佳实践","lastContentLink":"https://help.aliyun.com/document_detail/68166.html?spm=a2c4g.11186623.6.749.69fa181eLEqmk4"}},{"infoName":"产品推荐","infoContent":{"firstContentName":"消息队列 RocketMQ 版","firstContentLink":"https://www.aliyun.com/product/rocketmq?spm=5176.167616.J_8058803260.333.25a15a1ch94kIK","lastContentLink":"https://www.aliyun.com/product/amqp?spm=5176.167616.J_8058803260.336.25a15a1ch94kIK","lastContentName":"消息队列 RabbitMQ 版"}}]}],"card":[],"search":[],"infoCard":[{"bannerUrl":"https://img.alicdn.com/tfs/TB1Xf81a3gP7K4jSZFqXXamhVXa-5169-974.jpg","bannerTitle":"mPaaS 小程序","bannerContent":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。<br>不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","liveButtonName":"查看详情","liveButtonLink":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","contentTitle":"提供即开即用的端上体验","homePageLink":"https://common-buy.aliyun.com/?spm=5176.14673561.J_8751524360.2.56702709BussF3&commodityCode=mpaas_beta#/open","homePageName":"免费试用","linkGroup":[{"linkContent":"发布包大小极致优化，节省流量和存储。"},{"linkContent":"服务迭代不再受发版限制，快速发布，快速迭代。"},{"linkContent":"业务开发效率更加优秀，一次开发，多端运行。"}]}],"title":{"mainTitle":"mPaaS","subtitle":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","linkUrl":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","btnText":"查看详情"},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}}