Flink CDC在使用oracle cdc监控数据库，系统打印LogMiner is now using the maximum batch size 100000....，继而无法监控数据变更，除了调大log.mining.batch. size.max参数设置，还有其他办法么？这个过程中缺失的数据有啥办法能重新捕获到嘛？

问答 2023-11-15 来自：开发者社区

使用flink cdc 实时同步oracle 到 doris，必须开启数据库的增量日志设置吗？

目前在学习 flink cdc 实时同步技术，在 mysql 中测试通过。在 oracle 测试过程中，发现只能同步oracle 的表结构，数据无法同步到 doris，也看不到相关的错误日志。查看相关问题，文章说必须开启 oralce的supplemental_log_data_min,请问是否这个原因？公司环境的的 oracle 确实只开启了归档日志，supplemental_log_data....

共有20条

< 1 2 >

跳转至： GO

更新时间 2024-02-10 10:23:23

本页面内关键词为智能算法引擎基于机器学习所生成，如有任何问题，可在页面下方点击"联系我们"与我们沟通。

数据库设置相关内容

数据库更多设置相关

数据库您可能感兴趣

产品推荐

{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"","iconImg":"https://img.alicdn.com/tfs/TB1nmXJn7cx_u4jSZFlXXXnUFXa-200-200.png","contentLink":"https://www.aliyun.com/product/dbaudit","title":"数据库审计","des":"满足等保2.0二级和三级 “安全审计”合规要求的同时，智能解析数据库通信流量，细粒度审计数据库访问行为，通过对数据库全量行为的审计溯源、危险攻击的实时告警、风险语句的智能预警，提供数据库资产最安全的监控保障。","link1":"https://yundun.console.aliyun.com/?p=sddp#/audit/analysis/alarm/auditFirst/cn-zhangjiakou","btn1":"产品控制台","link2":"https://common-buy.aliyun.com/?commodityCode=sddp_pre&request=%7B%22ord_time%22:%221:Month%22,%22order_num%22:1,%22region%22:%22cn-zhangjiakou%22,%22type%22:%22normal%22,%22sddp_version%22:%22version_dengbao%22,%22audit_subscription_version%22:%220%22,%22logStorage_subscription%22:%221%22,%22logStorage%22:2%7D&regionId=cn-zhangjiakou","btn2":"立即购买","btn3":"产品文档","link3":"https://help.aliyun.com/product/52432.html?spm=5176.139959.J_5253785160.5.42de77d7KNxtZZ","infoGroup":[{"infoName":"精选推荐","infoContent":{"firstContentName":"包年享85折优惠","firstContentLink":"https://common-buy.aliyun.com/?commodityCode=sddp_pre&request=%7B%22ord_time%22:%221:Month%22,%22order_num%22:1,%22region%22:%22cn-zhangjiakou%22,%22type%22:%22normal%22,%22sddp_version%22:%22version_dengbao%22,%22audit_subscription_version%22:%220%22,%22logStorage_subscription%22:%221%22,%22logStorage%22:2%7D&regionId=cn-zhangjiakou","lastContentLink":"","lastContentName":""}},{"infoName":"用户指南","infoContent":{"firstContentName":"产品快速入门","lastContentName":"不同版本功能对比","firstContentLink":"https://help.aliyun.com/zh/dsc/data-security-center/user-guide/security-audit/","lastContentLink":"https://help.aliyun.com/zh/dsc/data-security-center/product-overview/difference-between-different-dsc-editions"}}]}],"card":[],"search":[],"infoCard":[{"bannerUrl":"https://img.alicdn.com/tfs/TB1Xf81a3gP7K4jSZFqXXamhVXa-5169-974.jpg","bannerTitle":"数据库审计","bannerContent":"满足等保2.0二级和三级 “安全审计”合规要求的同时，智能解析数据库通信流量，细粒度审计数据库访问行为，通过对数据库全量行为的审计溯源、危险攻击的实时告警、风险语句的智能预警，提供数据库资产最安全的监控保障。","liveButtonName":"查看详情","liveButtonLink":"https://www.aliyun.com/product/dbaudit?spm=5176.21213303.8115314850.1.faf453c9I9EKNe&scm=20140722.S_card@@%E5%8D%A1%E7%89%87@@1796._.ID_card@@%E5%8D%A1%E7%89%87@@1796-RL_%E6%95%B0%E6%8D%AE%E5%BA%93%E5%AE%A1%E8%AE%A1-OR_ser-V_2-P0_0","contentTitle":"满足等保2.0’安全审计‘的合规要求","homePageLink":"https://page.aliyun.com/form/act803688306/index.htm","homePageName":"7天试用","linkGroup":[{"linkContent":"发布包大小极致优化，节省流量和存储。"},{"linkContent":"服务迭代不再受发版限制，快速发布，快速迭代。"},{"linkContent":"业务开发效率更加优秀，一次开发，多端运行。"}]}],"title":{"mainTitle":"数据库审计","subtitle":"满足等保2.0二级和三级 “安全审计”合规要求的同时，智能解析数据库通信流量，细粒度审计数据库访问行为，通过对数据库全量行为的审计溯源、危险攻击的实时告警、风险语句的智能预警，提供数据库资产最安全的监控保障。","linkUrl":"https://www.aliyun.com/product/dbaudit?spm=5176.21213303.8115314850.1.faf453c9I9EKNe&scm=20140722.S_card@@%E5%8D%A1%E7%89%87@@1796._.ID_card@@%E5%8D%A1%E7%89%87@@1796-RL_%E6%95%B0%E6%8D%AE%E5%BA%93%E5%AE%A1%E8%AE%A1-OR_ser-V_2-P0_0","btnText":"查看详情"},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}

{"$env":{"JSON":{}},"$page":{"env":"production"},"$context":{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"","iconImg":"https://img.alicdn.com/tfs/TB1nmXJn7cx_u4jSZFlXXXnUFXa-200-200.png","contentLink":"https://www.aliyun.com/product/dbaudit","title":"数据库审计","des":"满足等保2.0二级和三级 “安全审计”合规要求的同时，智能解析数据库通信流量，细粒度审计数据库访问行为，通过对数据库全量行为的审计溯源、危险攻击的实时告警、风险语句的智能预警，提供数据库资产最安全的监控保障。","link1":"https://yundun.console.aliyun.com/?p=sddp#/audit/analysis/alarm/auditFirst/cn-zhangjiakou","btn1":"产品控制台","link2":"https://common-buy.aliyun.com/?commodityCode=sddp_pre&request=%7B%22ord_time%22:%221:Month%22,%22order_num%22:1,%22region%22:%22cn-zhangjiakou%22,%22type%22:%22normal%22,%22sddp_version%22:%22version_dengbao%22,%22audit_subscription_version%22:%220%22,%22logStorage_subscription%22:%221%22,%22logStorage%22:2%7D&regionId=cn-zhangjiakou","btn2":"立即购买","btn3":"产品文档","link3":"https://help.aliyun.com/product/52432.html?spm=5176.139959.J_5253785160.5.42de77d7KNxtZZ","infoGroup":[{"infoName":"精选推荐","infoContent":{"firstContentName":"包年享85折优惠","firstContentLink":"https://common-buy.aliyun.com/?commodityCode=sddp_pre&request=%7B%22ord_time%22:%221:Month%22,%22order_num%22:1,%22region%22:%22cn-zhangjiakou%22,%22type%22:%22normal%22,%22sddp_version%22:%22version_dengbao%22,%22audit_subscription_version%22:%220%22,%22logStorage_subscription%22:%221%22,%22logStorage%22:2%7D&regionId=cn-zhangjiakou","lastContentLink":"","lastContentName":""}},{"infoName":"用户指南","infoContent":{"firstContentName":"产品快速入门","lastContentName":"不同版本功能对比","firstContentLink":"https://help.aliyun.com/zh/dsc/data-security-center/user-guide/security-audit/","lastContentLink":"https://help.aliyun.com/zh/dsc/data-security-center/product-overview/difference-between-different-dsc-editions"}}]}],"card":[],"search":[],"infoCard":[{"bannerUrl":"https://img.alicdn.com/tfs/TB1Xf81a3gP7K4jSZFqXXamhVXa-5169-974.jpg","bannerTitle":"数据库审计","bannerContent":"满足等保2.0二级和三级 “安全审计”合规要求的同时，智能解析数据库通信流量，细粒度审计数据库访问行为，通过对数据库全量行为的审计溯源、危险攻击的实时告警、风险语句的智能预警，提供数据库资产最安全的监控保障。","liveButtonName":"查看详情","liveButtonLink":"https://www.aliyun.com/product/dbaudit?spm=5176.21213303.8115314850.1.faf453c9I9EKNe&scm=20140722.S_card@@%E5%8D%A1%E7%89%87@@1796._.ID_card@@%E5%8D%A1%E7%89%87@@1796-RL_%E6%95%B0%E6%8D%AE%E5%BA%93%E5%AE%A1%E8%AE%A1-OR_ser-V_2-P0_0","contentTitle":"满足等保2.0’安全审计‘的合规要求","homePageLink":"https://page.aliyun.com/form/act803688306/index.htm","homePageName":"7天试用","linkGroup":[{"linkContent":"发布包大小极致优化，节省流量和存储。"},{"linkContent":"服务迭代不再受发版限制，快速发布，快速迭代。"},{"linkContent":"业务开发效率更加优秀，一次开发，多端运行。"}]}],"title":{"mainTitle":"数据库审计","subtitle":"满足等保2.0二级和三级 “安全审计”合规要求的同时，智能解析数据库通信流量，细粒度审计数据库访问行为，通过对数据库全量行为的审计溯源、危险攻击的实时告警、风险语句的智能预警，提供数据库资产最安全的监控保障。","linkUrl":"https://www.aliyun.com/product/dbaudit?spm=5176.21213303.8115314850.1.faf453c9I9EKNe&scm=20140722.S_card@@%E5%8D%A1%E7%89%87@@1796._.ID_card@@%E5%8D%A1%E7%89%87@@1796-RL_%E6%95%B0%E6%8D%AE%E5%BA%93%E5%AE%A1%E8%AE%A1-OR_ser-V_2-P0_0","btnText":"查看详情"},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}}

数据库审计

满足等保2.0二级和三级 “安全审计”合规要求的同时，智能解析数据库通信流量，细粒度审计数据库访问行为，通过对数据库全量行为的审计溯源、危险攻击的实时告警、风险语句的智能预警，提供数据库资产最安全的监控保障。

产品控制台

立即购买

产品文档

精选推荐

包年享85折优惠

用户指南

产品快速入门

不同版本功能对比