1、canal-server异常信息
EntryPosition[included=false,journalName=binlog.001163,position=102983663,serverId=948551720,gtid=,timestamp=1606195870000] cost : 7ms , the next step is binlog dump |
|
2020-11-26 20:25:23.555 [destination = resource-destination , address = /**.**.**.**:3306 , EventParser] ERROR c.a.o.canal.parse.inbound.mysql.dbsync.DirectLogFetcher - I/O error while reading from client socket |
|
java.io.IOException: Received error packet: errno = 1236, sqlstate = HY000 errmsg = Could not find first log file name in binary log index file |
|
at com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch(DirectLogFetcher.java:102) ~[canal.parse-1.1.4.jar:na] |
|
at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.dump(MysqlConnection.java:235) [canal.parse-1.1.4.jar:na] |
|
at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$3.run(AbstractEventParser.java:265) [canal.parse-1.1.4.jar:na] |
|
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_152] |
|
2020-11-26 20:25:23.555 [destination = resource-destination , address = /**.**.**.**:3306 , EventParser] ERROR c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - dump address /**.**.**.**:3306 has an error, retrying. caused by |
|
java.io.IOException: Received error packet: errno = 1236, sqlstate = HY000 errmsg = Could not find first log file name in binary log index file |
|
at com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch(DirectLogFetcher.java:102) ~[canal.parse-1.1.4.jar:na] |
|
at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.dump(MysqlConnection.java:235) ~[canal.parse-1.1.4.jar:na] |
|
at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$3.run(AbstractEventParser.java:265) ~[canal.parse-1.1.4.jar:na] |
|
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_152] |
|
2020-11-26 20:25:23.555 [destination = resource-destination , address = /**.**.**.**:3306 , EventParser] ERROR com.alibaba.otter.canal.common.alarm.LogAlarmHandler - destination:resource-destination[java.io.IOException: Received error packet: errno = 1236, sqlstate = HY000 errmsg = Could not find first log file name in binary log index file |
|
at com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch(DirectLogFetcher.java:102) |
|
at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.dump(MysqlConnection.java:235) |
|
at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$3.run(AbstractEventParser.java:265) |
|
at java.lang.Thread.run(Thread.java:748) |
|
] |
2、分析原因：Could not find first log file name in binary log index file，不能找到binglog文件索引，因master cpu跑满重启，导致短时间的binglog dump失败，致使canal slave在dump binglog日志时出现错误，消费位置混乱
3、解决方法
1、zookeeper |
|
因canal-server使用zookeeper保存消费位点，需要删除zk里面的节点数据，但是需要先停掉canal-server以及client、找到destination存储位置如：ls /otter/canal/destinations/ 使用 rmr /otter/canal/destinations/，删除 |
|
2、mysql master |
|
找到当前master日志文件名称以及位置，登陆mysql，输入：show master status; 即可得到binglog文件名以及位置信息 |
|
3、canal-server destination |
|
集群模式下修改destination配置 |
|
canal.instance.master.journal.name=binlog.000357 |
|
canal.instance.master.position=67236808 |
|
4、重启canal-server client 即可 |