#Kafka

building confluentinc kafka-connect-hdfs

WhenItrytocompileIgetanerroraboutamissingSNAPSHOTdependency.Theerrorlookssomethinglikethis:Failedtoexecutegoalonprojectkafka-connect-hdfs:Couldnotresolvedepende...

using kafkacat reset kafka offset

1.installkafkacatUbuntuapt-getinstallkafkacatCentOSinstalldeepenencyyuminstalllibrdkafka-develdownloadsourcefromgithubbuildsourceoncentos./configure<usual-co...

Kafka Connect Architecture

KafkaConnect'sgoalofcopyingdatabetweensystemshasbeentackledbyavarietyofframeworks,manyofthemstillactivelydevelopedandmaintained.Thissectionexplainsthemotivation...
代码星球 ·2020-04-05

The usage of docker image wurstmeister/kafka

 Thedockerimage wurstmeister/kafkaisthemoststaredimageforkafkainhub.docker.com,buttheuseageisrare,so inthispost,Iwouldtakesometimetotalkabouttheu...
代码星球 ·2020-04-05

kafka connect rest api

1.获取ConnectWorker信息curl-shttp://127.0.0.1:8083/|jqlenmom@M1701:~/workspace/software/kafka_2.11-2.1.0/logs$curl-shttp://127.0.0.1:8083/|jq{"version":"2.1.0","com...
代码星球 ·2020-04-05

Kafka connect in practice(3): distributed mode mysql binlog ->kafka->hive

InthepreviouspostKafkaconnectinpractice(1):standalone,Ihaveintroducedaboutthebasicsofkafkaconnect  configurationanddemonstratealocalstandalonedemo.Int...

Linux Kafka源码环境搭建

本文主要讲述的是如何搭建Kafka的源码环境,主要针对的Linux操作系统下IntelliJIDEA编译器,其余操作系统或者IDE可以类推。1.安装和配置JDK确认JDK版本至少为1.7,最好是1.8及以上。使用java-version命令来查看当前JDK的版本,示例如下:lenmom@M1701:~/workspac...

kafka producer实例

1.定义要发送的消息UserPOJOpackagelenmom.kafkaproducer;publicclassUser{publicStringname;publicintage;publicStringaddress;publicUser(Stringname,intage,Stringaddress){this...
代码星球 ·2020-04-05

CentOS7 安装kafka集群

1.环境准备JDK1.8ZooKeeper集群(参见本人博文)Scala2.12(如果需要做scala开发的话,安装方法参见本人博文)本次安装的kafka和zookeeper集群在同一套物理机器上,192.168.1.101192.168.1.102192.168.1.103 2.下载kafka到kafka官...
代码星球 ·2020-04-05

kafka的安装 (单机)

https://blog.csdn.net/q282176713/article/details/81112988...
代码星球 ·2020-04-05

CDH5.10 添加kafka服务

简介:CDH的parcel包中是没有kafka的,kafka被剥离了出来,需要从新下载parcel包安装。或者在线安装,但是在线安装都很慢,这里使用下载parcel包离线安装的方式。PS:kafka有很多版本,CDH也有很多版本,那也许你会疑问如何知道你的CDH应该安装什么kafka版本。这个官方有介绍,文档地址:ht...
代码星球 ·2020-04-05

kafka常用命令(cdh5.10.0+kafka)

参考资料:http://kafka.apache.org/quickstart进入kafka安装目录(CDH安装路径为:/opt/cloudera/parcels/KAFKA):进入bin目录:cd /opt/cloudera/parcels/CDH-5.10.0-1.cdh5.10.0.p0.41/bin&...

Apache Kudu as a More Flexible And Reliable Kafka-style Queue

Howdyfriends!Inthisblogpost,IshowhowKudu,anewrandom-accessdatastore,canbemadetofunctionasamoreflexiblequeueingsystemwithnearlyashighthroughputasKafka.Oneofthemo...

kafka 安装部署

 环境:ubuntu12.0464位桌面版 解压kafkatar-zxvf/mnt/hgfs/mnt/kafka_2.11-0.10.0.0.tgz-C/root/software/进入目录cdkafka_2.11-0.10.0.0/创建data目录mkdir/root/software/kafka...
代码星球 ·2020-04-05

Oracle GoldenGate对接 Oracle 11g和Kafka

 本文主要是向读者介绍如何通过ogg为oracle数据库的变更操作实时同步到大数据产品kafka上。开始介绍前,先为读者介绍一下环境背景机器ip和其对应的服务192.168.88.166【ogg目标端】【ogg的mgr(端口1357),rep_test】192.168.88.128【ogg源端】 【...
首页上一页...910111213下一页尾页