Getting Started with AWS Managed Streaming for Kafka Service (MSK)

{"InstanceType": "kafka.m5.large","ClientSubnets": ["subnet-axxxxx","subnet-2xxxx","subnet-4xxxx"],"SecurityGroups": ["sg-05xxxxx"]}
sudo yum install java-1.8.0
wget ftp://apache.mirrors.tds.net/pub/apache.org/kafka/1.1.1/kafka_2.11-1.1.1.tgz
tar -xzf kafka_2.11–1.1.1.tgz
cd kafka_2.11–1.1.1/
[ec2-user]$ bin/kafka-topics.sh — create — zookeeper “ZookeeperConnectString” — replication-factor 3 — partitions 1 — topic mskiscool
Created topic “mskiscool”.
[ec2-user]$ bin/kafka-console-producer.sh — broker-list “BootstrapBrokerString” — topic mskiscool
>hello world
>msk demo
>cdl enjoy
(Control C)
[ec2-user]$ bin/kafka-console-consumer.sh — bootstrap-server “BootstrapBrokerString” — topic mskiscool — from-beginning
hello world
msk demo
cdl enjoy
(Control C)
Processed a total of 3 messages

--

--

Data Architect @CDL_Software , AWS Community Builder, 13 x AWS Certified. Qlik Global Luminary 50.

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Matt Houghton

Matt Houghton

20 Followers

Data Architect @CDL_Software , AWS Community Builder, 13 x AWS Certified. Qlik Global Luminary 50.