Kafka Connect: Build Data Pipelines by Integrating Existing Systems

Kafka Connect is a key component of Kafka that allows you to flow data between existing systems and Kafka to process data in real time. This practical guide shows how to build data pipelines between Kafka clusters and a variety of data sources and sinks, enabling advanced use cases and quick adoption.

Format: Paperback / softback
Length: 300 pages
Publication date: 29 September 2023
Publisher: O'Reilly Media

Apache Kafka, the preferred event streaming platform for over 80% of Fortune 100 companies, has emerged as the de facto standard. Kafka Connect, a vital component of Kafka, enables seamless data flow between existing systems and Kafka, facilitating real-time data processing. In this comprehensive guide, authored by Mickael Maison and Kate Stanley, data engineers, site reliability engineers, and application developers will learn how to establish data pipelines connecting Kafka clusters with diverse data sources and sinks.

Connect's versatility allows for quick adoption of Kafka by leveraging existing data and enabling a wide range of advanced use cases. Whether you are just starting your event streaming journey or looking to optimize your data pipeline, Kafka Connect is the ideal tool for building a modern and robust data infrastructure.

This guide will delve into Connect's capabilities, key concepts, and terminology. It will guide you in designing data and event streaming pipelines that leverage Connect's features. You will learn how to configure and operate Connect environments at scale, ensuring high availability and security. Additionally, you will explore the process of deploying secure and highly available Connect clusters, as well as building sink and source connectors, single message transforms, and converters.

By mastering Kafka Connect, you will gain the skills and knowledge necessary to build efficient and scalable event streaming systems that meet the demands of modern businesses. So, whether you are a data engineer, site reliability engineer, or application developer, this guide is your ultimate resource for unlocking the full potential of Apache Kafka and building data pipelines that drive success.

Weight: 700g
Dimension: 177 x 234 x 25 (mm)
ISBN-13: 9781098126537