Kafka in Action

Kafka in Action is a practical guide to building Kafka-based data pipelines, covering common use cases such as logging, streaming data, and analytics. Written for intermediate Java developers or data engineers, the book emphasizes Kafka's versatility as a distributed streaming platform and its integration with Java applications.

Format: Paperback / softback
Length: 375 pages
Publication date: 09 March 2022
Publisher: Manning Publications

Kafka in Action is a comprehensive and practical guide to building Kafka-based data pipelines. Filled with real-world use cases and scenarios, this book delves into Kafka's most common applications, ranging from simple logging to managing streaming data systems for message routing, analytics, and more.

In the realm of systems that handle large volumes of data, streaming data, or fast data, the accuracy and efficiency of data pipelines are paramount. Apache Kafka emerges as a powerful distributed streaming platform that surpasses its traditional roles as a persistent log or a flexible message queue. It operates as a versatile tool capable of handling a wide range of use cases.

Key Features:

Understanding Kafka's Concepts: This book provides a solid foundation for understanding Kafka's core concepts, including topics, partitions, brokers, and consumers. It helps readers grasp the fundamental principles of Kafka's architecture and its role in data streaming.

Implementing Kafka as a Message Queue: Readers learn how to set up and utilize Kafka as a message queue, enabling efficient communication between services or applications. They explore the basics of message persistence, delivery, and consumption, and how Kafka can be integrated into existing systems.

Setting Up and Executing Basic ETL Tasks: The book covers the process of setting up and executing basic Extract, Transform, and Load (ETL) tasks using Kafka. It explains how to extract data from various sources, transform it according to requirements, and load it into Kafka topics for further processing.

Recording and Consuming Streaming Data: Readers learn how to record and consume streaming data from Kafka topics. They explore the concepts of Kafka streams, which enable real-time processing of data as it arrives, and learn how to implement streaming data applications using Java.

Working with Kafka Producers and Consumers from Java Applications: The book demonstrates how to work with Kafka producers and consumers from Java applications. It covers the integration of Kafka with Java frameworks, such as Spring Boot, and provides examples of producing and consuming messages using Kafka clients.

Using Kafka as Part of a Large Data Project Team: Readers gain insights into the role of Kafka in large data projects. It discusses the collaboration and communication requirements between different teams involved in data processing, and how Kafka can facilitate data sharing and integration.

Performing Kafka Developer and Admin Tasks: The book covers the essential tasks involved in Kafka development and administration, such as configuring Kafka clusters, monitoring performance, and troubleshooting issues. It provides practical guidance for developers and administrators who need to maintain and operate Kafka systems.

Written for Intermediate Java Developers or Data Engineers: This book is designed for intermediate Java developers or data engineers who have a basic understanding of Java and are interested in learning Kafka. No prior knowledge of Kafka is required, as the book provides a comprehensive introduction to the platform.

About the Technology:

Apache Kafka is a distributed streaming platform that enables the logging and streaming of data between services or applications. With Kafka, developers can build applications that can react to or act on data streams as they flow through their systems. Some of the key applications of Kafka include operational data monitoring, large-scale message processing, website activity tracking, log aggregation, and more.

Dylan Scott, the author of Kafka in Action, is a software developer with over ten years of experience in Java and Perl. His extensive experience includes implementing Kafka as a messaging system for a large-scale data migration project. Dylan currently works in the insurance industry, where he leverages Kafka for various data processing and analysis tasks.

In conclusion, Kafka in Action is a valuable resource for anyone looking to build Kafka-based data pipelines. With its practical approach, real-world use cases, and comprehensive coverage of Kafka's features, this book provides intermediate Java developers or data engineers with the knowledge and skills they need to leverage Kafka's power in their data processing projects. Whether you are a beginner or an experienced Kafka user, this book will help you unlock the full potential of this versatile distributed streaming platform.

Weight: 510g
Dimension: 187 x 235 x 22 (mm)
ISBN-13: 9781617295232