Practical Implementation of a Data Lake: Translating Customer Expectations into Tangible Technical Goals

This book provides guidance on implementing a data lake strategy, covering technical and business challenges, and emphasizing customer requirements. It covers key stakeholder identification, requirement gathering, security, and organizational roles. It also discusses data division, organization, sensitivity, obfuscation, audit, and logging. The book concludes with production operationalization and solutions.

Format: Paperback / softback
Length: 202 pages
Publication date: 04 October 2023
Publisher: APress

Implementing a data lake strategy can be a complex task, but this comprehensive book provides architects with the necessary guidance to navigate the technical and business challenges that often arise. By emphasizing the importance of client requirements driving architectural decisions, the author guides readers through the process of creating a data lake that meets the specific needs of their customers.

The book begins by asking the fundamental question: what does your customer need? This serves as a guiding principle throughout the entire implementation process. The author then delves into the importance of identifying key stakeholders and focusing on the key points when starting a new project. This includes understanding the business objectives, identifying data sources, and defining the desired outcome.

Once the business and technical requirements have been gathered, the author walks readers through the process of translating customer expectations into tangible technical goals. This involves understanding the various technologies and tools available for data storage, processing, and analysis, as well as the security considerations that need to be taken into account. The book provides detailed insights into the security model, including the establishment of security and legal guardrails, as well as different aspects of security from the end-user perspective.

Organizational roles are also discussed in detail, with a focus on the responsibilities and services that different teams need access to. The book outlines the hierarchy of escalations and how to ensure that issues are resolved efficiently.

The next chapters explore how to divide data lakes into zones, organize data for security and access, manage data sensitivity, and employ techniques for data obfuscation. Audit and logging capabilities in the data lake are also covered, along with designing data lakes to handle multiple kinds and file formats and access patterns.

The book concludes by focusing on production operationalization and solutions for implementing a production setup. By completing this book, readers will gain a deep understanding of how to implement a data lake, the best practices to employ, and practical tips to solve business problems.

In summary, this book is a valuable resource for architects looking to implement a data lake strategy. It provides a comprehensive guide to the technical and business challenges involved, and emphasizes the importance of client requirements driving architectural decisions. By focusing on the practical aspects of implementation, readers will be well-equipped to create a data lake that meets the needs of their customers and drives business success.

Weight: 349g
Dimension: 235 x 155 (mm)
ISBN-13: 9781484297346
Edition number: 1st ed.