[ Ссылка ] | The data mesh architectural paradigm shift is all about moving analytical data away from a monolithic data warehouse or data lake into a distributed architecture—allowing data to be shared for analytical purposes in real time, right at the point of origin. The idea of data mesh was introduced by Zhamak Dehghani (Director of Emerging Technologies, Thoughtworks) in 2019. Here, she provides an introduction to data mesh and the fundamental problems that it’s trying to solve.

Zhamak describes that the complexity and ambition to use data have grown in today’s industry. But what is data mesh? For over half a century, we’ve been trying to democratize data to deliver value and provide better analytic insights. With the ever-growing number of distributed domain data sets, diverse information arrives in increasing volumes and with high velocity. To remove the friction and serve the requirement for data to be consumed by operational needs in various use cases, the best way is to mesh the data. This means connecting data through a peer-to-peer fashion and liberating data for analytics, machine learning, serving up data-intensive applications across the organization, and more. Data mesh tackles the deficiency of the traditional, centralized data lake and data warehouse platform architecture.

The data mesh paradigm is founded on four principles:
1. Domain-oriented ownership
2. Data as a product
3. Data available everywhere in a self-serve data infrastructure
4. Data standardization governance

A decentralized, agnostic data structure enables you to synthesize data and innovate. The starting point is embracing the ideology that data can be anywhere. Source-aligned data should serve as a product available for people across the organization to combine, explore, and drive actionable insights. Zhamak and Tim also discuss the next steps we need to take in order to bring data mesh to life at the industry level.

To learn more about the topic, you can visit the all-new Confluent Developer course: Data Mesh 101. Confluent Developer is a single destination with resources to begin your Kafka journey.

EPISODE LINKS
► Zhamak Dehghani Kafka Summit Europe 2021 Keynote: How to Build the Data Mesh Foundation: [ Ссылка ]
► Data Mesh 101 Course: [ Ссылка ]
► Saxo Bank’s Best Practices for a Distributed Domain-Driven Architecture Founded on the Data Mesh: [ Ссылка ]
► Placing Apache Kafka at the Heart of a Data Revolution at Saxo Bank: [ Ссылка ]
► Why Data Mesh?: [ Ссылка ]
► Join the Confluent Community: [ Ссылка ]
► Learn more with Kafka tutorials, resources, and guides at Confluent Developer: [ Ссылка ]
► Live demo: Intro to Event-Driven Microservices with Confluent: [ Ссылка ]
► Use PODCAST100 to get an additional $100 of free Confluent Cloud usage: [ Ссылка ]
► Promo code details: [ Ссылка ]

ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.

#datamesh #apachekafka #kafka #confluent

свернуть