How to customize and serve DBT documentation in Google Cloud Platform

Mohamed Dhaoui
13 min readNov 20, 2023

In today’s data-driven world, organizations are constantly seeking ways to manage and make the most out of their data. One promising approach to tackle data scaling challenges is the concept of a “Data Mesh.” The Data Mesh architecture aims to address the issues of centralized, monolithic data architectures by distributing data responsibilities across cross-functional teams. This approach allows organizations to efficiently scale their data capabilities. In this article, we will explore how to implement a Data Mesh architecture using DBT (Data Build Tool) as the central component. We will describe the different approaches for structuring our DBT project(s) and, most importantly, it goes through the steps involved to do so. Let’s start 🚀 !

Table of Contents

  1. What is Data Mesh?
  2. Why Use DBT in a Data Mesh?
  3. Implementing Data Mesh with DBT Building a Data Mesh Team
  4. DBT Folder organisation
  5. DBT cross documentation deployment
  6. Conclusion

1. What is Data Mesh?

Data Mesh is an architectural approach that acknowledges the complexity of modern data ecosystems. It suggests breaking up the centralized data monolith into…

--

--

Mohamed Dhaoui

Lead Data engineer and Data science practitioner ! Interested in data science and software development topics. GCP 5x certified and Go fan.