The vault.ssp.sh features a collection of over 1000 curated notes, interconnected concepts that create a knowledge hub for data engineers. This is a brief demo of how the Data Engineering Vault looks like and how you can navigate it. I've spent years collecting, connecting, and curating knowledge.
This terrific resource crossed my bow just as I'm developing guidance for tech professionals getting into data warehousing. I'm sharing it with my clients. Thank you so much for putting this together!
Hey Doug, thanks so much for sharing it and the kind feedback 🙌🏻.
The DE Vault It's a Second Brain approach to DE knowledge where: ✦ Each concept links to related terms, creating natural learning paths ✦ Historical context shows how the field evolved from BI to modern data engineering ✦ Practical applications connect theory to real-world implementation
The vault contains deep dives into: ↠ DE Lifecycle ↠ Data Modeling (Dimensional to ECM) ↠ Modern Data Infrastructure (Lakehouses, Delta Lake, Iceberg, Hudi) ↠ Transformation (Functional DE, dbt, SQLMesh) ↠ Data Contracts & Semantic Layers ↠ CDC, Time Travel & Schema Evolution
Beyond definitions, the DE Vault offers curated paths through: ↠ DE lifecycle ↠ Essential books & thought leaders ↠ Whitepapers & learning resources ↠ Learning resources to get started The interconnected approach mimicking how our brains naturally learn. Explore at vault.ssp.sh.
TIL—There is no way to force YT to create a video instead of a short. Unfortunately YT automatically turned the video into a short, hopefully it's still watchable (I hate shorts...) 😅.