InTowards Data EngineeringbyPritam DebData Engineering 2.0: Trends That Are Shaping the Industry’s FutureStay ahead of the curve with insights into cutting-edge data engineering trends and technologiesNov 27, 20242Nov 27, 20242
InData Engineer ThingsbyPeter FlookData Contracts in Action: ToolsSome people have asked me “Are data contracts really a thing?”, soon followed up by “What tools are available when using data contracts?”Sep 30, 2024Sep 30, 2024
Andriy ZabavskyyData Product in a NutshellA big-picture layout shaped by TOGAF’s domainsMay 24, 20248May 24, 20248
InThe Telegraph EngineeringbyStefano SolimitoDBT: A new way to handle data transformation at The TelegraphDBT enables data engineers to easily transform data in their warehouses. More than 280 companies are using it, The Telegraph is among them.Aug 23, 20194Aug 23, 20194
Arsalan MehmoodWriting ETL Pipelines In Apache Beam — Part 1Write Your Pipeline Code Once & Carry it to runner of your choice!Aug 16, 2020Aug 16, 2020
InTDS ArchivebyEric BrodaTowards A Practical Data Mesh RoadmapThe journey to an enterprise Data Mesh can be challenging. It can be made a bit easier and quicker by using a practical data mesh roadmap.Nov 17, 20223Nov 17, 20223
InNetflix TechBlogbyNetflix Technology BlogDBLog: A Generic Change-Data-Capture FrameworkAndreas Andreakis, Ioannis PapapanagiotouDec 17, 201928Dec 17, 201928
InMeroxabyTaron FoxworthStream Your Database Changes with Change Data CaptureNobody wants to look at a dashboard or make decisions with yesterday’s data. We live in a world where real-time information is a…Aug 11, 20211Aug 11, 20211
InTowards Data EngineeringbyAyush DixitDatabase Design for a system like LinkedIn.If you’re preparing for Data engineering interviews at big product-based companies, then you must have to appear in the data modeling or…Jan 29, 20235Jan 29, 20235
InLevel Up CodingbyMark AngPopulate your AWS Kinesis data stream with Python: A short guideIf you’re using AWS (like I do on a regular basis), you’re probably familiar with AWS’s Kinesis queue service. According to Amazon’s…Dec 2, 20203Dec 2, 20203
InHashmap, an NTT DATA CompanybyVenkat SekarGetting Started with Data Vault 2.0My top recommendations for beginning your journey with DV2Jan 19, 2022Jan 19, 2022
InData Engineer ThingsbyPavan KumarIntroduction to Apache Iceberg | PySparkThe Story Behind a Data LakeApr 25, 20245Apr 25, 20245
InData Engineer ThingsbyVu TrinhHow does Uber handle petabytes of Spark shuffle data every day?The Remote External Service (RSS)Jun 22, 20241Jun 22, 20241
Piethein StrengholtIntegrating Azure Databricks and Microsoft FabricThe article discusses the integration of Azure Databricks and Microsoft Fabric, presenting several architectural design options.Jun 4, 202410Jun 4, 202410
Steve JonesYour new Data Architecture — The Data Mullet: Business in the Front, Party in the backYour AI future needs a Data MulletFeb 20, 20244Feb 20, 20244
Piethein StrengholtData Quality within LakehousesA deep dive into data quality using bronze, silver, and gold layered architecturesMar 5, 20246Mar 5, 20246
