If you run change data capture (CDC) out of PostgreSQL with AWS DMS, one component quietly holds the fate of your source database in its hands: the logical replication slot. Understand how the write-ahead log and slots interact, and you understand why disks fill, why CDC stalls, and how to fix it. TL;DR The WAL … Continue reading WAL, Replication Slots & AWS DMS: A PostgreSQL Deep Dive
CloudBeaver on ECS: Why Password Authentication Fails Intermittently
The CloudBeaver ECS tasks started crash-looping yesterday. We spent a few hours debugging an intermittent "password authentication failed" error in CloudBeaver running on ECS with an RDS PostgreSQL backend. The root cause turned out to be an undocumented interaction between CloudBeaver's config parser and special characters in auto-generated passwords. Here's the full investigation. The Symptom … Continue reading CloudBeaver on ECS: Why Password Authentication Fails Intermittently
Personalised AWS Daily Briefing and Podcast
Keeping up with AWS is hard - hundreds of updates every month. I'd scroll through the "What's New" feed trying to find what's relevant, but still miss things.So I built an app called "AWS What's New" to solve this for myself.It lets me set my interests, focus areas, and what I'm currently working on โ … Continue reading Personalised AWS Daily Briefing and Podcast
Scratching My Own Itch: Turning Apple Health Data Into Insights
For a long time, I thought I was doing everything right. I tracked everything โ workouts, calories, sleep, water intake, even alcohol consumption and reading habits. Like many people, I relied on Apple Health to store all my data. The problem wasnโt collecting the data. It was understanding it. The Problem With Tracking Everything I … Continue reading Scratching My Own Itch: Turning Apple Health Data Into Insights
Understanding how third-party query engines integrate with Lake Formation
Integrating with AWS Lake Formation allows third-party services to securely access data stored in Amazon S3โbased data lakes. Over the past few days, Iโve gained several valuable insights from hands-on experience that Iโd like to share. I will walk you through the end-to-end workflow illustrated above and highlight some key lessons and challenges encountered along … Continue reading Understanding how third-party query engines integrate with Lake Formation
