I spent the start of my career in data engineering at fintech companies. While it doesn’t come up as much in my day-to-day at this point, related notes will be tagged here when they come up.
Recent Posts
Don't Double Down: Structured Streaming to Wrangle Data
— Stop reprocessing your entire dataset every time new data arrives. A practical guide to Spark Structured Streaming with code examples and cost logic. (9 min read)
What *are* Supply Chains, Anyway?
— A first foray into network visualization: messy graphs, abject terror. Early data viz experiments searching for supply loops. Bad graphs; interesting questions. (2 min read)