One of the things that lights my brain up is bring able to process, analyze, and visualize cool datasets. I’ve been incredibly fortunate to be able to make a living out of that. This tag is a catch-all for projects related to data processing, statistics, and data engineering.
#data
Graph View
Recent Posts
Design of a mucin-selective protease for targeted degradation of cancer-associated mucins
— The rubber hits the road on ColabFold! I hope that's rubber I'm smelling — although it may be the computer. A replication attempt of a protein fold figure in K. Pedram et al (2023). (7 min read)
An Annotated Guide to Hobbyist Protein Folding
— Amaze (or bore) your friends and family by picking up on a hot new hobby that's all the rage — protein folding! An annotated starter to the 2021 paper "ColabFold - Making protein folding accessible to all" (8 min read)
APL: Pattern 3; City Country Fingers
— City, with natural stripes — or nature, with city stripes? Annotations for A Pattern Language, and tracking public opinion of where Americans want to live over the past 50 years. (4 min read)
Privacy Policy
— When it comes to collecting data, there's a fine line between making a good site and making an invasive product. To make this site more useful, I want to collect enough data to improve, but never enough to undermine anybody's privacy. (3 min read)
Ants in the Neighborhood
— Is Jane Street run by soccer-loving ants? Inconclusive. We *can* conclude that they're fans of Markov Chains, though — an invaluable tool for understanding complex data structures. (1 min read)
Show 10 more posts
A Pattern Language, and a Beautiful Day in the Neighborhood
— The beginning of a topological review of the 1977 urban design and architecture reference book A Pattern Language, and a journey to understand Earth's greatest graph: the Earth, itself. (12 min read)
The Advantages of Advantage: Intro to Probability Convolutions
— What *is* the advantage of rolling with advantage? Exploring dice roll combinations and probability convolutions. (8 min read)
Dice Roll Distribution Widget
— Discover the probability distributions of different dice roll combinations (1 min read)
Some initial thoughts about time tracking
— TODO. (1 min read)
Don't Double Down: Structured Streaming to Wrangle Data
— Stop reprocessing your entire dataset every time new data arrives. A practical guide to Spark Structured Streaming with code examples and cost logic. (9 min read)
Littlefield Simulator: The Art of Laziness
— Efficiency: spending six hours building a web scraper to avoid five minutes of daily work. Automating a business simulation because checking in is for chumps. (8 min read)
Entries to SOME 1
— Stable matching, optimal stopping, and Bachelor analysis - visualized with some care. (1 min read)
Utah Office Consult
— People problems are the hardest engineering problems. A consult on thinking out-of-the-box to explain morale problems in small companies. (2 min read)
College Admissions and the Stability of Marriage
— My college presentation on the Gale-Shapley paper, recorded on an iPad, like a true professional. Non-market environments, matchmaking lattices, and gratitude for good professors. (1 min read)
What *are* Supply Chains, Anyway?
— A first foray into network visualization: messy graphs, abject terror. Early data viz experiments searching for supply loops. Bad graphs; interesting questions. (2 min read)