One of the things that lights my brain up is bring able to process, analyze, and visualize cool datasets. I’ve been incredibly fortunate to be able to make a living out of that. This tag is a catch-all for projects related to data processing, statistics, and data engineering.
#data
1 min read
Recent Posts
The Wild Web
— Come with me and explore an invisible social network: IndieWeb, where the cowboy can-do attitude of Web 1.0 is alive and a-thrivin'.
You can pry my dashes from my cold, dead hands
— A bit of self-reflection on dashes in my writing to decide if LLMs have rotted my brain, or if my brain was already beyond saving from the start.
Hyperparameter verification of StcE protein folds in Pedram et al., 2023 .pdf
— The rubber hits the road on ColabFold! I hope that's rubber I'm smelling — although it may be the computer. A replication attempt of a protein fold figure in K. Pedram et al (2023).
An Annotated Guide to Hobbyist Protein Folding .pdf
— Amaze (or bore) your friends and family by picking up on a hot new hobby that's all the rage — protein folding! An annotated starter to the 2021 paper "ColabFold - Making protein folding accessible to all"
APL: Pattern 4; Agricultural Valleys
— Urban development has the high ground over agricultural and ecological preservation — and it should! *A Pattern Language* annotations on Pattern 4: Agricultural Valleys
APL: Pattern 3; City Country Fingers
— City, with natural stripes — or nature, with city stripes? Annotations for A Pattern Language, and tracking public opinion of where Americans want to live over the past 50 years.
Privacy Policy
— When it comes to collecting data, there's a fine line between making a good site and making an invasive product. To make this site more useful, I want to collect enough data to improve, but never enough to undermine anybody's privacy.
Ants in the Neighborhood
— Is Jane Street run by soccer-loving ants? Inconclusive. We *can* conclude that they're fans of Markov Chains, though — an invaluable tool for understanding complex data structures.
A Pattern Language, and a Beautiful Day in the Neighborhood
— The beginning of a topological review of the 1977 urban design and architecture reference book A Pattern Language, and a journey to understand Earth's greatest graph: the Earth, itself.
Dice Roll Distribution Widget
— Discover the probability distributions of different dice roll combinations
The Advantages of Advantage: Intro to Probability Convolutions
— What *is* the advantage of rolling with advantage? Exploring dice roll combinations and probability convolutions.
Some initial thoughts about time tracking
— Initial thoughts on using tools like Apple Shortcuts and Timery/Toggle for tracking how I spend my time -- every minute of every day.
Don't Double Down: Structured Streaming to Wrangle Data
— Stop reprocessing your entire dataset every time new data arrives. A practical guide to Spark Structured Streaming with code examples and cost logic.
Littlefield Simulator: The Art of Laziness
— Efficiency: spending six hours building a web scraper to avoid five minutes of daily work. Automating a business simulation because checking in is for chumps.
Entries to SOME 1
— Stable matching, optimal stopping, and Bachelor analysis - visualized with some care.
Utah Office Consult .pdf
— People problems are the hardest engineering problems. A consult on thinking out-of-the-box to explain morale problems in small companies.
College Admissions and the Stability of Marriage
— My college presentation on the Gale-Shapley paper, recorded on an iPad, like a true professional. Non-market environments, matchmaking lattices, and gratitude for good professors.
What *are* Supply Chains, Anyway?
— A first foray into network visualization: messy graphs, abject terror. Early data viz experiments searching for supply loops. Bad graphs; interesting questions.
Core Posts
Don't Double Down: Structured Streaming to Wrangle Data
— Stop reprocessing your entire dataset every time new data arrives. A practical guide to Spark Structured Streaming with code examples and cost logic.
APL: Pattern 4; Agricultural Valleys
— Urban development has the high ground over agricultural and ecological preservation — and it should! *A Pattern Language* annotations on Pattern 4: Agricultural Valleys
APL: Pattern 3; City Country Fingers
— City, with natural stripes — or nature, with city stripes? Annotations for A Pattern Language, and tracking public opinion of where Americans want to live over the past 50 years.
A Pattern Language, and a Beautiful Day in the Neighborhood
— The beginning of a topological review of the 1977 urban design and architecture reference book A Pattern Language, and a journey to understand Earth's greatest graph: the Earth, itself.
College Admissions and the Stability of Marriage
— My college presentation on the Gale-Shapley paper, recorded on an iPad, like a true professional. Non-market environments, matchmaking lattices, and gratitude for good professors.
An Annotated Guide to Hobbyist Protein Folding .pdf
— Amaze (or bore) your friends and family by picking up on a hot new hobby that's all the rage — protein folding! An annotated starter to the 2021 paper "ColabFold - Making protein folding accessible to all"
Ants in the Neighborhood
— Is Jane Street run by soccer-loving ants? Inconclusive. We *can* conclude that they're fans of Markov Chains, though — an invaluable tool for understanding complex data structures.
The Advantages of Advantage: Intro to Probability Convolutions
— What *is* the advantage of rolling with advantage? Exploring dice roll combinations and probability convolutions.
Some initial thoughts about time tracking
— Initial thoughts on using tools like Apple Shortcuts and Timery/Toggle for tracking how I spend my time -- every minute of every day.
Littlefield Simulator: The Art of Laziness
— Efficiency: spending six hours building a web scraper to avoid five minutes of daily work. Automating a business simulation because checking in is for chumps.