Substrate

A living collection of notes, ideas, and reflections from Doug Belshaw.

notes updated

I got 99 mules...

This is such great satire from McSweeney's on the state of AI company financing. We all know it's a bubble, it's just whether it's going to pop or slowly deflate...

Benjamin owns a farm. He employs 100 workers plowing his fields. His total payroll is $10 million/year. One day, he buys a mule, which provides the worker who uses it with a modest 10 percent productivity gain. Benjamin fires 99 of his workers and purchases 99 mules, expecting a 1,000 percent productivity gain. The driverless mules cause plow damage to his property in excess of $50 million. Benjamin loses another $5 million due to the loss of productivity from his one remaining employee, who no longer guides a plow but instead spends 100 percent of his time shoveling mule shit. Goldman Sachs builds an altar to Benjamin in their lobby and cuts out the heart of a junior analyst on it every Friday. They call it “Blood Sacrifice Friday.” The name isn’t catchy, but the event becomes a management favorite nonetheless.

notes updated

Unsatisfying GIFs

The ball doesn't always go in the hoop, the can doesn't always come out of the vending machine, the firework sometimes fails to go off, and the spoon sometimes sinks into the soup. That's life.

Paris-based motion design studio Parallel created a series of short animations which aim to do anything but impress, clips that highlight the frustrating day-to-day mishaps by turning them digital. The series, titled UNSATISFYING, aims to go against the trend of oddly satisfying videos that are currently pervading the internet, instead making audiences cringe with scenes that only deliver disappointment.

notes updated

Can LLMs invent a "private language"?

I'm not sure how cool I am with the latest versions of Anthropic's Claude models (Fable 5 & Mythos 5) seemingly inventing their own internal language:

When we’re first starting to understand a new model’s behavior, the most abundant source of data we have to draw on is its behavior during reinforcement-learning training. Reviewing this evidence for signs of reward hacking (exploiting loopholes that go against the spirit of a task) or unexpected actions can inform what we should be looking out for in the model’s real-world behavior. The most notable finding was illegible reasoning in a few reinforcement-learning environments over long rollout, but little sign of deceptive or highly surprising actions, and no clear evidence of unexpected coherent goals.