How we rebuilt Photon's shared iMessage routing to handle 10M+ messages a day — migrating Bun to Node, fixing a memory leak, ...
I was the bottleneck the whole time ...
OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, ...
OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, using software optimization alone. Engineers achieved more than 50% savings ...