Anthropic CFO Krishna Rao Interview: How They Plan Compute https://t.co/nvRA1OM5DU 1. They buy Nvidia GPUs, Google TPUs, Amazon Trainium and use all 3 fungibly. 2. Built in-house orchestration to utilize each generation of different chip most efficiently. 3. Works as close to the bare metal on all 3 chips as possible to have maximum flexiblity and efficiency. 4. Has influence over Amazon Trainium design roadmap. Sometimes works directly with Annapurna engineers. 5. They have allocation for their own engineers separate from research which in itself has an allocation. 6. Model Development has highest priority even over Customer allocation. 7. ROI of being on the best frontier model is very high, especially enterprise. Immediately when Opus 4.7 comes out, almost everyone switches to
在 X 查看 ↗