· ai-devtools
Fireworks says you’re wasting money on AI unless you’re using all the models
Fireworks AI is fine with helping companies run AI models in their own datacenters, though VP Rob Ferguson argues against doing so.
Ferguson told The Register in an interview that while Fireworks AI, a managed inference provider, supports on-prem AI, "we're trying to push people more and more away from it because frankly, it's just the economics." The GPU hardware is just so expensive that if you can't keep it fully utilized, it's a waste of money, he contends. Ten thousand GPUs, he said, represent a billion dollars of capital.
"You don't want those things to be sitting idle," he said. For companies with particularly sensitive workloads, Ferguson said, Fireworks is happy to work something out – it offers a service called Sovereign for just that purpose and it has partners like Microsoft that can help.
