(01-03-2018, 01:01 AM)Chick3nman Wrote: A box with 8x V100 does like 1.5-2x the speed for ~half the power usage. And you can rent them from Amazon super cheap too.
https://twitter.com/Chick3nman512/status...4383591424
(01-03-2018, 02:51 AM)Chick3nman Wrote: I was referring to spot pricing, not reserved pricing. Spot price right now for an 8x V100 box is only 9.10$/hr. Running that instance for a month would only cost you $6552, not almost 18k$. Of course the price can fluctuate a bit with spot pricing, but the graph on the N. Virginia region has been pretty stable recently. The price of 1 V100 is higher than running an AWS instance with 8 of them for a month.
Right, so the acquisition cost for the 16 x P104-100 GPU box is still less than the AWS 8x V100 instance spot pricing over the course of 1.5 months.