New Math Unlocks Machine Learning Performance

Machine Learning is the New Math

Bill Dally said, \”We’ve seen a 1,000-fold improvement in training performance per chip over the past 10 years. A lot of that is due to the number representation.\” Bill Dally was speaking at the IEEE Symposium on Computer Arithmetic.