Are AI Models Working Harder Than They Need to?

He’d been working on spiking neural networks, another alternative to standard neural networks. Energy-Efficient Weightless Neural NetworksWhy is now the time to look into weightless neural networks? John: In datasets like human-activity recognition or medical monitoring, ECG, EEG, blood pressure, weightless neural networks can do the job at 1,000 times less energy use. The best other small AI model for one problem we looked at is 17 megabytes. At some point I’m hoping we can train on FPGA-based hardware instead, because FPGAs already have small lookup tables built into them, so it’s a natural fit for both training and inference.