Liveness Analysis Helps Save Gigabytes of Memory Usage for AI Inference

Figure 1: Memory footprint normalized to total tensor size. The smaller, the better.
Figure 2: IR of LeNet, transformed from ONNX by ONNC.
Figure 3: Memory allocation result for LeNet.

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store