gradient checkpointing

OpenAI’s gradient checkpointing: A package that makes huge neural nets fit into memory

OpenAI releases a python/Tensorflow package, Gradient checkpointing! Gradient checkpointing lets you fit 10x larger neural nets into memory at the…

6 years ago