TVM: A New Apache Incubator Project

TVM is an open deep learning compiler stack for CPUs, GPUs, and specialized accelerators. It aims to close the gap between the productivity-focused deep learning frameworks, and the performance -or efficiency- oriented hardware backends. TVM provides the following main features:

• Compilation of deep learning models in Keras, MXNet, PyTorch, Tensorflow, CoreML, DarkNet into minimum deployable modules on diverse hardware backends.
• Infrastructure to automatic generate and optimize tensor operators on more backend with better performance.

TVM provides two level optimizations show in the following figure. Computational graph optimization to perform tasks such as high-level operator fusion, layout transformation, and memory management. Then a tensor operator optimization and code generation layer that optimizes tensor operators.

TVM has been accepted to Apache Incubator and I will be a Mentor of the Apache TVM project. I’ll supervise the TVM community in order for them to reach an open meritocratic environment.

[1] https://tvm.ai

[2] https://medium.com/@furkankamaci/open-source-software-development-and-apache-incubator-372cc90081ae