[DEV] TVM v0.6 Roadmap

[ZihengJiang]

This roadmap for TVM v0.6. TVM is a community-driven project and we love your feedback and proposals on where we should be heading. Please open up discussion in the discussion forum as well as bring RFCs.

• Feel free to volunteer yourself if you are interested in trying out some items(they do not have to be on the list).
• Please also check out the help wanted list in the github issues on things that need help

Features

• Quantization
  • Support for configuring mix-precision
  • Per-Channel scale
  • Graph packing
  • Smarter calibration algorithm
  • Model coverage
  • Support importing quantization model from other frameworks
• Relay
  • Algebra Data Type
  • Runtime support for dynamic models
  • Support Any syntax
  • Pass Manager
  • Official text format support
• Automated tuning and scheduling
  • graph level automated optimization
• Ultra low-bit support
  • tutorials of low-bit ops
  • customized accelerator support
• VTA enhancements
  • support generic high level models
  • Enhanced operator/model coverage
  • Ultra-96, ZCU102 support
  • Amazon F1 preliminary support
  • Low-bit support, bit serial support
  • Chisel version
• Micro-asm kernel exploration
  • Core micro-asm primitives for certain ops
• Hybrid python programming model
  • transition of vision operators to hybrid mode.
• RPC and Device API
  • Support a c++ version of cross platform RPC
• Training
  • First-order auto differentiation
  • Gradient operators
  • High-order auto differentiation
• Arithmetics
  • Formalize Integer Arithmetic Analysis
• Tutorials
  • Tutorials of low-bit ops using Relay

[icemelon]

Does runtime for dynamic model refer to the runtime for Relay? Otherwise, we can also add Relay runtime into 0.6 roadmap.

[ZihengJiang]

@edmBernard Great to hear that! Added!

[ZihengJiang]

@icemelon9 Right, it refers to the runtime for Relay

[icemelon]

Cool. @jroesch @zhiics @wweic and I can work on runtime for Relay.

[FrozenGene]

Wish TVM v0.6 can finish this item: #2351. i.e. Support importing exist quantization TFLite model. This can be a start for supporting importing existing quantization model (i.e. don't restrict TFLite).

[zhiics]

Pass manager for relay, should be able to finish discussion soon, haha

[yzhliu]

does "graph level automated optimization" mean #2184 or something else?

[ZihengJiang]

@yzhliu I think so. It is a legacy item from roadmap v0.5

[antinucleon]

Will work together with @icemelon9 on dynamic runtime.

[antinucleon]

I think we should also deprecate nnvm fully in 0.6. So far there are still some legacy code in topi depends on nnvm.

[icemelon]

Could we also add Any dimension support in Relay to the roadmap? I think it's an important feature to have.