Unified API

PyTorch 在torch.nn https://docs.pytorch.org/docs/stable/nn.html#module-torch.nn下提供 module，包括 常见层（卷积、池化、RNN、Transformer）、激活函数、损失函数等。

• AD Automatic Differentiation ← https://docs.pytorch.org/docs/stable/autograd.html#function(API)
  • tutorial https://docs.pytorch.org/docs/stable/notes/autograd.html
  • Computational Graph - Getting started https://docs.pytorch.org/tutorials/beginner/basics/autogradqs_tutorial.html#tensors-functions-and-computational-graph

→ Abstract of VGON

• [ ] opt problem need a data structure and implement operator (提供一个底层包，加速)
• [ ]