microsoft/nni

Does ProxylessNas implementation really support optimizing inference latency?

開放

#3,113 建立於 2020年11月22日

 (1 則留言) (0 個反應) (1 位負責人)Python (1,830 個分叉)batch import
NAShelp wantednew featureuser raised

倉庫指標

星標
 (13,504 顆星)
PR 合併指標
 (30 天內沒有已合併 PR)

描述

Environment:

  • NNI version: v1.9 (including current master)
  • NNI mode (local|remote|pai):
  • Client OS:
  • Server OS (for remote mode only):
  • Python version:
  • PyTorch/TensorFlow version:
  • Is conda/virtualenv/venv used?:
  • Is running in Docker?:

Log message:

  • nnimanager.log:
  • dispatcher.log:
  • nnictl stdout and stderr:

What issue meet, what's expected?:

The most important feature of ProxylessNas is that it can balance deployment latency and accuracy with simple regularization parameters. But this feature is clearly missing in nni. I only found loss = criterion(outputs, labels) and loss.backward() where the criterion is just a cross-entropy loss and only applicable for image classification.

Would nni team consider adding this feature? If not, would you mind I writing this feature and pulling a request?

How to reproduce it?:

Additional information:

貢獻者指南