microsoft /nni
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
★ 14,366⑂ 1,850👁 8⑃ 3,492● 2,078▤ 40
automldeep-learningneural-architecture-searchhyperparameter-optimizationdistributedbayesian-optimizationautomated-machine-learningmachine-learning
More from this author
-1
Daily
+0
Weekly
+1
Monthly
14,366
stars
1,850
forks
8
watchers
3,492
prs
2,078
issues
40
releases
README
NNI automates feature engineering, neural architecture search, hyperparameter tuning, and model compression for deep learning. Find the latest features, API, examples and tutorials in our official documentation (简体中文版点这里). What's NEW! New release: v3.0 preview is available - _released on May-5-2022_ New demo available: Youtube entry | Bilibili 入口 - _last updated on June-22-2022_ New research paper: SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute - _published in OSDI 2022_ New research paper: Privacy-preserving Online AutoML for Domain-Specific Face Detection - _published in CVPR 2022_ Newly upgraded documentation: Doc upgraded Installation See the NNI installation guide to install from pip, or build from source. To install the current release: $ pip install nni To update NNI to the latest version, add --upgrade flag to the above commands. NNI capabilities in a glance Hyperparameter Tuning Neural Architecture Search Model Compression Algorithms Exhaustive search Grid Search Random Heuristic search Anneal Evolution Hyperband PBT Bayesian optimization BOHB DNGO GP Metis SMAC TPE Multi-trial Grid Search Policy Based RL Random Regularized Evolution TPE One-shot DARTS ENAS FBNet ProxylessNAS SPOS Pruning Level L1 Norm Taylor FO Weight Movement AGP Auto Compress More... Quantization Naive QAT LSQ Observer DoReFa BNN Supported Frameworks Training Services Tutorials Supports PyTorch TensorFlow Scikit-learn XGBoost LightGBM MXNet Caffe2 More... Local machine Remote SSH servers Azure Machine Learning (AML) Kubernetes Based OpenAPI Kubeflow FrameworkController AdaptDL PAI DLC Hybrid training services HPO PyTorch TensorFlow NAS Hello NAS NAS Benchmarks Compression Pruning Pruning Speedup Quantization Quantization Speedup Resources NNI Documentation Homepage NNI Installation Guide NNI Examples Python API Reference Releases (Change Log) Related Research and Publications Youtube Channel of NNI Bilibili Space of NNI Webinar of Introducing Retiarii: A deep learning exploratory-training framework on NNI Community Discussions Contribution guidelines If you want to contribute to NNI, be sure to review the contribution guidelines, which includes instructions of submitting feedbacks, best coding practices, and code of conduct. We use GitHub issues to track tracking requests and bugs. Please use NNI Discussion for general questions and new ideas. For questions of specific use cases, please go to Stack Overflow. Participating discussions via the following IM groups is also welcomed. |Gitter||WeChat| |----|----|----| |!image| OR |!image| Over the past few years, NNI has received thousands of feedbacks on GitHub issues, and pull requests from hundreds of contributors. We appreciate all contributions from community to make NNI thrive. Test status Essentials | Type | Status | | :---: | :---: | | Fast test | | | F
Top issues
#3496Failed to establish a new connection34 comments · 2021-03-29#4945Supported for torch.sum12 comments · 2022-06-17#4542Doubts about NAS+TypeError: tuple is not a Module subclass22 comments · 2022-02-10#5421TypeError: forward() takes 2 positional arguments but 6 were given21 comments · 2023-03-06#3814[Retiarii] migrate FBNet from NAS 1.0 to Retiarii framework21 comments · 2021-06-11#5614Cannot access https://nni.blob.core.windows.net/nashub/darts-v2-5465b0d2.pth for pretrained model20 comments · 2023-06-20#5417AssertionError, while speeding up Convnext model. 17 comments · 2023-03-02#5185 assert len(args) >= len(self.undetermined) AssertionError13 comments · 2022-10-26
Discussions
#5789I wanna know how to use python to output the best hyperparameters generating by NNI0 comments · 2024-05-29#5787Tensorflow support0 comments · 2024-05-22#5786About How to Save the Pruned Model0 comments · 2024-05-19#5785Training services URL(error 404) for references in readme.md.0 comments · 2024-05-18#5784What is a good value for trialConcurrency config parameter?0 comments · 2024-05-16#5781Is NNI stop developing?0 comments · 2024-05-13#5756Verification on the GP tuner accuracy when perform HPO/Save GP tuner iteratively1 comments · 2024-03-13#5753nni GELU is not registered, please register setting with QuantizationSetting.register().1 comments · 2024-03-07
Latest release
Release 3.0 - 21/8/2023 v3.0 2023-09-14Web Portal New look and feel Neural Architecture Search Breaking change: nni.retiarii is no longer maintained and tested. Please migrate to nni.nas. + Inherit nni.nas.nn.pytorch.ModelSpace, rather than use @model_wrapper. + Use nni.choice, rather than nni.nas.nn.pytorch.ValueChoice. + Use nni.nas.experiment.NasExperiment and NasExperimentConfig, rather than RetiariiExperiment. + Use nni.nas.model_context, rather than nni.nas.fixed_arch. + Please refer to quickstart for more changes. A refreshed experience to construct model space. + Enhanced debuggability via