OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
Go to file
Bartosz Sochacki fc1a3ce2f1
[GNA] Fake quantization layer support for int-8 mode for GNA plugin (#2937)
* [GNA] added support for per-channel FakeQuantise layer

* [GNA] added quantisation types detection in FQ enabled networks, and added input scale factors detection from FQ connected to input layer

* added FakeQuantize callback that will be use to cast integer values stored as float in FakeQuantized layer

* fixed per-channel multiplier calculation for int8 case

* precision improvements for int8 fake quantization and support for propagating scale factors to activation layers

* added initial int16 support

* added support for fake quantize layer with many connected output layers and support for FQ data encoded as FP16

* added support for already quantized weights

* Shared single layer test

* Added subgraph test

* Fix comment

* int8

* Enabling FQ tests on GNA

Co-authored-by: Eugene Smirnov <eugene.smirnov@intel.com>
Co-authored-by: Andrey Dmitriev <andrey.dmitriev@intel.com>
2020-11-20 16:40:19 +03:00
.ci [OpenVino ONNX CI watchdog] Small improvements (#3096) 2020-11-13 12:17:11 +03:00
.github Remove Java bindings (#3216) 2020-11-19 13:59:20 +03:00
cmake Ngraph static lib (#3193) 2020-11-18 18:09:41 +03:00
docs Minor markdown fix: adding back-quotes (#3204) 2020-11-19 11:31:06 +03:00
inference-engine [GNA] Fake quantization layer support for int-8 mode for GNA plugin (#2937) 2020-11-20 16:40:19 +03:00
licensing added third party programs files (#2751) 2020-10-23 18:03:01 +03:00
model-optimizer [MO] cli_parser fix when input contains substring with matching scale/mean values (#3146) 2020-11-20 11:42:42 +03:00
ngraph Complete CTCGreedyDecoder implementation in nGraph and add tests (#3190) 2020-11-19 18:32:25 +03:00
openvino ITT performance counters for first inference (#1741) 2020-11-12 14:00:14 +03:00
scripts Update install_openvino_dependencies.sh (#3197) 2020-11-19 01:30:08 +03:00
tests Add new model to tgl_test_config.yml (#3236) 2020-11-20 13:33:57 +03:00
tools Fix spelling errors in tools (#3217) 2020-11-19 16:56:47 +03:00
.gitattributes Doc Migration (master) (#1377) 2020-07-20 17:36:08 +03:00
.gitignore publish master branch snapshot, revision 8d31237e2c3f673cbb0f0ba110fc10f5cce1d2bb 2020-05-22 02:23:12 +03:00
.gitmodules add submodules for mkl-dnn, gflags and gtest 2020-05-21 23:00:55 +03:00
CMakeLists.txt Connect some ngraph and IE cmake options (#3147) 2020-11-17 11:42:34 +03:00
CODEOWNERS Added code owners for scripts folder (#2130) 2020-09-08 17:23:27 +03:00
install_build_dependencies.sh [install_dependencies.sh] install latest cmake if current version is lower 3.13 (#2695) 2020-10-16 21:03:46 +03:00
Jenkinsfile [Jenkinsfile] Get rid of dldtPipelineEntrypoint (#3012) 2020-11-09 19:17:19 +03:00
LICENSE Publishing R3 2018-10-16 13:45:03 +03:00
README.md Removed documents which are ported to OpenVINO WiKi (#3106) 2020-11-17 11:46:05 +03:00
SECURITY.md Added SECURITY.md back (#3177) 2020-11-17 16:44:44 +03:00

OpenVINO™ Toolkit - Deep Learning Deployment Toolkit repository

Stable release Apache License Version 2.0 Azure DevOps builds (branch)

This toolkit allows developers to deploy pre-trained deep learning models through a high-level C++ Inference Engine API integrated with application logic.

This open source version includes several components: namely Model Optimizer, ngraph and Inference Engine, as well as CPU, GPU, MYRIAD, multi device and heterogeneous plugins to accelerate deep learning inferencing on Intel® CPUs and Intel® Processor Graphics. It supports pre-trained models from the Open Model Zoo, along with 100+ open source and public models in popular formats such as Caffe*, TensorFlow*, MXNet* and ONNX*.

Repository components:

License

Deep Learning Deployment Toolkit is licensed under Apache License Version 2.0. By contributing to the project, you agree to the license and copyright terms therein and release your contribution under these terms.

Resources:

Support

Please report questions, issues and suggestions using:


* Other names and brands may be claimed as the property of others.