OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
Go to file
Mikhail Nosov 896532ace2
[OV2.0] PrePostProcessor dump to output stream for debugging purposes (#9580)
* Calculate model layout based on 'tensor' layout and convert steps

Previously, 'model layout' is set to '...' by default,
thus no shape conversion happened when tensor layout is set to 'NHWC', then there was explicit convert_layout "NCHW"

Now "model layout" is calculated based on tensor layout and conversion steps:
Examples:
 1) Tensor: NHWC, Convert: NCHW. Result: NCHW
 2) Tensor: NHWC, Convert: 0312. Result: NCHW

* Initial move of tensor data calculation

* Moved 'impls' to new file

* Postprocessing + unit tests

* clang-format fix

* Added more details to preprocessing nodes
- Mean/Scale - will print mean/scale values
- Convert type - will print type
- Convert layout - will print destination layout
- Convert color - will print destination color

It is needed to troubleshoot the problems. If error occurs, message will not display last op's target shape/layout/type

* Add python bindings

* update tests

* Added memory type to dump if set

* Code style fix

* unity build fix

* Dump tensor if only memory type is set

* Added debug print

* Fix Param->Result case

Previously, layout was set by preprocessing set to old parameter as well
This is incorrect because in case of exception layout info will not be reverted

In this case old Result pointed to old Parameter and was able to preserve runtime info

After fixing of this, case Param->Result was broken if revalidation is not triggerred

Fix is to detect 'Result' as a consumer of some parameter and force revalidation in this case

* Revert occasionally committed line

* And one more line
2022-01-12 22:00:32 +03:00
.ci Add openvino_contrib to coverity scan (#9253) 2022-01-12 16:56:34 +03:00
.github [Python API] Move wheel folder to the python dir (#9125) 2022-01-11 16:55:18 +03:00
cmake ShutdownProtobufLibrary when unload paddle frontend dynmaic library t… (#9442) 2022-01-12 13:07:51 +03:00
docs doc-versions-from-server (#9437) 2022-01-12 14:40:07 +03:00
inference-engine [Python API] Move wheel folder to the python dir (#9125) 2022-01-11 16:55:18 +03:00
licensing Export frontend_common as dev target (#9003) 2021-12-08 17:18:44 +03:00
samples Enable THROUGHPUT by default for all the devices. (#9107) 2022-01-12 11:09:54 +03:00
scripts Clean up setupvars scripts (#9410) 2021-12-29 17:57:56 +03:00
src [OV2.0] PrePostProcessor dump to output stream for debugging purposes (#9580) 2022-01-12 22:00:32 +03:00
tests Change omz model (#9551) 2022-01-11 10:56:50 +03:00
thirdparty omz: catch up https://github.com/openvinotoolkit/open_model_zoo/pull/3060 (#9602) 2022-01-12 17:23:19 +03:00
tools [tools] some fixes for python benchmark (#9584) 2022-01-12 17:22:58 +03:00
.gitattributes [POT] Update tests with new data (#8209) 2021-10-27 12:40:19 +03:00
.gitignore Feature/azaytsev/from 2021 4 (#9247) 2021-12-21 20:26:37 +03:00
.gitmodules [GPU] Moved onednn_gpu to plugin folder (#9458) 2021-12-29 11:06:14 +03:00
CMakeLists.txt Remove ngraph backends (#9162) 2021-12-13 00:04:56 +03:00
CODEOWNERS [GPU] Moved onednn_gpu to plugin folder (#9458) 2021-12-29 11:06:14 +03:00
install_build_dependencies.sh Enabled proper OpenVINOConfig.cmake generation for static build (#8634) 2021-11-20 02:27:43 +03:00
Jenkinsfile Beautify Jenkinsfile a little bit 2021-05-31 15:24:56 +03:00
LICENSE Publishing R3 2018-10-16 13:45:03 +03:00
README.md [README.md] change latest release to 2021.4.2 2021-11-16 22:12:20 +03:00
SECURITY.md Added SECURITY.md back (#3177) 2020-11-17 16:44:44 +03:00

OpenVINO™ Toolkit

Stable release Apache License Version 2.0 GitHub branch checks state Azure DevOps builds (branch) PyPI Downloads

This toolkit allows developers to deploy pre-trained deep learning models through a high-level C++ Inference Engine API integrated with application logic.

This open source version includes several components: namely Model Optimizer, nGraph and Inference Engine, as well as CPU, GPU, MYRIAD, multi device and heterogeneous plugins to accelerate deep learning inferencing on Intel® CPUs and Intel® Processor Graphics. It supports pre-trained models from the Open Model Zoo, along with 100+ open source and public models in popular formats such as Caffe*, TensorFlow*, MXNet* and ONNX*.

Repository components:

License

Deep Learning Deployment Toolkit is licensed under Apache License Version 2.0. By contributing to the project, you agree to the license and copyright terms therein and release your contribution under these terms.

Resources:

Support

Please report questions, issues and suggestions using:


* Other names and brands may be claimed as the property of others.