Compare commits

..

951 Commits

Author SHA1 Message Date
csy0225
7cd3c8e86e Fix compile problem when open -Wnon-virtual-dtor compile flag (#10705)
* Fix compile problem when open -Wnon-virtual-dtor compile flag

* update code style

* fix the code style
2022-03-02 16:31:37 +03:00
Ilya Churaev
d3ded2fc36 Fixed declaration of 'xxx' hides global declaration (#10733) 2022-03-02 16:01:21 +03:00
Gorokhov Dmitriy
40fc5334d8 [CPU] Fixed number of streams initialization for hint = throughput (#10728) 2022-03-02 15:44:34 +03:00
Anastasia Kuporosova
cd52cc6767 [Python API][Docs] Remove excess info (#10672)
* [Python API][Docs] Remove excess info

* autodoc: add skip methods (#68)

* remove utils from docs

* undo changes

Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>
2022-03-02 15:36:31 +03:00
Victor Kuznetsov
c54926ecb8 Update nightly memcheck models scope (#10709) 2022-03-02 18:03:28 +08:00
Wilson Seok
969060c8db Add op impl check tests (#10339)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add initial op impl check tests

* add op imple check tests

* add op impl check tests

* add rnn cell based ops

* modify lstmsequence

* update rnn cell base op test

* add priorbox, priorboxclustered, proposal

* add ROIAlign to ReverseSequence

* add Roll to ScatterElementsUpdate

* add select to swish tests

* add tensoriterator to variadicsplit test

* temporary block of LSTMCell v1 due to crash in mkldnn

* use ov namespace instead of ngraph as possible

* update indexing of vector array

* update multiple parameter vector

* add loop test

* fix cpplint errors

* fix build error
2022-03-02 12:50:31 +03:00
Ilya Lavrenov
86b175534a Docs: complete migration guide (#10652)
* Updated glossary

* Removed references to OpenVX

* Moved migration_ov_2_0 to OpenVINO User guide

* Replaced IE with OV runtime

* Complete migration guide

* Migration 2.0

* Self-review

* Added property migration guide

* Fixed table

* Added preprocessing migration

* Update docs/OV_Runtime_UG/migration_ov_2_0/preprocessing.md

Co-authored-by: Mikhail Nosov <mikhail.nosov@intel.com>

* Update docs/OV_Runtime_UG/migration_ov_2_0/preprocessing.md

Co-authored-by: Mikhail Nosov <mikhail.nosov@intel.com>

* Update docs/snippets/ov_preprocessing_migration.cpp

Co-authored-by: Mikhail Nosov <mikhail.nosov@intel.com>

* reivew fixes

* Preprocessing intro updated

* Updated config migration guide

* Updates

* Fixes

Co-authored-by: Mikhail Nosov <mikhail.nosov@intel.com>
2022-03-02 12:16:58 +03:00
Yuan Xu
d1bcb6d0fc CVS-80445 (#10723)
* Add Overview page

* Revert "Add Overview page"

* fix format

* test formatting

* test formatting

* update

* test formatting

* minor changes
2022-03-02 11:10:58 +03:00
Pavel Zamelin
9cd3bff7df Fix install failures for static libs with EXCLUDE_FROM_ALL (#10706)
* Remove EXCLUDE_FROM_ALL for some static targets

* Add install check for static libs
2022-03-02 03:39:30 +03:00
Vladislav Golubev
e75ee60bec [CPU] Disabled sequences decomposition for dynamic case (#10710) 2022-03-01 22:33:42 +03:00
Nikolay Tyukaev
81cd9d86d1 sphinxdirective: allow commented blocks (#10720)
* sphinxdirective: allow commented blocks

* minor correction
2022-03-01 22:11:37 +03:00
Mikhail Nosov
5e023ebdd9 Fix issue with default arguments in preprocessing python bindings (#10702)
* Fix in Preprocessing python bindings - add correct default arguments for:
    - PreProcessSteps::convert_element_type
    - PostProcessSteps::convert_element_type
    - InputTensorInfo::set_color_format

Otherwise, python users must always specify optional params

E.g. instead of writing `tensor().set_color_format(ColorFormat.RGB)` python users will have to write `tensor().set_color_format(ColorFormat.RGB, [])`

* Corrected 'help' output

* Exposing 'openvino.runtime.Type.undefined' and use it in 'convert_element_type' documentation
2022-03-01 17:32:36 +03:00
Ilya Lavrenov
6b067bc0ed Fixed install on Apple (#8302)
* Fixed Apple install

* Update path to libs in setupvars.sh

* Fix IE_CPACK_RUNTIME_PATH for Apple

* Fix wheels packaging

Co-authored-by: Alexey Suhov <alexey.suhov@intel.com>
2022-03-01 16:56:15 +03:00
David Nam
18035209a0 Add op impl checkt tests (#10414)
* Add op impl checkt tests

* Add op impl check tests

* Add op impl check tests

* Add op impl check test

* Add op impl check tests

* Add op impl check tests

* Fix usage of makeConstant()

* Fix build error in ubuntu18_i386

* Fix error in linux-macos

Co-authored-by: PVA-CI <pva-ci@intel.com>
2022-03-01 16:27:11 +03:00
Anastasia Kuporosova
0f409ccea9 [Python API] Fix typo in method name (#10707) 2022-03-01 16:11:57 +03:00
Anastasia Popova
3f941e3c5f Corrected layout parsing error message. (#10651)
* Corrected error message.

* Corrected message.

* Small correction

* Corrected error message for source and target layout.
2022-03-01 16:03:09 +03:00
Irina Efode
9eca8515b8 [IE TESTS] Extend EvaluatorMaps by Greater, If, Equal (#10026)
* [IE TESTS] Extend EvaluatesMap

* fix code style
2022-03-01 16:01:30 +03:00
Sergey Shlyapnikov
6c6aa8fa95 [GPU] Fix RemoteBlob lock() and ulock() behaviour in case of multiple threads (#10685)
* [GPU] Fix RemoteBlob lock() and ulock() behaviour in case of multiple threads and add tests
2022-03-01 15:15:04 +03:00
Karol Blaszczak
1d469a2b87 [DOCS] hddl update (#10616)
* [DOCS] hddl update

include info on hddl and myriad working at the same time

* Update docs/OV_Runtime_UG/supported_plugins/MYRIAD.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update HDDL.md

* Update MYRIAD.md

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
2022-03-01 15:00:38 +03:00
Maxim Andronov
8e0978818c [CPU] Prevent internalBlobs cleanup for dynamic deconv node (#10697) 2022-03-01 14:31:21 +03:00
Nikita Semaev
64fca57af4 Fix NMS Conformance tests for Template plugin (#9273)
* Added inputs argument to all compare() function overloads

* Rewritten compare() function for NMS

* Implemented sorting by name of expected outputs

* Implemented sorting by name of actual outputs

* Added accounting for simultaneous dynamism and the need to convert outputs in Template plugin

* Added a separate case to the GetBlob function for correct dimensions

* Rewritten Expected outputs sorting to work correctly on cpuFuncTests

* Fixing code style problems

* Implemented sorting by name of actual outputs for functional tests

* Debug prints removed

* Replacing a raw pointer with a vector

* Fixing code style problems

* Shifting the sorting place Expected outputs

* Added sorting of Expected exits in one more place

* Quality transition to SLT2.0

* Removing unnecessary code after SLT2.0

* Fix soft_nms_sigma argument

* Removing unnecessary parts after SLT2.0

* Remove unnecessary outputs sorting

* Removing parts from the code for debugging

* Fix for NMS

* Trying to make CI green

* Checking test passage without adding convert precision

* Checking CI

* There is an algorithm that adds Convert only if there is f16, fp16 in inputs

* Add Convert Op in cases where inputs are not already installed f32

* Check that the CI will go away if you put everything back

* Revert changes, validate f32 change on ci

* Adding Convert f16-f32 only if there is a function parameter of type f16

* The presence of f16/bf16 as a parameter type is now mandatory to add Convert

* Added prints for params, inputs, outputs

* Logic checking the absence of Convert

* Cosmetic fixes

* Setting the correct value for selected_scores_type NMS-5

* Fix bf

* Increased readability

* Missing parts added

* Removed the static for the vector
2022-03-01 12:14:45 +03:00
Ilya Lavrenov
5f40ba9a23 Fixed onecoreuap.toolchain.cmake (#10646)
* Fixed onecoreuap.toolchain.cmake

* Updated mt.runtime.win32.toolchain.cmake
2022-03-01 11:12:12 +03:00
Roman Kazantsev
6c78715749 [MO] Clean up Model Optimizer options, help, and documentation (#10653)
* [MO] Clean-up MO cmd-line options

Remove the following Model Optimizer deprecated options that are no longer used for several releases: disable_fusing, disable_gfusing, generate_deprecated_IR_V7,
legacy_ir_generation, keep_shape_ops, move_to_preprocess
Deprecate through CLI the following options for which functionality triggered from POT or automatically: disable_weights_compression, disable_nhwc_to_nchw,
disable_resnet_optimization, finegrain_fusing.
Correct and extend description of each MO option to be printed during model conversion.

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Correct documentation about input shapes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Perform final corrections in documentation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove legacy_ir_generation overall

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Clean-up tests from deprecated options

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Recover disable_fusing option as deprecated

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix keys for static_shape and extensions

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove extension key that does not work

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply feedback: remove disable_gfusing, correct docs

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Recover disable_fusing option for unit-tests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply feedback for documentation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply feedback about parameters use_legacy_frontend and use_new_frontend

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* DO minor fixes for indentation of MO logs

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Revert log.error for fallback message

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Revert disable_weights_compression parameter for tests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2022-03-01 10:57:24 +03:00
Ilya Churaev
9da124544a Transformation guide (#10628)
* Fixed some comments about transformations

* Changed transformation guide

* Fixed typo

* Moved transformation doc to extensibility

* Moved images to Extensibility_UG

* Added separate document for each pass

* Added see also section

* Fixed comments
2022-03-01 09:03:59 +03:00
Andrei Kochin
4b29eed013 Update MO requirements to allow TF1.15 if already installed (#10673)
* Update MO requirements to allow TF1.15 if already installed

* Removing pyhton version check as redundant

* Updating requirements.txt as well
2022-02-28 18:55:44 +03:00
Mikhail Nosov
173f328c53 Checking compatibility between 'pyopenvino' and 'libopenvino' (#10668)
* Checking compatibility between 'pyopenvino' and 'libopenvino' on 'import phase'

This fix is to prevent undefined behavior when user loads OpenVINO from python, but pyopenvino loads different version of 'libopenvino'
This may happen if user has several releases installed and played around PATH/PYTHONPATH environment variables.

In such case, user may have undefined behavior - application may crash in the middle of the usage or use incorrect release.

Fix checks build versions for pyopenvino and ov::get_openvino_version. If mismatch occurs, exception is thrown.

This logic is disabled if user has built OpenVINO locally, experienced developers probably know what they're doing, so if version has 'custom_'  prefix - this logic is disabled

* Removed custom logic for CI_BUILD_NUMBER, it is reused from already included version.cmake

* Use addVersionDefines macro
2022-02-28 17:04:59 +03:00
Maxim Andronov
b319acc672 [CPU] Prohibit to load model with dynamic output shapes (#10643) 2022-02-28 17:01:18 +03:00
Mateusz Tabaka
4a8b142fef [PYTHON] fix importing lstm_sequence for opsets >= 5 (#10637)
* [PYTHON] fix importing lstm_sequence for opsets >= 5

* update compat opsets
2022-02-28 17:00:51 +03:00
Nikita Malinin
33ad1b96d4 [POT] Update samples and samplers with the new DataLoader format (#10595)
* Update samples and samplers with the new DataLoader format

* Update with utils

* Pylint updates

* Update metric with the exception

* Pylint

* Update with the exception

* Pylint

* Revert index sampler changes

* Update ImageLoader & SimplifiedEngine

* Update with the different solution

* Remove utils

* Pylint

* Remove list wrapping

* Remove list from meta_data
2022-02-28 16:26:07 +03:00
Maxim Vafin
7d0d950b9a Add pytorch Resnext101 from fb into documentation (#10665) 2022-02-28 15:30:33 +03:00
Irina Efode
f6fbef1f66 Allow to specify conformance by shape_type (#10667)
* Init

* the solution

* Remove extra

* Update CMakeLists.txt

* Readme

* fix build

* dd
2022-02-28 15:06:03 +03:00
Maxim Shevtsov
bed0adf5ef creating remote ocl buffer/tensor per request, to avoid simulteneous locking of the same ocl buffer when auto-batching is used (#10607) 2022-02-28 15:04:03 +03:00
Vladislav Golubev
1ceb9729e9 [CPU] friendly name duplication fixed for the TypeRelaxed case (#10486) 2022-02-28 14:06:17 +03:00
Maxim Gordeev
b9ef57112e [IE Samples] Fixed memory allocation problem for speech sample (#10671) 2022-02-28 12:31:01 +03:00
Vitaliy Urusovskij
d4f77f1d3e Mute 'maybe-uninitialized' error for RELWITHDEBINFO in intel_gpu (#10682) 2022-02-28 12:30:21 +03:00
Fedor Zharinov
f55e69d656 Legacy benchmark_app is added (#10239)
* Legacy benchmark_app is added

* apply fix for supporting multiple -i arguments

* new CMakeLists.txt with OpenCV auto detection

* fixes

* docs

* docs2

* Docs changes

* docs

* CMakeLists.txt modification

* Update tools/legacy/benchmark_app/README.md

Co-authored-by: ivikhrev <ivan.vikhrev@intel.com>
Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>
2022-02-28 12:26:41 +03:00
Andrey Zaytsev
5724c5ac44 Image added (#10674) 2022-02-25 20:42:00 +00:00
Denis Orlov
52b450a5fb [GNA] Update documentation (#10570) 2022-02-25 18:55:15 +03:00
Tatiana Savina
7b58f931b5 [DOCS] Add wb images for nightly docs fix (#10663)
* add img

* wb img for input

* dataset added

* add img

* wb img for input

* dataset added

* ov_fix
2022-02-25 18:22:13 +03:00
Egor Duplensky
18ff8afe63 [IE TESTS] Avoid extra checks for test skipping (#10609)
Avoid double iteration over skip patterns
Skip test after first pattern match
2022-02-25 16:11:16 +03:00
Ilya Znamenskiy
94cbbe063b [GPU] Cum sum int32/64 support (#10629) 2022-02-25 15:48:17 +03:00
Ilya Lavrenov
e9e59cb954 Moved ngraphConfig.cmake to root (#10618) 2022-02-25 15:47:21 +03:00
Jan Iwaszkiewicz
54f39294de [PYTHON] Fix style in python doc strings (#10606)
* Fix style in python doc strings

* New line quotes
2022-02-25 13:02:04 +03:00
Yury Gaydaychuk
14d11a8998 [CPU] Fix of invalid read in DefConv (#10481) 2022-02-25 12:57:03 +03:00
Anuj Mittal
bdee939fe0 installing-openvino-yocto: fix documentation links (#10546)
* installing-openvino-yocto: fix documentation links

Point to the new Yocto docs website.

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>

* Update installing-openvino-yocto.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2022-02-25 12:31:32 +03:00
Anton Pankratov
38d87dd9de Removed stream enum (#10645)
* Removed stream enum

* Fixed build

* fixed build

* Fixed test
2022-02-25 11:57:23 +03:00
Ilya Churaev
a32ed5a07a Fixed build for CI (#10659) 2022-02-25 11:41:23 +03:00
Dmitry Pigasin
bacf597516 [CPP Speech Sample] Improve -o and -oname flags (#10321)
* Improve `-o` and `-oname` flags

* Apply clang-format tool

* fix saving output files

* Apply clang-format

* Fix error when `-oname` not specified

* apply clang format

* Fix error `-oname`

* Use output name with port to find model output

* fix comment line breaking

* fix comparison with reference for multiple outputs

* Fix output name printing  error

* try to fix clang format

* fix problem with bs > 1

* minimal change to rerun test pipeline

* clang format

* Revert "Fix error `-oname`"

This reverts commit c33d5f16e8.
2022-02-25 11:25:35 +03:00
Maksim Kutakov
9e3610c028 [CPU] Fix for subnormal numbers nullifying routine (#10622) 2022-02-25 10:55:59 +03:00
Nikolay Tyukaev
6062e3d4b7 DOCS: benchmarks ovino vs tf (#10654)
* benchmarks-ovino-vs-tf

* minor fixes
2022-02-25 10:34:11 +03:00
Ilya Lavrenov
53d3ef8eab Removed ngraph mentions (#10647) 2022-02-25 07:02:09 +03:00
Ilya Lavrenov
ffd63f9758 Replaced IE with OV runtime: docs (#10642)
* Updated glossary

* Removed references to OpenVX

* Moved migration_ov_2_0 to OpenVINO User guide

* Replaced IE with OV runtime
2022-02-25 00:44:48 +03:00
Ilya Churaev
806ce96899 Remove onnx_custom_op doc (#10638)
* Remove onnx_custom_op doc

* Remove test

* Fixed tests
2022-02-24 19:41:47 +03:00
Anastasia Kazantaeva
f2bbd5bbb8 Add original contribution guide to root (#10644) 2022-02-24 16:13:21 +00:00
Sergey Shlyapnikov
e906b3581f [GPU] Replace handle_permute optimization pass with proper Reorder adding instead of Permute primitive (#10569) 2022-02-24 16:41:43 +03:00
Paul Youngsoo Ahn
163a79b232 [GPU] Fix activation fusing issue(#10636) (#10636) 2022-02-24 16:07:33 +03:00
Ilya Churaev
1c18733ade Changed location of extensibility guide (#10433)
* Changed location of extensibility guide

* Removed hardware kernels legacy documentation

* Changed all extension guild to new API

* Removed Custom_Layers_Guide

* Fixed build

* Fixed some moments

* Update docs/Extensibility_UG/Intro.md

* Fixed build

* Added more examples

* Fixed typo

* Fixed comments

* Extend library topic

* Fixed typo
2022-02-24 15:50:31 +03:00
Maksim Derbasov
a2f9963045 Fix warnings from builders.hpp (#10568) 2022-02-24 15:33:30 +03:00
Ilya Churaev
85707198b3 Revert "Disable reshape for new API (#10064)" (#10634)
This reverts commit 3f4e384d5d.
2022-02-24 15:22:08 +03:00
Evgenya Stepyreva
3de428c713 Auto-batch ConvertLike enabled (#10631) 2022-02-24 14:37:03 +03:00
Alina Kladieva
4c01d6c50c Skip canRun3SyncRequestsConsistentlyFromThreads sporadic on Myriad (#10598) 2022-02-24 12:03:36 +03:00
Ivan Novoselov
506303cc79 [Snippets][CPU] Fix empty shapes handling in canonicalization (#10632) 2022-02-24 11:54:15 +03:00
Vladimir Dudnik
23b74840c1 renamed streams property (#10620) 2022-02-24 10:49:38 +03:00
Evgenya Stepyreva
e544f5e66f Enable einsum shape inferenxe test (#10603) 2022-02-23 15:29:12 +00:00
Anton Pankratov
9dec8db964 Common OV configuration tests (#10286)
* Used new config for streams and threads

* Fixed review coments in ba

* format fix

* fixed hello_query_device

* Added STL string io

* fixed tests

* Fixed test

* Fixed build

* fixed format

* Fixed build

* try fix win

* other any io specialization

* Fixed after merge

* renamed streams

* build fixed

* fixed build

* fixed format

* fix for old mac build

* Fixed type of exception

* test fix

* Added ov configuration test

* Added common OV properties tests

* fix mklnn

* fixed foramat

* merge conflicts

* Remoed compile_model tests

* removed duplicated test
2022-02-23 13:03:37 +03:00
Karol Blaszczak
c1919a0f1d update documents for Paddle inclusion (#10613)
Introduce PaddlePaddle articles and include PP references in other articles
2022-02-23 12:53:37 +03:00
Ilya Churaev
7ff8ada805 Fixed API for transformations (#10584)
* Fixed API for transformations

* Fixed code style

* Fixed build

* Fixed typo
2022-02-23 06:29:03 +03:00
Fedor Zharinov
75cca1e9e9 [benchamrk_app] error if -b is set but there's no batch info (#10592)
* Added code showing error message if -b is provided, but got no batch info for inputs

* stylefix / batch>1 case
2022-02-23 01:30:08 +03:00
Vladimir Dudnik
817550fa0a [OMZ] update OMZ submodule, docs updated (#10594)
* update OMZ submodule, docs updated

* rebase to master
2022-02-22 23:37:55 +03:00
Ilya Churaev
3f4e384d5d Disable reshape for new API (#10064)
* Disable reshape for new API

* Update cnn_network_ngraph_impl.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-02-22 23:05:23 +03:00
Ilya Lavrenov
5b3b48aa17 samples overview & model protection: docs (#10596)
* Renamed hetero md

* Renamed some guides

* Updated OpenVINO_Runtime_User_Guide.md

* Updated plugin's page

* More updates

* Fixed links

* Updated link names

* Fixed links

* Fixed docs build

* Self-review

* Fixed issues in doc snippets

* Updated Samples_Overview.md

* Updated model protection guide

* Renamed ngraph_function creation samples
2022-02-22 20:11:42 +03:00
Liubov Talamanova
37923a9183 [POT] Remove DataFreeEngine (#10600) 2022-02-22 18:38:08 +03:00
hyunback kim
14d31d59af [GPU] Enable deconv with oneDNN (#10580)
* [GPU] Enable deconv with oneDNN

remove post-op data_type into oneDNN.

Signed-off-by: hyunback <hyunback.kim@intel.com>

* Update to use data_type in conv sum post-op.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-02-23 00:25:26 +09:00
Ivan Novoselov
b12c3389ee [Sinppets] Add virt destructors to Emitter and TargetMachine (#10588) 2022-02-22 18:18:49 +03:00
Indira Salyahova
e2df6d149b [POT] Update face detection sample (#10471)
* support cascade model for sw api

* update mtcnnengine

* delete empty line
2022-02-22 17:46:08 +03:00
Maxim Shevtsov
dab1a34aa2 checking the network batch-ability (internal helper func on top of bat… (#10446)
* checking the network batchability (internal helper func on top of batch tracking) before doing hetero

* more general logic with respect to batch-ability of the network

* a dynamism check that I've owed from the PR-10560

* using the DO-detached mechanism for early hetero exit, also fixed this flag in the Batching plugin (although minor, as the DO is removed by HETERO)

* adding the dimension tracking logic depending on whether implicitly/expicitly the auto-batching is enabled

* changed the DetectionOutput affinity markup to go over results, also accomodate Convert, so only 2 subgraphs are made by the HETERO
2022-02-22 17:19:23 +03:00
Nikolay Shchegolev
e59739ce88 [CPU] RNN node enforce bf16 mode does not work. (#9859) 2022-02-22 16:57:26 +03:00
Mikhail Ryzhov
71a0a6d261 [GNA] Klocwork fixes 2022-02-22 16:54:56 +03:00
Roman Kazantsev
bc0a84a1c1 [MO] Print information about new API 2.0 (#10567)
* [MO] Print information about new API 2.0

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply feedback

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply feedback

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2022-02-22 16:54:20 +03:00
Indira Salyahova
aced89a655 fix: don't pass parametr inplace_statistic for weights (#10593) 2022-02-22 16:53:53 +03:00
Anastasia Kuporosova
5bb8f77c3f [Python API] Remove get/set_config methods from the PyOV (#10587) 2022-02-22 16:51:41 +03:00
Maxim Vafin
435584bb91 Support dynamic Broadcast and new pattern for TI condition (#9735)
* Support dynamic Broadcast and new pattern for TI condition

* Apply review feedback

* Fix broadcast if statement
2022-02-22 16:46:48 +03:00
Min, Byungil
487bb67995 Resolve onednn fc issue to enable bert-base (#10177)
+ Enabled bert-base-ber model
+ Resolve failure of onednn fc

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-02-22 22:23:45 +09:00
Maksim Kutakov
850f93f21b [CPU] INT8 tests for convolution sum fusing (#10359)
* int8 tests

* Sum second term port selection fix

* Fix after rebase
2022-02-22 15:42:26 +03:00
Tingqian Li
51ef938385 [CPU] fix crash in resnet binary model (#9761) 2022-02-22 15:23:20 +03:00
Tatiana Savina
6dc8b8b047 add note (#10566) 2022-02-22 14:50:37 +03:00
Anton Romanov
c80a872f73 Fix Coverity in samples (#10583)
* Fix coverity samples

* Fixed coverity issue in speech sample
2022-02-22 14:49:35 +03:00
Alexey Lebedev
a3004e7d80 [PYTHON API] reshape helper (#10402)
* Add reshape helper

* add dimension(range)

* Add partial_shape helper

* Fix code style

* fix comments

* Split reshape on several overloads

* Fix code style

* correct exception

* remove range support

* fix code style

* Add exception

* Dimension from str, PartialShape from str, reshape(str) support

* Apply review comments

* Add default init for shape

* Add PS syntax examples

* Remove pshape parsing from benchmark_app

* Update src/bindings/python/src/pyopenvino/graph/model.cpp

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>

* Update src/bindings/python/src/pyopenvino/graph/model.cpp

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>

* Apply suggestions from code review

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
2022-02-22 14:48:55 +03:00
Ilya Lavrenov
991c9db1c1 Config api docs (#10563)
* Renamed hetero md

* Renamed some guides

* Updated OpenVINO_Runtime_User_Guide.md

* Updated plugin's page

* More updates

* Fixed links

* Updated link names

* Fixed links

* Fixed docs build

* Self-review

* Fixed issues in doc snippets
2022-02-22 14:32:57 +03:00
Sofya Balandina
3f15afb926 [IE TEST] Continue run after crash (#10037) 2022-02-22 13:55:51 +03:00
Pavel Esir
3d223ebc2a [MO] update error message when reverse infer was not successful (#10576)
* update error message when reverse infer was not successful

* corrected message when there are several undefined Parameters
2022-02-22 13:51:10 +03:00
Andrey Zaytsev
efd3c119fa Update Yocto documentation (#10547) (#10591)
* installing-openvino-yocto: fix documentation links

Point to the new Yocto docs website.

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>

* Update installing-openvino-yocto.md

* installing-openvino-yocto: add step to checkout specific branch

Request users to checkout specific branch of meta-intel where this
version of OpenVINO is available.

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

Co-authored-by: Anuj Mittal <anuj.mittal@intel.com>
Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2022-02-22 13:33:44 +03:00
Ivan Novoselov
6500ec775d [Snippets] Check for cyclic dependencies during ternary merge. (#10374) 2022-02-22 13:30:15 +03:00
Alexey Varyzgin
a3887f3328 [CPU] Transpose node optimized with Reorder (#10551) 2022-02-22 13:05:19 +03:00
Irina Efode
b7ead46943 [IE TESTS] Functional tests Review. Part 2 (#10476)
* [IE TESTS] Functional tests Review. Part 2

* tmp

* revert set_blob changes
2022-02-22 13:02:05 +03:00
Irina Efode
d57fb75ba6 migration to OV2.0 (#10562) 2022-02-22 12:58:07 +03:00
Mikhail Letavin
171ad9536f [GPU] Disable unrolling by default for LSTMsequence and TensorIterator having length>=16 (#10406) 2022-02-22 12:45:32 +03:00
Egor Duplensky
3f56438d06 [CPU] Align return types handling for all the new API parameters (#10363) 2022-02-22 12:42:24 +03:00
Ivan Tikhonov
472ebc0cd9 [TF FE] Add translators for ScatterND, Conv3DBackpropInputV2 ops (#10550)
* Add translators for ScatterND, ConvBackpropInputV2 ops

* add a new line
2022-02-22 12:20:32 +03:00
Maxim Shevtsov
5247fdfcaf avoiding layouts (#10560) 2022-02-22 12:15:19 +03:00
Nikolay Tyukaev
100fff83bf dynamic title tag (#10575)
* dynamic title tag

* dynamic title tag
2022-02-22 12:05:55 +03:00
Evgenya Stepyreva
4afd8667cf DO detachment (#10577) 2022-02-22 12:05:18 +03:00
Egor Duplensky
4075f8ed51 [CPU] Fix ScaleShift and FQ merge optimization (#9244) 2022-02-22 11:38:02 +03:00
Taylor Yeonbok Lee
746b77c74a [GPU] Revised unique ID setting scheme. (#10548)
* Revised unique ID setting scheme. Previously it was using program id to distinguish the loop body networks' id.
However, it results in cl cache miss for same network loaded multiple time, because program ids are differnt.
Now revised it to use parent primitive id instead of program_id for unique id of nodes in body networks.

* Revised adding unique_id to entry points to have a temporal number as unique id

* Revert the canceld change

* Added test to check whether two networks loaded from same function creates same cl cache
2022-02-22 09:34:46 +03:00
Liubov Talamanova
1891967ad3 [POT] Add quantization templates to wheel (#10557) 2022-02-22 09:11:43 +03:00
Andrew Kwangwoong Park
33062bef7a [GPU] Fix permute performance degradation (#10559)
* [GPU] Fix permute performance degradation

Signed-off-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>

* add description for update

Signed-off-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>
2022-02-22 11:35:04 +09:00
Andrey Zaytsev
aea0532d76 Fixed POT docs (#10574) 2022-02-22 02:15:58 +03:00
Edward Shogulin
5be402750a [LPT] FuseConvert transformation extension (#10558)
* [LPT] FuseConvert transformation extension

* [LPT] Tests

* [LPT] Cleanup & tests refactoring
2022-02-22 02:02:11 +03:00
Mikhail Letavin
d7ad1bd9cd [GPU] Extra graph transformation passes in case of Dynamic Batch for correct optimization behavior (#10561) 2022-02-22 00:40:26 +03:00
Maxim Gordeev
e7145bd343 [IE Samples] Changed input's tensor preprocessing for speech sample (#10552)
* Changed input's tensor preprocessing

* improved processing
2022-02-21 23:29:38 +03:00
Ilya Lavrenov
d26fd3aa22 Ability to fully override OUTPUT_DIR (#10524) 2022-02-21 22:39:26 +03:00
Mikhail Nosov
f82533005b [OV2.0] Preprocessing documentation (#10451)
* [OV2.0] Preprocessing documentation - first draft

* Small update

* Added ov::Layout overview

* Fix code style

* Preprocessing details - ~50% done

* Corrected links

* Fixed comments, added more docs

* Minor updates

* Couple more links

* Fixed comments

* Remove 'future' link
2022-02-21 19:20:23 +03:00
Nikolay Tyukaev
65d1575642 DOCS: ovms integration (#10528)
* ignore model server pages

* merge

* fixed link to ovms docs

* workbench fix

Co-authored-by: azaytsev <andrey.zaytsev@intel.com>
2022-02-21 18:48:29 +03:00
Vladislav Volkov
1d33c37970 [CPU] Issue in opset name determining (#10479) 2022-02-21 18:47:24 +03:00
Egor Duplensky
b7fede89c8 [CPU] Fix uninitialized reorder implementation type (valgrind, asan) (#10520) 2022-02-21 18:26:20 +03:00
Mateusz Tabaka
6bb8701651 Add MatMulConstTransposesExtraction transformation (#10412)
Transformation insert Transpose for MatMul's weights and
sets its transpose_b attribute to true.
If executed by MO, it helps to reduce LoadNetwork time on CPU plugin,
since ConvertMatMulToFC doesn't have to insert Transpose by itself.

Ticket: 78635
2022-02-21 16:08:28 +01:00
Fedor Zharinov
4decf16927 Set Latency performance mode in case of sync mode. (#10516) 2022-02-21 18:08:05 +03:00
Yuan Hu
09379dca86 [AUTOPLUGIN] add device priority if set ov::device::priorities (#10296)
* support config key device priority

for example:
if AUTO:CPU,GPU
the priority of CPU will be higher than GPU

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add test and fix compile and test error

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add an info for device priority and add lost [AUTOPLUGIN] on log

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* parseMetaDevice return all DEVICE of GPU, when use AUTO:GPU

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix compile issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* modify test and add test case, fix code issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix a bug and mutli with HETERO test failed

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix mock test faild issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix misprint

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* Disable AUTO:MYRIAD case

MYRIAD/CoreThreadingTests.smoke_QueryNetwork/targetDevice=MULTI_config=MULTI_DEVICE_PRIORITIES:MYRIAD_
faild on windows
the error is
myriadFuncTests-0 INFO: [E:] [BSL] found 0 ioexpander device

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* use ov::device::priorities key in this PR

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix a logic bug in key_network_priority after enable device priority

add test case cover it

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2022-02-21 23:06:51 +08:00
Irina Efode
ae42bf1e86 [IE TESTS] Functional test review. Part1 (#10328)
* [IE TESTS] Move Preprocess&Chacing tests to plugin. Add Cachinf tests for OV2.0

* Conformance

* Fix

* Apply Ilya's comments

* Update caching_tests.cpp

* Fixes

* Update mkldnn_plugin.cpp

* try to skip

* try to fix

* Fix cpu

* tmp
2022-02-21 16:22:01 +03:00
Gorokhov Dmitriy
f53f09f020 [CPU] Fixed legacy post ops behavior (#10542) 2022-02-21 16:09:29 +03:00
Ilya Lavrenov
68e873c6c8 Config and hetero (#10555)
* Updated properties documentation

* Fixed doc refernce

* merged snipet files

* fixed build

* Updated Hetero docs

* Self-review

Co-authored-by: Anton Pankratv <anton.pankratov@intel.com>
2022-02-21 16:01:47 +03:00
Alexey Lebedev
0ce255e56a [tools][benchmark_app] update readme (#10518)
* Save work

* update readme

* Name refactoring

* Remove duplicated readme

* Add note about default hint
2022-02-21 15:35:07 +03:00
Maksim Derbasov
11bf540018 Simple patch for fix random bool vector generation (#10493)
* Dirty patch for fix bool generation

* Bernoulli distribution for bool
2022-02-21 14:24:27 +03:00
Mikhail Ryzhov
5dbf2f7088 [GNA] Compact mode ordering fix (#10408)
* Compact mode ordering fix

* Fixed comment
2022-02-21 14:05:36 +03:00
Jan Iwaszkiewicz
206442fb19 [PYTHON] Add OV Types support to parameter and constant from opsets (#10489)
* Add OV Types to parameter and constant node factory, refactor tests and error handling

* Fix name mismatch in docstring

* Fix docs and hints
2022-02-21 12:45:55 +03:00
Yuan Xu
828d9d810a updating apt, yum, conda installation for 22/1 (#10219)
* Add Overview page

* update yum installation

* update apt installation

* update conda installation

* Revert "Add Overview page"

* Update docs/install_guides/installing-openvino-apt.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* update Ubuntu version format

* update as per review comments

* integrate comments

* update version format

* add a configurations chapter

* update

* Update docs/install_guides/installing-openvino-yum.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/install_guides/installing-openvino-conda.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/install_guides/installing-openvino-yum.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/install_guides/installing-openvino-yum.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/install_guides/installing-openvino-yum.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/install_guides/installing-openvino-apt.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/install_guides/installing-openvino-yum.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/install_guides/installing-openvino-yum.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* update comments

* Update docs/install_guides/installing-openvino-apt.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/install_guides/installing-openvino-yum.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/install_guides/installing-openvino-yum.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* update references to OpenVINO Runtime User Guide

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
2022-02-21 12:15:15 +03:00
Yuan Xu
cd77b33f3a docker installation updates for 22/1 (#10341)
* Add Overview page

* Revert "Add Overview page"

* update

* update install flows

* update

* Update docs/install_guides/installing-openvino-docker-linux.md

Co-authored-by: Ilya Naumov <ilya.naumov@intel.com>

* Update docs/install_guides/installing-openvino-docker-linux.md

Co-authored-by: Ilya Naumov <ilya.naumov@intel.com>

* update structure

* small changes

* improve structure

* Update docs/install_guides/installing-openvino-docker-linux.md

Co-authored-by: Ilya Naumov <ilya.naumov@intel.com>

* integrate comments

* remove outdated note

* Update docs/install_guides/installing-openvino-docker-windows.md

Co-authored-by: Ilya Naumov <ilya.naumov@intel.com>

* Update installing-openvino-docker-windows.md

* Update docs/install_guides/installing-openvino-docker-linux.md

Co-authored-by: Ilya Naumov <ilya.naumov@intel.com>

* Update docs/install_guides/installing-openvino-docker-linux.md

Co-authored-by: Ilya Naumov <ilya.naumov@intel.com>

* Update docs/install_guides/installing-openvino-docker-linux.md

Co-authored-by: Ilya Naumov <ilya.naumov@intel.com>

* integrate comments

* adding an issue: Permission Errors for `/dev/shm`

* Update docs/install_guides/troubleshooting.md

Co-authored-by: Ilya Naumov <ilya.naumov@intel.com>

* update comments

* fix mistake

* fix mistake

* fix a link

Co-authored-by: Ilya Naumov <ilya.naumov@intel.com>
2022-02-21 12:11:08 +03:00
Mateusz Tabaka
430e898c33 Add bf16, f64, i4, u4, i16, u16 types to Equal's evaluate (#10508)
* Add f64 type to Equal's evaluate

Required by t2t-vit models.

Ticket: 79610.

* add also i16 u16 because prior_box tests fail with "Check eval_status failed at"

* code style

* add i4, u4, bf16 to equal's evaluate
2022-02-21 11:37:17 +03:00
Maxim Andronov
1fa5d44769 [CPU] WA for MergeTransposeAndReorder after conv + sum (#10466) 2022-02-21 11:30:24 +03:00
Ivan Tikhonov
33ab7f9063 remove redundant node_context.hpp files, fix handling nodes with several output ports (#10484) 2022-02-21 10:27:11 +03:00
Maxim Andronov
31f517a3b4 [CPU] Fix error message for shape infer (#10522) 2022-02-21 10:16:29 +03:00
Ivan Tikhonov
e5d6f18366 [TF FE] Fix BatchToSpace op translator (#10511)
* use shape value, not rank in batch_to_space conversion

* codestyle

* resolve review comment
2022-02-21 10:14:08 +03:00
Tingqian Li
2cc6629624 [CPU] Avoid using xmm0 for input to store_emitter (#6566) 2022-02-21 10:02:31 +03:00
Nikita Demashov
f7a85c59fe [LPT] Disable Move Fake Quantize on shuffle channels pattern (#10389)
* added shuffle channels check

* refactoring
2022-02-21 10:01:37 +03:00
Ivan Tikhonov
e89c7ed8e5 Describe MakeStateful transformation in MO help (#10536)
* Update --transform help for MakeStateful transformation

* add quotes
2022-02-21 09:55:26 +03:00
Taylor Yeonbok Lee
73a6d50dbc [GPU] Fixed batch size again to 8 as a workaround of compiler restriction. (#10502) 2022-02-21 09:42:08 +03:00
Roman Lyamin
0ee6959537 [GPU] Replacing get_shape() with get_partial_shape() (#10525) 2022-02-21 09:41:24 +03:00
Andrew Kwangwoong Park
a7fff7447c Fix to extract scores for each class in consideration of background label's id (#10500)
Signed-off-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>
2022-02-21 15:35:44 +09:00
Andrei Molotkov
575ded54a9 [GPU] Move adding biases to the end convolution_bfyx_to_bfyx_f16 kernel (#10533) 2022-02-21 09:30:00 +03:00
Xuejun Zhai
ea3bd087c4 [CVS-78727][python version] bug fix for -d AUTO:CPU,GPU the return device should be AUTO only (#10506)
Signed-off-by: xuejun <xuejun.zhai@intel.com>
2022-02-21 03:21:52 +00:00
Ilya Znamenskiy
7c93902dac [GPU] Fix issues with floating point fusings support for cldnn / onednn fully connected kernels (#10519)
* [GPU] Fix of floating point fusings inside fc kernels

* [GPU] Fix for related tests
2022-02-21 12:03:23 +09:00
Maxim Shevtsov
a52c755d21 refactor the perf counters to get really on-demand (rather than on every inference) (#10526)
* refactor the perf counters to get really on-demand (rather than on every inference)

* removed the (now) un-needed needPerfCounters flag
2022-02-20 20:56:15 +03:00
Maxim Vafin
982942fa5d Fix typo in CropAndResize translator (#10541) 2022-02-20 12:39:52 +03:00
Nikita Malinin
a312dd4a9f [POT] IEEngine output data order (#10527)
* IEEngine fix for multiply-output nets

* Update docstrings and docs

* Codestyle changes

* Update docs

* Update docstring

* Pylint
2022-02-20 09:44:04 +03:00
Alexander Kozlov
5c7be85435 [POT] Documentation update (#10068)
* Updated main README

* Added saturation fix desciption

* Changed Low-precision model representation document

* Added Simplified mode desciption. Updated DefaultQuantization, AccuracyAware, API descriptions.

* Added Data-free model description. Adjusted other Readmes accordingly

* Revised Configuration file description

* Revised AA method description

* Changed Quantization readme

* Cross-links in quantization methods

* Fixed reference

* Fixed the structure

* Removed data-free

* Update tools/pot/docs/CLI.md

Co-authored-by: Nikita Malinin <nikita.malinin@intel.com>

* Update tools/pot/openvino/tools/pot/api/README.md

Co-authored-by: Nikita Malinin <nikita.malinin@intel.com>

* Applied comments

* Fixed comments

* Applied more comment

* Applied comments

* Fixed build errors

* Fixed build errors

* Small changes

* Fixed a typo

Co-authored-by: Nikita Malinin <nikita.malinin@intel.com>
2022-02-20 09:43:14 +03:00
Alexey Lebedev
5671ca2cf5 add test (#10531) 2022-02-19 20:19:28 +03:00
Mingyu Kim
af62ff22b1 [GPU] Mixed precision fix for mask rcnn (#10467) (#10535)
* Select proper layout for fp16-int8 mixed precision network
* Set proper layout in layout propagation for mixed precision
2022-02-19 21:55:15 +09:00
Alexey Lebedev
661002689f latency mode is default for sync (#10521) 2022-02-19 05:58:51 +03:00
Maxim Vafin
71fdcdf899 Fix Unpack translator in TF FE (#10494)
* Fix Unpack translator in TF FE

* Apply review feedback
2022-02-19 02:52:48 +03:00
Anastasia Popova
2e164b4ddc AvgPool3D translator, fix of MaxPool translator in TF FE (#10530)
* Fixed MaxPool translator, added AvgPool3D translator.

* Update src/frontends/tensorflow/src/op/avg_pool.cpp

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

* Code style.

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2022-02-19 02:47:01 +03:00
Pavel Esir
fb6359586d fix ConvertGroupedStridedSlice.py for XLNet (#10496) 2022-02-18 22:40:28 +03:00
Ilya Lavrenov
6b22d0d109 Revert "repair TF FE tests after build (#10432)" (#10523)
This reverts commit 306b7611d9.
2022-02-18 19:48:35 +03:00
Yuan Xu
c9bfd3bf8b Updating installation guide structure for 22/1 (#10343)
* Add Overview page

* update overview

* update install dev tools page

* Revert "Add Overview page"

* create overview page

* update movidius setup guide

* split the configurations for linux part to a separate topi

* split the general configurations for linux to a separate topic

* create a separate topic for configurations for vpu on windows

* create a separate topic on configurating gpu

* create a separate topic for configurations for ncs2

* update structure

* update structure

* update structure

* restructure

* update overview

* update

* update according to comments

* update structure

* update the structure

* correct naming

* correct naming

* update trademark symbol

* remove .bak file

* update

* test formatting

* update

* update

* fix errors

* add a leading sentence for GPU configurations

* update structure

* delete redundant files

* Update docs/install_guides/configurations-for-intel-gpu.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Update docs/install_guides/configurations-for-ncs2.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Update docs/install_guides/installing-openvino-config-ivad-vpu.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* fix formatting

* fix errors

* fix errors

* fix errors

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>
2022-02-18 19:47:00 +03:00
Svetlana Dolinina
d2177cf177 remove old protobuf eggs (#10473) 2022-02-18 18:12:23 +03:00
Gleb Kazantaev
b22585a696 Fix Coverity issue (#10510) 2022-02-18 18:00:40 +03:00
Alina Kladieva
7985c92095 Revert "[GPU] Mixed precision fix for mask rcnn (#10467)" (#10515)
This reverts commit 10ac5b280b.
2022-02-18 16:38:49 +03:00
Anton Voronov
d9b1f10074 [CPU] [OneDNN] disabled unused amx primitives and conv primitives (#10326) 2022-02-18 16:36:49 +03:00
Katarzyna Mitrus
f52f129ed8 [Python API] Improvement of dynamic reshape error message in compatibility ie (#10495)
* Add test_reshape_dynamic to tests compatibility

* Catch OverflowError on dynamic dimension reshape
2022-02-18 14:23:10 +03:00
Zhang Yi
ba9d18f181 [CPU] Parallel copy for output in case data doesn't fit L2 cache capacity (#10340) 2022-02-18 13:16:51 +03:00
Ilya Churaev
a18c8076cc Removed obsolete documentation (#10504)
* Removed obsolete documentation

* Fixed documentation

* Additional fix
2022-02-18 13:02:55 +03:00
Ekaterina Aidova
e8ff31f4fb [OMZ]: update submodule (#10490) 2022-02-18 12:58:38 +03:00
Roman Kazantsev
20266dd0c3 [MO] Upgrade TensorFlow version dependency due to SNYK hits (#10487)
* [MO] Upgrade TensorFlow version dependency due to SNYK hits

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Still use 2.5.0 TensorFlow for Python 3.6 and older

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2022-02-18 12:29:58 +03:00
Anton Voronov
7a82bb2acb [CPU] fixed including <cpuid.h> on android (#10482) 2022-02-18 11:50:38 +03:00
Andrey Somsikov
dea35b8e6e Upgrade protobuf to 3.18.2 (#10435)
* Upgrade protobuf to 3.19.4

* Upgdate precompiled protoc version

* Update protobuf to v3.18.2

Updating further peding this fix to be released
https://github.com/protocolbuffers/protobuf/pull/9437

* Disable warnings for protobuf
2022-02-18 11:43:19 +03:00
Nikita Semaev
03862e780f Fixing SetUp for SLT tests of ShapeOF (#10323)
* Fixing SetUp for SLT tests of ShapeOF

* Attempting to pass outputPrecision into the test

* Correcting deficiencies, taking into account in the name of the test of the output precision
2022-02-18 10:37:39 +03:00
Jacek Skowron
3a89c87f52 [DOCS] update install guides gifs (#10444) 2022-02-18 10:31:42 +03:00
Maxim Shevtsov
dcd6e3e961 removed unsed var and fixed mixup from code shuffling (#10492) 2022-02-18 10:05:23 +03:00
Xuejun Zhai
2ac15eae3d [CVS-78727] bug fix for -d AUTO:CPU,GPU the return device should be AUTO only (#10417)
Signed-off-by: xuejun <xuejun.zhai@intel.com>
2022-02-18 09:56:56 +03:00
Edward Shogulin
17311c46b3 [LPT] checkElementwise extending for 1D tensor (#10498) 2022-02-18 09:41:17 +03:00
Anton Romanov
b8ac041da9 Fixed coverity issues in samples (#10421)
* Fixed coverity issues

* Fixed coverity isuues samples part 2

* Fixed code style

* Delete goto

* update after comments
2022-02-18 08:08:09 +03:00
Vitaliy Urusovskij
76ade7a7d0 Update docstrings with information about static build (#10488) 2022-02-18 07:48:58 +03:00
Xuejun Zhai
9b36daf23b Modify for CVS-69023(python version): hint configuration (#10312)
Signed-off-by: xuejun <xuejun.zhai@intel.com>
2022-02-18 09:40:27 +08:00
guozhong wang
2d88e67616 Guozhong/remove format time (#9923)
* remove formatTimeMilli from time_utils.cpp

* add traceCallStacks test case

* add traceCallStacks test case in format_test.cpp

* add param:"test" to function TraceCallStacks()

* rollback file in master branch

* add traceCallStacks test case in format_test.cpp

* remove formatTimeMilli from time_utils.cpp and add traceCallStacks test case in format_test.cpp
2022-02-18 09:36:01 +08:00
Mingyu Kim
10ac5b280b [GPU] Mixed precision fix for mask rcnn (#10467)
* Select proper layout for fp16-int8 mixed precision network
* Set proper layout in layout propagation for mixed precision
2022-02-18 10:27:54 +09:00
hyunback kim
215db2dad8 [GPU] Enable shuffle and fsv32 in implicit concat (#9888)
[GPU] Enable shuffle and fsv32 in implicit concat

* Support shuffle fsv32
* Check feature depths in first input depedency.
* Add to select onednn convolution in case block format in get_preferred_impl_type func.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-02-18 09:40:14 +09:00
Vladislav Volkov
b6a75d7d91 CPU plugin namespaces and files renaming (#10248) 2022-02-17 23:48:26 +03:00
Nikolay Tyukaev
7fa9d07a1f ignore api/reference.rst warnings (#10491) 2022-02-17 23:13:09 +03:00
Maxim Vafin
f482f9765e Fix values reading from protobuf (#10391)
* Fix values reading from protobuf

* Remove exception

* Small fix
2022-02-17 21:42:49 +03:00
Maxim Vafin
ac880f601c Fix getting attribute in TF FE (#10458)
* if attribute is not present and default value provided it should return default value
2022-02-17 20:30:04 +03:00
Anton Grishin
b8bbe056b1 Improve l-capturing (#10468) 2022-02-17 19:17:07 +03:00
Artur Kulikowski
73caba0f67 Fix ONNX boolean tests (#10404) 2022-02-17 15:31:11 +00:00
Nikita Malinin
a090abbc92 Update remove_converts pass with shape inference (#10474) 2022-02-17 18:17:07 +03:00
Yegor Kruglov
6e5eb87340 Add note to YOLO-v3 conversion instructions (#10428)
* added note to yolo v3 conversion instructions

* fix typo

* Update docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_YOLO_From_Tensorflow.md

style fix

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
2022-02-17 18:00:38 +03:00
Ivan Tikhonov
ade4c6c7f9 OpExtension: fix framework attributes handling (#10445)
* Fix attribute handling in OpExtension, add unit tests

* add missed file

* fix warning

* fix warning

* rename convert_from_py_object method to py_object_to_any, fix PEP8

* fix PEP8

* delete redundant include dir, fix includes
2022-02-17 17:42:12 +03:00
Anton Pankratov
61f657795c Streams property with special values (#10411)
* Streams  property with special values

* Fixed clang
2022-02-17 16:39:06 +03:00
Fedor Zharinov
198f44fdc7 Fix for missing throughput in case of Multi device (#10407)
* Fix for missing throughput in case of Multi device

* stylefix
2022-02-17 16:32:19 +03:00
Ilya Lavrenov
306b7611d9 repair TF FE tests after build (#10432)
* repair TF FE tests after build

* Small improvements

* Fixed static build
2022-02-17 16:28:24 +03:00
Maxim Gordeev
3144c5fab8 Added processing of layout for speech sample (#10254)
* Added processing of layout for speech sample

* fixed notes

* some improvements

* Code style format

* changed NCC value for NullStatement

* improved batch processing

* added loading batch for imported model

* fixed notes

* fixed notes

* added layout parameter to azure tests
2022-02-17 16:11:57 +03:00
Irina Efode
ccd7104108 [IE TESTS][CONFORMANCE] Add support of dynamic shapes in SubgraphDumper (#10380)
* Initial commit. Need to remove debug code

* Remove extra flags. Fix comparation in the matchers

* Fix small issue with the default args

* Update eltwise.hpp

* Update ov_subgraph.cpp
2022-02-17 15:52:37 +03:00
Nikolay Tyukaev
fc1157cf68 add api folder if enable python (#10477) 2022-02-17 15:24:29 +03:00
Egor Shulman
8ae4bc95fd [CPU] Coverity fixes (#10392) 2022-02-17 15:11:18 +03:00
Anton Pankratov
0882f863d6 Any compilation time optimization (#10335)
* Optimized any compilation time

* Fixed Any  compilation time

* any::addressof

* reverted

* Fixed read write

* format fix

* Fixed build

* format fix

* Moved any tests back

* removed inline

* fix format

* used static inline

* format fix

* removed inline static

* fixed merge confkicts
2022-02-17 14:55:37 +03:00
Anton Pankratov
7ce9801ec3 Added mkldnn ov properties test for compile_model (#10442)
* Added mkldnn ov properties test

* fixed  macos build
2022-02-17 13:54:02 +03:00
Anton Pankratov
d1378d94b8 Fixed default inference precision in benchmark app (#10443) 2022-02-17 13:53:50 +03:00
Vladislav Golubev
ff4e97ab09 [LPT] Security fixes (#10465) 2022-02-17 13:47:27 +03:00
Anton Chetverikov
e444715c8d [MO] Restore inputs order in IR Reader (#10403)
* Restore inputs order in IR Reader

* Add saving of outputs order
2022-02-17 13:07:34 +03:00
Tomasz Dołbniak
83a8ac800c ONNX model validator enhancements (#10456) 2022-02-17 11:01:47 +01:00
Anton Voronov
61f915b4f6 [CPU] changed checks with_cpu_x86...() to mayiuse() (#9911) 2022-02-17 12:56:55 +03:00
Pavel Esir
43784e2cec fix convert_nms_gather_path_to_unsigned: added opset8::Slice into patter_list (#10439) 2022-02-17 12:47:25 +03:00
Aleksandr Korolev
8abb949af9 [VPU] Coverity fixes (#10396)
Tickets:
-79244
-78866
2022-02-17 12:29:28 +03:00
Aleksandr Korolev
5ace7bb96f [MYX] Added missing supported properties in GetMetric method (#10440) 2022-02-17 12:23:41 +03:00
Anton Pankratov
a7b28953e2 Added Import export device capability into hetero plugin (#10455) 2022-02-17 12:15:45 +03:00
hyunback kim
8148921fa7 [GPU] Fix deconv b32 onednn regression in onednn (#10462)
After enabling deconv b32 onednn, colorization-siggraph f16 b32 has regresison,
Fix it. Add to check sum post ops in case deconv onednn.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-02-17 18:09:51 +09:00
Irina Efode
68f523010e [IE TESTS][CONFORMANCE] Support dynamic shapes in Operation Conformance (#10400)
* emove namespeca unity

* [IE TESTS][IE CONFORMANCE] Suppot dynamic shapes in Operation Conformance runner

* Update CMakeLists.txt

* Fix dim generation
2022-02-17 11:27:45 +03:00
hyunback kim
ed323afc93 [GPU] Remove default bfyx quantize in get_preferred_format (#9654)
* [GPU] Remove default bfyx quantize in get_preferred_format

Default bfyx occurs redundant reorder in fsv-format network.
And remove onednn concat limitation for depdendency input should be
onednn impl.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-02-17 17:25:55 +09:00
Taylor Yeonbok Lee
d35335193a [GPU] Adjust build batch size to 9 from 10 due to the compiler limitation w.r.t the entire module size (#10450) 2022-02-17 11:01:31 +03:00
Anastasia Kuporosova
861d43e06d [Python API] Fix benchmark hanging (#10457) 2022-02-17 10:59:55 +03:00
Liubov Talamanova
be6a3c34f1 [POT] Throw exception for IRv10 (#10345)
* [POT] Throw exception for IRv10

* Update reference models

* Updated AC framework name from dldt to openvino
2022-02-17 10:54:08 +03:00
Vladimir Dudnik
29883a152a fix 79520 (#10449) 2022-02-17 10:52:30 +03:00
Egor Shulman
ff293f5560 [CPU] Disable display of constant layers in PerfMap (#10307) 2022-02-17 10:51:07 +03:00
Egor Duplensky
541627d319 [CPU] [SANITIZER] Avoid possible stack-use-after-scope (#10377) 2022-02-17 10:27:58 +03:00
Ivan Tikhonov
3597ae61f9 Fix increased build time and memory consumption caused by multiple ov::Any instantiation (#10452)
* Fix increased build time and memory consumption caused by multiple instansion of ov::Any.

* delete unused method, correct exception message

* codestyle

* Resolve review comment

* fix exception: throw it in else branch
2022-02-17 09:08:55 +03:00
Gleb Kazantaev
926460e603 Fix Coverity issues (#10427) 2022-02-17 08:54:57 +03:00
Mateusz Tabaka
ab4a11b3bd Remove unnecessary AutoBroadcastSpec parameter in MatMulMultiplyFusion (#10005) 2022-02-17 08:51:32 +03:00
Julia Kamelina
1fc61299c8 update omz submodule (#10441) 2022-02-17 00:50:21 +03:00
Tomasz Dołbniak
90a100d5f6 Default opset bump in ONNX FE (#10437) 2022-02-17 00:47:07 +03:00
Fedor Zharinov
00abcbacc4 Fix for Layout and image_info related issues (#10258)
* bugfix78627

* stylefix

* fix
2022-02-17 00:42:51 +03:00
Maxim Vafin
5cadee20eb Fix issue with constants having inputs in TF FE (#10393) 2022-02-16 20:40:23 +03:00
Andrey Zaytsev
abeb910ce2 Removing the old Intel logo from docs (#10429)
* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Updated the link to software license agreements

* Revert "Updated the link to software license agreements"

This reverts commit 706dac500e.

* Removed the Intel logo

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
2022-02-16 17:26:26 +03:00
Yuan Xu
4f000b780d update pypi installation (#10217)
* Add Overview page

* update pypi installation

* Revert "Add Overview page"

* integrate review comments

* update formatting

* Update docs/install_guides/installing-openvino-pip.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/install_guides/installing-openvino-pip.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/install_guides/installing-openvino-pip.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

Co-authored-by: Adrian Boguszewski <adekboguszewski@gmail.com>
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
2022-02-16 17:09:56 +03:00
Egor Shulman
5bf9631073 Fixed ProfilingInfo layer status (#10342) 2022-02-16 16:10:19 +03:00
Anton Grishin
05650551b7 [GNA] Fix static analyzer issues (#10379)
* fix incorrect braces

* move pointer check

* add pointer check to VerifyConcat

* Prevent iterator invalidation
2022-02-16 15:46:32 +03:00
Ilya Churaev
434d7bbecc Fixed 4458 warning for Windows (#10418) 2022-02-16 11:39:43 +00:00
Anton Pankratov
5b8b698f88 Fixed ICore GetSupportedProperties (#10394)
* Added ICore::get_property

* Added tests

* Format fix

* All properties
2022-02-16 14:36:01 +03:00
Andrey Noskov
7a24f53b57 [GNA] Moved am_intel_dnn tests (#10294)
* [GNA] am_intel_dnn tests moved from deprecated tests

* fixed code style

* [GNA]fixed copyright date
2022-02-16 14:21:12 +03:00
Andrey Noskov
e2948a807c [GNA] Moved cpp_wrapper test (#10297)
* [GNA] Moved cpp_wrapper test

* [GNA] fixed copyright data
2022-02-16 14:19:29 +03:00
Nadezhda Ageeva
fc5a416423 [SAMPLES][GNA] Update C++ speech sample with new config API (#10357)
* [SAMPLES][GNA] Update speech sample with new cofig API

* Review comments

* Some additional checks
2022-02-16 13:23:50 +03:00
Alexander Zhogov
2e71fccd82 Azure CI: Disable tests on Mac due to long building 2022-02-16 13:12:06 +03:00
Anton Dudchenko
483b3828ca [VPU] Enable CheckTensorPrecision tests (#10390)
Enable CheckTensorPrecision tests for the myriad plugin.
-75944
2022-02-16 13:06:13 +03:00
Artyom Anokhov
ba69bae055 [Scripts] Remove MacOS install dependencies (#10397)
* OpenVINO scripts: Removed legacy install install_guide.html. Removed installation of scripts for MacOS

* scripts/CMakeLists: optimized if case
2022-02-16 12:52:57 +03:00
Chen Xu
4d954d0c13 [CPU] Fix the unnecessary calculation of blk_stride for dynamic shape (#10385) 2022-02-16 12:20:01 +03:00
Andrew Kwangwoong Park
2a1d8d7e99 [GPU] Minor fix for dump layer (#10291)
- Replace find with compare func to avoid dumping all layers that contain layer name

Signed-off-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>
2022-02-16 12:02:28 +03:00
Nikolay Tyukaev
0c4d50239a update requirements to fix tabs (#10409) 2022-02-16 11:47:11 +03:00
Gleb Kazantaev
709084888a Remove deprecated classes from openvino headers (#10371)
* Remove deprecated classes from openvino headers

* Fix tests
2022-02-16 11:41:16 +03:00
Ilya Churaev
0b27fb80b1 Fix for new coverity issues (#10378)
* Fix for new coverity issues

* Fixed cc coverity

* Fixed code style

* Revert some changes

* Fixed build
2022-02-16 11:12:24 +03:00
Nikita Malinin
c8ce93290e [POT] Sync mode only for gna_sample (#10355)
* Sync mode only for gna_sample

* Disable test
2022-02-16 11:00:13 +03:00
Vladimir Zinoviev
e22a2b3076 [CommonTransformations] Fix default output take from Split/VariadicSplit (#10395) 2022-02-16 10:59:11 +03:00
Mateusz Bencer
0a056857c5 fix handling stride_y (#10398) 2022-02-16 07:57:56 +00:00
Mingyu Kim
c0d54e48bb [GPU] Bugfix for onednn post op optimization (#10416)
When post-op has pattern like below, binary_mul was ignored previously.
1. binary_add
2. eltwise_linear
3. binary_mul
4. binary_add

It happens when prev_post_op_idx == 2, cur_post_op_idx == 4.
prev_post_op_idx was supposed to proceed to idx 3, but it did not.
2022-02-16 10:44:42 +03:00
Vladislav Golubev
fa4246d531 [LPT] Security fixes (#10381) 2022-02-16 10:31:17 +03:00
Taylor Yeonbok Lee
cbb5dff9c1 Fix coverity errors (#10384) 2022-02-16 10:10:10 +03:00
Ivan Tikhonov
06eb74b77f Fix MakeStateful transformation: use tensor names instead of friendly names (#8997)
* Use tensor names instead of friendly names, handle one output tensor to several Result ops case

* fix python tests

* fix python test

* fix incorrect merge

* remove redundant files

* fix variable names generation, fix python test

* Apply review comments

* fix python test
2022-02-16 09:26:31 +03:00
Jan Iwaszkiewicz
e71f23fc7e [PYTHON] Add __repr__ to main objects (#10365) 2022-02-15 21:30:33 +00:00
Evgenya Stepyreva
d14f1e54a5 MatMul Shape Inference (#10348)
* Proper dynamic dimension broadcasting

* make shape infer race condition reproducer

* Use ngraph only

* MatMul shape inference

* Style

* Dynamic rank case covered

* Build fix

Co-authored-by: Maksim Kutakov <maksim.kutakov@intel.com>
2022-02-16 00:22:46 +03:00
Vladimir Dudnik
eda4cbf30e [OMZ] rest of public models with layout (#10293)
* update OMZ submodule, rest of public models with layout

* sync with PR-10150

* ac fixes for WB

* fix CVS-78616
2022-02-15 23:42:41 +03:00
Maxim Shevtsov
317b956d2e fixed possible situation when auto-batching returns zero requests (#10388) 2022-02-15 15:13:25 +00:00
Mikhail Nosov
d5e8e0fb88 Fix coverity findings - add nullptr check before dereferencing (#10375)
Even though it is not possible to hit into this situation using existing plugins - there is theoretical possibility that some plugin may return 'nullptr' as it is allowed.
So this check shall remain in generic part which should not rely on plugin-specific behavior
2022-02-15 18:01:05 +03:00
Maxim Andronov
dc905f972a [CPU] AdaptivePooling child edges number check fix (#10372) 2022-02-15 17:59:51 +03:00
Ivan Novoselov
fa6865d569 [CPU] Disable MatMul+FQ(I8 out) if MatMul cant execute in I8 (#10316) 2022-02-15 17:59:06 +03:00
Maxim Vafin
0793a56260 Fix Conv3D translator in TF FE (#10387) 2022-02-15 17:53:13 +03:00
Mikhail Letavin
f150e2ad09 [GPU] Remove debug suffix from OpenCL.dll on Windows (#10361) 2022-02-15 16:43:40 +03:00
Sergey Lyubimtsev
498d865ea6 Correction for install guides: (#10373)
- OpenVINO installer path for macOS
- Default install pathnon macOS
- Red Hat Enterprise Linux 8.x, 64-bit is not part of IRC installer
2022-02-15 16:22:26 +03:00
Gleb Kazantaev
b837b7e32c Fix Coverity Isues (#10376) 2022-02-15 15:26:04 +03:00
Pavel Esir
121d59aa80 [MO] move importlib-metadata into setup.py (#10319)
* handle 'and' marker in requirements

* Revert "handle 'and' marker in requirements"

This reverts commit 952bb949ca.

* moved importlib-metadata from requirements.txt into setup.py
2022-02-15 15:01:27 +03:00
Indira Salyahova
f1557c06de [POT] Fix inference sample in fbc when get list prediction (#10159)
* fix: inference sample in fbc when get list prediction

* update reference metrics
2022-02-15 14:42:40 +03:00
Wilson Seok
e168c9b1c3 Add slt in template plugin/tensor iterator (#9692)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add initial op reference code of TensorIterator with LSTM body function

* add GRU/RNN case in setup

* add all other test cases

* add visitor api test

* remove unnecessary header files

* fix clang-format issue

* fix copyright year and remove ngraph_helper namespace

* rename ti.cpp to tensor_iterator.cpp in core unit test

* apply suggestions
2022-02-15 13:48:18 +03:00
Ivan Novoselov
68c390f679 [Snippets][CPU] MKLDNNSnippetNode adopts canBeInPlace logics from eltwise node (#10334) 2022-02-15 13:13:35 +03:00
Maksim Kutakov
788a5bb9f2 [CPU] Convolution plus sum fusing in the case of dynamic shapes (#10235) 2022-02-15 13:12:07 +03:00
Anastasia Kazantaeva
ccc38d22a8 Upgrade MO message for 2022.1 (#10315) 2022-02-15 13:10:45 +03:00
Alexander Zhogov
2b8e1ec49a Azure CI: no ARM triggers on docs/* (#10322)
* Azure CI: no triggers on docs/*

* Remove "PR:"
2022-02-15 13:04:44 +03:00
Taylor Yeonbok Lee
f5283300f0 Reduced available host VRAM & phys mem limitation (#10360) 2022-02-15 19:01:05 +09:00
Mateusz Tabaka
a875f6ed9c Add transformation that aligns elementwise input ranks (#10125)
* [CPU] Add transformation that aligns elementwise input ranks

* fix tests - check also aBcd16b format

* add support for fq

* add test for sqr diff

* move to moc transformations

* fix tests

* align only for numpy autobroadcast type

* fix fetching autob from fq

* [CPU] Eltwise tests corrected & callback for CPU removed

* remove transformation callback call

* revert changes to getMKLDNNOutputMemoryFormats

* remove comment

* use single wrap_type

Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
2022-02-15 12:47:54 +03:00
Ilya Znamenskiy
523adff17a [GPU] Fully connected int8 optimizations, some fixes, better fused ops support (#10035) 2022-02-15 12:33:16 +03:00
Andrei Gorbachev
64812fd635 [GPU] disable options in batch compilation (#10311) 2022-02-15 08:50:58 +00:00
Ilya Znamenskiy
0099755434 [GPU] Gemm opt tile_n min size fix (#10369) 2022-02-15 11:48:02 +03:00
Artur Kulikowski
004daca1fa Clear outputs vector after run TestCase (#10279) 2022-02-15 09:41:01 +01:00
wood-ghost
ded2d00711 Add paddle logical and reduce ops support. (#10352) 2022-02-15 16:23:50 +08:00
Anton Pankratov
39c90e9d48 Streams number fix (#10336)
* Streams number fix

* fixed perfomance hint

* fixed format

* removed dbg

* simplified code

* reverted becnhmark_app
2022-02-15 08:04:45 +00:00
Bartek Szmelczynski
2b03d5fe66 [MO args][ONNX FE]fix cutting graph with input, output or both (#9698)
* fix cutting graph with input, output or both

* fix collisions

* add regex

* revert changes to regex, fix decond_name_with_port function

* fix collisions

* optimize try_get_node function

* swap bool with enum

* revert accidental import

* optimize the code

* Update tools/mo/unit_tests/mo/moc_frontend/moc_extractor_test_actual.py

Co-authored-by: Mikhail Nosov <mikhail.nosov@intel.com>

* Update tools/mo/unit_tests/mo/moc_frontend/moc_extractor_test_actual.py

Co-authored-by: Mikhail Nosov <mikhail.nosov@intel.com>

* Update tools/mo/unit_tests/mo/moc_frontend/moc_extractor_test_actual.py

Co-authored-by: Mikhail Nosov <mikhail.nosov@intel.com>

* Update tools/mo/unit_tests/mo/moc_frontend/moc_extractor_test_actual.py

Co-authored-by: Mikhail Nosov <mikhail.nosov@intel.com>

* Update tools/mo/unit_tests/mo/moc_frontend/moc_extractor_test_actual.py

Co-authored-by: Mikhail Nosov <mikhail.nosov@intel.com>

* remove redundant check

* fix wrong nodes returns

* fix decode_with_port_name implementation, add comments

* reduce code duplicates

* remove redundant imports

Co-authored-by: Mikhail Nosov <mikhail.nosov@intel.com>
2022-02-15 10:55:40 +03:00
Vladislav Golubev
d48dd1f26c [Transformaitons] BatchNormDecomposition fix (#10310)
* [Transformaitons] Changed BN decomposition

* matcher updated to cover dynamic shape in opset1 case

* BatchNormDecomposition: added positive test-cases

* removed WA
2022-02-15 10:48:30 +03:00
Alexey Lebedev
e85c473d59 [tools] fix bin processing in benchmark app (#10366)
* fix bin reading

* Remove unsupported type
2022-02-15 10:34:14 +03:00
Indira Salyahova
acf6185bf3 Update load image in sample (#10223) 2022-02-15 10:18:27 +03:00
Mingyu Kim
13c024b7a3 Remove unnecessary cout message (#10346) 2022-02-15 16:14:56 +09:00
Ilya Churaev
8020a7abcc Disabled LTO for frontend_common (#10362) 2022-02-15 06:03:20 +00:00
bell
f75e50cc88 limit gpu compiling threads (#10349)
* limit gpu compiling threads

Signed-off-by: fishbell <bell.song@intel.com>

* switch to 2.0

Signed-off-by: fishbell <bell.song@intel.com>

* clang format

Signed-off-by: fishbell <bell.song@intel.com>
2022-02-15 08:52:49 +03:00
Maxim Andronov
c3c52bae63 [CPU] Convolution caching support (#9954) 2022-02-15 08:47:03 +03:00
Anton Chetverikov
84ee38d89e [MO] Move redundant checks in ScatterUpdate operation shape infer (#10306)
* Add extender for ScatterUpdate operation

* Remove scatterupdate extender

* Remove redundant checks in Scatter shape inference function

* Move checks to ScatterElementsUpdate operations

* mava checks to appropriate place
2022-02-15 04:55:38 +03:00
Jacek Skowron
a0ad849c19 [DOCS] add install guides minor changes (#10317)
* [DOCS] add minor changes to install guides

[DOCS] add minor changes to install guides

[DOCS] add minor changes to install guides

[DOCS] add minor changes to install guides

[DOCS] add minor changes to install guides

[DOCS] add minor changes to install guides

* [DOCS] add minor changes to install guides
2022-02-15 02:43:50 +03:00
Maxim Andronov
1ab9c07ccd [CPU] Skip dynamic tests which executed via legacy API (#10358) 2022-02-15 00:45:50 +03:00
Daniil Lyakhov
2f9c5df271 [Ngraph transformation][Pruning]Matmul ops pruning support (#10211)
* Linear pruning support

* Minor fix

* Fix types

* Fix: stop 1d multiply propagation
2022-02-14 22:00:29 +03:00
Mikhail Nosov
2f876e3b5b Fix ONNX's PriorBoxClustered accuracy (#10091)
* Fix ONNX's PriorBoxClustered accuracy
If step_heights == 0 and step_heights == 0, but 'step' is 16, then we should treat this as both = 16

* Removed workaround for ONNX frontend
2022-02-14 20:55:41 +03:00
Alexey Lebedev
d3712a148b [tools] cross check tool with api 2.0 (#10058)
* save work

* save work

* save work

* basic changes with api 2.0

* Support input file mapping and bin files

* Some impovements

* remove mapping support

* Add -ref_layers parameter

* Fix error handler

* Update Readme and remove old parameters

* Fix readme

* remove info about precision

* rename layer to op

* rename blob to tensor

* remove info about shape

* remove unused imports
2022-02-14 20:25:31 +03:00
Katarzyna Mitrus
0050643e9b Add BroadcastConstRangeReplacement transformation (#10318) 2022-02-14 19:42:51 +03:00
Dmitry Pigasin
3a5d821219 [IE Python Sample] Update docs (#9807)
* update hello_classification readme

* update classification_async readme

* update hello_query_device readme

* Fix hello_classification launch line

* Update hello_reshape_ssd readme

* update speech sample docs

* update ngraph sample docs

* fix launch command

* refactor py ngraph imports

* Replace `network` with `model`

* update example section with openvino-dev

* Update samples/python/classification_sample_async/README.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update samples/python/classification_sample_async/README.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update samples/python/hello_classification/README.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update samples/python/hello_classification/README.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update samples/python/hello_reshape_ssd/README.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update samples/python/ngraph_function_creation_sample/README.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update samples/python/ngraph_function_creation_sample/README.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update samples/python/ngraph_function_creation_sample/README.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update samples/python/ngraph_function_creation_sample/README.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Replace `Inference Engine` with `OpenVINO`

* fix ngraph ref

* Replace `Inference Engine` by `OpenVINO™ Runtime`

* Fix IR mentions

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
2022-02-14 19:03:45 +03:00
Dmitry Pigasin
310eb81403 [IE Samples] Update docs for C++ samples (#9937)
* update hello classification readme

* update hello classification readme

* update classification async readme

* replace `network` with `model`

* update example section with openvino-dev

* update hello query device readme

* Update hello reshape readme

* Update ngraph func creation readme

* update speech sample readme

* update hello nv12 readme

* Apply suggestions from code review

review comments accepted

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Replace `Inference Engine` with `OpenVINO`

* fix model ref

* Replace `Inference Engine` by `OpenVINO™ Runtime`

* Fix IR mentions

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
2022-02-14 19:03:19 +03:00
Egor Duplensky
3fcff15166 [CPU] Fix performance hint property handling (#10351) 2022-02-14 18:42:57 +03:00
Ilya Lavrenov
2d3bd40c3d Removed dead code (#10331) 2022-02-14 17:57:27 +03:00
Katarzyna Mitrus
e1197065fe [Docs] Add Slice-8 op cpp constructors docs (#10320) 2022-02-14 17:46:45 +03:00
Xuejun Zhai
9b41aa707d Modify for CVS-69023: hint configuration (#10259)
Signed-off-by: xuejun <xuejun.zhai@intel.com>
2022-02-14 17:46:11 +03:00
Gleb Kazantaev
a3d5b6501d Fix get_constant_from_source (#10350) 2022-02-14 16:03:12 +03:00
Pavel Esir
d1477b8569 fixed setting 'out_ports_count' in ir_reader (#10265) 2022-02-14 16:01:22 +03:00
Mateusz Tabaka
08eb4766f2 [CPU] Don't change inputs child precision if it has Subgraph consumers (#10238) 2022-02-14 15:54:35 +03:00
Andrey Zaytsev
25bd2c8aee Feature/azaytsev/docs dlsteamer revision (#10155)
* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Updated the link to software license agreements

* Revert "Updated the link to software license agreements"

This reverts commit 706dac500e.

* Revised dlstreamer documentation

* Minor edits

* Fixed link

* Fix

* Edits after review

* Shorten DL Streamer name in the TOC

* Update documentation.md

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
2022-02-14 12:43:52 +00:00
Maxim Andronov
9ac542c455 [CPU] Restore legacy SetBlob and GetBlob to API 1.0 version (#10094) 2022-02-14 15:35:13 +03:00
Daniil Lyakhov
56be1a5438 Change User Transformations applying order in MO (#10241)
* Fix user transformation order in mo

* Move user transformation behind FP16 compression

* Move user transformation call before fp16 compression
2022-02-14 15:06:09 +03:00
Tomasz Dołbniak
a9b6eaf5c0 Multiple ONNX opset imports handling (#10332) 2022-02-14 12:59:41 +01:00
Dmitry Pigasin
9b1e4b801b Add -layout option (#10272) 2022-02-14 14:47:10 +03:00
Nikolay Shchegolev
3cb7592607 [CPU] Gather node. Support case with batchDims == indicesRank. (#10170) 2022-02-14 14:44:10 +03:00
Gorokhov Dmitriy
be4464ca2b [CPU] Migrated legacy post ops mechanism on runtime data pointers (#9938) 2022-02-14 14:17:45 +03:00
Jan Iwaszkiewicz
9e89ee2478 [PYTHON] New Python docs and refactor/improvements (#10032) 2022-02-14 10:24:33 +01:00
Irina Efode
7ff5f5ea70 [IE TESTS][IE CONFORMANCE] Move Read_ir tests to Conformance (#10300) 2022-02-14 12:15:37 +03:00
hyunback kim
c5b26bc10c [GPU] Support deconv double blocked format for b=32 (#10164)
* [GPU] Support batch32 deconv onednn

onednn rls-v2.6-pc2 support deconv batch32,
so remove the batch size limitation.

Signed-off-by: hyunback <hyunback.kim@intel.com>

* Update to merge duplicated checking onednn condidton in deconv.

Signed-off-by: hyunback <hyunback.kim@intel.com>

* Update to use is_node_for_onednn func in get_preferred_impl_type

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-02-14 17:39:26 +09:00
Anastasia Kuporosova
931f4c077d [Python API] Update python test installation (#10283) 2022-02-14 11:24:29 +03:00
Anton Pankratov
be8e15c180 fix HETERO with branching without splits (#10325)
* Default value of streams in ba is AUTO

* Fixed hetero cases with branches

* Fixed format
2022-02-14 10:36:41 +03:00
Roman Lyamin
d13e04a693 [GPU] convolution_kernel_bfyx_1x1_opt fix (#10338) 2022-02-14 10:32:19 +03:00
Maksim Derbasov
bb0d82f724 Fix warnings (#10278) 2022-02-14 07:48:41 +03:00
Mikhail Nosov
d85715f991 Remove dynamism from API 1.0 (#10167)
* Refresh the PR

* Added check for dynamic inputs to LoadNetwork/QueryNetwork

* Fix review comment

* Added 'validation' callback to 'load network from file'

* Fix MockICore

* Added null-pointer check
2022-02-13 20:41:14 +03:00
Ilya Lavrenov
ba19551b13 Fixed typo (#10313) 2022-02-13 16:20:41 +03:00
Anastasia Popova
ac2e639ff8 Added telemetry to modules names list. (#10295) 2022-02-13 10:28:17 +03:00
Ilya Lavrenov
80a901e103 Add TF FE to OpenVINO package (#10314)
* Add TF FE to OpenVINO package

* Add double install for TF FE
2022-02-12 23:42:12 +03:00
Indira Salyahova
ea00eae922 [POT] Fix for measuring input shape when inference model with batch greater 1 in FBC (#10063)
* fix: diffrent batch shape in prediction and target in ac

* add calculate metric in engine True

* resolve conflicts
2022-02-12 19:12:58 +03:00
Nikita Malinin
8e43987cd7 [POT] Update IEEngine for SW API support (#10304)
* Update IEEngine for SW API support

* Change Engine for GNA sample

* Change stacks into reshape
2022-02-12 18:57:35 +03:00
Indira Salyahova
976a20cedf [POT] Update input pattern (#10220)
* Update special_patterns.py

* Update IgnoredPatterns.md
2022-02-12 18:56:41 +03:00
Vladislav Volkov
78281fef74 [CPU] [Ngraph] Fix of memory leak in PassBase::get_name and leak in jit_avx2_1x1_convolution_with_dw_conv_fwd_t kernel (#10199) 2022-02-12 15:48:49 +03:00
Maksim Kutakov
451453c4ce [CPU] Fixes for CpuBlockedMemoryDesc constructor and reorder availability checks (#10299) 2022-02-12 15:29:55 +03:00
Alexander Zhogov
e49370c008 Azure CI: Enable tests on Mac again 2022-02-12 14:22:37 +03:00
Alexander Zhogov
74475e216d Azure CI: Add ccache on Mac (#10290)
* Azure CI: Add ccache on Mac

* Temp OFF

* disable tests
2022-02-12 11:52:07 +03:00
Ivan Tikhonov
9989db5ae0 Rename frontend extension files (#10257)
* Delete _extension suffix in file names; add extension.hpp header to include all extensions

* add extension.hpp file to include all extensions

* codestyle
2022-02-12 09:19:20 +03:00
Maxim Shevtsov
e3cc4833f4 Auto batch smart reshape strict testing (once we moved to dim tracking) (#10253)
* fixed perf-counters

* explicit auto-batching params that should guarantee the auto-batching is triggered ( to avoid fallback to no-batching when the selected batch1 size is just 1)

* makeConvPoolReluNoReshapes and using that whenever applicable to gaurantee the auto-batching is required (not important for things like plugin/executable-network config tests, but important for the inference-requests)

* getDefaultNGraphFunctionForTheDevice moved to the ov_behavior_test_utils.hpp
2022-02-12 02:00:34 +03:00
Pavel Esir
653ed4a34c [MO] use revision hashes to compare IE & MO versions (#10230)
* fixed version comparison: for comparsion extracted hashes are used

* shortened 7 -> 11 to match the current version fromat from nightly

* corrected regex, added comparing by minimal hash len
2022-02-12 00:13:48 +03:00
Anton Pankratov
897e2acd91 Default value of streams in ba is AUTO (#10305) 2022-02-12 00:09:31 +03:00
Roman Lyamin
7b288d125a [GPU] Gather fusion tests fix (#10308) 2022-02-11 20:57:44 +03:00
Aleksandr Korolev
c2a9036482 [VPU] Fix performance hint (#10309) 2022-02-11 19:39:00 +03:00
guozhong wang
14c1e98e8c Guozhong/check format (#10184)
* remove formatTimeMilli from time_utils.cpp

* add traceCallStacks test case

* add traceCallStacks test case in format_test.cpp

* add param:"test" to function TraceCallStacks()

* catch the exception of checkFormat

* add space for try catch

* rollback time_utils.cpp time_utils.hpp and log_utils_format_test.cpp

* modify testcase for log.hpp

* modify testcase from format_s to format_s_d_ld_u_lu2
2022-02-11 19:10:13 +03:00
Yuan Hu
7abd61f867 [AUTOPLUGIN] OV config 2.0 support (#10191)
* add support for LOG_LEVEL and supported_properties

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix compile error

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add test case for log_level and full_name

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* update to ov 2.0

Signed-off-by: fishbell <bell.song@intel.com>

* fix benchmark_app faild for AUTO:GPU, GPU

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add case

Signed-off-by: fishbell <bell.song@intel.com>

* refine logic

Signed-off-by: fishbell <bell.song@intel.com>

* add test cases

Signed-off-by: fishbell <bell.song@intel.com>

* add more cases

Signed-off-by: fishbell <bell.song@intel.com>

* fix redifinition

Signed-off-by: fishbell <bell.song@intel.com>

* cpu plugin only in cpu tests

Signed-off-by: fishbell <bell.song@intel.com>

* typo in parameter

Signed-off-by: fishbell <bell.song@intel.com>

* use _core directly

Signed-off-by: fishbell <bell.song@intel.com>

* fix multi case failure

Signed-off-by: fishbell <bell.song@intel.com>

Co-authored-by: fishbell <bell.song@intel.com>
2022-02-11 23:39:09 +08:00
Ivan Novoselov
cc602ac6fd [Snippets] Convert Load/Store to slarar versions if shape ends with 1 (#10292) 2022-02-11 17:27:32 +03:00
Liubov Talamanova
4d61600077 [POT] Fix cascade model names (#10112) 2022-02-11 15:54:41 +03:00
Victor Kuznetsov
bcd192e882 Revert changes with single-image-super-resolution-1032 - memcheck precommit (#10271) 2022-02-11 20:30:09 +08:00
Anton Pankratov
f36d3303d2 Added callback capturing notes (#10256)
* Added callback capturing notes

* fixed spelling
2022-02-11 14:51:32 +03:00
Sergey Shlyapnikov
03566b4e4d [GPU] Fix outputs blobs allocation for U16/I16 data types (#10180)
* [GPU] Fix outputs blobs allocation for U16/I16 data types

* [GPU] Add U32, U64, FP64 data types support; add information about legacy fused activations to .info file

* Update auto_batch.cpp

fixed u64 inputs for the auto-batching

Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
2022-02-11 14:08:36 +03:00
Nikita Demashov
20d2633af0 removed defaultPrecisions as global variable and added as field in Params class (#9185)
fix canConvolutionBeTransformed arguments

fix isAsymmetricOnWeights in GPU plugin

added defaultPrecisions in TestTransformationParams

set new default attribute precisions

try to set const default precisions in network_helper.cpp

apply precision_set

[LPT] Default precisions

rebase

remove extra const

used defaultPrecision in tests

fixed SimpleLowPrecisionTransformer default argument

fixed AttributeParameters default argument

added defaultPrecisions in functions

fix assign_and_read_value_transformation tests

fixed wrong defaultPrecisions definition

fixed ConcatWithNeighborsWithConvolutionTransformation tests

remove getDefaultPrecisions

rebase

remove getDefaultPrecisions from gpu plugin

remove getDefaultPrecisions from lpt_mkldnn_plugin.cpp

use predefined member

update mkldnn_plugin.cpp & lpt_mkldnn_plugin.cpp

resolved conversations

make all lambda captures by ref
2022-02-11 13:41:03 +03:00
tgubanova-lohika
04c1b9760c [GPU] Implement ExperimentalDetectronTopKROIs operation (#10208) 2022-02-11 13:32:49 +03:00
Vladimir Paramuzov
dc1e9aa9bd [GPU] 6d broadcast support (#10280) 2022-02-11 13:29:09 +03:00
Vladimir Paramuzov
013b5f5b5f [GPU] Added cl batched headers post-processing (#10093) 2022-02-11 13:26:22 +03:00
Nikita Malinin
d758a21d6e Update gna_sample with API 2.0 features (#10236) 2022-02-11 13:23:02 +03:00
Alexey Lebedev
31501a7992 Fix random (#10240) 2022-02-11 13:06:07 +03:00
Mateusz Tabaka
6e1bc49862 Update xfail reason for ssd mobilenet models (#10287) 2022-02-11 10:34:42 +01:00
Nikolay Tyukaev
f03590d245 fix edit on github for pot and ovsa (#10285) 2022-02-11 12:13:12 +03:00
Mikhail Nosov
5535fdefa9 Fix coverity scan issues (#10266)
* Fix coverity scan issues

For virtual 'noexcept' functions everything that can throw exception shall be handled inside function

* Remove 'noexcept'
2022-02-11 10:44:57 +03:00
Tomasz Dołbniak
c186449735 Do not process null nodes in JSON analysis (#10269) 2022-02-11 08:42:25 +01:00
Mang Guo
8bbabf8720 [CPU] Get interpolate scales input during interpolate node init if the input is Constant. (#10229) 2022-02-11 10:27:50 +03:00
Maxim Andronov
cf805b17b9 [CPU] Support legacy dynamic batch via dynamic shapes (#9646) 2022-02-11 10:17:58 +03:00
Min, Byungil
281e38bd83 Use onednn reorder for newly added format (#10273)
+ Added new format to onednn optimized format list

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-02-11 15:58:11 +09:00
Anton Pankratov
1621a5a0b5 Used new config for streams and threads (#10150)
* Used new config for streams and threads

* Fixed review coments in ba

* format fix

* fixed hello_query_device

* Added STL string io

* fixed tests

* Fixed test

* Fixed build

* fixed format

* Fixed build

* try fix win

* other any io specialization

* Fixed after merge

* renamed streams

* build fixed

* fixed build

* fixed format

* fix for old mac build

* Fixed type of exception

* test fix
2022-02-11 09:22:45 +03:00
Nikolay Tyukaev
437bc3280d Feature/ntyukaev/add doxygen snippet sphinx (#10277)
* add doxygensnippet directive

* update MANIFEST.in
2022-02-11 09:19:46 +03:00
Jade Cho
dedcbeafa8 [GPU] Binary post-op support for full tensor. (#9856)
* [GPU] Binary post-op support for full tensor.

* Add unit tests

* Add a reorder if output dtype of conv layer is fp32.
2022-02-11 11:33:31 +09:00
Paul Youngsoo Ahn
fa69ee9596 [GPI] Update kernels to cache.json (#10260) (#10260) 2022-02-11 10:51:37 +09:00
Irina Efode
fd79ca91a1 [IE TESTS] Rename Op_impl_check (#10275) 2022-02-10 21:39:54 +03:00
Maxim Shevtsov
e41e1f51a0 Auto batch smart reshape (relies on the dim tracking) (#9964) 2022-02-10 20:43:06 +03:00
Andrey Somsikov
510e5fb746 Do not publish coverity submission to azure (#10274) 2022-02-10 19:09:36 +03:00
Vladimir Gavrilov
7b1b6f22e5 Added i64 and i32 as admissible element types of input port 0 into op::v4::Interpolate::validate_and_infer_types(). (#10263) 2022-02-10 18:59:38 +03:00
Anton Pankratov
7c455c7f23 Removed ov::Any rvalue cast (#10267) 2022-02-10 18:53:21 +03:00
hyunback kim
efbfd957ff [GPU] Enable disabled network fro oneDNNv2.6-pc2 (#10226)
Some networks newly uses wtags in oneDNN.
Add g_os_is_yx_osa2_isa8_osv8_isv2

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-02-10 18:13:33 +03:00
Anton Chetverikov
50dffb80bb Add missed DeformableConvolution to back transformations (#10255) 2022-02-10 17:20:11 +03:00
Anastasiya Ageeva
87f8ff5918 Reviewed header files for new APIs (#9873)
* Reviewed header files for new APIs

* Update compiled_model.hpp

* Resolved conflicts

* Implemented review comments

* Fixed code style issues

* Fixed code style issues

* Fixed code style issues

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2022-02-10 17:12:18 +03:00
Anton Chetverikov
9af8d9339c [MO] Avoid maskedconstant to array conversion (#10233)
* Avoid maskedconstant to array conversion

* remove redundant input

* Add link to github issue
2022-02-10 16:24:05 +03:00
Sergey Shlyapnikov
bc21e52912 [GPU] Fix FC 3D input size propagation and bias fusion (#10249) 2022-02-10 16:16:12 +03:00
Anton Grishin
d94cff59a3 [GNA] Add PReLu and LeakyReLu activations in tests (#10194)
original commit #9414
2022-02-10 16:15:47 +03:00
Andrey Zaytsev
54f56be077 Feature/azaytsev/docs update openvino readme (#10270)
* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Updated the link to software license agreements

* Revert "Updated the link to software license agreements"

This reverts commit 706dac500e.

* Added POT, replaced IE with OV Runtime

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
2022-02-10 15:44:35 +03:00
Aleksandr Korolev
8b7aeb7f52 [VPU] Coverity fixes (#10090) 2022-02-10 15:31:00 +03:00
Evgenya Stepyreva
9ad09f2120 Shape inference adoption for dimension tracking (#10016)
* Shape inference adoption for dimension tracking

* Style

* test adj

* tests fixed
2022-02-10 15:30:18 +03:00
Anton Voronov
d5c837cc1b [CPU] added some legacy parallel methods to fix perf issues (#9758) 2022-02-10 15:13:05 +03:00
Andrei Molotkov
80be557605 [GPU] Fix Backpropagation issue with BS >= 16 (#10228) 2022-02-10 14:53:27 +03:00
Ilya Lavrenov
ea26ec32b3 Removed runtime namespace (#10231) 2022-02-10 14:53:13 +03:00
Alexey Lebedev
d484411f39 [tools] Fix image_info detection in benchmark app (#10192)
* Fix image_info detection

* exception instead warning in case input data is not compatible with input
2022-02-10 14:32:56 +03:00
Andrew Kwangwoong Park
51c89dff26 [GPU] Fix detection output stage-0 kernel (#10262)
- Change the constant value to the maximum work group size
- Add CLK_GLOBAL_MEM_FENCE barrier to synchronize storing result in intermediate buffer
- Add condition to prevent access local array out of range

Signed-off-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>
2022-02-10 19:43:16 +09:00
Evgenya Stepyreva
89c3a18f83 Fix TensorIterator dynamic rank output (#10247)
* Fix TensorIterator dynamic rank output

* style
2022-02-10 13:03:16 +03:00
Ivan Tikhonov
3f0e532dce Fix the issue in values_from_const method in OVTF integration with TF FE (#10225)
* Fix the issue in values_from_const method in OVTF integration with TF FE

* fix comment
2022-02-10 11:33:42 +03:00
Min, Byungil
334e9e994e Revert WA for onednn first conv (#9783)
+ Reverted WA for fsv32 format first conv
+ Applied blocked input format bsv8fsv4 & bsv8fsv2 for onednn first conv
+ Implemented onednn usage for first conv of feature size 1
+ Added new weight format ABcd16a4b
+ Bugfix in fetch_weight
+ Updated thirdparty onednn_gpu
+ Known issue : AcdB16a4b is not supported

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-02-10 12:12:09 +09:00
Bartek Szmelczynski
36de4e8e28 [Model Enablement] fix default onnx domain (#10106) 2022-02-10 03:16:24 +03:00
Gleb Kazantaev
87c6e09cae Fix Add/MulFQFusion transformations (#10252) 2022-02-10 01:22:16 +03:00
Maxim Andronov
36afedd93d [CPU] Increase executor cache capacity (#10232) 2022-02-09 21:49:37 +03:00
Alexandra Sidorova
fce49e6d80 [Transformations] Added interchangeable reshape elimination (#9691)
* [Transformations] Added interchangeable reshape elimination

* Applied comments #2

* returned Reshape in condition

* applied comments #3

* applied comments #4

* added comment in plugin with reason about transformation
2022-02-09 21:11:49 +03:00
Mikhail Ryzhov
a002b26294 Fixed import for the new api 2.0 (#10175) 2022-02-09 20:51:49 +03:00
Vladislav Golubev
d28f8b7857 [LPT] Security fixes (#10243) 2022-02-09 20:46:39 +03:00
Tomasz Dołbniak
aedd902cd8 Use double quotes in JSON analysis (#10237) 2022-02-09 20:41:49 +03:00
Egor Shulman
840d2fb80d [CPU] Coverity fixes (#10207) 2022-02-09 20:39:50 +03:00
Gorokhov Dmitriy
6ea20340d1 [CPU] Fixed out of bounds read in JIT planar convolution (#7025) 2022-02-09 20:26:57 +03:00
Irina Efode
a37195492c [IE TESTS] Add exception to comparation to provide correct conformance results (#10197)
* [IE TESTS] Add exception to comparation to provide correct conformance results

* Apply comments
2022-02-09 19:15:00 +03:00
Nikolay Tyukaev
e81ca9f975 DOCS: change doc tests (#10213)
* change doc tests

* fixes

* fixes

* fixes

* fixes

* fixes
2022-02-09 18:28:54 +03:00
Maxim Shevtsov
c0a375f844 adding I64/U64 support to the auto-batching (#10234)
* adding I64/U64/etc support

* inputs precisions tests instantiations for the GPU and BATCH:GPU
2022-02-09 18:28:13 +03:00
Mikhail Nosov
f56c640550 SmartReshape: support Param->Convert->Reshape->Proposal pattern (#10204)
Current SmartReshape finds matched to Param->Reshape->Proposal patterns

    For FP16 models, there is additional 'Convert' is inserted after 'Parameter'.

    It causes transformation is not applied and 'ov::set_batch' or CNNNetwork::set_batch will throw

    Proposal1Scales and Proposal4Scales transformations were updated to handle these conditions
2022-02-09 17:44:54 +03:00
Tomasz Dołbniak
a60c110b96 Use i64 for ONNX Split attribute (#10203) 2022-02-09 17:30:00 +03:00
Vitaliy Urusovskij
c186069025 Fix several coverity issues (#10205)
* Update def value for GetParamAsBool() in legacy parseParams()

* Remove extra check from legacy convertFunctionToICNNNetwork()
2022-02-09 15:43:04 +03:00
Chen Xu
c93c9ec3d5 [CPU] Fix bug in topk_bubble_BLK_on_channel_horiz method (#10218) 2022-02-09 14:40:46 +03:00
Victor Kuznetsov
21601398d6 Remove dynamism from time_tests (API 1.0) (#10193) 2022-02-09 19:15:16 +08:00
Vladislav Golubev
051724f0d5 [LPT][Dynamic shapes] MoveFakeQuantize trasformation fix (#10178)
* [LPT] MoveFQ fix

* [LPT] MoveFQ: added check on dynamic channel in case of per-channel fq

* [LPT] MoveFQ: tests extending
2022-02-09 13:55:50 +03:00
Taylor Yeonbok Lee
603ea50277 Fix max batch size to respect available virtual memory in linux environment. (#10201) 2022-02-09 19:40:29 +09:00
Ilya Churaev
79fceddd7e Fixed some coverity issues (#10165) 2022-02-09 12:37:19 +03:00
Gleb Kazantaev
60011b6eb2 Fix EltwiseBroadcastFusion pass (#10214) 2022-02-09 12:35:38 +03:00
Pavel Esir
654b025a26 [MO] set explicitly argument dtype to int for np.split (#9988)
* forced split argument dtype to int

* added unit-test

* fixed typo in split_test.py

* set explicitly np.int64 instead of np.int

* use split_length's dtype
2022-02-09 12:16:33 +03:00
Anton Chetverikov
25ca17e789 [MO IR Reader] Update *Sequence backend_attrs (#10041)
* Update LSTMSequence backend_attrs

* Add missed attribute clip

* Update backend_attrs for all *sequence operations

* Add extender for GRUSequence

* Add GRUSequence to custom ops list

* use has_and_set instead if direct acces to attributes
2022-02-09 12:13:23 +03:00
Gleb Kazantaev
4fdf71cdc1 Preserve RTInfo in output ports (#10114)
* Automation for preserving rt info in output ports; Update FunctionComparator to compare rt info correctly

* Update LPT tests to use real rt_info attributes, so they can be compared

* Fix tests
2022-02-09 12:09:23 +03:00
Daniil Lyakhov
0168bda833 [Offline Transformations] Reshape Layer Pruning Transformation Support (#9350)
* Reshape op pruning support

* Minor reshape fix

* GroupConv reshape extended support

* Comment ir test

* Fix: reshape can only work with constants

* Apply comments

* Fix output shape computing for reshape op

* Fix comment
2022-02-09 12:03:56 +03:00
Maxim Shevtsov
320c64de24 disabling auto-batching when batch<4 (as batch1 kernels are heavily optimized) (#10188) 2022-02-09 12:02:30 +03:00
Anastasia Kuporosova
04194b292d [Python API] Add if for yocto cross-compilation (#10216) 2022-02-09 11:56:42 +03:00
Maxim Vafin
52374a4b8b Write runtime version and how IR was genarated (legacy path or not) (#10196) 2022-02-09 11:41:49 +03:00
Daria Mityagina
6dd6fb6c12 [VPU][XLink] Printf over XLink fails on OpenVINO 2021.4.2 - fix (#10099)
The XLinkReadDataWithTimeout() is used with and incorrect value for timeout parameter.
2022-02-09 11:30:29 +03:00
Edward Shogulin
c4e54d882b [LPT] StridedSlice extending (#10148)
* [LPT] StridedSlice extending

* [LPT] tests
2022-02-09 11:23:18 +03:00
Ilya Churaev
9d40c5184f Removed legacy names and environment variables from the code (#10195)
* Removed legacy names and environment variables from the code

* Support documented legacy variables

* Fixed core unit tests

* Fixed some test
2022-02-09 11:04:25 +03:00
Vitaliy Urusovskij
532a1da548 Fix "Error handling issue" (#10119)
* Fix coverity 'error handling issue' in ~CacheGuard()

* Fix coverity 'error handling issue' in reshape()
2022-02-09 11:04:02 +03:00
Sergey Lyubimtsev
acf8cacfbc requirements markers clean up (#10179)
* requirements markers clean up

* formatting & comments

* typos
2022-02-09 10:18:24 +03:00
Roman Lyamin
0d64afc2c8 [GPU] program_helpers::are_layouts_identical fix (#10109) 2022-02-09 09:27:15 +03:00
Sergey Shlyapnikov
8f0e974ee6 [GPU] Add new properties and fix bechmark_app (#10149) 2022-02-09 09:18:54 +03:00
Maxim Vafin
1970baeb1c Apply RIC for dynamic dimension in legacy MO (#10130)
* Apply RIC for dynamic dimension in legacy MO and fail if RIC wasn't applied to any input

* Fix moc tests
2022-02-08 22:17:19 +03:00
Smirnov Grigorii
d951433b12 fix bug in Serialize (#74447) (#9840)
* fix bug in Serialize (#74447)

add simple serialization test to check pads changes

clang fix

add check and change pads in conv

refactor ov::clone_model

fix

check in test

* fix FrameworkNode and add test

* fix assert in identiry.cpp

* fix clone_nodes

* remove for node and constructor for node_input.cpp

add spaces

add space
2022-02-08 22:00:20 +03:00
Evgenya Stepyreva
a18069926e Partial Value propagation from partial to static value (#10162)
* Partial Value propagation from partial to static value

* Style

* Tests ajustment
2022-02-08 21:55:17 +03:00
Yury Gaydaychuk
0dfdadb531 [CPU] Clamp reduces float boundaries in the case of integer data (#6668) 2022-02-08 19:50:45 +03:00
Ivan Novoselov
b47b8ad4bf [CPU] Snippets throughput mode fixes (#9488) 2022-02-08 17:58:42 +03:00
Jacek Skowron
dfc738b493 [docs] update macos installation guide 2 (#9636)
* update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

update macos installation guide

* update macos installation guide
2022-02-08 16:44:57 +03:00
Nikita Malinin
0c855ee8b2 [POT] Renaming NXModel (#10168)
* NXModel -> CompressedModel renaming

* Update references & remove Dicts

* Pylint fixes
2022-02-08 14:07:12 +03:00
Indira Salyahova
f17c26506f Update utils.py (#10186) 2022-02-08 13:51:29 +03:00
Alexey Lebedev
24c4ccc621 [PYTHON API] add __hash__ for Type (#10059)
* define hash operator for type

* Fix code style
2022-02-08 13:28:25 +03:00
Evgenya Stepyreva
47b8c77a59 Q-DQ pairs folding where applicable (#10181) 2022-02-08 13:18:26 +03:00
Maxim Andronov
42a0ce0514 [CPU] Fixed dummy shape creation for Pooling (#10147) 2022-02-08 12:54:00 +03:00
Maksim Kutakov
7406b1ffc3 [CPU] Memory manager was introduced in MKLDNNMemory (#7925) 2022-02-08 12:34:17 +03:00
Anton Chetverikov
f9eaaa9ff6 [MO] Sqrt operation implementation (#9950)
* Add sqrt extender

* Update check to not use default infer in infer was set before

* Update comment

* Fix comment

* Remove Sqrt extender

* Remove unnecessary changes

* Add MO implementation of SQRT operation
2022-02-08 11:41:13 +03:00
Maxim Shevtsov
863c74471f Auto batch fix default val +test (#10169)
* default config value for the AUTO_BATCH_TIMEOUT

* test for default config value for the AUTO_BATCH_TIMEOUT

* default val for timeout var
2022-02-08 10:14:15 +03:00
Vladimir Dudnik
0a316216f3 update open_model_zoo submodule (#10182) 2022-02-08 09:31:22 +03:00
Vladislav Golubev
c4c46beb6b [CPU] Optimize*SequenceTransposes: Gather7->Gather8 (#10122) 2022-02-08 08:56:38 +03:00
Mingyu Kim
67e2bdfc28 [GPU] Update onednn to rls-v2.6-pc2 (#10156)
It is expected to have functional improvements
2022-02-08 09:47:33 +09:00
Nadezhda Ageeva
2215440188 [GNA] Set performance mode to undefined (#10174) 2022-02-07 23:04:29 +03:00
Jacek Skowron
65701e12ef [docs] update raspbianos installation guide (#9728)
* update raspbianos installation guide

update raspbianos installation guide

update raspbianos installation guide

update raspbianos installation guide

update raspbianos installation guide

update raspbianos installation guide

update raspbianos installation guide

update raspbianos installation guide

update raspbianos installation guide

update raspbianos installation guide

update raspbianos installation guide

* update raspbianos installation guide

* update raspbianos installation guide

* update raspbianos installation guide
2022-02-07 20:01:28 +00:00
Yegor Kruglov
9d3028a9f7 [MO] Pip installation message for not satisfied dependencies (#9952)
* changed message for not satisfied package

* changed warning message
2022-02-07 22:19:02 +03:00
Jacek Skowron
2d9a248912 [docs] update uninstall guide (#9725)
* CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

CVS-71850 update uninstall guide

* CVS-71850 update uninstall guide
2022-02-07 18:19:09 +00:00
Edward Shogulin
c6c9a06d41 [LPT] getDataPrecision extending (#10071)
* [LPT] getDataPrecision extending

* [LPT] getDataPrecision unit tests addition
2022-02-07 19:49:01 +03:00
Anton Pankratov
e34ff009e0 Fix for mac caching test (#10151)
* Fix for mac

* Fixed rtti comparison

* used defined
2022-02-07 19:22:21 +03:00
Andrey Zaytsev
d62d185ac5 Feature/azaytsev/docs omz revision (#10176)
* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Updated the link to software license agreements

* Revert "Updated the link to software license agreements"

This reverts commit 706dac500e.

* Added a link to the omz repo

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
2022-02-07 16:12:28 +00:00
Yegor Kruglov
bde1d5edb0 added condition for optional outputs (#10097) 2022-02-07 18:24:28 +03:00
Victor Kuznetsov
857c0bd9dd [Time tests] Update reshape pipeline (use default inputs before reshape for data generation) (#10129) 2022-02-07 22:50:12 +08:00
Maxim Shevtsov
14fcd196a3 updated the mem_statistics ( since "current" is removed) and TOTAL_MEM as it is now types thru Any (and hence needs the as<>()) (#10135) 2022-02-07 17:31:12 +03:00
Ivan Tikhonov
707a1b9377 FrontEnd OpExtension (#10153)
* Squash commits: OpExtension, pybindings, unit tests

* fix incorrect merge

* fix builds

* fix macro on Windows

* Update OPENVINO_FRAMEWORK_MAP to support any cnt of attributes, fix pybinding, resolve review comments, add unit tests

* Fix PEP8, fix unit tests build

* Remove exports from template classes

* fix MacOS build, fix copyrights, clean up

* investigate issue with reshape py tests: temporary delete OpExtension python tests

* Revert "investigate issue with reshape py tests: temporary delete OpExtension python tests"

This reverts commit 2ea2bc9e2e.

* fix model name for onnx tests

* fix python unit tests

* add new lines in the end of files

* fix unicode support on Win OS

* fix codestyle

* Update ends_with function implementation

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* update copyrights

* resolve review comments

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-02-07 16:21:18 +03:00
Alexey Lebedev
89f071f5fa [PYTHON API] Forbid building python api with debug postfix (#10158)
* Forbid building python api with library postfix

* Fix condition
2022-02-07 13:58:53 +03:00
Alexandra Sidorova
57b08583cc [Benchmark] Align comments with command argument 'data_shape' (#9897) 2022-02-07 13:31:38 +03:00
Pavel Esir
3d6e90b8f9 concat['override_output_shape'] = True in StridedSliceNormalizer.py (#10045) 2022-02-07 13:24:56 +03:00
Mikhail Nosov
abda6eb4af Remove 'evaluate' from I420toRGB/BGR operations (#10128) 2022-02-07 13:05:51 +03:00
Nikita Demashov
74fa60cf86 [LPT] Fixed an incorrect condition & added test to MoveFakeQuantize transformation (#10009)
* fixed an incorrect condition & added test

* fixed an incorrect condition & added test
2022-02-07 12:32:49 +03:00
Anton Grishin
b365e67561 [GNA] Add support for non-functional subgraphs (#9732)
* [GNA] Add support for non-functional subgraphs

Details:
* Insert copy before the last layer to allow nonfunc subgraphs

Tickets:
57363

* Traverse graph in upstream order

* Add param-reshape-result tests

* Fix insert condition

* review comments
2022-02-07 12:21:23 +03:00
Anastasia Kuporosova
3c13cea02b [Python API] Fix import/export of model + update speech sample (#10103)
* Fix import/export of model

* update speech sample

* fix code-style

Co-authored-by: jiwaszki <jan.iwaszkiewicz@intel.com>
2022-02-07 12:12:06 +03:00
Fedor Zharinov
38f470c184 set U8 precision for image-like inputs even in case of random filling (#10140) 2022-02-07 12:09:16 +03:00
Ilya Znamenskiy
ac28063b19 [GPU] Gemm onednn implementation (#9984)
* [GPU] Gemm onednn implementation

* [GPU] Added implementation choice logic
2022-02-07 11:48:42 +03:00
Mikhail Nosov
9f9df184c4 Added compatibility check of layout with partial shape (#10144)
* Added compatibility check of layout with partial shape

E.g. layout "NC" in not compatible with PartialShape{1,3,224,224}

Check is added:
- For parameter set_layout
- For parameter set_partial_shape
- For result set_layout
- Checked also compatibility for all results after 'validate_and_infer_types'

* Fix incorrect tests

* Fix of more incorrect tests

* Removed couple of obsoleted error-handling tests - these are catched now on earlier stages

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-02-07 11:17:28 +03:00
Vladimir Paramuzov
ae4c727b31 [GPU] StridedSlice shape propagation fix (#10095) 2022-02-07 10:08:06 +03:00
Vladimir Paramuzov
12746efbe5 [GPU] Fixed safe index func for per-channel case (#10136)
Co-authored-by: Ilya Znamenskiy <ilya.znamenskiy@intel.com>
2022-02-07 09:59:52 +03:00
Ilya Churaev
a2ca1d4499 Merge IE & nGraph DG (#10055)
* Changed folder for documentation

* Fixed links

* Merged nGraph DG to OpenVINO Runtime UG

* Fixed errors

* Fixed some issues

* Fixed tree

* Fixed typo

* Update docs/documentation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update README.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update README.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Fixed name

* FIxed snippets

* Small fixes

* Update docs/HOWTO/Custom_Layers_Guide.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Fixed comments

* Try to fix doc

* Try to fix doc issue

* Update docs/OV_Runtime_UG/Integrate_with_customer_application_new_API.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* Update docs/OV_Runtime_UG/model_representation.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
2022-02-07 06:57:35 +03:00
Ilya Churaev
788fb5c010 Improvement for AtomicGuard (#10120) 2022-02-06 15:18:54 +03:00
Ilya Churaev
eff6084ec9 Fixed coverity issues for core and frontends (#10123)
* Fixed coverity issues for core and frontends

* Fixed code style

* Fixed comments

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-02-05 14:52:55 +03:00
Anastasia Kuporosova
7d1ad47611 [Python API] Install only one openvino/__init__.py (#10145)
Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2022-02-05 14:48:11 +03:00
Vladislav Volkov
a365ee768b Fix for leaked ExecutorManager (#10070)
* Fix for leaked ExecutorManager

* Code style fix

* Fixed plugin pointer access from ExecutableNetwork
2022-02-05 14:03:50 +03:00
Oleg Pipikin
502c89e4a7 [HETERO] Fix segfault in supported/unsuppoterd layers check (#10104) 2022-02-05 13:35:25 +03:00
Anton Pankratov
ced90de0a5 PERF_COUNT replaced with ov::enable_profiling (#10118)
* String conversions in any

* Fixed chaching tests

* Fixed tests

* fixed build

* PERF_COUNT replaced with ov::enable_profiling

* fixed format

* fixed format

* fixed optimal config

* merge fix

* fix build

* format fix

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-02-05 13:27:46 +03:00
Anton Pankratov
213e02f3b0 Import Export using capabilities (#10081)
* String conversions in any

* Fixed chaching tests

* Fixed tests

* fixed build

* Fixed gpu
2022-02-05 11:16:55 +03:00
Anton Pankratov
5f5bea2c5a Fix for android type info comparison (#10142)
* Any value can fromm inner string

* Fixed review coment

* strict str to value conversion

* fix format

* [VPU] update config header (#9857)

* [VPU] update config header

* Review fixes

* Performance hint config update

* Removal deprecated vpu config stuff

* Review changes

* Rename myriad properties from camelCase to snake_case

* Review changes

* Review fixes

* Removal intel_myriad::common namespace

* OV throughput stream option

* Test fix

* Reverted disable_convert & disable_reorder

* Bugfixes

* Change default value for PerformanceHintNumRequestsOption

* fixed excessive outputs copying (in case when the fallback happened) and updated the test for that (#10110)

* fixed excessive outputs copying (in case when the fallback happened) and updated the test for that

* enum eExecutionFlavor to cover initial state

* Transformations: eltwise and FQ fusings fixes (#10078)

* FQ fusings fixes

* FQ Fusings: added negative test-cases for non-broadcasted constant

* Disable single-image-super-resolution-1032  from MemCheck precommit (#10133)

* add performance hint to time infer

* disable model from memcheck

* Fixed input cut for case when port is not specified. (#10134)

* Fix for android type info comparison

Co-authored-by: Aleksandr Korolev <aleksandr.korolev@intel.com>
Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
Co-authored-by: Victor Kuznetsov <victor.kuznetsov@intel.com>
Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>
2022-02-05 11:15:16 +03:00
Alexander Zhogov
18fd46a447 Revert "FrontEnd OpExtension (#9917)" (#10146)
This reverts commit 768f353300.
2022-02-05 10:42:17 +03:00
Alexander Zhogov
e0114fd22d Azure CI: increase timeout on Windows 2022-02-05 08:48:42 +03:00
Alexander Zhogov
6ac54df960 Azure CI: remove IB from running test (#10141) 2022-02-05 08:37:29 +03:00
Ivan Tikhonov
768f353300 FrontEnd OpExtension (#9917)
* Squash commits: OpExtension, pybindings, unit tests

* fix incorrect merge

* fix builds

* fix macro on Windows

* Update OPENVINO_FRAMEWORK_MAP to support any cnt of attributes, fix pybinding, resolve review comments, add unit tests

* Fix PEP8, fix unit tests build

* Remove exports from template classes

* fix MacOS build, fix copyrights, clean up

* investigate issue with reshape py tests: temporary delete OpExtension python tests

* Revert "investigate issue with reshape py tests: temporary delete OpExtension python tests"

This reverts commit 2ea2bc9e2e.

* fix model name for onnx tests

* fix python unit tests

* add new lines in the end of files

* fix unicode support on Win OS

* fix codestyle

* Update ends_with function implementation

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* update copyrights

* resolve review comments

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-02-04 22:28:13 +03:00
Egor Duplensky
c83d265416 [CPU] Add support for OV2.0 configuration API (#9997) 2022-02-04 22:26:42 +03:00
Maxim Andronov
a8c520878d [CPU] Dummy shape creation fix for Deconvolution (#10079) 2022-02-04 21:43:25 +03:00
Anton Pankratov
69b118ed7b ov::Any can get value from stored string (#10131)
* Any value can fromm inner string

* Fixed review coment

* strict str to value conversion

* fix format
2022-02-04 20:41:37 +03:00
Nikolay Tyukaev
1abc6e2a16 edit log parse regex (#10117) 2022-02-04 20:15:26 +03:00
Anastasia Popova
12a310636d Fixed input cut for case when port is not specified. (#10134) 2022-02-04 19:03:12 +03:00
Victor Kuznetsov
b3a990b0a7 Disable single-image-super-resolution-1032 from MemCheck precommit (#10133)
* add performance hint to time infer

* disable model from memcheck
2022-02-04 18:00:00 +03:00
Vladislav Golubev
265ab03314 Transformations: eltwise and FQ fusings fixes (#10078)
* FQ fusings fixes

* FQ Fusings: added negative test-cases for non-broadcasted constant
2022-02-04 17:57:13 +03:00
Maxim Shevtsov
8a85bfa312 fixed excessive outputs copying (in case when the fallback happened) and updated the test for that (#10110)
* fixed excessive outputs copying (in case when the fallback happened) and updated the test for that

* enum eExecutionFlavor to cover initial state
2022-02-04 16:58:37 +03:00
Aleksandr Korolev
9743784f91 [VPU] update config header (#9857)
* [VPU] update config header

* Review fixes

* Performance hint config update

* Removal deprecated vpu config stuff

* Review changes

* Rename myriad properties from camelCase to snake_case

* Review changes

* Review fixes

* Removal intel_myriad::common namespace

* OV throughput stream option

* Test fix

* Reverted disable_convert & disable_reorder

* Bugfixes

* Change default value for PerformanceHintNumRequestsOption
2022-02-04 16:32:00 +03:00
Mateusz Tabaka
72216a9b95 [ONNX] Replace subgraph's inputs from parent with Parameter before node is created (#10113)
This patch fixes case when If operator has subgraph with just Identity op,
which input comes from parent graph. Since Identity is eliminated,
its input is incorrectly pulled to this subgraph's body.
For example:
this ONNX subgraph:
```
               +-----------+
               |AveragePool|
               +-+---+-----+
                 |   |
            +----+   v
            |      .....
            |        |
            |        v
    +-------|--------------------------+
    |       |       If                 |
    |   then|branch      else branch   |
    +-------|--------+-----------------+
    |       |        |                 |
    |       v        |                 |
    |  +-----------+ |                 |
    |  | Identity  | |    .........    |
    |  +-----------+ |                 |
    |                |                 |
    |                |                 |
    +----------------+-----------------+
```
was converted to following (incorrect) nGraph representation:
```
              +-------------+
              | AveragePool |
              +--+---+------+
                 |   |
            +----+   v
            |      .....
            |        |
            |        v
    +-------|---------------------------+
    |       |        If                 |
    |   then|branch       else branch   |
    +-------|---------+-----------------+
    |       v         |                 |
    |  +-----------+  |                 |
    |  | Parameter |  |                 |
    |  +-----------+  |                 |
    |       |         |                 |
    |       v         |                 |
    | +-------------+ |                 |
    | | AveragePool | |    .........    |
    | +-------------+ |                 |
    |       |         |                 |
    |       v         |                 |
    |   +--------+    |                 |
    |   | Result |    |                 |
    |   +--------+    |                 |
    |                 |                 |
    +-----------------+-----------------+
```

With this change, subgraph's inputs from parent scope are replaced with
Parameter before nGraph node is created. In that case Identity's input
is a Parameter (and not AveragePool) and therefore 'then branch' looks like:
```
     +-----------+
     | Parameter |
     +-----------+
           |
           v
     +-----------+
     |  Result   |
     +-----------+

```

Ticket: 73895.
2022-02-04 12:23:27 +01:00
Ivan Novoselov
b7c62fcfbc [CPU] Improve weights sharing sync on multiple outputs (#10060) 2022-02-04 12:26:57 +03:00
Tomasz Dołbniak
797b2221be ONNX pooling - extended auto_pad attribute support (#10092) 2022-02-04 10:23:31 +01:00
Alexey Lebedev
7478915ef3 [PYTHON API] Fix InferQueue.is_ready() call (#10096)
* Fix is_ready and add tests

* remove wrong comment

* refactor test

* Fix code style
2022-02-04 11:57:56 +03:00
Indira Salyahova
da02951d67 [POT] Fix get layout from model (#10018)
* fix: layout pot

* layout

* fix: layout

* pylint

* add logger

* Update image_loader.py

* pylint

* repeat layout in data free

* resolve conflicts

* sample

* resolve comments
2022-02-04 11:46:54 +03:00
Victor Kuznetsov
ed6bb8ab2d Update models folder for TimeTests (#10107)
* add performance hint to time infer

* upd time models
2022-02-04 11:33:15 +03:00
Ilya Lavrenov
70ca4b6e40 Fix template plugin tests (#10124)
* Fix template plugin tests

* Fix template plugin tests
2022-02-04 11:25:46 +03:00
Ilya Churaev
7b5a4e8c5e Remove WA from ImportNetwork (#10111) 2022-02-04 07:16:57 +03:00
Taylor Yeonbok Lee
54678f47cf [GPU] Adjust preferred format of resample operation (#9919)
* Adjust preferred format of resample operation

* Applied review comment

* Not to fix resample layout when there is permute user unless the permute order is rotating
2022-02-04 09:57:57 +09:00
Vladimir Dudnik
f9b88c385c upd OMZ submodule. first part public models with layout as MO param (#10108) 2022-02-04 02:57:06 +03:00
Edward Shogulin
e8b88b9021 [LPT] foldFakeQuantize extending to support empty shapes (#10116) 2022-02-03 23:01:27 +03:00
Roman Kazantsev
64aabc74d1 Check the selected frontend to correspond use_new/legacy_frontend options (#10084)
* Check the selected frontend to correspond use_new/legacy_frontend options

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix a default case when no frontend is found

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2022-02-03 20:34:07 +03:00
Ilya Lavrenov
f2f281e60b Renamed ov_runtime => openvino, ov_ => openvino_ prefix (#10069)
* Renamed ov_runtime => openvino, ov_ => openvino_ prefix

* Coverage fix

* More fixes

* Fixed MO tests with custom FE
2022-02-03 20:03:41 +03:00
Anastasia Popova
86faa25724 Fix of output tensor names for mask-rcnn* models (#10042)
* Added op names to tensor names for MaskRCNN replacement transformation. Fixed output layout for MaskRCNN.

* Applied commentes left from PR with tensor names fix.

* Added tests for remove_tensor_names().

* Added checks in emitter.

* Removed debug output.

* Small fix.

* Small fix.
2022-02-03 19:44:47 +03:00
Evgeny Kotov
d30365f3d5 fix (#9868) 2022-02-03 19:14:57 +03:00
Anton Pankratov
8993c4c18a Deprecated ov::Any implicit cast to any types (#9409)
* Depricated Any implicit cast

* Fixed test

* fixed gna build

* Fixed warnings in benchmark_app

* Fixed test build

* ncc exception for PrintTo

* Error mesage in test

* Error mesage in test

* fixed build
2022-02-03 19:10:52 +03:00
Krzysztof Bruniecki
6677079821 Set proper precision for added output (#9496) 2022-02-03 18:34:55 +03:00
Anton Pankratov
5c9b6915dc Added undefined perfomnance hint value (#10082)
* Added undefined perfomnance hint value

* Added tests

* Fixed tests

* fixed dormat
2022-02-03 18:03:45 +03:00
Ilya Lavrenov
168bfe58c4 Fix NCC (#10105) 2022-02-03 16:51:26 +03:00
Ilya Lavrenov
3c35cf73c2 Build only static libraries on Linux Azure (#10062) 2022-02-03 16:26:21 +03:00
Anastasia Popova
ca45bf430a Fixed tensor names set in InputCut and AutomlEfficientDet transformation. (#9998)
* Fixed tensor names setting in InputCut, fixed tensor names losing in AutomlEfficientDet.

* Changed op name adding to tensor names in InputCut for output port case only.
2022-02-03 15:55:16 +03:00
Artyom Anokhov
f57be8fdd8 configs: Updated path to licensing (#10102) 2022-02-03 15:24:40 +03:00
Anton Dudchenko
711d6de33b [VPU] Fix precisions for execGraph (#9767)
ExecGraph didn't contain the parameter node and precisions
65013
2022-02-03 13:20:59 +03:00
Sergey Shlyapnikov
ccf4f4e420 [GPU] Update config api 2.0 (#9649) 2022-02-03 13:04:36 +03:00
Nikolay Shchegolev
b34cb55081 [CPU] Gather JIT implementation + Gather8 support. (#10083) 2022-02-03 12:32:23 +03:00
Ilya Churaev
0b75589e27 Fix cc build (#10073)
* Try to fix cc build

* Fixed build
2022-02-03 11:43:51 +03:00
Wilson Seok
3d9da2901e Template slt bug fix/mish partial dynamic (#9976)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* fix demension dynamic support bug in mish op reference test
2022-02-03 11:32:39 +03:00
Wilson Seok
8d27103f06 Add slt in template plugin/rnn sequence (#9526)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add initial op reference test of rnn_sequence

* add op reference test of GRUSequence

* replace input and refOut data to hard coded value

* update copyright year and namespace of Tensor

* rename S_t to sequence_lengths
2022-02-03 11:32:08 +03:00
Jan Iwaszkiewicz
db334efbbd Fix vector casting for Constants with float16 type (#10088) 2022-02-03 09:15:28 +01:00
Vladislav Golubev
38ed0de9cf Test enabled (#9341) 2022-02-03 10:58:03 +03:00
Liubov Talamanova
b4206fe0a1 Supported Simplified mode without provided config (#10049)
* Support Simplified mode without provided config

* Change data-source default location
2022-02-03 10:56:25 +03:00
Eugeny Volosenkov
e7d8284e4d fix pot (#9980) 2022-02-03 10:47:31 +03:00
Maxim Gordeev
cf69c97765 Added new correct gna frequency result for Alder Lake (#10047)
* Added new correct gna frequency result for Alder Lake

* Update samples/cpp/speech_sample/utils.hpp

Co-authored-by: Krzysztof Bruniecki <krzysztof.bruniecki@intel.com>

Co-authored-by: Krzysztof Bruniecki <krzysztof.bruniecki@intel.com>
2022-02-03 10:38:25 +03:00
Ilya Churaev
03c38ca3fd Changed code which check newAPI flag from Core (#10080)
* Changed code which check newAPI flag from Core

* Fixed typo
2022-02-03 10:36:23 +03:00
Fedor Zharinov
9219242dbd Benchmark_app: JSON writer for statistics (#9887)
* Refactored statistics output with JSON support

* Detailed/average reports are added

* stylefix

* Update samples/cpp/benchmark_app/statistics_report.hpp

Co-authored-by: Ivan Vikhrev <ivan.vikhrev@intel.com>

* Linux Fixes

* stylefixes

* data_shape field format is changed

* stylefix

Co-authored-by: Ivan Vikhrev <ivan.vikhrev@intel.com>
2022-02-03 01:47:46 +03:00
Alina Kladieva
552454a3f0 Revert "[CPU] Gather jit implementation. (#6601)" (#10077)
This reverts commit fbe8aa94a4.
2022-02-02 20:12:24 +03:00
Ilya Churaev
5406839e3f Removed layouts config (#10067) 2022-02-02 15:56:26 +03:00
Nikolay Shchegolev
fbe8aa94a4 [CPU] Gather jit implementation. (#6601) 2022-02-02 15:02:49 +03:00
Nikolay Tyukaev
7a88daa8f7 enable doc html artifact (#10065) 2022-02-02 14:43:20 +03:00
Tomasz Dołbniak
8a05ef2514 Softmax tests fixed (#10051) 2022-02-02 12:28:39 +01:00
Tomasz Dołbniak
0700ba781b ONNX ConvInteger - handling of scalar zero points (#10057) 2022-02-02 12:16:08 +01:00
dependabot[bot]
53af687a0c Bump jinja2 (#9966)
Bumps [jinja2](https://github.com/pallets/jinja) from 2.11.2 to 2.11.3.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/2.11.2...2.11.3)

---
updated-dependencies:
- dependency-name: jinja2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-02-02 14:09:45 +03:00
Nikita Malinin
04f5b233f2 [POT] Introduce saturation_fix option (#9940)
* Introduce statiration_fix option

* Pylint fix

* Update namings and pipelilne

* Change node_input target
2022-02-02 13:46:20 +03:00
Andrey Somsikov
9dd4476c58 Reduce noise from security tests (#9774)
* Mute noicy undefined behavior checks

* Fix GCC build error with unsupported option

* Fix missprint
2022-02-02 12:48:21 +03:00
Andrey Somsikov
176bc2d83d Set -DENABLE_FASTER_BUILD=OFF for coverity (#10044) 2022-02-02 12:47:32 +03:00
Victor Kuznetsov
0dd8d895a0 [Time tests] Add API 2.0 support (#9878)
* add performance hint to time infer

* init commit - add api 2 support

* change imInfo filling

* change copyright dates

* check hw positions to default

* add debug info

* fix mistake

* add check layout funcs for api2 time infer

* reformat code (2 -> 4)

* upd with reshape api2

* upd with master

* --

* fix fillTensors - set as template

* fix common_utils.cpp after merge master
2022-02-02 12:33:02 +03:00
Anastasia Kuporosova
70f65bdb74 [Python API] Rename configuration API + update tests/tools (#9927)
* [Python API] Rename configuration API + update tests/tools

* keep old api for compatibility

* add deprecation warnings

* apply comments to query sample

* remove convert to pyobject

* use Any instead of string

* update tests

* update set_property

* fix sample

* update test + try-except for pot

* add docstrings

* fix codestyle for pot
2022-02-02 11:28:41 +03:00
Anton Grishin
336fc37b94 Define static variable (#10053) 2022-02-02 11:26:26 +03:00
Smirnov Grigorii
83b1a247ec move convert_broadcast3_test.cpp to op_coversions (#10043)
* move

* remove convolution_ie header
2022-02-02 10:59:11 +03:00
Mateusz Tabaka
bf908e9bdf Enable argmin/argmax test cases (#10056)
Ticket: 35473
2022-02-02 08:39:58 +03:00
Anton Pankratov
4cbcf4b4e3 Added get property additional arguments (#9993)
* Added get property additional arguments

* Fixed build

* Fixed error

* Added api wiht property and map

* Fixed gna build

* reverted available_devices
2022-02-01 23:56:52 +03:00
Tatiana Troilova
c715fde8f0 Update third party files (#9992)
* Update third party files

* Update third party files (OMZ added)
2022-02-01 21:06:06 +03:00
Nikolay Tyukaev
172cbe7340 DOCS: Fix js and add ipython (#9995)
* js and ipython

* add to suppress warnings

* fixes

* fixes

* fixes

* fixes
2022-02-01 20:39:17 +03:00
Evgenya Stepyreva
ff8c217e03 Not tracking fixed, tracking restored (#10040) 2022-02-01 19:58:29 +03:00
Maxim Andronov
ba736e2bcd [CPU] Fix dynamic RNNSeq with native order (#9932) 2022-02-01 18:52:57 +03:00
Vitaliy Urusovskij
89fe26e3db Copy RandomUniform m_state during clone_with_new_inputs() (#10031)
* Copy RandomUniform m_state during clone_with_new_inputs()

* Add `get_state()` for RandomUniform op

* Add copy.random_uniform test
2022-02-01 18:46:09 +03:00
Jacek Skowron
56759d9cdc [docs] update linux/win installation guide (#9720)
* CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

CVS-71745 update linux installation guide

* CVS-71745 update linux installation guide

* CVS-71745 update linux installation guide

* CVS-71745 update linux installation guide

* lfs

* CVS-71745 update linux installation guide

* CVS-71745 update linux installation guide

Co-authored-by: CCR\ntyukaev <nikolay.tyukaev@intel.com>
2022-02-01 18:33:36 +03:00
Svetlana Dolinina
5e8f997262 Fix bug in AddReshapeTransposeAroundConvPool for Kaldi LSTM networks (#9885)
* change order of transformations to work correctly with Convolutions in Kaldi LSTM networks

* removed unneeded changes and add unit tests

* remove comment

* remove changes from memory_offset_adjustment, move all fixes inside add_reshape_transpose_around_conv_pool to avoid new bugs

* removed test for deleted changes

* replace -1 by None
2022-02-01 17:06:49 +03:00
Fedor Zharinov
c848e55f5e Benchmark_app: Command line args processing is modified to use both tensor and corresponding node names (#9968)
* Node/name conversions

* stylefix
2022-02-01 16:05:00 +03:00
Fedor Zharinov
6845392aa6 Benchmark_app: incorrect indexing during precision set is fixed (#10033)
* Precision problem fix. Behavior of auto precision conversion to U8 (in case of image) is changed

* stylefix
2022-02-01 15:58:48 +03:00
Liubov Talamanova
ca09ddd123 [POT] Implement DataFreeEngine (#9484)
* [POT] Implement DataFreeEngine

* Add CLI

* Updated CLI

* Moved logic to SynteticImageLoader

* Fix bug with draw modes

* Fix bug in DataFreeEngine

* Fix multiprocessing

* Fix pylint

* Add DataFreeEngine test

* Download models

* Fill background

* Fix test

* Fix args

* Support config option for DataFree mode

* Minor fixes

* Add data_free config

* Add more test cases

* Enable RCNN models quantization
2022-02-01 15:15:20 +03:00
Ekaterina Aidova
09f53b56e6 [OMZ]: update submodule (#10036) 2022-02-01 15:03:17 +03:00
Katarzyna Mitrus
52d53d187d Enable reshape sequence fusion transformation based target shape bounds (#9886)
* Calculate value bounds in ReshapeSequenceFusion

* Reashape fusion upper bounds check

* Revert last return to false

* Add transformation unit tests

* Use output node as check param

* Use evaluate helper and remove deprecation macro

* Header update

* Checks refactor and comments

* Update unit tests

* Get element type from node_out
2022-02-01 14:51:47 +03:00
Lidia Toropova
2ce7becc6b Moved memory tests to OV API 2.0 (#9924)
* Moved memory tests to OV API 2.0

* Added configs for OV api 2, updated configs for api 1

* Commented several models in configs (no such models on omz)

* Updated fillTensors

* Fix to get network inputs

* Updated fillTensors and configs
2022-02-01 14:36:05 +03:00
Yuan Hu
8892b7b327 add Debug statistic log for devices infer nums (#9825)
* add statics log

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* change LOG_DEBUG to LOG_INFO

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix type

Signed-off-by: fishbell <bell.song@intel.com>

Co-authored-by: fishbell <bell.song@intel.com>
2022-02-01 14:18:29 +03:00
Alina Kladieva
f25c450534 Exclude gpu registerPluginsXMLUnicodePath test due to 76197 (#10029) 2022-02-01 13:43:38 +03:00
Pavel Esir
9bb7697b2f [MO] fix simplified MO import for PyCharm Debug (#9866)
* fix simplified MO import for PyCharm Debug

* package_BOM update
2022-02-01 13:14:48 +03:00
Eugeny Volosenkov
e0af970d62 Fix yolov3 documentation (#9901) 2022-02-01 13:12:12 +03:00
Anton Pankratov
b8a4b0742b Streams executor configured using OV2.0 configuration API (#9587)
* Streams executor config OV2.0

* Fixed error

* Reverted CPU tests
2022-02-01 13:08:32 +03:00
Anton Pankratov
8ca6aeae83 New configuration API in set get property (#10012)
* New configuration API in set|get property

* removed supported metrics and keys

* Fixed build

* Fixed build

* Fixed samples build

* Fixed samples build

* Fixed build

* Removed old properties in plugin

* Fixed build
2022-02-01 13:05:14 +03:00
Maxim Andronov
6866ced978 [Transformations] ConvertBroadcast3 for boolean fix (#10001) 2022-02-01 12:53:05 +03:00
Alexey Suhov
e1e467f23f [CMake] Add debug postfix on mac (#10027) 2022-02-01 12:41:26 +03:00
Daria Mityagina
a3f2a4ef99 [VPU] - I64 issue with ONNX models - fix (#9978)
i32 or i64 is used for index_element_type. So it is more convenient to get rid of the condition and stay only with the i32 option.
Tickets:
75748
75747
75029
2022-02-01 11:42:55 +03:00
Roman Kazantsev
298cced3b3 [MO, TF frontend] Correct loaders for StridedSlice and Pack operations (#10034)
* Correct Loaders for TensorFlow StridedSlice and Pack operations

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Supress INFO and WARNING messages from TensorFlow

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2022-02-01 11:02:28 +03:00
Ilya Lavrenov
4717e7639c Param/Const => Result tests (#9294)
* Tests for param => result

* Added const => result, param => result tests

* Disabled tests on CPU

* Added more tests

* Enabled import / export for template

* clang-format

* Reverted scatter tests

* Rename back

* Fixed typo

* Fixed compilation for GNA

* Fixed comments

* Fixed collisions

* Revert renaming back

* Added skip filters for GNA / MYRIAD
2022-02-01 11:01:12 +03:00
Anton Grishin
75abee2500 [GNA] Refactor and install libGNAConfig.cmake (#9793)
* Install libGNAconfig.cmake

* Refactor gnaConfig to correctly find from OV package

* remove ENABLE_INTEL_GNA option from CI

* Apply comments and fix CI

* re-trigger CI (demos issue)

* Enable GNA/samples smoke tests

* rename GNA to GNA_EXT_DIR

* re-trigger CI (mxnet cpu test issue)

* Pick azhogov changes to check CI

* try win wa

* fix win build

* re-trigger onnx

* tests

* disable win samples tests

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2022-02-01 10:51:07 +03:00
Pavel Finashov
ab3207a81b POT: Fixed command line to convert models for Windows platform. (#10024)
* For testing purpose

* Fixed command line for windows: removed re-writing PYTHOPATH

* Changed command line for re-writing PYTHONPATH
2022-02-01 10:31:16 +03:00
Vladislav Volkov
ff784ed6ab [CPU] I420toRGB and I420toBGR operations for CPU plugin (#9118) 2022-02-01 09:26:14 +03:00
Alexandra Sidorova
44362c97be [CPU] Fixed TensorIterator/Loop dynamism leftovers (#9722) 2022-02-01 09:17:03 +03:00
Edward Shogulin
cc19ff74f1 [LPT] [GPU] Multiply to group convolution (#9971)
* [LPT] MultiplyToGroupConvolution optimization for GPU

* [LPT] MatMul in FP32 in GPU workarround support

* [LPT] GPU plugin tests
2022-02-01 08:10:27 +03:00
Ilya Lavrenov
8c7e0d9479 Update include of legacy in tests (#10030) 2022-02-01 06:43:39 +03:00
Mikhail Ryzhov
bcdf7b0cad [GNA] Fixed output convert transformation (#9808)
* Fixed output convert transformation

* Update src/plugins/intel_gna/transformations/remove_converts.cpp

* Reverted wa
2022-01-31 20:08:24 +00:00
Pavel Esir
73e9eb4c61 [MO] add reinterp_shape for StridedSlice (#9622)
* added reinterp_shape for StridedSlice

* package_BOM update

* corrected unit-tests

* returned removed tests
2022-01-31 22:17:15 +03:00
Andrei Molotkov
d5b74b0c6b [GPU] Fix redefinition variables issue in ExperimentalDetectronROIFeatureExtractor kernel (#9960) 2022-01-31 20:19:16 +03:00
Nadezhda Ageeva
a7910b8869 [GNA] Support new configuration API (#9955)
* [GNA] Support new configuration API

* Review comments: description fixes

* Review comments
2022-01-31 18:48:18 +03:00
Gleb Kazantaev
6dea8d3d86 Update replace_output_update_name method (#10000)
* Update replace_output_update_name method

* Remove wrong legacy test
2022-01-31 18:06:05 +03:00
Lidia Toropova
2f0bcc8542 Moved stress tests to OV API 2.0 (#9791)
* Moved stress tests to OV API 2.0

* Fix for using ouput index instead of get_index

* Removed ov::runtime namespace in stress tests

* Updated stress tests according to latest changes in OV 2.0

* Fix memleaks tests

* Updated run_memcheck.py to process gtest_filter

* Updated fillTensors, added InferAPI1 and InferAPI2 classes

* Updated test_inference_with_streams

* Updated isImage, comments

* Updated fillTensors to fill image_info inputs with positive pseudo-random numbers

* Removed redundant variable in fillTensors
2022-01-31 17:07:25 +03:00
Alexandra Sidorova
252b7d4728 [Benchmark] Fixed preprocessing inputs (#10022) 2022-01-31 17:05:44 +03:00
Anton Dudchenko
89b88af28d [VPU] Rename INTEL_VPU to INTEL_MYRIAD, move thirdparty and vpu_dependencies (#9827)
* Rename INTEL_VPU to INTEL_MYRIAD, move thirdparty and vpu_dependencies

* Fix thirdparty

* Rename HDDL

* Remove unused files

* Fix HDDL

* Add path to mvnc

* Fix installation on Linux

* Remove thirdparty dir from codeowners

* Move new files

* Remove IE_MAIN_SOURCE_DIR dependencies

Co-authored-by: Maksim Doronin <maksim.doronin@intel.com>
2022-01-31 16:58:33 +03:00
Szymon Irzabek
4eac21e7c0 [GNA] Fix handling reshapes around matmul with 3D/4D Add layer (#9900) 2022-01-31 16:44:35 +03:00
Vladislav Golubev
43130622d3 [Transformations] Convert TI to sequences: dynamic case fix (#9742)
* Convert TI to sequences: dynamic case fix

* tests corrected
2022-01-31 16:37:15 +03:00
Evgenya Stepyreva
cf4d4db4c7 Option not to track dimensions down (#10019) 2022-01-31 16:09:32 +03:00
Anton Pankratov
29d103087a Aggregating plugins use single config value to pass device list (#9379)
* Aggregating plugins use single config value to pass device list

* format fix

* fixed build

* Fixed tests

* Fixed test

* fied build
2022-01-31 15:43:32 +03:00
Alexey Lebedev
495931673d [PYTHON API] fix request busy using AsyncInferQueue (#10020)
* Add request.wait() call to get_idle_request_id and wait_all()

* rethrow exception on default callback

* update comment

* fix code style
2022-01-31 15:30:04 +03:00
Egor Shulman
b56fd07169 [CPU] Fixed data storing for AVG Pooling with PostOps on avx2 (#9325) 2022-01-31 14:36:18 +03:00
Indira Salyahova
6145cb736e [POT] Update patterns with transpose (#9555)
* fix: update pot patterns with transpose

* add tests

* delete tests

* updatereference metrics tf model

* Update test_sanity.py
2022-01-31 14:30:28 +03:00
Mikhail Letavin
70987e327a [GPU] Remove potentially unsafe references to temporary objects (#9959) 2022-01-31 14:22:59 +03:00
Ilya Sharikov
56f2bc2f12 Add support api 2.0 to layer_tests (#9814)
* Add support api 2.0

* Upd imports

* Update onnx_tests

* Upd tenserflow_tests

* Fix test_split_concat.py

* Fixed comparing
2022-01-31 13:15:30 +03:00
Ilya Churaev
0a2c0e1539 Fixed coverity issues (#10014) 2022-01-31 12:51:52 +03:00
Wang, Yang
80d70dd438 Ywang2/update auto configuration api (#9977)
* Update AUTO OV 2.0 c++ configuration API.

Signed-off-by: ywang2 <yang4.wang@intel.com>

* Support the OV 2.0 key to set model priority and add the test case to verify the prioirty map logic within AUTO plugin.

Signed-off-by: ywang2 <yang4.wang@intel.com>

* Replace the old model priority key and add the corresponding test case.

Signed-off-by: ywang2 <yang4.wang@intel.com>
2022-01-31 16:24:46 +08:00
Nikolay Shchegolev
7d173eb354 [CPU] RNN, GRU, LSTM Sequences batch 1 tests failure. (#9719) 2022-01-31 11:21:39 +03:00
Mikhail Nosov
4e4b04bbd3 LSTMSequence/GPUSequence - fix validate_and_infer_types (#9996)
* Fix LSTMSequence/GPUSequence validation behavior consistent with RNNSequence

Fixed issue with no exception if num_directions=2, but 'm_direction' is not set to BIDIRECTIONAL. Previously there was no error with this (and luckily it failed later in some CPU transformations during compile_network)

Corrected several tests which use copy-pasted num_directions=2 without m_direction set
Also for dynamic 'num_directions' - output shape still has 1 or 2 directions, because m_direction is known. Tests for GRU/LSTM are updated for this
Also several tests worked incorrectly for LSTMv0 - expectation was specific error to be thrown, but no expection was also allowed

* Fixed clang-format
2022-01-31 08:24:43 +03:00
Tomasz Dołbniak
351c84e6e4 TestCase class fix (#10011)
* Store the expected output data in the TestCase class

* Skip the failing ONNX If tests

* Disable failing ONNX Softmax tests

* Disable the remaining failures
2022-01-31 08:11:18 +03:00
Chen Xu
49a01bf9fc [CPU] Fix bug concerning model accuracy in Reduce node (#9929) 2022-01-30 17:36:36 +00:00
Chen Xu
cc5d30b26c [CPU] Fixed TopK node optimization leftovers (#9862) 2022-01-30 19:11:47 +03:00
bell
aaf02ab4c7 modify optimal request num(add a multiplexer) (#10004)
* muliply the request# by 2

Signed-off-by: fishbell <bell.song@intel.com>

* modify case

Signed-off-by: fishbell <bell.song@intel.com>
2022-01-30 16:43:41 +03:00
Smirnov Grigorii
f424d2d8ae Split transformations tests src to match IE transformations library structure (#55385) (#9949)
* refactor transformations directory

* create offline_transformations directory
2022-01-29 15:38:19 +03:00
Mikhail Nosov
2b87f000ed ROI tensor support for Template plugin (#9914)
* ROI tensor support for Template plugin + tests for Template and CPU plugins

GPU doesn'tsupport ROI tensors, so tests were not added for GPU

* Added asserts for unsupported mixed axis order (like 0,3,1,2), and unsupported types like int4/int2 for ROI tensors
2022-01-29 10:52:52 +03:00
Edward Shogulin
1176b0f1f9 [LPT] MoveFakeQuantize parent output fix & refactoring (#9872)
* [LPT] MoveFakeQuantize parent output fix & refactoring

* [LPT] tests extending
2022-01-29 10:04:07 +03:00
Katarzyna Mitrus
e3ec1ac9b3 Allow duplicated outputs in ie_plugin_internal (#9882)
* Avoid duplicated outputs with the same name

* Revert onnx graph changes

* Allow output duplicates in ie_plugin_internal check

* Add test with onnx model

* Check get_tensor_ptr instead of any_name

* More outputs test

* Refactor to use std::transform

* test manifest update

* Remove redundant header

* INTERPRETER segfaults fix for duplicated output names

* Simplify duplication assert

* Update test names

* Test update
2022-01-29 02:58:09 +03:00
Egor Duplensky
9cb6626ffd [CPU] Fix FullyConnected node for strided inputs and outputs (#9575)
FullyConnected node cannot work with strided inputs (for example
inplace descs) because it implicitly reshapes input and output tensors.
2022-01-28 22:20:09 +03:00
Maxim Andronov
b5ea943267 [CPU] MatMul dummy shapes creation fixed (#9858) 2022-01-28 21:21:02 +03:00
Anton Chetverikov
97a78d0059 [MO] EmptyTensorList transform (#9361)
* Initial change for new transformations

* Update patterns

* Update unsupported operation replacement

* Add input/output normalization passes call

* Update logic

* Refactor output concatination transform

* Update re_numerate_input_ports and shape infer functions for Loop

* Update comments

* Add back edge removing to output concatenation transformations

* Update comment

* Remove redundant normallization call

* Update supported layers list

* Use routine in check

* Add transformation to rub_before list
2022-01-28 20:53:16 +03:00
Ilya Lavrenov
eaa0a68fdb Updated on OV 2.0 properties (#9906) 2022-01-28 18:52:50 +03:00
Sergey Lyubimtsev
4b35d48283 Add ability to generate requirements.txt files with dev tags (#9986) 2022-01-28 18:23:10 +03:00
Edward Shogulin
72583261fc [LPT] Coverity issue fix: getMinValue (#9991) 2022-01-28 17:49:38 +03:00
Ilya Churaev
39b5cb809e Fixed collisions in friendly names for internal operations (#9965)
* Fixed collisions in friendly names for internal operations

* Fixed renaming

* Added comments

* Renamed test file

* Fix behavior for outputs

* Fixed logic

* Fixed comments
2022-01-28 17:33:08 +03:00
Tatiana Savina
da1324db68 [DOCS] Enable sphinx panels directive (#9982)
* new directive

* add panels version
2022-01-28 17:18:57 +03:00
Alina Kladieva
8f3ebed8ec Bump OMZ version (fix for pip-conflicts & wheels on Win & Mac) (#9987) 2022-01-28 16:45:28 +03:00
Gleb Kazantaev
45f98cece5 Load Time Improvements (#9946)
* Fix ConstantFolding; update ric fusion

* Update MarkPrecisionSensitiveDivdes pass

* Move back RIC fusion; Update copy_runtime_info logic + tests

* Update CF + tests

* Code style fix

* Code clean-up

* fix cf attr propagation

* Fix windows build
2022-01-28 16:36:45 +03:00
Maxim Gordeev
f0e2a2e811 Speech sample improvements (#9985) 2022-01-28 16:13:51 +03:00
Ilya Churaev
d5cd14efe3 Fixed cmake generation for CC build (#9974)
* Fixed cmake generation for CC build

* Fixed static build
2022-01-28 14:09:53 +03:00
Anastasia Popova
a61655040f Fixed loader for TF2. (#9962) 2022-01-28 13:23:22 +03:00
Sergey Lyubimtsev
4cd20425c3 Building of openvino-dev wheel results many temp files in source tree (#9936) 2022-01-28 13:14:26 +03:00
Daria Mityagina
917994293c [VPU] Added support for dynamic nodes for QueryNetwork - copy (#9925)
Currently, calling QueryNetwork from Myriad plugin with dynamic network could result in exception, this PR should fix this by removing nodes that could cause it from consideration.

Co-authored-by: Polina <polina.brzezinskaya@intel.com>
2022-01-28 13:06:37 +03:00
Alexandra Sidorova
2666a3dac4 [CPU] Enabled brgemm matmul primitives avx512 (#9824) 2022-01-28 11:34:32 +03:00
Szymon Irzabek
ef0a080323 [GNA] Extend matmul handling support (#9810)
Support matmuls with two non-const inputs.
Detect concat inputs to matmul as changing batch size and
handle appropriately.
Enable tests in GNA_SW_EXACT mode for convolution stride > kernel size.
2022-01-28 10:20:47 +03:00
Steve Yoo
068bdff787 Add SLT to Template Plugin: Loop-5 (#9789) 2022-01-28 07:56:04 +03:00
Steve Yoo
e8b954d6ec Add testcases of index type i32 for NonMaxSuppression (#9902) 2022-01-28 07:53:01 +03:00
Wilson Seok
1e0470f4e7 Add slt in template plugin/lstm sequence (#9305)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* initial code commit

* add runtime reference

* apply ov::Model

* initial lstmcell-1 definition

* initial change

* apply Peepholes

* apply input_forget option

* apply initial test case of lstmsequence-1

* fix clang-format error

* fix clang-format error 2

* add lstms_sequence test cases by runtime reference and onnx test cases

* fix clang-format error

* fix clang-format error

* fix onnx test failure of LSTM IE_CPU

* fix clang-format issue

* fix clang-format issue 2

* add type_prop and visitor api test of lstm_sequence_v1

* fix clang-format error

* replace input/refOut data to hard coded and remove unnecessary enum definition

* update namespace of Tensor()

* remove supported test cases in disabling list
2022-01-28 07:49:32 +03:00
Tomasz Dołbniak
658d9c3633 Removal of ONNX FE warning regarding Constant creation (#9935) 2022-01-28 07:16:18 +03:00
Yuan Hu
8883732ca8 [AutoPlugin] get optimal infer request number (#9529)
* dynamic optimal infer request

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* modify test case to match logic

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* for CPU_HELP,CPU case, use default value

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* update logic for GPU VPUX MYRIAD

throughput
GPU num = GPU_THROUGHPUT_STREAMS * 2
VPUX = 8
MYRIAD = 4

other mode
GPU NUM = 1
VPUX = 1
MYRIAD = 1

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* print GPU_THROUGHTPUT_STRREAM FOR TEST

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* get streams num from rangestreams for GPU

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* Revert "print GPU_THROUGHTPUT_STRREAM FOR TEST"

This reverts commit 06e348d21dfaed626bebcc32837737da9b036e44.

* use default variable instead of 4u and 1u

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* simple if else logic

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* check allow batching key

Signed-off-by: fishbell <bell.song@intel.com>

* add comment, optimize logic

Signed-off-by: fishbell <bell.song@intel.com>

Co-authored-by: fishbell <bell.song@intel.com>
2022-01-28 10:13:02 +08:00
Daria Mityagina
aa53948379 [VPU] Hello classification MyriadX issue (#9701)
This PR fixes error
inference-engine/src/vpu/graph_transformer/src/stages/interpolate.cpp:65 Current Interpolate does not support resize by channels that started to appear after sample refactoring.

Issues: -75837
2022-01-28 00:20:06 +03:00
Szymon Irzabek
069b3839ce [GNA] Fix large eltwise split in case split dimension is less than alignment (#9933)
* [GNA] Fix large eltwise split in case split dimension is less than alignment

* Update src/plugins/intel_gna/optimizer/gna_pass_manager.cpp

Co-authored-by: Krzysztof Bruniecki <krzysztof.bruniecki@intel.com>

Co-authored-by: Krzysztof Bruniecki <krzysztof.bruniecki@intel.com>
2022-01-27 22:09:32 +03:00
Pavel Durandin
d4779bb351 Parallel onednn graph compilation GPU (#9958) 2022-01-27 19:47:24 +03:00
Nikolay Tyukaev
622027bee5 fix errors in documentation (#9384)
* add sphinx log parsing

* fix

* fix log

* fixes

* fixes

* fixes

* fixes

* fixes

* fixes

* fixes

* fixes

* fixes

* fixes

* doxygen-xfail

* fixes

* fixes

* fixes

* fixe

* fixes

* fixes

* fix pot

* add pot check

* fixes

* fixes

* Fixed POT docs

* Fixed POT docs

* Fixes

* change heading markup

* fixes

Co-authored-by: azaytsev <andrey.zaytsev@intel.com>
2022-01-27 19:39:49 +03:00
Alexander Zhogov
a99ae43d61 Azure CI Win: Update pool to D8S (#9963) 2022-01-27 19:35:24 +03:00
Anton Chetverikov
05684b7cd0 Move tensor name restoring transformation after output normalization (#9904) 2022-01-27 17:41:58 +03:00
Pavel Zamelin
578afb9bb8 Allow to specify cpack component in addItTargetTest (#9945) 2022-01-27 17:01:46 +03:00
Mikhail Nosov
cf328d299f More fixes of plugins.xml generation (#9942)
* Further fixes of plugins.xml generation
1) Unregistration is done by name (e.g. CPU), not by file name (ov_cpu_plugin)
2) Unregistered line is searched by name="MULTI" instead of just 'MULTI' to not conflict with MULTI_WORK_MODE_AS_AUTO entry
3) Removed list of all possible plugins from ov_runtime as logic shall not rely on this (not possible to add 3rd party plugins)

* Revert ov_runtime - some CI jobs require plugins.xml even though plugins are not built

Registration - if some entry already exists in XML - don't copy it.
E.g.
- Registration of 'TEMPLATE' is performed
- Registration loops through existing plugins.xml
   - If name="TEMPLATE" is found - don't take it to newContent
   - If name like "myCustomPlugin" is found - take it
- As result - "myCustomPlugin" will exist after update, but old "TEMPLATE" will be removed

* Add missing change
2022-01-27 16:54:21 +03:00
Evgenya Stepyreva
1d5352dae3 Dimension tracking: Always output batch the same as it was before (#9953) 2022-01-27 16:29:16 +03:00
Vladislav Golubev
bd7a5db029 [LPT] Reduced gaps between static and dynamic execution (#9775)
* LPT: removed limitations on Dq by dynamic channel

* [TESTS] LPT tests updated
2022-01-27 15:07:42 +03:00
Maxim Gordeev
0627fe857e [IE Samples] Export and Import of model, fixed (#9776)
* [IE Samples] Export and Import of model, fixed https://jira.devtools.intel.com/browse/CVS-76225

* Added IE_SUPPRESS_DEPRECATED

* [IE Samples] Export and Import of model, fixed 76225

* Added IE_SUPPRESS_DEPRECATED

* fixed notes

* Update samples/cpp/speech_sample/main.cpp

Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>

* Update samples/cpp/speech_sample/main.cpp

Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>

* fixed formatting

* changed processing of inputs

* working export

Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
2022-01-27 14:46:02 +03:00
Roman Lyamin
cf80eda8e0 [GPU] Added handle permute (#9853) 2022-01-27 14:37:55 +03:00
Mang Guo
f6162ed657 [CPU] Add MVNLayoutType enum (#9889) 2022-01-27 14:27:40 +03:00
Ilya Naumov
1be838576c Fix UnicodeEncodeError on Python 3.6 (#9285) 2022-01-27 14:00:38 +03:00
Yegor Kruglov
bc70b2b68b [ MO ] Support MXNet operation arange_like (#8939)
* arange_like_op

* added comments

* added unittests

* added step attr, changed axis condition, updated tests

* added op description

* fix nodes renaming

* sorted imports

* added case with repeat > 1

* finished arange_like, removed unit test

* small fix in gather infer function

* gather fix

* fix doc

* added unittests

* correct renames

* removed ConvertLike from div_sqrt_dim

* used ReduceProd instead reshape-shapeof

* added keep_dims attr to reduce_prod node
2022-01-27 12:44:12 +03:00
Aleksandr Korolev
4ecab1eeea [VPU] Fix vpu_scale tests (#9693)
Fix memory leak in VpuScaleTest
2022-01-27 12:41:45 +03:00
Aleksandr Korolev
18c20f5766 [VPU] Add performance hints (#9349)
Added a new key required for benchmark_app
2022-01-27 12:39:27 +03:00
Roman Kazantsev
7ec1cc919e [MO] Correct preprocessing block for TensorFlow OD 2.4+ models (#9944)
* Detect casting node inside preprocessing block and leave it

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix unit-test for ObjectDetectionAPI

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2022-01-27 12:15:30 +03:00
Vladimir Dudnik
b84f75f346 update open_model_zoo submodule (#9947) 2022-01-27 11:09:23 +03:00
Sergey Shlyapnikov
0af8916d1d [GPU] Fix dependencies list in fused primitive descriptor (#9941) 2022-01-27 11:05:20 +03:00
Maxim Shevtsov
2b1bacaf6e fixing mem leak by avoiding cyclic ref (when shared_ptr was captured in lambda) (#9930) 2022-01-27 10:47:00 +03:00
song, bell
49c2086d23 allocate host blob from hw context (#9854)
* allocate host blob from hw context

Signed-off-by: fishbell <bell.song@intel.com>

* accomodate to new namespace

Signed-off-by: fishbell <bell.song@intel.com>

* fix build

Signed-off-by: fishbell <bell.song@intel.com>

* refine logic

Signed-off-by: fishbell <bell.song@intel.com>

* dynamic shape need to share blob with cpu infer request

Signed-off-by: fishbell <bell.song@intel.com>

* reuse icore from core

Signed-off-by: fishbell <bell.song@intel.com>

* cpu,gpu case fallback to original code, CI failure

Signed-off-by: fishbell <bell.song@intel.com>
2022-01-27 13:52:25 +08:00
Milana Shhanukova
aa518282b0 updat gna configs (#9920) 2022-01-27 08:50:15 +03:00
David Nam
78a1212a90 Implement interpolate-1 and interpolate-4 in template plugin test (#9704)
* Implement interpolate-1 and interpolate-4 in template plugin test

* Fix clang error

* Fix clang error

* Fix clang error

* Fix linux build

* Fix cpplint error

* Fix clang error

* Fix linux build

* Change way to pass attribute into struct for linux build

* Correct supported type

* Fix clang error

* Add visitor api test for interpolate-1 and interpoate-4

* Fix typo and cpplint

* Update copyright

* Avoid using a class that will be deprecated

* Rollback to CoordinateTransform

* Remove interpolate.in.cpp
2022-01-27 08:27:34 +03:00
Kelvin Choi
00b7f58152 [GPU] enable validate after adding reorder (#9594) 2022-01-27 13:08:35 +09:00
Anastasia Kuporosova
c7eeda0247 [Python API] Align openvino/__init__ files (#9871)
* [Python API] Align openvino/__init__ files

* style fix
2022-01-26 21:16:34 +03:00
Mikhail Letavin
a90bb1ff01 [GPU] Force shared surface cache cleanup in RemoteContext (#9816) 2022-01-26 19:19:29 +03:00
Nikolay Tyukaev
e0c10c1a6f nbdoc cmake (#9869) 2022-01-26 18:45:16 +03:00
Zhang Yi
f23714fe65 fix klocwork scan (#9785) 2022-01-26 18:26:55 +03:00
Mikhail Nosov
6d40e5df96 'If' deserialization fixes (#9881) 2022-01-26 17:50:43 +03:00
Egor Shulman
68423cef40 [CPU] Coverity fixes (#9838) 2022-01-26 17:43:28 +03:00
Xin Wang
26ccbe9ebc Change internal function name to avoid loop issue. (#9890)
* Change internal function name to avoid loop issue.

* Fix comment.
2022-01-26 17:35:31 +03:00
Anastasia Popova
84f2e9fc24 Parameter/Result tensor names fix (#9754)
* Added tensor names checking transformation. Added framework name saving to tensor names list for input/output cut.

* Small fixes.

* Fixed tensor propagation in PowerToEltwises.

* Corrected tensor checking.

* Corrected tensor checking.

* Fixed MemoryOffsetAdjustment().

* Fixed tensor propagation for Yolo, ONNXMaskRCNNTransformation().

* Small fix.

* DetectionOutput tensor name set.

* Tensor name set for Reshape node in OD API.

* Temporarily added set of tensor names in ConvertGroupedStridedSlice.

* Small corrections, added tests.

* Added checks.

* Added deafault names setting.

* Moved default names setting to single place.

* Added port normilize befor setting tensor names.

* Fixed ResultRename logic.

* Removed tensor setting of unset ports.

* Corrected input cut tensor naming.

* Corrected InputCut, renamed set_tensor_names()->add_tensor_names().

* Fixed tensor setting for InputCut.

* Code corrections.
2022-01-26 17:23:46 +03:00
Mikhail Nosov
8f94d6dd3f Fix unity build for 'inference_engine_s' target (#9899)
Without fix, build of 'cpuUnitTests' will fail as 'inference_engine_s' will contain:
IE_STATIC_DEPENDENT_FILES = file_utils.cpp
$<TARGET_OBJECTS:${TARGET_NAME}_obj> - containing 'unity_cxx' which includes 'file_utils.cpp'
This causes multiple definition error of all methods inside file_utils.cpp
2022-01-26 17:11:40 +03:00
Alexandra Sidorova
1d82294e00 [CPU] Fixed dynamic Concat with negative axis (#9861) 2022-01-26 17:10:34 +03:00
Vladislav Volkov
c026f8348b [CPU] Fix for memory leak in MKLDNNTensorIteratorNode (#9903) 2022-01-26 16:59:41 +03:00
Anton Dudchenko
022abf8614 [IE][VPU]: Don't compile myriad custom layers and tools for ARM (#9912) 2022-01-26 16:30:32 +03:00
Maksim Doronin
e46b629950 [IE][VPU]: dynamic hswish and gather downgrade (#9915)
* Dynamic HSwish
* Gather8 to Gather7 downgrade
2022-01-26 16:28:03 +03:00
Mikhail Nosov
2ea52bae6e Fixes of plugins.xml generation (#9922)
- Added registration (and unregistration) of ov_auto_batch_plugin. Otherwise 'BATCH' plugin will always produce new XML line without removing old one
- Added unregistration of legacy plugin names (<= 2021.4 release). Otherwise old lines like "libHeteroPlugin.so" will not be removed from plugins.xml file
2022-01-26 16:00:04 +03:00
Indira Salyahova
17c394c8fe [POT] Update patterns (#9786)
* Update special_patterns.py

* add pattern in docs
2022-01-26 14:59:51 +03:00
Indira Salyahova
cf49cd6ce8 fix: check batch bias shape equal one in fbc (#9907) 2022-01-26 14:37:43 +03:00
Ilya Churaev
251897a91a Removed old cmake scripts (#9876) 2022-01-26 14:24:30 +03:00
Ilya Churaev
d2c92d26be Added offline transformation to all target (#9893) 2022-01-26 14:23:59 +03:00
Irina Efode
ed273ab47a [IE TESTS][IE CONFORMANCE] Allow to specify body extracting in statistic and subgraphDumper (#9797)
* [IE TESTS][IE CONFORMANCE] Allow to specify body extracting in statistic and subgraphDumper

* Fix link
2022-01-26 11:35:36 +03:00
Nikita Malinin
1524ff898a Update IEEngine with annotation for async (#9909) 2022-01-26 11:13:01 +03:00
Mingyu Kim
1d417e888b Spacing fix (#9894)
* Update benchmark_app.hpp

* Update benchmark_app.hpp
2022-01-26 08:46:05 +03:00
Milana Shhanukova
d81d7f15a1 do not change shape for scalars (#9751) 2022-01-25 19:37:34 +03:00
song, bell
f2e5788035 use priority queue for timeout issue (#9765)
* use priority queue for timeout issue

Signed-off-by: fishbell <bell.song@intel.com>

wrap tbb pq

Signed-off-by: fishbell <bell.song@intel.com>

clang format

Signed-off-by: fishbell <bell.song@intel.com>

fix potential dead-lock

Signed-off-by: fishbell <bell.song@intel.com>

fix arm build

Signed-off-by: fishbell <bell.song@intel.com>

try fix build on arm

Signed-off-by: fishbell <bell.song@intel.com>

merge master

Signed-off-by: fishbell <bell.song@intel.com>

* remove debug info

Signed-off-by: fishbell <bell.song@intel.com>

* use atomic to replace the lock

Signed-off-by: fishbell <bell.song@intel.com>

* clang format

Signed-off-by: fishbell <bell.song@intel.com>
2022-01-25 18:44:46 +03:00
Eugeny Volosenkov
b57f1b0fb3 Delete check on port id in InputCut (#9796)
* delete refer_to_faq_msg(31)

* fix documentation

* fix documentation
2022-01-25 17:41:08 +03:00
Indira Salyahova
0ecbe50bf5 [POT] Optimize quantization scheme for SPR/ATS (#9564)
* feat: delete fq from branch

* delete transformation

* pylint

* delete gpu_ats

* add tests

* pylint
2022-01-25 17:37:45 +03:00
Nikita Malinin
6927547f9c [POT] Update IEEngine with raw output processing (#9777)
* Update IEEngine with raw output processing

* Update ieengine output layers naming

* Pylint fixes

* Update replace with the regex method

* utils.py newline

* Pylint fix
2022-01-25 17:37:12 +03:00
Yury Gaydaychuk
365bd7c46e [CPU] DefConv fixed for small channels (#9718) 2022-01-25 17:26:00 +03:00
Vitaliy Urusovskij
0282f11165 Fix control flow issue (#9865)
* Fix control flow issue

* Extend exception messages in TF PB parsing
2022-01-25 17:23:59 +03:00
Eugeny Volosenkov
439e3b26aa Model Optimizer incorrectly convert per-channel Quantize/Dequantize operatros to FakeQuantize (#8321)
* add q_dq_resolver

* prepare FQ for offline transfornations

* fix quantize_dequantize_linear_resolver.py

* fix tools/mo/openvino/tools/mo/middle/dequantize_linear_resolver.py

* enable compress_quantized_weights.py

* fix sub case

* delete force_clean_up

* add isolated attribute

* add test for quantize_dequantize_linear_resolver

* fix comments

* apply comments

* aplying comments

* applying comments

* applying comments

* Replace q_dq_resolver using pattern

* clean imports

* fix imports

* fix pattern

* delete refernce to unit tests
2022-01-25 15:35:43 +03:00
Pavel Durandin
9f343fa37f Device memory fix for benchmark app (#9880) 2022-01-25 15:10:34 +03:00
Mateusz Tabaka
fa605a2760 Fix begin and end mask in StridedSlice in builder::opset1::flatten (#9837) 2022-01-25 13:04:36 +01:00
Maxim Andronov
94d403a1eb [CPU] Don't set subnormals to zero for rnn packed format (#9836) 2022-01-25 14:58:41 +03:00
Sergey Lyubimtsev
54203a2095 Fix for setting PATH to openvino libs installed from pip in windows conda env (#9892) 2022-01-25 14:58:19 +03:00
Anton Chetverikov
88903ee7ae Remove incorrect layout changing (#9764) 2022-01-25 14:10:06 +03:00
Mang Guo
9a522137bf Hot fix fir regression on Mac (#9895) 2022-01-25 13:47:37 +03:00
Ekaterina Aidova
2385a16e80 [OMZ]: try update submodule (#9830)
* [OMZ]: try update submodule

* check conflict resolving
2022-01-25 13:29:30 +03:00
Jan Iwaszkiewicz
1e58c55678 [PYTHON] Allow ports as inputs for infer methods (#9839)
* Use of ports for input values

* Refactor tests

* Fix inputs overwritting

* Fixed for review comments

* Remove unused branch and refactor ie_api.py
2022-01-25 13:19:12 +03:00
Anton Pankratov
f45991bd64 OV 2.0 c++ configuration API (#9870)
* New configuration API

* Review fix

* review coments

* fixed device name map

* fixed header

* code stile

* fixed optimization capabilities

* flatten properties

* dox fix

* doc

* merge conflicts

* fixed merge conflicts

* Fixed subobject linkage warning

* foramt fix

* Fixed unity test build

* Merge conflict fixes

* Fixed variadic
2022-01-25 12:43:56 +03:00
Evgenya Stepyreva
3bd6eb6dcd Dimension tracking: Label propagation along with partial value propagation (#9834) 2022-01-25 12:35:56 +03:00
Evgenya Stepyreva
4a85982427 mark sensitive inputs in all Interpolate ctors (#9883) 2022-01-25 12:04:27 +03:00
Victor Kuznetsov
013d3f01a0 Change thresholds for MemCheck nightly (#9879)
* add performance hint to time infer

* change th-ds for mtcnn-o
2022-01-25 11:30:51 +03:00
song, bell
2b9e726040 enable batching plugin through auto (#9520)
* initial commit

Signed-off-by: fishbell <bell.song@intel.com>

* remove debug code

Signed-off-by: fishbell <bell.song@intel.com>

* fix bug  with CPU,GPU

Signed-off-by: fishbell <bell.song@intel.com>

* refine code and test case for auto batching

Signed-off-by: fishbell <bell.song@intel.com>

* optimize the batching query

Signed-off-by: fishbell <bell.song@intel.com>

* refine test case

Signed-off-by: fishbell <bell.song@intel.com>

* optimize if/else

Signed-off-by: fishbell <bell.song@intel.com>

* fix sporadic crash

Signed-off-by: fishbell <bell.song@intel.com>

* refine logic

Signed-off-by: fishbell <bell.song@intel.com>

* refine case

Signed-off-by: fishbell <bell.song@intel.com>

* temp solution to disable batching in auto

Signed-off-by: fishbell <bell.song@intel.com>

* add debug logs

Signed-off-by: fishbell <bell.song@intel.com>

* merge with #9724

Signed-off-by: fishbell <bell.song@intel.com>

* refine the logic

Signed-off-by: fishbell <bell.song@intel.com>

* accurate debug message

Signed-off-by: fishbell <bell.song@intel.com>
2022-01-25 16:28:49 +08:00
Alexey Lebedev
fe5c16ba6a [tools] Allow to use node name in command line parameters in python benchmark app (#9874)
* support node names in model specific parameters

* allow to use node name in -i parameter
2022-01-25 11:16:56 +03:00
Pavel Esir
41d4fcdf25 [MO] Add reverse_infer (input rank deducing) for set of operations (#8928)
* grouped convolution resolver fix

* add reverse_infer for Transpose, Elementwise, Identity and some fixes to successfully OOB convert MXNet models

* add reverse_infer for BatchNorms, dynamic groups fix, multi_box_prior.py fix

* add reverse infer for trivial cases

* input rank setting for image detection ops

* reverse_infer for Gather, AttributedGather add todo comment for Parameter

* reverse infer for LSTM, swapaxis; fixes and unit-tests for Elementwise, Gather, Transpose; also generalized Parameter reverse_infer; fixed DetectionOutput and partial reverse_infer

* clarified comment for LSTM reverse_infer

* detalized Elementwise reverse_infer, added several more unit-tests, Split reverse_infer fix, IteratorGetNext_ext.py fix

* generalized group convolution resolver

* specified in_ports explicitly

* clarified Split, Concat, Parameter, other minor typos

* relaxed compatibility check for elementwise; simplified scalar extracting for convolution.py and gather.py, fixed replacer order for ConvolutionNormalizer.py

* added routine set_input_shapes for image detection ops

* fixed typos to pass locally E2E, slightly changed LSTM reverse_infer

* VariadicSplit reverse_infer bugfix

* IteratorGetNextCut.py added check if port is connected

* explicitly specified in_port, added asserts, improved Split reverse infer

* sorted imports

* reverse_infer for ONNX and MXNet LSTM, GRU, RNN operations

* replaced Error raising with red warning

* added missing return for defined input shapes, fixed getting num groups for tf conv

* added mandatory attributes; fixed failing unit-tests, fixed typo with scalar group in ConvolutionNormalizer

* removed priorbox reverse_infer; Parameter reverse_infer corrected to use the only one existing out_port

* fixed clarify_partial_shape_test
2022-01-25 10:14:41 +03:00
Anastasia Popova
d27bbb4bdd Preserve inputs and outputs order for TensorFlow 2 and MXNet models (#9683)
* Preserve outputs order TF.

* Preserve of input/output indices for MxNet.

* Small fix.

* Added check.

* Small fix.

* Corrected Keras model importing.

* Fixed Keras model loading.

* Small correction.

* Corrected model loading.

* Small fix.

* Comment corrected.

* Removed unnecessary import.
2022-01-25 10:13:05 +03:00
Victor Kuznetsov
6f60a7d8f0 First time inference validation for dynamic shapes (#9671)
* add performance hint to time infer

* add reshape methods for time infer tool

* add func declarations to common_utils.h

* add check if node is static (reshape pipeline)

* changes in desc of reshape funcs

* fix logic operator

* add reshape utils.h | move parsing logic in main func

* add tests_shared_lib to CMakeLists.txt

* change fill blobs with setStaticShapesBlobs

* change delimiter
2022-01-24 16:19:03 +03:00
Anastasia Popova
ce533fc287 Preserve input/output order for ONNX. (#9352)
* Preserving of input/output indices for ONNX.

* Fixed checks.

* Fixed for case of multiple outputs of node before Result.

* Added test for multiple tensor names before Result.

* Multiple tensor names before Result  fix.

* Added order alignment for user input/output.

* Extended for case of input names in Parameter tensor list.

* Fixed unit tests.

* Corrected help.

* Small correction.

* Code refactoring.

* Temporarily reverted refactor.

* Fixed wrong changes.

* Fixed wrong changes.

* Returned reverted refactoring.

* Removed inputs_list from serializing.
2022-01-24 15:50:28 +03:00
Mang Guo
413fee2a86 [CPU] Enable cache for MVN (#9549) 2022-01-24 15:07:35 +03:00
tgubanova-lohika
7114253d17 [GPU] Implement Gelu7 operation support (#9813)
* [GPU] Add Gelu tanh approximation support

* [GPU] Register op7::Gelu operation in gpu plugin.

* [GPU] Add op7::Gelu operation tests to GPU single layer tests
2022-01-24 15:05:34 +03:00
Irina Efode
ec38a88b60 [IE TESTS] Conformance migration to OV2.0 (#9092)
* Squashed commit of the following:

commit a9fa429b2d
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 28 13:33:16 2021 +0300

    cpu fix

commit 86bf737e0a
Merge: 15dd12613 f743fee0f
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 28 13:16:37 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 15dd126139
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 28 13:13:08 2021 +0300

    Fix myriad

commit 39ed74825d
Merge: e61d3fcf9 6416b7385
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 28 11:00:43 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit e61d3fcf91
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 28 10:41:58 2021 +0300

    try to fix myriad

commit 5e435d6fd9
Merge: 17e3172ad a0a70ab53
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 27 18:43:15 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 17e3172ad3
Merge: 759326e50 a46db8a72
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 27 17:20:28 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 759326e50d
Merge: bee267747 ac5b0e881
Author: Efode, Irina <irina.efode@intel.com>
Date:   Tue Oct 26 16:57:28 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit bee2677471
Merge: 4bab8e2ba 445292b07
Author: Efode, Irina <irina.efode@intel.com>
Date:   Tue Oct 26 11:35:09 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 4bab8e2ba6
Author: Efode, Irina <irina.efode@intel.com>
Date:   Tue Oct 26 11:34:54 2021 +0300

    skip gpu

commit 034c3c0dc2
Merge: 105d44db7 65d6010e4
Author: Efode, Irina <irina.efode@intel.com>
Date:   Tue Oct 26 10:27:30 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 105d44db7d
Merge: fd171ee27 1858fa385
Author: Efode, Irina <irina.efode@intel.com>
Date:   Mon Oct 25 16:19:16 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit fd171ee275
Author: Efode, Irina <irina.efode@intel.com>
Date:   Mon Oct 25 16:02:38 2021 +0300

    Fixes according to new api

commit 9ff7886d23
Merge: 0a9534cdd 86208efd5
Author: Efode, Irina <irina.efode@intel.com>
Date:   Mon Oct 25 14:04:43 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 0a9534cdd0
Author: Efode, Irina <irina.efode@intel.com>
Date:   Mon Oct 25 14:02:36 2021 +0300

    Fix tests

commit 410c703682
Merge: 50740fd5c dfefb9216
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 21 23:53:54 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 50740fd5ca
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 21 23:53:37 2021 +0300

    fix tests

commit 709cf57a2a
Merge: 866ec7494 c9dc922f3
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 21 16:21:48 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 866ec74944
Merge: 2ee8c92df 0f282b687
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 21 14:34:02 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 2ee8c92df6
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 21 11:22:42 2021 +0300

    return in, out, prc

commit 5a492efa3b
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 20 15:17:16 2021 +0300

    ieFuncTests

commit 404aa787e9
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 20 15:08:22 2021 +0300

    Fix build

commit 6c7fee7f66
Merge: 75440ce24 028d78a90
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 20 14:48:05 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 75440ce241
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 20 14:42:55 2021 +0300

    Apply Maxim's comments

commit 230a1298b8
Merge: 0feed998e 17914d516
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 20 11:33:51 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 0feed998e3
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 20 00:25:22 2021 +0300

    Remove incorrect OPENVINO_ASSERT, correct eltwise tests and fix threshold

commit a504be8440
Merge: 86f10b5c1 ac9c2f19d
Author: Efode, Irina <irina.efode@intel.com>
Date:   Mon Oct 18 18:23:50 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 86f10b5c11
Author: Efode, Irina <irina.efode@intel.com>
Date:   Mon Oct 18 14:46:41 2021 +0300

    Remove In,OutPrecision

commit 5ed1394735
Merge: 2c86940cc 2079563e4
Author: Efode, Irina <irina.efode@intel.com>
Date:   Fri Oct 15 15:52:20 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 2c86940cca
Merge: 2b19f6c60 d21572d7c
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 14 18:42:27 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 2b19f6c607
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 14 17:05:24 2021 +0300

    fix oss build

commit 537c0536f9
Merge: 1393c9c80 eb838d569
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 14 15:09:29 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 1393c9c805
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 14 01:34:14 2021 +0300

    Remove old dynamism

commit fadf43ecb7
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 14 01:27:24 2021 +0300

    Eltwise

commit 49633d43c6
Author: Efode, Irina <irina.efode@intel.com>
Date:   Thu Oct 14 00:52:41 2021 +0300

    Adopt eltwise

commit bb2b6e2f76
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 13 23:49:28 2021 +0300

    fix softmax

commit 77fceb6478
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 13 21:56:38 2021 +0300

    Remove extra

commit 568116859a
Merge: 707d549ce 7b1a418bf
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 13 20:19:58 2021 +0300

    Merge remote-tracking branch 'upstream/master' into layer_test_common

commit 707d549ce8
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 13 20:19:43 2021 +0300

    Add configure model

commit d09dc07a3f
Author: Efode, Irina <irina.efode@intel.com>
Date:   Wed Oct 13 14:33:14 2021 +0300

    Fix cpuFuncTests

commit 4df40629b0
Author: Efode, Irina <irina.efode@intel.com>
Date:   Tue Oct 12 00:09:10 2021 +0300

    fix size of expected

commit 4e32737bc2
Author: Efode, Irina <irina.efode@intel.com>
Date:   Mon Oct 11 21:20:58 2021 +0300

    try adopt softmax

commit c66d8626e4
Author: Efode, Irina <irina.efode@intel.com>
Date:   Mon Oct 11 18:23:26 2021 +0300

    Init

* init

* test

* Merge fix

* test

* tmp

* fix build

* print config

* correct merge

* Tmp

* fix merge

* move

* Remove extra

* Extend

* tnp

* Fix eltwiae

* fix node

* psroipolling

* roipolling

* roialign

* Remove extra lines

* detection_output

* tmp

* fix

* MNS

* Remove extra lines

* Bucketsize

* Remove extra lines

* If + Apply some comments

* Apply comments

* Add logical ranges

* Fix win + Apply comment

* Fix my comments

* Try to fix win

* CPU fix

* fix python

* debug

* fix nms

* Aplly Ilya's comments
2022-01-24 14:59:15 +03:00
Ilya Lavrenov
138fb37fde Use clang-12 for U20 (#9867) 2022-01-24 14:23:16 +03:00
Vladislav Volkov
951dc97997 [CPU] Optimizations for FQ in planar layout (#9832) 2022-01-24 14:07:36 +03:00
Mikhail Nosov
1b3ca1b671 Fix klocwork warning (#9800)
Functionality is already covered by tests. In case of incorrect logic, like
`need_validate=need_validate || impl.build(...)` some test cases will fail
2022-01-24 13:59:30 +03:00
Mikhail Ryzhov
aaf4ba0b51 [GNA] Enabled the new tests (#9753)
* Enabled the new tests

* Enabled unsupported precisions

* Added additional checks
2022-01-24 13:41:14 +03:00
Chen Xu
3437a2c9e7 [CPU]Implement TopK-3 to CPU plugin (#6272) 2022-01-24 13:30:27 +03:00
Anastasia Kuporosova
a8b59458d1 [Python API] Move old python bindings (#9134)
* [Python API] Remove offline transformations from old python api

* [Python API] Move wheel folder to the python dir

* codestyle files

* [Python API] Move old python bindings

* move api

* one more codestyle

* fix install stage

* remove unexisting file from gitignore

* flake8 style

* try to fix jenkins

* undo comments

* return variable

* remove cpack

* fix after merge

* try to fix version

* fix test

* remove debug info

* version of python

* try to fix pyversion

* update tests

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2022-01-24 13:16:07 +03:00
Mikhail Kozlov
40b4356537 Default IO precision for vpux and myriad (#9845) 2022-01-24 13:03:22 +03:00
Svetlana Dolinina
b9293dc424 changed Exit op infer function implementation: re-write in new API to avoid unmasking of shapes (#9664) 2022-01-24 12:12:02 +03:00
Alexander Zhogov
6c2d1e923c Revert "OV2.0 c++ configuration API (#9829)" (#9860)
This reverts commit 50da8c4aed.
2022-01-24 11:29:09 +03:00
Liubov Talamanova
b738983c1f [POT] Change version.txt location (#9715)
* Change POT version.txt location

* Update version

* Added version.txt to wheel

* Fix install requires
2022-01-24 11:22:12 +03:00
Nikita Malinin
5fe10299ab [POT] Small references update (#9831)
* Update golds and tolerance

* Disable mtcnn at sanity
2022-01-23 12:27:30 +03:00
Krzysztof Bruniecki
ede5da5a96 Update doc and thrown message (#9770)
* Update doc and thrown message

* Review
2022-01-21 19:54:55 +03:00
Sergey Lyubimtsev
dbae4fef18 Update install guides for PyPI (#9760)
* update copyright

* Inference Engine -> OpenVINO™ Runtime

* Update package names

Update link to release notes
Update link to Inference Engine guide
Add note about plugins supported on macOS

* update names in headers

* trademarks

* beautify wording
2022-01-21 19:31:08 +03:00
Alexey Suhov
dfaaa45b5a Move licensing to docs folder in install package (#9842) 2022-01-21 19:14:02 +03:00
Ilya Churaev
f6fe714213 Fixed collisions with auto-generated operation names (#9737)
* Added test to reproduce issue with names generation

* Resolve names collisions

* Added additional check

* Added transformation to fix generated names

* Fixed comments

* Fixed tests

* Moved resolve names transformation to plugin pipeline
2022-01-21 18:53:07 +03:00
Anton Pankratov
50da8c4aed OV2.0 c++ configuration API (#9829)
* New configuration API

* Review fix

* review coments

* fixed device name map

* fixed header

* code stile

* fixed optimization capabilities

* flatten properties

* dox fix

* doc

* merge conflicts

* fixed merge conflicts

* Fixed subobject linkage warning

* foramt fix
2022-01-21 18:44:41 +03:00
Egor Shulman
cf84f43b78 [CPU] Fix FuseConvolutionSumAndConvolutionSumActivation (#9595) 2022-01-21 17:24:46 +03:00
Andrei Molotkov
d6bcfb7b8f [GPU] Sporadic failure test was fixed (#9748) 2022-01-21 17:12:53 +03:00
Mateusz Bencer
82cc7165e7 Fall back to legacy path if input freezing feature is used (#9668) 2022-01-21 16:46:59 +03:00
Chenhu Wang
8ebe75f81a [CPU] ROIAlign jitted optimization (#9421) 2022-01-21 16:17:10 +03:00
Nikolay Tyukaev
c4a4382d84 Nbdoc change source (#9739) (#9811)
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>

Co-authored-by: Jakub Debski <jakub.debski@intel.com>
2022-01-21 15:31:56 +03:00
Mikhail Nosov
d8e557b39c FrontEnds.cmake: FEM include headers as public (#9792)
ONNX/Paddle/TF frontends: added 'standalone_build' target to verify that frontends can be used standalone by applications
2022-01-21 13:43:07 +03:00
Artyom Anokhov
101e762969 [Scripts][Driver] Updated script logic with approved for 2022.1 driver (#9801)
* install_NEO_OCL_driver: Updated script logic with approved for 2022.1 release drivers.

Removed COS7 support and checksum.

* Update scripts/install_dependencies/install_NEO_OCL_driver.sh

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Update scripts/install_dependencies/install_NEO_OCL_driver.sh

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* install_NEO_OCL_driver: Removed _is_package_installed function

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>
2022-01-21 13:38:51 +03:00
Alexander Zhogov
79ff926b6d Revert "OpenVINO runtime Configuration API (#7750)" (#9828)
This reverts commit 400e9ad916.
2022-01-21 13:30:39 +03:00
Jan Iwaszkiewicz
967fc0a756 Added callable CompiledModel (#9812) 2022-01-21 13:27:51 +03:00
Mikhail Nosov
7f10473b96 Loop/If/TensorIterator - fix dynamic input cases (#9752)
* Loop/If/TensorIterator - fix dynamic input cases
Reference evaluate for body uses Model::evaluate instead of custom evaluation
Loop/TensorIterator additional fix - set result shape according to body execution result

Only op_eval test verifies issues, template tests were added just in case (these passed even without fix)

* Fix clang-format

* rename ti.cpp
2022-01-21 13:27:20 +03:00
Victor Kuznetsov
0f4f2ebade Change thresholds for MemCheck nightly (#9815)
* add performance hint to time infer

* fix th values for memcheck nightly
2022-01-21 11:54:29 +03:00
Serhii Pavlovskyi
01096508f9 [GPU] Disable range layer gpu test (#9819)
* move gpu functional tests for range to correct location

* disable range layer test on gpu

it needs dynamic shapes support

Co-authored-by: Serhii Pavlovskyi <spavlovskyi@lohika.com>
2022-01-21 11:04:40 +03:00
Anton Pankratov
400e9ad916 OpenVINO runtime Configuration API (#7750)
* New configuration API

* Review fix

* review coments

* fixed device name map

* fixed header

* code stile

* fixed optimization capabilities

* flatten properties

* dox fix

* doc

* merge conflicts

* fixed merge conflicts
2022-01-21 10:32:57 +03:00
Vladislav Golubev
a3e2dbe353 [LPT] MoveFQ fix (#9821) 2022-01-21 10:06:17 +03:00
Taylor Yeonbok Lee
78db56d92d [GPU] Make cl_dump to distinguish program (#8763)
* Make cl_dump to distinguish program

* Applied review comment
2022-01-21 06:37:08 +03:00
Evgenya Stepyreva
d977b7238a Divide partial value propagation fix (#9822) 2022-01-21 03:38:53 +03:00
Alexander Zhogov
df27fd5d47 Azure CI: Add ccache for ARM (#9817)
* Azure CI: Add ccache for ARM

* Add a few required options

* Fix work dir
2022-01-21 02:01:06 +03:00
Mateusz Bencer
70ccd0e91f Handle special cases during fallback (#9651) 2022-01-20 23:34:24 +01:00
Evgenya Stepyreva
5aa43d560a 51145 (#9795)
* 51145 - PriorBox dynamic shape propagation

* code style
2022-01-21 00:32:04 +03:00
Jan Iwaszkiewicz
e39614954b [PYTHON] Return InferRequestWrapper as shared pointer (#9805) 2022-01-20 23:22:42 +03:00
Vladislav Golubev
fd754ab917 SimplifySecondInputOfReshapeFix (#9809) 2022-01-20 22:47:40 +03:00
Ivan Tikhonov
29d73ce3c8 FrontEnd ConversionExtensions (#9070)
* Squash commit: implement Conversion extensions

* Refactor PaddlePaddle FrontEnd

* Codestyle

* FrontEnd,InputModel,Place base classes -> abstract, renamed model file

* Fix unit tests

* fix unit tests

* ngraph:: to ov::

* Rename frontends dir to frontend

* fix merge conflicts

* Fix ConversionExtension

* get rid of NamedInputs/Outputs in TF FE

* Rename paddlepaddle to paddle; pdpd to paddle

* add missing file

* codestyle

* Remove local change

* paddlepaddle -> paddle for azure configs and .md files

* fix package name, fix config files

* Fix win build

* Revert Broadcast/AutoBroadcast changes

* codestyle

* fix FronEnd class

* fix ngraph_cpp_api.config

* fix incorrect merge, codestyle

* fix conversion extension

* conversion extension

* codestyle

* merge master

* fix build

* refactoring; revert broadcast/autobroadcast changes

* codestyle

* fix MacOS config

* resolve merge conflicts

* refactor includes

* register ConversionExtension in FrontEnds

* move get_op_type to base NodeContex class

* set op_translator map in ctor of Paddle FE; fix unit tests

* update unit tests; codestyle

* codestyle

* preliminary version of conversion extension in pybind

* conversion extension

* get_attribute_as_any method for NodeContext

* move get_attribute methods to NodeContext base class, rename get_ng_input to get_input

* add missed file

* Implement ov::Any getter in ONNX NodeContext

* fix py bindings

* Add update ConversionExtension unit tests, add SO unit tests, fix TF FE

* fix segfault on destructor

* fix NodeContext interface, fix unit tests

* set different names for ConversionExtensions in unit tests

* fix PaddleFuzzy tests

* fix Paddle Fuzzy tests

* revert changes in generate_slice.py

* fix codestyle

* fix pybindings

* revert local changes in generate_slice.py

* delete duplicate exceptions.hpp

* Refactoring: fix names according to convention

* pybinding for NodeContext, FrontEnd, ConversionExtension; fix unit tests; implement new unit tests

* Refactoring

* fix the case when a new converter rewrites existed one; delete unnecessary NodeContext from pybindings; use CreatorFunctons from the base class in ConversionExtension; update unit tests

* Revert local change

* PythonAPI: fix get_attribute method; fix get_input method; implement support of dtype and default attributes

* Fix py unit tests: add support for vector<ov::element::Type> as attribute

* resolve review comments

* fix unit tests

* move extension_holder to openvino/frontend/extension folder

* fix build on mac os

* temporary disable cast from vector<bool> to investigate issue on mac os

* Resolve review comments

* Resolve review comments

* Use dev API for .so extension

* Link frontends to pyopenvino as separate targets

* Temporary enable tf fe installation

* ignore PEP8 E402 for init files, set correct directory for py modules

* revert local changes

* Fix deadlock in pybind GIL; fix Win build; fix PEP8

* fix PEP8

* Add a return type annotation

* fix builds; fix ON/OFF switcher for ENABLE_OV_xxx_FRONTEND cmake options

* Fix the issue with ifdefs on WinOS; fix the issue related to pybindings and static c++ object

* fix python unit tests

* fix static build on WinOS

* Retrigger CI builds

* Fix static build on Windows

* fix static build on Windows again

* Retrigger CI

* delete unused includes; add a comment about issue on MacOS

* fix missprint

* resolve review comments

* fix missprint

* resolve review remarks

* Resolve review comments

* win win wheels build

* resolve review comments
2022-01-20 20:44:31 +03:00
Anton Chetverikov
ff6a9a1179 [MO] Fix normalize_outputs MaxPool function condition (#9613)
* Fix condition to correct handling MaxPool1 with only 1 output port

* Update check condition

* Add unit tests

* Sort imports

* Add comment
2022-01-20 19:52:42 +03:00
Gleb Kazantaev
61762fbaf0 Update Transformations For Dynamic cases (#9803)
* Dynamic support

* Update transformations
2022-01-20 19:48:29 +03:00
Krzysztof Bruniecki
68ef22a53d Add CNN1D limitation for stride > filter, add negative tests, simplify (#9506)
Pad filter when effective stride > filter
    Add tests with stride bigger than filter
    Add stride not aligned to 8 from review
2022-01-20 19:14:44 +03:00
Evgeny Talanin
ae648614d9 Revert "OMZ submodule update. (#9771)" (#9802)
This reverts commit d98909289a.
2022-01-20 17:32:22 +03:00
Mikhail Nosov
7126bef2be [Python Bindings] Frontend test for telemetry extension (#9768)
* Python bindings - test for telemetry extension

This also ensures that actual 'Telemetry' object containing callbacks is still alive even there is no explicit Python objects holding it

* Fix pylint

* fix clang-format
2022-01-20 16:44:54 +03:00
Nikita Malinin
ed634bd18e [POT] Tests & References update (#9694)
* Enable disabled tests

* Update references

* Update references

* Update passes.py for FP16 graph

* Update precision for nightly mobilenet

* Update references

* Update refs and disable model

* Update nightly refs

* Update nightly

* Revert mbv2 sanity gold
2022-01-20 16:23:00 +03:00
Ilya Lavrenov
8f3d030d79 Removed ov::runtime namespace (#9781)
* Removed ov::runtime namespace

* clang-format

* Fixes

* template reference

* Fixes
2022-01-20 16:17:57 +03:00
Smirnov Grigorii
29c3b8e201 Update SmartReshape tests to check tensor and node names (#68694) (#9633)
* add name checks but some tets in sss fail

* delete <utility> header

* update SS squeeze tests

* move util functions and correct node replacement

* delete anonymous namespace
2022-01-20 15:29:29 +03:00
Alexander Zhogov
686dad066a CODEOWNERS: Add IE Paddle frontend 2022-01-20 14:32:43 +03:00
Alexander Zhogov
850bf4a025 dependbot: Disable creating PRs 2022-01-20 14:14:00 +03:00
Sergey Lyubimtsev
9ead9b4831 Remove test_utils package from distributions (#9780) 2022-01-20 13:27:51 +03:00
Evgenya Stepyreva
b18d0644c4 Dim tracking essentials (#9559)
* Dim tracking essentials
2022-01-20 12:31:22 +03:00
Sergey Shlyapnikov
89868df352 [GPU] Fix eltwise's inputs indexes calculation and order of dimensions (#9778) 2022-01-20 11:15:40 +03:00
Wilson Seok
22fae50229 Add slt in template plugin/region yolo (#8886)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of region_tolo

* add type_prop test and remove backend test of region_yolo

* apply type conversion for loading file test and add bf16 test case in skip_test_config

* change location of compile definition under target and use path_join from file_util

* add dependency of test_model_zoo

* apply ov::Model

* remove unnecessary

* changed compile definition of TEST_FILES

* skip test cases of external test file

* remove test cases of importing data file
2022-01-20 09:27:42 +03:00
Mikhail Kozlov
42309d1a65 Change name of vpux plugin (#9744) 2022-01-20 09:01:55 +03:00
Anton Romanov
d554713bf9 Enable python tests (#9623) 2022-01-20 01:09:54 +03:00
Vitaliy Urusovskij
1ae0618dee Fix memleaks caused by SetupDiGetClassDevs() (#9746)
To prevent leaks, object should be cleaned up
by calling SetupDiDestroyDeviceInfoList()
Refer to https://docs.microsoft.com/en-us/windows/win32/api/setupapi/nf-setupapi-setupdigetclassdevsw#remarks
2022-01-19 23:54:59 +03:00
Ekaterina Matrosova
d98909289a OMZ submodule update. (#9771) 2022-01-19 23:00:42 +03:00
Mikhail Nosov
9f2cb8e102 [PyBind] Fix crash on destroying dtype_to_ov_type static map (#9772)
* Use std::string for static map instead of py::str

Probable reason is that this static map is destroyed after 'pybind' module is destoryed itself, thus py::str can't be cleaned up properly

* Added test via 'subprocess' execution of separate file
2022-01-19 21:01:18 +03:00
Yuan Hu
403339f8f4 [AUTOPLUGIN] not select if only one device (#9730)
* if only one Device, not select

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* modify test case to match logic

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2022-01-19 17:13:29 +03:00
River Li
d792545365 [PYTHON] Add python APIs for loadNetwork and compile_network without device name (#9536)
* [PYTHON] Add python APIs for loadNetwork and compile_networt without device name

   CVS: https://jira.devtools.intel.com/browse/CVS-75249

Change-Id: Ia28e35f4ee66fc8fc5997b5bafe1b159670f9a21
Signed-off-by: River,Li <river.li@intel.com>

* Fix clang issue

Change-Id: I9988b16863af0e3883e99369f124cd05761d3210

* Fixed positional arguments issue

Change-Id: I6c3aa98bb693a619fa54fd6e96cf5eb89cdb9369

* Fixed 2 blank lines issue

Change-Id: I7f2afd7ebb80867a69d0c3ac9a6d4a38d95edb12

* Set AUTO as default device if no device name is set

Change-Id: Ic8646b12af0a2ab2fec6a07f5a12d460dcf781d7

* Resolve comments from code reviewer

Change-Id: Ia47faeb48937096e41e22ac59fbd88ec82cc6733
2022-01-19 16:09:15 +03:00
Maxim Andronov
204ca99dac [CPU] Migration to API 2.0 (#9456) 2022-01-19 14:45:28 +03:00
Maxim Shevtsov
81685c8d21 Enabling auto batching for the GPU when tput hint is set (#9724)
* moving the HETERO logic to the Auto-Batch (WIP), reverting to the ALLOW_AUTO_BATCHING and using that in the GPU remote tests

* shortned the vars names in the ie_core and prevented recursive auto-batching calls by checking for exclusive requests and disabling further auto-batching in the plugin, when HETERO is involved

* checking for the batch-dim presence (this is still WA until the https://github.com/openvinotoolkit/openvino/pull/9559 is merged) - pls see CVS-75317
+clang for the ie_core.cpp

* moving the HETERO logic back to the ie_core.cpp, storing the _so internally for no-batch code-path
2022-01-19 14:05:13 +03:00
Tomasz Dołbniak
59456efbfa Use ninja in the OV-ONNX CI build stage (#9685) 2022-01-19 13:14:31 +03:00
Nesterov Alexander
81d45c0c6e Init arm ci (#9757) 2022-01-19 13:12:59 +03:00
Alexander Zhogov
b8bea9a034 CODEOWNERS: Rename multi->auto plugin 2022-01-19 13:03:02 +03:00
Sofya Balandina
6d14875387 [IE TEST] Fix missing falls of HoldersTest in case of crash (#9277) 2022-01-19 12:21:42 +03:00
Mingyu Kim
de4bd44a38 [benchmark_app] Fix spacing (#9759) 2022-01-19 12:16:40 +03:00
Sergey Shlyapnikov
0a225c2d84 [GPU] Fix fusions indexes calculation in b_fs_yx_fsv32 pooling kernel (#9756) 2022-01-19 11:18:53 +03:00
Mikhail Nosov
690e7a5958 Local build seems good today (#9402) 2022-01-19 11:15:40 +03:00
Maxim Vafin
32b1c509d5 Fix data type of inserted constants for means and scales (#9741) 2022-01-19 11:09:22 +03:00
Vladislav Volkov
483fe51f71 [CPU] Fusing of transpose and reorder is disabled for dynamic shapes (#9705) 2022-01-19 10:50:19 +03:00
Victor Kuznetsov
6a9519be8a Update list of OMZ models for stress tests (#9750)
* add performance hint to time infer

* del octave model
2022-01-19 10:09:49 +03:00
Vladimir Paramuzov
57e918c7b2 [GPU] Added WA for wrong TensorDesc in InferRequest for some outputs (#9734) 2022-01-19 13:06:53 +09:00
Maxim Gordeev
ec3283ebe1 [IE SAMPLES] activated NCC tool for c++ samples (#9600)
* [IE SAMPLES] activated NCC tool for c++ samples

* exclude ov_ncc_naming_style for tests

* fixed NCC hit

* Added support for source files in samples

* changed style of methods for benchmark

* changed style for speech sample

* changed code style

* changed code style for shared_tensor

* benchmark changes

* changed remote_tensors_filling

* fixed notes

* rebase of branch
2022-01-19 01:08:07 +03:00
Alexey Suhov
a79830cb55 Update year to 2022 in copyright notice (#9755) 2022-01-19 01:07:49 +03:00
Dmitry Pigasin
071dc5aef6 [IE Python Speech Sample] Fix problem with different utterance names in input files (#9678)
* Fix problem with different utterance names in input files

* Update file utils

* Change cw arg errors to pass tests

* refactor variable names
2022-01-18 23:21:25 +03:00
Alexey Lebedev
9a59e871eb [PYTHON API] fix hash operator for ports (#9673)
* Fix get_node call

* Add operators and define hash

* rename infer request property

* add new line

* remove unused var

* Move tensor getters to InferRequestWrapper

* check node hash

* add new line

* fix samples

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
2022-01-18 21:09:03 +03:00
Mateusz Tabaka
aae5fbf8e9 Allow non constant pad_value in PadFusion's pattern (#9740)
Useful in cases when pad_value is a subgraph marked as decompression
which cannot be constant folded, but still, Pad can be eliminated
if pad_value evaluates to zero.
2022-01-18 18:28:42 +01:00
Sofya Balandina
832b5d0f60 [IE TEST] Fix converiting to constant in applying of meta info (#9666) 2022-01-18 19:08:20 +03:00
Bo Liu
d520e5558f add hardware support description for Paddle models (#9731)
* add hardware support description for Paddle models

* fix 'Fast-SCNN' name
2022-01-18 18:40:03 +03:00
Nadezhda Ageeva
d09c09d9fd [GNA] Deprecate GNA_SW mode (#9738) 2022-01-18 18:26:55 +03:00
Mateusz Bencer
0843555ff0 switch onnx to default path for MO (#9661) 2022-01-18 16:01:10 +01:00
Indira Salyahova
0082c7a286 [POT] set shape in FBC if undefined dimension in model (#9532)
* fix: set shape in fbc if undefined dimension in model

* Update tools/pot/openvino/tools/pot/algorithms/quantization/fast_bias_correction/algorithm.py

Co-authored-by: Liubov Talamanova  <piccione-mail@yandex.ru>

* Apply suggestions from code review

Co-authored-by: Liubov Talamanova  <piccione-mail@yandex.ru>

* update shape in bc id dynamic shape

Co-authored-by: Liubov Talamanova  <piccione-mail@yandex.ru>
2022-01-18 17:48:30 +03:00
Tomasz Dołbniak
456a5c65e3 Friendly names setting in ONNX FE (#9682) 2022-01-18 17:46:23 +03:00
Mateusz Tabaka
79e442eea6 [VPU] Convert precisions on input/output blobs (#9115) 2022-01-18 15:43:27 +01:00
Andrey Noskov
0824bc65d1 [GNA] Deleted logs from test (#9721)
* [GNA] Deleted logs from test

* removed commented code

Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
2022-01-18 16:01:37 +03:00
Mateusz Tabaka
14f525e96e Fix FakeQuantizeMulFusion on weights (#9515) 2022-01-18 13:44:33 +01:00
Ivan Vikhrev
41aadfd116 remove ifdef opencv related to load & dump configs (#9736) 2022-01-18 14:08:45 +03:00
Fedor Zharinov
14f8614da6 Benchmarkapp: Added processing of inputs/outputs by index (#9703)
* Added processing of inputs/outputs by index

* fix

* All tensor's get_friendly_name are replaced with get_any_name

* stylefix
2022-01-18 13:40:54 +03:00
Maxim Vafin
96e7ee58e1 Optimize and simplify ConvertCompressedOnlyToLegacy transformation (#9702) 2022-01-18 13:30:28 +03:00
Mateusz Bencer
5fe228bc14 Intorduce json model analysis feature on the new path (#9618) 2022-01-18 11:18:19 +01:00
Ilya Churaev
a8381f71f9 Fixed coverity issue for inference component (#9688)
* Fixed coverity issue for inference component

* Removed noexcept
2022-01-18 12:43:10 +03:00
Gleb Kazantaev
18eaaedb39 Fix If operation validation function (#9726) 2022-01-18 12:41:50 +03:00
Egor Duplensky
3a9dba7362 [CPU] [DEBUG CAPS] Implicitly enable perf counters for verbose mode (#8754)
Also refactor debug capabilities configuration.
Now debug caps config parameters are the part of plugin configuration.
2022-01-18 12:32:53 +03:00
Svetlana Dolinina
71b7c7000a Changed permutes mechanics for Kaldi (#5744)
* changed permutes

* fixed permutes

* fixed kernel

* fix transpose after convolution

* fix for convnet

* insert transposes for all convolutions and poolings

* refactor transformations;
added unit tests;
removed old transformations for addinf permutes/reshapes

* fixed constant types

* fixes after merge

* fixed bug for rm_cnn4a: added correct time_dim for the first convolution

* added fix for timeheightconvolution: in this case we have correct time set in convolution kernel already

* minor review fixes: renamed transformation and file

* rename in test

* rename in test

* sort imports + couplt changes in comments

* review fixes: refactoring

* replaced recursive implementation by nx.topological_sort;
fixed comments

* minor fixes: comment + preserving node names
2022-01-18 12:10:51 +03:00
Anton Chetverikov
919ada63ad Update undefined dimensions parcing im parameter extender (#9699) 2022-01-18 12:02:30 +03:00
Katarzyna Mitrus
18309852ba Update Model::reshape to rethrow currently handled exception (#9723)
* Update Model::reshape to rethrow the currently handled exception

* Set expected type of exception in TestInvalidReshape
2022-01-18 11:49:02 +03:00
Tingqian Li
89f4a569d5 [CPU] Reuse the new nGraph shape infer functionality to the MKLDNN plugin (#9220) 2022-01-18 11:46:35 +03:00
Tingqian Li
822cb48a1e [CPU] Add cache support to transpose node (#9513)
* Add cache support to transpose

* Re-enable test case

* comments apply
2022-01-18 11:29:32 +03:00
Ivan Vikhrev
a2cf98bebb [IE Samples] json configuration reader and dumper for benchmark_app (#9648)
* added load_config and dump_config functions implemented with json library

* add warning, upd readme

* Update samples/cpp/benchmark_app/README.md

Co-authored-by: Fedor Zharinov <fedor.zharinov@intel.com>

Co-authored-by: Fedor Zharinov <fedor.zharinov@intel.com>
2022-01-18 11:22:47 +03:00
Nadezhda Ageeva
eb9e2c986a GNA: move transformation test (#9716) 2022-01-18 11:17:21 +03:00
Yegor Kruglov
9b129b7c1a [MO] Support MXNet Operations: batch_dot, LayerNorm, div_sqrt_dim (#7641)
* Add new operation support

* Update range_like replacer

* Move layer normalizer to middle

* Update bom file

* Update bom

* removed ArangeLike op

* updated bom

* added tests

* Updated docs

* comments relolving

* resolve documentation merge conflict

* arange_like op

* Revert "arange_like op"

This reverts commit a30f5bbb48.

* fixes in div_sqrt_dim

* comments resolving

* updated tests

* added batch_dot and layer_norm descriptions

* updated batch_dot comment

* updated comment

* move extractors to mxnet folder

* added replacer for batch_dot

* Revert "added replacer for batch_dot"

This reverts commit 8c0e52f7dc.

* return fully connected normalization

* fix typo

* updated fully connected normalization for mxnet

* changed assert message

* fixed gamma and beta shape incompatibility problem

* fixed imports, updated unittest

* resolve comments

Co-authored-by: iimironov <iliya.mironov@intel.com>
2022-01-18 11:12:30 +03:00
Tingqian Li
ff2df42339 [CPU] Add cache support for normalize (#9508) 2022-01-18 10:06:52 +03:00
Vladimir Paramuzov
4c36f8d16d [GPU] Allow 3d fsv16 layout for quantize and reduce prims (#9697) 2022-01-18 09:44:16 +03:00
Maxim Andronov
dd8a073aa4 [CPU] FullyConnected leftovers (#9621) 2022-01-18 09:14:29 +03:00
Mikhail Nosov
26f222dea5 [Tests] Graph comparator - take sinks into accounts (#9695)
* Graph comparator - take sinks into accounts

Previously graph has been traversed only from Results, so any differences in 'Sinks' were not detected

* Fix functional tests

* Update after internal discussion

* Fix low_latency_test (addition to low_latency_v2_test)

* Fix typo
2022-01-18 09:01:05 +03:00
Gleb Kazantaev
72942471de Added MO root directory search to simplify MO execution process (#9681)
* Added MO root directory search to simplify MO execution process

* Update sys.path

* Simplify implementation
2022-01-18 01:58:22 +03:00
Sergey Lyubimtsev
5ebbad9bcf Fixes for scripts (#9640)
* fixes for scripts

* reduce to warning python bitness check
2022-01-17 21:54:05 +03:00
Nikolay Tyukaev
a6c97000c5 update requirements (#9714)
* update requirements

* fixes
2022-01-17 17:38:15 +03:00
Ilya Churaev
6c0cddec78 Removed redundant sources from core component (#9689)
* Removed redundant sources from core component

* Fixed CC build

* Removed redundant includes
2022-01-17 16:16:03 +03:00
Maxim Shevtsov
7ca9641ead Auto batch ov2.0 API support+tests (#9672)
* additional OV 2.0 tests for Auto-Batching

* adding 2.0 way of creating the requests

* performance counters support
2022-01-17 16:00:35 +03:00
Yuan Hu
580a0f30eb [AUTOPLUGIN] Add format string checker for log information (#9592)
* add limit format on snprintf

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add limit on format

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add test case

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix a bug for LOG_TRACE

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* remove debug info
2022-01-17 14:50:01 +03:00
Anton Chetverikov
394e5c5515 Change nGraph serializer behavior for dynamic dimensions (#8526)
* Change dynamic_to_static to dinamic_to_undefined function to use -1 values instead of upperbounds in serialized IRs

* Resolve conflict after src files transition

* Remove resolve_dynamic_shapes function

* Fix typo

* Fix codestyle
2022-01-17 14:43:09 +03:00
Nadezhda Ageeva
56581dbe2e [GNA] Support new kaldi irs (#9474)
* Support new kaldi IRs (generated in NHWC layout)

* Update tests with activation and fq

* Cleanup

* Fix reordering FQ and MaxPool and problem with overflow

* Fix win

* Update src/plugins/intel_gna/transformations/unfuse_reshape_and_transpose.hpp

Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>

* Update src/plugins/intel_gna/transformations/unfuse_reshape_and_transpose.cpp

Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>

* Update inference-engine/tests/unit/gna/ngraph/transformations/gna_unfuse_reshape_and_transpose.cpp

Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>

* Code review

Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>
2022-01-17 14:16:23 +03:00
Andrey Somsikov
3c7589184d Do not force gold linker for sanitizer builds (#9680)
Gold linker fails to link tests built with sanitizer
2022-01-17 13:14:42 +03:00
Maksim Shabunin
76a74f3f2d Fixed compilation of user code with VS2015 (#9644) 2022-01-17 12:53:28 +03:00
Eugeny Volosenkov
0948a54f53 yolov4 conversion documentation is incorrect (#9143)
* Rewrite doc

* added addition info abot weights and cfg files

* fix path to cfg and weights

* fix description

* fix description

* fix description

* fix description

* fix description

* fix description
2022-01-17 12:32:18 +03:00
Luwei Zhou
a76483ddb2 [CPU] Enable CPU plugin cache for ShuffleChannels and SpaceToDepth (#9556)
* Space to depth.

* Shuffle Channels RT cache.

* Update

* Apllied reivew comments.

* Applied review comments.
2022-01-17 12:28:30 +03:00
Svetlana Dolinina
0ed3da0e86 add warning about order if both mean and scale set (#9284)
* add warning about order if both mean and scale set

* Update tools/mo/openvino/tools/mo/main.py

Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>

* removed warning, added phrase in documentation

* fixed merge

* added phrase about order of ,mean and scale in MO help

* duplicate MO help phrase in doc

* Update docs/MO_DG/prepare_model/convert_model/Converting_Model.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/MO_DG/prepare_model/convert_model/Converting_Model.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/MO_DG/prepare_model/convert_model/Converting_Model.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update tools/mo/openvino/tools/mo/utils/cli_parser.py

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update tools/mo/openvino/tools/mo/utils/cli_parser.py

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* remove tabs

* fix in order of reverse, mean, scale

Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
2022-01-17 12:12:06 +03:00
Mikhail Letavin
f2be2c915f [GPU] Implement dynamic shape case support for one dimension only (batch) via legacy dynamic batch functionality (#9314) 2022-01-17 12:02:52 +03:00
Sergey Lyubimtsev
98cbaf0f08 align numpy version range for openvino wheel package (#9669) 2022-01-17 12:00:04 +03:00
Anastasia Kuporosova
8f12b72f46 [Python API] Rename offline_transformations in the new api (#9634)
* [Python API] Rename offline_transformations in the new api

* remove comments

* one more place to rename

* fix mo building

* fix after merge

* fix for pot import
2022-01-17 11:57:00 +03:00
Krzysztof Bruniecki
97df59a4ab [GNA] Restore deprecated options for GNA Plugin (#9611)
* Restore deprecatet options for GNA Plugin

* Apply review use INFERENCE_ENGINE_DEPRECATED macro

* Deprecate PWL_UNIFORM_DESIGN and PWL_MAX_ERROR_PERCENT

* Add doxygen deprecation message

* Use string for deprecated config keys to avoid compile time errors

* Use IE_SUPPRESS_DEPRECATED_START

* Fixup lint

* Fix indentation

* Usue future release instead 2022.2 in deprecated message, supress deprecation error in tests

* Fix test
2022-01-17 10:32:02 +03:00
Vladimir Paramuzov
1fc013208d [GPU] Integer floor and floor_mod support (#9629) 2022-01-17 10:14:51 +03:00
Ilya Churaev
3d4e82dcd1 Added new tests for tensors element types (#9667) 2022-01-14 22:59:08 +03:00
Andrey Noskov
5ad242ecce [GNA] Added reset before and after export (#8900)
* [GNA] Added reset before and after export

* [GNA] Added query states check
2022-01-14 19:06:44 +03:00
Daniil Lyakhov
4693f7b854 [Offline Transformations] EfficientNet_b0 Pruning Transformation Enabling (#8926)
* Add include guard to file_utils.cpp

* Rebase src

* Rename acc tests, fix rebase

* Revert debug changes

* Fix linter

* Move ac tests to new template

* Test updated

* Fix result operation are sharing output tensor with previous op

* Pruning test visualzation option

* Add ac support for all test cases with pruned kernels

* Remove redundant files

* Enable extended pruning logging by env variable

* Adjust pruning tests

* Remove pruning extended debug env var

* Enable init masks only in debug mode

* Set result mask to input tensor instead of output tensor by separate key

* Bug fix / Test coverage

* Fix comments
2022-01-14 18:43:38 +03:00
Vladimir Paramuzov
4734b17e52 [GPU] Fixed USM shared blob allocation type (#9662) 2022-01-14 14:35:08 +00:00
Daria Mityagina
c1e2e0344b [ICV] Add flag to prevent IE from booting MX VPU (#9447)
An additional option whose purpose is to prevent the booting of the MX VPU when we want to generate some blobfile.
2022-01-14 17:15:51 +03:00
Irina Efode
720f78ebde [IE TESTS] Skip tests with Default device (#9643)
* [IE TESTS] Skip tests with Default device

* test
2022-01-14 16:56:53 +03:00
Jan Iwaszkiewicz
e1696deb3a [PYTHON] Expose If, Loop and TensorIterator API (#9603) 2022-01-14 14:30:30 +01:00
Roman Lyamin
baa1a8e59d [GPU] Add batching buffer to new API (#9565) 2022-01-14 16:02:19 +03:00
Wang, Yang
c7d216db13 passing by reference to fix performance inefficiencies. (#9590)
* passing by reference to fix performance inefficiencies.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Passing by const reference.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2022-01-14 15:33:58 +03:00
Jade Cho
9e01cbd532 [GPU] fix a minor bug of dump graph (#9659) 2022-01-14 15:06:58 +03:00
Tomasz Dołbniak
8b1514d49e Set additional tensor names only if necessary (#9652) 2022-01-14 12:44:50 +01:00
Anton Dudchenko
eb299f819e [IE][VPU] Rename and move VPU plugin to src/plugins (#9110)
* [IE][VPU] Rename and move VPU plugin to src/plugins

* Update some dependencies

* Change .md

* Update some dependencies

* Update some dependencies (again)

* I'll rename this one

* Remove ENABLE_MYRIAD arg

* Update XLink.cmake

* Update thirdparty CMakeList

* Minor fixes
2022-01-14 14:02:08 +03:00
Edward Shogulin
bd97d1edc6 [LPT] SharedValueAttribute extending (#9534)
* [LPT] SharedValueAttribute extending

* [LPT] tests + comments
2022-01-14 13:33:07 +03:00
Sergey Lyubimtsev
0ff88458f9 fix PyPI upload error: Invalid value for classifiers. Error: Classifier 'OSI Approved :: Apache Software License' is not a valid classifier. (#9656) 2022-01-14 13:09:12 +03:00
Anton Chetverikov
f4b0d40cd0 [MO] Skip rt_info in old graph comparator (#9638)
* Skip rt_info while graph comparing

* Remove incorrect comparing for rt_info
2022-01-14 12:49:12 +03:00
Anton Pankratov
790f02c0b1 Hetero creates single result node (#9572) 2022-01-14 12:26:39 +03:00
Nadezhda Ageeva
12ab842970 [GNA] Deprecate GNA_LIB_N_THREADS and SINGLE_THREAD parameters + sample update (#9637)
* Deprecate GNA_LIB_N_THREADS and SINGLE_THREAD parameters

* Remove deprecated options from sample

* Fix speech sample test

* Adds doxy deprecated comment
2022-01-14 12:20:36 +03:00
Mingyu Kim
645c44459c [GPU] Add formats for crop (#9660) 2022-01-14 12:19:18 +03:00
Vladislav Golubev
c734100ec5 [Transformations] SkipGather transformation (#9627)
* [Transformations] SkipGather transformation implemented

* review fixes
2022-01-14 12:17:03 +03:00
dependabot[bot]
29d57ad0a8 Bump tox from 3.23.1 to 3.24.5 in /src/bindings/python (#9497)
Bumps [tox](https://github.com/tox-dev/tox) from 3.23.1 to 3.24.5.
- [Release notes](https://github.com/tox-dev/tox/releases)
- [Changelog](https://github.com/tox-dev/tox/blob/master/docs/changelog.rst)
- [Commits](https://github.com/tox-dev/tox/compare/3.23.1...3.24.5)

---
updated-dependencies:
- dependency-name: tox
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-01-14 11:55:53 +03:00
Mateusz Tabaka
954172a010 [GPU] Don't optimize crop if its user is a reshape that can be optimized (#9537)
Crop uses more eltwise assign kernel which yields better performance than reshape_ref.
2022-01-14 11:51:02 +03:00
Vitaliy Urusovskij
583d97314a Remove skip for smoke_SetBlobCPU*PrecisionInNet=BOOL* (#9655) 2022-01-14 11:09:35 +03:00
Nikita Demashov
1df9f958e2 [LPT]MoveFakeQuantize resolved minor comments (#9614)
* Q/DQ + mulichannel support

backup

fix interval

mfk_functiun.cpp

WIP moveDequantizationBefore

add moveDequantizationBefore function

add cpu and gpu tests

attribute cmp false

attribute cmp false

rm temp line

mkl-dnn update

concat with multichanels for mOve_fake_quantize_function, bad runtime info for q/dq

rm extra qualification

fix run time info for q/dq

add support of multichanel fakequantize, bad test for it

work tests for multi chanel FQ

rm workaround

cpplint fix

cpplint fix

don't worl Variadic split

ieFuncTest work

cpuFuncTest work

Fix benchmark_app build (#7577)

[GPU] Added onednn dependency. (#6564)

cpp lint

cpplint

fix get_shape

fix fq constants

cpp lint

some fix in mfk.cpp

resolve conversations, add spil_nodes function

add new tests for multi-chanels, rename NetworkHelper::split_consts_before_concat()

fix get fq constants

* add new multi-chanels test and use constant_fold to split constant

* remove extra spaces

fix namespase terminated

fix namespase terminated

* resolved minor comments

* added check for convert_q
2022-01-14 10:40:10 +03:00
Nikolay Shchegolev
77c2c5fab3 [CPU] RNN node kernel caching. (#9588) 2022-01-14 09:28:05 +03:00
Luwei Zhou
d5fb0a0c24 [CPU] Enable Reorder node run time cache. (#9490) 2022-01-14 09:20:18 +03:00
Tomasz Dołbniak
320c89f0ab Obsolete xfail for 38722 (#9653) 2022-01-14 08:25:26 +03:00
Luo Cheng
68d8ca8060 MulticlassNms/MatrixNms: ngraph op support FP16 output (#9481)
* recover overwritten code in #8520

* support fp16

* update spec

* apply review comments

* support dynamic type check
2022-01-14 07:54:32 +03:00
Pavel Zamelin
2e59029e68 Fix build error with -DBUILD_SHARED_LIBS=OFF (#9639)
* Add _ov_frontends_hpp dependency to frontend_common_obj

* Move _ov_frontends_hpp dependency to frontend_common_obj
2022-01-14 07:53:14 +03:00
Ilya Lavrenov
9ef48cbe6d Moved NCC check to U20 (#9631) 2022-01-14 07:50:55 +03:00
Ilya Lavrenov
5affdc3284 Added NCC support for source files (#9630) 2022-01-14 07:50:30 +03:00
Vladislav Golubev
1f241277f4 [ngraph] Add UnsqueezeConcatReduceFusion transformation (#9183)
* [ngraph] Add UnsqueezeConcatReduceFusion transformation

* Quick refactoring & build fix

* Transformation disabled in the GNA Plugin

* Review comments applied

* codestyle fix

* test fix

Co-authored-by: Aleksandr Pertovsky <aleksandr.pertovsky@intel.com>
2022-01-14 07:36:55 +03:00
mei, yang
e6d062e395 remove option ENABLE_SHUTDOWN_PROTOBUF (#9619)
* remove option ENABLE_SHUTDOWN_PROTOBUF

* shutdown protobuf library is enabled automatically if protobuf is used in frontend
2022-01-14 05:02:26 +03:00
Mingyu Kim
11cb8ebf55 [GPU] New debug option to serialize execution of inferences (#9510) 2022-01-14 10:24:40 +09:00
Mateusz Tabaka
508af22c66 Add CompressQuantizeWeights transformation (#7538)
* Add CompressQuantizeWeights transformation

It's based on model-optimizer/extensions/back/compress_quantized_weights.py

* handle dequantization subgraph after quantization

* fix scale shift calculation

* remove TRANSFORMATIONS_API from CompressQuantizeWeights

* ZeroPointOptimizer

* add CompressQuantizeWeights pass to to ApplyMOCTransformations

* add comment

* fix code style

* cleanup

* ambiguous copy_runtime_info

* ambigous call

* fix case when zero_point is close to zero

* fix cf test case

* move files

* update tests

* add tests for evaluate_subgraph

* Address review comments

* make params static
2022-01-13 23:38:39 +01:00
Fedor Zharinov
6c69535d6c Benchmark_app batch calculation fix (#9554)
* BenchmarkApp - batch size calculation fix

* stylefix

* -ip/op fix

* stylefix
2022-01-13 23:34:38 +03:00
Fedor Zharinov
6a126ac6bb avg statistics calculation fix (#9612) 2022-01-13 22:57:20 +03:00
Anastasia Kuporosova
2944f39bac [Python API] Remove extra version info from get_version (#9645) 2022-01-13 22:38:02 +03:00
Maksim Proshin
ec0dd6051a [POT] Minor correction about OpenSource (#9625)
* Update README.md

* Update README.md
2022-01-13 20:10:34 +03:00
Mateusz Tabaka
8ba339d16f Eliminate no-op elementwise operations (#8840)
* Eliminate no-op elementwise operations

This change adds EliminateEltwise pass to NopElimination.
EliminateEltwise removes:
- Subtract with zero
- Multiply with one
- Divide by one

* add Add support to EliminateEltwise

* fix unit test

* use get_all_data_elements_bitwise_identical instead of get_single_value

* fix are_all_data_elements_bitwise_identical for constant created from HostTensor

* fix lpt tests

* check for mul in is_dequantization_subgraph function

* optimize fetching constant value

* apply review comments
2022-01-13 20:05:47 +03:00
Liubov Talamanova
cde61f2411 [POT] Fix bug with git (#9604)
* [POT] Fix bug with git

* Add UNKNOWN_VERSION constant
2022-01-13 19:56:18 +03:00
Nikita Malinin
0166cb8f5c [POT] New IE API integration (#9004)
* Initial commit for integration

* Apply latest updates

* Update ie_engine for multi input models

* Update reference, pylint fixed, method replacement

* Change for AC 2.0 support

* Update aac_engine with raw data processing

* Update for pylint

* Update model utils

* Disable pylint check

* Update ac_engine with the processing

* Using tensor names instead of friendly names

* Tensor names for all statistics

* BiasCorrection with tensor names

* Remove debug info usage

* Fix for sequential stats

* Fix for the scalar stats

* Update with comments

* Update tests & builder

* Update tests

(cherry picked from commit 5022ce4a4fac230ac11db68f14cd58971fe9b2a2)

* Executable_model -> compiled_model

(cherry picked from commit 0d447ff4917f764df76d9c0c0068277e5e090f3b)

* Update with PartialShapes for reshape

* Update async mode

* Update refs

* Update BC Parameter dtype

* Update simplified with inferqueue

* Disable ssd512 nightly

* BC renaming

* Revert OMZ commit

* Update references

* Update BC algo with the parameter selection

* Update AC config filter

* Pylint fixes

* Update async data

* Update pylint for ie_engine

* Update ie_engine

* Revert refs changes

(cherry picked from commit 4d3530216b3d79c33c3437a7dfcc1140693320c8)

* Update OMZ submodule
2022-01-13 19:21:37 +03:00
Chenhu Wang
b33dcd02c6 fix windows debug test failure (#9635) 2022-01-13 18:53:20 +03:00
Vladimir Paramuzov
20d9d551eb [GPU] Layout API improvement to replace direct named dimension usages from tensor (#9056) 2022-01-13 17:02:13 +03:00
Dawid Kożykowski
5059184789 remove unnecessary warning (#9243) 2022-01-13 14:50:56 +01:00
Vasily Shamporov
b7e8ef910d Fix a paragraph in LPT docs w.r.t mixed precision (#9570) 2022-01-13 15:58:14 +03:00
Ilya Lavrenov
fdee2d5728 Disabled dynamic Windows build in Azure (#9568) 2022-01-13 15:44:04 +03:00
Alexander Zhogov
04c9a55b45 Revert "Deprecate GNA_LIB_N_THREADS and SINGLE_THREAD parameters (#9486)" (#9632)
This reverts commit c06d4e7fb7.
2022-01-13 15:41:15 +03:00
Roman Kazantsev
a53a4da3a2 [MO, Frontends] Implement ChangePlaceholderType as Offline Transformation (#8245)
* [Common FrontEnd] Implement ChangePlaceholderType transformation with OldApiMap

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add ChangePlaceholderType pass into frontend normalize

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add a comment about the transformation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code review comments: remove ngraph namespace rountine, etc.

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove use of extra Node object in set_old_api_map call

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Create separate pass for legacy nGraph transformations for MO with new frontend

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build for ieFuncTests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue with namespace conflicts

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Revert "Fix build issue with namespace conflicts"

This reverts commit 50a189f4e5.

* Move legacy transformations to ngraph namespace

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue with unresolved MOCLegacyTransformation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Adjust code to new OldApiMap API

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Resolve merge conflicts

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Do not set legacy type for parameter in case user defined type

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2022-01-13 15:29:51 +03:00
Ilya Churaev
f74b9caabb Removed old dynamism API from infer request (#9557)
* Removed old dynamism API from infer request

* Fixed segfault

* Fixed some tests

* Added method to set inputs, outputs

* Fix python tests

* Try to fix window build
2022-01-13 14:54:14 +03:00
Ilya Lavrenov
9fe5165ffa Support of clang-11 (#9620) 2022-01-13 14:31:25 +03:00
Nadezhda Ageeva
c06d4e7fb7 Deprecate GNA_LIB_N_THREADS and SINGLE_THREAD parameters (#9486) 2022-01-13 14:30:41 +03:00
Maxim Andronov
2b996c32ad [CPU] FullyConnected dynamism support (#9380) 2022-01-13 13:18:02 +03:00
Gorokhov Dmitriy
c36afa495e Temporarily disable onnx_if_inside_if unit test on CPU (#9624) 2022-01-13 13:14:37 +03:00
Mikhail Nosov
fc6eff048f Python bindings: expose InputTensorInfo::set_memory_type (#9608)
* Exposing set_memory_type method

* Update quotes
2022-01-13 12:48:26 +03:00
Steve Yoo
a23a398dc0 Add SLT to Template Plugin: NonMaxSuppression-4,3,1 (#9511)
* Add SLT to Template Plugin: NonMaxSuppression-4

* Add SLT to Template Plugin: NonMaxSuppression-4,3,1
2022-01-13 12:42:56 +03:00
Jade Cho
35bcb77182 [GPU] Merge reorder into next onednn conv (#9601)
+ When the format of onednn convolution is bs_fs_yx_bsv32_fsv32, the reorder for dependency primitive of fused eltwise sum is removed.
2022-01-13 18:32:50 +09:00
Sergey Shlyapnikov
bd12648ec0 [GPU] Fix users invalidation and output layout recalculation in graph dump mode (#9439) 2022-01-13 12:29:43 +03:00
mei, yang
6ae0ba481e fix build issue on android on shutdown protobuf (#9615)
* fix build issue on android on shutdown protobuf

* add ie_dependent_option for shutdown protobuf
2022-01-13 11:47:54 +03:00
Mateusz Bencer
080477aa9c MO fallback to old path if some features are not supported yet (#9034) 2022-01-13 09:39:14 +01:00
Vladimir Dudnik
28fb55dffe [IE Samples][OV2.0] final clean up of old API headers (#9494)
* final clean up of old API headers, compile_tool separated from samples

* make cpplint happy
2022-01-13 11:12:20 +03:00
Jade Cho
113014161d Add a gpu func test to compare with ngraph runtime (#9591)
+ Compare conv result of gpu plugin with ngraph result.
2022-01-13 11:03:52 +03:00
Vladimir Paramuzov
ef3df6de03 [GPU] Fixed uninit axis field in pooling prim (#9598) 2022-01-13 10:53:20 +03:00
Vladimir Paramuzov
f68dd90413 [GPU] Get rid of PreAllocator usages to allow setShape (#9576) 2022-01-13 10:52:59 +03:00
Chen Xu
e329baef04 [CPU] Cache for Reduce node (#9519) 2022-01-13 10:42:24 +03:00
Vladislav Golubev
456347e1b6 [Transformations] ConvertDivide disabled transformation for divide ops from precision sensitive subgraphs (#9561)
* [Transformations] Skip ConvertDivide if Divide is on fp16 shapeOf subgraph

* lambda definition moved out of loop

* review fixes
2022-01-13 10:32:44 +03:00
song, bell
282f37cdae fix sporadic crash (#9616)
Signed-off-by: fishbell <bell.song@intel.com>
2022-01-13 10:25:53 +03:00
Zhang Yi
6d3f99c7db [CPU] Pooling & FakeQuantize cache (#9503)
* [CPUCache]Impl FakeQuantize

* [CPUCache]Impl Pooling

* [CPUCache]Fix Pooling ==

* [CpuCache]apply review comments

* [CpuCache]fix pooling ==
2022-01-13 10:25:39 +03:00
Mikhail Znamenskiy
5b40f381cb Fix for benchmark_app: set model stream flags (#9609) 2022-01-13 10:15:33 +03:00
Chenhu Wang
ac45196ce2 [CPU] Interpolate runtime params cache (#9524) 2022-01-13 10:01:02 +03:00
Mang Guo
f562e5572f [CPU] Enable cache for LRN (#9589) 2022-01-13 09:54:00 +03:00
Ilya Lavrenov
c3d2af7501 Fixed CVS-75003 (#9552)
* Fixed CVS-75003

* Allow dynamic shapes
2022-01-13 06:46:52 +03:00
Mingyu Kim
3ae3c8dfb5 [GPU] Enable a network with onednn deconv (#9597) 2022-01-13 12:03:08 +09:00
Indira Salyahova
c597bc8928 [POT] requirements install telemetry library (#9605)
* Update telemetry.py

* Update setup.py

* Update test_telemetry.py

* Update telemetry.py
2022-01-13 03:30:58 +03:00
Ilya Lavrenov
f222814f0c Updated documentation for OV Inference Runtime (#9573)
* Updated documentation for OV Inference Runtime

* Updated documentation

* Fixed comments
2022-01-13 01:05:17 +03:00
Eugeny Volosenkov
00da13b058 Support TF ScatterND and CenterNet (#9257)
* add ScatterND for tf

* Fix ApplyPermutation

* fix description of TFScatterNDDecomposition

* fix permutation

* fix package_POM

* fix pom file

* fix BOM file

* fix bom file

* Added layer tests for TF ScatterND

* fix comments

* fix bom file

* Add additional tests

* Add additional tests

* Added ConvertLike to ScatterND decomposition
2022-01-12 23:15:45 +03:00
Mikhail Nosov
896532ace2 [OV2.0] PrePostProcessor dump to output stream for debugging purposes (#9580)
* Calculate model layout based on 'tensor' layout and convert steps

Previously, 'model layout' is set to '...' by default,
thus no shape conversion happened when tensor layout is set to 'NHWC', then there was explicit convert_layout "NCHW"

Now "model layout" is calculated based on tensor layout and conversion steps:
Examples:
 1) Tensor: NHWC, Convert: NCHW. Result: NCHW
 2) Tensor: NHWC, Convert: 0312. Result: NCHW

* Initial move of tensor data calculation

* Moved 'impls' to new file

* Postprocessing + unit tests

* clang-format fix

* Added more details to preprocessing nodes
- Mean/Scale - will print mean/scale values
- Convert type - will print type
- Convert layout - will print destination layout
- Convert color - will print destination color

It is needed to troubleshoot the problems. If error occurs, message will not display last op's target shape/layout/type

* Add python bindings

* update tests

* Added memory type to dump if set

* Code style fix

* unity build fix

* Dump tensor if only memory type is set

* Added debug print

* Fix Param->Result case

Previously, layout was set by preprocessing set to old parameter as well
This is incorrect because in case of exception layout info will not be reverted

In this case old Result pointed to old Parameter and was able to preserve runtime info

After fixing of this, case Param->Result was broken if revalidation is not triggerred

Fix is to detect 'Result' as a consumer of some parameter and force revalidation in this case

* Revert occasionally committed line

* And one more line
2022-01-12 22:00:32 +03:00
Ilya Churaev
e78ada1178 Introduce dev_api for core component (#9571)
* Introduce dev_api for core component

* Fixed CPU plugin for static build

* Fixed comments
2022-01-12 20:23:18 +03:00
Vladislav Golubev
01689ee408 [CommonOptimizations] SimplifySecondInputOfReshape fix (#9210)
* [CommonOptimizations] SimplifySecondInputOfReshape fix

* GroupedGatherElimination: added Gather v8 support
2022-01-12 17:50:49 +03:00
Alexey Lebedev
4a6575b4b7 [PYTHON API] fix direct access to model input shape (#9562)
* Copy port shape to avoid direct access to shape buffer

* Add __eq__ for shape

* Add tests

* Fix getters

* add __setitem__

* Add a note about copy
2022-01-12 17:48:10 +03:00
Zlobin Vladimir
6840d945c7 omz: catch up https://github.com/openvinotoolkit/open_model_zoo/pull/3060 (#9602) 2022-01-12 17:23:19 +03:00
Alexey Lebedev
0a85417896 [tools] some fixes for python benchmark (#9584)
* rename inference_engine to OpenVINO

* correct exception for batch

* check all inputs to find batch dimension before throwing exception

* correct warning about batch

* avoid set_shape in static case

* refactoring latency output

* message about benchmarking mode

* use new precision naming

* use pass manager instead offline_transformations
2022-01-12 17:22:58 +03:00
Andrey Somsikov
9cf3359958 Add openvino_contrib to coverity scan (#9253) 2022-01-12 16:56:34 +03:00
Maxim Vafin
9fb9e19efa Fix output layout of tf yolo models converted with transformations config (#9583) 2022-01-12 16:25:35 +03:00
Nikita Malinin
cf344a3b73 Change rename_node for fq (#9599) 2022-01-12 12:44:58 +00:00
Mang Guo
171863e3ce [CPU] Enable CPU Plugin cache for roi_pooling (#9502) 2022-01-12 15:21:51 +03:00
Vladimir Zinoviev
b6d60a2c82 [LPT] Support FakeQuantize with convert on intervals (#9579)
* [LPT] Support FakeQuantize with convert on intervals

* [LPT] GPU tests
2022-01-12 14:50:19 +03:00
Ilya Churaev
12d92dfa2d Fixed itt_collector build (#9596) 2022-01-12 14:47:24 +03:00
Nikolay Tyukaev
2990049c93 doc-versions-from-server (#9437) 2022-01-12 14:40:07 +03:00
Mikhail Nosov
a6c9f9aeab Move 'NV12toRGB/BGR' reference evaluates to template plugin (#9548)
* Move 'NV12toRGB/BGR' reference evaluates to template plugin

CPU doesn't need this fallback, so implementation can be moved to reduce core binary size

* Moved evaluate_nv12 to 'runtime::reference'

* Fix arm build
2022-01-12 14:29:03 +03:00
Mateusz Tabaka
8ef08292a6 Reduce number of Reshape operations in RNN sequences decomposition (#9495)
Move Squeeze/Unsqueeze for hidden and cell state outside of tensor
iterator's body. So it's executed once per sequence instead of once
per cell.
2022-01-12 12:10:18 +01:00
Yury Gaydaychuk
b06c0b5c32 [CPU] DS support for Deformable Convolution (#8986) 2022-01-12 14:08:24 +03:00
mei, yang
613facafde ShutdownProtobufLibrary when unload paddle frontend dynmaic library t… (#9442)
* ShutdownProtobufLibrary when unload paddle frontend dynmaic library to fix probuf memory leak

* ShutdownProtobufLibrary if the frontend libraries use protobuf

* make shutdown_protobuf a library
2022-01-12 13:07:51 +03:00
Luwei Zhou
84bf5fa178 [CPU] Enable CPU plugin cache for DepthToSpace. (#9492)
* Enable CPU plugin RT cache for DepthToSpace.

* Applied review comments.

* Applied review comments.

* Apply reivew comments.
2022-01-12 11:43:24 +03:00
Wang, Yang
4546df5091 Enable THROUGHPUT by default for all the devices. (#9107)
* Set THROUGHPUT as the default configration for all the plugin and display the config of the plugin.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* updated format.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update benchmark python API.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Replace str 'THROUGHPUT' with CONFIG_VALUE(THROUGHPUT).

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Using CONFIG_VALUE(THROUGHPUT) replace 'THROUGHPUT' string.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* update code style.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Move the setting output code into the try block.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2022-01-12 11:09:54 +03:00
Mikhail Nosov
26a78fcb5d [OV2.0] Calculate model layout based on 'tensor' layout and convert steps (#9550)
* Calculate model layout based on 'tensor' layout and convert steps

Previously, 'model layout' is set to '...' by default,
thus no shape conversion happened when tensor layout is set to 'NHWC', then there was explicit convert_layout "NCHW"

Now "model layout" is calculated based on tensor layout and conversion steps:
Examples:
 1) Tensor: NHWC, Convert: NCHW. Result: NCHW
 2) Tensor: NHWC, Convert: 0312. Result: NCHW

* Fix for set_shape + resize case
2022-01-12 10:52:02 +03:00
Vitaliy Urusovskij
c1d7535044 Fix proposal_exec in ref impl (#9569)
ROI indices and ROI counter aren't cleaned up, so it led to segfault
2022-01-12 06:18:15 +03:00
Luwei Zhou
5bf44b92e1 [shape_infer]Implement shape inference of DepthToSpace,SpaceToDepth, BatchToSpace,SpaceToBatch (#8465)
* Implement the batch to space shape infer

* Implement the space_to_batch shape inference.

* Implement shape infer of space_to_depth and depth_to_space OPs

* Fix Azure building issue.

* Add namespace for the shape_infer function.

* Avoid using friend declaration for shape infer.

* update coding style issue

* Update based on review comments

* Apply review comments

* Add test cases.

* Update the shape infer flow.

* Fix the bug in the previous test case.

* Update coding style.

* Fix the code bug caused by the DepthToSpace check fix.

* update coding style.

* Implment the Dimension/StaticDimension division operator by a value

* Refine the the code.

* Fix the issue when T is implicitly construct StaticShape with PartialShape when comparing

* Update the CI issue.

* Move the shape_infer helper into src folder.

* Apply the review comments.

* Coding style fix.

* Remove the ngraph folder

* Applied review comments

* Fix CI windows building issue

* Move test into new folder.

* Not support divisor is negative.

* Apply review comments.

* Fix CI issues

* Apply review comments.

* Update

Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2022-01-12 00:32:14 +00:00
Vladimir Dudnik
6fbfd96ba0 update open_model_zoo submodule to add telemetry update (#9586) 2022-01-12 00:48:54 +03:00
Mang Guo
8b93880b37 [shape infer]BroadcastV3 and BroadcastV1 shape inference (#8976)
* Implement broadcastv3 shape infer

* Implement BroadcastV1 shape infer

* Use shape_inference in test case

* Fix myriadx test case failure

* Apply review comments

* Change file name

* Apply review comments

* Apply review comments

* Change broadcast bidirection logic to align with master change
2022-01-12 00:33:33 +03:00
Nikita Demashov
dce2aa2c0e [LPT]MoveFakeQuantize Q/DQ (#7430)
* Q/DQ + mulichannel support

backup

fix interval

mfk_functiun.cpp

WIP moveDequantizationBefore

add moveDequantizationBefore function

add cpu and gpu tests

attribute cmp false

attribute cmp false

rm temp line

mkl-dnn update

concat with multichanels for mOve_fake_quantize_function, bad runtime info for q/dq

rm extra qualification

fix run time info for q/dq

add support of multichanel fakequantize, bad test for it

work tests for multi chanel FQ

rm workaround

cpplint fix

cpplint fix

don't worl Variadic split

ieFuncTest work

cpuFuncTest work

Fix benchmark_app build (#7577)

[GPU] Added onednn dependency. (#6564)

cpp lint

cpplint

fix get_shape

fix fq constants

cpp lint

some fix in mfk.cpp

resolve conversations, add spil_nodes function

add new tests for multi-chanels, rename NetworkHelper::split_consts_before_concat()

fix get fq constants

* add new multi-chanels test and use constant_fold to split constant

* remove extra spaces

fix namespase terminated

fix namespase terminated
2022-01-11 22:49:16 +03:00
Smirnov Grigorii
e9be93aec5 try to delete header and cpp file (#9543) 2022-01-11 22:10:50 +03:00
Anastasia Popova
1a8506f205 Updated requirements for MO with telemetry. (#9431)
* Updated requirements for MO and POT with telemetry.

* Added mock telemetry common class for unit tests.

* Used mock telemetry in preprocessing unit tests.

* Small correction.
2022-01-11 19:54:49 +03:00
song, bell
3e9ae4bea7 Bell/release resource (#9222)
* recycle helper resources when hw is ready

Signed-off-by: fishbell <bell.song@intel.com>

* use cv to avoid additional while loop

Signed-off-by: fishbell <bell.song@intel.com>

* refine the logic

Signed-off-by: fishbell <bell.song@intel.com>

* fix potential threading issue

Signed-off-by: fishbell <bell.song@intel.com>

* refine logic

Signed-off-by: fishbell <bell.song@intel.com>

* avoid using global var

Signed-off-by: fishbell <bell.song@intel.com>

* clean up code

Signed-off-by: fishbell <bell.song@intel.com>

* refine

Signed-off-by: fishbell <bell.song@intel.com>

* release helper network/plugin also

Signed-off-by: fishbell <bell.song@intel.com>

* lock when release, avoid double release in destructor

Signed-off-by: fishbell <bell.song@intel.com>

* formatting

Signed-off-by: fishbell <bell.song@intel.com>

* add test case

Signed-off-by: fishbell <bell.song@intel.com>

* add case coverage

Signed-off-by: fishbell <bell.song@intel.com>

* move the task

Signed-off-by: fishbell <bell.song@intel.com>

* remove uncessary lock

Signed-off-by: fishbell <bell.song@intel.com>
2022-01-11 19:41:17 +03:00
Dmitrii Khurtin
91c89e77d8 Removed noexcept specifier; removed dead code and restored ostream format (#9563) 2022-01-11 19:01:34 +03:00
Nikolay Shchegolev
62e8923605 [CPU] Dynamic shapes. RNN node. (#9002) 2022-01-11 18:17:35 +03:00
Ilya Churaev
02cabcda3c Fixed coverity issues for core componets (#9558)
* Fixed coverity issues for core componets

* Fixed some tests
2022-01-11 17:28:50 +03:00
Vladislav Golubev
a49f1b3bc6 ConvertTensorIteratorToLSTMSequence fix (#9541) 2022-01-11 17:23:32 +03:00
Irina Efode
c6079ccc11 [IE TESTS] Add body to the reporting (#9430) 2022-01-11 17:21:50 +03:00
Irina Efode
f96a5183fb [IE TESTS] Fix Conformance report generation (#9577) 2022-01-11 17:21:17 +03:00
Anastasia Kuporosova
ab09135195 [Python API] Move wheel folder to the python dir (#9125)
* [Python API] Move wheel folder to the python dir

* codestyle files

* one more codestyle

* align with master

* ignore some flake8 comments
2022-01-11 16:55:18 +03:00
Dmitrii Khurtin
ddc4098473 [GNA] Fixed symbolic links in tarball (#9545) 2022-01-11 16:22:28 +03:00
Alexey Lebedev
42c5be23b1 [PYTHON API] infer helper (#9478)
* inputs as list in infer

* fix import

* fix import 2

* refactor test
2022-01-11 16:12:11 +03:00
Vladislav Volkov
6ddc1e981b Fix missing declarations for TBB_HYBRID_CPUS (#9567) 2022-01-11 16:06:37 +03:00
Vladimir Gavrilov
ebcd9eaf07 Fixed conversion of some models with (I)DFT when a layer immediately before (I)DFT is a producer for Result (#9489)
* Fix in the transformation PreserveRuntimeInfo: now Transpose is inserted before input port 0 of Result only, not after data node of layer before Result layer.

* Deleted commented code.

* Added more tests for the MO transformation PreserveRuntimeInfo.
2022-01-11 15:20:24 +03:00
Vladimir Zinoviev
acdbbf4363 [LPT] fix build (#9566) 2022-01-11 13:25:36 +03:00
Mikhail Nosov
bd3a996239 [OV2.0] Preprocessing: support convert HWC->NCHW layout (#9540)
* Initial implementation

* Template reference tests

* cpu & gpu tests for HWC -> NCHW conversion
2022-01-11 13:13:37 +03:00
Vladimir Paramuzov
062523c9e1 [GPU] Split fusion tests into separate files (#9553) 2022-01-11 12:52:12 +03:00
Roman Slivinskyi
c634f105e3 Atomic guard impromenents (#9473)
* Read atomic before doing CAS in the constructor.

* Typo

* Code style fix.

Co-authored-by: Roman Slivinskyi <rsl@keepit.com>
2022-01-11 12:33:36 +03:00
Mingyu Kim
ef390902ec [GPU] fp16-int8 mixed precision (#9483)
* Use fp16-int8 mixed precision, instead of fp32-int8 mixed precision for onednn
* Allow quantization fusion into bsv32_fsv16 conv
* For conv, do not select bsv16_fsv16. Select bsv32_fsv16 for mixed-layout
* depthwise conv is supported even though it is not fp16
* Allow resample kernel to work as cross-layout
* test case for cross-layout of resample_opt kernel
* Select onednn-friendly format from cldnn conv
* Optimization for fp16 mixed precision
* Choose mixed layout in case of mixed precision from reorder_inputs
* Support for mixed precision from depth_to_space
* Do not convert first conv format
* Use onednn for FC output of fp16
* Choose bsv8_fsv4 from quantization even when conv kernel size is not 7
* Select cldnn for first conv when input feature depth is 1
* For first conv, use onednn only when kernel size is 7x7
* Use short variable name and added is_i8_u8 helper function

Co-authored-by: Kim,SungEun <sungeun.kim@intel.com>
2022-01-11 17:56:36 +09:00
Edward Shogulin
2c6078e96c [LPT] Documentation (developer guide) (#7444)
* [LPT] Documentation

* 1) ToC was removed 2) SVG => PNG temporary conversion

* [LPT] Refactoring + developer guide

* [LPT] attribute doxygen documentation was added

* [LPT] Developer Guide to Reference API links were added

* [LPT] comments fixes

* [LPT] Reference API to Developer Guide links were added

* [LPT] titles were changed

* [LPT] comments fixes #2

* [LPT] root document was moved to Plugin DG

* [LPT] Documentation: image link quick fix

* [LPT] Docummentation: PrecisionsAttribute description quick fix

* fix comments from Karol

* fixes

* movement

* directive was added

* movement #2

* LPT reference in Executable Network rollback

* snippets were updated ini accordance with new API
2022-01-11 11:51:15 +03:00
Zhang Yi
986f0eaac6 [CPU] Impl extract_image_patches cache (#9525) 2022-01-11 11:03:10 +03:00
Ilya Sharikov
1a3d0adb3e Change omz model (#9551) 2022-01-11 10:56:50 +03:00
Jade Cho
28e52a0475 [GPU] Fix a bug of logical padding of convolution (#9518)
* [GPU] Fix a bug of logical padding of convolution

+ Transforms logical padding with wrong axis.

* Fix a typo bug.
2022-01-11 10:37:27 +03:00
Ilya Churaev
e095a90cdf Handle names collisions for old IR with new API (#9388)
* Handle names collisions for old IR with new API

* Fixed load model

* Try to fix tests

* Try to fix tests

* Try to fix build

* Try to fix tests

* Fixed tests

* Revert "Fixed tests"

This reverts commit 35da307210.

* Refactoring

* Fixed functional test

* Try to fix CPU tests

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-01-11 09:36:13 +03:00
Min, Byungil
e0485c1ad2 Add reshape in front of a fully connected node for using bf input (#9449)
Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-01-11 13:18:40 +09:00
Fedor Zharinov
fc4185e92a Compiled network loading is fixed (#9547)
* compiled network loading is fixed

* StyleFix
2022-01-10 23:37:46 +03:00
Vladimir Paramuzov
b4bd4e743b [GPU] Fixed uninitialized field issue in pooling (#9542) 2022-01-10 21:44:11 +03:00
Vladimir Zinoviev
b744c11b88 [LPT] INT16, INT32 leftovers (#7653) 2022-01-10 21:09:10 +03:00
Vladimir Paramuzov
0c2b53eba3 [GPU] Moved several module tests to proper folder (#9544) 2022-01-10 20:14:22 +03:00
Zhang Yi
c1206ef447 [CPU] SoftMax cache (#9480)
* [CPUCache]SoftMax cache

* [CpuCache]fix bf16 tests

* [CPUCache]apply review comments

* [CPUCache]fix compilation
2022-01-10 18:46:57 +03:00
Alexandra Sidorova
af105b86f8 [CPU] Fixed Replicate via ov::Model (#9252) 2022-01-10 17:51:33 +03:00
Anastasia Kuporosova
8fe5484645 [Python API] Remove offline transformations from old python api (#9121)
* [Python API] Remove offline transformations from old python api

* try to fix import error

* try to fix pylint

* try to fix pylint2

* Use new api in graph_utils

* Fix pylint

* Try to fix pylint

* Use serialize from pass manager

* try to skip tests

* try to use new ir

Co-authored-by: AlexeyLebedev1 <alexey.lebedev@intel.com>
2022-01-10 17:32:55 +03:00
Svetlana Dolinina
04386bb667 fixed tensor shapes to work correctly if shape of the first arg less then shape of the second arg; (#9368)
added according unit test
2022-01-10 17:15:21 +03:00
Vladimir Paramuzov
8d8ceeb5d7 [GPU] Fixed invalid vector element access in reduce test (#9538) 2022-01-10 15:08:11 +03:00
Yuan Hu
00361b7617 try to fix klocwork issue (#9207)
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2022-01-10 14:57:37 +03:00
Yuan Hu
b6951bfb2c change INT8 to VPUX as first priority (#9261)
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2022-01-10 14:54:21 +03:00
Anastasia Popova
aecbd549f8 Support of partial shapes with boundaries in MO IR reader. (#9223)
* Added support of partial shapes boundaries in MO IR reader.

* Added comments.
2022-01-10 14:36:36 +03:00
Ilya Znamenskiy
371eaba7cd [GPU] Fix of gws/lws inconsistency for some reorder cases (#9467) 2022-01-10 14:04:04 +03:00
Ilya Sharikov
cb0084718a Update list of OMZ models for stress tests (#9391) 2022-01-10 13:50:03 +03:00
Andrei Molotkov
9e41208791 [GPU] QueryNetwork method correction to work with dynamic shapes (#9462) 2022-01-10 12:07:12 +03:00
hyunback kim
2a476f6906 [GPU] Enable unet2d enable on DG2 (#9522)
* [GPU] Enable unet2d enable on DG2

Add to support is_os_yx_isa2_osa8_isv8_osv2 format, which is used in
weight reorder.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-01-07 18:38:07 +09:00
hyunback kim
89f48e0558 [GPU] Enable implicit concat batch1 in oneDNN. (#9424)
* [GPU] Enable implicit concat batch1 in oneDNN.

* Use gpu_usm memory offset, enable implicit concat batch1 in oneDNN.
  And optimized_out node doesn't always have to be mutable input,
  so add to check whether mutable input is existed in optimized node.
* Update to check use_usm condition in implicit concat.
* Add the condition for implicit concat.
* implicit concat's dependency should not be fused_op with eltwise.
* Buffer reuse is required for onednn sum post operation, output padding
did the buffer reuse failure.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-01-06 12:41:09 +09:00
Dawid Kożykowski
e89db1c6de Fix "Unexpected number of outputs after override_all_outputs" (#9454) 2022-01-05 12:10:16 +01:00
Min, Byungil
f255c195c5 [GPU] Add functional and pass test-cases (#8998)
Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-01-04 22:09:23 +09:00
Jade Cho
2945232982 Split hard sigmoid into eltw linear and eltw clip (#9500)
+ cldnn supports hard sigmoid activation function but onednn doesn't.
+ split it into eltwise linear and eltwise clip in
add_onednn_optimization_attributes pass.
2022-01-04 20:22:11 +09:00
Alexey Lebedev
339849fde8 [PYTHON API] add_extension api (#9339)
* Pass ov::extension in core.add_extension

* fix code style

* revert mock and inherit extension on python side

* Fix code style

* Enable add_extension test

* Fix code style

* Move Extension to openvino.runtime

* use static_cast instead c-cast

* Fix code style

* fix test
2022-01-04 13:54:15 +03:00
Tomasz Dołbniak
326289265b MO: progress bar implementation for new frontends (#9381) 2022-01-03 14:04:45 +01:00
Taylor Yeonbok Lee
c26a904c6e Disable blocked layout selection for quantize when the user is gemm beacuse no gemm kernels are using blocked format currently (#9425) 2022-01-03 09:58:16 +09:00
Maxim Vafin
738a571742 Use layouts in legacy pre-processing (#9355)
* Use layouts in legacy pre-processing

* Use layouts for batch in MO

* Unify code for channel and batch dimension

* Fix issue when idx is None
2021-12-30 21:01:55 +03:00
Mateusz Tabaka
50a33436d4 Add MatMulMultiplyFusion (#9023)
* Add MatMulMultiplyFusion

MatMulMultiplyFusion replaces following subgraph:
MatMul->Multiply (with const)
to following:
Multiply->MatMul
where Multiply is applied to MatMul's second input.
2021-12-30 18:13:11 +01:00
Fedor Zharinov
4dbc9ae2e7 benchmark_app with dynamic reshapes and API 2.0 (#8609)
* API 2.0 changes

* stylefix

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update samples/cpp/benchmark_app/infer_request_wrap.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update samples/cpp/benchmark_app/utils.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* fixes

* fix for: gpu headers are moved to another folder... yet again

* fix for mac build paranoia

* function,classes and files renames/change logic to work with inputs()

* stylefix

* 2nd portion of fixes

* stylefix

* Batch warnings

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2021-12-30 19:09:12 +03:00
Vladislav Volkov
e52c96389d [CPU] Bug in jit_convert fixed (#9485) 2021-12-30 18:22:16 +03:00
Edward Shogulin
ec5198094a [CPU] PriorBox & PriorBoxClustered dynamism enabling (#8597) 2021-12-30 17:43:16 +03:00
Maxim Andronov
8ba94cfb8f [CPU] Fix memory allocation for non default shape infer path (#9475) 2021-12-30 17:04:33 +03:00
Chen Xu
bea10d6e3c [CPU] Optimize Broadcast node for case with scalar input (#9358) 2021-12-30 16:47:48 +03:00
12638 changed files with 168441 additions and 92084 deletions

143
.ci/azure/android_arm64.yml Normal file
View File

@@ -0,0 +1,143 @@
trigger:
branches:
include:
- master
- releases/*
paths:
exclude:
- docs/*
resources:
repositories:
- repository: openvino_contrib
type: github
endpoint: openvinotoolkit
name: openvinotoolkit/openvino_contrib
jobs:
- job: android_arm64
# About 150% of total time
timeoutInMinutes: 120
pool:
name: LIN_VMSS_VENV_F16S_U20_WU2
variables:
system.debug: true
VSTS_HTTP_RETRY: 5
VSTS_HTTP_TIMEOUT: 200
BUILD_TYPE: Release
OPENVINO_REPO_DIR: $(Build.Repository.LocalPath)
OPENVINO_CONTRIB_REPO_DIR: $(OPENVINO_REPO_DIR)/../openvino_contrib
WORK_DIR: $(Pipeline.Workspace)/_w
BUILD_DIR: $(WORK_DIR)/build
ANDROID_TOOLS: $(WORK_DIR)/android_tools
ANDROID_SDK_VERSION: 29
ANDROID_ABI_CONFIG: arm64-v8a
TMP_DIR: /mnt/tmp
SHARE_DIR: /mount/cinfsshare/onnxtestdata
CCACHE_DIR: $(SHARE_DIR)/ccache/master/android_arm64
steps:
- script: |
curl -H Metadata:true --noproxy "*" "http://169.254.169.254/metadata/instance?api-version=2019-06-01"
whoami
uname -a
echo Python3 info ; which python3 ; python3 --version
echo Python info ; which python ; python --version
echo Java info ; which java ; java -version
echo gcc info ; which gcc ; gcc --version
echo cmake info ; which cmake ; cmake --version
lsb_release
env
cat /proc/cpuinfo
cat /proc/meminfo
cat /etc/fstab
vmstat -s
df
lsblk -o NAME,HCTL,SIZE,MOUNTPOINT | grep -i "sd"
free -h
displayName: 'System information'
- script: |
rm -rf $(WORK_DIR) ; mkdir $(WORK_DIR)
rm -rf $(BUILD_DIR) ; mkdir $(BUILD_DIR)
rm -rf $(ANDROID_TOOLS) ; mkdir $(ANDROID_TOOLS)
sudo rm -rf $(TMP_DIR) ; sudo mkdir $(TMP_DIR) ; sudo chmod 777 -R $(TMP_DIR)
sudo mkdir -p $(SHARE_DIR)
sudo apt --assume-yes update && sudo apt --assume-yes install nfs-common
sudo mount -vvv -t nfs cinfsshare.file.core.windows.net:/cinfsshare/onnxtestdata $(SHARE_DIR) -o vers=4,minorversion=1,sec=sys
mkdir -p $(CCACHE_DIR)
displayName: 'Make dir'
- checkout: self
clean: true
lfs: false
submodules: recursive
path: openvino
- checkout: openvino_contrib
clean: true
lfs: false
submodules: recursive
path: openvino_contrib
- script: |
set -e
$(OPENVINO_REPO_DIR)/install_build_dependencies.sh
# Move into contrib install_build_dependencies.sh
sudo apt --assume-yes install scons crossbuild-essential-arm64 libprotoc-dev protobuf-compiler default-jdk
# Speed up build
wget https://github.com/ninja-build/ninja/releases/download/v1.10.2/ninja-linux.zip
unzip ninja-linux.zip
sudo cp -v ninja /usr/local/bin/
# Install Android SDK, NDK and TOOLS
wget https://dl.google.com/android/repository/commandlinetools-linux-7583922_latest.zip
unzip commandlinetools-linux-7583922_latest.zip
yes | ./cmdline-tools/bin/sdkmanager --sdk_root=$(ANDROID_TOOLS) --licenses
./cmdline-tools/bin/sdkmanager --sdk_root=$(ANDROID_TOOLS) --install "ndk-bundle" "platform-tools" "platforms;android-$(ANDROID_SDK_VERSION)"
workingDirectory: $(WORK_DIR)
displayName: 'Install dependencies'
- task: CMake@1
inputs:
cmakeArgs: >
-GNinja
-DVERBOSE_BUILD=ON
-DCMAKE_BUILD_TYPE=$(BUILD_TYPE)
-DCMAKE_TOOLCHAIN_FILE=$(ANDROID_TOOLS)/ndk-bundle/build/cmake/android.toolchain.cmake
-DANDROID_ABI=$(ANDROID_ABI_CONFIG)
-DANDROID_STL=c++_shared
-DANDROID_PLATFORM=$(ANDROID_SDK_VERSION)
-DENABLE_OPENCV=OFF
-DENABLE_TESTS=ON
-DENABLE_SAMPLES=ON
-DENABLE_INTEL_MYRIAD=OFF
-DBUILD_java_api=ON
-DTHREADING=SEQ
-DIE_EXTRA_MODULES=$(OPENVINO_CONTRIB_REPO_DIR)/modules
-DCMAKE_CXX_COMPILER_LAUNCHER=ccache
-DCMAKE_C_COMPILER_LAUNCHER=ccache
$(OPENVINO_REPO_DIR)
workingDirectory: $(BUILD_DIR)
- script: ls -alR $(OPENVINO_REPO_DIR)/temp/
displayName: 'List temp SDKs'
- script: ccache --zero-stats --max-size=50G --show-config
displayName: 'Clean ccache stats'
- script: |
export CCACHE_DIR=$(CCACHE_DIR)
export CCACHE_TEMPDIR=$(TMP_DIR)/ccache
export CCACHE_BASEDIR=$(Pipeline.Workspace)
export CCACHE_MAXSIZE=50G
ninja
workingDirectory: $(BUILD_DIR)
displayName: 'Build Android ARM64'
- script: ccache --show-stats
displayName: 'Show ccache stats'
- script: ls -alR $(OPENVINO_REPO_DIR)/bin/
displayName: 'List binary files'

View File

@@ -23,16 +23,16 @@ jobs:
- job: Lin
strategy:
matrix:
Dynamic:
CMAKE_BUILD_SHARED_LIBS: 'ON'
PYTHON_STATIC_ARGS:
# Dynamic:
# CMAKE_BUILD_SHARED_LIBS: 'ON'
# PYTHON_STATIC_ARGS:
Static:
CMAKE_BUILD_SHARED_LIBS: 'OFF'
PYTHON_STATIC_ARGS: -m "not dynamic_library and not template_plugin"
maxParallel: 2
# About 150% of total time
timeoutInMinutes: 90
timeoutInMinutes: 120
pool:
name: LIN_VMSS_VENV_F16S_U20_WU2
@@ -56,7 +56,7 @@ jobs:
SETUPVARS: $(INSTALL_DIR)/setupvars.sh
TMP_DIR: /mnt/tmp
SHARE_DIR: /mount/cinfsshare/onnxtestdata
CCACHE_DIR: $(SHARE_DIR)/ccache
CCACHE_DIR: $(SHARE_DIR)/ccache/master/linux
steps:
- script: |
@@ -112,10 +112,10 @@ jobs:
sudo apt --assume-yes install openjdk-11-jdk
# For opencv-python: python3-setuptools and pip upgrade
python3 -m pip install --upgrade pip
python3 -m pip install -r $(REPO_DIR)/inference-engine/ie_bridges/python/requirements.txt
python3 -m pip install -r $(REPO_DIR)/inference-engine/ie_bridges/python/wheel/requirements-dev.txt
python3 -m pip install -r $(REPO_DIR)/src/bindings/python/src/compatibility/openvino/requirements.txt
python3 -m pip install -r $(REPO_DIR)/src/bindings/python/wheel/requirements-dev.txt
# For running Python API tests
python3 -m pip install -r $(REPO_DIR)/inference-engine/ie_bridges/python/src/requirements-dev.txt
python3 -m pip install -r $(REPO_DIR)/src/bindings/python/src/compatibility/openvino/requirements-dev.txt
# For running Paddle frontend unit tests
python3 -m pip install -r $(REPO_DIR)/src/core/tests/frontend/paddle/requirements_dev.txt
# For running ONNX frontend unit tests
@@ -147,7 +147,6 @@ jobs:
-DCMAKE_BUILD_TYPE=$(BUILD_TYPE)
-DENABLE_PYTHON=ON
-DBUILD_SHARED_LIBS=$(CMAKE_BUILD_SHARED_LIBS)
-DENABLE_INTEL_GNA=$(CMAKE_BUILD_SHARED_LIBS)
-DENABLE_ONEDNN_FOR_GPU=$(CMAKE_BUILD_SHARED_LIBS)
-DPYTHON_EXECUTABLE=/usr/bin/python3.8
-DENABLE_WHEEL=ON
@@ -165,12 +164,14 @@ jobs:
- script: ls -alR $(REPO_DIR)/temp/
displayName: 'List temp SDKs'
- script: ccache --zero-stats --max-size=1T --show-config
- script: ccache --zero-stats --max-size=50G --show-config
displayName: 'Clean ccache stats'
- script: |
export CCACHE_DIR=$(CCACHE_DIR)
export CCACHE_TEMPDIR=$(TMP_DIR)/ccache
export CCACHE_BASEDIR=$(Pipeline.Workspace)
export CCACHE_MAXSIZE=50G
ninja
workingDirectory: $(BUILD_DIR)
displayName: 'Build Lin'
@@ -235,8 +236,16 @@ jobs:
- script: |
export DATA_PATH=$(MODELS_PATH)
export MODELS_PATH=$(MODELS_PATH)
. $(SETUPVARS) -pyver 3.8 && python3 -m pytest -s $(INSTALL_TEST_DIR)/pyngraph $(PYTHON_STATIC_ARGS) --junitxml=TEST-Pyngraph.xml --ignore=$(INSTALL_TEST_DIR)/pyngraph/tests/test_utils/test_utils.py --ignore=$(INSTALL_TEST_DIR)/pyngraph/tests/test_onnx/test_zoo_models.py --ignore=$(INSTALL_TEST_DIR)/pyngraph/tests/test_onnx/test_backend.py
displayName: 'nGraph Python Bindings Tests'
. $(SETUPVARS) -pyver 3.8 && python3 -m pytest -s $(INSTALL_TEST_DIR)/pyngraph $(PYTHON_STATIC_ARGS) --junitxml=TEST-Pyngraph.xml --ignore=$(INSTALL_TEST_DIR)/pyngraph/tests/test_onnx/test_zoo_models.py --ignore=$(INSTALL_TEST_DIR)/pyngraph/tests/test_onnx/test_backend.py
displayName: 'nGraph and IE Python Bindings Tests'
continueOnError: false
# Skip test_onnx/test_zoo_models and test_onnx/test_backend due to long execution time
- script: |
export DATA_PATH=$(MODELS_PATH)
export MODELS_PATH=$(MODELS_PATH)
. $(SETUPVARS) -pyver 3.8 && python3 -m pytest -s $(INSTALL_TEST_DIR)/pyopenvino $(PYTHON_STATIC_ARGS) --junitxml=TEST-Pyngraph.xml --ignore=$(INSTALL_TEST_DIR)/pyopenvino/tests/test_utils/test_utils.py --ignore=$(INSTALL_TEST_DIR)/pyopenvino/tests/test_onnx/test_zoo_models.py --ignore=$(INSTALL_TEST_DIR)/pyopenvino/tests/test_onnx/test_backend.py
displayName: 'Python API 2.0 Tests'
continueOnError: false
- script: |
@@ -244,7 +253,6 @@ jobs:
. $(SETUPVARS) -pyver 3.8 && python3 -m pytest -s $(INSTALL_DIR)/tests/mo/unit_tests --junitxml=TEST-ModelOptimizer.xml
displayName: 'Model Optimizer UT'
continueOnError: false
enabled: true
- script: . $(SETUPVARS) && $(INSTALL_TEST_DIR)/ov_core_unit_tests --gtest_print_time=1 --gtest_filter=-*IE_GPU* --gtest_output=xml:TEST-NGraphUT.xml
workingDirectory: $(INSTALL_TEST_DIR)
@@ -275,7 +283,6 @@ jobs:
- script: . $(SETUPVARS) && $(INSTALL_TEST_DIR)/gnaUnitTests --gtest_output=xml:TEST-gnaUnitTests.xml
displayName: 'GNA UT'
continueOnError: false
condition: eq(variables['CMAKE_BUILD_SHARED_LIBS'], 'ON')
- script: . $(SETUPVARS) && $(INSTALL_TEST_DIR)/vpuUnitTests --gtest_output=xml:TEST-vpuUnitTests.xml
displayName: 'VPU UT'
@@ -336,16 +343,6 @@ jobs:
workingDirectory: $(INSTALL_DIR)/samples_bin
displayName: 'Samples Smoke Tests'
continueOnError: false
condition: eq(variables['CMAKE_BUILD_SHARED_LIBS'], 'ON')
enabled: true
- script: |
export DATA_PATH=$(MODELS_PATH)
export MODELS_PATH=$(MODELS_PATH)
cd $(REPO_DIR)/inference-engine/ie_bridges/python/tests
. $(SETUPVARS) -pyver 3.8 && python3 -m pytest --junitxml=TEST-PythonAPI.xml $(PYTHON_STATIC_ARGS)
displayName: 'Python API Tests'
continueOnError: false
- script: |
. $(SETUPVARS)
@@ -356,7 +353,6 @@ jobs:
workingDirectory: $(LAYER_TESTS_DIR)
displayName: 'Layer Tests'
continueOnError: false
enabled: true
- task: PublishTestResults@2
condition: always()

156
.ci/azure/linux_arm64.yml Normal file
View File

@@ -0,0 +1,156 @@
trigger:
branches:
include:
- master
- releases/*
paths:
exclude:
- docs/*
resources:
repositories:
- repository: openvino_contrib
type: github
endpoint: openvinotoolkit
name: openvinotoolkit/openvino_contrib
jobs:
- job: linux_arm64
# About 150% of total time
timeoutInMinutes: 120
pool:
name: LIN_VMSS_VENV_F16S_U20_WU2
variables:
system.debug: true
VSTS_HTTP_RETRY: 5
VSTS_HTTP_TIMEOUT: 200
BUILD_TYPE: Release
OPENVINO_REPO_DIR: $(Build.Repository.LocalPath)
OPENVINO_CONTRIB_REPO_DIR: $(OPENVINO_REPO_DIR)/../openvino_contrib
OPENCV_REPO_DIR: $(OPENVINO_REPO_DIR)/../opencv
WORK_DIR: $(Pipeline.Workspace)/_w
BUILD_DIR: $(WORK_DIR)/build
BUILD_DIR_OPENCV: $(WORK_DIR)/build_opencv
TMP_DIR: /mnt/tmp
SHARE_DIR: /mount/cinfsshare/onnxtestdata
CCACHE_DIR: $(SHARE_DIR)/ccache/master/linux_arm64
steps:
- script: |
curl -H Metadata:true --noproxy "*" "http://169.254.169.254/metadata/instance?api-version=2019-06-01"
whoami
uname -a
echo Python3 info ; which python3 ; python3 --version
echo Python info ; which python ; python --version
echo Java info ; which java ; java -version
echo gcc info ; which gcc ; gcc --version
echo cmake info ; which cmake ; cmake --version
lsb_release
env
cat /proc/cpuinfo
cat /proc/meminfo
cat /etc/fstab
vmstat -s
df
lsblk -o NAME,HCTL,SIZE,MOUNTPOINT | grep -i "sd"
free -h
displayName: 'System information'
- script: |
rm -rf $(WORK_DIR) ; mkdir $(WORK_DIR)
rm -rf $(BUILD_DIR) ; mkdir $(BUILD_DIR)
sudo rm -rf $(TMP_DIR) ; sudo mkdir $(TMP_DIR) ; sudo chmod 777 -R $(TMP_DIR)
sudo mkdir -p $(SHARE_DIR)
sudo apt --assume-yes update && sudo apt --assume-yes install nfs-common
sudo mount -vvv -t nfs cinfsshare.file.core.windows.net:/cinfsshare/onnxtestdata $(SHARE_DIR) -o vers=4,minorversion=1,sec=sys
mkdir -p $(CCACHE_DIR)
displayName: 'Make directory'
- checkout: self
clean: true
lfs: false
submodules: recursive
path: openvino
- checkout: openvino_contrib
clean: true
lfs: false
submodules: recursive
path: openvino_contrib
- script: |
set -e
$(OPENVINO_REPO_DIR)/install_build_dependencies.sh
# Move into contrib install_build_dependencies.sh
sudo apt --assume-yes install scons crossbuild-essential-arm64 libprotoc-dev protobuf-compiler
# OpenCV should provide install_build_dependencies.sh as well
# Move into resources
git clone https://github.com/opencv/opencv.git --depth 1 $(OPENCV_REPO_DIR)
# Speed up build
wget https://github.com/ninja-build/ninja/releases/download/v1.10.2/ninja-linux.zip
unzip ninja-linux.zip
sudo cp -v ninja /usr/local/bin/
workingDirectory: $(WORK_DIR)
displayName: 'Install dependencies'
- task: CMake@1
inputs:
cmakeArgs: >
-GNinja
-DVERBOSE_BUILD=ON
-DCMAKE_BUILD_TYPE=$(BUILD_TYPE)
-DBUILD_LIST=imgcodecs,videoio,highgui
-DCMAKE_TOOLCHAIN_FILE=$(OPENCV_REPO_DIR)/platforms/linux/aarch64-gnu.toolchain.cmake
$(OPENCV_REPO_DIR)
workingDirectory: $(BUILD_DIR_OPENCV)
- script: ninja
workingDirectory: $(BUILD_DIR_OPENCV)
displayName: 'Build OpenCV Linux ARM64'
- script: ninja install
workingDirectory: $(BUILD_DIR_OPENCV)
displayName: 'Install OpenCV Linux ARM64'
- task: CMake@1
inputs:
cmakeArgs: >
-GNinja
-DVERBOSE_BUILD=ON
-DCMAKE_BUILD_TYPE=$(BUILD_TYPE)
-DCMAKE_TOOLCHAIN_FILE=$(OPENVINO_REPO_DIR)/cmake/arm64.toolchain.cmake
-DOpenCV_DIR=$(BUILD_DIR_OPENCV)/install/lib/cmake/opencv4
-DENABLE_OPENCV=OFF
-DENABLE_TESTS=ON
-DENABLE_SAMPLES=ON
-DBUILD_java_api=OFF
-DENABLE_INTEL_MYRIAD=OFF
-DTHREADING=SEQ
-DIE_EXTRA_MODULES=$(OPENVINO_CONTRIB_REPO_DIR)/modules
-DCMAKE_CXX_COMPILER_LAUNCHER=ccache
-DCMAKE_C_COMPILER_LAUNCHER=ccache
$(OPENVINO_REPO_DIR)
workingDirectory: $(BUILD_DIR)
- script: ls -alR $(OPENVINO_REPO_DIR)/temp/
displayName: 'List temp SDKs'
- script: ccache --zero-stats --max-size=50G --show-config
displayName: 'Clean ccache stats'
- script: |
export CCACHE_DIR=$(CCACHE_DIR)
export CCACHE_TEMPDIR=$(TMP_DIR)/ccache
export CCACHE_BASEDIR=$(Pipeline.Workspace)
export CCACHE_MAXSIZE=50G
ninja
workingDirectory: $(BUILD_DIR)
displayName: 'Build Linux ARM64'
- script: ccache --show-stats
displayName: 'Show ccache stats'
- script: ls -alR $(OPENVINO_REPO_DIR)/bin/
displayName: 'List binary files'

View File

@@ -63,7 +63,7 @@ jobs:
- script: |
set -e
$(REPO_DIR)/install_build_dependencies.sh
python3 -m pip install -r $(REPO_DIR)/inference-engine/ie_bridges/python/requirements.txt
python3 -m pip install -r $(REPO_DIR)/src/bindings/python/src/compatibility/openvino/requirements.txt
# Speed up build
wget https://github.com/ninja-build/ninja/releases/download/v1.10.2/ninja-linux.zip
unzip ninja-linux.zip

View File

@@ -1,3 +1,10 @@
resources:
repositories:
- repository: openvino_contrib
type: github
endpoint: openvinotoolkit
name: openvinotoolkit/openvino_contrib
jobs:
- job: Lin
# About 150% of total time
@@ -12,6 +19,7 @@ jobs:
VSTS_HTTP_TIMEOUT: 200
BUILD_TYPE: Release
REPO_DIR: $(Build.Repository.LocalPath)
OPENVINO_CONTRIB_REPO_DIR: $(REPO_DIR)/../openvino_contrib
WORK_DIR: $(Pipeline.Workspace)/_w
BUILD_DIR: $(WORK_DIR)/build
BUILD_SAMPLES_DIR: $(WORK_DIR)/build_samples
@@ -51,9 +59,17 @@ jobs:
submodules: recursive
path: openvino
- checkout: openvino_contrib
clean: true
lfs: false
submodules: recursive
path: openvino_contrib
- script: |
set -e
$(REPO_DIR)/install_build_dependencies.sh
# Move jdk into contrib
sudo apt --assume-yes install openjdk-11-jdk
# Speed up build
wget https://github.com/ninja-build/ninja/releases/download/v1.10.2/ninja-linux.zip
unzip ninja-linux.zip
@@ -63,13 +79,15 @@ jobs:
- task: CMake@1
inputs:
# Coverity has too many PARSE_ERROR errors with ENABLE_FASTER_BUILD=ON. Disabling FASTER_BUILD.
cmakeArgs: >
-GNinja
-DVERBOSE_BUILD=ON
-DCMAKE_BUILD_TYPE=$(BUILD_TYPE)
-DENABLE_FASTER_BUILD=ON
-DENABLE_FASTER_BUILD=OFF
-DENABLE_STRICT_DEPENDENCIES=OFF
-DENABLE_REQUIREMENTS_INSTALL=OFF
-DIE_EXTRA_MODULES=$(OPENVINO_CONTRIB_REPO_DIR)/modules
$(REPO_DIR)
workingDirectory: $(BUILD_DIR)
@@ -95,11 +113,6 @@ jobs:
workingDirectory: $(BUILD_DIR)
displayName: 'Pack cov-int folder for submission'
- publish: $(BUILD_DIR)/openvino.tgz
artifact: openvino.tgz
continueOnError: true
displayName: 'Publish submission'
- script: |
curl --form token=$(COVERITY_TOKEN) \
--form email=$(COVERITY_USER) \

View File

@@ -69,9 +69,9 @@ jobs:
- script: >
env -C ~/work
./buildreleasenolto.sh
libinference_engine_preproc.so
ov_intel_cpu_plugin
ov_intel_gpu_plugin
libopenvino_gapi_preproc.so
openvino_intel_cpu_plugin
openvino_intel_gpu_plugin
clDNN_unit_tests64
gpuFuncTests
displayName: Build Lin

View File

@@ -73,9 +73,9 @@ jobs:
set -e
$(REPO_DIR)/install_build_dependencies.sh
python3 -m pip install --upgrade pip
python3 -m pip install -r $(REPO_DIR)/inference-engine/ie_bridges/python/requirements.txt
python3 -m pip install -r $(REPO_DIR)/src/bindings/python/src/compatibility/openvino/requirements.txt
# For running Python API tests
python3 -m pip install -r $(REPO_DIR)/inference-engine/ie_bridges/python/src/requirements-dev.txt
python3 -m pip install -r $(REPO_DIR)/src/bindings/python/src/compatibility/openvino/requirements-dev.txt
# Speed up build
wget https://github.com/ninja-build/ninja/releases/download/v1.10.2/ninja-linux.zip
unzip ninja-linux.zip
@@ -93,7 +93,7 @@ jobs:
-DCMAKE_BUILD_TYPE=$(BUILD_TYPE)
-DENABLE_PYTHON=ON
-DPYTHON_EXECUTABLE=/usr/bin/python3.8
-DENABLE_VPU=OFF
-DENABLE_INTEL_MYRIAD_COMMON=OFF
-DENABLE_INTEL_GNA=OFF
-DENABLE_OPENCV=OFF
-DENABLE_CPPLINT=OFF

View File

@@ -40,6 +40,8 @@ jobs:
INSTALL_DIR: $(WORK_DIR)/install_pkg
INSTALL_TEST_DIR: $(INSTALL_DIR)/tests
SETUPVARS: $(INSTALL_DIR)/setupvars.sh
TMP_DIR: /tmp
CCACHE_DIR: $(WORK_DIR)/ccache/mac
steps:
- script: |
@@ -87,6 +89,7 @@ jobs:
python3 -m pip install -r $(REPO_DIR)/src/core/tests/requirements_test_onnx.txt
# Speed up build
brew install ninja
brew install ccache
# Speed up tests
git clone https://github.com/google/gtest-parallel.git
workingDirectory: $(WORK_DIR)
@@ -96,17 +99,36 @@ jobs:
export PATH="/usr/local/opt/cython/bin:$PATH"
export CC=gcc
export CXX=g++
cmake -GNinja -DVERBOSE_BUILD=ON -DENABLE_REQUIREMENTS_INSTALL=OFF -DCMAKE_BUILD_TYPE=$(BUILD_TYPE) -DENABLE_PYTHON=ON -DENABLE_TESTS=ON -DENABLE_STRICT_DEPENDENCIES=OFF -DIE_EXTRA_MODULES=$(OPENVINO_CONTRIB_REPO_DIR)/modules $(REPO_DIR)
cmake -GNinja -DVERBOSE_BUILD=ON -DENABLE_REQUIREMENTS_INSTALL=OFF -DCMAKE_BUILD_TYPE=$(BUILD_TYPE) -DENABLE_PYTHON=ON -DENABLE_TESTS=OFF -DENABLE_STRICT_DEPENDENCIES=OFF -DIE_EXTRA_MODULES=$(OPENVINO_CONTRIB_REPO_DIR)/modules -DCMAKE_CXX_COMPILER_LAUNCHER=ccache -DCMAKE_C_COMPILER_LAUNCHER=ccache $(REPO_DIR)
workingDirectory: $(BUILD_DIR)
displayName: 'CMake'
- script: ls -alR $(REPO_DIR)/temp/
displayName: 'List temp SDKs'
- script: ninja
- task: Cache@2
inputs:
key: 'ccache | "$(Agent.OS)"'
path: $(CCACHE_DIR)
restoreKeys: |
ccache | "$(Agent.OS)"
displayName: Cache
- script: ccache --zero-stats --max-size=10G --show-config
displayName: 'Clean ccache stats'
- script: |
export CCACHE_DIR=$(CCACHE_DIR)
export CCACHE_TEMPDIR=$(TMP_DIR)/ccache
export CCACHE_BASEDIR=$(Pipeline.Workspace)
export CCACHE_MAXSIZE=10G
ninja
workingDirectory: $(BUILD_DIR)
displayName: 'Build Mac'
- script: ccache --show-stats
displayName: 'Show ccache stats'
- script: ls -alR $(REPO_DIR)/bin/
displayName: 'List bin files'
@@ -132,34 +154,42 @@ jobs:
workingDirectory: $(INSTALL_TEST_DIR)
displayName: 'OV Core UT'
continueOnError: false
enabled: false
- script: . $(SETUPVARS) && $(INSTALL_TEST_DIR)/InferenceEngineUnitTests --gtest_print_time=1 --gtest_filter=-MKLDNNGraphStructureTests.TestNoRedundantReordersBeforeDWConvolution:TestConvolution/MKLDNNGraphConvolutionTests.TestsConvolution/0:TestConvolutionDefaultPrimitivesPriority/MKLDNNGraphConvolutionTests.TestsConvolution/0 --gtest_output=xml:TEST-InferenceEngineUnitTests.xml
displayName: 'IE UT old'
continueOnError: false
enabled: false
- script: . $(SETUPVARS) && $(INSTALL_TEST_DIR)/ieUnitTests --gtest_output=xml:TEST-ieUnitTests.xml
displayName: 'IE UT'
continueOnError: false
enabled: false
- script: . $(SETUPVARS) && $(INSTALL_TEST_DIR)/cpuUnitTests --gtest_output=xml:TEST-cpuUnitTests.xml
displayName: 'CPU UT'
continueOnError: false
enabled: false
- script: . $(SETUPVARS) && $(INSTALL_TEST_DIR)/vpuUnitTests --gtest_output=xml:TEST-vpuUnitTests.xml
displayName: 'VPU UT'
continueOnError: false
enabled: false
- script: . $(SETUPVARS) && $(INSTALL_TEST_DIR)/onnxImporterUnitTests --gtest_output=xml:TEST-onnxImporterUnitTests.xml
displayName: 'ONNX Importer UT'
continueOnError: false
enabled: false
- script: . $(SETUPVARS) && $(INSTALL_TEST_DIR)/ieMultiPluginUnitTests --gtest_output=xml:TEST-ieMultiPluginUnitTests.xml
displayName: 'MULTI UT'
continueOnError: false
enabled: false
- script: . $(SETUPVARS) && $(INSTALL_TEST_DIR)/ieFuncTests --gtest_output=xml:TEST-ieFuncTests.xml
displayName: 'IE FuncTests'
continueOnError: false
enabled: false
- script: . $(SETUPVARS) && $(INSTALL_TEST_DIR)/cpuFuncTests --gtest_filter=*smoke*:-smoke_LPT/ReduceMinTransformation.CompareWithRefImpl/f32_Shape* --gtest_print_time=1 --gtest_output=xml:TEST-cpuFuncTests.xml
displayName: 'CPU FuncTests'
@@ -172,6 +202,7 @@ jobs:
. $(SETUPVARS) && $(INSTALL_TEST_DIR)/InferenceEngineCAPITests --gtest_output=xml:TEST-InferenceEngineCAPITests.xml
displayName: 'IE CAPITests'
continueOnError: false
enabled: false
- task: PublishTestResults@2
condition: always()

View File

@@ -23,17 +23,17 @@ jobs:
- job: Win
strategy:
matrix:
Dynamic:
CMAKE_BUILD_SHARED_LIBS: 'ON'
Static:
CMAKE_BUILD_SHARED_LIBS: 'OFF'
# Dynamic:
# CMAKE_BUILD_SHARED_LIBS: 'ON'
maxParallel: 2
# About 150% of total time
timeoutInMinutes: 120
timeoutInMinutes: 150
pool:
name: WIN_VMSS_VENV_F8S_WU2
name: WIN_VMSS_VENV_D8S_WU2
variables:
system.debug: true
@@ -44,9 +44,9 @@ jobs:
OPENVINO_CONTRIB_REPO_DIR: $(REPO_DIR)\..\openvino_contrib
MODELS_PATH: $(REPO_DIR)\..\testdata
WORK_DIR: $(Pipeline.Workspace)\_w
BUILD_DIR: D:\build
BUILD_SAMPLES_DIR: D:\build_samples
BUILD_SAMPLES_TESTS_DIR: D:\build_samples_tests
BUILD_DIR: $(WORK_DIR)\build
BUILD_SAMPLES_DIR: $(WORK_DIR)\build_samples
BUILD_SAMPLES_TESTS_DIR: $(WORK_DIR)\build_samples_tests
MSVS_VARS_PATH: C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Auxiliary\Build\vcvars64.bat
MSVC_COMPILER_PATH: C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.24.28314\bin\Hostx64\x64\cl.exe
INSTALL_DIR: $(WORK_DIR)\install_pkg
@@ -108,8 +108,8 @@ jobs:
- script: |
python -m pip install --upgrade pip
rem For running Python API tests
python -m pip install -r $(REPO_DIR)\inference-engine\ie_bridges\python\src\requirements-dev.txt
python -m pip install -r $(REPO_DIR)\inference-engine\ie_bridges\python\wheel\requirements-dev.txt
python -m pip install -r $(REPO_DIR)\src\bindings\python\src\compatibility\openvino\requirements-dev.txt
python -m pip install -r $(REPO_DIR)\src\bindings\python\wheel\requirements-dev.txt
rem For running Paddle frontend unit tests
python -m pip install -r $(REPO_DIR)\src\core\tests\frontend\paddle\requirements_dev.txt
rem For running ONNX frontend unit tests
@@ -133,7 +133,7 @@ jobs:
- script: |
set PATH=$(WORK_DIR)\ninja-win;%PATH%
call "$(MSVS_VARS_PATH)" && $(CMAKE_CMD) -G "Ninja Multi-Config" -DENABLE_ONEDNN_FOR_GPU=OFF -DENABLE_WHEEL=ON -DENABLE_INTEL_GNA=$(CMAKE_BUILD_SHARED_LIBS) -DENABLE_INTEL_GPU=$(CMAKE_BUILD_SHARED_LIBS) -DENABLE_GAPI_PREPROCESSING=$(CMAKE_BUILD_SHARED_LIBS) -DBUILD_SHARED_LIBS=$(CMAKE_BUILD_SHARED_LIBS) -DENABLE_REQUIREMENTS_INSTALL=OFF -DENABLE_FASTER_BUILD=ON -DCMAKE_BUILD_TYPE=$(BUILD_TYPE) -DENABLE_TESTS=ON -DENABLE_STRICT_DEPENDENCIES=OFF -DENABLE_PYTHON=ON -DPYTHON_EXECUTABLE="C:\hostedtoolcache\windows\Python\3.7.6\x64\python.exe" -DPYTHON_INCLUDE_DIR="C:\hostedtoolcache\windows\Python\3.7.6\x64\include" -DPYTHON_LIBRARY="C:\hostedtoolcache\windows\Python\3.7.6\x64\libs\python37.lib" -DIE_EXTRA_MODULES=$(OPENVINO_CONTRIB_REPO_DIR)\modules -DCMAKE_C_COMPILER:PATH="$(MSVC_COMPILER_PATH)" -DCMAKE_CXX_COMPILER:PATH="$(MSVC_COMPILER_PATH)" $(REPO_DIR)
call "$(MSVS_VARS_PATH)" && $(CMAKE_CMD) -G "Ninja Multi-Config" -DENABLE_WHEEL=ON -DENABLE_ONEDNN_FOR_GPU=$(CMAKE_BUILD_SHARED_LIBS) -DENABLE_GAPI_PREPROCESSING=$(CMAKE_BUILD_SHARED_LIBS) -DBUILD_SHARED_LIBS=$(CMAKE_BUILD_SHARED_LIBS) -DENABLE_REQUIREMENTS_INSTALL=OFF -DENABLE_FASTER_BUILD=ON -DCMAKE_BUILD_TYPE=$(BUILD_TYPE) -DENABLE_TESTS=ON -DENABLE_STRICT_DEPENDENCIES=OFF -DENABLE_PYTHON=ON -DPYTHON_EXECUTABLE="C:\hostedtoolcache\windows\Python\3.7.6\x64\python.exe" -DPYTHON_INCLUDE_DIR="C:\hostedtoolcache\windows\Python\3.7.6\x64\include" -DPYTHON_LIBRARY="C:\hostedtoolcache\windows\Python\3.7.6\x64\libs\python37.lib" -DIE_EXTRA_MODULES=$(OPENVINO_CONTRIB_REPO_DIR)\modules -DCMAKE_C_COMPILER:PATH="$(MSVC_COMPILER_PATH)" -DCMAKE_CXX_COMPILER:PATH="$(MSVC_COMPILER_PATH)" $(REPO_DIR)
workingDirectory: $(BUILD_DIR)
displayName: 'CMake'
@@ -198,8 +198,8 @@ jobs:
python -m pytest $(INSTALL_DIR)\tests\smoke_tests\ --env_conf $(INSTALL_DIR)\tests\smoke_tests\env_config.yml -s --junitxml=TEST-SamplesSmokeTests.xml
workingDirectory: $(INSTALL_DIR)
displayName: 'Samples Smoke Tests'
continueOnError: false
condition: eq(variables['CMAKE_BUILD_SHARED_LIBS'], 'ON')
continueOnError: false
- script: rd /Q /S $(BUILD_DIR)
displayName: 'Clean build dir'
@@ -218,10 +218,10 @@ jobs:
displayName: 'Tensorflow Frontend UT'
continueOnError: false
- script: |
set PATH=$(IB_DIR);%PATH%
call $(SETUPVARS) && "$(IB_TESTCONSOLE)" $(INSTALL_TEST_DIR)\InferenceEngineUnitTests.exe --gtest_output=xml:TEST-InferenceEngineUnitTests-IB.xml
displayName: 'IE UT old - IB'
# set PATH=$(IB_DIR);%PATH%
# call $(SETUPVARS) && "$(IB_TESTCONSOLE)" $(INSTALL_TEST_DIR)\InferenceEngineUnitTests.exe --gtest_output=xml:TEST-InferenceEngineUnitTests-IB.xml
- script: call $(SETUPVARS) && $(INSTALL_TEST_DIR)\InferenceEngineUnitTests --gtest_output=xml:TEST-InferenceEngineUnitTests.xml
displayName: 'IE UT old'
continueOnError: false
- script: call $(SETUPVARS) && $(INSTALL_TEST_DIR)\ieUnitTests --gtest_output=xml:TEST-ieUnitTests.xml
@@ -235,7 +235,6 @@ jobs:
- script: call $(SETUPVARS) && $(INSTALL_TEST_DIR)\gnaUnitTests --gtest_output=xml:TEST-gnaUnitTests.xml
displayName: 'GNA UT'
continueOnError: false
condition: eq(variables['CMAKE_BUILD_SHARED_LIBS'], 'ON')
- script: call $(SETUPVARS) && $(INSTALL_TEST_DIR)\vpuUnitTests --gtest_output=xml:TEST-vpuUnitTests.xml
displayName: 'VPU UT'
@@ -257,11 +256,10 @@ jobs:
displayName: 'TEMPLATE FuncTests'
continueOnError: false
# call $(SETUPVARS) && $(INSTALL_TEST_DIR)\cpuFuncTests.exe --gtest_filter=*smoke* --gtest_output=xml:TEST-cpuFuncTests.xml
- script: |
set PATH=$(IB_DIR);%PATH%
call $(SETUPVARS) && "$(IB_TESTCONSOLE)" $(INSTALL_TEST_DIR)\cpuFuncTests.exe --gtest_filter=*smoke*:-*CompareWithRefs/base_size=16_pre_nms_topn=100_post_nms_topn=100_nms_thresh=0.7_feat_stride=1_min_size=1_ratio*:*smoke_GRUSequenceCommonZeroClip/GRUSequenceTest.CompareWithRefs/mode=CONVERT_TO_TI_MAX_SEQ_LEN_CONST_seq_lengths* --gtest_output=xml:TEST-cpuFuncTests-IB.xml /testlevel=24
displayName: 'CPU FuncTests - IB'
# set PATH=$(IB_DIR);%PATH%
# call $(SETUPVARS) && "$(IB_TESTCONSOLE)" $(INSTALL_TEST_DIR)\cpuFuncTests.exe --gtest_filter=*smoke*:-*CompareWithRefs/base_size=16_pre_nms_topn=100_post_nms_topn=100_nms_thresh=0.7_feat_stride=1_min_size=1_ratio*:*smoke_GRUSequenceCommonZeroClip/GRUSequenceTest.CompareWithRefs/mode=CONVERT_TO_TI_MAX_SEQ_LEN_CONST_seq_lengths* --gtest_output=xml:TEST-cpuFuncTests-IB.xml /testlevel=24
- script: call $(SETUPVARS) && $(INSTALL_TEST_DIR)\cpuFuncTests --gtest_filter=*smoke* --gtest_output=xml:TEST-cpuFuncTests.xml
displayName: 'CPU FuncTests'
continueOnError: false
condition: eq(variables['CMAKE_BUILD_SHARED_LIBS'], 'OFF')

View File

@@ -24,7 +24,7 @@ jobs:
OPENVINO_CONTRIB_REPO_DIR: $(REPO_DIR)\..\openvino_contrib
MODELS_PATH: $(REPO_DIR)\..\testdata
WORK_DIR: $(Pipeline.Workspace)\_w
BUILD_DIR: D:\build
BUILD_DIR: $(WORK_DIR)\build
MSVS_VARS_PATH: C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Auxiliary\Build\vcvars64.bat
MSVC_COMPILER_PATH: C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.24.28314\bin\Hostx64\x64\cl.exe
INSTALL_DIR: $(WORK_DIR)\install_pkg

View File

@@ -28,6 +28,7 @@ RUN apt-get update && apt-get -y --no-install-recommends install \
autoconf \
automake \
build-essential \
ninja-build \
cmake \
curl \
git \
@@ -54,11 +55,13 @@ RUN apt-get update && apt-get -y --no-install-recommends install \
COPY . /openvino/
WORKDIR /openvino/build
RUN cmake .. \
-G Ninja \
-DCMAKE_BUILD_TYPE=${BUILD_TYPE} \
-DENABLE_VPU=OFF \
-DENABLE_INTEL_MYRIAD_COMMON=OFF \
-DENABLE_INTEL_GNA=OFF \
-DENABLE_OPENCV=OFF \
-DENABLE_CPPLINT=OFF \
-DENABLE_NCC_STYLE=OFF \
-DENABLE_TESTS=OFF \
-DENABLE_INTEL_CPU=ON \
-DENABLE_INTEL_GPU=OFF \
@@ -67,9 +70,11 @@ RUN cmake .. \
-DENABLE_PYTHON=ON \
-DPYTHON_EXECUTABLE=/usr/bin/python3 \
-DENABLE_OV_ONNX_FRONTEND=ON \
-DENABLE_OV_PADDLE_FRONTEND=OFF \
-DENABLE_OV_TF_FRONTEND=OFF \
-DENABLE_OPENVINO_DEBUG=OFF \
-DCMAKE_INSTALL_PREFIX=/openvino/dist
RUN make -j $(nproc) install
RUN ninja install
# Run tests via tox
WORKDIR /openvino/src/bindings/python

View File

@@ -47,7 +47,7 @@ assignees: ''
- [ ] I checked the problem with documentation, FAQ, open issues, Stack Overflow, etc and have not found solution
<!--
Places to check:
* OpenVINO documentation: https://docs.openvinotoolkit.org/
* OpenVINO documentation: https://docs.openvino.ai/
* OpenVINO forum: https://community.intel.com/t5/Intel-Distribution-of-OpenVINO/bd-p/distribution-openvino-toolkit
* OpenVINO issue tracker: https://github.com/openvinotoolkit/openvino/issues?q=is%3Aissue
* Stack Overflow branch: https://stackoverflow.com/questions/tagged/openvino

View File

@@ -2,14 +2,14 @@
version: 2
updates:
# Enable version updates for nGraph Python API
# Enable version updates for Python API
- package-ecosystem: pip
directory: "/src/bindings/python"
schedule:
interval: weekly
day: monday
time: "13:00"
open-pull-requests-limit: 10
open-pull-requests-limit: 0
reviewers:
- jiwaszki
- akuporos

View File

@@ -47,7 +47,7 @@ jobs:
- name: Build doc
run: |
cmake --build . --target sphinx_docs
cmake --build . --target sphinx_docs -j8
working-directory: build
- name: Archive HTML
@@ -58,9 +58,13 @@ jobs:
- name: Run Pytest
run: |
pytest --doxygen="./build/docs/doxygen.log" \
--include_pot \
--sphinx="./build/docs/sphinx.log" \
--suppress-warnings="./docs/suppress_warnings.txt" \
--confcutdir="./docs/scripts/tests/" \
--html="./build/docs/_artifacts/doc-generation.html" \
--doxygen-strip="$(pwd)" \
--sphinx-strip="$(pwd)/build/docs/rst" \
--doxygen-xfail="./docs/doxygen-xfail.txt" \
--self-contained-html ./docs/scripts/tests/test_docs.py
@@ -70,9 +74,23 @@ jobs:
with:
name: openvino_doc_pytest
path: build/docs/_artifacts/
- name: 'Upload doxygen.log'
if: always()
uses: actions/upload-artifact@v2
with:
name: doxygen_log
path: build/docs/doxygen.log
- name: 'Upload sphinx.log'
if: always()
uses: actions/upload-artifact@v2
with:
name: sphinx_log
path: build/docs/sphinx.log
- name: 'Upload html'
if: github.event_name == 'push'
if: always()
uses: actions/upload-artifact@v2
with:
name: openvino_html

View File

@@ -19,9 +19,9 @@ jobs:
sudo apt update
sudo apt --assume-yes install libusb-1.0-0-dev
python3 -m pip install --upgrade pip
python3 -m pip install -r ./inference-engine/ie_bridges/python/requirements.txt
python3 -m pip install -r ./src/bindings/python/src/compatibility/openvino/requirements.txt
# Add for -DENABLE_PYTHON=ON, no cython
python3 -m pip install -r ./inference-engine/ie_bridges/python/src/requirements-dev.txt
python3 -m pip install -r ./src/bindings/python/src/compatibility/openvino/requirements-dev.txt
# Run cmake with -DENABLE_PROFILING_ITT=ON -DSELECTIVE_BUILD=COLLECT in order to enable codestyle check for ITT collector
- name: CMake
@@ -60,20 +60,20 @@ jobs:
sudo apt --assume-yes install shellcheck
- name: Install dependencies
run: python3 -m pip install -r ./inference-engine/ie_bridges/python/requirements.txt
run: python3 -m pip install -r ./src/bindings/python/src/compatibility/openvino/requirements.txt
- name: CMake
run: |
mkdir build
cd build
cmake -DENABLE_VPU=OFF ..
cmake -DENABLE_INTEL_MYRIAD_COMMON=OFF ..
- name: ShellCheck
run: cmake --build . --target ie_shellcheck -j8
working-directory: build
NamingConventionCheck:
runs-on: ubuntu-18.04
runs-on: ubuntu-20.04
steps:
- uses: actions/checkout@v2
with:
@@ -82,7 +82,8 @@ jobs:
- name: Install Clang dependency
run: |
sudo apt update
sudo apt --assume-yes install libclang-9-dev
sudo apt --assume-yes remove clang-7 clang-8 clang-9 clang-10 clang-11
sudo apt --assume-yes install libclang-12-dev
- name: Install Python-based dependencies
run: python3 -m pip install -r cmake/developer_package/ncc_naming_style/requirements_dev.txt
@@ -91,7 +92,7 @@ jobs:
run: |
mkdir build
cd build
cmake -DENABLE_VPU=OFF ..
cmake -DENABLE_INTEL_MYRIAD_COMMON=OFF ..
- name: Naming convention check
run: cmake --build . --target ncc_all -j8

View File

@@ -4,11 +4,11 @@ on:
workflow_dispatch:
push:
paths:
- 'inference-engine/ie_bridges/python/**'
- 'src/bindings/python/**'
- 'samples/python/**'
pull_request:
paths:
- 'inference-engine/ie_bridges/python/**'
- 'src/bindings/python/**'
- 'samples/python/**'
jobs:
linters:
@@ -23,7 +23,7 @@ jobs:
with:
python-version: '3.6'
- name: Install dependencies
run: python -m pip install -r inference-engine/ie_bridges/python/requirements_dev.txt
run: python -m pip install -r src/bindings/python/src/compatibility/openvino/requirements_dev.txt
- name: Run Flake on samples
run: python -m flake8 ./ --config=setup.cfg
working-directory: samples/python
@@ -39,14 +39,14 @@ jobs:
name: samples_diff
path: samples_diff.diff
- name: Run Flake on src
run: python -m flake8 ./ --config=../setup.cfg
working-directory: inference-engine/ie_bridges/python/src
run: python -m flake8 ./ --config=setup.cfg
working-directory: src/bindings/python/src/compatibility/openvino
- name: Create code style diff for Python src
if: failure()
run: |
python -m black -l 160 -S ./
git diff > src_diff.diff
working-directory: inference-engine/ie_bridges/python/src
working-directory: src/bindings/python/src/compatibility/openvino
- uses: actions/upload-artifact@v2
if: failure()
with:
@@ -54,13 +54,13 @@ jobs:
path: src_diff.diff
- name: Run Flake on wheel
run: python -m flake8 ./ --config=../setup.cfg
working-directory: inference-engine/ie_bridges/python/wheel
working-directory: src/bindings/python/wheel
- name: Create code style diff for wheel
if: failure()
run: |
python -m black -l 160 -S ./
git diff > wheel_diff.diff
working-directory: inference-engine/ie_bridges/python/wheel
working-directory: src/bindings/python/wheel
- uses: actions/upload-artifact@v2
if: failure()
with:
@@ -69,9 +69,9 @@ jobs:
- name: Run MyPy
run: python -m mypy ./ --config-file ./setup.cfg
working-directory: inference-engine/ie_bridges/python
working-directory: src/bindings/python/src/compatibility/openvino
- name: Run Bandit
run: python -m bandit -r ./ -f screen
working-directory: inference-engine/ie_bridges/python
working-directory: src/bindings/python/src/compatibility/openvino

1
.gitignore vendored
View File

@@ -28,7 +28,6 @@ temp/
docs/template_plugin/html/
CMakeLists.txt.user
docs/IE_PLUGIN_DG/html/
inference-engine/ie_bridges/python/wheel/.env
*.project
*.cproject

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -34,7 +34,9 @@ endif()
message (STATUS "PROJECT ............................... " ${PROJECT_NAME})
message (STATUS "CMAKE_VERSION ......................... " ${CMAKE_VERSION})
message (STATUS "CMAKE_BINARY_DIR ...................... " ${CMAKE_BINARY_DIR})
message (STATUS "CMAKE_SOURCE_DIR ...................... " ${CMAKE_SOURCE_DIR})
message (STATUS "OpenVINO_SOURCE_DIR ................... " ${OpenVINO_SOURCE_DIR})
message (STATUS "OpenVINO_BINARY_DIR ................... " ${OpenVINO_BINARY_DIR})
message (STATUS "CMAKE_GENERATOR ....................... " ${CMAKE_GENERATOR})
message (STATUS "CMAKE_C_COMPILER_ID ................... " ${CMAKE_C_COMPILER_ID})
message (STATUS "CMAKE_CXX_COMPILER_ID ................. " ${CMAKE_CXX_COMPILER_ID})
@@ -42,7 +44,7 @@ message (STATUS "CMAKE_BUILD_TYPE ...................... " ${CMAKE_BUILD_TYPE})
message (STATUS "CMAKE_TOOLCHAIN_FILE .................. " ${CMAKE_TOOLCHAIN_FILE})
# remove file with exported developer targets to force its regeneration
file(REMOVE "${CMAKE_BINARY_DIR}/ngraph/ngraphTargets.cmake")
file(REMOVE "${CMAKE_BINARY_DIR}/ngraphTargets.cmake")
file(REMOVE "${CMAKE_BINARY_DIR}/InferenceEngineTargets.cmake")
file(REMOVE "${CMAKE_BINARY_DIR}/OpenVINOTargets.cmake")
foreach(component IN LISTS openvino_export_components)
@@ -91,11 +93,8 @@ endfunction()
include(cmake/test_model_zoo.cmake)
add_subdirectory(thirdparty)
add_subdirectory(inference-engine/thirdparty)
add_subdirectory(inference-engine/src)
add_subdirectory(src)
add_subdirectory(samples)
add_subdirectory(inference-engine)
# Enable interpreter backend
if (ENABLE_TESTS OR ENABLE_TEMPLATE)

View File

@@ -29,7 +29,7 @@ Jenkinsfile @openvinotoolkit/openvino-admins
# IE Core:
/inference-engine/ @openvinotoolkit/openvino-ie-maintainers
/inference-engine/ie_bridges/python @openvinotoolkit/openvino-ie-python-api-maintainers
/src/bindings/python/ @openvinotoolkit/openvino-ie-python-api-maintainers
/src/common/transformations/ @GlebKazantaev @ilyachur
/src/common/legacy/ @openvinotoolkit/openvino-ngraph-maintainers
/src/common/ @openvinotoolkit/openvino-ie-maintainers
@@ -49,9 +49,8 @@ Jenkinsfile @openvinotoolkit/openvino-admins
/src/plugins/intel_gpu/ @openvinotoolkit/openvino-ie-gpu-maintainers @openvinotoolkit/openvino-ie-gpu-developers
# IE VPU:
/inference-engine/src/vpu/ @openvinotoolkit/openvino-ie-vpu-maintainers
/src/plugins/intel_myriad @openvinotoolkit/openvino-ie-vpu-maintainers
/src/inference/include/ie/vpu/ @openvinotoolkit/openvino-ie-vpu-maintainers
/inference-engine/thirdparty/movidius/ @openvinotoolkit/openvino-ie-vpu-maintainers
/src/tests_deprecated/unit/engines/vpu/ @openvinotoolkit/openvino-ie-vpu-maintainers @openvinotoolkit/openvino-ie-tests-maintainers
/src/tests_deprecated/functional/vpu/ @openvinotoolkit/openvino-ie-vpu-maintainers @openvinotoolkit/openvino-ie-tests-maintainers
/src/tests_deprecated/behavior/vpu/ @openvinotoolkit/openvino-ie-vpu-maintainers @openvinotoolkit/openvino-ie-tests-maintainers
@@ -64,9 +63,12 @@ Jenkinsfile @openvinotoolkit/openvino-admins
/src/plugins/intel_gna/ @openvinotoolkit/openvino-ie-gna-maintainers
/src/inference/include/ie/gna/ @openvinotoolkit/openvino-ie-gna-maintainers
# IE MULTI:
/src/plugins/auto/ @openvinotoolkit/openvino-ie-multi-maintainers
/src/inference/include/ie/multi-device/ @openvinotoolkit/openvino-ie-multi-maintainers
# IE Auto (MULTI) plugin:
/src/plugins/auto/ @openvinotoolkit/openvino-ie-auto-multi-maintainers
/src/inference/include/ie/multi-device/ @openvinotoolkit/openvino-ie-auto-multi-maintainers
# IE Paddle frontend:
/src/frontends/paddle/ @openvinotoolkit/openvino-ie-paddle-maintainers
# IE Tests:
/src/tests/ @openvinotoolkit/openvino-ie-tests-maintainers

68
CONTRIBUTING.md Normal file
View File

@@ -0,0 +1,68 @@
# How to contribute to the OpenVINO repository
We suppose that you are an enthusiastic coder, want to contribute some code. For that purpose OpenVINO project now has a repository on the GitHub, to simplify everybody's life! All the bug fixes, new functionality, new tutorials etc. should be submitted via the GitHub's mechanism of pull requests.
If you are not familiar with the mechanism - do not worry, it's very simple. Keep reading.
## Before you start contributing you should
- Make sure you agree to contribute your code under [OpenVINO (Apache 2.0)](https://github.com/openvinotoolkit/openvino/blob/master/LICENSE) license.
- If you are submitting a new module, you should go into [openvino_contrib](https://github.com/openvinotoolkit/openvino_contrib) repository by default.
- If you are going to fix a bug, check that it's still exists. This can be done by building the latest [releases/2020/3](https://github.com/openvinotoolkit/openvino/tree/releases/2020/3) branch (LTS release) or the latest master branch, and make sure that the error is still reproducible there. We do not fix bugs that only affect older non-LTS releases like 2020.2 for example (more details about [branching strategy](https://github.com/openvinotoolkit/openvino/wiki/Branches))
- Make sure that nobody beat you into fixing or reporting the issue by doing a search on the [Github OpenVINO issues](https://github.com/openvinotoolkit/openvino/issues) page, and making sure that there isn't someone working on it. In the latter case you might provide support or suggestion in the issue or in the linked pull request.
- If you have a question about the software, then this is **NOT** the right place. You should open up a question at the [OpenVINO forum](https://community.intel.com/t5/Intel-Distribution-of-OpenVINO/bd-p/distribution-openvino-toolkit). In order to post a decent question from the start, feel free to read the official forum guidelines.
Before you open up anything on the OpenVINO GitHub page, be sure that you are at the right place with your problem.
## "Fork & Pull Request model" for code contribution
### [](https://github.com/openvinotoolkit/openvino/wiki/Contribute#the-instruction-in-brief)The instruction in brief
- Register at GitHub. Create your fork of OpenVINO repository [https://github.com/openvinotoolkit/openvino](https://github.com/openvinotoolkit/openvino) (see [https://help.github.com/articles/fork-a-repo](https://help.github.com/articles/fork-a-repo) for details).
- Install Git.
- Set your user name and email address in a Git configuration according to GitHub account (see [https://git-scm.com/book/en/v2/Getting-Started-First-Time-Git-Setup](https://git-scm.com/book/en/v2/Getting-Started-First-Time-Git-Setup) for details).
- Choose a task for yourself. It could be a bugfix or some new code.
- Choose a base branch for your work. More details about branches and policies are here: [Branches](https://github.com/openvinotoolkit/openvino/wiki/Branches)
- Clone your fork to your computer.
- Create a new branch (with a meaningful name) from the base branch you chose.
- Modify / add the code following our [Coding Style Guide](https://github.com/openvinotoolkit/openvino/wiki/CodingStyleGuideLines) and [Documentation guidelines](https://github.com/openvinotoolkit/openvino/wiki/CodingStyleGuideLinesDocumentation).
- If you want to add a new sample, please look at this [Guide for contributing to C++/C/Python IE samples](https://github.com/openvinotoolkit/openvino/wiki/SampleContribute)
- Run testsuite locally:
- execute each test binary from the artifacts directory, e.g. `<source dir>/bin/intel64/Release/ieFuncTests`
- If you contribute to the documentation and want to add a new guide:
- Create a new markdown file in an appropriate folder.
- **REQUIRED:** The document title must contain a document label in a form: `{#openvino_docs_<name>}`. For example: `Deep Learning Network Intermediate Representation and Operation Sets in OpenVINO™ {#openvino_docs_MO_DG_IR_and_opsets}`.
- Add your file to the documentation structure. Open the documentation structure file [`docs/doxygen/ie_docs.xml`](https://github.com/openvinotoolkit/openvino/blob/master/docs/doxygen/ie_docs.xml) and add your file path to the appropriate section.
- When you are done, make sure that your branch is to date with latest state of the branch you want to contribute to (e.g. `git fetch upstream && git merge upstream/master`), push your branch to your GitHub fork; then create a pull request from your branch to the base branch (see [https://help.github.com/articles/using-pull-requests](https://help.github.com/articles/using-pull-requests) for details).
## Making a good pull request
Following these guidelines will increase the likelihood of your pull request being accepted:
- Before pushing your PR to the repository, make sure that it builds perfectly fine on your local system.
- Add enough information, like a meaningful title, the reason why you made the commit and a link to the issue page if you opened one for this PR.
- Scope your PR to one issue. Before submitting, make sure the diff contains no unrelated changes. If you want to cover more than one issue, submit your changes for each as separate pull requests.
- If you have added new functionality, you should update/create the relevant documentation, as well as add tests for it to the testsuite.
- Try not to include "oops" commits - ones that just fix an error in the previous commit. If you have those, then before submitting [squash](https://github.com/openvinotoolkit/openvino/wiki/Contribute#https://git-scm.com/book/en/v2/Git-Tools-Rewriting-History#Squashing-Commits) those fixes directly into the commits where they belong.
- Make sure to choose the right base branch and to follow the [Coding Style Guide](https://github.com/openvinotoolkit/openvino/wiki/CodingStyleGuideLines) for your code or [Documentation guidelines](https://github.com/openvinotoolkit/openvino/wiki/CodingStyleGuideLinesDocumentation) you are changing documentation files.
- Make sure to add test for new functionality or test that reproduces fixed bug with related test data. Please do not add extra images or videos, if some of existing media files are suitable.
## Testing and merging pull requests
- Your pull request will be automatically tested by OpenVINO's precommit (testing status are automatically reported as "green" or "red" circles in precommit steps on PR's page). If any builders have failed, you should fix the issue. To rerun the automatic builds just push changes to your branch on GitHub. No need to close pull request and open a new one!
- Once all the builders are "green", one of OpenVINO developers will review your code. Reviewer could ask you to modify your pull request. Please provide timely response for reviewers (within weeks, not months), otherwise you submission could be postponed or even rejected.
## PR review good practices
- Originator is responsible for driving the review of changes and should ping reviewers periodically.
- Originator should close comments from the Reviewer when it is resolved. The Reviewer may re-open the comment if he does not agree with the resolution.
- Originator should request re-review from the Reviewer when all comments are resolved by pushing the button in the “Reviewers” section.
- If it is still WIP and you want to check CI test results early then use _Draft_ PR.
- Do **NOT** rewrite history (push -f) once you converted draft PR into regular one, add new commits instead. Looking at diffs makes review easier.
- Write meaningful description of commits resulting from review. _"Addressing review comments"_ is **NOT** a good description! Having a quick look at good descriptions can tell you much what is going on in PR without a need to go through all of resolved comments.
## Merging PR
As soon as the reviewer is fine with the pull request and Precommit likes your code and shows "green" status, the "Approved" review status is put, which signals OpenVINO maintainers that they can merge your pull request.
© Copyright 2018-2022, OpenVINO team

View File

@@ -6,30 +6,29 @@
[![PyPI Downloads](https://pepy.tech/badge/openvino)](https://pepy.tech/project/openvino)
This toolkit allows developers to deploy pre-trained deep learning models
through a high-level C++ Inference Engine API integrated with application logic.
through a high-level OpenVINO™ Runtime C++ and Python APIs integrated with application logic.
This open source version includes several components: namely [Model Optimizer], [nGraph] and
[Inference Engine], as well as CPU, GPU, MYRIAD, multi device and heterogeneous plugins to accelerate deep learning inferencing on Intel® CPUs and Intel® Processor Graphics.
This open source version includes several components: namely [Model Optimizer], [OpenVINO™ Runtime], [Post-Training Optimization Tool], as well as CPU, GPU, MYRIAD, multi device and heterogeneous plugins to accelerate deep learning inferencing on Intel® CPUs and Intel® Processor Graphics.
It supports pre-trained models from the [Open Model Zoo], along with 100+ open
source and public models in popular formats such as Caffe\*, TensorFlow\*,
MXNet\* and ONNX\*.
source and public models in popular formats such as TensorFlow, ONNX, PaddlePaddle, MXNet, Caffe, Kaldi.
## Repository components:
* [Inference Engine]
* [nGraph]
## Repository components
* [OpenVINO™ Runtime]
* [Model Optimizer]
* [Post-Training Optimization Tool]
## License
Deep Learning Deployment Toolkit is licensed under [Apache License Version 2.0](LICENSE).
By contributing to the project, you agree to the license and copyright terms therein
and release your contribution under these terms.
## Resources:
* Docs: https://docs.openvinotoolkit.org/
## Resources
* Docs: https://docs.openvino.ai/
* Wiki: https://github.com/openvinotoolkit/openvino/wiki
* Issue tracking: https://github.com/openvinotoolkit/openvino/issues
* Storage: https://storage.openvinotoolkit.org/
* Additional OpenVINO™ modules: https://github.com/openvinotoolkit/openvino_contrib
* Additional OpenVINO™ toolkit modules: https://github.com/openvinotoolkit/openvino_contrib
* [Intel® Distribution of OpenVINO™ toolkit Product Page](https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html)
* [Intel® Distribution of OpenVINO™ toolkit Release Notes](https://software.intel.com/en-us/articles/OpenVINO-RelNotes)
@@ -44,8 +43,8 @@ Please report questions, issues and suggestions using:
\* Other names and brands may be claimed as the property of others.
[Open Model Zoo]:https://github.com/openvinotoolkit/open_model_zoo
[Inference Engine]:https://software.intel.com/en-us/articles/OpenVINO-InferEngine
[Model Optimizer]:https://software.intel.com/en-us/articles/OpenVINO-ModelOptimizer
[nGraph]:https://docs.openvinotoolkit.org/latest/openvino_docs_nGraph_DG_DevGuide.html
[OpenVINO™ Runtime]:https://docs.openvino.ai/latest/openvino_docs_OV_Runtime_User_Guide.html
[Model Optimizer]:https://docs.openvino.ai/latest/openvino_docs_MO_DG_Deep_Learning_Model_Optimizer_DevGuide.html
[Post-Training Optimization Tool]:https://docs.openvino.ai/latest/pot_README.html
[tag on StackOverflow]:https://stackoverflow.com/search?q=%23openvino

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -23,14 +23,14 @@ ie_coverage_extract(INPUT "openvino" OUTPUT "legacy"
ie_coverage_genhtml(INFO_FILE "legacy"
PREFIX "${OV_COVERAGE_BASE_DIRECTORY}")
ie_coverage_extract(INPUT "openvino" OUTPUT "ov_hetero_plugin"
ie_coverage_extract(INPUT "openvino" OUTPUT "hetero_plugin"
PATTERNS "${OV_COVERAGE_BASE_DIRECTORY}/src/plugins/hetero/*")
ie_coverage_genhtml(INFO_FILE "ov_hetero_plugin"
ie_coverage_genhtml(INFO_FILE "hetero_plugin"
PREFIX "${OV_COVERAGE_BASE_DIRECTORY}")
ie_coverage_extract(INPUT "openvino" OUTPUT "ov_auto_plugin"
ie_coverage_extract(INPUT "openvino" OUTPUT "auto_plugin"
PATTERNS "${OV_COVERAGE_BASE_DIRECTORY}/src/plugins/auto/*")
ie_coverage_genhtml(INFO_FILE "ov_auto_plugin"
ie_coverage_genhtml(INFO_FILE "auto_plugin"
PREFIX "${OV_COVERAGE_BASE_DIRECTORY}")
ie_coverage_extract(INPUT "openvino" OUTPUT "preprocessing"
@@ -73,9 +73,9 @@ if (ENABLE_INTEL_GPU)
endif()
if(ENABLE_INTEL_GNA)
ie_coverage_extract(INPUT "openvino" OUTPUT "ov_intel_gna_plugin"
ie_coverage_extract(INPUT "openvino" OUTPUT "intel_gna_plugin"
PATTERNS "${OV_COVERAGE_BASE_DIRECTORY}/src/plugins/intel_gna/*")
ie_coverage_genhtml(INFO_FILE "ov_intel_gna_plugin"
ie_coverage_genhtml(INFO_FILE "intel_gna_plugin"
PREFIX "${OV_COVERAGE_BASE_DIRECTORY}")
endif()

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -28,12 +28,12 @@ if(COMMAND get_linux_name)
endif()
if(CMAKE_CROSSCOMPILING AND CMAKE_HOST_SYSTEM_NAME MATCHES Linux AND CMAKE_HOST_SYSTEM_PROCESSOR MATCHES "amd64.*|x86_64.*|AMD64.*")
set(protoc_version "3.9.2")
set(protoc_version "3.18.2")
RESOLVE_DEPENDENCY(SYSTEM_PROTOC_ROOT
ARCHIVE_LIN "protoc-${protoc_version}-linux-x86_64.tar.gz"
TARGET_PATH "${TEMP}/protoc-${protoc_version}-linux-x86_64"
SHA256 "1d6da1d97d0cbfcd333558afe24533eb3cb48dc1e0ab5e971aa1e50ede8bcf45"
SHA256 "42fde2b6044c1f74c7e86d4e03b43aac87128ddf57ac6ed8c4eab7a1e21bbf21"
)
debug_message(STATUS "host protoc-${protoc_version} root path = " ${SYSTEM_PROTOC_ROOT})
@@ -51,8 +51,8 @@ if(CMAKE_CROSSCOMPILING AND CMAKE_HOST_SYSTEM_NAME MATCHES Linux AND CMAKE_HOST_
update_deps_cache(SYSTEM_PROTOC "${SYSTEM_PROTOC}" "Path to host protoc for ONNX Importer")
endif()
if(ENABLE_MYRIAD)
include(${IE_MAIN_SOURCE_DIR}/cmake/vpu_dependencies.cmake)
if(ENABLE_INTEL_MYRIAD)
include(${OpenVINO_SOURCE_DIR}/src/plugins/intel_myriad/myriad_dependencies.cmake)
endif()
## Intel OMP package
@@ -269,15 +269,15 @@ include(${OpenVINO_SOURCE_DIR}/src/cmake/ie_parallel.cmake)
if(ENABLE_INTEL_GNA)
reset_deps_cache(
GNA
GNA_EXT_DIR
GNA_PLATFORM_DIR
GNA_KERNEL_LIB_NAME
GNA_LIBS_LIST
GNA_LIB_DIR
libGNA_INCLUDE_DIRS
libGNA_LIBRARIES_BASE_PATH)
set(GNA_VERSION "03.00.00.1455")
set(GNA_HASH "8ac1af18eb32777b00193f4f8c252ee4f8bd64a9069138b4a5aaeebd82ead464")
set(GNA_VERSION "03.00.00.1455.0")
set(GNA_HASH "99891696269d8fa10116c96e6b7bda4362736881f0df8df8b56c751ee18e5820")
set(FILES_TO_EXTRACT_LIST gna_${GNA_VERSION}/include)
if(WIN32)
@@ -286,12 +286,26 @@ if(ENABLE_INTEL_GNA)
LIST(APPEND FILES_TO_EXTRACT_LIST gna_${GNA_VERSION}/linux)
endif()
RESOLVE_DEPENDENCY(GNA
RESOLVE_DEPENDENCY(GNA_EXT_DIR
ARCHIVE_UNIFIED "GNA/GNA_${GNA_VERSION}.zip"
TARGET_PATH "${TEMP}/gna_${GNA_VERSION}"
VERSION_REGEX ".*_([0-9]+.[0-9]+.[0-9]+.[0-9]+).*"
FILES_TO_EXTRACT FILES_TO_EXTRACT_LIST
SHA256 ${GNA_HASH})
update_deps_cache(GNA "${GNA}" "Path to GNA root folder")
debug_message(STATUS "gna=" ${GNA})
update_deps_cache(GNA_EXT_DIR "${GNA_EXT_DIR}" "Path to GNA root folder")
debug_message(STATUS "gna=" ${GNA_EXT_DIR})
if (WIN32)
set(GNA_PLATFORM_DIR win64 CACHE STRING "" FORCE)
elseif (UNIX)
set(GNA_PLATFORM_DIR linux CACHE STRING "" FORCE)
else ()
message(FATAL_ERROR "GNA not supported on this platform, only linux, and windows")
endif ()
set(GNA_LIB_DIR x64 CACHE STRING "" FORCE)
set(GNA_PATH ${GNA_EXT_DIR}/${GNA_PLATFORM_DIR}/${GNA_LIB_DIR} CACHE STRING "" FORCE)
if(NOT BUILD_SHARED_LIBS)
list(APPEND PATH_VARS "GNA_PATH")
endif()
endif()

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -129,7 +129,7 @@ set(IE_DEBUG_POSTFIX_WIN "d")
set(IE_RELEASE_POSTFIX_WIN "")
set(IE_DEBUG_POSTFIX_LIN "")
set(IE_RELEASE_POSTFIX_LIN "")
set(IE_DEBUG_POSTFIX_MAC "")
set(IE_DEBUG_POSTFIX_MAC "d")
set(IE_RELEASE_POSTFIX_MAC "")
if(WIN32)
@@ -158,16 +158,22 @@ else ()
endif()
add_definitions(-DIE_BUILD_POSTFIX=\"${IE_BUILD_POSTFIX}\")
macro(ov_set_if_not_defined var value)
if(NOT DEFINED ${var})
set(${var} ${value})
endif()
endmacro()
if(NOT UNIX)
set(CMAKE_LIBRARY_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER})
set(CMAKE_ARCHIVE_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER})
ov_set_if_not_defined(CMAKE_LIBRARY_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER})
ov_set_if_not_defined(CMAKE_ARCHIVE_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER})
else()
set(CMAKE_LIBRARY_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER}/lib)
set(CMAKE_ARCHIVE_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER}/lib)
ov_set_if_not_defined(CMAKE_LIBRARY_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER}/lib)
ov_set_if_not_defined(CMAKE_ARCHIVE_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER}/lib)
endif()
set(CMAKE_COMPILE_PDB_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER})
set(CMAKE_PDB_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER})
set(CMAKE_RUNTIME_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER})
ov_set_if_not_defined(CMAKE_COMPILE_PDB_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER})
ov_set_if_not_defined(CMAKE_PDB_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER})
ov_set_if_not_defined(CMAKE_RUNTIME_OUTPUT_DIRECTORY ${OUTPUT_ROOT}/${BIN_FOLDER})
if(APPLE)
set(CMAKE_MACOSX_RPATH ON)
@@ -206,6 +212,10 @@ endif()
macro(ov_install_static_lib target comp)
if(NOT BUILD_SHARED_LIBS)
get_target_property(target_type ${target} TYPE)
if(${target_type} STREQUAL "STATIC_LIBRARY")
set_target_properties(${target} PROPERTIES EXCLUDE_FROM_ALL FALSE)
endif()
install(TARGETS ${target} EXPORT OpenVINOTargets
ARCHIVE DESTINATION ${IE_CPACK_ARCHIVE_PATH} COMPONENT ${comp} ${ARGN})
endif()

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -151,11 +151,15 @@ function(addIeTargetTest)
NAME
)
set(oneValueOptionalArgs
COMPONENT
)
set(multiValueArgs
LABELS
)
cmake_parse_arguments(ARG "${options}" "${oneValueRequiredArgs};${oneValueOptionalArgs}" "${multiValueArgs}" ${ARGN} )
if (NOT DEFINED ARG_COMPONENT)
set(ARG_COMPONENT tests)
endif()
addIeTarget(TYPE EXECUTABLE NAME ${ARG_NAME} ${ARG_UNPARSED_ARGUMENTS})
@@ -164,7 +168,7 @@ function(addIeTargetTest)
install(TARGETS ${ARG_NAME}
RUNTIME DESTINATION tests
COMPONENT tests
COMPONENT ${ARG_COMPONENT}
EXCLUDE_FROM_ALL)
endfunction()

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -50,9 +50,9 @@ endfunction()
set(VALIDATED_LIBRARIES "" CACHE INTERNAL "")
function(_ie_add_api_validator_post_build_step)
function(_ov_add_api_validator_post_build_step)
if(NOT BUILD_SHARED_LIBS)
# since _ie_add_api_validator_post_build_step
# since _ov_add_api_validator_post_build_step
# is currently run only on shared libraries, we have nothing to test
return()
endif()
@@ -149,5 +149,5 @@ endfunction()
# ie_add_api_validator_post_build_step(TARGET <name>)
#
macro(ie_add_api_validator_post_build_step)
_ie_add_api_validator_post_build_step(${ARGV})
_ov_add_api_validator_post_build_step(${ARGV})
endmacro()

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -28,9 +28,26 @@ if (ENABLE_UB_SANITIZER)
if (WIN32)
message(FATAL_ERROR "UndefinedBehavior sanitizer is not supported in Windows")
endif()
# TODO: Remove -fno-sanitize=null as thirdparty/ocl/clhpp_headers UBSAN compatibility resolved:
# https://github.com/KhronosGroup/OpenCL-CLHPP/issues/17
set(SANITIZER_COMPILER_FLAGS "${SANITIZER_COMPILER_FLAGS} -fsanitize=undefined -fno-sanitize=null")
# Mute -fsanitize=function Indirect call of a function through a function pointer of the wrong type.
# Sample cases:
# call to function GetAPIVersion through pointer to incorrect function type 'void *(*)()'
# Mute -fsanitize=alignment Use of a misaligned pointer or creation of a misaligned reference. Also sanitizes assume_aligned-like attributes.
# Sample cases:
# VPU_FixedMaxHeapTest.DefaultConstructor test case load of misaligned address 0x62000000187f for type 'const DataType', which requires 4 byte alignment
# Mute -fsanitize=bool Load of a bool value which is neither true nor false.
# Samples cases:
# ie_c_api_version.apiVersion test case load of value 32, which is not a valid value for type 'bool'
# Mute -fsanitize=enum Load of a value of an enumerated type which is not in the range of representable values for that enumerated type.
# Samples cases:
# load of value 4294967295, which is not a valid value for type 'const (anonymous namespace)::onnx::Field'
set(SANITIZER_COMPILER_FLAGS "${SANITIZER_COMPILER_FLAGS} -fsanitize=undefined -fno-sanitize=null -fno-sanitize=alignment -fno-sanitize=bool -fno-sanitize=enum")
if(OV_COMPILER_IS_CLANG)
set(SANITIZER_COMPILER_FLAGS "${SANITIZER_COMPILER_FLAGS} -fno-sanitize=function")
endif()
if (CMAKE_CXX_COMPILER_ID STREQUAL "GNU")
# TODO: Remove -Wno-maybe-uninitialized after CVS-61143 fix
set(SANITIZER_COMPILER_FLAGS "${SANITIZER_COMPILER_FLAGS} -Wno-maybe-uninitialized")

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2020 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -146,8 +146,6 @@ function (DownloadOrExtractInternal URL archive_path unpacked_path folder fattal
endfunction(DownloadOrExtractInternal)
file(REMOVE ${CMAKE_BINARY_DIR}/dependencies_64.txt)
function (CheckOrDownloadAndExtract component RELATIVE_URL archive_name unpacked_path result_path folder fattal resultExt use_alternatives sha256 files_to_extract)
set (archive_path ${TEMP}/download/${archive_name})
set (status "ON")
@@ -164,7 +162,6 @@ function (CheckOrDownloadAndExtract component RELATIVE_URL archive_name unpacked
if (${use_alternatives})
set(DEP_INFO "${component}=${URL}")
debug_message (STATUS "DEPENDENCY_URL: ${DEP_INFO}")
file(APPEND ${CMAKE_BINARY_DIR}/dependencies_64.txt "${DEP_INFO}\n")
endif()
debug_message ("checking that unpacked directory exist: ${unpacked_path}")

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,9 +1,9 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
set(FRONTEND_INSTALL_INCLUDE "runtime/include/")
set(FRONTEND_NAME_PREFIX "ov_")
set(FRONTEND_NAME_PREFIX "openvino_")
set(FRONTEND_NAME_SUFFIX "_frontend")
set(FRONTEND_NAMES "" CACHE INTERNAL "")
@@ -35,7 +35,7 @@ function(ov_generate_frontends_hpp)
endif()
# add frontends to libraries including ov_frontends.hpp
ov_target_link_frontends(ov_runtime)
ov_target_link_frontends(openvino)
set(ov_frontends_hpp "${CMAKE_BINARY_DIR}/src/frontends/common/src/ov_frontends.hpp")
set(frontends_hpp_in "${IEDevScripts_DIR}/frontends/ov_frontends.hpp.in")
@@ -57,7 +57,7 @@ function(ov_generate_frontends_hpp)
# for some reason dependency on source files does not work
# so, we have to use explicit target and make it dependency for frontend_common
add_custom_target(_ov_frontends_hpp DEPENDS ${ov_frontends_hpp})
add_dependencies(frontend_common _ov_frontends_hpp)
add_dependencies(frontend_common_obj _ov_frontends_hpp)
# add dependency for object files
get_target_property(sources frontend_common_obj SOURCES)
@@ -89,7 +89,7 @@ unset(protobuf_installed CACHE)
# [LINK_LIBRARIES <lib1 lib2 ...>])
#
macro(ov_add_frontend)
set(options LINKABLE_FRONTEND PROTOBUF_LITE SKIP_NCC_STYLE SKIP_INSTALL)
set(options LINKABLE_FRONTEND SHUTDOWN_PROTOBUF PROTOBUF_LITE SKIP_NCC_STYLE SKIP_INSTALL)
set(oneValueArgs NAME FILEDESCRIPTION)
set(multiValueArgs LINK_LIBRARIES PROTO_FILES)
cmake_parse_arguments(OV_FRONTEND "${options}" "${oneValueArgs}" "${multiValueArgs}" ${ARGN})
@@ -149,6 +149,11 @@ macro(ov_add_frontend)
add_library(openvino::frontend::${OV_FRONTEND_NAME} ALIAS ${TARGET_NAME})
endif()
# Shutdown protobuf when unloading the front dynamic library
if(OV_FRONTEND_SHUTDOWN_PROTOBUF AND BUILD_SHARED_LIBS)
target_link_libraries(${TARGET_NAME} PRIVATE ov_protobuf_shutdown)
endif()
if(NOT BUILD_SHARED_LIBS)
# override default function names
target_compile_definitions(${TARGET_NAME} PRIVATE
@@ -160,7 +165,7 @@ macro(ov_add_frontend)
# frontend's CMakeLists.txt must define its own custom 'ov_ncc_naming_style' step
else()
ov_ncc_naming_style(FOR_TARGET ${TARGET_NAME}
INCLUDE_DIRECTORY "${CMAKE_CURRENT_SOURCE_DIR}/include"
SOURCE_DIRECTORY "${CMAKE_CURRENT_SOURCE_DIR}/include"
ADDITIONAL_INCLUDE_DIRECTORIES
$<TARGET_PROPERTY:frontend_common::static,INTERFACE_INCLUDE_DIRECTORIES>)
endif()
@@ -177,7 +182,8 @@ macro(ov_add_frontend)
ie_add_api_validator_post_build_step(TARGET ${TARGET_NAME})
target_link_libraries(${TARGET_NAME} PRIVATE openvino::runtime ${OV_FRONTEND_LINK_LIBRARIES})
target_link_libraries(${TARGET_NAME} PUBLIC openvino::runtime)
target_link_libraries(${TARGET_NAME} PRIVATE ${OV_FRONTEND_LINK_LIBRARIES})
# WA for TF frontends which always requires protobuf (not protobuf-lite)
# if TF FE is built in static mode, use protobuf for all other FEs

View File

@@ -1,4 +1,4 @@
// Copyright (C) 2018-2021 Intel Corporation
// Copyright (C) 2018-2022 Intel Corporation
// SPDX-License-Identifier: Apache-2.0
//

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -19,11 +19,13 @@ execute_process(
"${CMAKE_COMMAND}" -S "${ncc_style_bin_dir}/source"
-B "${ncc_style_bin_dir}/build"
RESULT_VARIABLE clang_find_result
OUTPUT_VARIABLE output
ERROR_VARIABLE output)
OUTPUT_VARIABLE output_var
ERROR_VARIABLE error_var)
if(NOT clang_find_result EQUAL "0")
message(WARNING "Please, install libclang-[N]-dev package (required for ncc naming style check)")
message(WARNING "find_package(Clang) output: ${output_var}")
message(WARNING "find_package(Clang) error: ${error_var}")
set(ENABLE_NCC_STYLE OFF)
endif()
@@ -75,12 +77,12 @@ endif()
#
# ov_ncc_naming_style(FOR_TARGET target_name
# INCLUDE_DIRECTORY dir
# SOURCE_DIRECTORY dir
# [ADDITIONAL_INCLUDE_DIRECTORIES dir1 dir2 ..]
# [DEFINITIONS def1 def2 ..])
#
# FOR_TARGET - name of the target
# INCLUDE_DIRECTORY - directory to check headers from
# SOURCE_DIRECTORY - directory to check sources from
# ADDITIONAL_INCLUDE_DIRECTORIES - additional include directories used in checked headers
# DEFINITIONS - additional definitions passed to preprocessor stage
#
@@ -90,23 +92,24 @@ function(ov_ncc_naming_style)
endif()
cmake_parse_arguments(NCC_STYLE "FAIL"
"FOR_TARGET;INCLUDE_DIRECTORY" "ADDITIONAL_INCLUDE_DIRECTORIES;DEFINITIONS" ${ARGN})
"FOR_TARGET;SOURCE_DIRECTORY" "ADDITIONAL_INCLUDE_DIRECTORIES;DEFINITIONS" ${ARGN})
foreach(var FOR_TARGET INCLUDE_DIRECTORY)
foreach(var FOR_TARGET SOURCE_DIRECTORY)
if(NOT DEFINED NCC_STYLE_${var})
message(FATAL_ERROR "${var} is not defined in ov_ncc_naming_style function")
endif()
endforeach()
file(GLOB_RECURSE headers
RELATIVE "${NCC_STYLE_INCLUDE_DIRECTORY}"
"${NCC_STYLE_INCLUDE_DIRECTORY}/*.hpp")
file(GLOB_RECURSE sources
RELATIVE "${NCC_STYLE_SOURCE_DIRECTORY}"
"${NCC_STYLE_SOURCE_DIRECTORY}/*.hpp"
"${NCC_STYLE_SOURCE_DIRECTORY}/*.cpp")
list(APPEND NCC_STYLE_ADDITIONAL_INCLUDE_DIRECTORIES "${NCC_STYLE_INCLUDE_DIRECTORY}")
list(APPEND NCC_STYLE_ADDITIONAL_INCLUDE_DIRECTORIES "${NCC_STYLE_SOURCE_DIRECTORY}")
foreach(header IN LISTS headers)
set(output_file "${ncc_style_bin_dir}/${header}.ncc_style")
set(full_header_path "${NCC_STYLE_INCLUDE_DIRECTORY}/${header}")
foreach(source IN LISTS sources)
set(output_file "${ncc_style_bin_dir}/${source}.ncc_style")
set(full_source_path "${NCC_STYLE_SOURCE_DIRECTORY}/${source}")
add_custom_command(
OUTPUT
@@ -115,7 +118,7 @@ function(ov_ncc_naming_style)
"${CMAKE_COMMAND}"
-D "PYTHON_EXECUTABLE=${PYTHON_EXECUTABLE}"
-D "NCC_PY_SCRIPT=${ncc_script_py}"
-D "INPUT_FILE=${full_header_path}"
-D "INPUT_FILE=${full_source_path}"
-D "OUTPUT_FILE=${output_file}"
-D "DEFINITIONS=${NCC_STYLE_DEFINITIONS}"
-D "CLANG_LIB_PATH=${libclang_location}"
@@ -124,12 +127,12 @@ function(ov_ncc_naming_style)
-D "EXPECTED_FAIL=${NCC_STYLE_FAIL}"
-P "${ncc_style_dir}/ncc_run.cmake"
DEPENDS
"${full_header_path}"
"${full_source_path}"
"${ncc_style_dir}/openvino.style"
"${ncc_script_py}"
"${ncc_style_dir}/ncc_run.cmake"
COMMENT
"[ncc naming style] ${header}"
"[ncc naming style] ${source}"
VERBATIM)
list(APPEND output_files ${output_file})
endforeach()
@@ -145,6 +148,6 @@ endfunction()
if(TARGET ncc_all)
ov_ncc_naming_style(FOR_TARGET ncc_all
INCLUDE_DIRECTORY "${ncc_style_dir}/self_check"
SOURCE_DIRECTORY "${ncc_style_dir}/self_check"
FAIL)
endif()

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -2,12 +2,12 @@
CppMethod: '^(operator\W+|[a-z_\d]+|signaling_NaN|quiet_NaN)$'
ClassName: '^([A-Z][\w]+|b?float16|numeric_limits|ngraph_error|stopwatch|unsupported_op)$'
StructName: '^([A-Z][\w]+|element_type_traits|hash|oi_pair)$'
FunctionName: '^(operator\W+|[a-z_\d]+)$'
FunctionName: '^(operator\W+|[a-z_\d]+)|PrintTo$'
Namespace: '^([a-z\d_]+|InferenceEngine)$'
NamespaceAlias: '^([a-z\d_]+|InferenceEngine)$'
UnionName: '[A-Z][\w]+$'
TemplateTemplateParameter: '[A-Z][\w]+'
NamespaceReference: '^([a-z\d_]+|InferenceEngine)$'
NamespaceReference: '^([a-z\d_]+|InferenceEngine|GPUContextParams)$'
TemplateNonTypeParameter: '^\w*$'
ClassTemplate: '^([A-Z][\w]+|element_type_traits)$'
TemplateTypeParameter: '^\w*$'
@@ -72,12 +72,12 @@ CxxNullPointerLiteralExpression: '^.*$'
CxxThisExpression: '^.*$'
CxxThrowExpression: '^.*$'
CxxNewExpression: '^.*$'
CxxDeleteExpression: 'XXXX'
CxxDeleteExpression: '^.*$'
CxxUnaryExpression: '^.*$'
PackExpansionExpression: '^.*$'
SizeOfPackExpression: '^.*$'
LambdaExpression: '^.*$'
ObjectBoolLiteralExpression: 'XXXX'
ObjectBoolLiteralExpression: '^.*$'
ObjectSelfExpression: 'XXXX'
UnexposedStatement: 'XXXX'
LabelStatement: 'XXXX'
@@ -99,7 +99,7 @@ CxxCatchStatement: '^.*$'
CxxTryStatement: '^.*$'
CxxForRangeStatement: '^.*$'
MsAsmStatement: 'XXXX'
NullStatement: 'XXXX'
NullStatement: '^.*$'
DeclarationStatement: '^.*$'
TranslationUnit: 'XXXX'
UnexposedAttribute: '^.*$'

View File

@@ -1,2 +1,2 @@
clang==9.0
clang==11.0
pyyaml

View File

@@ -1,4 +1,4 @@
// Copyright (C) 2018-2021 Intel Corporation
// Copyright (C) 2018-2022 Intel Corporation
// SPDX-License-Identifier: Apache-2.0
//

View File

@@ -1,4 +1,4 @@
// Copyright (C) 2018-2021 Intel Corporation
// Copyright (C) 2018-2022 Intel Corporation
// SPDX-License-Identifier: Apache-2.0
//

View File

@@ -1,4 +1,4 @@
// Copyright (C) 2018-2021 Intel Corporation
// Copyright (C) 2018-2022 Intel Corporation
// SPDX-License-Identifier: Apache-2.0
//

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -15,6 +15,10 @@ function(ie_cpack_set_library_dir)
set(IE_CPACK_LIBRARY_PATH runtime/lib/${ARCH_FOLDER}/$<CONFIG> PARENT_SCOPE)
set(IE_CPACK_RUNTIME_PATH runtime/bin/${ARCH_FOLDER}/$<CONFIG> PARENT_SCOPE)
set(IE_CPACK_ARCHIVE_PATH runtime/lib/${ARCH_FOLDER}/$<CONFIG> PARENT_SCOPE)
elseif(APPLE)
set(IE_CPACK_LIBRARY_PATH runtime/lib/${ARCH_FOLDER}/$<CONFIG> PARENT_SCOPE)
set(IE_CPACK_RUNTIME_PATH runtime/lib/${ARCH_FOLDER}/$<CONFIG> PARENT_SCOPE)
set(IE_CPACK_ARCHIVE_PATH runtime/lib/${ARCH_FOLDER}/$<CONFIG> PARENT_SCOPE)
else()
set(IE_CPACK_LIBRARY_PATH runtime/lib/${ARCH_FOLDER} PARENT_SCOPE)
set(IE_CPACK_RUNTIME_PATH runtime/lib/${ARCH_FOLDER} PARENT_SCOPE)

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -102,32 +102,33 @@ function(ie_add_plugin)
endif()
add_dependencies(ie_plugins ${IE_PLUGIN_NAME})
if(TARGET inference_engine_preproc)
if(TARGET openvino_gapi_preproc)
if(BUILD_SHARED_LIBS)
add_dependencies(${IE_PLUGIN_NAME} inference_engine_preproc)
add_dependencies(${IE_PLUGIN_NAME} openvino_gapi_preproc)
else()
target_link_libraries(${IE_PLUGIN_NAME} PRIVATE inference_engine_preproc)
target_link_libraries(${IE_PLUGIN_NAME} PRIVATE openvino_gapi_preproc)
endif()
endif()
# fake dependencies to build in the following order:
# IE -> IE readers -> IE inference plugins -> IE-based apps
if(BUILD_SHARED_LIBS)
if(TARGET ov_ir_frontend)
add_dependencies(${IE_PLUGIN_NAME} ov_ir_frontend)
if(TARGET openvino_ir_frontend)
add_dependencies(${IE_PLUGIN_NAME} openvino_ir_frontend)
endif()
if(TARGET openvino_onnx_frontend)
add_dependencies(${IE_PLUGIN_NAME} openvino_onnx_frontend)
endif()
if(TARGET openvino_paddle_frontend)
add_dependencies(${IE_PLUGIN_NAME} openvino_paddle_frontend)
endif()
if(TARGET openvino_tensorflow_frontend)
add_dependencies(${IE_PLUGIN_NAME} openvino_tensorflow_frontend)
endif()
# TODO: remove with legacy CNNNLayer API / IR v7
if(TARGET inference_engine_ir_v7_reader)
add_dependencies(${IE_PLUGIN_NAME} inference_engine_ir_v7_reader)
endif()
if(TARGET ov_onnx_frontend)
add_dependencies(${IE_PLUGIN_NAME} ov_onnx_frontend)
endif()
if(TARGET ov_paddle_frontend)
add_dependencies(${IE_PLUGIN_NAME} ov_paddle_frontend)
endif()
if(TARGET ov_tensorflow_frontend)
add_dependencies(${IE_PLUGIN_NAME} ov_tensorflow_frontend)
endif()
endif()
# install rules
@@ -186,19 +187,24 @@ macro(ie_register_plugins_dynamic)
# Unregister <device_name>.xml files for plugins from current build tree
set(plugins_to_remove ${IE_REGISTER_POSSIBLE_PLUGINS})
set(config_output_file "$<TARGET_FILE_DIR:${IE_REGISTER_MAIN_TARGET}>/plugins.xml")
foreach(plugin IN LISTS plugins_to_remove)
foreach(name IN LISTS PLUGIN_FILES)
string(REPLACE ":" ";" name "${name}")
list(LENGTH name length)
if(NOT ${length} EQUAL 2)
message(FATAL_ERROR "Unexpected error, please, contact developer of this script")
endif()
list(GET name 0 device_name)
add_custom_command(TARGET ${IE_REGISTER_MAIN_TARGET} POST_BUILD
COMMAND
"${CMAKE_COMMAND}"
-D "IE_CONFIG_OUTPUT_FILE=${config_output_file}"
-D "IE_PLUGIN_NAME=${plugin}"
-D "IE_PLUGIN_NAME=${device_name}"
-D "IE_CONFIGS_DIR=${CMAKE_BINARY_DIR}/plugins"
-P "${IEDevScripts_DIR}/plugins/unregister_plugin_cmake.cmake"
COMMENT
"Remove ${plugin} from the plugins.xml file"
"Remove ${device_name} from the plugins.xml file"
VERBATIM)
endforeach()
@@ -314,7 +320,7 @@ function(ie_generate_plugins_hpp)
endforeach()
# add plugins to libraries including ie_plugins.hpp
ie_target_link_plugins(ov_runtime)
ie_target_link_plugins(openvino)
if(TARGET inference_engine_s)
ie_target_link_plugins(inference_engine_s)
endif()

View File

@@ -1,4 +1,4 @@
// Copyright (C) 2018-2021 Intel Corporation
// Copyright (C) 2018-2022 Intel Corporation
// SPDX-License-Identifier: Apache-2.0
//

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -46,19 +46,34 @@ endforeach()
set(newContent "")
file(STRINGS "${IE_CONFIG_OUTPUT_FILE}" content)
set(already_exists_in_xml OFF)
foreach(line IN LISTS content)
if("${line}" MATCHES "</plugins>")
if(NOT already_exists_in_xml)
foreach(plugin_file IN LISTS plugin_files_to_add)
file(READ "${plugin_file}" content)
set(newContent "${newContent}
${content}")
get_filename_component(plugin_name "${plugin_file}" NAME_WE)
if("${line}" MATCHES "name=\"${plugin_name}\"")
set(already_exists_in_xml ON)
endif()
endforeach()
endif()
if (NOT already_exists_in_xml)
if("${line}" MATCHES "</plugins>")
foreach(plugin_file IN LISTS plugin_files_to_add)
file(READ "${plugin_file}" content)
set(newContent "${newContent}
${content}")
endforeach()
endif()
if(newContent)
set(newContent "${newContent}\n${line}")
else()
set(newContent "${line}")
if(newContent)
set(newContent "${newContent}\n${line}")
else()
set(newContent "${line}")
endif()
endif()
if("${line}" MATCHES "</plugin>")
set(already_exists_in_xml OFF)
endif()
endforeach()

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -15,7 +15,7 @@ file(STRINGS "${IE_CONFIG_OUTPUT_FILE}" content)
set(skip_plugin OFF)
foreach(line IN LISTS content)
if("${line}" MATCHES "${IE_PLUGIN_NAME}")
if("${line}" MATCHES "name=\"${IE_PLUGIN_NAME}\"")
set(skip_plugin ON)
endif()

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
# Target system specific flags

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
# TBB_FOUND should not be set explicitly. It is defined automatically by CMake.

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -10,7 +10,7 @@ set(IE_VS_VER_COMPANY_NAME_STR "Intel Corporation")
set(IE_VS_VER_PRODUCTVERSION_STR "${CI_BUILD_NUMBER}")
set(IE_VS_VER_PRODUCTNAME_STR "OpenVINO toolkit")
set(IE_VS_VER_COPYRIGHT_STR "Copyright (C) 2018-2021, Intel Corporation")
set(IE_VS_VER_COMMENTS_STR "https://docs.openvinotoolkit.org/")
set(IE_VS_VER_COMMENTS_STR "https://docs.openvino.ai/")
#
# ie_add_vs_version_file(NAME <name>

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -82,8 +82,8 @@ function(register_extra_modules)
endif()
endforeach()
if ("${NS}" STREQUAL "openvino")
file(APPEND "${devconfig_file}" "add_library(${NS}::runtime ALIAS ov_runtime)\n")
file(APPEND "${devconfig_file}" "add_library(${NS}::runtime::dev ALIAS ov_runtime_dev)\n")
file(APPEND "${devconfig_file}" "add_library(${NS}::runtime ALIAS openvino)\n")
file(APPEND "${devconfig_file}" "add_library(${NS}::runtime::dev ALIAS openvino_dev)\n")
endif()
endfunction()

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -106,17 +106,17 @@ ie_option (ENABLE_HETERO "Enables Hetero Device Plugin" ON)
ie_option (ENABLE_TEMPLATE "Enable template plugin" ON)
ie_dependent_option (ENABLE_VPU "vpu targeted plugins for inference engine" ON "NOT WINDOWS_PHONE;NOT WINDOWS_STORE" OFF)
ie_dependent_option (ENABLE_INTEL_MYRIAD_COMMON "common part of myriad plugin" ON "NOT WINDOWS_PHONE;NOT WINDOWS_STORE" OFF)
ie_dependent_option (ENABLE_MYRIAD "myriad targeted plugin for inference engine" ON "ENABLE_VPU" OFF)
ie_dependent_option (ENABLE_INTEL_MYRIAD "myriad targeted plugin for inference engine" ON "ENABLE_INTEL_MYRIAD_COMMON" OFF)
ie_dependent_option (ENABLE_MYRIAD_NO_BOOT "myriad plugin will skip device boot" OFF "ENABLE_MYRIAD" OFF)
ie_dependent_option (ENABLE_MYRIAD_NO_BOOT "myriad plugin will skip device boot" OFF "ENABLE_INTEL_MYRIAD" OFF)
ie_dependent_option (ENABLE_GAPI_TESTS "tests for GAPI kernels" ON "ENABLE_GAPI_PREPROCESSING;ENABLE_TESTS" OFF)
ie_dependent_option (GAPI_TEST_PERF "if GAPI unit tests should examine performance" OFF "ENABLE_GAPI_TESTS" OFF)
ie_dependent_option (ENABLE_MYRIAD_MVNC_TESTS "functional and behavior tests for mvnc api" OFF "ENABLE_TESTS;ENABLE_MYRIAD" OFF)
ie_dependent_option (ENABLE_MYRIAD_MVNC_TESTS "functional and behavior tests for mvnc api" OFF "ENABLE_TESTS;ENABLE_INTEL_MYRIAD" OFF)
ie_dependent_option (ENABLE_DATA "fetch models from testdata repo" ON "ENABLE_FUNCTIONAL_TESTS;NOT ANDROID" OFF)
@@ -181,11 +181,11 @@ if (ENABLE_PROFILING_RAW)
add_definitions(-DENABLE_PROFILING_RAW=1)
endif()
if (ENABLE_MYRIAD)
add_definitions(-DENABLE_MYRIAD=1)
if (ENABLE_INTEL_MYRIAD)
add_definitions(-DENABLE_INTEL_MYRIAD=1)
endif()
if (ENABLE_MYRIAD_NO_BOOT AND ENABLE_MYRIAD )
if (ENABLE_MYRIAD_NO_BOOT AND ENABLE_INTEL_MYRIAD)
add_definitions(-DENABLE_MYRIAD_NO_BOOT=1)
endif()

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -9,7 +9,6 @@ include(CMakeFindDependencyMacro)
# TODO: remove after changing [private plugins]
set_and_check(OpenVINO_SOURCE_DIR "@OpenVINO_SOURCE_DIR@") # KMB
set_and_check(OpenVINO_MAIN_SOURCE_DIR "@OpenVINO_SOURCE_DIR@") # KMB
set_and_check(IE_MAIN_SOURCE_DIR "@IE_MAIN_SOURCE_DIR@") # HDDL
# Variables to export in plugin's projects
@@ -45,7 +44,7 @@ find_dependency(InferenceEngine
NO_DEFAULT_PATH)
find_dependency(ngraph
PATHS "${CMAKE_CURRENT_LIST_DIR}/src/core"
PATHS "${CMAKE_CURRENT_LIST_DIR}"
NO_CMAKE_FIND_ROOT_PATH
NO_DEFAULT_PATH)

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
# FindOpenVINO
@@ -168,7 +168,19 @@ endif()
_ov_find_dependency(Threads)
if(NOT TARGET ov_runtime)
set(ENABLE_INTEL_GNA "@ENABLE_INTEL_GNA@")
set(ENABLE_INTEL_GNA_SHARED "@BUILD_SHARED_LIBS@")
if(ENABLE_INTEL_GNA AND NOT ENABLE_INTEL_GNA_SHARED AND NOT libGNA_FOUND)
set_and_check(GNA_PATH "@PACKAGE_GNA_PATH@")
_ov_find_dependency(libGNA
COMPONENTS KERNEL
CONFIG
PATHS ${CMAKE_CURRENT_LIST_DIR}
NO_CMAKE_FIND_ROOT_PATH
NO_DEFAULT_PATH)
endif()
if(NOT TARGET openvino)
set(_ov_as_external_package ON)
include("${CMAKE_CURRENT_LIST_DIR}/OpenVINOTargets.cmake")
@@ -224,6 +236,7 @@ if(_need_package_name_reset)
unset(_need_package_name_reset)
endif()
unset(${CMAKE_FIND_PACKAGE_NAME}_IR_FOUND)
unset(${CMAKE_FIND_PACKAGE_NAME}_Paddle_FOUND)
unset(${CMAKE_FIND_PACKAGE_NAME}_ONNX_FOUND)
unset(${CMAKE_FIND_PACKAGE_NAME}_TensorFlow_FOUND)

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#

View File

@@ -1,5 +1,5 @@
# ******************************************************************************
# Copyright 2017-2021 Intel Corporation
# Copyright 2017-2022 Intel Corporation
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
@@ -26,11 +26,16 @@
#
# Frontends:
#
# ngraph_ov_onnx_frontend_FOUND - True if the system has ov_onnx_frontend library
# ngraph::ov_onnx_frontend - ONNX FrontEnd target (optional)
# ngraph_onnx_frontend_FOUND - True if the system has ngraph::onnx_frontend library
# ngraph::onnx_frontend - ONNX FrontEnd target (optional)
#
# ngraph_paddle_frontend_FOUND - True if the system has Paddle frontend
# ngraph::ov_paddle_frontend - nGraph Paddle frontend (optional)
# ngraph_paddle_frontend_FOUND - True if the system has Paddle frontend
# ngraph::paddle_frontend - nGraph Paddle frontend (optional)
#
# ngraph_ir_frontend_FOUND - True if the system has OpenVINO IR frontend
#
# ngraph_tensorflow_frontend_FOUND - True if the system has TensorFlow frontend
# ngraph::tensorflow_frontend - nGraph TensorFlow frontend (optional)
#
@PACKAGE_INIT@
@@ -50,43 +55,46 @@ if(TARGET openvino::runtime AND NOT TARGET ngraph::ngraph)
INTERFACE_LINK_LIBRARIES openvino::runtime)
endif()
if(TARGET openvino::frontend::onnx AND NOT TARGET ngraph::ov_onnx_frontend)
add_library(ngraph::ov_onnx_frontend INTERFACE IMPORTED)
set_target_properties(ngraph::ov_onnx_frontend PROPERTIES
if(TARGET openvino::frontend::onnx AND NOT TARGET ngraph::onnx_frontend)
add_library(ngraph::onnx_frontend INTERFACE IMPORTED)
set_target_properties(ngraph::onnx_frontend PROPERTIES
INTERFACE_LINK_LIBRARIES openvino::frontend::onnx)
endif()
if(TARGET openvino::frontend::paddle AND NOT TARGET ngraph::ov_paddle_frontend)
add_library(ngraph::ov_paddle_frontend INTERFACE IMPORTED)
set_target_properties(ngraph::ov_paddle_frontend PROPERTIES
if(TARGET openvino::frontend::paddle AND NOT TARGET ngraph::paddle_frontend)
add_library(ngraph::paddle_frontend INTERFACE IMPORTED)
set_target_properties(ngraph::paddle_frontend PROPERTIES
INTERFACE_LINK_LIBRARIES openvino::frontend::paddle)
endif()
if(TARGET openvino::frontend::tensorflow AND NOT TARGET ngraph::ov_tensorflow_frontend)
add_library(ngraph::ov_tensorflow_frontend INTERFACE IMPORTED)
set_target_properties(ngraph::ov_tensorflow_frontend PROPERTIES
if(TARGET openvino::frontend::tensorflow AND NOT TARGET ngraph::tensorflow_frontend)
add_library(ngraph::tensorflow_frontend INTERFACE IMPORTED)
set_target_properties(ngraph::tensorflow_frontend PROPERTIES
INTERFACE_LINK_LIBRARIES openvino::frontend::tensorflow)
endif()
set(ngraph_ngraph_FOUND ON)
set(NGRAPH_LIBRARIES ngraph::ngraph)
set(ngraph_ov_onnx_frontend_FOUND ${OpenVINO_Frontend_ONNX_FOUND})
set(ngraph_onnx_frontend_FOUND ${OpenVINO_Frontend_ONNX_FOUND})
set(ngraph_tensorflow_frontend_FOUND ${OpenVINO_Frontend_TensorFlow_FOUND})
set(ngraph_paddle_frontend_FOUND ${OpenVINO_Frontend_Paddle_FOUND})
set(ngraph_onnx_importer_FOUND ${OpenVINO_Frontend_ONNX_FOUND})
if(ngraph_onnx_importer_FOUND)
set(ONNX_IMPORTER_LIBRARIES ngraph::ov_onnx_frontend)
set(ONNX_IMPORTER_LIBRARIES ngraph::onnx_frontend)
# ngraph::onnx_importer target and variables are deprecated
# but need to create a dummy target for BW compatibility
if(NOT TARGET ngraph::onnx_importer)
add_library(ngraph::onnx_importer INTERFACE IMPORTED)
set_target_properties(ngraph::onnx_importer PROPERTIES
INTERFACE_LINK_LIBRARIES ngraph::ov_onnx_frontend)
INTERFACE_LINK_LIBRARIES ngraph::onnx_frontend)
endif()
endif()
set(ngraph_paddle_frontend_FOUND ${OpenVINO_Frontend_Paddle_FOUND})
set(ngraph_tensorflow_frontend_FOUND ${OpenVINO_Frontend_TensorFlow_FOUND})
set(ngraph_onnx_frontend_FOUND ${OpenVINO_Frontend_ONNX_FOUND})
set(ngraph_ir_frontend_FOUND ${OpenVINO_Frontend_IR_FOUND})
check_required_components(ngraph)

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -86,11 +86,6 @@ ov_model_convert("${OpenVINO_SOURCE_DIR}/${rel_path}"
"${CMAKE_RUNTIME_OUTPUT_DIRECTORY}/test_model_zoo/onnx_import"
ie_onnx_import_out_files)
set(rel_path "docs/onnx_custom_op")
ov_model_convert("${OpenVINO_SOURCE_DIR}/${rel_path}"
"${CMAKE_RUNTIME_OUTPUT_DIRECTORY}/test_model_zoo/docs/models"
docs_onnx_out_files)
if(ENABLE_TESTS)
if(ENABLE_OV_ONNX_FRONTEND AND ENABLE_REQUIREMENTS_INSTALL)
find_package(PythonInterp 3 REQUIRED)

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -21,4 +21,4 @@ endmacro()
_set_if_not_defined(FORCE_32 ON)
# need libusb 32-bits version
_set_if_not_defined(ENABLE_VPU OFF)
_set_if_not_defined(ENABLE_INTEL_MYRIAD_COMMON OFF)

View File

@@ -1,4 +1,4 @@
# Copyright (C) 2018-2021 Intel Corporation
# Copyright (C) 2018-2022 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
#
@@ -25,7 +25,7 @@ endif()
if(use_static_runtime)
foreach(lang C CXX)
foreach(build_type "" "_DEBUG" "_MINSIZEREL" "_RELEASE" "_RELWITHDEBINFO")
set(flag_var "CMAKE_${lang}_FLAGS${build_type}")
set(flag_var "CMAKE_${lang}_FLAGS${build_type}_INIT")
string(REPLACE "/MD" "/MT" ${flag_var} "${${flag_var}}")
endforeach()
endforeach()

Some files were not shown because too many files have changed in this diff Show More