Commit Graph

6079 Commits

Author SHA1 Message Date
Egor Duplensky
abee3ea4d4
[CPU] Refactoring. Avoid using align arg when appending post ops (#9225)
Always align legacy scale shift post ops
2021-12-20 10:23:32 +03:00
Vladislav Golubev
fab4448ebd
[dynamism][Transformations] Fusing transformations: dynamic batch support (#7351) 2021-12-20 10:11:43 +03:00
Liubov Talamanova
4564867a44
Update POT tests for OMZ location in openvino/thirdparty (#9171)
* Move OMZ to thirdparty/open_model_zoo

* Improve diagnostic of issues

* Update path to OMZ in the Python wheel setup.py

* Update POT tests for OMZ location in openvino/thirdparty

* fix mo path

Co-authored-by: azhogov <alexander.zhogov@intel.com>
2021-12-20 09:10:39 +03:00
Jade Cho
a4518ae595
[GPU] Add DumpLayersLimitBatch config to GPU debug utils. (#9196)
* Add DumpLayersLimitBatch config to GPU debug utils.

+ Support OV_GPU_Help config
+ Only run first inference if OV_GPU_DumpLayersPath is set.
+ Fix dump graph bug.

* Apply some comments

* Remove unnecessary code.
2021-12-20 14:19:53 +09:00
Maxim Gordeev
abcd7486a9
Moving of C++ speech sample to OpenVINO API 2.0 (#9027)
* Moved Speech sample to OpenVINO 2.0

* improved samples's score

* changed code style

* added GNA configs

* renamed function due to new API

* added dynamic batch

* reordered includes

* speech_sample has more than 1 input

* added oname processing

* added multi input

* fixed notes

* removed getFullDeviceName with old api

* getFullDeviceName for benchmark
2021-12-19 20:56:40 +03:00
Anton Chetverikov
6b0d1525fd
[MO]Implement additional shape extraction for TF Placeholder operation (#8817)
* Implement additional shape extraction for TF placeholder operation

* Update checks and add comments

* Use more accurate check

* Extract _output_shapes attr only if we have problems with shape attr

* Add missed import

* Apply suggestions from code review

Update code comments

Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>

* Add update condition to avoid unnecessary checks

* Remove unnecessary checks

Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>
2021-12-18 19:55:06 +03:00
Ivan Tikhonov
526fe3098d
JsonConfig/JsonTranformation/DecoderTransformation Extensions (#9042)
* Squash commits: JsonConfig/JsonTranformation/DecoderTransformation extensions,
Unit tests, pybindings

* Call transformation_extensions in convert_partially method

* fix codestyle

* move json extensions to offline transformations

* Fix unit tests

* fix cmake files

* Refactor JsonConfig extensions and FrontEnds

* Update python bindings

* Add missing files

* correct mkl hash

* fix conflicts with master branch

* Resolve review comments

* Revert local changes

* code style

* Add lib destinations

* fix cmake

* correct nlohmann_json hash

* FunctionPass to ModelPass

* fix unit tests and pyopenvino

* fix pyopenvino

* resolve review comments

* revert local change

* Fix dynamic Win build

* Try to fix linux builds

* Fix Lin build: set correct lib directory

* Resolve review commets

* code style

* resolve review comments

* ubuntu20 issue investigation: temporary disable LTO for frontends

* ubuntu20 issue investigation: temporary disable LTO for unit tests

* ubuntu20 issue investigation: temporary disable LTO for thirdparty and core parts

* Revert "ubuntu20 issue investigation: temporary disable LTO for thirdparty and core parts"

This reverts commit 5489072e4a.

* Revert "ubuntu20 issue investigation: temporary disable LTO for unit tests"

This reverts commit 73bd3c6bac.

* Revert "ubuntu20 issue investigation: temporary disable LTO for frontends"

This reverts commit dce2ba4830.

* resolve review comments

* try to disable lto for 3rd party json libs

* fix missprint; codestyle
2021-12-18 18:19:25 +03:00
Tomasz Dołbniak
d82b58a408
Handling of cut + reshape in MO using ONNX FE (#9102) 2021-12-18 13:29:40 +01:00
Ilya Churaev
be86ec51ab
Renamed frontends from *ov_frontend to ov_*_frontend (#9275)
* Renamed frontends from *ov_frontend to ov_*_frontend

* Fixed MO

* Fixed include
2021-12-18 13:25:42 +03:00
Ilya Churaev
e02e777df3
Fixed codeowners (#9283) 2021-12-18 02:03:09 +03:00
Mikhail Nosov
c7a3c93d3f
FrontEnd API - change 'shared_ptr' to 'const shared_ptr&' (#9287)
* FrontEnd API - change 'shared_ptr' to 'const shared_ptr&' in public arguments

* Fix clang-format
2021-12-17 22:39:13 +03:00
Maxim Vafin
36a6774067
Fix preprocessing in MO to use friendly names as well as tensor names (#9206)
* Fix preprocessing in MO to use friendly names as well as tensor names

* Apply review comments

* Revert not necessary changes

* Apply review feedback
2021-12-17 19:05:43 +03:00
Liubov Talamanova
ad10edbd2e
Set fullname instead of name in fq_configuration (#9281) 2021-12-17 18:46:57 +03:00
Pavel Esir
ba4802554e
[MO] Azure CI, unit-test dirs and howto doc fixes (#9146)
* Azure CI fixes for MO

* leftover: update imports in docs

* moved unit-tests from extensions/ into mo/
2021-12-17 15:56:40 +03:00
Egor Duplensky
b394441c79
[CPU] Fix sse4 uni_ methods (Normalize and Input nodes) (#9268) 2021-12-17 15:13:16 +03:00
Smirnov Grigorii
123c99ca52
move conv_ie deconv_ie to legacy with related passes. (#9117)
* move conv_ie deconv_ie to legacy with related passes. Change headers to legacy

* update convert_nms_gather_path_to_unsigned.cpp

* add legacy dependecy and revert changes in tests

* remove INFERENCE_ENGINE_API_CLASS
2021-12-17 15:08:50 +03:00
Piotr Szmelczynski
9e8c8dbd94
[PYTHON] Improve Tensor-to-numpy converts (#9138)
* add support for f16 and bf16 for outputs_to_dict

* create test for f16

* add test for infer new request return type

* fix infer return type test

* update Type import

* update asserts in infer_new_request_return_type

* fix import in test_infer_request

* clean test file

* style fix
2021-12-17 14:37:59 +03:00
Ivan Tikhonov
59fca61dd5
[FrontEnds]: Fix build issue on Win platforms (#9274)
* include place.hpp into input_model.hpp

* resolve issues in api validator

* set full namespaces for Place::Ptr in input_model
2021-12-17 13:37:16 +03:00
serhii-pavlovskyi-altran
c047da07c0
fix lohika ci checkout in the face of changed submodules (#9266)
* fix ci checkout in the face of changed submodules

* update cldnn plugin name in lohika ci script

Co-authored-by: Serhii Pavlovskyi <spavlovskyi@lohika.com>
2021-12-17 13:31:01 +03:00
Sergey Shlyapnikov
71f3e2da10
[GPU] Fix fused ops reshaping for OneDNN FC (#9217) 2021-12-17 13:26:59 +03:00
Victor Kuznetsov
e212a1ac83
[TimeTests] Disable VPU option, rename cache option (#9114)
* add performance hint to time infer

* Update time tests with options

* fix mistake in help

* update test conf with GPU models

* move ie configs from load plugin timer
2021-12-17 13:06:56 +03:00
Yaroslav Torzuk
3f5fca80db
[GPU] Slice operation (#8267) 2021-12-17 12:41:05 +03:00
Sofya Balandina
062d86f71f
[IE TESTS] Fix fill blob with random data for precision U4/I4/BIN (#9241) 2021-12-17 12:25:47 +03:00
Fedor Zharinov
e9874ec1d4
Dynamic reshapes (#7788)
* Merged and compiling

* Fix for dynamic shape type

* review fixes

* renamed blob shape to tensor shape, small improvements

* fix code style

* added parsing of multiple shapes

* store latency per group, add isIdleRequestAvailable() to Infer Queue

* added cached random inputs

* redesign pipeline, added new metrics(avg, max, min), added metrics per groups

* fixed code style

* small improvements

* modified tensor parameters parsing

* modified -i parameter parsing: added possibility to specify input names

* implemented image cashing

* added cashed blobs creating

* added -pcseq flag, modified batch filling, changes fps formula

* improvements

* code formatting

* code formatting2

* apply suggestions from review

* replaced Buffer class with InferenceEngine Blobs

* use batch size in blobs filling

* added shared blob allocator to handle blob's data

* fixed warnings & code style

* allocate blobs

* fix for networks with image info input

* added comments & fixed codestyle

* clear data in free() in SharedBlobAllocator

* remove unnecessary check

* Delimeter is changed to ::

* stylefix

* added layout from string function, small improvements

* modified parsing to enable : in input parameters

* small fixes

* small fixes

* added missed blob allocation, fixes

* [TEST]added support for remote blobs

* fix remote blobs

* new inputs/files output format

* removed vectors resize which caused bugs

* made cl::Buffer type under ifdef, fix inputs filling

* changed batch() function to not throwing exceptions

* removed unused var

* fix code style

* replace empty name in input files with name from net input

* restored old behaviour for static models

* fix code style

* fix warning - made const iterator

* fix warning - remove reference in loop variable

* added random and image_info input types to -i, fix problem with layout

* replaced batch() with getBatchSize() in main

* fix layout, shape, tensor shape parameters parsing

* upd help messages for input, tensor shape and pcseq command

* added buffer for cl output blobs, small fixes

Signed-off-by: ivikhrev <ivan.vikhrev@intel.com>

* added legacy mode

* restore setBlob

* code style formatting

* move collecting latency for groups under flag

* removed not applicable layouts

* added hint to error message when wrong input name in -tensor_shape was specified

* added new metrics to statistics report

* Apply suggestions from code review

* fix binary blobs filling when layout is CN

* apply suggestions

* moved file in the right place after rebase

* improved -pcseq output

* updated args and readme

* removed TEMPLATE plugin registration

* fix -shape arg  decsription

* enable providing several -i args as input

* renamed legacy_mode to inference_only and made it default for static models, renamed tensor_shape to data_shape

* upd readme

* use getBlob() in inference only mode

* fix old input type for static case

* fix typo

* upd readme

* move log about benchmark mode to the measuring perfomance step

* added class for latency metrics

* upd readme, fix typos, renamed funcs

* fix warning and upd parsing to avoid error with : in file paths

* fix error on centos : error: use of deleted function ‘std::basic_stringstream<char>::basic_stringstream(const std::basic_stringstream<char>&)

* added check for key in inputs

* renamed input to inputs

* adjust batch size for binary blobs

* replaced warning with exception in bench mode defining

* align measurement cycle with master

Co-authored-by: ivikhrev <ivan.vikhrev@intel.com>
2021-12-17 12:20:43 +03:00
Aleksandr Korolev
4c4d006c5a
[VPU] restore network P/R info in Import method (#8844)
In the new API, we need to recover information about function inputs/outputs.
2021-12-17 12:14:08 +03:00
Indira Salyahova
0644aaa947
[POT] Add new special metrics in aa (#9251)
* Update utils.py

* Update utils.py
2021-12-17 12:05:27 +03:00
Maxim Andronov
04dc16f861
[CPU] General fixes for dynamic shapes. Part 2 (#8871) 2021-12-17 11:12:07 +03:00
Min, Byungil
94c3731b50
[GPU] support multiple sum post-op of onednn kernel (#9221)
+ Applied WA for multiple sum post-ops of nednn kernel

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2021-12-17 10:43:21 +03:00
Sergey Lyubimtsev
b41cb57773
Fix build issue for openvino wheel package on Windows (#9265)
* Fix build issue for openvino wheel package on Windows

* fix env
2021-12-17 10:42:21 +03:00
Ivan Tikhonov
dbd2b5dc08
ONNX/IR/Common FrontEnds Refactoring (#9174)
* Refactor ONNX,IR,Common FrontEnds

* Rename frontends dir to frontend

* Rename frontend_manager, frontend_defs -> manager, defs; move Place, InputModel to src for Paddle FE

* remove exports for ir/input_model

* fix unit tests

* Fix unit tests

* revert ONNX_API/IR_API defines

* move manager.hpp to frontend dir

* delete common folder; rename defs to visibility; fix includes

* revert local changes

* codestyle

* fix build: set correct includes

* fix includes

* fix build; resolve review comments

* fix install paths

* correct installation folder for onnx_import

* use IE_THROW in ir frontend
2021-12-17 08:05:30 +03:00
Mikhail Nosov
4fea4024b4
Overwrite 'model' layout with preprocessing when layout is already set (#9258) 2021-12-17 00:55:47 +03:00
Alexander Zhogov
d421bc6c4f
Azure CI: Fix "access denied" issue with certutil on Windows CC (#9269) 2021-12-16 22:09:26 +03:00
Yury Gaydaychuk
58f0c75b91
[CPU] RoiAlign: case of integer tensor handled (#8069) 2021-12-16 22:02:09 +03:00
Ekaterina Aidova
012e513f75
update POT submodule (#8740)
* update POT submodule

* update tests
2021-12-16 19:05:36 +03:00
Alexander Zhogov
0668ea0779
Azure CI: Fix "access denied" issue with certutil on Windows (#9262)
* Azure CI: Fix "access denied" issue with certutil on Windows

* Use Invoke-WebRequest for GitHub
2021-12-16 18:54:08 +03:00
Steve Yoo
bd2e3de295
Create LSTMCell-1 (#9073) 2021-12-16 17:48:10 +03:00
Vladislav Volkov
6ddc47a7ef
[CPU] Convert precisions on inputs/outputs (#8805) 2021-12-16 16:58:19 +03:00
Sergey Shlyapnikov
2514c0ef38
[GPU] Add gemm_tiled_opt i8/u8 output support (#9202) 2021-12-16 15:20:28 +03:00
Alexander Zhogov
d10e8005c0
Revert "Fix build issue for openvino wheel package on Windows (#9231)" (#9260)
This reverts commit 460a6634fd.
2021-12-16 14:33:56 +03:00
Vitaliy Urusovskij
2db19e6bf7
Fix c4146 warning: unary minus operator on unsigned type (#9153) 2021-12-16 13:13:05 +03:00
Sergey Lyubimtsev
460a6634fd
Fix build issue for openvino wheel package on Windows (#9231)
* fix build issue for openvino wheel package on Windows

* revert ngraph_libs
2021-12-16 13:01:03 +03:00
Anton Chetverikov
fa05743e01
[MO]Handle new format of fp16 irs in croupconv pass (#8921)
* Handle new format of fp16 irs in croupconv pass

* Update condition check

* Make check more explicit
2021-12-16 11:20:50 +03:00
Yuan Hu
4dab2662aa
[Auto plugin] add KEY_NETWORK_PRIORITY (#8146)
* add KEY_NETWORK_PRIORITY

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* use uniqueName instead of fulldieviceName

use lamba instead of macro

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* test draft

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix compile issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add test config

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add origin select test

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* perf Counter as seperate member

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add null device test case for select device

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix cache test failed issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* use a function to register priority

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add const

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add some comments

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* initialize AutoContext in define

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* use lock guard

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* change get() to wait()

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add unregister in load failed

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add const on unique name

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix compile issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add test for ParseMetaDevices and fix logic issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* change key name to AUTO_NETWORK_PRIORITY

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix compile issue caused by API change in master

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix key incorrect test in ci

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* go back to origin set config code

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix mock test issue after Parameter changed to Any

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix macos compile issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* remove question comments

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* remove duplicate config

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* update test case

from the hello_query_device
CPU
   FULL_DEVICE_NAME : Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz
GPU
  FULL_DEVICE_NAME : Intel(R) Gen9 HD Graphics (iGPU)
MYRIAD.3.1-ma2480
  FULL_DEVICE_NAME : Intel Movidius Myriad X VPU
MYRIAD.3.2-ma2480
  FULL_DEVICE_NAME : Intel Movidius Myriad X VPU

currently GetMetric("MYRIAD","FULL_DEVICE_NAME")
will thrown No KEY_DEVICE_ID

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* only GPU use the fullDeviceName

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix rebase issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* change directory after ie test moved

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix winodws compile unit test issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2021-12-16 10:48:04 +03:00
Roman Lyamin
2068d5838b
[GPU] Add I420toRGB/I420toBGR operations (#9204) 2021-12-16 10:27:27 +03:00
Alexandra Sidorova
58be795970
[CPU] Added BF16 support for CumSum as well (#9030) 2021-12-16 10:24:57 +03:00
Maxim Andronov
d5f84ad783
[CPU] Deconvolution dynamism support (#8512) 2021-12-16 09:53:14 +03:00
Indira Salyahova
ea3f34c351
Temporary revert test layout (#9242)
* Update test_image_loading.py

* Update test_image_loading.py
2021-12-16 08:51:24 +03:00
Ilya Churaev
9b71a5fb70
Fixed python tests (#9238) 2021-12-16 07:52:59 +03:00
Mateusz Tabaka
40f668140e
Fix compilation error in template_plugin tests (#9248) 2021-12-16 01:52:26 +03:00
Irina Efode
d1e54d9961
[IE TESTS] Fix filters in report (#9232) 2021-12-15 23:43:24 +03:00