Commit Graph

6038 Commits

Author SHA1 Message Date
Vladislav Golubev
191b15a228
build fix (#9311) 2021-12-20 14:58:04 +03:00
Sergey Lyubimtsev
ff330ea41e
Fetch requirements directly from openvino tools (#9154)
* Fetch requirements directly from accuracy_checker

* get requirements from pot & benchmark tool directly
2021-12-20 14:01:17 +03:00
Vladislav Golubev
f3dd39e3d2
DetectionOutput8ToDetectionOutput1 test disabled (#9307) 2021-12-20 13:25:09 +03:00
Liubov Talamanova
a847e1f7fa
[POT] Added printing IE, MO and POT versions during POT launch (#8679)
* Add POT version print

* Changed version in setup.py

* Add version to setup.py

* Update imports
2021-12-20 13:09:22 +03:00
Vladislav Golubev
ca7600edde
[dynamism][Transformations] Sequences conversions: dynamic shapes support (#7766)
* [Transformations] Sequences conversion: refactoring & dynamic shapes support

* tests moved
2021-12-20 12:49:39 +03:00
Vladimir Paramuzov
d56dc20956
[GPU] Moved GPU remote headers to intel_gpu folder and namespace (#9290) 2021-12-20 12:14:32 +03:00
Anton Pankratov
114d37b28c
Fixed release oreder (#9218) 2021-12-20 12:11:32 +03:00
Ilya Churaev
dbf8fcf556
Create ov_runtime library (#9199)
* Create ov_runtime library

* Added dev target

* Fixed SOURCE_DIR property for interface lib

* Fixed missed include path

* Fixed SOURCES for plugins and frontends

* Fixed Windows export

* Try to fix preproc build

* Fixed MKLDNNPlugin

* Fix C API

* Try to fix public CI

* Fixed comments

* Use TARGET_NAME variable

* Fixed static build

* Fixed target name in comfig

* Revert "Fixed target name in comfig"

This reverts commit f61c1e0c09.

* Try to remove WA with include path

* Try to fix TBB dependency for old CMake

* Revert install to lib for legacy tests

* Try to fix public tests

* Add WA for v7 reader

* Fixed dev export name

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-12-20 11:59:08 +03:00
Edward Shogulin
37ad512d98
[CPU] Optimize quantization scheme for SPR/ATS (#7549)
* [CPU] Optimize quantization scheme for SPR/ATS

* [CPU] [LPT] plugin tests

* [GPU] [LPT] plugin tests

* [CPU] limitation was removed

* [CPU] optimization FP32 old way support

* [LPT] comment fix

* [LPT] Multiply plugin test improvement

* [LPT] Multiply support

* [LPT] GPU tests fix

* [LPT] test quick fix

* [LPT] new ppi fix

* look like spent time for tests refactoring
2021-12-20 11:19:40 +03:00
Egor Duplensky
abee3ea4d4
[CPU] Refactoring. Avoid using align arg when appending post ops (#9225)
Always align legacy scale shift post ops
2021-12-20 10:23:32 +03:00
Vladislav Golubev
fab4448ebd
[dynamism][Transformations] Fusing transformations: dynamic batch support (#7351) 2021-12-20 10:11:43 +03:00
Liubov Talamanova
4564867a44
Update POT tests for OMZ location in openvino/thirdparty (#9171)
* Move OMZ to thirdparty/open_model_zoo

* Improve diagnostic of issues

* Update path to OMZ in the Python wheel setup.py

* Update POT tests for OMZ location in openvino/thirdparty

* fix mo path

Co-authored-by: azhogov <alexander.zhogov@intel.com>
2021-12-20 09:10:39 +03:00
Jade Cho
a4518ae595
[GPU] Add DumpLayersLimitBatch config to GPU debug utils. (#9196)
* Add DumpLayersLimitBatch config to GPU debug utils.

+ Support OV_GPU_Help config
+ Only run first inference if OV_GPU_DumpLayersPath is set.
+ Fix dump graph bug.

* Apply some comments

* Remove unnecessary code.
2021-12-20 14:19:53 +09:00
Maxim Gordeev
abcd7486a9
Moving of C++ speech sample to OpenVINO API 2.0 (#9027)
* Moved Speech sample to OpenVINO 2.0

* improved samples's score

* changed code style

* added GNA configs

* renamed function due to new API

* added dynamic batch

* reordered includes

* speech_sample has more than 1 input

* added oname processing

* added multi input

* fixed notes

* removed getFullDeviceName with old api

* getFullDeviceName for benchmark
2021-12-19 20:56:40 +03:00
Anton Chetverikov
6b0d1525fd
[MO]Implement additional shape extraction for TF Placeholder operation (#8817)
* Implement additional shape extraction for TF placeholder operation

* Update checks and add comments

* Use more accurate check

* Extract _output_shapes attr only if we have problems with shape attr

* Add missed import

* Apply suggestions from code review

Update code comments

Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>

* Add update condition to avoid unnecessary checks

* Remove unnecessary checks

Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>
2021-12-18 19:55:06 +03:00
Ivan Tikhonov
526fe3098d
JsonConfig/JsonTranformation/DecoderTransformation Extensions (#9042)
* Squash commits: JsonConfig/JsonTranformation/DecoderTransformation extensions,
Unit tests, pybindings

* Call transformation_extensions in convert_partially method

* fix codestyle

* move json extensions to offline transformations

* Fix unit tests

* fix cmake files

* Refactor JsonConfig extensions and FrontEnds

* Update python bindings

* Add missing files

* correct mkl hash

* fix conflicts with master branch

* Resolve review comments

* Revert local changes

* code style

* Add lib destinations

* fix cmake

* correct nlohmann_json hash

* FunctionPass to ModelPass

* fix unit tests and pyopenvino

* fix pyopenvino

* resolve review comments

* revert local change

* Fix dynamic Win build

* Try to fix linux builds

* Fix Lin build: set correct lib directory

* Resolve review commets

* code style

* resolve review comments

* ubuntu20 issue investigation: temporary disable LTO for frontends

* ubuntu20 issue investigation: temporary disable LTO for unit tests

* ubuntu20 issue investigation: temporary disable LTO for thirdparty and core parts

* Revert "ubuntu20 issue investigation: temporary disable LTO for thirdparty and core parts"

This reverts commit 5489072e4a.

* Revert "ubuntu20 issue investigation: temporary disable LTO for unit tests"

This reverts commit 73bd3c6bac.

* Revert "ubuntu20 issue investigation: temporary disable LTO for frontends"

This reverts commit dce2ba4830.

* resolve review comments

* try to disable lto for 3rd party json libs

* fix missprint; codestyle
2021-12-18 18:19:25 +03:00
Tomasz Dołbniak
d82b58a408
Handling of cut + reshape in MO using ONNX FE (#9102) 2021-12-18 13:29:40 +01:00
Ilya Churaev
be86ec51ab
Renamed frontends from *ov_frontend to ov_*_frontend (#9275)
* Renamed frontends from *ov_frontend to ov_*_frontend

* Fixed MO

* Fixed include
2021-12-18 13:25:42 +03:00
Ilya Churaev
e02e777df3
Fixed codeowners (#9283) 2021-12-18 02:03:09 +03:00
Mikhail Nosov
c7a3c93d3f
FrontEnd API - change 'shared_ptr' to 'const shared_ptr&' (#9287)
* FrontEnd API - change 'shared_ptr' to 'const shared_ptr&' in public arguments

* Fix clang-format
2021-12-17 22:39:13 +03:00
Maxim Vafin
36a6774067
Fix preprocessing in MO to use friendly names as well as tensor names (#9206)
* Fix preprocessing in MO to use friendly names as well as tensor names

* Apply review comments

* Revert not necessary changes

* Apply review feedback
2021-12-17 19:05:43 +03:00
Liubov Talamanova
ad10edbd2e
Set fullname instead of name in fq_configuration (#9281) 2021-12-17 18:46:57 +03:00
Pavel Esir
ba4802554e
[MO] Azure CI, unit-test dirs and howto doc fixes (#9146)
* Azure CI fixes for MO

* leftover: update imports in docs

* moved unit-tests from extensions/ into mo/
2021-12-17 15:56:40 +03:00
Egor Duplensky
b394441c79
[CPU] Fix sse4 uni_ methods (Normalize and Input nodes) (#9268) 2021-12-17 15:13:16 +03:00
Smirnov Grigorii
123c99ca52
move conv_ie deconv_ie to legacy with related passes. (#9117)
* move conv_ie deconv_ie to legacy with related passes. Change headers to legacy

* update convert_nms_gather_path_to_unsigned.cpp

* add legacy dependecy and revert changes in tests

* remove INFERENCE_ENGINE_API_CLASS
2021-12-17 15:08:50 +03:00
Piotr Szmelczynski
9e8c8dbd94
[PYTHON] Improve Tensor-to-numpy converts (#9138)
* add support for f16 and bf16 for outputs_to_dict

* create test for f16

* add test for infer new request return type

* fix infer return type test

* update Type import

* update asserts in infer_new_request_return_type

* fix import in test_infer_request

* clean test file

* style fix
2021-12-17 14:37:59 +03:00
Ivan Tikhonov
59fca61dd5
[FrontEnds]: Fix build issue on Win platforms (#9274)
* include place.hpp into input_model.hpp

* resolve issues in api validator

* set full namespaces for Place::Ptr in input_model
2021-12-17 13:37:16 +03:00
serhii-pavlovskyi-altran
c047da07c0
fix lohika ci checkout in the face of changed submodules (#9266)
* fix ci checkout in the face of changed submodules

* update cldnn plugin name in lohika ci script

Co-authored-by: Serhii Pavlovskyi <spavlovskyi@lohika.com>
2021-12-17 13:31:01 +03:00
Sergey Shlyapnikov
71f3e2da10
[GPU] Fix fused ops reshaping for OneDNN FC (#9217) 2021-12-17 13:26:59 +03:00
Victor Kuznetsov
e212a1ac83
[TimeTests] Disable VPU option, rename cache option (#9114)
* add performance hint to time infer

* Update time tests with options

* fix mistake in help

* update test conf with GPU models

* move ie configs from load plugin timer
2021-12-17 13:06:56 +03:00
Yaroslav Torzuk
3f5fca80db
[GPU] Slice operation (#8267) 2021-12-17 12:41:05 +03:00
Sofya Balandina
062d86f71f
[IE TESTS] Fix fill blob with random data for precision U4/I4/BIN (#9241) 2021-12-17 12:25:47 +03:00
Fedor Zharinov
e9874ec1d4
Dynamic reshapes (#7788)
* Merged and compiling

* Fix for dynamic shape type

* review fixes

* renamed blob shape to tensor shape, small improvements

* fix code style

* added parsing of multiple shapes

* store latency per group, add isIdleRequestAvailable() to Infer Queue

* added cached random inputs

* redesign pipeline, added new metrics(avg, max, min), added metrics per groups

* fixed code style

* small improvements

* modified tensor parameters parsing

* modified -i parameter parsing: added possibility to specify input names

* implemented image cashing

* added cashed blobs creating

* added -pcseq flag, modified batch filling, changes fps formula

* improvements

* code formatting

* code formatting2

* apply suggestions from review

* replaced Buffer class with InferenceEngine Blobs

* use batch size in blobs filling

* added shared blob allocator to handle blob's data

* fixed warnings & code style

* allocate blobs

* fix for networks with image info input

* added comments & fixed codestyle

* clear data in free() in SharedBlobAllocator

* remove unnecessary check

* Delimeter is changed to ::

* stylefix

* added layout from string function, small improvements

* modified parsing to enable : in input parameters

* small fixes

* small fixes

* added missed blob allocation, fixes

* [TEST]added support for remote blobs

* fix remote blobs

* new inputs/files output format

* removed vectors resize which caused bugs

* made cl::Buffer type under ifdef, fix inputs filling

* changed batch() function to not throwing exceptions

* removed unused var

* fix code style

* replace empty name in input files with name from net input

* restored old behaviour for static models

* fix code style

* fix warning - made const iterator

* fix warning - remove reference in loop variable

* added random and image_info input types to -i, fix problem with layout

* replaced batch() with getBatchSize() in main

* fix layout, shape, tensor shape parameters parsing

* upd help messages for input, tensor shape and pcseq command

* added buffer for cl output blobs, small fixes

Signed-off-by: ivikhrev <ivan.vikhrev@intel.com>

* added legacy mode

* restore setBlob

* code style formatting

* move collecting latency for groups under flag

* removed not applicable layouts

* added hint to error message when wrong input name in -tensor_shape was specified

* added new metrics to statistics report

* Apply suggestions from code review

* fix binary blobs filling when layout is CN

* apply suggestions

* moved file in the right place after rebase

* improved -pcseq output

* updated args and readme

* removed TEMPLATE plugin registration

* fix -shape arg  decsription

* enable providing several -i args as input

* renamed legacy_mode to inference_only and made it default for static models, renamed tensor_shape to data_shape

* upd readme

* use getBlob() in inference only mode

* fix old input type for static case

* fix typo

* upd readme

* move log about benchmark mode to the measuring perfomance step

* added class for latency metrics

* upd readme, fix typos, renamed funcs

* fix warning and upd parsing to avoid error with : in file paths

* fix error on centos : error: use of deleted function ‘std::basic_stringstream<char>::basic_stringstream(const std::basic_stringstream<char>&)

* added check for key in inputs

* renamed input to inputs

* adjust batch size for binary blobs

* replaced warning with exception in bench mode defining

* align measurement cycle with master

Co-authored-by: ivikhrev <ivan.vikhrev@intel.com>
2021-12-17 12:20:43 +03:00
Aleksandr Korolev
4c4d006c5a
[VPU] restore network P/R info in Import method (#8844)
In the new API, we need to recover information about function inputs/outputs.
2021-12-17 12:14:08 +03:00
Indira Salyahova
0644aaa947
[POT] Add new special metrics in aa (#9251)
* Update utils.py

* Update utils.py
2021-12-17 12:05:27 +03:00
Maxim Andronov
04dc16f861
[CPU] General fixes for dynamic shapes. Part 2 (#8871) 2021-12-17 11:12:07 +03:00
Min, Byungil
94c3731b50
[GPU] support multiple sum post-op of onednn kernel (#9221)
+ Applied WA for multiple sum post-ops of nednn kernel

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2021-12-17 10:43:21 +03:00
Sergey Lyubimtsev
b41cb57773
Fix build issue for openvino wheel package on Windows (#9265)
* Fix build issue for openvino wheel package on Windows

* fix env
2021-12-17 10:42:21 +03:00
Ivan Tikhonov
dbd2b5dc08
ONNX/IR/Common FrontEnds Refactoring (#9174)
* Refactor ONNX,IR,Common FrontEnds

* Rename frontends dir to frontend

* Rename frontend_manager, frontend_defs -> manager, defs; move Place, InputModel to src for Paddle FE

* remove exports for ir/input_model

* fix unit tests

* Fix unit tests

* revert ONNX_API/IR_API defines

* move manager.hpp to frontend dir

* delete common folder; rename defs to visibility; fix includes

* revert local changes

* codestyle

* fix build: set correct includes

* fix includes

* fix build; resolve review comments

* fix install paths

* correct installation folder for onnx_import

* use IE_THROW in ir frontend
2021-12-17 08:05:30 +03:00
Mikhail Nosov
4fea4024b4
Overwrite 'model' layout with preprocessing when layout is already set (#9258) 2021-12-17 00:55:47 +03:00
Alexander Zhogov
d421bc6c4f
Azure CI: Fix "access denied" issue with certutil on Windows CC (#9269) 2021-12-16 22:09:26 +03:00
Yury Gaydaychuk
58f0c75b91
[CPU] RoiAlign: case of integer tensor handled (#8069) 2021-12-16 22:02:09 +03:00
Ekaterina Aidova
012e513f75
update POT submodule (#8740)
* update POT submodule

* update tests
2021-12-16 19:05:36 +03:00
Alexander Zhogov
0668ea0779
Azure CI: Fix "access denied" issue with certutil on Windows (#9262)
* Azure CI: Fix "access denied" issue with certutil on Windows

* Use Invoke-WebRequest for GitHub
2021-12-16 18:54:08 +03:00
Steve Yoo
bd2e3de295
Create LSTMCell-1 (#9073) 2021-12-16 17:48:10 +03:00
Vladislav Volkov
6ddc47a7ef
[CPU] Convert precisions on inputs/outputs (#8805) 2021-12-16 16:58:19 +03:00
Sergey Shlyapnikov
2514c0ef38
[GPU] Add gemm_tiled_opt i8/u8 output support (#9202) 2021-12-16 15:20:28 +03:00
Alexander Zhogov
d10e8005c0
Revert "Fix build issue for openvino wheel package on Windows (#9231)" (#9260)
This reverts commit 460a6634fd.
2021-12-16 14:33:56 +03:00
Vitaliy Urusovskij
2db19e6bf7
Fix c4146 warning: unary minus operator on unsigned type (#9153) 2021-12-16 13:13:05 +03:00
Sergey Lyubimtsev
460a6634fd
Fix build issue for openvino wheel package on Windows (#9231)
* fix build issue for openvino wheel package on Windows

* revert ngraph_libs
2021-12-16 13:01:03 +03:00