Commit Graph
2808 Commits
Author SHA1 Message Date
Pavel Esir 572ab040dc [IE] fix printing dynamic signatures (#7620)
* [IE] fix printing dynamic signatures

* fixed printing scalars output dimensions as well

* turned off printing dynamic signatures
2021-09-24 18:50:35 +03:00
Vladimir Paramuzov 3eb1aa59de [MULTI] Fixed devices comparison to respect default device id (#7311)
* [GPU] Fixed default device id

* [MULTI] Fixed devices comparison to respect default device id
2021-09-24 12:32:38 +03:00
Maxim Shevtsov fdc125118e Reverted to atomic flag on the load completion + GetGraph that will wait for graph to be loaded (as opposite to assuming it is loaded) (#7629) 2021-09-24 12:20:57 +03:00
Vladislav Volkov f8618b75a9 benchmark_app incorrectly fills in the inputs for cached models (#7535) 2021-09-24 11:07:14 +03:00
Bartek Szmelczynski f038fcf2bb ScatterUpdate ng op shell revision (#7375)
* add visitors, type_prop tests, update ngrap op class

* update NGRPH_RTTI for scatter_update

* add proper formatting for error message

* update opset
2021-09-24 10:31:45 +03:00
Roman Lyamin f202c45c46 [IE TESTS] Move locale test to shared folder (#7605) 2021-09-24 10:27:07 +03:00
Maxim Shevtsov f2dda1bbca Added new tests that config set via ie.SetConfig or LoadNetwork is returned via exe_net.GetConfig and align plugin impl to that (#7627) 2021-09-24 10:03:24 +03:00
Egor Shulman 95342de8c8 [CPU] Fixed failed tests (#6742) 2021-09-24 09:37:54 +03:00
Alexandra Sidorova ae3e3af521 [CPU] Removed optimized out nodes from infer stage (#7440) 2021-09-24 09:31:41 +03:00
Vladislav Volkov f8f6e57c39 [CPU] Fix for Int8 models serialization issues (#7554) 2021-09-24 09:24:35 +03:00
Anna Khakimova 3d07763835 Fix for int overflow (#7592) 2021-09-24 09:03:58 +03:00
Ilya Churaev 6159a5b0bc New ov::Function API (#7436)
* Generates tensor names

* Implement function helpers for Inputs/Outputs

* Fixed code style

* Share result tensor and add more tests

* Avoid not unique tensor names

* Print tensor name

* Fixed comment

* Fixed matmul transformation

* Fixed function evaluate

* Fixed typo

* Fixed interpreter backend

* Fixed comments

* Removed tensor names check

* Disabled negative tests

* Fixed NetworkContext_CNNNetwork tests

* Fixed GNA tests

* Remove reset names

* Fixed code style

* Temporary disable names generation

* Revert "Temporary disable names generation"

This reverts commit 133315a611.

* Fixed mapping generation and e2e tests

* Fixe Myriad tests

* Introduce AtomicGuard to fix possible thread issues

* Fixed comments
2021-09-24 07:11:02 +03:00
Mikhail Nosov 531118c4b0 OV2.0 Preprocessing shared tests - initial version (#7568)
* Shared preprocessing tests for plugins.
Comparing inference with reference implementation

* Moved evaluate tests to template plugin

* Fixed clang-style

* CPU tests: Set IE precision manually in SetUp. Also allow rounding to integer mismatch

* Added acceptable threshold depending on particular test
2021-09-23 23:17:59 +03:00
Sergey Shlyapnikov 9c2b3f24a9 Fix benchmark_app build (#7577) 2021-09-23 18:42:19 +03:00
Vladimir Dudnik 6e95c96443 fix typo in NC layout description (#7622) 2021-09-23 17:13:57 +03:00
Ilya Lavrenov 84a07889f0 Added version information to OpenVINO Core (#7600)
* Added version information to OpenVINO Core

* Fixed code style

* Fixed Windows

* Fixed code style

* Fixed clang
2021-09-23 17:03:45 +03:00
Ilya Churaev 634759210f Introduced OpenVINO RTTI and add version string to operations (#7288)
* Introduced OpenVINO RTTI and add version string to operations

* Fixed build

* Try to fix build

* Removed get_type_info_static

* Fixed tests

* Moved ov operations to new macros

* Fixed type_info_static

* Introduce new header only declaration

* Deprecate type_info static member

* Introduced OPENVINO_OPERATION macro

* Fixed ngraph lib with new RTTI

* Fixed unit tests

* Fixed code style

* Fixed VPU common

* Fixed all target for macOS

* Changed macto to OPENVINO_OP

* Changed cldnn

* Fixed typo

* Fixed some unit tests with old operations

* Fixed DiscreteTypeInfo

* Fixed type relaxed operations

* Fixed legacy tests

* Fixed naming style

* Fixed cpuTests

* Disabled deprecation to pass CI

* Added compatibility to internal operations

* Added BWDCMP for internal ops

* Deprecate type_info

* Fixed Slice RTTI

* Fixed Myriad

* Applied patch from PR 7573
2021-09-23 13:29:39 +03:00
Ilya Lavrenov 7938c18b7c Improved openvino runtime python wheel build (#7604)
* Proper dependencies for ie_wheel

* Used version information when building wheels
2021-09-23 10:41:57 +03:00
Ilya Lavrenov e253b5931c Removed TensorDesc from OpenVINO Runtime API (#7587)
* Removed TensorDesc from OpenVINO Runtime API

* Fixed docs
2021-09-23 10:41:14 +03:00
Ilya Lavrenov ab34701590 Added OpenVINO runtime macro (#7586)
* Fixed typo

* Moved ie::Parameter to new API

* New OpenVINO API macro

* Used OpenVINO Plugin API for some plugins

* Used OPENVINO_RUNTIME_API

* Revert "Moved ie::Parameter to new API"

This reverts commit fef5e3b487.

* Fixed code style and docs

* Fixed compilation
2021-09-23 10:39:20 +03:00
Alexey Lebedev 243028a408 Add create_encoder (#7566) 2021-09-22 22:23:39 +03:00
Ilya Lavrenov 1078bb8718 Install python test utils to tests cpack component (#7594) 2021-09-22 18:29:12 +03:00
Vladimir Paramuzov 0b4ae86001 [GPU] New data and weights formats support (#6616) 2021-09-22 15:45:10 +03:00
Ilya Lavrenov 538d492a70 Removed dependencies scripts (#7569) 2021-09-22 12:17:41 +03:00
Irina Efode f5e7c9646d [IE TESTS] Separate conformance tests to 3 targets: op_conformance, api_conformace and conformance_infra (#7503)
* [IE TESTS] Separate conformance tests to 3 targets: op_conformance, api_conformace and conformance_infra

* Small fixes

* small fix

* try fix ci
2021-09-22 11:00:37 +03:00
Anton Pankratv 5dc773e51b Added range roi blob API (#7567) 2021-09-22 10:54:37 +03:00
mei, yang e2272331be [GPU] Improve IsNodeOnConstPath() method (#7458) 2021-09-22 10:52:58 +03:00
Ilya Lavrenov 377f46898c Moved ie::Parameter to new API (#7584)
* Fixed typo

* Moved ie::Parameter to new API

* Fixed compilation for Android
2021-09-22 10:38:09 +03:00
Vladimir Zinoviev 1aa6db4aaf [LPT] Move FQ disabled for non-per-tensor FQs (#7581) 2021-09-22 01:15:36 +03:00
Dawid Kożykowski c29edb1f4e remove deprecated test classes (#7390) 2021-09-21 15:15:48 +03:00
Ilya Lavrenov db385569c2 Throw ov::Exception from ov::runtime (#7536)
* Exceptions

* Throw ov::Exception from ov::runtime

* code style

* Fixed function name
2021-09-21 14:26:01 +03:00
Roman Lyamin d6ade04fc7 [GPU] Performance improvement for Load Network (#7514) 2021-09-21 11:35:23 +03:00
Andrey SapozhnikovandSzymon Irzabek 2349caa482 [GNA] Plugin transition to the library v3.0 Master (#7386)
* GNA Plugin transition to the library v3.0 Master

* [GNA] Enable 2D convolution decomposition on GNA 3.0

* [GNA] Fix cpplint

* [GNA] Fix cpplint

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>
2021-09-21 10:59:35 +03:00
Vladimir Zinoviev fadb768fcd [LPT] INT16, INT32 Quantization support (#7199)
* [LPT] INT16, INT32 Quantization support

* [LPT] Support build on platforms with size_t == unsigned int

* [LPT] Test and fix wrong constant

* Fix build for size_t = unsigned int
2021-09-21 10:00:35 +03:00
Vladimir Paramuzov 43609b4b4e [GPU] Added onednn dependency. (#6564) 2021-09-21 09:48:16 +03:00
Gleb Kazantaev 07d9b51121 Replace IR Reader With IR Frontend (#7249)
* Replace IR Reader With IR Frontend
2021-09-20 23:17:22 +03:00
Ilya Churaev 55fb542bc6 Added OpenVINO util library (#7481)
* Added OpenVINO util library

* Fixed code style

* Fixed build

* Fixed build

* Added methods from IE utils

* Fixed style

* Fixed Windows build

* Fixed linux build

* Fixed windows build

* Try to fix dladdr

* Try to fix windows

* Fixed typo

* Fixed detection dynamic libs from static library

* Revert some changes

* Revert changes in windows loader

* Revert network reader

* Removed some methods from plugin API

* Fixed fluid tests

* Fixed typo

* Fixed include

* Try to fix CI

* Try to fix centos

* fix typo
2021-09-20 18:37:32 +03:00
Vladislav Golubev da9595dae4 [LPT] getDequantization: added precision limitation for mul/sub constants (#7517)
* [LPT] getDequantization: added precision limitation for dequantization constants

* [TESTS] GetDequantizationTransformation: added test case with unsupported precision
2021-09-20 14:02:55 +03:00
Egor Duplensky db565e60c6 [CPU] Refactor node dumping to avoid extra code in Infer method (#6931) 2021-09-20 12:29:21 +03:00
Nikolay Shchegolev 168d8b9e84 [General] Statically detected issues. (#7432) 2021-09-20 09:28:39 +03:00
Taylor Yeonbok Lee 30ddd06159 [GPU] Allocate internal buffer to usm_device (#7109)
* Allocate internal buffer to usm_device when one of the input tensor is from usm_device.
Allocate output tensors if there is no user which is cpu impl.

* Move intermediate buffer allocation to primitive_inst

* Allocate to usm_host when the internal buffer is allocated close to limitation of device memory

* Remove internal_buffer_info and replace it with vector of layout.
Updated conditions to use alloc_type w.r.t the availability.

* Allocate internal buffer within primitive_inst construction

* Fixed device_mem allocation condition aligned with driver team
- Single allocation should be less than CL_DEVICE_MAX_MEM_ALLOC_SIZE
- Total allocation for a kernel should be less than CL_DEVICE_GLOBAL_MEM_SIZE

* Apply review comment
2021-09-18 07:50:36 +03:00
Andrew Kwangwoong Park 277a23b8e4 [GPU] Update debug config verbose option to show the name of tensors allocated (#7407)
Signed-off-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>
2021-09-17 21:12:53 +03:00
Andrew Kwangwoong Park 7772aeb3bb [GPU] Fix RapidJSON assertion failure during loading kernel (#7526)
Signed-off-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>
2021-09-17 20:13:09 +03:00
Roman Lyamin 660c106233 [GPU] Performance counters fix (#7143) 2021-09-17 13:12:25 +03:00
Dmitry PigasinandDmitry Pigasin a6bdb8744f [IE Python Speech Sample] Enable --scale_factor for multiple input files (#7482)
* Enable --scale_factor for multiple input files

* Small refactoring of getting a first utterance

* Fix mypy issue

* Update readme

Co-authored-by: Dmitry Pigasin <dmitry.pigasin@intel.com>
2021-09-17 11:59:49 +03:00
Yuan Hu ac8db25864 Enable CPU accelerate FIL in MULTI (#7380)
* Enable CPU accelerate FIL in MULTI

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add configure to device

KEY_PERFORMANCE_HINT_NUM_REQUESTS

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2021-09-17 11:17:54 +03:00
Sergey Shlyapnikov 1f85d4230d Add use_device_mem option to benchmark_app (#7433) 2021-09-17 11:04:50 +03:00
Anton Pankratv 8690e14a5b Disabled TBB Executor (#7454) 2021-09-17 10:26:23 +03:00
Ilya Churaev d2333cc012 Introduced template for OV2.0 migration guide (#7360)
* Introduced template for OV2.0 migration guide

* Fixed comments

* Fixed comments
2021-09-17 03:53:39 +03:00
Dmitry Pigasin ffa07eb6f3 Refactor code to output result after each utterance infer (#7450) 2021-09-16 12:52:10 +03:00