Commit Graph

12220 Commits

Author SHA1 Message Date
Evgenya Stepyreva
4f415ba211
Partial Values and Labels visualization and update in label equality checks (#18527)
* Provided visualization of partial values and labels. Adopted DimensionTracker for better equivalence tracking

* Addressed comments and fixed one test
2023-07-17 11:59:24 +00:00
Oleg Pipikin
b211767280
Consolidate common test utils targets (#18385)
* Consolidate test util targets

* Fix code style

* Fix 1

* Fix code style
2023-07-17 11:59:13 +00:00
Anastasiia Pnevskaia
cd6ffd7620
Removed redundant copy of Tensor in TF Const translator (#18299)
* Removed copy of consts in translator, added test.

* Fixed memory loss for tf.Const.

* Added test, minor corrections.

* Update src/bindings/python/src/openvino/frontend/tensorflow/node_decoder.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Test corrections.

* Added comment.

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-07-17 11:41:33 +00:00
Ilya Churaev
f9ead5016f
Moved copy_to to impl and move template plugin to this API (#18574)
* Moved copy_to to impl and move template plugin to this API

* Fixed code style

* Fixed documentation
2023-07-17 15:27:17 +04:00
Vitaliy Urusovskij
aeff5056f5
Hetero 2.0 leftovers (#18559)
* Enable `LoadedTensor.*HETERO` test

* Fix use of `ICompiledModel::outputs()`

* Remove extra `loaded_from_cache` argument

* Misprint

* Small refactoring

* Remove extra `model` from `CompiledModelDesc`
Use `get_runtime_model()` instead

* ClangFormat
2023-07-17 11:58:44 +04:00
Eddy Kim
2c73916093
[GPU] fix compilation context to use kernel_impl_params as key (#18470)
* fixed aompilation context to use kernel_impl_params for key

* fixed the argument for push_task
2023-07-17 00:48:12 -07:00
Anastasia Kuporosova
5b522b556d
[PyOV] Extend Tensor API (#18464)
* [PyOV] Extend Tensor API

* one more ctor

* apply comments

* support constoutput

* add checks for shape

* checks for type and shape

* apply comments

* is_continuos

* codestyle
2023-07-17 09:44:47 +02:00
Ilya Churaev
f38566834b
Remove unsupported plugin from proxy in order to avoid exception catching (#18518)
* Remove unsupported plugin from proxy in order to avoid exception
catching

* Remove from alias for

* Globally remove unavailable devices

* Do not load proxy if no available devices

* Try to fix CI

* Add debug messages

* Avoid two times the same plugin

* Revert "Add debug messages"

This reverts commit 562e36c633.

* Cache hidden devices

* Update if fallback order was changed

* Try to fix CI

* Fixed CoreThreading tests

* Fixed typo

* Try to fix plugin initialization

* Fixed initialization

* Fixed lock
2023-07-17 11:10:59 +04:00
Ilya Churaev
a2b75bbc87
Do not return default context from the compiled model (#18468)
* Do not return default context from the compiled model

* Try to fix segfault

* Added test

* Remove unnecessary code

* Remove code duplication

* Migrate to new API

* Fixed comment

* Revert renamed variable

* Remove cast

* Hetero throws OV Exception
2023-07-17 07:15:54 +04:00
Piotr Krzemiński
d7984f3ec2
[PT FE] Add aten::quantize_per_tensor, aten::quantize_per_channel, aten::dequantize (#18266)
* Support GetAttr with packed params

* Apply suggestions from code review

* [PT FE] Add quantized types as normal types to decoder

* [PT FE] Add decoder dequantize, add dtypes to quantize

* [PT FE] Add dequantize example

* [PT FE] Implement replacer for quantized nodes

* [PT FE] Register replacer for quantize/dequantize

* [PT FE] Remove unwanted junk from previous version

* [PT FE] Fix building mistakes for frontend

* [PT FE] Clang fix

* [PT FE] Ease of use upgrade to quantize funcs

* [PT FE] Clang format

* [PT FE] Introduce new version of quantize/dequantize

* [PT FE] Remove unwanted files from new version

* [PT FE] Fix style

* [PT FE] Add QuantizedPtNode replacer, fix accuracy error

* [PT FE] Add improved version of quantize/dequantize with shared_ptrs

* [PT FE] Fix utils shared ptr reference error

* [PT FE] Quantize now takes correct input for operations

* [PT FE] Upgrade quantize method

* [PT FE] Add BFS for dequantize, add quantize_per_channel

* [PT FE] Add missing replacer to frontend, improve tests

* [PT FE] Rename replacer -> remover, remove unwanted header files

* [PT FE] Change function declarations to return ov::Output instead of shared ptr

* [PT FE] Add missing context mark node

* [PT FE] Remove unknown modifications to ie_c_api

* [PT FE] Remove fp16 support, turn off int32 tests

* [PT FE] Clang format

* [PT FE] Fix quantize_per_tensor

* [PT FE] Minor fixes from review

* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead

* [PT FE] Rename Replacer to Remover for dequantize nodes

* [PT FE] Clang format

* [PT FE] Move comments to header files, minor import fixes

* [PT FE] Fix clang format

* [PT FE] Fix dtype issue

* [PT FE] Fix quantize_per_channel tests

* Apply suggestions from code review

Removing sporadic tests from precommit

* Apply suggestions from code review

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-07-17 02:30:02 +02:00
Ilya Churaev
8defcef3f1
Trim paths only for Release mode (#18552) 2023-07-16 03:00:00 +04:00
Zlobin Vladimir
5d28498d65
Don't require opencv-python for benchmark_app (#18565)
cv2 availability is already optional: 238c7fa47e/tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py (L148)
2023-07-15 13:00:29 +04:00
Vitaliy Urusovskij
37d055e477
Enable -pie compile option for MacOS (#18568) 2023-07-14 21:06:04 +00:00
Vladimir Paramuzov
325d02b760
[GPU] Use stream executor and exceptions from new api (#18531)
* [Common] Handle ov::Exception too in CompiledModel wrapper

* [GPU] Use new threading and exception interfaces where possible
2023-07-14 20:51:40 +02:00
Georgy Krivoruchko
08cd757ed5
PostgreSQL interface for reporting from test apps (#14483)
* PostgreSQL interface for reporting from test apps

* Fixes for Linux and MacOS builds

* Fixed segmentation fault and linux build issue

* Removed unnecessary debug messages and std::endl

* Improved logging

* Added loading libpq.so.5 on Linux and fixed typos

* Removed explicit definition for conformance runner

* Added reporting levels with less details, but faster

* Added escaping strings due to unexpected tests naming

* Added env-var defined Run ID (external grouping)

* Added transaction-based queries

* Stored amount of tests to run

* Added handling of serialization errors for transactions

* Cleanup unnecessary code due to latest changes in env

* Added customizable test results

* Enabled conformanceTests.exe for PostgreSQL Reporting

* Changed behavior of Run ID. Changed behavior of Suite Results.
Fixed void in declarations.

* Refactored code regarding control of custom fields in runtime

* Updating targetDevice and case type in Conformance Test

* Introduced wasting test results in case of skipping
Fixed behavior of missing data in case of Fast reporting
Refactored Initialize function by moving loading part separately

* Updated queries naming

* Added runtime resolution of an opset version for operation

* Added capturing a PostgreSQL logs for diagnostic purposes

* Remove unused header

* Fix for fresh master

* Try to detect run on ARM, fix for latest IR hash format

* Updated status values for easier queries

* Added a version info to session information

* Added simple DGPU detection, removed unused prints

* Reduced serialization errors

* Replaced usleep by nanosleep

* Improving robustness

* Fixed behavior of OpImplCheck

* Added IR Weight

* Added a customizable "device architecture" field

* Fix for CI

* Added missing device detection in OpImplCheck

* Introduced Manual Start feature for delayed posting start
information to a tables

* Added app_id to test_results

* Changed architecture detection as requested by owner

* Moved CMake option to src/tests

* Added TODO

* Added full device name as a part of target device

* Added MacOS libpq loading

* Trying alternate way to load on MacOS

* Adding correct executable name detection for MacOS
2023-07-14 20:47:58 +02:00
Vitaliy Urusovskij
e1d99a8ff3
Suppress signal-unsafe call tsan issue (#18562) 2023-07-14 21:17:27 +04:00
Ryszard Jezierski
072b9f1e2a
added check for availability of GNA HW in QueueInference (#18549) 2023-07-14 17:10:33 +00:00
Przemyslaw Wysocki
7bceba1523
[PyOV] Extend Python API with opset12, Pad-12, ScatterElementsUpdate-12 and GroupNormalization-12 (#18481) 2023-07-14 15:59:13 +00:00
Zlobin Vladimir
ce8f164fea
Fix -api sync for single -data_shape (#18463)
* Fix -api sync for single -data_shape

Tickets 111187 and 111185

I wasn’t able to find C++ equivalent of Python’s `info.original_shape.is_static`. Later I realized that it shouldn’t be considered because -shape cmd arg should have higher priority for shape inference than model’s shape. So I removed it from Python.

Replace

`if benchmark.inference_only and batch_size.is_dynamic:`

with

`if allow_inference_only_or_sync and batch_size.is_dynamic:`

to reset batch_size to static in case of dynamic shape with single -data_shape

* Check only app_input_info.size() == 1 because if it's gretaer than 1, input shape is dynamic and there are more that one static shapes. Apply TODO
2023-07-14 15:21:55 +00:00
Andrey Kashchikhin
9973feda74
Disable windows GA workflow (#18566) 2023-07-14 16:22:58 +02:00
Anastasiia Pnevskaia
6af1bb307c
String tensors in tf.Graph decoder (#18461)
* String consts in TF Decoder.

* Fixed test.

* Small corrections.

* Added test, minor corrections.

* Test correction, removed decoding.

* Removed wrong changes.

* Removed not needed code.
2023-07-14 17:58:07 +04:00
Roman Kazantsev
826f345daf
[TF FE] Support TF1 Control Flow: Switch, Merge (#18378)
* [TF FE] Support Switch and Merge to fuse into If operation

It introduces support of TF1 control flow with Switch and Merge nodes.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add script for test model generation

* Fix code-style

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue with types

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply code-review feedback: optimizations in utils

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply code-review remarks and cover more cases

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove commented code

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove unused vars

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update MO unit-tests wit Switch-Merge case

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue: remove unused variable

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-07-14 15:56:34 +02:00
Nesterov Alexander
238c7fa47e
[CPU][ARM] Add ACL executor for Transpose (#17322)
* separate executors + add acl executor fot transpose

* correct axisCast

* update transpose executors list

* update new changes

* enable tests

* fix fortting

* fixed test shapes and transpose generalization

* fixed different signedness error

* size_t usage in loop counters

* undo unwanted changes

* fixed comments

* added i8 and fp32 to blocked x86 tests

* fixed comments

* fixed comments

* extracted general reference executor from PermuteKernel

* fix mayiuse in JitTransposeExecutorBuilder::isSupported

* getDescWithType name refactoring

* refactoring

* removed 2nd executor creation in transpose node

* Moved RefOptimizedTranspose to the top

* fixed comments

---------

Co-authored-by: Aleksandr Voron <aleksandr.voron@intel.com>
2023-07-14 15:16:09 +02:00
Maxim Vafin
73ed804134
Fix typo in align types function (#18474) 2023-07-14 13:02:02 +02:00
Fang Xu
84bf35958e
enable canary for linux oneTBB2021.2.1 (#18444)
* enable canary for linux oneTBB2021.2.1

* modify oneTBB package name
2023-07-14 10:35:56 +00:00
Sungeun Kim
181238bcfb
[GPU] Move unit test file to the proper location (#18545) 2023-07-14 14:19:56 +04:00
Andrey Kashchikhin
7f94bd4c12
[CI] [GHA] Cancel in-progress Linux & Win pipelines in favour of that of on the latest commit in PRs (#18548)
* cancel in-progress PR pipelines in favour of the latest

* add unique vals to the concurrency

* sample change

* revert
2023-07-14 14:00:21 +04:00
Sebastian Golebiewski
6761a29af5
[DOCS] Updating Interactive Tutorials (#18504)
* update-notebooks

* Update docs/nbdoc/nbdoc.py

Co-authored-by: bstankix <bartoszx.stankiewicz@intel.com>

* Update docs/nbdoc/nbdoc.py

Co-authored-by: bstankix <bartoszx.stankiewicz@intel.com>

---------

Co-authored-by: bstankix <bartoszx.stankiewicz@intel.com>
2023-07-14 10:57:06 +02:00
Sofya Balandina
92ecccc1b9
[conformance] Move query model tests from api to opset (#18242)
* [conformance] Move query model tests from api to opset

* test summary

* Fix build

* Fix large amount of new tests
2023-07-14 11:53:51 +04:00
Evgeny Kotov
31f86c83d3
remove debug (#18514) 2023-07-14 11:06:09 +04:00
Ilya Churaev
93e30468b1
Change plugin api (#18441)
* Remove vector of so objects from Tensor, Any, VariableState and
RemoteContext

* Change IRemoteContext

* Fixed build without Proxy

* Moved API to ITensor

* Remove friends from Tensor class

* Changed query_state API

* Remote SoPtr for some returned values

* Fixed auto plugin

* Add so to converted objects

* Fixed build all on macOS

* Check that tensor pointers != nullptr

* Add SO to converter

* Added new constructors for SO ptrs

* Changed IVariableState API

* Remove proxy friend

* Remove friends and nullptrs from auto

* Fixed build

* Fixed HETERO plugin

* Fixed code style
2023-07-14 10:47:53 +04:00
Andrew Kwangwoong Park
38913f2184
[GPU] Add debug config for disabled async compilation (#18535) 2023-07-14 10:42:03 +04:00
Ilya Churaev
cba84fd763
Fixed clang format for plugin files with version (#18546) 2023-07-14 10:41:38 +04:00
Ekaterina Aidova
4c49040ce6
[PT FE]: multiple fixes for models from optimum testing scope (#18501)
* [PT FE]: multiple fixes for models from optimum testing scope

* Update src/frontends/pytorch/src/op_table.cpp
2023-07-14 10:37:53 +04:00
Maxim Vafin
1d9be8c76e
Do not freeze models with compressed constants (#18505)
* Do not freeze models with compressed constants

* Add test
2023-07-14 08:30:35 +02:00
Maxim Vafin
acb14d5d6b
[PT FE] Support bfloat16 constants (#18534)
* [PT FE] Support bfloat16 constants

* Update src/bindings/python/src/openvino/frontend/pytorch/decoder.py

* Add tests for tracing
2023-07-14 08:29:55 +02:00
Andrew Kwangwoong Park
3f67b3948d
[GPU] Dynamism support for Proposal (#18489) 2023-07-14 10:28:56 +04:00
Alexandra Sidorova
67c88f4434
[Snippets] Added SplitDimensionM optimization (#18160) 2023-07-14 07:31:24 +02:00
Sergey Shlyapnikov
b7935bb869
[GPU] Fix data races in RegisterFactory() and LogHelper::LogHelper() functions (#18521) 2023-07-14 09:06:10 +04:00
Evgeny Kotov
bfe8899839
initial fixes (#18508)
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-14 04:53:54 +02:00
Andrey Kashchikhin
f1faa5f5a3
add path-ignore (#18533) 2023-07-14 00:47:06 +04:00
Vitaliy Urusovskij
43ff356f1a
Hetero 2.0 (#18429)
* Hetero 2.0: Implement `hetero::Plugin`

* Fix CMakeLists.txt

* Remove duplicated "itt.hpp"

* Remove extra API method

* Delete `HeteroPlugin::Engine`

* Intregrate `ov::hetero::Plugin` into `HeteroExeNet`

* Use `is_new_api()`

* Add `override` modificator

* Rename `GetDevicePlugins` to `get_device_properties`

* Small fixes

* Fix precommit

* Fix Import/Export

* Fix `import_model()`

* Remove extra lines

* TEMPORARY disable one test

* ClangFormat+Refactoring

* Build fix

* Update `hetero::Configuration` logic

* Update `hetero::Plugin::get_property()`

* Fix

* Changes after code review

* Remove extra comments

* Revert "TEMPORARY disable one test"

This reverts commit 13fa48d8102ec5146e79987835e6f7444e469f7a.

* Small fix

* Refactoring + Fixes

* Add `hetero::Plugin::device_supports_model_caching`

* Replace `device_supports_model_caching` with ICore impl

* Code review changes

* Rework `Configuration`

* Implement `hetero::CompiledModel`

* Fix caching_test

* ClangFormat

* Fix inputs/outputs mapping
After some fix in ICompiledModel, m_inputs != model->inputs,
so mapping was updated to be independent from m_inputs
(same for m_outputs)

* Fix types

* Update `get_runtime_model()`

* Remove `ngraph` and `IE_THROW`

* Implement Hetero Sync/Async Infer Requests

* A lot of changes

* Add `submodels_output_to_input` to import/export

* Implement `get_tensors()`/`set_tensors()`

* Fix `Configuration` ctor

* Skip `SetPreProcessTo` legacy tests for hetero

* Change `Output->Input` logic to `Input->PrevOutput`
because for one output may be several inputs
(map key collision)

* Update `CompiledModel` to use shared_ptr vs *

* Update `CompiledModel`  public/private members

* Names refactoring

* Optimize imports

* Fix properties for `query_model()` call

* Use static objects in `Configuration` methods

* `Configuration` refactoring

* Get `ov::supported_properties` from subdevices

* InferRequest +1 import and fwd declaration

* Update `InferRequest` prof_info, remove extra methods

* Remove `InferRequestDesc`

* Remove `InferRequest::cancel()`

* Update CMakeLists.txt

* Remove extra `catch` in `CompiledModel`

* Replace `InferenceEngine::details::contains()`

* ClangFormat

* Use `const auto&`

* Try to fix types

* Remove `friendly_name` for subgraphs connection

* Remove TODO comment

* Remove `CompiledModel::m_model` as unused

* Polish .hpp files

* Fix size_t serialization in `CompiledModel::export_model()`

* Minor changes

* Move `intersect*` IE utils to anonym namespace

* Use `const auto&`

* Update Hetero `get_profiling_info()`

* Minor changes

* Rename `deviceName` to `device_name`

* Add `hetero::VariableState` in order to hold HW so

* Port internal properties to `ov::internal`

* Add `CompiledModel::set_inputs_and_outputs()`

* Add `OPENVINO_SUPPRESS_DEPRECATED_*`

* Fix CompiledModel `ov::device::properties` issue

* Use `get_device_name()` instead of hardcoded name

* Make `get_profiling_info()` names bwd compatible

* Remove `include` folder

* Remove try/catch from CompiledModel

* Update error message

* `CompiledModel::set_property` throw not implemented
2023-07-13 23:26:04 +04:00
Mateusz Bencer
c59746fd27
Implementation of MMAP for ONNX FE (#18026)
* Implementation of MMAP for ONNX FE

* fix win offsets

* added virtual dtor to MappedMemory

* review remarks. part.1

* added disable mmap flag to MO

* added additional checks to mmap

* remove unnecessary const

* fix pybind default value

* Added args.disable_mmap = False to MO tests

* fixed MO test

* avoid global headers

* fix casting for win

* disable mmap for legacy frontends flow

* review remarks

* Fixed passing parameters

* added doc to MappedMemory and load_mmap_object
2023-07-13 19:17:58 +00:00
Ilya Lavrenov
96d16b141d
Ability to configure setup.py via env variables (#18538) 2023-07-13 23:12:07 +04:00
Ilya Lavrenov
7b5acbb29a
Rely on find_package(OpenCL) (#18541) 2023-07-13 23:11:32 +04:00
Ilya Lavrenov
82fe1677d0
Revert "Use system gflags only in samples (#18478)" (#18543)
This reverts commit bca3f3e441.
2023-07-13 21:05:55 +04:00
Ilya Lavrenov
bca3f3e441
Use system gflags only in samples (#18478) 2023-07-13 20:45:22 +04:00
Ilya Lavrenov
3daa387692
Revert "Fixed cases if cast data from Tensor to compatible type (#18479)" (#18539)
This reverts commit 63b18adf68.
2023-07-13 18:34:53 +04:00
Ivan Tikhonov
97fb4ed18c
Update the transformations to use the concrete op versions instead of opsets (#18503)
* codestyle

* update the transformations to use the concrete op versions instead of opsets

* resolve review comments

* codestyle
2023-07-13 16:46:05 +04:00
Sungeun Kim
6913a5effb
[GPU] set fixed random seed (#18144)
* random_generator
* apply random_generator to all tests
2023-07-13 21:13:29 +09:00