Commit Graph

11982 Commits

Author SHA1 Message Date
Vladislav Golubev
42d2c130c2
[Snippets] ExtractReshapesFromMHA transformation (#18477) 2023-07-17 20:42:18 +02:00
Sergey Shlyapnikov
3958f771da
[GPU] Add oneDNN primitives profiling support (#17785)
* [GPU] Add oneDNN primitives profiling support

* [GPU] Add stream.wait() method to prevent caches flushing and other possible impacts of finish() call

* Add comment for wait() usage
2023-07-17 19:17:31 +04:00
Mateusz Bencer
5464216404
Fix IRDFT for 1D complex input in debug mode (#18525) 2023-07-17 16:45:21 +02:00
Ilya Lavrenov
3a92054cf4
Updated pybind11 to v2.11 version (#18580) 2023-07-17 18:18:02 +04:00
Ilya Lavrenov
b89bf8c280
Updated ITTAPI to v3.24.2 (#18581) 2023-07-17 18:17:38 +04:00
Zlobin Vladimir
06bfbd7f28
becnhmark_app/python: revert TODO application because it's not 23.3 yet (#18577) 2023-07-17 18:12:40 +04:00
Alexandra Sidorova
440c05d5b9
[CI][NVIDIA] Fixed test names (#18585) 2023-07-17 17:47:19 +04:00
Anastasiia Pnevskaia
e434285445
Fixed temporary directory creating in test_save_and_restore_with_converts(). (#18569)
* Fixed temporary dir creating in test_save_and_restore_with_converts().

* Small correction.
2023-07-17 17:26:16 +04:00
Katarzyna Mitrus
019723a05d
[ONNX] Use ov::v12::pad in ONNX FE Pad (#18460)
* Update ONNX FE Pad to use Pad-12

* Add negative pads test

* Use default_opset(opset12) for Pad
2023-07-17 15:02:45 +02:00
Zlobin Vladimir
a5880ee1eb
Report dynamic -data_shape (#18457)
Ticket 112256

Python check was already there
2023-07-17 14:32:01 +02:00
Pawel Raasz
c1fde50cd9
Improve __FILE__ trim on windows builds (#18573) 2023-07-17 14:29:40 +02:00
Vitaliy Urusovskij
ef56b53a3f
Remove excess ov::Model clone in Hetero (#18576) 2023-07-17 12:27:33 +00:00
Evgenya Stepyreva
4f415ba211
Partial Values and Labels visualization and update in label equality checks (#18527)
* Provided visualization of partial values and labels. Adopted DimensionTracker for better equivalence tracking

* Addressed comments and fixed one test
2023-07-17 11:59:24 +00:00
Oleg Pipikin
b211767280
Consolidate common test utils targets (#18385)
* Consolidate test util targets

* Fix code style

* Fix 1

* Fix code style
2023-07-17 11:59:13 +00:00
Anastasiia Pnevskaia
cd6ffd7620
Removed redundant copy of Tensor in TF Const translator (#18299)
* Removed copy of consts in translator, added test.

* Fixed memory loss for tf.Const.

* Added test, minor corrections.

* Update src/bindings/python/src/openvino/frontend/tensorflow/node_decoder.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Test corrections.

* Added comment.

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-07-17 11:41:33 +00:00
Ilya Churaev
f9ead5016f
Moved copy_to to impl and move template plugin to this API (#18574)
* Moved copy_to to impl and move template plugin to this API

* Fixed code style

* Fixed documentation
2023-07-17 15:27:17 +04:00
Vitaliy Urusovskij
aeff5056f5
Hetero 2.0 leftovers (#18559)
* Enable `LoadedTensor.*HETERO` test

* Fix use of `ICompiledModel::outputs()`

* Remove extra `loaded_from_cache` argument

* Misprint

* Small refactoring

* Remove extra `model` from `CompiledModelDesc`
Use `get_runtime_model()` instead

* ClangFormat
2023-07-17 11:58:44 +04:00
Eddy Kim
2c73916093
[GPU] fix compilation context to use kernel_impl_params as key (#18470)
* fixed aompilation context to use kernel_impl_params for key

* fixed the argument for push_task
2023-07-17 00:48:12 -07:00
Anastasia Kuporosova
5b522b556d
[PyOV] Extend Tensor API (#18464)
* [PyOV] Extend Tensor API

* one more ctor

* apply comments

* support constoutput

* add checks for shape

* checks for type and shape

* apply comments

* is_continuos

* codestyle
2023-07-17 09:44:47 +02:00
Ilya Churaev
f38566834b
Remove unsupported plugin from proxy in order to avoid exception catching (#18518)
* Remove unsupported plugin from proxy in order to avoid exception
catching

* Remove from alias for

* Globally remove unavailable devices

* Do not load proxy if no available devices

* Try to fix CI

* Add debug messages

* Avoid two times the same plugin

* Revert "Add debug messages"

This reverts commit 562e36c633.

* Cache hidden devices

* Update if fallback order was changed

* Try to fix CI

* Fixed CoreThreading tests

* Fixed typo

* Try to fix plugin initialization

* Fixed initialization

* Fixed lock
2023-07-17 11:10:59 +04:00
Ilya Churaev
a2b75bbc87
Do not return default context from the compiled model (#18468)
* Do not return default context from the compiled model

* Try to fix segfault

* Added test

* Remove unnecessary code

* Remove code duplication

* Migrate to new API

* Fixed comment

* Revert renamed variable

* Remove cast

* Hetero throws OV Exception
2023-07-17 07:15:54 +04:00
Piotr Krzemiński
d7984f3ec2
[PT FE] Add aten::quantize_per_tensor, aten::quantize_per_channel, aten::dequantize (#18266)
* Support GetAttr with packed params

* Apply suggestions from code review

* [PT FE] Add quantized types as normal types to decoder

* [PT FE] Add decoder dequantize, add dtypes to quantize

* [PT FE] Add dequantize example

* [PT FE] Implement replacer for quantized nodes

* [PT FE] Register replacer for quantize/dequantize

* [PT FE] Remove unwanted junk from previous version

* [PT FE] Fix building mistakes for frontend

* [PT FE] Clang fix

* [PT FE] Ease of use upgrade to quantize funcs

* [PT FE] Clang format

* [PT FE] Introduce new version of quantize/dequantize

* [PT FE] Remove unwanted files from new version

* [PT FE] Fix style

* [PT FE] Add QuantizedPtNode replacer, fix accuracy error

* [PT FE] Add improved version of quantize/dequantize with shared_ptrs

* [PT FE] Fix utils shared ptr reference error

* [PT FE] Quantize now takes correct input for operations

* [PT FE] Upgrade quantize method

* [PT FE] Add BFS for dequantize, add quantize_per_channel

* [PT FE] Add missing replacer to frontend, improve tests

* [PT FE] Rename replacer -> remover, remove unwanted header files

* [PT FE] Change function declarations to return ov::Output instead of shared ptr

* [PT FE] Add missing context mark node

* [PT FE] Remove unknown modifications to ie_c_api

* [PT FE] Remove fp16 support, turn off int32 tests

* [PT FE] Clang format

* [PT FE] Fix quantize_per_tensor

* [PT FE] Minor fixes from review

* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead

* [PT FE] Rename Replacer to Remover for dequantize nodes

* [PT FE] Clang format

* [PT FE] Move comments to header files, minor import fixes

* [PT FE] Fix clang format

* [PT FE] Fix dtype issue

* [PT FE] Fix quantize_per_channel tests

* Apply suggestions from code review

Removing sporadic tests from precommit

* Apply suggestions from code review

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-07-17 02:30:02 +02:00
Ilya Churaev
8defcef3f1
Trim paths only for Release mode (#18552) 2023-07-16 03:00:00 +04:00
Zlobin Vladimir
5d28498d65
Don't require opencv-python for benchmark_app (#18565)
cv2 availability is already optional: 238c7fa47e/tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py (L148)
2023-07-15 13:00:29 +04:00
Vitaliy Urusovskij
37d055e477
Enable -pie compile option for MacOS (#18568) 2023-07-14 21:06:04 +00:00
Vladimir Paramuzov
325d02b760
[GPU] Use stream executor and exceptions from new api (#18531)
* [Common] Handle ov::Exception too in CompiledModel wrapper

* [GPU] Use new threading and exception interfaces where possible
2023-07-14 20:51:40 +02:00
Georgy Krivoruchko
08cd757ed5
PostgreSQL interface for reporting from test apps (#14483)
* PostgreSQL interface for reporting from test apps

* Fixes for Linux and MacOS builds

* Fixed segmentation fault and linux build issue

* Removed unnecessary debug messages and std::endl

* Improved logging

* Added loading libpq.so.5 on Linux and fixed typos

* Removed explicit definition for conformance runner

* Added reporting levels with less details, but faster

* Added escaping strings due to unexpected tests naming

* Added env-var defined Run ID (external grouping)

* Added transaction-based queries

* Stored amount of tests to run

* Added handling of serialization errors for transactions

* Cleanup unnecessary code due to latest changes in env

* Added customizable test results

* Enabled conformanceTests.exe for PostgreSQL Reporting

* Changed behavior of Run ID. Changed behavior of Suite Results.
Fixed void in declarations.

* Refactored code regarding control of custom fields in runtime

* Updating targetDevice and case type in Conformance Test

* Introduced wasting test results in case of skipping
Fixed behavior of missing data in case of Fast reporting
Refactored Initialize function by moving loading part separately

* Updated queries naming

* Added runtime resolution of an opset version for operation

* Added capturing a PostgreSQL logs for diagnostic purposes

* Remove unused header

* Fix for fresh master

* Try to detect run on ARM, fix for latest IR hash format

* Updated status values for easier queries

* Added a version info to session information

* Added simple DGPU detection, removed unused prints

* Reduced serialization errors

* Replaced usleep by nanosleep

* Improving robustness

* Fixed behavior of OpImplCheck

* Added IR Weight

* Added a customizable "device architecture" field

* Fix for CI

* Added missing device detection in OpImplCheck

* Introduced Manual Start feature for delayed posting start
information to a tables

* Added app_id to test_results

* Changed architecture detection as requested by owner

* Moved CMake option to src/tests

* Added TODO

* Added full device name as a part of target device

* Added MacOS libpq loading

* Trying alternate way to load on MacOS

* Adding correct executable name detection for MacOS
2023-07-14 20:47:58 +02:00
Vitaliy Urusovskij
e1d99a8ff3
Suppress signal-unsafe call tsan issue (#18562) 2023-07-14 21:17:27 +04:00
Ryszard Jezierski
072b9f1e2a
added check for availability of GNA HW in QueueInference (#18549) 2023-07-14 17:10:33 +00:00
Przemyslaw Wysocki
7bceba1523
[PyOV] Extend Python API with opset12, Pad-12, ScatterElementsUpdate-12 and GroupNormalization-12 (#18481) 2023-07-14 15:59:13 +00:00
Zlobin Vladimir
ce8f164fea
Fix -api sync for single -data_shape (#18463)
* Fix -api sync for single -data_shape

Tickets 111187 and 111185

I wasn’t able to find C++ equivalent of Python’s `info.original_shape.is_static`. Later I realized that it shouldn’t be considered because -shape cmd arg should have higher priority for shape inference than model’s shape. So I removed it from Python.

Replace

`if benchmark.inference_only and batch_size.is_dynamic:`

with

`if allow_inference_only_or_sync and batch_size.is_dynamic:`

to reset batch_size to static in case of dynamic shape with single -data_shape

* Check only app_input_info.size() == 1 because if it's gretaer than 1, input shape is dynamic and there are more that one static shapes. Apply TODO
2023-07-14 15:21:55 +00:00
Andrey Kashchikhin
9973feda74
Disable windows GA workflow (#18566) 2023-07-14 16:22:58 +02:00
Anastasiia Pnevskaia
6af1bb307c
String tensors in tf.Graph decoder (#18461)
* String consts in TF Decoder.

* Fixed test.

* Small corrections.

* Added test, minor corrections.

* Test correction, removed decoding.

* Removed wrong changes.

* Removed not needed code.
2023-07-14 17:58:07 +04:00
Roman Kazantsev
826f345daf
[TF FE] Support TF1 Control Flow: Switch, Merge (#18378)
* [TF FE] Support Switch and Merge to fuse into If operation

It introduces support of TF1 control flow with Switch and Merge nodes.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add script for test model generation

* Fix code-style

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue with types

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply code-review feedback: optimizations in utils

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply code-review remarks and cover more cases

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove commented code

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove unused vars

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update MO unit-tests wit Switch-Merge case

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue: remove unused variable

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-07-14 15:56:34 +02:00
Nesterov Alexander
238c7fa47e
[CPU][ARM] Add ACL executor for Transpose (#17322)
* separate executors + add acl executor fot transpose

* correct axisCast

* update transpose executors list

* update new changes

* enable tests

* fix fortting

* fixed test shapes and transpose generalization

* fixed different signedness error

* size_t usage in loop counters

* undo unwanted changes

* fixed comments

* added i8 and fp32 to blocked x86 tests

* fixed comments

* fixed comments

* extracted general reference executor from PermuteKernel

* fix mayiuse in JitTransposeExecutorBuilder::isSupported

* getDescWithType name refactoring

* refactoring

* removed 2nd executor creation in transpose node

* Moved RefOptimizedTranspose to the top

* fixed comments

---------

Co-authored-by: Aleksandr Voron <aleksandr.voron@intel.com>
2023-07-14 15:16:09 +02:00
Maxim Vafin
73ed804134
Fix typo in align types function (#18474) 2023-07-14 13:02:02 +02:00
Fang Xu
84bf35958e
enable canary for linux oneTBB2021.2.1 (#18444)
* enable canary for linux oneTBB2021.2.1

* modify oneTBB package name
2023-07-14 10:35:56 +00:00
Sungeun Kim
181238bcfb
[GPU] Move unit test file to the proper location (#18545) 2023-07-14 14:19:56 +04:00
Andrey Kashchikhin
7f94bd4c12
[CI] [GHA] Cancel in-progress Linux & Win pipelines in favour of that of on the latest commit in PRs (#18548)
* cancel in-progress PR pipelines in favour of the latest

* add unique vals to the concurrency

* sample change

* revert
2023-07-14 14:00:21 +04:00
Sebastian Golebiewski
6761a29af5
[DOCS] Updating Interactive Tutorials (#18504)
* update-notebooks

* Update docs/nbdoc/nbdoc.py

Co-authored-by: bstankix <bartoszx.stankiewicz@intel.com>

* Update docs/nbdoc/nbdoc.py

Co-authored-by: bstankix <bartoszx.stankiewicz@intel.com>

---------

Co-authored-by: bstankix <bartoszx.stankiewicz@intel.com>
2023-07-14 10:57:06 +02:00
Sofya Balandina
92ecccc1b9
[conformance] Move query model tests from api to opset (#18242)
* [conformance] Move query model tests from api to opset

* test summary

* Fix build

* Fix large amount of new tests
2023-07-14 11:53:51 +04:00
Evgeny Kotov
31f86c83d3
remove debug (#18514) 2023-07-14 11:06:09 +04:00
Ilya Churaev
93e30468b1
Change plugin api (#18441)
* Remove vector of so objects from Tensor, Any, VariableState and
RemoteContext

* Change IRemoteContext

* Fixed build without Proxy

* Moved API to ITensor

* Remove friends from Tensor class

* Changed query_state API

* Remote SoPtr for some returned values

* Fixed auto plugin

* Add so to converted objects

* Fixed build all on macOS

* Check that tensor pointers != nullptr

* Add SO to converter

* Added new constructors for SO ptrs

* Changed IVariableState API

* Remove proxy friend

* Remove friends and nullptrs from auto

* Fixed build

* Fixed HETERO plugin

* Fixed code style
2023-07-14 10:47:53 +04:00
Andrew Kwangwoong Park
38913f2184
[GPU] Add debug config for disabled async compilation (#18535) 2023-07-14 10:42:03 +04:00
Ilya Churaev
cba84fd763
Fixed clang format for plugin files with version (#18546) 2023-07-14 10:41:38 +04:00
Ekaterina Aidova
4c49040ce6
[PT FE]: multiple fixes for models from optimum testing scope (#18501)
* [PT FE]: multiple fixes for models from optimum testing scope

* Update src/frontends/pytorch/src/op_table.cpp
2023-07-14 10:37:53 +04:00
Maxim Vafin
1d9be8c76e
Do not freeze models with compressed constants (#18505)
* Do not freeze models with compressed constants

* Add test
2023-07-14 08:30:35 +02:00
Maxim Vafin
acb14d5d6b
[PT FE] Support bfloat16 constants (#18534)
* [PT FE] Support bfloat16 constants

* Update src/bindings/python/src/openvino/frontend/pytorch/decoder.py

* Add tests for tracing
2023-07-14 08:29:55 +02:00
Andrew Kwangwoong Park
3f67b3948d
[GPU] Dynamism support for Proposal (#18489) 2023-07-14 10:28:56 +04:00
Alexandra Sidorova
67c88f4434
[Snippets] Added SplitDimensionM optimization (#18160) 2023-07-14 07:31:24 +02:00