Commit Graph

11735 Commits

Author SHA1 Message Date
Maxim Vafin
acb14d5d6b
[PT FE] Support bfloat16 constants (#18534)
* [PT FE] Support bfloat16 constants

* Update src/bindings/python/src/openvino/frontend/pytorch/decoder.py

* Add tests for tracing
2023-07-14 08:29:55 +02:00
Andrew Kwangwoong Park
3f67b3948d
[GPU] Dynamism support for Proposal (#18489) 2023-07-14 10:28:56 +04:00
Alexandra Sidorova
67c88f4434
[Snippets] Added SplitDimensionM optimization (#18160) 2023-07-14 07:31:24 +02:00
Sergey Shlyapnikov
b7935bb869
[GPU] Fix data races in RegisterFactory() and LogHelper::LogHelper() functions (#18521) 2023-07-14 09:06:10 +04:00
Evgeny Kotov
bfe8899839
initial fixes (#18508)
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-14 04:53:54 +02:00
Andrey Kashchikhin
f1faa5f5a3
add path-ignore (#18533) 2023-07-14 00:47:06 +04:00
Vitaliy Urusovskij
43ff356f1a
Hetero 2.0 (#18429)
* Hetero 2.0: Implement `hetero::Plugin`

* Fix CMakeLists.txt

* Remove duplicated "itt.hpp"

* Remove extra API method

* Delete `HeteroPlugin::Engine`

* Intregrate `ov::hetero::Plugin` into `HeteroExeNet`

* Use `is_new_api()`

* Add `override` modificator

* Rename `GetDevicePlugins` to `get_device_properties`

* Small fixes

* Fix precommit

* Fix Import/Export

* Fix `import_model()`

* Remove extra lines

* TEMPORARY disable one test

* ClangFormat+Refactoring

* Build fix

* Update `hetero::Configuration` logic

* Update `hetero::Plugin::get_property()`

* Fix

* Changes after code review

* Remove extra comments

* Revert "TEMPORARY disable one test"

This reverts commit 13fa48d8102ec5146e79987835e6f7444e469f7a.

* Small fix

* Refactoring + Fixes

* Add `hetero::Plugin::device_supports_model_caching`

* Replace `device_supports_model_caching` with ICore impl

* Code review changes

* Rework `Configuration`

* Implement `hetero::CompiledModel`

* Fix caching_test

* ClangFormat

* Fix inputs/outputs mapping
After some fix in ICompiledModel, m_inputs != model->inputs,
so mapping was updated to be independent from m_inputs
(same for m_outputs)

* Fix types

* Update `get_runtime_model()`

* Remove `ngraph` and `IE_THROW`

* Implement Hetero Sync/Async Infer Requests

* A lot of changes

* Add `submodels_output_to_input` to import/export

* Implement `get_tensors()`/`set_tensors()`

* Fix `Configuration` ctor

* Skip `SetPreProcessTo` legacy tests for hetero

* Change `Output->Input` logic to `Input->PrevOutput`
because for one output may be several inputs
(map key collision)

* Update `CompiledModel` to use shared_ptr vs *

* Update `CompiledModel`  public/private members

* Names refactoring

* Optimize imports

* Fix properties for `query_model()` call

* Use static objects in `Configuration` methods

* `Configuration` refactoring

* Get `ov::supported_properties` from subdevices

* InferRequest +1 import and fwd declaration

* Update `InferRequest` prof_info, remove extra methods

* Remove `InferRequestDesc`

* Remove `InferRequest::cancel()`

* Update CMakeLists.txt

* Remove extra `catch` in `CompiledModel`

* Replace `InferenceEngine::details::contains()`

* ClangFormat

* Use `const auto&`

* Try to fix types

* Remove `friendly_name` for subgraphs connection

* Remove TODO comment

* Remove `CompiledModel::m_model` as unused

* Polish .hpp files

* Fix size_t serialization in `CompiledModel::export_model()`

* Minor changes

* Move `intersect*` IE utils to anonym namespace

* Use `const auto&`

* Update Hetero `get_profiling_info()`

* Minor changes

* Rename `deviceName` to `device_name`

* Add `hetero::VariableState` in order to hold HW so

* Port internal properties to `ov::internal`

* Add `CompiledModel::set_inputs_and_outputs()`

* Add `OPENVINO_SUPPRESS_DEPRECATED_*`

* Fix CompiledModel `ov::device::properties` issue

* Use `get_device_name()` instead of hardcoded name

* Make `get_profiling_info()` names bwd compatible

* Remove `include` folder

* Remove try/catch from CompiledModel

* Update error message

* `CompiledModel::set_property` throw not implemented
2023-07-13 23:26:04 +04:00
Mateusz Bencer
c59746fd27
Implementation of MMAP for ONNX FE (#18026)
* Implementation of MMAP for ONNX FE

* fix win offsets

* added virtual dtor to MappedMemory

* review remarks. part.1

* added disable mmap flag to MO

* added additional checks to mmap

* remove unnecessary const

* fix pybind default value

* Added args.disable_mmap = False to MO tests

* fixed MO test

* avoid global headers

* fix casting for win

* disable mmap for legacy frontends flow

* review remarks

* Fixed passing parameters

* added doc to MappedMemory and load_mmap_object
2023-07-13 19:17:58 +00:00
Ilya Lavrenov
96d16b141d
Ability to configure setup.py via env variables (#18538) 2023-07-13 23:12:07 +04:00
Ilya Lavrenov
7b5acbb29a
Rely on find_package(OpenCL) (#18541) 2023-07-13 23:11:32 +04:00
Ilya Lavrenov
82fe1677d0
Revert "Use system gflags only in samples (#18478)" (#18543)
This reverts commit bca3f3e441.
2023-07-13 21:05:55 +04:00
Ilya Lavrenov
bca3f3e441
Use system gflags only in samples (#18478) 2023-07-13 20:45:22 +04:00
Ilya Lavrenov
3daa387692
Revert "Fixed cases if cast data from Tensor to compatible type (#18479)" (#18539)
This reverts commit 63b18adf68.
2023-07-13 18:34:53 +04:00
Ivan Tikhonov
97fb4ed18c
Update the transformations to use the concrete op versions instead of opsets (#18503)
* codestyle

* update the transformations to use the concrete op versions instead of opsets

* resolve review comments

* codestyle
2023-07-13 16:46:05 +04:00
Sungeun Kim
6913a5effb
[GPU] set fixed random seed (#18144)
* random_generator
* apply random_generator to all tests
2023-07-13 21:13:29 +09:00
bstankix
d6c4e1acc0
[DOCS] Update newsletter (#18529)
* Change trigger to work from iframe

* Add more debug info
2023-07-13 12:50:43 +02:00
Nesterov Alexander
6822eb612e
[CPU][ARM] Add ACL executor for Convert (#17323)
* seaprate executors + add acl executor for convert

* update convert

* enabled tests and lot of changes in acl executor

* fixed different signedness comparison

* added expectedPrimitiveType method

* fixed comments

* fp16 WAs

* enable fp16 convert tests

* Revert "enable fp16 convert tests"

This reverts commit 037af672ce.

* Revert "fp16 WAs"

This reverts commit 3db3d4294e.

* fixed comments

* updated expected privitive to ref

* fixed comments

* getDescWithType name refactoring

* GetPtr to getData refactoring

* GetPtr to getData refactoring

---------

Co-authored-by: Aleksandr Voron <aleksandr.voron@intel.com>
2023-07-13 12:36:49 +02:00
Katarzyna Mitrus
d026ae74ce
[ONNX] Use ov::v12::ScatterElementsUpdate in ONNX FE ScatterElements (enable reduction) (#18462)
* Update ONNX FE scatter_elements to use ScatterElementsUpdate-12

* ONNX tests update

* Set reduction update

* Enable xfailed tests

* Add more onnx tests

* Fix reference implementation to support negative indices

* Style alignment
2023-07-13 12:16:31 +02:00
Orest Chura
355ba34b9e
Fix step numbers in nv12 classification sample (#18530) 2023-07-13 14:03:58 +04:00
Andrey Kashchikhin
a5782e0906
[CI] Introduce Windows pipeline in GitHub Actions (#18487)
* introduce win pipeline

* save only on master

* skip test_if for pytorch tests

* skip pytorch layer tests

* skip one test, execute python tests
2023-07-13 14:03:33 +04:00
yanlan song
77f065e4b1
refactor code (#18475)
Signed-off-by: fishbell <bell.song@intel.com>
2023-07-13 13:58:44 +04:00
Pawel Raasz
2cfd259824
[core]Trim __FILE__ macro by compiler if supported (#18411)
* Trim __FILE__ macro by compiler if supported

* Use file for older version cmake
Debug messages

* Move trim compilation options to os_flags.cmake

* Fix MSVC trimming options

* Add additional trim on runtime

* Update trim function description

* Use ov implementation for ngraph::trim_file_name

* Restore ie_c_api.h

* Remove unused define

* MSVC add trim for CXX language
2023-07-13 13:42:01 +04:00
Katarzyna Mitrus
605be1df07
[ONNX][OV Opset12] Update ONNX FE to use ov::opset12 as default (#18453)
* Update ONNX FE to use ov::opset12 as default

* Adjust other files

* Temp keep pad opset11
2023-07-13 09:24:28 +00:00
Min, Byungil
884006a0cf
[GPU] Optimizing primitives for only batch axis padding (#18163)
+ Optimized out Reshape if only batch axis has padding
+ Not to add Reorder before oneDNN if only batch axis has padding
+ Re-calculate output layout's padding if Reshape is optimized opt
+ Not to apply optimization of stable diffusion iGPU perf to dGPU(#18200)

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-07-13 18:19:04 +09:00
Sergey Shlyapnikov
feab0ab75e
[GPU] Memory preallocation optimization (#18181)
* [GPU] Use real layout for cpu impls instead of memory's

* [GPU] Add memory tracking and pre allocation mechanism

* Tests and minor code refactoring

* Apply review comments

* Remove unused include
2023-07-13 07:26:17 +02:00
Andrew Kwangwoong Park
eba1b46719
[GPU] Update ROIPooling to use nGraph shape inference (#18500) 2023-07-13 09:04:13 +04:00
Anastasia Kuporosova
acc13a70e8
[PyOV] py wrappers for clone/deepcopy model (#18502)
* [PyOV] py wrappers for clone/copy model

* -amend

* py wrap for clone_model

* codestyle

* mypy checks

* enable mypy for new file

* apply comment

* deprecate clone_model

* deepcopy removal from cpp
2023-07-13 01:10:38 +00:00
Wang, Yang
7b9f6c47b1
[AUTO] AUTO can't fall back if target device throws the exception before compiling model via AUTO (#18311)
* 1. Update AUTO candidate device filtering logic.
2. Add AUTO handling the exception logic when generating the target device infomation.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-07-13 09:09:25 +08:00
Ilya Churaev
63b18adf68
Fixed cases if cast data from Tensor to compatible type (#18479)
* Fixed cases if cast data from Tensor to compatible type

* Allow cast only if both element types are real or not
2023-07-12 22:51:34 +04:00
Anastasiia Pnevskaia
dd45925802
OVC tool leftovers (#18410)
* Made MO cli parser independent from OVC, added OVC Pylint test, minor fixes.

* Small corrections.

* PyLint fixes.

* Added init files.

* PyLint fixes.

* Small correction.

* Removed OVC dependency from MO.

* Fixed MO unit tests.

* PyLint fixes.

* Unit tests fix.

* Returned MO unit tests.

* PyLint configs.

* Small correction.

* Moved offline_transformations to back.

* Moved offline_transformations to back.
2023-07-12 18:18:22 +04:00
Xiping Yan
a396f07421
[CPU][NGraph]Enable node scatter_nd_update support negative indices. (#17219) 2023-07-12 17:04:44 +04:00
Nikolay Shchegolev
98e88bee52
[CPU] Support Pad-12. (#18407) 2023-07-12 16:59:07 +04:00
Katarzyna Mitrus
4c948ab6f8
[Transformations][ONNX FE][GroupNormalization-12] Decomposition transformation and ONNX FE update (#18416)
* Use GroupNormalization in ONNX FE

* Add and enable decomposition transformation

* Add NodeRegistry

* Adjust eps type

* Use Unsqueeze for bias and scale adjustment

* Add transformation tests

* Add Squeeze for bias and scale to ONNX FE

* Simplify get_range helper

* Add cast double to float eps helper

* Adjust reduction axes

* Style alignment

* Add float eps values in tests

* Enable accuracy comparator in transformation tests

* Skip F16 ref test

* Namespace adjustment

* Const ref for shape vec

* Remove nested scopes from transform tests

* Rename function to model in tests

* Add more const to variables

* Use common input shapes and elem type in transform tests

* Add ticket number to the test

* Update tests headers and names

* Use compatible ror rank check

* Use move to insert splits in new shape

* Add docs to cast_eps helper

* Additional test for eps

* Use versions instead of opset

* Include each op separately
2023-07-12 14:37:03 +02:00
Xiuchuan Zhai
5630d3a8b2
enable 1-D axis in cumsum (#17650)
* enable 1-D axis in cumsum

* fix according to comments; add testcases
2023-07-12 11:54:00 +00:00
Ryszard Jezierski
7bdaedf4f8
[GNA] Pre/post-processing optimizations using AVX2 (#18065)
* Added AVX2 optimizations for score preprocessing

* Revert special scaling case for scale factor 1.0f

* changed dimension variables to size_t, fixed warnings

* fixed bug with exporting scores

* Used templates in conversion functions

* Refactor after review

* Linux build fixes

* Review fixes

* Review fixes
2023-07-12 12:16:57 +01:00
bstankix
0e1d006144
[DOCS] Add newsletter popup (#18506)
* Add newsletter modal

* Add icons to message box

* Add debug info
2023-07-12 12:44:20 +02:00
Nadezhda Ageeva
3330cd69a7
[GPU] Introduce ov::config_device_id internal property to the new API (#17820)
* [GPU] Introduce ov::config_device_id internal property to the new API. Fix setting property for specific device

* Introduce ov::internal::supported_properties

* Fix caching tests

* Fix win tests

* Fix Proxy tests

* Replace CONFIG_KEY_INTERNAL(CONFIG_DEVICE_ID) by ov::internal::config_device_id in PROXY plugin

* Review comments
2023-07-12 10:03:35 +00:00
Karol Blaszczak
b30bd0d3e4
[DOCS] GNA disclaimer 2023-07-12 11:46:08 +02:00
Chen Xu
7c1949421f
[CPU] Fix performance issue for some cases of Reduce node (#11456) 2023-07-12 08:48:38 +00:00
Andrei Gorbachev
af6c2b0671
[Coverity] Replace find to count (#18493)
* fix CVS-112761

* fix CVS-112760

* fix CVS-112770

* fix CVS-112763, replace find to count
2023-07-12 11:57:41 +04:00
Ilya Churaev
cd02804d5b
Catch errors in case if some plugin doesn't have environment on the system (#18491)
* Catch errors in case if some plugin doesn't have environment on the
system

* Fixed typo

* Fixed Windows build
2023-07-12 06:58:41 +00:00
Paul Youngsoo Ahn
1e69152d9f
[GPU] Set default format only for the dynamic model with static input shape (#18486) 2023-07-11 23:37:56 -07:00
Taylor Yeonbok Lee
8f513002b6
Disable redundant reset for internal buffer (#18447) 2023-07-12 02:00:11 +02:00
Ilya Churaev
0927e867b0
Implement ov::IInferRequestInternalWrapper::GetPreProcess to recover python GetPrepProcess tests (#18484)
Co-authored-by: River.Li <river.li@intel.com>
2023-07-12 00:02:54 +04:00
Oleg Pipikin
ee50d2d120
Fix deprecation warning for debian build (#18488) 2023-07-11 21:46:20 +04:00
Andrey Kashchikhin
f06e0816f7
add missing stages (#18480) 2023-07-11 21:05:55 +04:00
Jan Iwaszkiewicz
59052d846e
[PyOV] Memory flow control with share_inputs and share_outputs (#18275)
* Added ReturnPolicy and updated common array helpers

* Clean up

* Remove ReturnPolicy initial

* Add share_inputs and share_outputs

* Tests and minor fixes

* Fix docstrings

* Fix whitespace

* Fix typing
2023-07-11 21:05:22 +04:00
Pawel Raasz
56f51135d4
Grey preprocessing yuv nv12 i420 (#18239)
* Add two plane YOV to Grey conversion

* Add i420 to grey conversion

* Add yuv to grey conversion for GPU

* Fix cmakes

* Remove static from local function

* Remove opencv dependency from tests

* Put grey_from_yuv_single_plane into namespace
2023-07-11 12:41:24 +02:00
Nikolay Shchegolev
88703905f4
[CPU] Leftovers for Extension convert I64/U64 to I32. (#16941)
* [CPU] Leftovers for Extension convert I64/U64 to I32.

* Fix as per comments

* Fixes as per commits 2

* Fixes as per commits 3

* Revert "Fixes as per commits 3"

This reverts commit 84022be66f64faccd96a32da5611db0e5137d049.

* Some fixes

* Test fix
2023-07-11 11:42:53 +02:00
Marcin Kacprzak
521c846b72
[GNA] Fix for concat requantization problem (#18008)
* [GNA] Fix for concat requantization problem

* [GNA] Review fixes

* [GNA] Reverted `using namespace std`

* [GNA] Updated transformation description
2023-07-11 10:32:49 +01:00