Commit Graph

10304 Commits

Author SHA1 Message Date
Ilya Lavrenov
e66b837104
Properties improvements: part 2 (#16489)
* Properties improvements: part 2

* Accurate configs handling in HETERO / BATCH

* Align plugins in caching properties

* Fixed caching mock tests

* Added new TestNoCachingProperties test

* Fixed test

* Added ov::caching_properties to API 1.0 metrics as well

* Fixes for HETERO plugin

* Fixed tests

* Even more refactoring in HETERO plugin config management
2023-03-25 19:28:05 +04:00
Fang Xu
a96da994ec
Update prebuilt oneTBB2021.2.1 (#16548)
*update prebuilt oneTBB2021.2.1

*modify tbb and tbb component installation

*modify the implementation of removing soft links

*update prebuilt oneTBB2021.2.1
macos: 11.4
windows: win10+visual studio 2019(MSVC 14.21)
https://github.com/open-mpi/hwloc/archive/refs/tags/hwloc-2.8.0.tar.gz
https://github.com/open-mpi/hwloc/archive/refs/tags/hwloc-2.8.0.zip
https://github.com/oneapi-src/oneTBB/archive/refs/tags/v2021.2.1.tar.gz(commitid:96af5d3)
https://github.com/oneapi-src/oneTBB/archive/refs/tags/v2021.2.1.zip(commitid:96af5d3)

before building oneTBB 2021.2.1, replace all strings "2_4" of the source code with "2_5"

for windows, after compilation, replace all strings
INTERFACE_COMPILE_DEFINITIONS "\$<\$<CONFIG:DEBUG>:TBB_USE_DEBUG>" to INTERFACE_COMPILE_DEFINITIONS "\$<\$<CONFIG:DEBUG>:TBB_USE_DEBUG>;__TBB_NO_IMPLICIT_LINKAGE=1"
in cmake file "%cd%\install\lib\cmake\TBB\TBBTargets.cmake"
2023-03-25 08:46:43 +00:00
Ilya Lavrenov
580b99c99b
Align plugins in caching properties (#16528)
* Align plugins in caching properties

* Fixed caching mock tests

* Added new TestNoCachingProperties test

* Fixed test

* Added ov::caching_properties to API 1.0 metrics as well
2023-03-25 00:26:18 +04:00
Taylor Yeonbok Lee
6a25143045
[GPU] Prevent memory reset at runtime allocation for dynamic shape, fix wrong padding handling (#16351)
* Prevent memory reset at runtime allocation for dynamic shape

* Set default alloc to reset mem

* Additional fixes :
- If there is any convolution/deconvolution users which requires padded input, enqueue reset buffer when reuse buffer.
- Removed cl finish from gpu_buffer::fill. (Hopefully it should be waited only when needed. Otherwise sync is to be done by event)
- Removed buffer reset from on_execute of nonzero count, which is not needed any more.

* Remove unused API

* Fix tensor offset to project the padding

* Added unittest

* Applied review comment
2023-03-24 13:10:33 -07:00
Ekaterina Aidova
1ef94ec069
[PT FE]: support aten::linalng_vector_norm (#16109)
* [PT FE]: support aten::linalng_vector_norm

* more norm ops

* update tests
2023-03-24 21:00:17 +01:00
Ilya Lavrenov
18df64c135
More accurate hwloc finding in case of dynamic tbbbind (#16488) 2023-03-24 19:42:20 +01:00
Sebastian Golebiewski
81b4666632
Update tutorials (#16544) 2023-03-24 18:17:36 +01:00
Ekaterina Aidova
179403ddc9
[PT FE]: improve integration into mo.convert_model (#16243) 2023-03-24 16:55:07 +01:00
Karol Blaszczak
953a166a62
[DOCS] minor fix for content and config (#16538) 2023-03-24 14:33:04 +01:00
Ivan Tikhonov
5a8a195dad
TransposeSinking: add support for Slice and Reshape ops (#16208)
* Resolve the performance issues in TransposeSinking transformation

* codestyle

* fix warning as error, fix tests failures

* fix ts for Concat and Reduce

* Fix TransposeReduceBackward

* fix the issue in TransposeFuse transformation

* fix TransposeReduce transformations

* Fix TransposeReduction, fix TransposeSinkingSplit, add unsqueeze support

* delete debug print

* Add additional validations

* fix node validation

* Fix validate for split, revert changes for concat, add BatchToSpace/SpaceToBatch

* Add SpaceToBatch/BatchToSpace

* fix TS for Interpolate + codestyle

* fix gna build

* Support TS for Interpolate, VariadicSplit, IsInf, IsNan, IsFinite + refactoring

* add the missed line

* add include

* TransposeSinking tests refactoring: part1

* TransposeSinking tests refactoring: part2

* Add limited support for StridedSlice op

* codestye

* TransposeReduction: skip the case when 2nd input for Squeeze is not provided

* Transpose sinking tests refactoring: part 3. + Revert changes in MOC.

* fix build

* codestyle

* Add tests for TS backward transformations, update TransposeSinkingFuse transformation, delete StridedSlice transformation prototype + tests refactoring

* fix unary tests

* Fix warning as error on Windows

* Add new tests for Unsqueeze/Squeeze; refactoring; remove debug code

* TransposeSinking: add support for Slice op

* Add descriptions to the transformations, add additional checks

* fix a warning

* TransposeSinking Rafactoring part2: move the transformations to a separate folder, align namespaces

* TransposeSinking refactoring: class names, namespaces

* codestyle

* resolve merge conflicts

* codestyle

* TSReduction refactoring, move Unsqueeze/Squeeze transformations to separate files, added limited support for Reshape op + tests

* fix minor mistakes

* fix warnings

* Added TSSlice transformation to TSGeneral, created TransposeSinkingGeneral alias in ov::pass namespace

* refactoring

* codestyle

* fix TSSqueeze/TSUnsqueeze transformations

* delete debug serialize

* remove TransposeSinking from MOC

* fix TSSqueeze/TSUnsqueeze transformations in case of Reshape op

* delete debug code

* codestyle

* fix unit tests, revert changes for TSSlice transformation

* fix TSSqueeze transformation

* resolve review comments

* codestyle
2023-03-24 17:01:15 +04:00
Georgy Krivoruchko
c5b348dd4f
[POC][TF FE] Support SavedModel format (with compression) (#16317)
* Added Saved Model proto descriptors

* Included Google's protobuf repository

* Added wstring version of ov::util::directory_exists

* Added initial implementation of Saved Model iterator

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Added missing proto files to repository

* Implemented reading of variables index and data files

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Renamed class

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Fix for cross-platform directory_exists

* Fixed codestyle and simplified code

* CI fixes

* Separeted Saved Model iterator from Proto iterator

* Moved variables index into separate class

* Added initial implementation of reading a variables from
saved model

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Added external variable mapping

* Code cleanup

* Commit is for discussion purposes!!!
Implemented RestoreV2 with a workaround for strings
Not optimized, includes mem leak

* In progress...

* Added DT_STRING coverage into decoder_proto

* m_variables_index moved into underlying class

* Updated copyrgihts, added space between license and code

* Moved string constant to separate class

* Added AssignVariableOp operation

* Changed behavior of RestoreV2
Updated stubs for other ops

* Second working implementation, enabled:
Program-only models
Variables reading from data files

* Extended docs

* Fixed dynamic type

* Fixed naming

* Added Snappy submodule to support compression in TF FE

* Enabled Snappy Compression for TF FE

* Make static linkage of Snappy
Changing Warning as error behavior for 3rd party

* CI fixes

* Added Snappy copyright info

* Aligned behavior of StringConstant with UnsupportedConstant

* Added correct naming and removing unused inputs/outputs
2023-03-24 15:07:16 +04:00
Ilya Churaev
9eab122952
Disable QSpectre flag by default (#16526) 2023-03-24 13:55:42 +04:00
Ilya Churaev
077d0e43f2
Fixed Windows warnings for core (#16523) 2023-03-24 09:34:06 +00:00
Andrei Gorbachev
cabb917b1f
[GPU] Fix warnings (#16516)
* fix a few warnings

* cast size_t to uint32_t
2023-03-24 13:26:24 +04:00
Maxim Vafin
86c4489aca
[PT FE] Add telemetry extension support (#16438)
* Initial telemetry introduction in PyTorch frontend

* Add test

* remove obsolete checks from test

* Move statistics gathering into TranslateSession

* Fix code style

* Fix codestyle
2023-03-24 10:11:12 +01:00
Nadezhda Ageeva
65e5ed7dd7
[HETERO]: support caching properties (#16451)
* Fixed build

* [HETERO]: support caching properties

* Fix caching test

* Code style

* Change result type from map to vector

* Review comments

---------

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-03-24 12:25:55 +04:00
Luo Cheng
16933efc06
[CPU] Enable brgconv primitives with binary post-ops by default on AVX512+ ISA (#16286) 2023-03-24 11:31:00 +04:00
Shen, Wanglei
613b66ba35
include nireq during streams calculation (#16378)
* include nireq during streams calculation

* update description for comments

* update description
2023-03-24 15:27:13 +08:00
Roman Kazantsev
3f4b1e8205
[TF FE] Post leftovers to support the MUSE model in SavedModel format (#16520)
* [TF FE] Post leftovers to support the MUSE model in SavedModel format

It contains tests imitating a case with Tokenizer extension and raised problems:
setting custom type for body graph Parameter, named ports for RaggedTensorToSparse
and Unique operations.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update src/frontends/tensorflow/tests/convert_tricky_models.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-24 11:07:56 +04:00
Ilya Churaev
fbdd158615
Small fixes for template plugin developer documentation (#16521) 2023-03-24 10:29:09 +04:00
Fang Xu
025115f695
Update prebuilt tbbbind static library for Linux (#15832)
* update prebuilt tbbbind static library

* update LICENSE file

* update SHA256

* update prebuilt tbbbind static library for linux

cmake 3.23.2
centos7

https://github.com/open-mpi/hwloc/archive/refs/tags/hwloc-2.8.0.tar.gz
./autogen.sh
./configure --enable-static --disable-io --disable-libudev --disable-libxml2 --disable-cairo CFLAGS="-fPIE"
make -j$(proc)
make install prefix=$(pwd)/install

https://github.com/oneapi-src/oneTBB/archive/refs/tags/v2021.7.0.tar.gz
sed -i "s/APPLE\s*OR\s*NOT\s*BUILD_SHARED_LIBS/APPLE/g" CMakeLists.txt
export HWLOC_DIR="${hwloc_root_dir}/hwloc-hwloc-2.8.0/install"
export PKG_CONFIG_PATH="${HWLOC_DIR}/lib/pkgconfig"
export CXXFLAGS="-I ${HWLOC_DIR}/include -L ${HWLOC_DIR}/lib"
~/cmake-3.23.2-linux-x86_64/bin/cmake -DTBB_TEST=OFF -DTBB_BUILD=OFF -DTBBMALLOC_BUILD=OFF -DBUILD_SHARED_LIBS=OFF
make -j$(nproc)

* remove changes for windows

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-03-24 14:27:57 +08:00
Zlobin Vladimir
69cec4a5e2
py/benchmark_app: fix -hint (#16511)
* py/benchmark_app: fix -hint

Don't warn about values which are explicitly set in -hint.
That aligns C++ and Python implementations.

Ticket 106544

* Remove extra throw

* Fix code style
2023-03-24 10:24:08 +04:00
Kelvin Choi
8518a3a8e8
[GPU] Disable converting gather8 to 7 pass because GPU plugin supports gather8:nagative-index feature (#15868)
* Add GatherV7 and gatherV8 for convert_gather_0d pattern

* Add updating output_shape using reorder/reshape for scalar indice instead of using ConvertGather0D pass

* Add WA for NMS-gather8 pattern
2023-03-23 23:12:12 -07:00
Sergey Shlyapnikov
e434c320f5
[GPU] Update tuning params of shape agnostic version of fully_connected_bf_tiled kernel for dGPUs (#16482) 2023-03-24 09:08:09 +04:00
Georgy Krivoruchko
7601e8a874
Added compilation flag (#15436) 2023-03-24 07:09:29 +04:00
Tomasz Dołbniak
1b89ecdbae
Interpolate v11 usage in ONNX FE (#16463) 2023-03-24 02:06:22 +00:00
Maxim Vafin
abaf61d059
Improve detectron2 support (#16011)
* Improve op support for detectron mask rcnn

* Initial commit

* Fix for reading processed list

* Format code

* Cleanup

* cleanup

* Cleanup

* cleanup test

* Add comment

* Add rt_info

* fix type

* More fixes for detectron

* Fix build

* Add tests for if

* Revert changes in index

* Add comment

* Fix test

* Fix get_axes_range

* Add tests and fix if type alignment

* Fix code style

---------

Co-authored-by: Mateusz <mateusz.mikolajczyk@intel.com>
2023-03-23 22:30:03 +00:00
Przemyslaw Wysocki
52b27d82c5
Upgrade ONNX to 1.13, protobuf to 3.20.3 and relax tensorflow (#14773)
* Bump ONNX version

* Bump protobuf

* Add xfails and skips

* Add tickets

* Skip ONNX Serialization tests

* Compile ONNX with C++17

* Force cpp17 - 2

* Use MSVC check

* Update tensorflow

* Minor change

* Bump onnx to 1.13.1

* Bump protobuf to 3.20.3

* Debug test tf

* Xfail tests in comp

* Update comp tests

* Update tf reqs

* Remove deprecated ONNX function

* Align PDPD FE protobuf req with 2.4.1

* Satisfy dependency review

* Attempt to fix dependency review

* Revert pdpd protobuf

* Skip pdpd tests

* Fix MO-TF-PB test

* Skip TF test case

* Add ticket numbers, rewrite reqs

* Fix requirements

* Minor change

* Set TF to 2.12

* Remove wrapt and skip test
2023-03-24 00:43:01 +04:00
Paul Youngsoo Ahn
74870f9b0b
[GPU] Fix gpu dynamic model multistream test issue (#16510) (#16510) 2023-03-23 10:51:57 -07:00
Ilya Churaev
2755b32fb9
Changed Template plugin public property (#16496)
* Changed template plugin public property

* Add property documentation

* Fixed comments

* Fixed typo
2023-03-23 16:34:49 +01:00
Tomasz Dołbniak
de0a4e16fb
TopK 11 exposed to Python (#16501) 2023-03-23 16:33:54 +01:00
Sebastian Golebiewski
44d6d97871
DOCS shift to rst - OpenVINO 2.0 Deployment (#16509) 2023-03-23 14:47:54 +01:00
Edward Shogulin
fb24e91416
[LPT] NNCF GroupConvolution 5D on weights support (#16336)
* [LPT] NNCF GroupConvolution 5D on weights support

* PullReshapeThroughDequantization rollback
2023-03-23 13:24:10 +00:00
Maksim Kutakov
8a246a8bf2
[CPU] Use Dnnl executor to avoid extra dnnl primitve desc query (#16372) 2023-03-23 16:25:39 +04:00
Nadezhda Ageeva
3b8d9c568c
Allow skip LoadNetworkToDefaultDeviceNoThrow tests (#16507) 2023-03-23 16:09:13 +04:00
Irina Efode
448654ea65
[CONFORMANCE] Fix report gewneration in case of mixed reports: rel and abs (#16505) 2023-03-23 15:08:18 +04:00
Sebastian Golebiewski
c89da1aee2
DOCS shift to rst - Install OpenVINO on macOS, Raspbian (#16506) 2023-03-23 12:02:01 +01:00
Sofya Balandina
9d0749a5b7
[conformanceTests] Add key for manage pipeline after crashes (#16123)
* [conformanceTests] Add key for manage pipeline after crashes

* Move crash_handler to funcTestsUtils
2023-03-23 14:59:31 +04:00
Mateusz Bencer
a004601774
[ONNX FE] Fix Windows warnings (#16141) 2023-03-23 10:59:00 +01:00
Ilya Churaev
a3958d6ddf
Use evaluation context for the inference (#16492) 2023-03-23 13:52:03 +04:00
Anastasia Kuporosova
982e1c1192
[PyOV] Fix issues with RTMap (#15636)
* [PyOV] Fix issues with RTMap

* update year

* some clean-up and items fix

* tests and small fixes

* Update src/bindings/python/src/pyopenvino/utils/utils.cpp

* undo changes

* fix serialization on python side

* rt_info as rt_map

* undo several changes in tests

* fix mo test

* sadd docstrings

* add tests

* fix codestyle

* try to fix win

* fix master

* apply comments
2023-03-23 10:29:32 +01:00
Edward Shogulin
087b10ff00
Snippets: precision propagation (#14996) 2023-03-23 13:16:04 +04:00
Sebastian Golebiewski
5fa95ff19d
DOCS shift to rst - Protecting Deep Learning Model (#16474) 2023-03-23 10:12:13 +01:00
Sebastian Golebiewski
66ae71454a
DOCS shift to rst - Install OpenVINO on Windows (#16502) 2023-03-23 10:09:43 +01:00
Roman Kazantsev
aaa4a4c210
[TF FE] Skip Assert operation and add test (#16484)
At the conversion stage we can't resolve Assert node because the condition
is computed only during inference time.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-23 11:49:46 +04:00
Maciej Smyk
17174a3839
DOCS shift to rst - Troubleshooting (#16483)
* troubleshooting
* code-block fix
2023-03-23 08:39:46 +01:00
Jade Cho
a20b3631fb
Support float64 data type as input of benchmark_app (#16435) 2023-03-23 13:55:55 +09:00
Ilya Churaev
a205c675db
Fix leftovers after removing plugins.xml (#16487)
* Fixed comments

* Rename ie_plugins to ov_plugins

* Remove dependency from tests
2023-03-23 04:32:36 +00:00
Kelvin Choi
6bf2fe11ae
[GPU] Need to exclude fused mem_dep from shape_infer_dep (#16300) 2023-03-22 13:00:29 -07:00
Tomasz Dołbniak
951c5fdae9
Interpolate 11 exposed to Python (#16465) 2023-03-22 18:12:16 +00:00