Commit Graph

10332 Commits

Author SHA1 Message Date
Ilya Churaev
167bf7e16a
Added test to check that layout can be created from serialized format (#16575) 2023-03-28 00:43:30 +04:00
Shen, Wanglei
815d4abc03
enable new property ov::hint::use_hyper_threading (#16176)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* enable new property use hyper threading

* update description

* resume legacy code

* change to ov::hint namespace

* update including header file

* update C API and Python API

* update description for comments

* update test case for comments

* update function location for comments

* fix typo

* fix typo

* fix code style issue and update test case

* move cpu_map_scheduling into threading folder
2023-03-28 00:39:26 +04:00
Orest Chura
aa0df8e535
[Python][Build] Fix building openvino wheel on Windows (#16374)
* Add snippets dependency

* - removed dependency back
- added an INTEL_CPU condition on snippets configuring -> no dependency when configured w/0 CPU

* Disable snippets_ngraph_functions conditionally if inference_engine_snippets are not configured

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-03-27 23:52:58 +04:00
Sebastian Golebiewski
68e067062f
Update Doxyfile.config (#16564) 2023-03-27 23:47:10 +04:00
Sebastian Golebiewski
1ca94326cb
DOCS shift to rst - Benchmark Samples and Tools (#16566) 2023-03-27 18:29:05 +02:00
Sebastian Golebiewski
5c5a29d095
DOCS shift to rst -Sync Benchmark Samples (#16561) 2023-03-27 18:28:16 +02:00
Maciej Smyk
6e99b48ecc
DOCS shift to rst - OpenVINO™ Samples and Get Started with C++ Samples (#16577) 2023-03-27 18:26:47 +02:00
Irina Efode
9863b32792
[CONFORMANCE] w/a Api Conformance crash for NVIDIA (#16508) 2023-03-27 17:57:10 +02:00
Maciej Smyk
7ccf1c89cf
DOCS shift to rst - Image Classification Async C++ Sample & Image Classification Async Python* Sample (#16580) 2023-03-27 16:54:50 +02:00
Roman Kazantsev
5e9ea6a146
[TF FE] Refactor utils routine (#16554)
Move all openvino_conversion rountines into utils. Avoid using Squeeze without axis
that can create dynamic output rank

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-27 11:10:00 +00:00
Roman Lyamin
5113a5538c
[GPU] Added shape canonicalization mechanism (#16166) 2023-03-27 15:02:06 +04:00
Tomasz Adamowicz
4936d4bb1d
[GNA] Introduce 16Byte memory alignment for LNL (GNA3.6) (#16363)
* [GNA] Introduce 16Byte memory alignment for LNL (GNA3.6)

* update after review
2023-03-27 10:42:34 +01:00
Mang Guo
5e835e327b
[CPU] Fix edge memory share issue (#16202) 2023-03-27 13:20:51 +04:00
Piotr Krzemiński
6b70c449ba
[PT FE] Add aten::Chunk implementation (#16035)
* [PT FE] Add chunk implementation:

* [PT FE] Fix chunk int64 instead of const node errors, add tests for chunking

* [PT FE] Test Chunk-If implementation

* [PT FE] Change the translate to replace chunk implementation, use VariadicSplit instead of Slice

* [PT FE] Reduce artifacts from debugging

* Update test_chunk.py

* [PT FE] Improve & debug chunk implementation:

* [PT FE] Simplify implementation, fix remaining bugs

* [PT FE] Statify the split lenghts output

* [PT FE] Clear code, remove debugging artifacts
2023-03-27 11:16:16 +02:00
Mateusz Mikolajczyk
7d16ee1835
[PT FE] Add torchvision::deform_conv2d translation (#16450)
* Initial commit

* Initial commit

* Cleanup

* Improve tests

* Make NodeContext const
2023-03-27 11:13:32 +02:00
Roman Kazantsev
bb9de29062
[TF FE] Add layer test for Bucketize (#16556)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-27 12:03:07 +04:00
cecilia peng
a1b8a6a941
[CPU] Disable ConvertNMSToNMSIEInternal (#16128) 2023-03-27 11:22:53 +04:00
dependabot[bot]
64e9dc32cd
Bump awalsh128/cache-apt-pkgs-action from 1.2.4 to 1.3.0 (#16562)
Bumps [awalsh128/cache-apt-pkgs-action](https://github.com/awalsh128/cache-apt-pkgs-action) from 1.2.4 to 1.3.0.
- [Release notes](https://github.com/awalsh128/cache-apt-pkgs-action/releases)
- [Commits](https://github.com/awalsh128/cache-apt-pkgs-action/compare/v1.2.4...v1.3.0)

---
updated-dependencies:
- dependency-name: awalsh128/cache-apt-pkgs-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-27 11:09:21 +04:00
Ilya Lavrenov
2638014d00
Enable build with system version of snappy (#16549)
* Enable build with system version of snappy

* Create Snappy::snappy alia
2023-03-27 10:01:11 +04:00
Maksim Kutakov
0765fa108a
[CPU] Debug Caps build fix (#16536) 2023-03-27 07:28:43 +02:00
Ilya Lavrenov
3f3bda592b
Revert "[MO] remove deprecated: data_type, disable_nhwc_to_nchw, tensorflow_use_custom_operations_config (#16394)" (#16555)
This reverts commit 43ef89e625.
2023-03-27 09:04:41 +04:00
Sergey Shlyapnikov
ce67ac09d3
[GPU] Disable OneDNN primitive cache (#16525) 2023-03-26 23:29:47 +04:00
Maksim Kutakov
ab151fd357
[CPU] Temporal object access fix (#16546) 2023-03-26 22:36:14 +04:00
Mateusz Tabaka
1df14c6a6c
Add docs for OPENVINO_FRAMEWORK_MAP macro (#14928)
* Add docs for OPENVINO_FRAMEWORK_MAP macro

Ticket: 98762

* Apply suggestions from code review

Co-authored-by: Piotr Krzemiński <piotrkrzeminski1234@gmail.com>

---------

Co-authored-by: Piotr Krzemiński <piotrkrzeminski1234@gmail.com>
2023-03-26 22:00:43 +04:00
Rajat U Krishna
6eb8f4b2b7
[Docs][PyOV] Fix broken link to section (#16553)
* [Docs][PyOV] Minor change to fix a broken link in code_examples.md
2023-03-26 21:58:52 +04:00
Pavel Esir
43ef89e625
[MO] remove deprecated: data_type, disable_nhwc_to_nchw, tensorflow_use_custom_operations_config (#16394)
* removed deprecated MO options: data_type, disable_nhwc_to_nchw, tensorflow_use_custom_operations_config

* fix layer_test_class.py

* data_type -> precision in layer_test_class.py

* typo fix

* corrected layer tests for compress_to_fp16 argument
2023-03-26 21:38:15 +04:00
Andrew Kwangwoong Park
2956717118
[GPU] Added shape agnostic TopK kernel (#16161)
* [GPU] Added shape agnostic TopK kernel implementation

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update kernel to use internal buffers for shape agnostic kernel

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add WA to compile_graph for shape agnostic arg_max_min_axis with non-const k input

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix is_dynamic pameter for FillCLKernelData with the case where the output is static shape

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix corner case where inbuf size becomes 0 when ops_size is 1

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-03-25 22:32:17 -07:00
guozhong wang
60ab7490bf
Implement CTPUT in AUTO code logic (#16220)
* Implement CTPUT in AUTO code logic

* Add logic to handle device loading failure

* add some code comments

* fix warnning conversion from size_t to int

* Updated code according to comments of bell and wanglei

* the preferred device code path need to be updated with ctput also

* add fallback logic for CTPUT

* Modify the code logic according to bell suggestion

* Add prints for debugging bug

* throw exception when no device to run pipline task

* initialize idleWorkerRequest for CTPUT

* fix getting properties

Signed-off-by: fishbell <bell.song@intel.com>

refine

Signed-off-by: fishbell <bell.song@intel.com>

* fix warning

Signed-off-by: fishbell <bell.song@intel.com>

* fix illegal character on windows

Signed-off-by: fishbell <bell.song@intel.com>

* fix illegal character

Signed-off-by: fishbell <bell.song@intel.com>

add missing include

Signed-off-by: fishbell <bell.song@intel.com>

* more code refine

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
Co-authored-by: fishbell <bell.song@intel.com>
2023-03-26 12:35:26 +08:00
Ilya Lavrenov
e66b837104
Properties improvements: part 2 (#16489)
* Properties improvements: part 2

* Accurate configs handling in HETERO / BATCH

* Align plugins in caching properties

* Fixed caching mock tests

* Added new TestNoCachingProperties test

* Fixed test

* Added ov::caching_properties to API 1.0 metrics as well

* Fixes for HETERO plugin

* Fixed tests

* Even more refactoring in HETERO plugin config management
2023-03-25 19:28:05 +04:00
Fang Xu
a96da994ec
Update prebuilt oneTBB2021.2.1 (#16548)
*update prebuilt oneTBB2021.2.1

*modify tbb and tbb component installation

*modify the implementation of removing soft links

*update prebuilt oneTBB2021.2.1
macos: 11.4
windows: win10+visual studio 2019(MSVC 14.21)
https://github.com/open-mpi/hwloc/archive/refs/tags/hwloc-2.8.0.tar.gz
https://github.com/open-mpi/hwloc/archive/refs/tags/hwloc-2.8.0.zip
https://github.com/oneapi-src/oneTBB/archive/refs/tags/v2021.2.1.tar.gz(commitid:96af5d3)
https://github.com/oneapi-src/oneTBB/archive/refs/tags/v2021.2.1.zip(commitid:96af5d3)

before building oneTBB 2021.2.1, replace all strings "2_4" of the source code with "2_5"

for windows, after compilation, replace all strings
INTERFACE_COMPILE_DEFINITIONS "\$<\$<CONFIG:DEBUG>:TBB_USE_DEBUG>" to INTERFACE_COMPILE_DEFINITIONS "\$<\$<CONFIG:DEBUG>:TBB_USE_DEBUG>;__TBB_NO_IMPLICIT_LINKAGE=1"
in cmake file "%cd%\install\lib\cmake\TBB\TBBTargets.cmake"
2023-03-25 08:46:43 +00:00
Ilya Lavrenov
580b99c99b
Align plugins in caching properties (#16528)
* Align plugins in caching properties

* Fixed caching mock tests

* Added new TestNoCachingProperties test

* Fixed test

* Added ov::caching_properties to API 1.0 metrics as well
2023-03-25 00:26:18 +04:00
Taylor Yeonbok Lee
6a25143045
[GPU] Prevent memory reset at runtime allocation for dynamic shape, fix wrong padding handling (#16351)
* Prevent memory reset at runtime allocation for dynamic shape

* Set default alloc to reset mem

* Additional fixes :
- If there is any convolution/deconvolution users which requires padded input, enqueue reset buffer when reuse buffer.
- Removed cl finish from gpu_buffer::fill. (Hopefully it should be waited only when needed. Otherwise sync is to be done by event)
- Removed buffer reset from on_execute of nonzero count, which is not needed any more.

* Remove unused API

* Fix tensor offset to project the padding

* Added unittest

* Applied review comment
2023-03-24 13:10:33 -07:00
Ekaterina Aidova
1ef94ec069
[PT FE]: support aten::linalng_vector_norm (#16109)
* [PT FE]: support aten::linalng_vector_norm

* more norm ops

* update tests
2023-03-24 21:00:17 +01:00
Ilya Lavrenov
18df64c135
More accurate hwloc finding in case of dynamic tbbbind (#16488) 2023-03-24 19:42:20 +01:00
Sebastian Golebiewski
81b4666632
Update tutorials (#16544) 2023-03-24 18:17:36 +01:00
Ekaterina Aidova
179403ddc9
[PT FE]: improve integration into mo.convert_model (#16243) 2023-03-24 16:55:07 +01:00
Karol Blaszczak
953a166a62
[DOCS] minor fix for content and config (#16538) 2023-03-24 14:33:04 +01:00
Ivan Tikhonov
5a8a195dad
TransposeSinking: add support for Slice and Reshape ops (#16208)
* Resolve the performance issues in TransposeSinking transformation

* codestyle

* fix warning as error, fix tests failures

* fix ts for Concat and Reduce

* Fix TransposeReduceBackward

* fix the issue in TransposeFuse transformation

* fix TransposeReduce transformations

* Fix TransposeReduction, fix TransposeSinkingSplit, add unsqueeze support

* delete debug print

* Add additional validations

* fix node validation

* Fix validate for split, revert changes for concat, add BatchToSpace/SpaceToBatch

* Add SpaceToBatch/BatchToSpace

* fix TS for Interpolate + codestyle

* fix gna build

* Support TS for Interpolate, VariadicSplit, IsInf, IsNan, IsFinite + refactoring

* add the missed line

* add include

* TransposeSinking tests refactoring: part1

* TransposeSinking tests refactoring: part2

* Add limited support for StridedSlice op

* codestye

* TransposeReduction: skip the case when 2nd input for Squeeze is not provided

* Transpose sinking tests refactoring: part 3. + Revert changes in MOC.

* fix build

* codestyle

* Add tests for TS backward transformations, update TransposeSinkingFuse transformation, delete StridedSlice transformation prototype + tests refactoring

* fix unary tests

* Fix warning as error on Windows

* Add new tests for Unsqueeze/Squeeze; refactoring; remove debug code

* TransposeSinking: add support for Slice op

* Add descriptions to the transformations, add additional checks

* fix a warning

* TransposeSinking Rafactoring part2: move the transformations to a separate folder, align namespaces

* TransposeSinking refactoring: class names, namespaces

* codestyle

* resolve merge conflicts

* codestyle

* TSReduction refactoring, move Unsqueeze/Squeeze transformations to separate files, added limited support for Reshape op + tests

* fix minor mistakes

* fix warnings

* Added TSSlice transformation to TSGeneral, created TransposeSinkingGeneral alias in ov::pass namespace

* refactoring

* codestyle

* fix TSSqueeze/TSUnsqueeze transformations

* delete debug serialize

* remove TransposeSinking from MOC

* fix TSSqueeze/TSUnsqueeze transformations in case of Reshape op

* delete debug code

* codestyle

* fix unit tests, revert changes for TSSlice transformation

* fix TSSqueeze transformation

* resolve review comments

* codestyle
2023-03-24 17:01:15 +04:00
Georgy Krivoruchko
c5b348dd4f
[POC][TF FE] Support SavedModel format (with compression) (#16317)
* Added Saved Model proto descriptors

* Included Google's protobuf repository

* Added wstring version of ov::util::directory_exists

* Added initial implementation of Saved Model iterator

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Added missing proto files to repository

* Implemented reading of variables index and data files

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Renamed class

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Fix for cross-platform directory_exists

* Fixed codestyle and simplified code

* CI fixes

* Separeted Saved Model iterator from Proto iterator

* Moved variables index into separate class

* Added initial implementation of reading a variables from
saved model

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Added external variable mapping

* Code cleanup

* Commit is for discussion purposes!!!
Implemented RestoreV2 with a workaround for strings
Not optimized, includes mem leak

* In progress...

* Added DT_STRING coverage into decoder_proto

* m_variables_index moved into underlying class

* Updated copyrgihts, added space between license and code

* Moved string constant to separate class

* Added AssignVariableOp operation

* Changed behavior of RestoreV2
Updated stubs for other ops

* Second working implementation, enabled:
Program-only models
Variables reading from data files

* Extended docs

* Fixed dynamic type

* Fixed naming

* Added Snappy submodule to support compression in TF FE

* Enabled Snappy Compression for TF FE

* Make static linkage of Snappy
Changing Warning as error behavior for 3rd party

* CI fixes

* Added Snappy copyright info

* Aligned behavior of StringConstant with UnsupportedConstant

* Added correct naming and removing unused inputs/outputs
2023-03-24 15:07:16 +04:00
Ilya Churaev
9eab122952
Disable QSpectre flag by default (#16526) 2023-03-24 13:55:42 +04:00
Ilya Churaev
077d0e43f2
Fixed Windows warnings for core (#16523) 2023-03-24 09:34:06 +00:00
Andrei Gorbachev
cabb917b1f
[GPU] Fix warnings (#16516)
* fix a few warnings

* cast size_t to uint32_t
2023-03-24 13:26:24 +04:00
Maxim Vafin
86c4489aca
[PT FE] Add telemetry extension support (#16438)
* Initial telemetry introduction in PyTorch frontend

* Add test

* remove obsolete checks from test

* Move statistics gathering into TranslateSession

* Fix code style

* Fix codestyle
2023-03-24 10:11:12 +01:00
Nadezhda Ageeva
65e5ed7dd7
[HETERO]: support caching properties (#16451)
* Fixed build

* [HETERO]: support caching properties

* Fix caching test

* Code style

* Change result type from map to vector

* Review comments

---------

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-03-24 12:25:55 +04:00
Luo Cheng
16933efc06
[CPU] Enable brgconv primitives with binary post-ops by default on AVX512+ ISA (#16286) 2023-03-24 11:31:00 +04:00
Shen, Wanglei
613b66ba35
include nireq during streams calculation (#16378)
* include nireq during streams calculation

* update description for comments

* update description
2023-03-24 15:27:13 +08:00
Roman Kazantsev
3f4b1e8205
[TF FE] Post leftovers to support the MUSE model in SavedModel format (#16520)
* [TF FE] Post leftovers to support the MUSE model in SavedModel format

It contains tests imitating a case with Tokenizer extension and raised problems:
setting custom type for body graph Parameter, named ports for RaggedTensorToSparse
and Unique operations.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update src/frontends/tensorflow/tests/convert_tricky_models.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-24 11:07:56 +04:00
Ilya Churaev
fbdd158615
Small fixes for template plugin developer documentation (#16521) 2023-03-24 10:29:09 +04:00
Fang Xu
025115f695
Update prebuilt tbbbind static library for Linux (#15832)
* update prebuilt tbbbind static library

* update LICENSE file

* update SHA256

* update prebuilt tbbbind static library for linux

cmake 3.23.2
centos7

https://github.com/open-mpi/hwloc/archive/refs/tags/hwloc-2.8.0.tar.gz
./autogen.sh
./configure --enable-static --disable-io --disable-libudev --disable-libxml2 --disable-cairo CFLAGS="-fPIE"
make -j$(proc)
make install prefix=$(pwd)/install

https://github.com/oneapi-src/oneTBB/archive/refs/tags/v2021.7.0.tar.gz
sed -i "s/APPLE\s*OR\s*NOT\s*BUILD_SHARED_LIBS/APPLE/g" CMakeLists.txt
export HWLOC_DIR="${hwloc_root_dir}/hwloc-hwloc-2.8.0/install"
export PKG_CONFIG_PATH="${HWLOC_DIR}/lib/pkgconfig"
export CXXFLAGS="-I ${HWLOC_DIR}/include -L ${HWLOC_DIR}/lib"
~/cmake-3.23.2-linux-x86_64/bin/cmake -DTBB_TEST=OFF -DTBB_BUILD=OFF -DTBBMALLOC_BUILD=OFF -DBUILD_SHARED_LIBS=OFF
make -j$(nproc)

* remove changes for windows

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-03-24 14:27:57 +08:00
Zlobin Vladimir
69cec4a5e2
py/benchmark_app: fix -hint (#16511)
* py/benchmark_app: fix -hint

Don't warn about values which are explicitly set in -hint.
That aligns C++ and Python implementations.

Ticket 106544

* Remove extra throw

* Fix code style
2023-03-24 10:24:08 +04:00