Commit Graph

10294 Commits

Author SHA1 Message Date
Georgy Krivoruchko
c5b348dd4f
[POC][TF FE] Support SavedModel format (with compression) (#16317)
* Added Saved Model proto descriptors

* Included Google's protobuf repository

* Added wstring version of ov::util::directory_exists

* Added initial implementation of Saved Model iterator

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Added missing proto files to repository

* Implemented reading of variables index and data files

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Renamed class

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Fix for cross-platform directory_exists

* Fixed codestyle and simplified code

* CI fixes

* Separeted Saved Model iterator from Proto iterator

* Moved variables index into separate class

* Added initial implementation of reading a variables from
saved model

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Added external variable mapping

* Code cleanup

* Commit is for discussion purposes!!!
Implemented RestoreV2 with a workaround for strings
Not optimized, includes mem leak

* In progress...

* Added DT_STRING coverage into decoder_proto

* m_variables_index moved into underlying class

* Updated copyrgihts, added space between license and code

* Moved string constant to separate class

* Added AssignVariableOp operation

* Changed behavior of RestoreV2
Updated stubs for other ops

* Second working implementation, enabled:
Program-only models
Variables reading from data files

* Extended docs

* Fixed dynamic type

* Fixed naming

* Added Snappy submodule to support compression in TF FE

* Enabled Snappy Compression for TF FE

* Make static linkage of Snappy
Changing Warning as error behavior for 3rd party

* CI fixes

* Added Snappy copyright info

* Aligned behavior of StringConstant with UnsupportedConstant

* Added correct naming and removing unused inputs/outputs
2023-03-24 15:07:16 +04:00
Ilya Churaev
9eab122952
Disable QSpectre flag by default (#16526) 2023-03-24 13:55:42 +04:00
Ilya Churaev
077d0e43f2
Fixed Windows warnings for core (#16523) 2023-03-24 09:34:06 +00:00
Andrei Gorbachev
cabb917b1f
[GPU] Fix warnings (#16516)
* fix a few warnings

* cast size_t to uint32_t
2023-03-24 13:26:24 +04:00
Maxim Vafin
86c4489aca
[PT FE] Add telemetry extension support (#16438)
* Initial telemetry introduction in PyTorch frontend

* Add test

* remove obsolete checks from test

* Move statistics gathering into TranslateSession

* Fix code style

* Fix codestyle
2023-03-24 10:11:12 +01:00
Nadezhda Ageeva
65e5ed7dd7
[HETERO]: support caching properties (#16451)
* Fixed build

* [HETERO]: support caching properties

* Fix caching test

* Code style

* Change result type from map to vector

* Review comments

---------

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-03-24 12:25:55 +04:00
Luo Cheng
16933efc06
[CPU] Enable brgconv primitives with binary post-ops by default on AVX512+ ISA (#16286) 2023-03-24 11:31:00 +04:00
Shen, Wanglei
613b66ba35
include nireq during streams calculation (#16378)
* include nireq during streams calculation

* update description for comments

* update description
2023-03-24 15:27:13 +08:00
Roman Kazantsev
3f4b1e8205
[TF FE] Post leftovers to support the MUSE model in SavedModel format (#16520)
* [TF FE] Post leftovers to support the MUSE model in SavedModel format

It contains tests imitating a case with Tokenizer extension and raised problems:
setting custom type for body graph Parameter, named ports for RaggedTensorToSparse
and Unique operations.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update src/frontends/tensorflow/tests/convert_tricky_models.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-24 11:07:56 +04:00
Ilya Churaev
fbdd158615
Small fixes for template plugin developer documentation (#16521) 2023-03-24 10:29:09 +04:00
Fang Xu
025115f695
Update prebuilt tbbbind static library for Linux (#15832)
* update prebuilt tbbbind static library

* update LICENSE file

* update SHA256

* update prebuilt tbbbind static library for linux

cmake 3.23.2
centos7

https://github.com/open-mpi/hwloc/archive/refs/tags/hwloc-2.8.0.tar.gz
./autogen.sh
./configure --enable-static --disable-io --disable-libudev --disable-libxml2 --disable-cairo CFLAGS="-fPIE"
make -j$(proc)
make install prefix=$(pwd)/install

https://github.com/oneapi-src/oneTBB/archive/refs/tags/v2021.7.0.tar.gz
sed -i "s/APPLE\s*OR\s*NOT\s*BUILD_SHARED_LIBS/APPLE/g" CMakeLists.txt
export HWLOC_DIR="${hwloc_root_dir}/hwloc-hwloc-2.8.0/install"
export PKG_CONFIG_PATH="${HWLOC_DIR}/lib/pkgconfig"
export CXXFLAGS="-I ${HWLOC_DIR}/include -L ${HWLOC_DIR}/lib"
~/cmake-3.23.2-linux-x86_64/bin/cmake -DTBB_TEST=OFF -DTBB_BUILD=OFF -DTBBMALLOC_BUILD=OFF -DBUILD_SHARED_LIBS=OFF
make -j$(nproc)

* remove changes for windows

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-03-24 14:27:57 +08:00
Zlobin Vladimir
69cec4a5e2
py/benchmark_app: fix -hint (#16511)
* py/benchmark_app: fix -hint

Don't warn about values which are explicitly set in -hint.
That aligns C++ and Python implementations.

Ticket 106544

* Remove extra throw

* Fix code style
2023-03-24 10:24:08 +04:00
Kelvin Choi
8518a3a8e8
[GPU] Disable converting gather8 to 7 pass because GPU plugin supports gather8:nagative-index feature (#15868)
* Add GatherV7 and gatherV8 for convert_gather_0d pattern

* Add updating output_shape using reorder/reshape for scalar indice instead of using ConvertGather0D pass

* Add WA for NMS-gather8 pattern
2023-03-23 23:12:12 -07:00
Sergey Shlyapnikov
e434c320f5
[GPU] Update tuning params of shape agnostic version of fully_connected_bf_tiled kernel for dGPUs (#16482) 2023-03-24 09:08:09 +04:00
Georgy Krivoruchko
7601e8a874
Added compilation flag (#15436) 2023-03-24 07:09:29 +04:00
Tomasz Dołbniak
1b89ecdbae
Interpolate v11 usage in ONNX FE (#16463) 2023-03-24 02:06:22 +00:00
Maxim Vafin
abaf61d059
Improve detectron2 support (#16011)
* Improve op support for detectron mask rcnn

* Initial commit

* Fix for reading processed list

* Format code

* Cleanup

* cleanup

* Cleanup

* cleanup test

* Add comment

* Add rt_info

* fix type

* More fixes for detectron

* Fix build

* Add tests for if

* Revert changes in index

* Add comment

* Fix test

* Fix get_axes_range

* Add tests and fix if type alignment

* Fix code style

---------

Co-authored-by: Mateusz <mateusz.mikolajczyk@intel.com>
2023-03-23 22:30:03 +00:00
Przemyslaw Wysocki
52b27d82c5
Upgrade ONNX to 1.13, protobuf to 3.20.3 and relax tensorflow (#14773)
* Bump ONNX version

* Bump protobuf

* Add xfails and skips

* Add tickets

* Skip ONNX Serialization tests

* Compile ONNX with C++17

* Force cpp17 - 2

* Use MSVC check

* Update tensorflow

* Minor change

* Bump onnx to 1.13.1

* Bump protobuf to 3.20.3

* Debug test tf

* Xfail tests in comp

* Update comp tests

* Update tf reqs

* Remove deprecated ONNX function

* Align PDPD FE protobuf req with 2.4.1

* Satisfy dependency review

* Attempt to fix dependency review

* Revert pdpd protobuf

* Skip pdpd tests

* Fix MO-TF-PB test

* Skip TF test case

* Add ticket numbers, rewrite reqs

* Fix requirements

* Minor change

* Set TF to 2.12

* Remove wrapt and skip test
2023-03-24 00:43:01 +04:00
Paul Youngsoo Ahn
74870f9b0b
[GPU] Fix gpu dynamic model multistream test issue (#16510) (#16510) 2023-03-23 10:51:57 -07:00
Ilya Churaev
2755b32fb9
Changed Template plugin public property (#16496)
* Changed template plugin public property

* Add property documentation

* Fixed comments

* Fixed typo
2023-03-23 16:34:49 +01:00
Tomasz Dołbniak
de0a4e16fb
TopK 11 exposed to Python (#16501) 2023-03-23 16:33:54 +01:00
Sebastian Golebiewski
44d6d97871
DOCS shift to rst - OpenVINO 2.0 Deployment (#16509) 2023-03-23 14:47:54 +01:00
Edward Shogulin
fb24e91416
[LPT] NNCF GroupConvolution 5D on weights support (#16336)
* [LPT] NNCF GroupConvolution 5D on weights support

* PullReshapeThroughDequantization rollback
2023-03-23 13:24:10 +00:00
Maksim Kutakov
8a246a8bf2
[CPU] Use Dnnl executor to avoid extra dnnl primitve desc query (#16372) 2023-03-23 16:25:39 +04:00
Nadezhda Ageeva
3b8d9c568c
Allow skip LoadNetworkToDefaultDeviceNoThrow tests (#16507) 2023-03-23 16:09:13 +04:00
Irina Efode
448654ea65
[CONFORMANCE] Fix report gewneration in case of mixed reports: rel and abs (#16505) 2023-03-23 15:08:18 +04:00
Sebastian Golebiewski
c89da1aee2
DOCS shift to rst - Install OpenVINO on macOS, Raspbian (#16506) 2023-03-23 12:02:01 +01:00
Sofya Balandina
9d0749a5b7
[conformanceTests] Add key for manage pipeline after crashes (#16123)
* [conformanceTests] Add key for manage pipeline after crashes

* Move crash_handler to funcTestsUtils
2023-03-23 14:59:31 +04:00
Mateusz Bencer
a004601774
[ONNX FE] Fix Windows warnings (#16141) 2023-03-23 10:59:00 +01:00
Ilya Churaev
a3958d6ddf
Use evaluation context for the inference (#16492) 2023-03-23 13:52:03 +04:00
Anastasia Kuporosova
982e1c1192
[PyOV] Fix issues with RTMap (#15636)
* [PyOV] Fix issues with RTMap

* update year

* some clean-up and items fix

* tests and small fixes

* Update src/bindings/python/src/pyopenvino/utils/utils.cpp

* undo changes

* fix serialization on python side

* rt_info as rt_map

* undo several changes in tests

* fix mo test

* sadd docstrings

* add tests

* fix codestyle

* try to fix win

* fix master

* apply comments
2023-03-23 10:29:32 +01:00
Edward Shogulin
087b10ff00
Snippets: precision propagation (#14996) 2023-03-23 13:16:04 +04:00
Sebastian Golebiewski
5fa95ff19d
DOCS shift to rst - Protecting Deep Learning Model (#16474) 2023-03-23 10:12:13 +01:00
Sebastian Golebiewski
66ae71454a
DOCS shift to rst - Install OpenVINO on Windows (#16502) 2023-03-23 10:09:43 +01:00
Roman Kazantsev
aaa4a4c210
[TF FE] Skip Assert operation and add test (#16484)
At the conversion stage we can't resolve Assert node because the condition
is computed only during inference time.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-23 11:49:46 +04:00
Maciej Smyk
17174a3839
DOCS shift to rst - Troubleshooting (#16483)
* troubleshooting
* code-block fix
2023-03-23 08:39:46 +01:00
Jade Cho
a20b3631fb
Support float64 data type as input of benchmark_app (#16435) 2023-03-23 13:55:55 +09:00
Ilya Churaev
a205c675db
Fix leftovers after removing plugins.xml (#16487)
* Fixed comments

* Rename ie_plugins to ov_plugins

* Remove dependency from tests
2023-03-23 04:32:36 +00:00
Kelvin Choi
6bf2fe11ae
[GPU] Need to exclude fused mem_dep from shape_infer_dep (#16300) 2023-03-22 13:00:29 -07:00
Tomasz Dołbniak
951c5fdae9
Interpolate 11 exposed to Python (#16465) 2023-03-22 18:12:16 +00:00
Yury Gaydaychuk
5290822f8b
[CPU] Enabled BatchToSpace and SpaceToBatch with nonconstant inputs support (#16344) 2023-03-22 16:36:05 +00:00
Irina Efode
6ac5e42b62
[CONFORMANCE] Fix if impossible to remove log (#16485)
* fix_reporting

* w/a for remove

* Update merge_xmls.py

remove extra
2023-03-22 20:07:47 +04:00
Tomasz Dołbniak
8eb142ca6e
Interpolate v11 -> v4 downgrade transformation (#16448) 2023-03-22 17:00:53 +01:00
Ilya Churaev
c23a1170ba
Remove plugins xml (#16470)
* Update core_impl.cpp

Add first implementation of register_compile_time_plugins (needs to depend on the actual CMake configuration as a next step).

* Update core.cpp

Check for missing plugins.xml

* Update core_impl.cpp

Avoid exception for missing plugins.xml

* Update core_impl.hpp

Add register_compile_time_plugins function definition

* Plugin loading based on CMake configuration

* Remove debug output command

* Unify static/dynamic plugin loading

* Add CMake option for plugins.xml that defaults to off

* Move GENERATE_PLUGINS_XML option to features.cmake

* Add missing brace

* Remove unnecessary #ifdef check

* Prepare to resolve conflicts

* Fix compile error

* Activate generation of plugins.xml in OpenVINODeveloperPackageConfig.cmake

* Fix CMake installation

* Plugin loading logic implemented in ie_core.cpp as well

* Fix format

* Small fixes

* Fixed code style

* Skip if xml file wasn't found

* Added function to find compiled plugins

* Generalize plugins hpp

* Use new API

* Fixed old core

* Fixed static build

---------

Co-authored-by: CSBVision <bjoern.boeken@csb.com>
2023-03-22 15:51:07 +00:00
Jan Iwaszkiewicz
4561aa7109
[PyOV] OVDict class - new return value from inference (#16370) 2023-03-22 16:12:07 +01:00
Xuejun Zhai
8509d0dd82
[Deprecated API] remove version (#16426)
* [Remove version] Remove version from py openvino

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Modify caused by remove version

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix clang format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Revert "Fix clang format issue"

This reverts commit 132787286f.

* Fix CI format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix merge conflict error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-03-22 16:09:14 +01:00
Ilya Lavrenov
1b72352f6f
Fixed CVS-93736 (#16471) 2023-03-22 14:20:03 +04:00
Chen Xu
57c91e0c56
[CPU] Fix issue in reducing HW with small channel size in npsc layout (#16467) 2023-03-22 13:28:38 +04:00
Sebastian Golebiewski
90100451a3
DOCS shift to rst - Libraries for Local Distribution (#16469) 2023-03-22 09:43:44 +01:00
Sebastian Golebiewski
066ef694f5
DOCS shift to rst - Deploying Your Application with Deployment Manager (#16453) 2023-03-22 09:42:47 +01:00