Commit Graph

70 Commits

Author SHA1 Message Date
Sungeun Kim
bf3046e3a0 [GPU] Integration Prelu fusing (#8958)
* [GPU] Add new data format: os_is_yx_osa2_isa8_osv8_isv2

* fusing prelu

- add onednn_post_op_type::binary_relu

* update onednn_gpu
2021-12-14 20:09:50 +09:00
Ilya Lavrenov
4342473120 Migrated to ittapi v3.22.5 (#9165) 2021-12-13 15:59:58 +03:00
Ilya Lavrenov
9e519946f0 Integrate JSON libs (#9145)
* Add nlohmann json (Release 3.10.4) as submodule

* Move nlohmann_json lib to json folder, add json_schema validator lib as submodule

* Move BUILD_SHARED_LIBS flag to a separete scope

* Add export of nlohmann_json_schema_validator

* Fix build

* set folder thirdparty

* link lib to offline_transformations and benchmark_app

* suppress shadowing names warning in nlohmann_json lib

* fix include in benchmark_app

* Resolve review comments: add json subdirs to samples cmake

* Fix static build

* Proper json integration

* removed cpp_samples_deps component

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2021-12-12 20:40:41 +03:00
Ilya Lavrenov
02e7706776 Merged ngraph & core components (#9101) 2021-12-09 15:38:44 +03:00
Orest Chura
f734e7679b Update fluid (#9007) 2021-12-08 14:43:31 +03:00
Ilya Churaev
d502208f6e Remove ngraph options (#9016)
* Renamed options

* Fixed configs

* Renamed unit tests

* Fixed cmake generation

* Fixed comments

* Fixed comments
2021-12-08 08:17:31 +03:00
Ivan Tikhonov
e23e6f3628 Add nlohmann json (Release 3.10.4) as submodule (#8915) 2021-12-02 10:41:36 +03:00
Vladimir Paramuzov
9b97619687 [GPU] Move plugin to new source dir (#8890) 2021-11-30 17:26:09 +03:00
Ilya Lavrenov
c02fe4b813 Static OpenVINO frontends (#8868)
* Static OpenVINO frontends

* ONNX tests with shared extension CustomOpUser_ONNXImporter

* Resolved issues with ONNX's NCC style check

* Reverted openvino => ngraph for frontend includes install

* Try to fix ONNX / Protobuf

* Try to fix CI

* Try

* Fixed cmake stage with BUILD_SHARED_LIBS

* Fixed export for linkable frontends

* Fixed warnings on Linux

* Fixed after ngraph => src
2021-11-28 21:36:24 +03:00
Ilya Lavrenov
5719192687 Use ninja multi-config (#8757)
* Use ninja multu-config

* Reused OV_GENERATOR_MULTI_CONFIG

* Try to use config in api_validator post build task

* Fixes

* Revert "[GPU] Fix multi configuration build of onednn_gpu (#8743)"

This reverts commit a862331732.

* Propogate disable deprecated for _RELEASE flags as well
2021-11-27 14:58:24 +03:00
Ilya Lavrenov
22233414f9 Static MSVC runtime (#8726)
* Try to fix Windows Azure

* Try static MSVC runtime

* Fixed type

* cnpy

* Rename

* Set CMAKE_MSVC_RUNTIME_LIBRARY

* Fixed issues with oneDNN

* Removed IB

* Minimize a number of threads

* Increase image size to avoid test failures on some platforms

There is an assert 'length >= nlanes' and 'nlanes' value depends on machine architecture
Set 320x320 test image to guarantee that image size >= nlanes

Also increased image size for 'plugin shared tests' to ensure the same (even though tests do not work with legacy preprocessing)

* Descreased to 160x160

* Specify toolchain for samples

* Build samples and its tests even for static build

* Used 3.21 to enable CMAKE_TOOLCHAIN_FILE env var usage

* Fixed cmake download path

* Set CMAKE_TOOLCHAIN_FILE conditionally

* Fix

Co-authored-by: Michael Nosov <mikhail.nosov@intel.com>
2021-11-24 15:04:38 +03:00
Anton Romanov
b5134dc459 Fixed part coverity issues in samples (#8744) 2021-11-24 13:17:33 +03:00
Maksim Shabunin
94b6f64e0b oneDNN: fixed build with mullti-config generators (#8775) 2021-11-24 09:11:24 +03:00
Mikhail Letavin
a862331732 [GPU] Fix multi configuration build of onednn_gpu (#8743) 2021-11-23 00:22:05 +03:00
Ilya Lavrenov
51b9dff1bc Windows static (#8578)
* Enable LTO for oneDNN GPU

* Use importer target for onednn_gpu

* Fixed install of OpenCL, ittapi

* Try to enable samples build

* Fixed ie_wheel build

* Disabled samples

* Fixed incorrect install of pugixml in dynamic build

* Fixed clDNN_unit_tests64 link

* Minimized a number of hardcoded paths

* Switched off ITT

* Disable TBBBind for static Windows

* Fixed link on Windows

* Fixes

* Static build for Window

* Disable unit-tests

* Disabled TF

* Fixed add dependency for PDPD unit tests

* Disabled GNA

* Enabled ngraph test utils

* Fixes

* Fixes

* Disable clDNN for static build on Windows

* Dynamic MCVS runtime for OpenCL

* Disable ITT traces for static libs

* Ability to switch TBBBind_2_5 OFF

* Disabled GPU on Windows build

* Fixed libGNA link

* Disabled some GNA tests

* Fixed multiple definitions issue

* Hide FrontEnd::load in DLL

* Install libGNAStubs

* Trying to fix Windows

* Trying to fix frontends

* Passed compilation on Windows

* Updated install rules for ngraph backends

* Try CPU, TEMPLATE tests

* Enabled unit-tests

* Enabled ngraph tests

* Try to fix unit-test

* Fixed unit-test on Linux

* Fixed compilation with ENABLE_IR_V7_READER=OFF

* Fixed tests on Linux

* Enable cpuFuncTests only in static build

* Try to fix testMockPluginFrontEnd test

* Try to enable TF

* Fixed python tests

* Partial revert

* Removed OV_FRONTEND_PATH
2021-11-17 01:22:04 +03:00
Anton Romanov
cac45e4f29 Fixed cnpy coverity issues (#8515) 2021-11-15 17:24:48 +03:00
Ilya Lavrenov
8cb17ca218 Enable GPU in static build w/o oneDNN (#8563)
* Enable LTO for oneDNN GPU

* Use importer target for onednn_gpu

* Fixed install of OpenCL, ittapi

* Try to enable samples build

* Fixed ie_wheel build

* Disabled samples

* Fixed incorrect install of pugixml in dynamic build
2021-11-15 13:44:11 +03:00
Ilya Lavrenov
a0b5de0c88 Fixed incorrect install of pugixml in dynamic build (#8566) 2021-11-12 22:42:27 +03:00
Ilya Lavrenov
461f746430 Install rules for static libraries case (#8384)
* Proper cmake install for static libraries case

* Added an ability to skip template plugin

* Added install rules for VPU / GPU

* Install more libraries

* Fixed absolute TBB include paths

* Disable GNA

* Fixed issue with linker

* Some fixes

* Fixed linkage issues in tests

* Disabled some tests

* Updated CI pipelines

* Fixed Windows linkage

* Fixed custom_opset test for static casr

* Fixed CVS-70313

* Continue on error

* Fixed clanf-format

* Try to fix Windows linker

* Fixed compilation

* Disable samples

* Fixed samples build with THREADING=SEQ

* Fixed link error on Windows

* Fixed ieFuncTests

* Added static Azure CI

* Revert "Fixed link error on Windows"

This reverts commit 78cca36fd2.

* Merge static and dynamic linux pipelines

* Fixed Azure
2021-11-10 18:25:51 +03:00
Ilya Znamenskiy
91da09b1e5 [GPU] OneDNN gpu submodule update to version 2.5 (#8449)
* [GPU] OneDNN gpu submodule update to version 2.5

* [GPU] Updated onednn submodule and added layout optimizer fix
2021-11-10 17:58:11 +03:00
Tomasz Dołbniak
6780dfcba7 Update of ONNX submodule to v1.10.2 (#8383)
* Update of ONNX submodule to v1.10.0

* Update of ONNX to 1.10.2

* Adaptation of the ONNX FE to ONNX 1.10

* ConstantOfShape XFAIL removal

* SCEL reference model updated to the new ONNX functions expansion behavior

* UnXFAIL more ONNX tests

* UnXFAIL even more ONNX tests
2021-11-09 12:53:34 +03:00
Vladimir Paramuzov
d9847f7303 [GPU] Limit number of threads used for onednn build (#8328) 2021-11-01 17:59:30 +03:00
Sergey Shlyapnikov
2a20d9a6e7 [GPU] Update OneDNN submodule to 2.4.1 version (#8119) 2021-10-21 11:38:31 +03:00
Roman Kazantsev
1752298e17 Merge TensorFlow Frontend Implementation (#7855)
* Migrate POC for TensorFlow frontend

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Refactor InputModelTensorFlow API

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Repack POC to official API

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove tensorflow API from public include

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Make TF frontend work from MO and clean-up code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply codestyle

* Fix win biuld

* Fix Linux build

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Implement Place class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Determine outputs from graph

* Implement all Place classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Make small clean-up

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code-style corrections

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Determine cut nodes

* Apply codestyle

* Rework to use places

* Fix conversion issue

* Fix build

* Fix conversion

* Small fixes

* Add test for tf frontend

* Add tests

* Implement partial conversion

* Use dynamic type in TFFrameworkNode

* Fix build on Linux

* Implement InputModelTF class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix code by replacing InputModelTensorFlow to InputModelTF

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix to pass getPlaceByTensorName test

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Refactor and clean the code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Finalize refactoring code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Support freezing inputs

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add support for pruning input ports as new model output

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code-style fixes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* move op convertors to separate files, refactoring

* openvino codestyle

* openvino codestyle

* fix crash of layer tests

* fix missprint

* Implement TensorFlow NodeContext and DecoderTFProto classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Switch to new NodeContext

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove ngraph_builder class and node_context_impl class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Move decoder/graph_iterator to separate files and remove old files

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Document Decoder, GraphIterator, and NodeContext classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove empty file graph_iterator_proto.cpp and redundant comments

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use base class for GraphIterator in model class and correct exception class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use ends_with from util library

* Remain only InputModelTF constructor with GraphIterator and adopt other code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Correct code after merge

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix code based on feedback: delete extra namespace usage, etc.

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Make legacy TF frontend default in MO and avoid reading tf models from ReadNetwork

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue with FrameworkNode after upstream merge

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Correct frontend name in test and clean the code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* refactoring of tf FrontEnd: rename namespaces, delete default opset

* codestyle

* fix e2e tests

* change namespaces of external classes

* resolve review comment

* codestyle

* Clean useless comments and fix tests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add copyright for proto files

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Make op translators a part of FrontEndTF

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Align CMakeLists.txt file with other frontends

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add job_pool into CMakeLists.txt for tensorflow tests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove cout and WA in ie_network_reader.cpp

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Correct DecoderBase and FrontEndTF methods, clean the code from if 0, utility.hpp, ngraph_conversions.hpp

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Clean operation translator code and remove empty implementation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Extend cmake template files with tensorflow frontend

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code-style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issues on MacOS and apply review feedback

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove ConstantFolding pass, add destructors for DecoderBase, GraphIterator, and fix Win build

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix Windows build issue

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code-style fix

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix issues with code style: remove virtual keyword, OpMap removal

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Resolve review remarks

* Resolve review remarks

* codestyle

* resolve review remarks

* fix copyright

* resolve review comments

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2021-10-14 10:36:10 +03:00
Ilya Lavrenov
acb6aa01ab Added reporting of unresolved symbols for plugins (#7810)
* Added reporting of unresolved symbols for plugins

* Added HDDL dependency

* Removed cross-compilation if

* Revert "Removed cross-compilation if"

This reverts commit da644a3afe.
2021-10-05 04:26:01 +03:00
Sergey Shlyapnikov
9c2b3f24a9 Fix benchmark_app build (#7577) 2021-09-23 18:42:19 +03:00
Vladimir Paramuzov
43609b4b4e [GPU] Added onednn dependency. (#6564) 2021-09-21 09:48:16 +03:00
Sergey Shlyapnikov
1f85d4230d Add use_device_mem option to benchmark_app (#7433) 2021-09-17 11:04:50 +03:00
Ilya Lavrenov
0df7dab345 New IRC package structure (#6255)
* OV new package structure

* Fixes

* More fixes

* Fixed code style in ngraph tests

* Fixes

* Paths to setupvars inside demo scripts

* Fixed demo_security_barrier_camera.sh

* Added setupvars.sh to old location as well

* Fixed path

* Fixed MO install path in .co

* Fixed install of public headers

* Fixed frontends installation

* Updated DM config files

* Keep opencv in the root

* Improvements

* Fixes for demo scripts

* Added path to TBB

* Fix for MO unit-tests

* Fixed tests on Windows

* Reverted arch

* Removed arch

* Reverted arch back: second attemp

* System type

* Fix for Windows

* Resolve merge conflicts

* Fixed path

* Path for Windows

* Added debug for Windows

* Added requirements_dev.txt to install

* Fixed wheel's setup.py

* Fixed lin build

* Fixes after merge

* Fix 2

* Fixes

* Frontends path

* Fixed deployment manager

* Fixed Windows

* Added cldnn unit tests installation

* Install samples

* Fix samples

* Fix path for samples

* Proper path

* Try to fix MO hardcodes

* samples binary location

* MO print

* Added install for libopencv_c_wrapper.so

* Added library destination

* Fixed install rule for samples

* Updated demo scripts readme.md

* Samples

* Keep source permissions for Python samples

* Fixed python

* Updated path to fast run scripts

* Fixed C samples tests

* Removed debug output

* Small fixes

* Try to unify prefix
2021-09-15 16:49:11 +03:00
Anastasiya Koryachikhina
021639a044 Remove optimization for sea_itt_lib (#7463) 2021-09-11 16:34:56 +03:00
Ilya Churaev
5d68e890aa Removed incorrect link from cnpy readme (#7405) 2021-09-08 11:13:53 +03:00
Michał Karzyński
059870a3a0 Update ONNX to version 1.10 (#7186) 2021-08-25 11:37:44 +02:00
Ilya Sharikov
1dfc2369b7 Renamed component name (#7110) 2021-08-18 09:48:38 +03:00
Ilya Sharikov
85b85cf259 Added install for sea_itt_lib (#7039)
* Added install for sea_itt_lib

* Updated install
2021-08-17 06:42:01 +03:00
Mateusz Tabaka
3186d4ed6e Merge onnx_importer to onnx_ngraph_frontend (#6825)
* Merge onnx_importer to onnx_ngraph_frontend

* address review comments

* use onnx_ngraph_frontend in docs/template_extension

* link onnx_ngraph_frontend instead of onnx_importer

* switch onnxruntime branch to rel-1.8.1_ov_2022.1 in https://github.com/intel/onnxruntime

* Remove pip install cmake since the 1.8.1 release doesnt require it

* add alias

* set IMPORTED_GLOBAL

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-08-11 19:01:27 +03:00
Daria Ilina
5292de5338 Reorganize work with openvino/thirdparty (Copied from PR6744) (#6880)
* Copied PR6744

* Added CMakeLists.txt into gflags

* Return gflags into .gitmodules

* Added CMakeLists.txt into gtest

* fix: remove extra gflags and gtests from .gitmodules

* Change syntax in set gtest_targets

* Make gtest/CMakeLists.txt as in PR6744 for pre-commit experiment

* Update gtest/CMakeLists.txt

* Change version of gtest repo

* Return gtest info into .gitmodules

* Update gflags version to currently used
2021-08-11 11:33:52 +03:00
Ilya Churaev
16056de08e Update itt collector style (#7001)
* Updated ITT collector style

* Applied code style
2021-08-10 19:51:20 +03:00
Ilya Churaev
40a5ce21aa Use original onnx (#6673)
* Merged ONNX editor and ONNX importer to the one folder

* Try to migrate to original ONNX

* Remove ONNX_BUILD_SHARED_LIBS

* Update ONNX
2021-08-04 07:43:13 +03:00
Ilya Lavrenov
eabec388e2 Enabled LTO for ONNX FE (#6878)
* Fixed Windows public precommit

* ONNX LTO
2021-08-02 13:48:33 +03:00
Ilya Lavrenov
c38f08b777 Use protobuf-lite for ONNX FE by default (#6829) 2021-07-31 17:21:35 +03:00
Ilya Lavrenov
518ec79cb0 Updated samples compile options (#6818)
* Don't warn about obsolete cmake usage

* Removed build flags for samples

* Fixed ngraph with -Wpedantic

* cmake for 3rdparty
2021-07-30 13:54:09 +03:00
Ilya Lavrenov
37c619b0b8 Fixed compilation with Intel compiler (#6788)
* Fixed compilation with Intel compiler

* Fixed template containers for VPU

* Fixe one-dnn

* Updated submodule
2021-07-26 12:42:05 +03:00
Andrey Somsikov
feb1eaef05 Fix file handle leak in cnpy (#6380)
* Fix file handle leak in cnpy


Co-authored-by: Roman Donchenko <roman.donchenko@intel.com>
2021-07-26 11:54:39 +03:00
Ilya Lavrenov
df264e682a Protobuf lite (#6758)
* Compilation with protobuf-lite for PDPD FE
2021-07-22 19:13:43 +03:00
Ilya Lavrenov
21e678eb78 Fixed ngraph unit-test compilation with protobuf-lite (#6734) 2021-07-22 11:56:40 +03:00
Ilya Lavrenov
ecb5499702 Fixed build with protobuf-lite (#6730) 2021-07-21 13:56:55 +03:00
Ilya Lavrenov
7d85d61083 Fix for cmake 3.21.x (#6722)
* Fix for cmake 3.21.x

* Removed a lot -Wno-* compile options
2021-07-21 11:55:41 +03:00
Ilya Lavrenov
1a446b49a2 Fixed usage of system protobuf (#6716) 2021-07-20 18:13:22 +03:00
Ilya Lavrenov
bc36425381 Added suggest-override flag (#6631) 2021-07-16 18:55:05 +03:00
Ilya Lavrenov
1621c66ad8 Static protobuf for FEs (#6588)
* protobuf static + mixed editor and importer

* merged onnx common

* remove ngraph_test_util to onnx_importer and onnx

* styles applied

* Revert "remove ngraph_test_util to onnx_importer and onnx".

* test ngraph_test_util dependencies

* Fixed static protobuf

* Next

* Fixes

* Fixed cross-compilation

* Don't export / install onnx_proto

* Fixed Windows

* Fixed opencl headers

* Fix

* Added exclude-all for exe as well

* Fixed code style

* Try without LTO

* LTO off only for onnx importer

Co-authored-by: mbencer <mateusz.bencer@intel.com>
2021-07-16 07:25:40 +03:00