Commit Graph

159 Commits

Author SHA1 Message Date
Georgiy Manuilov
e6e901bdcf Add several missing <cctype> header entries (#12632) 2022-08-19 11:01:23 +04:00
Ilya Churaev
8a027f4e42 Replaced DLDT to OpenVINO (#12580)
* Replaced DLDT to OpenVINO

* Fixed samples build dir

* Fixed build folders
2022-08-17 12:46:07 +04:00
Nadezhda Ageeva
3e14988895 Extend inputs/outputs info with shape in BA printout (#12453) 2022-08-16 12:21:54 +04:00
Vladimir Paramuzov
03b7c1e69e [GPU] Support hint::inference_precision (#12526) 2022-08-15 16:34:36 +04:00
River Li
cbbac125f8 [C API] Refine OV 2.0 C APIs for better expansibility and compatibility (#12187)
* [C API 2.0]Redifine partial shape and property wrapper

1. Use dimension object to initialize partial_shape rather than string
2. Use void* to unify property value rather than union
3. rename some C api name to strict align with C++ method.

Change-Id: I64b5c521461264dba2d23543808584632fbd6d4b

* [C API 2.0]Memory check and implement all reshape interface

1. Memory safe create and free
2. Implement all reshape interface align with C++ interface
3. rename some api to align with C++ interface

Change-Id: Ib5e4192bdbd8a11cdd7e30b1dc84881ba3f2d505

* Rename prepostprocess to strict align with C++ name

Change-Id: I7a4d0a6e835b2d6ed01cd218ac81b1b621f600bf

* [C API 2.0]redefine ov_node and ov_model interface

1. redefine ov_node and ov_model interface
2. rename some api to aligne with C++ interface
3. remove some redundant code
4. align CMakeLists.txt with OpenVINO 2.0 convention

Change-Id: I4d5e92157e7891319c9754da8e70b9c6150ae2e3

* Redefine ov_layout to support more than one char

Change-Id: I39e5389246cf3edcc2f4734d13157457773d89b8

* Add interface to get partial_shape from node

Change-Id: I8cef77db581b43d2f0a9ac48cfdc09a86e39b694

* Use unique_ptr prevent memory leaks in case of exception

Change-Id: I150b375108a3eded400bdde087ab5c858958c25f

* Put legacy C API and 2.0 C API into a library

Change-Id: I067a55a00e78b80cdede5ae7adad316ee98cabd1

* Only keep OV 2.0 C sample and move legacy C sample to legacy directory

1. Move legacy C samples to tools/legacy/c directory
2. Keep OV 2.0 C samples in samples/c directory

Change-Id: I05880d17ee7cb7eafc6853ebb5394f3969258592

* Fix format and log issues

Change-Id: I05d909b3d7046d41b807e35808a993bb09672e68

* Restore documents update

Change-Id: I82dd92081c0aa1a2d7dca7f114cf6a35131d6f92

* Change config map data be const

Change-Id: I9043859e8308c01d80794dc8280ae236947f3bbb

* Update api document

Change-Id: I35bc149bad0de17424d95f48c3027030b708e147

* Add clang enable

Change-Id: I335639c05fb5fb38e682dbb72bfaf78380c0adaf

* Fix clang issue after enable clang for ie_c_api.c

Change-Id: Idcb4dda9d66e47a169eb79a9c4fe7a7d4df838db

* split header file and c file into multiple files

Change-Id: I7c3398966809ef70d7fcb799f2d612a33b471e31

* Fix clang format issue

Change-Id: Ibd18b45537c8f3bcbb5b995c90ae28999161d54d

* Add single ov_dimension_create method

Change-Id: Icd06b50e4f4df8f7897c7c4327edb67178162544

* Remove all legacy c samples completely

Change-Id: I098360a0d9002340e8769074181f7997b43bce8f

* Update ov_property_value to replace only ptr

Change-Id: I9f5a11b4cf07e759c1998e78e2624f0a1266d9b0

* Split more header files, add static dimension api

Change-Id: I14e4fb8585fc629480c06b86bd8219e75a9682f7

* Change ov_dimensions_create to be ov_dimensions_create_dynamic

Change-Id: I50c02749cea96f12bcea702b53a89c65b289550e

* rename status and get_out_tensor

Change-Id: I762c1d0c5a069454506fe3c04283c63ddbfacf31

* Split ov_c_api_test.cpp

* Split OV2.0 CAPI tests

* move var into Setup

* Merge legacy and 2.0 C API test

* Merge InferenceEngineCAPITests into openvino_capi_test

1. put InferenceEngineCAPITests into openvino_capi_test
2. resolve some format issues

Change-Id: I47bbba6bd70a871ee063becbd80eb57919fa9fb0

* legacy api test skips clang format

Change-Id: Id54ecdba827cf98c99b92295c0a0772123098b63

* Fix clang format issue

Change-Id: I7ed510d8178971fe04a895e812c261db99d8b9f2

* Restore InferenceEngineCAPITests

Change-Id: I4d641ffb1de9ce4d20ebecf35fc036fa7bd73e55

* rename openvino_capi_test to ov_capi_test

Change-Id: I6b6fe0cdb89aab7210abb17f32dbfdcdce72ba25

* unify list size name and refine ov_core_version_t

Change-Id: I137fc6d990c7b07f597ee94fa3b98d07ae843cb6

* align header file path to be openvino/c/openvino.h

Change-Id: I1a4552e1d558098af704942fe45488b0d6d53a90

* Fix path issue

Change-Id: I84d425d25e3b08c1516cbcc842fb9cb75574bf17

* move ov_color_format and remove opencv depenency

Change-Id: I486145f9e92e8bbf2e937d3572334aa9f0e68841

* Resolve some memory allocation error handling issues and read model with empty weight issue

Change-Id: Icd8e3b6de9741147993fa215a0c7cfd7debd5500

* Add GPU test cases

Change-Id: I13324ef019b5b1af79259ca932a36a0cec792c27

* Fix clang issue

Change-Id: I9bb4c47de301d142b5e2a77a39f667689ad9fe38

* Resolve CI test failure

Change-Id: Ia327d5edab19d8dd44ac369670f190d5c57aca79

* Redefine ov_shape and add default ov_core_create

Change-Id: I3e47d607f8aad65cb99cdddacaecf7bf34b1361b

* Remove some unnecessary api of node

Remove the unnecessary node api:
     ov_node_get_any_name(ov_output_const_node_t* node, char** tensor_name)
     ov_node_get_element_type(ov_output_const_node_t* node, ov_element_type_e* tensor_type)

Change-Id: I80a3243676800263a9e56afa3cfffce7b4bd2ae7

* Rename reshape api

ov_model_reshape should be common case which allow to reshape any models with different number of input.

Change-Id: I26bafeeb8a3dda7cd5164cda15fdb338db8668cb

* Rename ov_node api

Change-Id: I03114ecb6de5c46b6d02c909b6f6fb6c8bfd5cba

* Remove subfolder out of source code

Change-Id: Ib033ae7712cc0460d6fc21a0f89818381ae503c0

* apply absolute path for all header files

Change-Id: I8024c897d424b407025e21460ed4b62829b853d2

* Fix CI issue ov_capi_test failed to find libgna

Change-Id: I166e79a818498c6721fe956f43873f36d9ae1e07

* Resolve build issue to align with PR12214

Change-Id: I9e6094db213b431ee1b46e0d64199131db33bb36

Co-authored-by: ruiqi <ruiqi.yang@intel.com>
2022-08-14 19:51:34 +04:00
Ilya Lavrenov
af05733a3a Failed plugins search from current directory w/o LD_LIBRARY_PATH (#12499) 2022-08-12 12:10:03 +04:00
Ilya Lavrenov
e0b12009ea Removed old headers from OV 2.0 API (#12214)
* Removed old headers from OV 2.0 API

* FIxed clang

* Fixed warning

* Updated OMZ submodule

* Fixed gpu tests build
2022-08-12 11:35:36 +04:00
Ilya Lavrenov
6ca47b074d Library versions & made tests relocatable (#12416)
* Fixes for cases when TBB_DIR env var is set

* Don't use make in build_samples.sh script

* First version of Windows installer

* WIndows NSIS installer

* Improved version of debian packages

* Improvements

* Improvements

* Debian packages now look good

* Library versioning

* Fixed tests to run against debian packages

* Fixed frontend tests

* Fixed code style

* FIxed Windows

* Fixed python tests

* Fixed paths in tests

* fdvfdv

* Fixes

* USe versioning only for debian packages

* Relocatable tests

* Fixed

* Fixed all tests

* Fixed clang-format

* Fixed more tests

* Fixed some tests

* Absolute paths in .ci

* Fixes

* Added support of OpenCV 3.4

* Trying to fix gnaUnitTests
2022-08-08 13:59:24 +04:00
Ilya Lavrenov
14e8e3259d Fixed build_samples.sh not to call setupvars.sh for Debian package case (#12309) 2022-07-26 23:17:41 +04:00
Sebastian Golebiewski
6227123d21 Porting to master - update -readme for CPP and Python benchmark (#12245)
Porting #11961
2022-07-26 14:12:08 +02:00
Ilya Lavrenov
36df7f51ae Fixes for cases when TBB_DIR env var is set (#12266)
* Fixes for cases when TBB_DIR env var is set

* Don't use make in build_samples.sh script
2022-07-24 15:13:00 +04:00
Chenhu Wang
43b3fff708 [DOC][CPU] Denormals optimization doc (#12127) 2022-07-20 04:35:45 +03:00
Xiping Yan
6966af3ced Xp/benchmark app ocl (#12112)
* Add some tip description about enable OpenCL for benchmark_app.

Signed-off-by: xipingya <xiping.yan@intel.com>

* Export doesn't work, we need to add -Dopencl_root_hints=[PATH]/OpenCL-CLHPP/include to cmake command.

Signed-off-by: xipingya <xiping.yan@intel.com>

Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-07-19 14:43:59 +08:00
Luo Cheng
23b1b76457 [CPU] revert pr 11990 and enable brgconv avx512 on SPR by default (#12105) 2022-07-14 14:11:21 +04:00
Szymon Irzabek
ed812bdf68 [GNA] Reduce impact of sf propagation fix (#12115) 2022-07-13 11:59:44 +02:00
Marcin Kusmierski
3efda5067b [SAMPLES] Remove unused commandline arguments for speech_sample (#11892) 2022-07-11 12:23:32 +02:00
Chenhu Wang
8c152405ad [CPU] General denormals optimization (#11883)
* FTZ_and_DAZ_set_for_cpu

* remove DAZ

* fix

* extract to utils

* ie core part changes to add do as property and benchmark_app enable do

* enable brgcov from Luocheng patch

* add debug info

* enable_brgemm_on_avx512

* add python binding

* dlb test

* FTZ_and_DAZ_set_for_cpu

* remove DAZ

* fix

* extract to utils

* ie core part changes to add do as property and benchmark_app enable do

* enable brgcov from Luocheng patch

* add debug info

* enable_brgemm_on_avx512

* add python binding

* dlb test

* revert test code

* revert test code
2022-07-05 15:50:16 +08:00
Luo Cheng
35ee842446 [CPU] [WA] Use config to enable brgconv f32 kernel (#11990)
* enable brgconv f32

* use config to enable brgconv f32

* when brg disabled not init bin-postops

* change prop name for extensive

* use more general field

* fix review comments.
2022-07-05 07:14:40 +08:00
Tomasz Dołbniak
5a5c404f13 Hello reshape SSD sample fix (#12004) 2022-06-30 13:35:14 +03:00
Krzysztof Bruniecki
d25b8466f6 [GNA] Fix and extend removed logging capabilities (#11880)
* [GNA] Fix and extend warning and debug log levels using speech_sample

* [GNA] Cleanup and apply const correctness

* Apply review
2022-06-21 09:57:44 +02:00
Bartek Szmelczynski
6033e52dd9 Remove set_from from samples, update docstrings (#11889) 2022-06-15 12:10:00 +02:00
River Li
8faf8f2d89 OV 2.0 C API (#11700)
* Initial files & cmakefiles for ov 2.0 c api development

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add all ov 2.0 C APIs define

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix review comments

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Disable test of OV 2.0 C APIs test for tmp

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add related property key for ov 2.0 C-API

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add description for ov_property_key_e

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add EXECEPTION handling

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* compiledModel add interface

* add inferrequest interface

* solve cpplint problem

* Finished OV 2.0 C-APIs PPP related development

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix code review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add ov::tensor API

* add compiled model func

* Finished C-API funs about core, model, node development

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C-API] add const to ov_output_node

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C-API] Using define GET_OV_ELEMENT_TYPE & GET_CAPI_ELEMENT_TYPE in tensor APIs

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C-API] add string initialize

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* add inferrequest func

* add move construction to runtime_model

* supplement two infer request interface functions

* [OV 2.0 C-API] Add the common framwork of unit test

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* modify ov_infer_request_get_profiling_info

* add tests dir

* restore CMakeLists.txt

* Fix the bug of COPY in Tensor

* [OV 2.0 C API] Finished core related function unite test

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add ov:Tensor API test

* [OV 2.0 C API] fix some review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* add some infer request test

* add compiled model test

* [OV 2.0 C API] Finished preprocess related function unite test

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C API] Fix review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C API] Modify to use default model

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* transfer device_name from fix value to parameter

* add some infer request test

* remove compiled model get_property test

* add infer request tests

* Add ov::model Test and modify Tensor Test name

* Determine whether partial shape meets the standard

* Add get tensor name function and Modify reshape test case

* modify fixed tensor name,remove unnecessary comparison

* add ov_model_get_nodes_info, modify according to comments

* Update reshape test

* extract common function, modify interface about get tensor name,shape and type

* modify according comments

* [OV 2.0 C API] Finished hello classification with ov 2.0 c-api development

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C API] Fixed hello classification with ov 2.0 c-api review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C API] delete inactive code hello classification with ov 2.0 c-api

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix clang format issue

* [OV 2.0 C API] rename

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix windows build erre

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Apply qsort for sorting data

Apply qsort for sarting data
Fix issues of "potentially uninitialized local pointer variable"

* Not use deprecated INSTANTIATE_TEST_CASE_P for c api gtest

INSTANTIATE_TEST_CASE_P is deprecated, should use INSTANTIATE_TEST_SUITE_P.

* Fix some review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Ov 2.0 C API] Add error info

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix some review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* polish error message for ov c api

* Redefined ov_shape_t, ov_partial_shape_t and ov_layout_t. Modified functions and test cases involving these variables

* Added the conversion between char* and partial_shape

* Add partial_shape_to_shape

* prune code

* modify split

* Use regex to split and search pattern

* Modify str_to_char_array delete

* Add the judgment of rank

* Fix compiling error

Fix issue: address of array 'shape.dims' will always evaluate to 'true'  if -Wpointer-bool-conversion

Co-authored-by: xuejun <Xuejun.Zhai@intel.com>
Co-authored-by: sunxiaoxia2022 <xiaoxia.sun@intel.com>
Co-authored-by: ruiqi <ruiqi.yang@intel.com>
2022-06-09 10:39:07 +08:00
Luo Cheng
bb3868d8cd [CPU] OneDNN 2.6 migration (#11627)
* Migrate on OneDNN 2.7

* [CPU] Enabled brconv implementation

* Post ops optimizations

* [CPU] Enabled I8 precision on activations for Convolution node

* [CPU][WA] Disabled Deconvolution + post ops fusing optimization

* Fixed FQ post op optimization

* [CPU] Optimize post ops processing

* [WA] Add node name if tensor names are empty

* [WA] remove  layout compatibility chheck that leads to the fase-positive exceptions

* [CPU] Optimize processing for FQ + Sum + FQ post ops pattern

* [CPU][WA] Enabled ReduceSum -> AvgPool transformation due to perf issues

* fix compiler error

* rebase onednn master

* cherry pick from 2.7 to 2.6

* [WA] make cpu case to run completed

* fix xmm zero check

* reopen 'FuseDeconvolutionAndSimpleOperation' Transform  to fix CPU 'ConvolutionBackpropDataLayerTest' fail issue

* [WR] Removed failed the ReduceMean tests caused by 21f3555.

* group deconv may crash on memory out of bound

* [WA] Remove the moc fail case by #af4731a1

* testcase conv maxpool will check brgconv instead of jit

* test subgraph added nhwc format check

* fix gemm bf16 win crash

* fix avx2 groupconv accuracy problem

* [WA] remove invalid FQ tests

* WR to disable the LPT multiplyToGroupConv test because the  transformation was disabled in d5e16f

* add gemm int8 binary postops to fix GroupConvolutionQDqTransformation fail

* add gemm int8 binary postops to fix GroupConvolutionQDqTransformation fail

* fix gemm bf16 fail

* Fix ConcatConvSumInPlaceTest

* Add cpuDebugFuncTests target

* [WA] bf16 crash due to MemoryInput/Output

* OVClassBasicTest case typo

* testcase subgraph sets default ENFORCE_BF16 to NO

* fix clang check

* Fix primType check issue

* Fix cpplint error

* MemoryInput/Output support bf16; Enforce bf16 'NO' should enable snipptes

* disable BF16 fusing fakequant testcase

* testcase init support amx check

* testcase for conv brgconv avx512/amx

* testcase for conv brgconv avx512/amx

* WR enforce reorder bug and add NSPC into deconv supported list.

* Compiling issue fix.

* [WA] skip fakequantize fusing in bf16

* mix legacy/new binary postops

* make nightly case run. tested on amx/avx512/avx2.

* [CPU] Add BF16 AMX test for Matmul

* Add CPU dump check tool

* Add verbose log

* Generate exec graph in cpu dump check tool

* fix binary prelu post Ops

* fix cpplint

* Update ONEDNN version to fix AVX2 bug.

* cpu dump check supports compare dump files

* Add a new CPU_DEBUG_CAPS: OV_CPU_SUMMARY_PERF

* change VERBOSE_LOG to DEBUG_LOG

* fix oneDNN register_jit_code log

* fix cpplint

* Add OV_CPU_DEBUG_LOG controls debug logs to show

* Revert reorder WR.

* Enhanced CPU debug logs and breakpoint support

* Enhanced cpu_dump_check with --ports

* Fix DEBUG_LOG compile issue

* GroupDeconvolutionLayerCPUTest extend to add amx test cases

* Add Node into DBUEG_LOG

* cpu_dump_check: Dump results even no port is specified

* FIx MergeTransposeAndReorder for blocked input

* Fix cpu_dump_check result names

* Enhance DEBUG_LOG on edges

* Cpu dump check support shape mismatch

* Fix bi-directionl inplace

* Cpu dump check support inference_precion_hing f32.

* fix windows dump fail.

* fix depthwise nwc conv

* add rtol arg

* win debugbreak

* fix pooling accuracy

* GroupDeconvolutionLayerCPUTest remove invalid test param for nspc

* recover ov onednn fork

* revert af4731a1f1 '[WA] remove layout compatibility chheck'

* [WA] disable avx2 conv3d fusing case

* [WA] disable avx2 conv3d fusing case

* [WA] Disabled weights md transpose in FC to prevent perf degradations

Co-authored-by: dmitrygo <dmitry.gorokhov@intel.com>
Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
Co-authored-by: Zhang Yi3 <yi3.zhang@intel.com>
Co-authored-by: liubo-intel <bo4.liu@intel.com>
Co-authored-by: Luwei Zhou <luwei.zhou@intel.com>
Co-authored-by: Li, Tingqian <tingqian.li@intel.com>
Co-authored-by: xuchen-intel <chen.xu@intel.com>
Co-authored-by: ceciliapeng2011 <cecilia.peng@intel.com>
2022-06-06 18:30:32 +08:00
guozhong wang
0a65f5f607 selectdevice returns MULTI:device in cumulative_throughput (#11367)
* selectdevice returns MULTI:device in cumulative_throughput

* load multi with throughput and disable cpu helper in cumulative

* disable cpu helper in cumulative_throughput

* add cumulative to bechmark_app help message

* modify benchmark_app.hpp clang-format
2022-05-06 12:42:59 +08:00
Ilya Lavrenov
c2703c81f6 Don't install nlohmann_json_schema_validator for samples (#11446)
* Try to improve gflags

* Try to improve gflags: part 2

* Tried to use dependencies on system

* Use nlohmann_jsonConfig from system

* Enabled nlohmann_json from system

* Improvements

* handle system gflags in developer package

* Simplifications

* Simplify dependency management

* Corrected package names

* Fixed subgraphsDumper configure stage

* Try to fix rhel8

* Try to fix macosx

* Fixed VPUX build

* Fixed aliasing issues

* Suppress some wanrings

* export gflags when build it

* Fixed some LTO

* Try to fix Mac

* revert

* use gflags as private dependency

* Aligned targets in developer package

* Fixed frontends tests build on U20 with LTO

* PAssed

* Don't use pkg_search_module(zlib ..) during cross-compilation

* Removed unused variables

* Fixed finding of zlib during cross-compilation

* CVS-83529

* Use nothreads_static

* Fixed python
2022-04-05 19:16:32 +00:00
Maxim Gordeev
9c8a6aacb7 [IE Samples] Activating new parameter is compact mode(memory_reuse) in speech sample (#11405)
* [IE Samples] Activating new parameter is compact mode(memory_reuse) in speech sample

* changed format

* renamed the option to memory_reuse

* renamed the option
2022-04-05 11:31:05 +03:00
Ilya Lavrenov
4ad20fb53f Use system dependencies (#11419)
* Try to improve gflags

* Try to improve gflags: part 2

* Tried to use dependencies on system

* Use nlohmann_jsonConfig from system

* Enabled nlohmann_json from system

* Improvements

* handle system gflags in developer package

* Simplifications

* Simplify dependency management

* Corrected package names

* Fixed subgraphsDumper configure stage

* Try to fix rhel8

* Try to fix macosx

* Fixed VPUX build

* Fixed aliasing issues

* Suppress some wanrings

* export gflags when build it

* Fixed some LTO

* Try to fix Mac

* revert

* use gflags as private dependency

* Aligned targets in developer package

* Fixed frontends tests build on U20 with LTO

* PAssed

* Don't use pkg_search_module(zlib ..) during cross-compilation

* Removed unused variables

* Fixed finding of zlib during cross-compilation
2022-04-05 04:47:22 +03:00
Ilya Lavrenov
90366c2c60 Fixed detection of sample type c / cpp (#11444) 2022-04-05 01:57:10 +03:00
Fedor Zharinov
787610b0db -l option is replaced with -extensions (#10878) 2022-04-04 16:08:38 +03:00
Ilya Lavrenov
3c724a1dee Build with system TBB (#11244)
* Build with system TBB

* Fixes

* Check whether system TBB is available

* Try to fix ONNX Runtime build with system TBB

* Test

* Fixed compilation of threading.cpp

* Fixed unset of cache dirs

* Limit dearch paths of TBB

* Try to enable pip packages with custom TBB

* Fix for TBB 2021.2

* Install only needed TBB libraries

* Install TBB from system to pip package

* Reverted usage of TBBROOT

* Fixed oneTBB case

* Try to fix Android

* Escape some paths

* Added samples path

* Fixed TBBBind usage for case of system TBB
2022-03-31 18:05:59 +03:00
Ilya Lavrenov
c795382b1f Configurable OpenCL usage in BA (#11344) 2022-03-31 10:49:40 +03:00
Maxim Gordeev
fad66d8442 [IE Samples] New command line parameters format for speech sample (#11051)
* New command line parameters format for speech sample

* fixed notes

* changed format for scale factor

* changed format for scale factor in tests

* added more variants, when name is directy specified for i/o/r like it is done for sf

* removed nthreads flag

* fixed notes

* changed output params

* updated tests with new format

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2022-03-31 10:09:31 +03:00
Ilya Lavrenov
19d0e5ba52 CMAKE: IE_VERSION => OpenVINO_VERSION (#11242)
* IE_VERSION => OpenVINO_VERSION

* Reverted installation of python unconditionally
2022-03-28 19:32:21 +03:00
Ilya Lavrenov
a883dc0b85 DOCS: ported changes from 2022.1 release branch (#11206)
* Extensibility guide with FE extensions and remove OV_FRAMEWORK_MAP from docs

* Rework of Extensibility Intro, adopted examples to missing OPENVINO_FRAMEWORK_MAP

* Removed OPENVINO_FRAMEWORK_MAP reference

* Frontend extension detailed documentation

* Fixed distributed snippets

* Fixed snippet inclusion in FE extension document and chapter headers

* Fixed wrong name in a snippet reference

* Fixed test for template extension due to changed number of loaded extensions

* Update docs/Extensibility_UG/frontend_extensions.md

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>

* Minor fixes in extension snippets

* Small grammar fix

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>

* DOCS: transition banner (#10973)

* transition banner

* minor fix

* update transition banner

* updates

* update custom.js

* updates

* updates

* Documentation fixes (#11044)

* Benchmark app usage

* Fixed link to the devices

* More fixes

* Update docs/OV_Runtime_UG/multi_device.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Removed several hardcoded links

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Updated documentation for compile_tool (#11049)

* Added deployment guide (#11060)

* Added deployment guide

* Added local distribution

* Updates

* Fixed more indentations

* Removed obsolete code snippets (#11061)

* Removed obsolete code snippets

* NCC style

* Fixed NCC for BA

* Add a troubleshooting issue for PRC installation (#11074)

* updates

* adding gna to linux

* add missing reference

* update

* Update docs/install_guides/installing-model-dev-tools.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Update docs/install_guides/installing-model-dev-tools.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Update docs/install_guides/installing-model-dev-tools.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Update docs/install_guides/installing-model-dev-tools.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Update docs/install_guides/installing-model-dev-tools.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* update

* minor updates

* add gna item to yum and apt

* add gna to get started page

* update reference formatting

* merge commit

* add a troubleshooting issue

* update

* update

* fix CVS-71846

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* DOCS: fixed hardcoded links  (#11100)

* Fixes

* Use links

* applying reviewers comments to the Opt Guide (#11093)

* applying reviewrs comments

* fixed refs, more structuring (bold, bullets, etc)

* refactoring tput/latency sections

* next iteration (mostly latency), also brushed the auto-batching and other sections

* updates sync/async images

* common opts brushed

* WIP tput redesigned

* minor brushing of common and auto-batching

* Tput fully refactored

* fixed doc name in the link

* moved int8 perf counters to the right section

* fixed links

* fixed broken quotes

* fixed more links

* add ref to the internals to the TOC

* Added a note on the batch size

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* [80085] New images for docs (#11114)

* change doc structure

* fix manager tools

* fix manager tools 3 step

* fix manager tools 3 step

* new img

* new img for OV Runtime

* fix steps

* steps

* fix intendents

* change list

* fix space

* fix space

* code snippets fix

* change display

* Benchmarks 2022 1 (#11130)

* Minor fixes

* Updates for 2022.1

* Edits according to the review

* Edits according to review comments

* Edits according to review comments

* Edits according to review comments

* Fixed table

* Edits according to review comments

* Removed config for Intel® Core™ i7-11850HE

* Removed forward-tacotron-duration-prediction-241 graph

* Added resnet-18-pytorch

* Add info about Docker images in Deployment guide (#11136)

* Renamed user guides (#11137)

* fix screenshot (#11140)

* More conservative recommendations on dynamic shapes usage in docs (#11161)

* More conservative recommendations about using dynamic shapes

* Duplicated statement from C++ part to Python part of reshape doc (no semantical changes)

* Update ShapeInference.md (#11168)

* Benchmarks 2022 1 updates (#11180)

* Updated graphs

* Quick fix for TODO in Dynamic Shapes article

* Anchor link fixes

* Fixed DM config (#11199)

* DOCS: doxy sphinxtabs (#11027)

* initial implementation of doxy sphinxtabs

* fixes

* fixes

* fixes

* fixes

* fixes

* WA for ignored visibility attribute

* Fixes

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>
Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Ilya Naumov <ilya.naumov@intel.com>
Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2022-03-24 22:27:29 +03:00
Vladimir Dudnik
3a8800cbd2 [Docs][IE Samples] fix hard links (#11144)
* fix hard links

* change encoding

* fix TM

Co-authored-by: CCR\ntyukaev <nikolay.tyukaev@intel.com>
2022-03-23 23:48:08 +03:00
Fedor Zharinov
fe3270c232 [benchmark_app]Exception handling in callback (#11123)
* Exception handling in callback

* stylefix
2022-03-23 16:55:41 +03:00
Fedor Zharinov
1315cfaa64 Add CHW/HWC heuristics for tensors with 3 dimensions (#10817) 2022-03-23 16:54:56 +03:00
Alexey Lebedev
3de9189d50 [core][python] ov::serialize (#10945)
* add ov::serialize

* create python binding

* update python tools

* use ov::serialize in benchmark app

* remove serialize from python offline_transformations

* fix import

* revert pot

* update docs

* apply review comments

* add const

* make bin path optional

* Add docs

* add compare test
2022-03-23 11:44:00 +03:00
Egor Duplensky
090799a362 [Samples] Fix cpp benchmark_app help message (#11055) 2022-03-22 22:51:05 +03:00
Sergey Lyubimtsev
dacdf67c2c Update Benchmark guides (#11076) (#11085)
* - Update Benchmark Tool usage message
- Remove not existed paths
- Fix examples
* remove reference on FPGA

(cherry picked from commit 3caa77eb30)

# Conflicts:
#	samples/cpp/benchmark_app/README.md
2022-03-21 19:31:17 +03:00
Maxim Gordeev
3ac6e95ead [IE Samples] Fixed hanging of samples if InferImpl() throws exception (#11075)
* [IE Samples] Fixed hanging of samples if InferImpl() throws exception

* improved re-throw an exception
2022-03-21 19:30:30 +03:00
Fedor Zharinov
0b444ab2db [benchmark_app]Show network original I/O info (#10694)
* Show network original I/O info

* additional no-name case check

* stylefix

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
2022-03-21 13:57:56 +03:00
Vladislav Volkov
ed8c9d6f9a CPU Plugin refactoring: class names (#10639) 2022-03-16 17:16:29 +03:00
Vitaliy Urusovskij
2dbd60c1ae Mark get_type_info_static() op class methods as hidden (#10691)
* Mark `get_type_info_static()` as hidden

Each plugin linked with openvino library contains `type_info_static` symbols. In case when one of the libraries is unloaded and app tries to get opset, it leads to segfault. So mark `get_type_info_static()` as hidden to use only one implementation exactly from openvino lib

* Fix "'visibility' attribute ignored" issue by moving `TestPass` out of test scope

* Fix clang format

* Small update of `If` op

* Revert "fix 79520 (#10449)" to correctly compare DiscreteTypeInfo via `==`

This reverts commit 29883a152a.
2022-03-15 14:59:13 +03:00
Mikhail Nosov
72fe6082ea [Preprocess] InputTensorInfo::set_from implementation (#10839)
* InputTensorInfo::from implementation

If user's application already has `ov::runtime::Tensor` object created,
it will be possible to reuse basic characteristics for input (shape, precision) from tensor using InputTensorInfo::from method

* Rename 'from' to 'set_from' as  in Python 'from' keyword is used for import modules
Python bindings: from ov.Tensor and from numpy array

* Style fix (quotes)

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Fix code style

* Use set_from in hello_classification CPP sample

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-03-14 18:02:51 +03:00
Serhii Pavlovskyi
948347f3dd ncc build fixes (#10367)
* fix .ncc_style target names

it was breaking configure on system with libclang-12-dev, clang-12,
ninja and cmake 3.17+(ninja complains about duplicate
target). with lower cmake version configure succeeds, but build exits
immediately with error. by replacing ninja with make error becomes
warning(it's still significant, make just skips duplicate rules, i.e.
doesn't check style of some source files, rule duplication is genuine
bug). without libclang-12-dev and clang-12 ENABLE_NCC_STYLE is OFF and
bug is not triggered

* silence uninitialized warning in core_integration

probably it was always initialized before use, but compiler wasn't made
aware of it

* fix function spelling to unbreak code style checks in benchmark_app

* include <thread> for std::this_thread

existing code was relying on namespace pollution by old libstdc++

* replace is_pod with is_standard_layout && is_trivial

is_pod is deprecated, it breaks build on current gcc

Co-authored-by: Serhii Pavlovskyi <spavlovskyi@lohika.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2022-03-09 13:42:06 +03:00
Dmitry Pigasin
c28cebb2a6 [CPP Speech Sample] Fix result saving when batch size is not 1 (#10714)
* Fix result saving when batch size is not 1

* Remove useless if statement

* improved processing scores for model with more than one outputs

* added checking on count of model outputs

* improve if statements

* divide fix for model with several outputs to other PR

Co-authored-by: Maxim Gordeev <maxim.gordeev@intel.com>
2022-03-04 15:41:47 +03:00
Fedor Zharinov
043a773f61 [Benchmark_app]Check all I/O names (#10745)
* Check all I/O names

* stylefix
2022-03-04 09:49:03 +03:00
Maxim Gordeev
f81f819ecd [IE Samples] Improved processing outputs for model with more than one output (#10737)
* Improved processing outputs for model with more than one output

* fixed condition

* added checking count of output/reference files
2022-03-03 16:35:41 +03:00
Ilya Churaev
1fec99afa3 Removed duplicated words (#10754) 2022-03-03 06:50:54 +00:00