Commit Graph

334 Commits

Author SHA1 Message Date
Ilya Lavrenov
a34ef680f2 Made plugins.hpp generation to be CONFIG dependent (#17139) 2023-04-24 14:48:45 +04:00
Mikhail Ryzhov
0f7e6de346 [GNA] WA to fix config parsing of scale factor map (#17060)
* WA to fix config parsing

* clang fix

* excluded json
2023-04-20 10:51:23 +01:00
Ilya Churaev
566ef01a3f Remove constructors for ov Exceptions (#16938)
* Remove constructors for ov Exceptions

* Fixed linux build

* Fixed ONNX Frontend

* Fixed paddle

* Fixed exceptions in tests

* Deprecate constructors for ov::Exception

* Suppress some warnings

* Merge several exceptions

* Some small changes

* Suppress more warnings

* More warnings

* mode warnings

* Suppress more warnings

* More warnings
2023-04-18 21:02:26 +04:00
Shen, Wanglei
3461064507 update benchmark_app to remove setting UNDEFINED with -hint none (#16695)
* Remove setting ov::hint::PerformanceMode::UNDEFINED from benchmark_app

* update benchmark_app

* update python code and description

* update python code

* fix code style issue

* update python code

* update c++ app
2023-04-13 14:29:13 +00:00
Wang, Yang
86d7c97fa9 Update the logic of benchmark app property setting (#16427)
* 1. refine the logic to ov::device::properties setting.
2. the config overrides will be performed if same config setting is came from CMD line.-a

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update configuration sample file within README.md.

* Update.

* Update.

* 1. Update configuration example file within REAMDME.md for Python version.
2. implement the config DEVICE_PROPERTIES value convertation between the string type and dictionary of Python type.
3. Update the configuration file loading and dumping logic.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Update.

* Update.

* Update.

* 1. Enable configs to be interchangeable between C++ and Python.
2. Update perf_count showing logic.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Revert the logic of showing show performance counters.

* Update help msg for loading config option.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2023-04-12 15:32:54 +00:00
Wang Wangwang
c2c2143f45 clean AB property from virtual plugin and core global config (#16877)
* Benchmark_app set ov::hint::allow_auto_batching through compile_model

* Remove the process about allow_auto_batching in set_property of core

* Remove allow_auto_batching and auto_batch_timeout property from AUTO plugin

* Reserve the info logs and add API to check auto_batching

* Update test case, rm AB property test from core config tests

* Update some API in AUTO plugin config
2023-04-12 17:37:57 +04:00
Wang, Yang
3740ba9226 [IE Sample] incorrect nstreams retrieved from plugin (#16849)
* Retrieve the ov::num_streams through compiledModel rather than through plugin.

* Update python version.
2023-04-12 01:06:20 +04:00
Zlobin Vladimir
c7c7c4bb05 samples/cpp remove unused code (#16787) 2023-04-06 20:59:00 +04:00
Maciej Smyk
950b46ecad DOCS shift to rst - Model Creation C++ Sample & Model Creation Python* Sample (#16637) 2023-04-03 08:24:35 +02:00
Maciej Smyk
bb20151c9d DOCS shift to rst - Hello Query Device C++ Sample & Hello Query Device Python* Sample (#16650) 2023-04-03 08:24:02 +02:00
Maciej Smyk
f5dced8e69 DOCS shift to rst - Hello Classification Samples (#16681) 2023-04-03 08:23:44 +02:00
Maciej Smyk
73e75c58ba DOCS shift to rst - Hello NV12 Input Classification C++ Sample & Hello NV12 Input Classification C Sample (#16664) 2023-03-31 09:07:59 +02:00
Maciej Smyk
385bbbd49b DOCS shift to rst - Hello Reshape SSD C++ Sample & Hello Reshape SSD Python* Sample (#16662) 2023-03-31 09:07:30 +02:00
Ilya Lavrenov
ccf9c19f61 Deprecated UNDEFINED values for execution / performance hints (#16563)
* Deprecated UNDEFINED values for execution / performance hints

* Update src/tests/functional/plugin/gpu/shared_tests_instances/behavior/ov_plugin/properties_tests.cpp

* Fixes

* Fixes
2023-03-30 13:48:19 +04:00
Ilya Lavrenov
0250f62d11 Revert inference precision to be a hint (#16634) 2023-03-29 18:59:33 +04:00
Maciej Smyk
7d8f4af78a DOCS shift to rst - Automatic Speech Recognition C++ Sample & Automatic Speech Recognition Python* Sample (#16609) 2023-03-29 16:39:09 +02:00
Ilya Churaev
f3dcf93f96 Remove suppression Wno-delete-non-abstract-non-virtual-dtor (#16560)
* Remove suppression Wno-delete-non-abstract-non-virtual-dtor

* Fixed Allocator warning

* Suppress warning for GPU plugin

* Skip warning for GNA

* Fixed preprocessing

* Added virtual constructor for base plugin class

* Some fix for CPU

* Suppress for CPU

* Fixed any

* Fixed meta

* Disable warning for paddle

* Fixed Allocator tests

* Move suppress to paddle

* Fixed benchmark_app
2023-03-29 14:19:30 +04:00
Sebastian Golebiewski
1ca94326cb DOCS shift to rst - Benchmark Samples and Tools (#16566) 2023-03-27 18:29:05 +02:00
Sebastian Golebiewski
5c5a29d095 DOCS shift to rst -Sync Benchmark Samples (#16561) 2023-03-27 18:28:16 +02:00
Maciej Smyk
7ccf1c89cf DOCS shift to rst - Image Classification Async C++ Sample & Image Classification Async Python* Sample (#16580) 2023-03-27 16:54:50 +02:00
Zlobin Vladimir
69cec4a5e2 py/benchmark_app: fix -hint (#16511)
* py/benchmark_app: fix -hint

Don't warn about values which are explicitly set in -hint.
That aligns C++ and Python implementations.

Ticket 106544

* Remove extra throw

* Fix code style
2023-03-24 10:24:08 +04:00
Jade Cho
a20b3631fb Support float64 data type as input of benchmark_app (#16435) 2023-03-23 13:55:55 +09:00
River Li
a204b04fae fix mem leak (#16456) 2023-03-22 09:45:03 +04:00
Daria Mityagina
1c7b6a7b2a [VPUX] - Tensor data with element type f16, is not representable as pointer to i16 (#16379)
* [VPUX] - Tensor data with element type f16, is not representable as pointer to i16

* [VPUX] - Tensor data with element type f16, is not representable as pointer to i16
2023-03-20 14:54:27 +00:00
Ilya Lavrenov
0c99135d44 Improved properties handling between Core and plugins (#16296)
* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Multiple improvements

* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Code style, bugfix after merging improvement

* More improvements

* Even more improvements

* Commit changes in core_impl.cpp

* Added parsing of any maps

* Fixed code-style

* Fixed AB mock tests build

* Fixed comparison

* Added new AB config key

* Improvements and fixes (#147)

* Fix BA, fix GetSupportedConfig call for virtual plugins (#148)

* Fix GPU tests (#149)

* Fix BA, fix GetSupportedConfig call for virtual plugins

* Fix GPU tests

* Code style

* Improvements 10

* Fixed incorrect tests

* Revert removal cache_dir

* Revert removal cache_dir

* Fixed clean

* Supported device ID in CPU

* More fixed tests

* clang-format

* Fix legacy GPU tests (#150)

* Removed clone_map

* clang-format

* Added clone_map back

---------

Co-authored-by: Nadezhda Ageeva <nadezhda.ageeva@intel.com>
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
2023-03-20 12:42:40 +00:00
Denis Orlov
6ffa8da922 Fix documentation (md and inline) for C++ and Python spech samples (#16185)
* Fix documentation (md and inline) for C++ and Python spech samples

* Fix clang-format

* Minor fix

* Fix clang-format

* Fix a typo

* Fix according to Mike's review

* Fix clang-format
2023-03-16 15:44:12 +00:00
Ilya Churaev
95faa573ed Introduce ITensor instead of Blob (#16048)
* Introduce ITensor

* Added new allocator

* Hide ITensor from dev api

* Changed some python tests

* Remove deprecated API from sample

* Fixed warnings

* Skiped unsupported tests

* Fixed exception message

* Fixed template func tests

* Fixed incorrect tests

* Fixed comments and move ITensor to developer API

* Fixed CI issue

* Fixed allocated tensor

* Fixed docs and windows warning

* Fixed set shape for strided tensors

* Fixed build and some comments

* Introduce remote tensor

* Fixed code style

* Fixed build

* Remove static assert method

* Remove fail type

* Added device name API

* Try to fix GPU remote tests

* Added debug output

* Try to fix GPU tests

* Fixed comments

* Fixed build

* Added additional element type check

* Revert some comment changes
2023-03-14 19:12:27 +04:00
Ilya Lavrenov
f080a0d9cf Added NCC style for frontends sources (#16200)
* Ability to provide several source dirs for ncc-style checks

* Fixed include headers; added NCC to TF common

* Fixed NCC for frontends

* Fixed NCC for frontends

* Extra fixes

* Fixest push --f

* Clang-format

* Apply comments

* Add an option to specify required clang-format version

* Update src/frontends/tensorflow/src/decoder_proto.cpp

* Update src/frontends/tensorflow/src/decoder_proto.cpp
2023-03-13 14:54:00 +00:00
Zlobin Vladimir
0e91b07422 Prohibit FP16 FP32 values for cpp benchmark_app (#16217)
Ticket 100990

Python benchmark_app already prohibits FP16 and FP32.
2023-03-13 09:27:52 +04:00
Ilya Churaev
75314c2c53 Rename OPENVINO_UNREACHABLE to OPENVINO_THROW (#16201)
* Changed some exceptions to OPENVINO_THROW

* Changed samples throw exception

* Fixed some comments

* Remove OPENVINO_UNREACHABLE
2023-03-10 20:23:13 +04:00
Ilya Lavrenov
fa9677a6ee Removed visibility settings from samples (#16192) 2023-03-10 12:58:15 +04:00
Daria Mityagina
34bab897d6 [VPUX] - benchmark app issue fix - PERFORMANCE_HINT: UNDEFINED (#16065)
* [VPUX] - benchmark_app issue

* [VPUX] - benchmark_app issue - review
2023-03-10 12:46:51 +04:00
Szymon Irzabek
e79636bfbb [GNA] Add 3.6 and 4.0 targets (#15735) 2023-03-07 17:14:59 +01:00
Ilya Lavrenov
e1fbb7d768 Fixes for multi-config generators (#16097) 2023-03-05 10:46:53 +04:00
Wang, Yang
99a1800901 Fix the AUTO loadnetwork failure triggered by AUTO:-xxx (#15747)
* Check if the device is supported when AUTO retrieves the device list based on the ov::device::priorities.

* Update the logic to handle the situation like -d AUTO:-CPU to benchmark APP.

* Remove MYRIAD and add NVIDIA for AUTO supported devices.

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
2023-03-02 13:16:12 +08:00
Ilya Lavrenov
713b37cb25 Detection of WoA ARM64 in all places (#15960) 2023-02-27 10:29:14 +04:00
Ilya Lavrenov
57cb7015f0 Fixed samples build on Debian 10 with cmake 3.13 (#15940) 2023-02-24 22:28:45 +04:00
Wang, Yang
7f3ea9a59c Conversion fail for ov::hint::performance_mode with UNDEFINED value (#15629)
* Update ov::hint::performance_hint UNDEFINED value from empty string to "UNDEFINED".

* Update benchmark Python version.

* Update.

* Update.

* Update.

* Update the description about hint setting within benchmark APP README and help message.
2023-02-22 13:01:18 +04:00
Ilya Lavrenov
ed5fa69b41 Fixed compilation on CI (#15787) 2023-02-17 22:28:48 +04:00
Wang, Yang
a088d1ab7d Disable core::set_property() to support ov::device::properties setting (#15175)
* Disable set_property() to support ov::device::properties setting.

* Update benchmark APP to set device properties through compile_model() instead of through set_property().

* Update.

* Update.

* Update some test case including ov::device::properties setting via core.ser_property().

* Since core.set_property() didn't support ov::device::properties setting, just remove the test case to check compile_model() works well if setting ov::device::properties via core.set_property() first.

* Update CompileModel in test name to CompiledModel

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Add corresponding test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Remove the changes of this commit as this modification has nothing to do
with this PR.

This reverts commit 4f04b9f085.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-02-17 10:15:38 +04:00
Ilya Lavrenov
672522492e Changed sample's format_reader libraries type from dynamic to static (#15756) 2023-02-17 09:30:19 +04:00
Haiqi Pan
67fff4adcc Fix sign-compare warnings in PDPD FE (#15635)
* fix warnings in /paddle

* fix bmp_reader.c

* add -Wsign-compare

* fix code style

* fix sum.cpp

* remove paddle sign-compare

* fix return in input_model.cpp

* fix bmp_reader.c
2023-02-14 12:11:59 +04:00
Zlobin Vladimir
ee2e9d497c benchmark_app: factor out advanced options (#15605)
* benchmark_app: factor out advanced options

* cpp/benchmark_app: add usage word

* move api to advanced, group b/shape/data_shape/layout into Input shapes, factor out Statistics dumping options

* Factor out Device-specific performance options

* Factor out Preprocessing options

* Minor regroup
2023-02-13 17:45:17 +04:00
Piotr Krzemiński
d0a97af629 [BENCHMARK_APP] Introduce Numpy array loading for C++ benchmark app/Fix a bug that would cause Python Numpy array loading to fail (#14021)
* [C++/BENCHMARK_APP] Introduce Numpy array loading for C++ benchmark app

* [DOCS/BENCHMARK_APP] Update docs to reflect changes, update list of available extensions from OpenCV, align help messages

* Update inputs_filling.cpp

* Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update samples/cpp/benchmark_app/inputs_filling.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [C++/Python] Implement quality-of-life improvements from PR comments

* [C++] Fix compilation errors, fix linter output

* [C++/PYTHON] Apply requested changes

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update samples/cpp/benchmark_app/utils.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [PYTHON] Separate loading of numpy arrays similar to images

* [PYTHON] Remove unnecessary 'Prepare xxx file' print

* Update README again because IF OPENCV.. dissapeared for some reason

* Update second README with missing IF OPENCV..

* [C++] Remove unnecessary vector print function

* [C++ Add Numpy processing function - TODO link it to the tensor filling

* Reverse OneDnn plugin modification

* [C++] Numpy array loading for C++

* [C++] Add (almost) all missing types of data

* Reverse submodule modifications

* [C++/PYTHON] Fix compilation errors, clean code

* [C++] Modify supported extensions, add numpy checking to utils, add numpy to get_image_info method

* Update samples/cpp/benchmark_app/inputs_filling.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [C++] Fix utils header file to reflect unordered set change

* [PYTHON/C++] Fix compilation errors in C++ code, fix Python dynamic shapes numpy loading

* [C++] Fix explicit instantiation of NumpyArray reader

* [C++] Clang format, minor syntax fixes

* [PYTHON/C++] Remove unnecessary data types, introduce a new approach to cast data of different types from format_rt_reader, remove uppercase types from Python precision parameters

* [PYTHON] Update README to reflect new precision settings

* [PYTHON] Fix README, fix clang format

* [C++] Clean headers

* [C++] Fix uninitialized variable error

* [C++/PYTHON] Fixed choices in Python benchmark, fixed types in C++ benchmark

* [C++] Fixed ov::float16conversion, fixed Python types map - removed redundancies

* [C++] Add back boolean support

* [C++] Fix compilation errors

---------

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
2023-02-13 12:04:23 +04:00
Ilya Churaev
b83ccdd432 Removed TREAT_WARNING_AS_ERROR option (#15608)
* Removed TREAT_WARNING_AS_ERROR option

* Removed warning as error for samples if cmake option is not defined
2023-02-10 21:43:08 +04:00
Ilya Lavrenov
4fa5137af4 DEB: use alternative package names for nlohmann json (#15607) 2023-02-10 02:34:16 +04:00
Ilya Lavrenov
1f3e469c5e Added -Wall for Clang and GCC (#15513)
* Added -Wall for Clang and GCC

* Fixes

* Don't use /J

* Fixed warnings

* Fixed warnings

* More fixes

* Fixed for MSVC

* Fixed more warnings on Windows

* Suppressed some warnings in template plugin

* Update src/tests/functional/plugin/shared/include/behavior/plugin/caching_tests.hpp

* Added suppression for PT FE

* Suppressed warnings in TF FE

* Suppressed warnings on Core unit tests

* Suppress warnings in python

* Suppressed Windows warning for 3rd party modules

* Suppresed one more warning
2023-02-08 15:01:00 +04:00
Haiqi Pan
82286cc2af fix dump/load_config using opencv (#15540)
* fix dump/load_config using opencv

* fix format

* remove empty line

* fix format
2023-02-08 10:33:51 +00:00
Ilya Lavrenov
de1631d67d Generalized OpenCL handling (#15253)
* Squashed commit of the following:

commit 62c992f6a0bc3a2f559faac6912be9c5632a359f
Author: Ilya Lavrenov <ilya.lavrenov@intel.com>
Date:   Sun Jan 22 11:38:18 2023 +0400

    Generalized OpenCL handling

* Updates

* Fixes

* Update thirdparty/CMakeLists.txt

test

* Fixed build with CL/cl2.hpp

* Fixes

* Fixes

* Fixed compilation flags

* Fixed build with target OpenCL 120

* Don't use cache
2023-02-03 15:36:47 +00:00
Piotr Krzemiński
7e3e0ff003 [C++] Fix coverity issues (#15348)
* [C++] Fix coverity issues

* Merge master with this branch

* [C++] Reapply changes that got eaten during merge

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* [C++] Add missing const keyword

---------

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2023-01-31 13:13:35 +04:00