Wang, Yang
93509147d5
[AUTO] Update logic of setting TPUT by default for MULTI and AUTO. ( #12279 )
...
* update logic of setting TPUT by default for MULTI and AUTO.
Signed-off-by: Wang, Yang <yang4.wang@intel.com >
* Set config to MULTI instaed of target device when using -d MULTI:target_device in benchmark app.
Signed-off-by: Wang, Yang <yang4.wang@intel.com >
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com >
* Update logit to check if perfomance hint is set.
Signed-off-by: Wang, Yang <yang4.wang@intel.com >
* Update test cases.
Signed-off-by: Wang, Yang <yang4.wang@intel.com >
* Set the correct _so from passthrough executable network when batch plugin is disabel to fix lifecycle coredump.
Signed-off-by: Wang, Yang <yang4.wang@intel.com >
* Same update for AUTO plugin
Signed-off-by: Wang, Yang <yang4.wang@intel.com >
* Update
Signed-off-by: Wang, Yang <yang4.wang@intel.com >
* Update
Signed-off-by: Wang, Yang <yang4.wang@intel.com >
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com >
Signed-off-by: Wang, Yang <yang4.wang@intel.com >
Co-authored-by: Chen Peter <peter.chen@intel.com >
2022-08-26 17:31:22 +08:00
Yuan Hu
bf2d6a72a4
fix a typo in benchmark_app sample ( #12507 )
...
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com >
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com >
2022-08-25 07:12:03 +03:00
Vladimir Paramuzov
03b7c1e69e
[GPU] Support hint::inference_precision ( #12526 )
2022-08-15 16:34:36 +04:00
Ilya Lavrenov
e0b12009ea
Removed old headers from OV 2.0 API ( #12214 )
...
* Removed old headers from OV 2.0 API
* FIxed clang
* Fixed warning
* Updated OMZ submodule
* Fixed gpu tests build
2022-08-12 11:35:36 +04:00
Ilya Lavrenov
6ca47b074d
Library versions & made tests relocatable ( #12416 )
...
* Fixes for cases when TBB_DIR env var is set
* Don't use make in build_samples.sh script
* First version of Windows installer
* WIndows NSIS installer
* Improved version of debian packages
* Improvements
* Improvements
* Debian packages now look good
* Library versioning
* Fixed tests to run against debian packages
* Fixed frontend tests
* Fixed code style
* FIxed Windows
* Fixed python tests
* Fixed paths in tests
* fdvfdv
* Fixes
* USe versioning only for debian packages
* Relocatable tests
* Fixed
* Fixed all tests
* Fixed clang-format
* Fixed more tests
* Fixed some tests
* Absolute paths in .ci
* Fixes
* Added support of OpenCV 3.4
* Trying to fix gnaUnitTests
2022-08-08 13:59:24 +04:00
Sebastian Golebiewski
6227123d21
Porting to master - update -readme for CPP and Python benchmark ( #12245 )
...
Porting #11961
2022-07-26 14:12:08 +02:00
Chenhu Wang
43b3fff708
[DOC][CPU] Denormals optimization doc ( #12127 )
2022-07-20 04:35:45 +03:00
Xiping Yan
6966af3ced
Xp/benchmark app ocl ( #12112 )
...
* Add some tip description about enable OpenCL for benchmark_app.
Signed-off-by: xipingya <xiping.yan@intel.com >
* Export doesn't work, we need to add -Dopencl_root_hints=[PATH]/OpenCL-CLHPP/include to cmake command.
Signed-off-by: xipingya <xiping.yan@intel.com >
Co-authored-by: Chen Peter <peter.chen@intel.com >
2022-07-19 14:43:59 +08:00
Luo Cheng
23b1b76457
[CPU] revert pr 11990 and enable brgconv avx512 on SPR by default ( #12105 )
2022-07-14 14:11:21 +04:00
Chenhu Wang
8c152405ad
[CPU] General denormals optimization ( #11883 )
...
* FTZ_and_DAZ_set_for_cpu
* remove DAZ
* fix
* extract to utils
* ie core part changes to add do as property and benchmark_app enable do
* enable brgcov from Luocheng patch
* add debug info
* enable_brgemm_on_avx512
* add python binding
* dlb test
* FTZ_and_DAZ_set_for_cpu
* remove DAZ
* fix
* extract to utils
* ie core part changes to add do as property and benchmark_app enable do
* enable brgcov from Luocheng patch
* add debug info
* enable_brgemm_on_avx512
* add python binding
* dlb test
* revert test code
* revert test code
2022-07-05 15:50:16 +08:00
Luo Cheng
35ee842446
[CPU] [WA] Use config to enable brgconv f32 kernel ( #11990 )
...
* enable brgconv f32
* use config to enable brgconv f32
* when brg disabled not init bin-postops
* change prop name for extensive
* use more general field
* fix review comments.
2022-07-05 07:14:40 +08:00
Luo Cheng
bb3868d8cd
[CPU] OneDNN 2.6 migration ( #11627 )
...
* Migrate on OneDNN 2.7
* [CPU] Enabled brconv implementation
* Post ops optimizations
* [CPU] Enabled I8 precision on activations for Convolution node
* [CPU][WA] Disabled Deconvolution + post ops fusing optimization
* Fixed FQ post op optimization
* [CPU] Optimize post ops processing
* [WA] Add node name if tensor names are empty
* [WA] remove layout compatibility chheck that leads to the fase-positive exceptions
* [CPU] Optimize processing for FQ + Sum + FQ post ops pattern
* [CPU][WA] Enabled ReduceSum -> AvgPool transformation due to perf issues
* fix compiler error
* rebase onednn master
* cherry pick from 2.7 to 2.6
* [WA] make cpu case to run completed
* fix xmm zero check
* reopen 'FuseDeconvolutionAndSimpleOperation' Transform to fix CPU 'ConvolutionBackpropDataLayerTest' fail issue
* [WR] Removed failed the ReduceMean tests caused by 21f3555af4731a1f1dmitry.gorokhov@intel.com >
Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com >
Co-authored-by: Zhang Yi3 <yi3.zhang@intel.com >
Co-authored-by: liubo-intel <bo4.liu@intel.com >
Co-authored-by: Luwei Zhou <luwei.zhou@intel.com >
Co-authored-by: Li, Tingqian <tingqian.li@intel.com >
Co-authored-by: xuchen-intel <chen.xu@intel.com >
Co-authored-by: ceciliapeng2011 <cecilia.peng@intel.com >
2022-06-06 18:30:32 +08:00
guozhong wang
0a65f5f607
selectdevice returns MULTI:device in cumulative_throughput ( #11367 )
...
* selectdevice returns MULTI:device in cumulative_throughput
* load multi with throughput and disable cpu helper in cumulative
* disable cpu helper in cumulative_throughput
* add cumulative to bechmark_app help message
* modify benchmark_app.hpp clang-format
2022-05-06 12:42:59 +08:00
Ilya Lavrenov
4ad20fb53f
Use system dependencies ( #11419 )
...
* Try to improve gflags
* Try to improve gflags: part 2
* Tried to use dependencies on system
* Use nlohmann_jsonConfig from system
* Enabled nlohmann_json from system
* Improvements
* handle system gflags in developer package
* Simplifications
* Simplify dependency management
* Corrected package names
* Fixed subgraphsDumper configure stage
* Try to fix rhel8
* Try to fix macosx
* Fixed VPUX build
* Fixed aliasing issues
* Suppress some wanrings
* export gflags when build it
* Fixed some LTO
* Try to fix Mac
* revert
* use gflags as private dependency
* Aligned targets in developer package
* Fixed frontends tests build on U20 with LTO
* PAssed
* Don't use pkg_search_module(zlib ..) during cross-compilation
* Removed unused variables
* Fixed finding of zlib during cross-compilation
2022-04-05 04:47:22 +03:00
Fedor Zharinov
787610b0db
-l option is replaced with -extensions ( #10878 )
2022-04-04 16:08:38 +03:00
Ilya Lavrenov
3c724a1dee
Build with system TBB ( #11244 )
...
* Build with system TBB
* Fixes
* Check whether system TBB is available
* Try to fix ONNX Runtime build with system TBB
* Test
* Fixed compilation of threading.cpp
* Fixed unset of cache dirs
* Limit dearch paths of TBB
* Try to enable pip packages with custom TBB
* Fix for TBB 2021.2
* Install only needed TBB libraries
* Install TBB from system to pip package
* Reverted usage of TBBROOT
* Fixed oneTBB case
* Try to fix Android
* Escape some paths
* Added samples path
* Fixed TBBBind usage for case of system TBB
2022-03-31 18:05:59 +03:00
Ilya Lavrenov
c795382b1f
Configurable OpenCL usage in BA ( #11344 )
2022-03-31 10:49:40 +03:00
Ilya Lavrenov
19d0e5ba52
CMAKE: IE_VERSION => OpenVINO_VERSION ( #11242 )
...
* IE_VERSION => OpenVINO_VERSION
* Reverted installation of python unconditionally
2022-03-28 19:32:21 +03:00
Ilya Lavrenov
a883dc0b85
DOCS: ported changes from 2022.1 release branch ( #11206 )
...
* Extensibility guide with FE extensions and remove OV_FRAMEWORK_MAP from docs
* Rework of Extensibility Intro, adopted examples to missing OPENVINO_FRAMEWORK_MAP
* Removed OPENVINO_FRAMEWORK_MAP reference
* Frontend extension detailed documentation
* Fixed distributed snippets
* Fixed snippet inclusion in FE extension document and chapter headers
* Fixed wrong name in a snippet reference
* Fixed test for template extension due to changed number of loaded extensions
* Update docs/Extensibility_UG/frontend_extensions.md
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com >
* Minor fixes in extension snippets
* Small grammar fix
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com >
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com >
* DOCS: transition banner (#10973 )
* transition banner
* minor fix
* update transition banner
* updates
* update custom.js
* updates
* updates
* Documentation fixes (#11044 )
* Benchmark app usage
* Fixed link to the devices
* More fixes
* Update docs/OV_Runtime_UG/multi_device.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Removed several hardcoded links
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Updated documentation for compile_tool (#11049 )
* Added deployment guide (#11060 )
* Added deployment guide
* Added local distribution
* Updates
* Fixed more indentations
* Removed obsolete code snippets (#11061 )
* Removed obsolete code snippets
* NCC style
* Fixed NCC for BA
* Add a troubleshooting issue for PRC installation (#11074 )
* updates
* adding gna to linux
* add missing reference
* update
* Update docs/install_guides/installing-model-dev-tools.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Update docs/install_guides/installing-model-dev-tools.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Update docs/install_guides/installing-model-dev-tools.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Update docs/install_guides/installing-model-dev-tools.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Update docs/install_guides/installing-model-dev-tools.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* update
* minor updates
* add gna item to yum and apt
* add gna to get started page
* update reference formatting
* merge commit
* add a troubleshooting issue
* update
* update
* fix CVS-71846
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* DOCS: fixed hardcoded links (#11100 )
* Fixes
* Use links
* applying reviewers comments to the Opt Guide (#11093 )
* applying reviewrs comments
* fixed refs, more structuring (bold, bullets, etc)
* refactoring tput/latency sections
* next iteration (mostly latency), also brushed the auto-batching and other sections
* updates sync/async images
* common opts brushed
* WIP tput redesigned
* minor brushing of common and auto-batching
* Tput fully refactored
* fixed doc name in the link
* moved int8 perf counters to the right section
* fixed links
* fixed broken quotes
* fixed more links
* add ref to the internals to the TOC
* Added a note on the batch size
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* [80085] New images for docs (#11114 )
* change doc structure
* fix manager tools
* fix manager tools 3 step
* fix manager tools 3 step
* new img
* new img for OV Runtime
* fix steps
* steps
* fix intendents
* change list
* fix space
* fix space
* code snippets fix
* change display
* Benchmarks 2022 1 (#11130 )
* Minor fixes
* Updates for 2022.1
* Edits according to the review
* Edits according to review comments
* Edits according to review comments
* Edits according to review comments
* Fixed table
* Edits according to review comments
* Removed config for Intel® Core™ i7-11850HE
* Removed forward-tacotron-duration-prediction-241 graph
* Added resnet-18-pytorch
* Add info about Docker images in Deployment guide (#11136 )
* Renamed user guides (#11137 )
* fix screenshot (#11140 )
* More conservative recommendations on dynamic shapes usage in docs (#11161 )
* More conservative recommendations about using dynamic shapes
* Duplicated statement from C++ part to Python part of reshape doc (no semantical changes)
* Update ShapeInference.md (#11168 )
* Benchmarks 2022 1 updates (#11180 )
* Updated graphs
* Quick fix for TODO in Dynamic Shapes article
* Anchor link fixes
* Fixed DM config (#11199 )
* DOCS: doxy sphinxtabs (#11027 )
* initial implementation of doxy sphinxtabs
* fixes
* fixes
* fixes
* fixes
* fixes
* WA for ignored visibility attribute
* Fixes
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com >
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com >
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com >
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
Co-authored-by: Yuan Xu <yuan1.xu@intel.com >
Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com >
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com >
Co-authored-by: Ilya Naumov <ilya.naumov@intel.com >
Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com >
2022-03-24 22:27:29 +03:00
Vladimir Dudnik
3a8800cbd2
[Docs][IE Samples] fix hard links ( #11144 )
...
* fix hard links
* change encoding
* fix TM
Co-authored-by: CCR\ntyukaev <nikolay.tyukaev@intel.com >
2022-03-23 23:48:08 +03:00
Fedor Zharinov
fe3270c232
[benchmark_app]Exception handling in callback ( #11123 )
...
* Exception handling in callback
* stylefix
2022-03-23 16:55:41 +03:00
Fedor Zharinov
1315cfaa64
Add CHW/HWC heuristics for tensors with 3 dimensions ( #10817 )
2022-03-23 16:54:56 +03:00
Alexey Lebedev
3de9189d50
[core][python] ov::serialize ( #10945 )
...
* add ov::serialize
* create python binding
* update python tools
* use ov::serialize in benchmark app
* remove serialize from python offline_transformations
* fix import
* revert pot
* update docs
* apply review comments
* add const
* make bin path optional
* Add docs
* add compare test
2022-03-23 11:44:00 +03:00
Egor Duplensky
090799a362
[Samples] Fix cpp benchmark_app help message ( #11055 )
2022-03-22 22:51:05 +03:00
Sergey Lyubimtsev
dacdf67c2c
Update Benchmark guides ( #11076 ) ( #11085 )
...
* - Update Benchmark Tool usage message
- Remove not existed paths
- Fix examples
* remove reference on FPGA
(cherry picked from commit 3caa77eb30
2022-03-21 19:31:17 +03:00
Fedor Zharinov
0b444ab2db
[benchmark_app]Show network original I/O info ( #10694 )
...
* Show network original I/O info
* additional no-name case check
* stylefix
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com >
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com >
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com >
2022-03-21 13:57:56 +03:00
Vladislav Volkov
ed8c9d6f9a
CPU Plugin refactoring: class names ( #10639 )
2022-03-16 17:16:29 +03:00
Serhii Pavlovskyi
948347f3dd
ncc build fixes ( #10367 )
...
* fix .ncc_style target names
it was breaking configure on system with libclang-12-dev, clang-12,
ninja and cmake 3.17+(ninja complains about duplicate
target). with lower cmake version configure succeeds, but build exits
immediately with error. by replacing ninja with make error becomes
warning(it's still significant, make just skips duplicate rules, i.e.
doesn't check style of some source files, rule duplication is genuine
bug). without libclang-12-dev and clang-12 ENABLE_NCC_STYLE is OFF and
bug is not triggered
* silence uninitialized warning in core_integration
probably it was always initialized before use, but compiler wasn't made
aware of it
* fix function spelling to unbreak code style checks in benchmark_app
* include <thread> for std::this_thread
existing code was relying on namespace pollution by old libstdc++
* replace is_pod with is_standard_layout && is_trivial
is_pod is deprecated, it breaks build on current gcc
Co-authored-by: Serhii Pavlovskyi <spavlovskyi@lohika.com >
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com >
2022-03-09 13:42:06 +03:00
Fedor Zharinov
043a773f61
[Benchmark_app]Check all I/O names ( #10745 )
...
* Check all I/O names
* stylefix
2022-03-04 09:49:03 +03:00
Ilya Churaev
1fec99afa3
Removed duplicated words ( #10754 )
2022-03-03 06:50:54 +00:00
Maxim Shevtsov
bed0adf5ef
creating remote ocl buffer/tensor per request, to avoid simulteneous locking of the same ocl buffer when auto-batching is used ( #10607 )
2022-02-28 15:04:03 +03:00
Fedor Zharinov
75cca1e9e9
[benchamrk_app] error if -b is set but there's no batch info ( #10592 )
...
* Added code showing error message if -b is provided, but got no batch info for inputs
* stylefix / batch>1 case
2022-02-23 01:30:08 +03:00
Ilya Lavrenov
991c9db1c1
Config api docs ( #10563 )
...
* Renamed hetero md
* Renamed some guides
* Updated OpenVINO_Runtime_User_Guide.md
* Updated plugin's page
* More updates
* Fixed links
* Updated link names
* Fixed links
* Fixed docs build
* Self-review
* Fixed issues in doc snippets
2022-02-22 14:32:57 +03:00
Fedor Zharinov
4decf16927
Set Latency performance mode in case of sync mode. ( #10516 )
2022-02-21 18:08:05 +03:00
Xuejun Zhai
2ac15eae3d
[CVS-78727] bug fix for -d AUTO:CPU,GPU the return device should be AUTO only ( #10417 )
...
Signed-off-by: xuejun <xuejun.zhai@intel.com >
2022-02-18 09:56:56 +03:00
Anton Romanov
b8ac041da9
Fixed coverity issues in samples ( #10421 )
...
* Fixed coverity issues
* Fixed coverity isuues samples part 2
* Fixed code style
* Delete goto
* update after comments
2022-02-18 08:08:09 +03:00
Anton Pankratov
61f657795c
Streams property with special values ( #10411 )
...
* Streams property with special values
* Fixed clang
2022-02-17 16:39:06 +03:00
Fedor Zharinov
198f44fdc7
Fix for missing throughput in case of Multi device ( #10407 )
...
* Fix for missing throughput in case of Multi device
* stylefix
2022-02-17 16:32:19 +03:00
Anton Pankratov
d1378d94b8
Fixed default inference precision in benchmark app ( #10443 )
2022-02-17 13:53:50 +03:00
Fedor Zharinov
00abcbacc4
Fix for Layout and image_info related issues ( #10258 )
...
* bugfix78627
* stylefix
* fix
2022-02-17 00:42:51 +03:00
Anton Pankratov
39c90e9d48
Streams number fix ( #10336 )
...
* Streams number fix
* fixed perfomance hint
* fixed format
* removed dbg
* simplified code
* reverted becnhmark_app
2022-02-15 08:04:45 +00:00
bell
f75e50cc88
limit gpu compiling threads ( #10349 )
...
* limit gpu compiling threads
Signed-off-by: fishbell <bell.song@intel.com >
* switch to 2.0
Signed-off-by: fishbell <bell.song@intel.com >
* clang format
Signed-off-by: fishbell <bell.song@intel.com >
2022-02-15 08:52:49 +03:00
Ilya Lavrenov
2d3bd40c3d
Removed dead code ( #10331 )
2022-02-14 17:57:27 +03:00
Xuejun Zhai
9b41aa707d
Modify for CVS-69023: hint configuration ( #10259 )
...
Signed-off-by: xuejun <xuejun.zhai@intel.com >
2022-02-14 17:46:11 +03:00
Anton Pankratov
897e2acd91
Default value of streams in ba is AUTO ( #10305 )
2022-02-12 00:09:31 +03:00
Yuan Hu
7abd61f867
[AUTOPLUGIN] OV config 2.0 support ( #10191 )
...
* add support for LOG_LEVEL and supported_properties
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com >
* fix compile error
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com >
* add test case for log_level and full_name
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com >
* update to ov 2.0
Signed-off-by: fishbell <bell.song@intel.com >
* fix benchmark_app faild for AUTO:GPU, GPU
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com >
* add case
Signed-off-by: fishbell <bell.song@intel.com >
* refine logic
Signed-off-by: fishbell <bell.song@intel.com >
* add test cases
Signed-off-by: fishbell <bell.song@intel.com >
* add more cases
Signed-off-by: fishbell <bell.song@intel.com >
* fix redifinition
Signed-off-by: fishbell <bell.song@intel.com >
* cpu plugin only in cpu tests
Signed-off-by: fishbell <bell.song@intel.com >
* typo in parameter
Signed-off-by: fishbell <bell.song@intel.com >
* use _core directly
Signed-off-by: fishbell <bell.song@intel.com >
* fix multi case failure
Signed-off-by: fishbell <bell.song@intel.com >
Co-authored-by: fishbell <bell.song@intel.com >
2022-02-11 23:39:09 +08:00
Anton Pankratov
1621a5a0b5
Used new config for streams and threads ( #10150 )
...
* Used new config for streams and threads
* Fixed review coments in ba
* format fix
* fixed hello_query_device
* Added STL string io
* fixed tests
* Fixed test
* Fixed build
* fixed format
* Fixed build
* try fix win
* other any io specialization
* Fixed after merge
* renamed streams
* build fixed
* fixed build
* fixed format
* fix for old mac build
* Fixed type of exception
* test fix
2022-02-11 09:22:45 +03:00
Sergey Shlyapnikov
8f0e974ee6
[GPU] Add new properties and fix bechmark_app ( #10149 )
2022-02-09 09:18:54 +03:00
Alexandra Sidorova
57b08583cc
[Benchmark] Align comments with command argument 'data_shape' ( #9897 )
2022-02-07 13:31:38 +03:00
Fedor Zharinov
38f470c184
set U8 precision for image-like inputs even in case of random filling ( #10140 )
2022-02-07 12:09:16 +03:00
