Commit Graph

8941 Commits

Author SHA1 Message Date
Vladimir Paramuzov
21ead7cbc6
[GPU] Dynamic kernels infra and Permute ref kernel (#13661) 2022-11-16 09:29:12 +04:00
Anastasiia Pnevskaia
de1a08c076
Update OMZ submodule. (#14014) 2022-11-15 23:43:32 -05:00
River Li
0e76224199
[Windows] solve warning C4267 and C4244 issue for template plugin test cases (#13736)
* [Windows] solve warning C4267 and C4244 issue for template plugin

* Solve or WA C4267 and C4244 caused by system header files(numeric and utility)
2022-11-16 07:46:46 +04:00
Vladislav Golubev
0f531ffa2d
openvino_gapi_preproc_s including temporary disabled (#13982) 2022-11-16 02:23:08 +04:00
Tingqian Li
80971ae8e8
[CPU] Optimize fused FQ/Eltwise nodes to use less binary postOps (#13502) 2022-11-16 00:26:02 +03:00
Ivan Tikhonov
8d3b382ca9
fix DynamicStitch tests (#14005) 2022-11-16 00:24:38 +03:00
Maciej Kwapulinski
57293a6833
[GNA] race around GNA memory queues' destruction removed (#13905)
* race around gna memory queues' destruction removed

* GNA device gets closed at GNAPlugin destructor
2022-11-15 23:25:35 +03:00
Ilya Lavrenov
20419905c3
Fixed compilation with gcc-12 (#13983)
* Fixed compilation with gcc-12

* Made python to be a mandatory dependency for gpu plugin

* Apply suggestions from code review
2022-11-15 21:59:27 +03:00
Vladimir Paramuzov
fd961d6e56
[GPU] Allow devices which don't support OOO queue (#13900) 2022-11-15 17:51:09 +04:00
Vladislav Golubev
80ce00aa7c
[Snippets] BF16 support enabled (#13859) 2022-11-15 17:40:45 +04:00
Ilya Churaev
d337f6b16f
Add get available opsets (#13920)
* Added doxygen comment for opset10

* Added get_available_opsets method to API

* Fixed build

* Fixed build and typo

* Use constant map

* Removed defines from global opset

* Added const to map
2022-11-15 16:35:09 +03:00
Georgy Krivoruchko
8be7b791d3
Test Runner added separation of tests (#13684) 2022-11-15 16:53:32 +04:00
Denis Orlov
a6a63671f3
[GNA] Add the batch notice for GRUCell in docs (#14009) 2022-11-15 11:09:40 +00:00
Vladimir Paramuzov
d48ec0c855
[GPU] Added network input shape to perf data (#13628) 2022-11-15 14:49:15 +04:00
Irina Efode
ed2d34fc6b
[CONFORMANCE] FIX OpImplCheck (#13787) 2022-11-15 13:48:48 +03:00
yanlan song
80a07375bf
Bell/hetero execution devices (#13924)
* initial commit

Signed-off-by: fishbell <bell.song@intel.com>

* add cases

Signed-off-by: fishbell <bell.song@intel.com>

* apply review comments

Signed-off-by: fishbell <bell.song@intel.com>

* enable app

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* apply review comments

Signed-off-by: fishbell <bell.song@intel.com>

* enable cpu conditionally

Signed-off-by: fishbell <bell.song@intel.com>

* enable cpu tests

Signed-off-by: fishbell <bell.song@intel.com>

Signed-off-by: fishbell <bell.song@intel.com>
2022-11-15 09:53:18 +00:00
Katarzyna Mitrus
49b8a73c46
[ONNX] ConstantOfShape with empty tensor input (#13994)
* Tests for ConstantOfShape scalar

* Enable onnx ConstantOfShape scalar
2022-11-15 10:45:53 +01:00
Oleg Pipikin
1cc8550512
Move conditional compilation tests from ieFuncTests to ov_conditional_complilation_tests (#13899)
* Move CondCompl tests to new executable. Add it to CI

* Fix code style

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2022-11-15 13:29:19 +04:00
Felix Dohyun Kim
f9e0020677
[GPU] Unittest fix for discrete GPU (#13978) 2022-11-15 18:14:42 +09:00
Pavel Esir
34f16bf749
[MO] turn on bom_tests (#13721)
* turn on bom_tests

* fixed root directories to search

* leftovers fix

* removed requirements from package_BOM.txt; corrected error messages to install via pip

* removed extract_release_version.py from package_BOM.txt, added requirements files to skip

* removed redundant commented line

* mentioned CustomLayersMapping.xml.example in docs

Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
2022-11-15 12:38:59 +04:00
Maciej Smyk
11338ad076
tf_openvino (#13786) 2022-11-15 08:02:54 +01:00
Roman Kazantsev
83ee6aec15
[TF FE] Reimplement NonMaxSuppression translator and test in the pre-commit (#13974)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-11-15 10:58:47 +04:00
Sebastian Golebiewski
c9a44dcb9c
DOCS: Install raspbian updates - for master (#13992)
* update raspbian installation

* fix formatting

* update

* update unlink command

* update the architecture

* Update installing-openvino-raspbian.md

* Apply suggestions from code review

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2022-11-15 13:34:38 +08:00
Andrew Kwangwoong Park
64498b67a2
[GPU] Baseline program_node and kernel_impl_params with output layouts for multiple outputs support (#13761)
* Intial update for NMS mutiple outputs support

- update get_depedencies_new primitive overriding func for nms and reorder
- primitve API update for nms and reorder
- add non_max_suppression_base test TC for multiple outputs
- update non_max_suppression cpu impl for backward compatibility
- update dependencies_new for remove_redundant_reorders opt pass

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update program_node and kernel_impl_params for multiple outputs supports

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix runtime error and failed TC for multiple outputs support

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix conflicts and newly update

Signed-off-by: Andrew Park <andrew.park@intel.com>

* TopK shape infer

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Implement TopK gpuFunctests for dynamic shape and multiple outputs

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix conflicts

Signed-off-by: Andrew Park <andrew.park@intel.com>

* minor API fix

Signed-off-by: Andrew Park <andrew.park@intel.com>

* NMS shape infer

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Implement Nms gpuFunctests for dynamic shape and multiple outputs

Signed-off-by: Andrew Park <andrew.park@intel.com>

* move gpuFunctests and fix conflict

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix issues for Nms gpuFunctests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix conflicts and code cleanup

Signed-off-by: Andrew Park <andrew.park@intel.com>

* apply clang-format

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply change to onednn primitive_impl

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix CI issues

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

* updates for ngraph shape infer

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix conflicts

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Failing case

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

Signed-off-by: Andrew Park <andrew.park@intel.com>
Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2022-11-15 08:31:16 +03:00
Daria Mityagina
d27baa8811
[MyriadX][CVS-89635] - ovtf data->_producerEdge != nullptr - fix (#13973)
* [MyriadX][CVS-89635] - ovtf data->_producerEdge != nullptr - fix

* [MyriadX][CVS-89635] - ovtf data->_producerEdge != nullptr - trying not to break tests

* [MyriadX][CVS-89635] - ovtf data->_producerEdge != nullptr - exit them all + test
2022-11-15 07:45:22 +03:00
Tomasz Jankowski
c5eb25d3ea
Transformation component transition to OV namespace (phase 2) (#13557) 2022-11-15 04:40:48 +03:00
Roman Kazantsev
d6dc40bf34
[TF FE] Refactor translator for L2Loss and test in the pre-commit (#13972)
* [TF FE] Refactor translator for L2Loss and test in the pre-commit

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Use Power for square operation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-11-15 03:47:56 +03:00
Xiake Sun
5ac06838cd
Fix pcsort message format to be consistent cross language (#13936) 2022-11-14 14:26:31 +01:00
Piotr Krzemiński
d951623027
[BENCHMARK_APP/PYTHON/CPP] Align benchmark_app output across languages (#12814)
* [PYTHON] Pipeline transfer

* [PYTHON] Align python benchmark

* [PYTHON] Align last step

* [PYTHON] Fix innacuracies of the last step - median

* [PYTHON/CPP] Add Core::get_version method to python API, refactor Ben benchmark to print version with this func

* [PYTHON] Remove get_version_string from API

* [PYTHON/CPP] Align output for model input/output info

* [PYTHON/CPP] Step 4,6 alignment of outputs, step 8 dumps all info stored in config parameters

* [CPP] Fix a bug causing nstreams parameter to never be set to AUTO in CPP benchmark_app

* [CPP] Fix clang format errors

* [CPP] Modify print order and data output for 8th step

* [PYTHON] Add verification checks from C++, modify set_thoughtput_streams to match documentation

* [CPP] Revert changes to C++ benchmark_app

* [CPP] Remove additional spacebar

* Update submodules versions on remote

* Update module from master branch

* Redownload submodules from master and override changes from commit

* [PYTHON] Remove unneccesary parse_status from validation function

* [PYTHON] Check for HINT in map, fix circular import

* [PYTHON] Remove artifacts from commit, fix args.perf_hint set to '' instead to 'none'

* [PYTHON] Reverse changes to perf hint, add key in map check, fix validation function throwing error on set hint

* [PYTHON] Fix linter

* [PYTHON] Remove linter spacebar

* [CPP] Fix wait_all exception throw

* [CPP/PYTHON] Clean artifacts and unwanted changes from work process

* [PYTHON] Fix artifacts from merge, clean submodule update

* [C++ CPU] Fix device name string by removing padding NULL characters from the back

* [CPP] Fix ba infer_request_wrap in other throw-catch clauses

* [PYTHON/CPP] Fix missing latencies in final step for shape group, fix minor misaligned messages, add missing report parameter create infer requests time

* [CPP] Clang fix formatting

* [CPP] Reverse clang fix format on plugin.cpp

* [PYTHON/CPP] Fix C++ progressbar printing endl when disabled, fix rounding in python creating infer request message

* [CPP] Fix foramtiing error

* [PYTHON/C++] Refactor network to model based on naming conventions, provide fresh README output example

* [PYTHON/C++] Add example output to C++ README, remove unnecessary device loop

* [BENCHMARK_APP/C++] Fix artifact from refactoring, remove try-catch clause

* Update samples/cpp/benchmark_app/benchmark_app.hpp

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update tools/benchmark_tool/openvino/tools/benchmark/main.py

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* [CPP] Fix clang errors

* [CPP/PLUGIN Reverse modification to extract to separate task

* Update tools/benchmark_tool/openvino/tools/benchmark/main.py

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update tools/benchmark_tool/openvino/tools/benchmark/parameters.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update tools/benchmark_tool/openvino/tools/benchmark/utils/utils.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update tools/benchmark_tool/openvino/tools/benchmark/main.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [PYTHON/C++/BENCHMARK_APP] Fix language inconsistencies, remove unnecessary checks

* Update pyopenvino.cpp

* [CPP/BENCHMARK_APP] Remove unnecessary try-catch, fix linter errors

* [PYTHON/CPP/BENCHMARK_APP] Revert changes to Core, align version prints usin only provided methods

* [DOCS/BENCHMARK_APP] Update README with proper model examples

* Update README.md

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
2022-11-14 14:10:36 +01:00
Xuejun Zhai
cda2df8736
[CORE][Unite Test][Warning Fix] core unite test warning (#13757)
* [CORE][Unite test] Fix conflicts

Signed-off-by: Xuejun Zhai <Xuejun.Zhai@intel.com>

* [CORE][Unite Test] clear cmake

Signed-off-by: Xuejun Zhai <Xuejun.Zhai@intel.com>

Signed-off-by: Xuejun Zhai <Xuejun.Zhai@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2022-11-14 12:50:29 +00:00
Ilya Churaev
9d41136457
Fixed Android build (#13979)
* Fixed Android build

* Fixed Android
2022-11-14 16:17:21 +04:00
Georgy Krivoruchko
951be58dc3
Extended coverage of TensorFlow layer tests (#13547) 2022-11-14 15:50:43 +04:00
Katarzyna Mitrus
9f65092694
Use broadcast_merge_into for Broadcast-3 Bidirectional mode (#13940)
* Broadcast type_prop tests for param target shape

* Improve broadcast shape_infer with target shape as param

Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2022-11-14 10:57:35 +00:00
Marcin Kusmierski
4f6032cc7a
Revert "[GNA] Create new tests for PWL approximation validation (#13515)" (#13946)
This reverts commit 25ad4a6728.
2022-11-14 10:18:55 +00:00
Roman Kazantsev
3b7a5c691d
[TF FE] Fix TopK translator and add test to the pre-commit (#13971)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-11-14 14:02:12 +04:00
Anastasia Kuporosova
bbd221e6d3
[PyOV] Fix compatibility if-ops test (#13952) 2022-11-14 10:51:27 +01:00
Vladimir Paramuzov
fcef6220b0
[GPU] Refactor primitive_impl::create methods and kernel selector (#13748)
* [GPU] Refactor impls factory method

* [GPU] Return unique_ptr from impls factory

* [GPU] implemented get_kernel_params for most of ocl impls

* [GPU] Common create impl

* [GPU] Fixes after rebase

* [GPU] Codestyle fixes

* [GPU] handle optimized out prims in common create

* [GPU] Fix exception type in region yolo tests

* [GPU] Resolve ambiguity of make_unique on windows

* [GPU] Multiclass NMS

* [GPU] Fixes after rebase
2022-11-14 13:38:25 +04:00
Ilya Lavrenov
55a45a4d1a
Adjusted dependencies (#13942)
* Adjusted dependencies

* Fixed paths on Windows

* Move dependencies close to usage

* Updates
2022-11-14 12:57:27 +04:00
Roman Lyamin
fce64834d2
[GPU] PReLU broadcast 1d slope case fix (#13951) 2022-11-14 11:03:10 +04:00
Vladimir Paramuzov
ce257848ab
[GPU] Added fp precision support check and fallback to f32 if needed (#13939) 2022-11-14 10:33:53 +04:00
Vladimir Paramuzov
e78a9e93c2
[GPU] Fixed device name in query network result (#13915) 2022-11-14 09:09:32 +04:00
Xuejun Zhai
2faddf61bf
[C API][Preprocess] add more preprocess api (#13770)
* [C API][Preprocess API] Add api reverse_channels(), convert_layout(), crop(), scale(), mean()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][Preprocess API] Add unite test case for api reverse_channels(), convert_layout(), crop(), scale(), mean()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][Preprocess API] code format api reverse_channels(), convert_layout(), crop(), scale(), mean()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][Preprocess API] code format api reverse_channels(), convert_layout(), crop(), scale(), mean()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][Preprocess API] code format

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] clarify code with TEST_F

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] clarify code

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] remove space

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2022-11-14 08:07:56 +04:00
Eddy Kim
f488e6cc49
[GPU] Graph serialization for GPU (#13801)
* gpu graph serialization

* fix to rebase

* onednn_gpu.patch for serialization

* git apply --verbode to --quiet

* functional tests

* removed referece of mas_unpooling.hpp

* git apply --verbose

* add no args ctor for proposal_impl

* changed kernel_cache save/load error messages

* gpu model cacning control env. variable

* fixed nonnull warning

* impl_params are added to save and load

* changed a way to use kernel_impl_params in save and load

* get_arguments_by_idx is added

* setenv is disabled in windows

* added missed part for onednn

* code refactoring based on code review

* fixed to use get_node_output_layout()

* OV_GPU_MODEL_CACHING is changed to OV_GPU_CACHE_MODEL

* reference to node and primitive are removed

* fixed hash of enum class

* restored CanShareContextWith

* serialization of intermediate memory

* fix to rebase

* multiclass_nms serialization

* caching_properties added
2022-11-13 16:39:45 -08:00
Ilya Churaev
e4b21aa1ff
Port cc 10126 (#13955)
* Add the second step of CC

* Fixed linux path
2022-11-14 00:34:02 +04:00
Ilya Lavrenov
9ebbfbbed0
Added i686 arch support for python wheels (#13595) 2022-11-13 23:38:23 +04:00
Jan Iwaszkiewicz
2a9ae52ec1
[PyOV] Bump pygments version (#13947) 2022-11-13 14:09:50 +01:00
Sun Xiaoxia
966548d061
Xiaoxia/Custom setting nstreams with hyper thread enabled on Hybrid-aware P/E-core (#13836)
* add HybridAware stream setting and core binding

* fix clang format issue

* unified code style, add parameter check

* correct input affinity skip NUMA, modify function name

* remove unnecessary floor

* fix ci compile issue on Mac/windows platform

* modify smoke_SetConfigAffinity test

* modify ov_core_set_and_get_property_enum test, affinity HYBRID_AWARE is changed to NUMA

* remove affinity correcting on this pr

* revert ov_core_test.cpp

* merge function by comments

* fix code style issue

* add custom nstreams setting, remove mutable qualifier

* fix code style issue

* fix some issues according to comments

* modify UpdateHybridCustomThreads

* fix code style issue

* modify comments

* use logic core in phase 2

* modify steams threads setting method

* add custom setting nstreams nthreads

* modify comments

* fix code style issue

* fix threads_per_stream_big is wrong in the some ADL machine which has 6 pcore

* add one condition that custom set nthreads but not set nstreams

* remove the limit to nstreams

* remove the feature in branch p_e_core_phase2_logic

* add comments

* rename num_small_cores to num_small_cores_phys

* fix code style issue

* fix thread number is wrong in corner case on 6Pcore and 10Pcore condition

* fix some condition which nstreams<2

* add check for config._threads_per_stream_big

Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
2022-11-12 20:55:54 +03:00
Liubov Talamanova
bb00a9e664
[POT] Enable quantization inside subgraphs for CPU (#12776)
* Enable LSTMCell quantization

* Refactored unify function

* reverse dict

* Fix docs

* Add LSTM and GRU sequences

* Change scales to unified_scales in hw configs

* Fix inplace statistics

* Shift axis for subgraphs

* Changed HW config

* Update HW configs for tests

* Not quantize GRU ops with linear_before_reset: true

* Enable tests

* Support models with scalar input

* Fix tests

* return back submodules

* Fix tests

* Update GPU HW config

* Fix comments

* Fix axis
2022-11-12 07:54:29 +04:00
Roman Lyamin
5eae673220
[MO TESTS] PReLU tests fix (#13960) 2022-11-11 23:39:17 +04:00
Ivan Tikhonov
3ec40c490b
Fix copying of tensor names in OVTF TransposeSinking transformation (#13916)
* copy tensor names to transpose

* enable TransposeSinking, codestyle

* fix layer tests

* fix segfault

* delete transposes in catch block
2022-11-11 23:31:58 +04:00