Commit Graph

8652 Commits

Author SHA1 Message Date
Vladimir Paramuzov
ce257848ab
[GPU] Added fp precision support check and fallback to f32 if needed (#13939) 2022-11-14 10:33:53 +04:00
Vladimir Paramuzov
e78a9e93c2
[GPU] Fixed device name in query network result (#13915) 2022-11-14 09:09:32 +04:00
Xuejun Zhai
2faddf61bf
[C API][Preprocess] add more preprocess api (#13770)
* [C API][Preprocess API] Add api reverse_channels(), convert_layout(), crop(), scale(), mean()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][Preprocess API] Add unite test case for api reverse_channels(), convert_layout(), crop(), scale(), mean()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][Preprocess API] code format api reverse_channels(), convert_layout(), crop(), scale(), mean()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][Preprocess API] code format api reverse_channels(), convert_layout(), crop(), scale(), mean()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][Preprocess API] code format

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] clarify code with TEST_F

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] clarify code

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] remove space

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][PPP Test Case] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2022-11-14 08:07:56 +04:00
Eddy Kim
f488e6cc49
[GPU] Graph serialization for GPU (#13801)
* gpu graph serialization

* fix to rebase

* onednn_gpu.patch for serialization

* git apply --verbode to --quiet

* functional tests

* removed referece of mas_unpooling.hpp

* git apply --verbose

* add no args ctor for proposal_impl

* changed kernel_cache save/load error messages

* gpu model cacning control env. variable

* fixed nonnull warning

* impl_params are added to save and load

* changed a way to use kernel_impl_params in save and load

* get_arguments_by_idx is added

* setenv is disabled in windows

* added missed part for onednn

* code refactoring based on code review

* fixed to use get_node_output_layout()

* OV_GPU_MODEL_CACHING is changed to OV_GPU_CACHE_MODEL

* reference to node and primitive are removed

* fixed hash of enum class

* restored CanShareContextWith

* serialization of intermediate memory

* fix to rebase

* multiclass_nms serialization

* caching_properties added
2022-11-13 16:39:45 -08:00
Ilya Churaev
e4b21aa1ff
Port cc 10126 (#13955)
* Add the second step of CC

* Fixed linux path
2022-11-14 00:34:02 +04:00
Ilya Lavrenov
9ebbfbbed0
Added i686 arch support for python wheels (#13595) 2022-11-13 23:38:23 +04:00
Jan Iwaszkiewicz
2a9ae52ec1
[PyOV] Bump pygments version (#13947) 2022-11-13 14:09:50 +01:00
Sun Xiaoxia
966548d061
Xiaoxia/Custom setting nstreams with hyper thread enabled on Hybrid-aware P/E-core (#13836)
* add HybridAware stream setting and core binding

* fix clang format issue

* unified code style, add parameter check

* correct input affinity skip NUMA, modify function name

* remove unnecessary floor

* fix ci compile issue on Mac/windows platform

* modify smoke_SetConfigAffinity test

* modify ov_core_set_and_get_property_enum test, affinity HYBRID_AWARE is changed to NUMA

* remove affinity correcting on this pr

* revert ov_core_test.cpp

* merge function by comments

* fix code style issue

* add custom nstreams setting, remove mutable qualifier

* fix code style issue

* fix some issues according to comments

* modify UpdateHybridCustomThreads

* fix code style issue

* modify comments

* use logic core in phase 2

* modify steams threads setting method

* add custom setting nstreams nthreads

* modify comments

* fix code style issue

* fix threads_per_stream_big is wrong in the some ADL machine which has 6 pcore

* add one condition that custom set nthreads but not set nstreams

* remove the limit to nstreams

* remove the feature in branch p_e_core_phase2_logic

* add comments

* rename num_small_cores to num_small_cores_phys

* fix code style issue

* fix thread number is wrong in corner case on 6Pcore and 10Pcore condition

* fix some condition which nstreams<2

* add check for config._threads_per_stream_big

Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
2022-11-12 20:55:54 +03:00
Liubov Talamanova
bb00a9e664
[POT] Enable quantization inside subgraphs for CPU (#12776)
* Enable LSTMCell quantization

* Refactored unify function

* reverse dict

* Fix docs

* Add LSTM and GRU sequences

* Change scales to unified_scales in hw configs

* Fix inplace statistics

* Shift axis for subgraphs

* Changed HW config

* Update HW configs for tests

* Not quantize GRU ops with linear_before_reset: true

* Enable tests

* Support models with scalar input

* Fix tests

* return back submodules

* Fix tests

* Update GPU HW config

* Fix comments

* Fix axis
2022-11-12 07:54:29 +04:00
Roman Lyamin
5eae673220
[MO TESTS] PReLU tests fix (#13960) 2022-11-11 23:39:17 +04:00
Ivan Tikhonov
3ec40c490b
Fix copying of tensor names in OVTF TransposeSinking transformation (#13916)
* copy tensor names to transpose

* enable TransposeSinking, codestyle

* fix layer tests

* fix segfault

* delete transposes in catch block
2022-11-11 23:31:58 +04:00
Ilya Lavrenov
d1c1680a81
Fixed openvino-dev version (#13962) 2022-11-11 22:43:06 +04:00
Vladislav Golubev
cec772f2c0
[CPU] ModelCaching: added plugin specific config properties serialization (#13593) 2022-11-11 17:27:22 +00:00
Pawel Raasz
cb067de597
Review opset1 variadic split for shape inference aspects (#13894)
* Review variadic split shape_infer template
- extend static shape tests
- add default ctor tests

* Use OV_EXPECT_THROW in exception tests

* Review evaluate upper, lower and label propagation

* Fix usage broadcast in bound tests

* VariadicSplit bound check in evaluate lower,upper

* Clean-up tests leftovers
2022-11-11 15:29:42 +04:00
Zhang Yi
b8ada02cba
[CPU] Optimize concat node for dynamic shapes (#13019) 2022-11-11 13:46:32 +04:00
Jan Iwaszkiewicz
b44eb83551
[PyOV] Fix typo in filename generator (#13948) 2022-11-11 10:11:13 +01:00
Nikita Malinin
8e9a6d3457
[POT] BC update for transformers (#13869)
* Update node_utils

* HBC update

* Updated HBC & added test

* Apply comments
2022-11-11 11:33:11 +04:00
Xiake Sun
7ab81d0950
Add missing opset5 header for LSTMSequence in LPT (#13953) 2022-11-11 09:43:31 +03:00
OlehKravchyshyn
11d020ea06
[GPU] adjusted LWS for batch-blocked format (#13764)
LWS is adjusted to make items are fetched along batch axes in a workgroup if a layout has bsv32 or bsv16
2022-11-11 10:37:34 +04:00
Xuejun Zhai
5f1ce082ea
[C API][Unite Test] Add more tests to achieve code coverage target (#13885)
* [C API][Unite Test] Add more unite test case for C API (functional level)

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][Unite Test] remove unused function

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][Unite Test] fix function code coverage issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][TEST CASE] fix error

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2022-11-11 09:20:05 +04:00
Oleksii Khovan
71c23489c6
[GPU] Blocked layouts support for ExperimentalDetectronGenerateProposalsSingleImage (#12126)
* Blocked layouts support for ExperimentalDetectronGenerateProposalsSingleImage

* fix RHEL 8.2 build

* reduce number of tests

* Added bs_fs_yx_bsv16_fsv32 format
2022-11-10 18:03:39 -08:00
Haiqi Pan
28549a77bf
Fixed warnings for Auto plugin (#13810)
* fix warnings

* remove MSVC

* Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/plugins/auto/auto_schedule.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-11-11 04:56:54 +03:00
Jade Cho
f2d5c0cb5d
[GPU] Fix a bug of reorder input (#13840) 2022-11-10 17:30:30 -08:00
Piotr Krzemiński
054eea3c5a
[SAMPLES/PYTHON] Fix ACCESS_VIOLATION error when importing cv2 (#13443)
* [PYTHON] CV2 module required only when loading images

* [PYTHON] Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py

Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>

* [PYTHON] Make CV import not global

* [PYTHON] Update format of inputs_filling.py

* [PYTHON] Fix missing newline

* Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py

Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>

* [BENCHMARK_APP/PYTHON] Introduce exception when module is installed but fails to import

* [SAMPLES/PYTHON] Sporadic access violation fix through checking whether module was cached

Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2022-11-11 04:10:20 +03:00
OlehKravchyshyn
3443079a7b
[GPU] gemm batch format support (#12474) 2022-11-10 16:01:38 -08:00
Tomasz Jankowski
5eef0298d9
Transformation component transition to OV namespace (phase 1) (#13469)
* Move GeluFusion into ov namespace

It required to move utils as well.

* Move AddFakeQuantizeFusion into ov namespace

* Move AlignEltwiseInputRanks into ov namespace

* Move BatchToSpaceFusion into ov namespace

* Move BinarizeWeights into ov namespace

* Move BroadcastElementwiseFusion into ov namespace

* Move ClampFusion into ov namespace

* Move Concats and Eliminations into ov namespace

* Move many passes and such  into ov namespace

* Move many passes and such into ov namespace

ngraph_ops
op_conversions

* Move control_flow into ov namespace

* Apply style

* Move smart_reshape into ov namespace

* Move opset_conversions into ov namespace

* Move low_precision into ov namespace

* Apply style

* Move fused_names into ov namespace

* Add missing aliases

* Move few passes into ov namespace

ConvertPrecision
FixRtInfo
InitNodeInfo

* Move CommonOptimizations into ov namespace

* Fix convert_precision conflicting namespaces

* Apply code style

* ov-nize Type Relaxed definitions

* Remove useless aliases

bulkly added by script

* Revert opsets

* Address review comments

* Remove NGRAPH_RTTI

* Clean up remains of yet another implicit inclusion

Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2022-11-11 02:52:19 +03:00
Roman Lyamin
4dd75a1b8b
[GPU] Added Pad/Interpolate dynamic support and MVN dynamic tests (#13874)
* [GPU] Pad dynamic

* [GPU] Added MVN dynamic tests

* [GPU] Interpolate dynamic
2022-11-10 15:33:45 -08:00
Egor Duplenskii
c1733b5542
[CPU][LPT] Support quantized RNN (LSTM and GRU algorithms) (#12981) 2022-11-10 23:48:51 +03:00
Anastasia Kuporosova
96d835244c
[PyOV] Fix finding libs on windows (#13902)
* [PyOV] Fix finding libs on windows

* exclude install pkg dirs

* undo changes in setup.cfg

* change the logic
2022-11-10 21:32:47 +01:00
Ilya Churaev
63e24773ee
Added documentation for get_layout API (#13937)
* Added documentation for get_layout API

* Fixed typo
2022-11-10 18:10:07 +03:00
Oleksii Khovan
cf34d48e53
[GPU] MulticlassNMS (#13370)
* Single-layer test:
  - support both v8 and v9 in shared test;
  - add test for GPU.

* Transformation:
  - convert both v8 and v9 to internal operation;
  - add transformation to GPU pipeline.

* GPU primitive and CreateOp() for MulticlassNMS operation

* kernel stuff

* add unittests

* Added bs_fs_yx_bsv16_fsv32 format

* add int64 support

Co-authored-by: Mykhailo Hnap <mhnap@lohika.com>
2022-11-10 23:59:13 +09:00
Smirnova Maria
8f97ee55fc
Modify time tests so that data can be pushed to OVVP (#13636)
* Set db_api_handler for pushing to new database in timetests

* Change function of pushing to db.

Co-authored-by: Daria Ilina <daria.krupnova@intel.com>
2022-11-10 15:17:39 +01:00
Anastasia Kuporosova
0942c6617b
[PyOV] Add function which create unique names for test files (#13929) 2022-11-10 17:04:25 +03:00
Jan Iwaszkiewicz
d6fe686237
[PyOV] Bump version of pytest for compatibility API (#13932) 2022-11-10 16:55:42 +03:00
Marcin Kusmierski
25ad4a6728
[GNA] Create new tests for PWL approximation validation (#13515)
* added tests using new validation algorithm
* consolidated fp32eq usage by introducing is_fp_eq
* refactored float to int rounding methods
2022-11-10 11:32:19 +00:00
Andrey Churkin
dbb91c5e69
Minor changes to integrate AA algorithm into NNCF (#13765) 2022-11-10 13:17:50 +03:00
Roman Kazantsev
e2c320a455
[TF FE] Fix translator for Rank operation and test it (#13927)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-11-10 12:33:43 +03:00
Ilya Lavrenov
473bded2b2
Compile_tool is excluded from Debian / RPM (#13911)
* Compile_tool is excluded from Debian / RPM

* Removed warnings related to compile_tool

* Removed noarch for core-dev
2022-11-10 12:30:11 +04:00
Mingyu Kim
c478f7b266
Handle DT_UNKNOWN as DT_REG during file list-up (#13811)
* Handle DT_UNKNOWN as DT_REG during file list-up

Some filesystem does not return dt_type properly. (such as sshfs)
Without this fix, openvino fails to search frontend when mounted on
sshfs.

* style fix

* style fix
2022-11-10 12:21:45 +04:00
mdovbnia-lohika
1b2aff95a1
[GPU] Added blocked layouts support for roi_pooling operations (#12983)
* [GPU] Added unit tests for roi polling operations.

* [GPU] Added blocked layouts support for roi_pooling operations

* [GPU] Added single layer tests for roi polling operations.

* [GPU] Fix attach roi pooling impl, remov const from formats and types

* [GPU] Fix roi polling kernel, bilinear pooling operation

* Fix, whenever output_width and output_hight are equal to 1, which cause a dividing to 0.
* Fix, for proper calculation y and x.

Co-authored-by: Mykhailo Hnap <mhnap@lohika.com>
2022-11-09 22:37:12 -08:00
Taylor Yeonbok Lee
70cc27de53
[GPU] Fake alignment for fc kernel for improve dynamic shape perf improvement (#13887)
* Fake alignment infra + fake alignment for fc kernel for improve dynamic shape performance optimization

* Applied review

* Added unittest

* Removed unused function
2022-11-09 16:46:48 -08:00
Roman Kazantsev
aaefe0a256
[Common] Unique decomposition: fix the single element case (#13918)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-11-10 01:25:43 +03:00
Ilya Churaev
c7cd2645f4
Fix caching tests (#13928)
* Disabled set model

* Fixed sporadic fail
2022-11-09 22:55:27 +04:00
Sebastian Golebiewski
7d651a649f
DOCS: Fixing a list in Model Optimizer Extensibility - for master (#13380)
A minor fix that creates a list of main transformations responsible for a layout change.
2022-11-09 17:39:06 +01:00
Mateusz Mikolajczyk
1c03be58ff
[CORE] IsFinite, IsInf, IsNan reference implementation (#13621)
* Add reference implementation for Is ops

* FIx test

* Fix typo

* Remove deprecated

* Fix issues with API switch

* Force cast to float for float16/bfloat16 in ref

* Fix style

* Remove BWDCMP_RTTI

* Remove TensorVector helper check

* Remove evaluate functions

* Disable faling tests due to missing eval
2022-11-09 19:17:26 +03:00
Sebastian Golebiewski
5a50266dd7
DOCS: Fixing formatting in Multi Device (#13292) 2022-11-09 17:02:33 +01:00
Sebastian Golebiewski
95234490c2
Updating links in Model Optimization Guide (#13303)
Adding a link to Model Optimizer.

Porting:
https://github.com/openvinotoolkit/openvino/pull/13300
2022-11-09 16:59:07 +01:00
Sebastian Golebiewski
5941490d81
Fixing indentation in General Optimizations for master (#13305)
A minor fix that corrects indentation of snippets.

Porting:
https://github.com/openvinotoolkit/openvino/pull/13302
2022-11-09 16:54:04 +01:00
Maciej Smyk
3127c28a35
DOCS: Model Conversion Tutorials fix - Port to master (#13429) 2022-11-09 18:44:36 +03:00
Anastasia Kuporosova
e043dcbae7
fix markupsafe version (#13930) 2022-11-09 18:43:19 +04:00