Commit Graph

8954 Commits

Author SHA1 Message Date
Xiuchuan Zhai
9680617333
[CPU][Paddle] support paddle reverse op mapping and unittest (#12822)
* support paddle reverse op mapping and unittest

* Update reverse.cpp
2022-11-21 07:05:16 +04:00
Sungeun Kim
9d4d4888b2
[GPU] avoid to fuse reorder if the reorder could be fused. (#14019)
- Don't fuse reorder if the reorder is not input 0.
* add errta data types.

-add test cases
-get next.dep(0) only
2022-11-21 10:08:28 +09:00
Xiping Yan
2a7dc5404b
[Core/CC]Verify add_matcher scope for Conditinal Compilation. (#13148)
* My verification:
libopenvino.so original size: 10799560
After adding this patch, new size: 10684744

Reduce: (10799560 - 10684744)/1024.0 = 112.125K.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* try to fix clang issue

* Merge xuejun/cc_test

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Test

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* TEST1

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* TEST2

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Complete Add_matcher wraper.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* register_pass rebase

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix clang issue.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix some replace error.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* 1: Rename ADD_MATCHER_SCOPE_WITH_OBJ -> ADD_MATCHER_SCOPE;
2: Remove debug info;
3: Fix bug: REGISTER_PASS_WITH_FALSE_

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add ADD_MATCHER_SCOPE_WITHOUT_NSPACE macro

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix macro define issue.

* Add register_pass for cnn_network_ngraph_impl.cpp

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Try to fix vpux plugin fail issue.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix clang issue

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Merge macro "REGISTER_PASS_MODEL_SCOPE" and "REGISTER_PASS_FUNCTION_SCOPE" to "REGISTER_PASS_SCOPE"

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Rename "REGISTER_PASS_SCOPE_WITH_FALSE" to "REGISTER_DISABLED_PASS_SCOPE_WITH"

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Rename ADD_MATCHER_SCOPE_WITHOUT_OBJ to ADD_MATCHER_SCOPE_FOR_THIS
ADD_MATCHER_SCOPE_WITHOUT_NSPACE to ADD_MATCHER_SCOPE_FOR_THIS_WITHOUT_NSPACE

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* In order to implement CC, I have to move "StridesOptimization()" constructor to cpp file.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove "SCOPE" in macro.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Recover changes to fix clang issue.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove "REGISTER_PASS_MODEL_IF"

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* 1: Remove "ADD_MATCHER_FOR_THIS_WITHOUT_NSPACE";
2: Remove param "nspace" in Macro, replace with "using namespace " in local.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix missing update.

* For MACRO REGISTER_PASS:
1: Only keep a external macro define;
2: Judge 3 possibilities, if one of them is true, it will be disable;

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Optimize ADD_MATCHER_FOR_THIS.
-#    define ADD_MATCHER_FOR_THIS(region, ...)        add_matcher<region>(__VA_ARGS__);
+#    define ADD_MATCHER_FOR_THIS(region, ...)        ADD_MATCHER(this, region, __VA_ARGS__)

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Update src/common/conditional_compilation/include/openvino/cc/pass/itt.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/common/conditional_compilation/include/openvino/cc/pass/itt.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/common/conditional_compilation/include/openvino/cc/pass/itt.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/common/conditional_compilation/include/openvino/cc/pass/itt.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* clang format

* Update OR defiation in MACRO, increasing code scalability.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix window compiles error.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
Co-authored-by: xuejun <Xuejun.Zhai@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-11-20 19:02:42 +03:00
Anastasiia Pnevskaia
80b9a5eeae
compress_to_fp16 parameter in MO. (#13832)
* Added convert_to_fp16 param in MO.

* Deprecated data_type.

* Renamed param, made value optional.

* Docs update.

* Docs update.

* Docs update.

* Changed param description.

* Conflict fixed.

* Apply suggestions from code review

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>

* Param description correction.

* Corrected docs.

* Apply suggestions from code review

Co-authored-by: Pavel Esir <pavel.esir@gmail.com>

* Fixed docs.

* Small correction.

* Update docs/MO_DG/prepare_model/FP16_Compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/MO_DG/prepare_model/FP16_Compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/MO_DG/Deep_Learning_Model_Optimizer_DevGuide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update tools/mo/openvino/tools/mo/utils/cli_parser.py

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/MO_DG/prepare_model/Model_Optimizer_FAQ.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/get_started/get_started_demos.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/MO_DG/prepare_model/Model_Optimizer_FAQ.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
Co-authored-by: Pavel Esir <pavel.esir@gmail.com>
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2022-11-19 13:57:15 +00:00
Anastasiia Pnevskaia
558714ccdd
Support of passing model from memory to mo.convert_model() (#13457)
* convert() method added.

* Moved conversion to convert() method.

* Fixed commits.

* Output dir fix.

* Added objects support for extesions param.

* Added support for transformations_config extension objects.

* Input to str unit tests.

* Added tests, added comments.

* Updated BOM.

* Removed commented code.

* Fixed extension passing.

* Small corrections.

* Fixed for python 3.6.

* Small fix.

* Moved dir creating to ov.serialize(), removed mo.serialize(), small fixes.

* Small fix.

* Small correction.

* Removed coping of params, moved convert implemetation to separate module.

* Import fixes.

* Moved hiding of exceptions to main().

* Updated comment.

* Fixed unit tests.

* Comment changed.

* Fixed dir creating.

* Tests fixed.

* Small fixes.

* Test fix.

* Added meta data generation, removed printing of execution time for silent mode.

* Import fix.

* Conflict fix.

* Fixed error.

* Fix for custom config.

* Added version, data_type params to help.

* Added mo.convert() full-functional tests.

* Small corrections.

* Comment correction.

* Moved convert to openvino package, moved LayotMap and InputCutInfo to openvino.convert.

* Added help param.

* Wrong change removed.

* Small fix.

* Removed unnecessary comments.

* Removed .xml extension check from append_ir_info.

* Added missed file.

* Fixed error.

* Fix for bool value in InputCutInfo.

* Moved InputCutInfo, LayoutMap to openvino.tools.mo.

* Moved InputCutInfo, LayoutMap to openvino.tools.mo.

* Moved check and read_model to emit_ir.

* Small correction.

* Added comment.

* Added unit_tests with convert().

* Small corrections.

* Removed convert alias from openvino.

* Fixed conflicting unit tests.

* Removed unnecessary warnings.

* Params check fix.

* Small correction.

* Added paths checks.

* Added negative tests for to_str methods, fixed errors.

* Added tuples support in input parameter.

* Added direct support of BytesIO and TF1 graph def.

* Moved reminders to update OV and use API 2.0 to main().

* Fixed keras loading.

* Returned .mapping file generating.

* Added positional input_model param.

* Added test for unnamed input_model.

* Optimize imports.

* Added more informative error for brackets syntax in --input.

* Keras direct model support.

* Keras direct model support.

* Small fix.

* Conflict fix.

* Conflict fix.

* Added direct support of BytesIO and TF1 graph def.

* Fixed keras loading.

* Keras direct model support.

* Keras direct model support.

* Small fix.

* Tests for importing from memory.

* Support of other tf/pytorch formats.

* Updated mo_convert extensions tests to use ov models.

* Removed debug output.

* Implemented PyTorch converting logic.

* Small corrections.

* Small corrections.

* Added comments.

* Fixed for single input case.

* Added switching between save to file and BytesIO.

* Small fixes.

* Rename convert() to convert_model().

* Added env variable to disable converting to onnx.

* Tests refactoring.

* Add MO Python API tests to precommit.

* Add MO Python API tests to precommit.

* Added PyTorch to layer tests requirements.

* Added supported formats description.

* Fixed errors, added tests.

* Fixed bugs, added support of numpy and ov.Tensor sample_input.

* Added more torch.Size tests.

* Small correction.

* Renamed sample_input->example_inputs.

* Tests refactoring.

* Code style.

* Added support of dict in example_inputs.

* Small correction.

* Added removing of tmp onnx model in case of conversion error.

* Fix for lists of tensors in example_inputs.

* Support of dynamic axes for Keras layer, Keras module.

* Removed disabling of eager execution.

* Tests fixed.

* Added pytest requirement for layer tests.

* Added convert_model to openvino.runtime, fixed test runs.

* Small fix.

* Tests fix.

* Better help message.

* Error fixed.

* Renamed example_inputs->example_input.

* Small fix.

* Added support of list of layouts.

* Removed wrong change.

* Added tuple support for --layout.

* Removed convert_model from openvino.runtime.

* Use of default onnx opset version.

* Added support of dynamic input shapes without example_input.

* Made better error message.

* Removed stack trace from exceptions.

* Fixed tests.

* Small fix.

* Removed wrong change.

* Added import model from memory tests in unit tests.

* Replaced compare_functions() with MO IR reader compare.

* Removed test.

* Removed not needed change.

* Fixed conflicts.
2022-11-19 11:21:44 +03:00
Ivan Tikhonov
68e7f062c5
LowLatency v2 tests + resolving the review comments from PR 93758 (#14084)
* Enable SequenceFusion, TensorIteratorToSequence, GRUCellFusion transformation in MOC, the transformations have been deleted from plugin pipelines

* clean-up: delete augru transformation header

* Temporary disabled TensorIterator IR reader tests

* temporary disable tests, it's not TI issue, usqueeze doesn't have reference impl for fp64 and bf16

* Update ConvertTensorItearatorToSequence transformations: add Unsqueeze to pattern

* Codestyle

* Specify negative values for LSTM/GRU/RNN Sequence ops

* fix conflicts with master branch

* Insert ShapeOf subgraph in ConvertSequencesToTensorIterator transformation in case of dynamic input shape

* codestyle

* fix conflict with master branch

* fix onednn version

* Update low latency v2 to support GRU/RNN/LSTM Sequence ops, fix accuracy issue

* fix tensor names

* fix tensor name issue on gna

* fix transformation tests, fix copying rt_info in the transformation

* fix warning, enable bf16, f64 ti tests

* codestyle

* fix functional tests

* EliminateDuplicateTIInputs transformation, fix copy_with_new_inputs method of TI op

* move EliminateDuplicateTIInputs transformation

* codestyle

* add LLTv2 tests, resolve review comments

* resolve conflicts with master

Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
2022-11-19 10:57:44 +03:00
Nikita Malinin
ed643b3f74
[POT] Added GNA3.5 to the POT's devices list (#14071)
* Added GNA3.5 to the special devices list

* Remove cpp device filtration
2022-11-19 06:35:33 +03:00
guozhong wang
42b816ace7
set cpu affinity to numa in MULTI situation (#13407)
* change gpunum to 3

* hold threads for GPU for MULTI:GPU,CPU

* need to first check if there is a CPU in the device list

* use getNumberOfCPUCores to get CPU cores

* load GPU first

* assign the correct value to multiSContext->_devicePriorities

* load GPU first and load CPU last and set numa for CPU

* MULTI set CPU affinity to “NUMA” during load network

* Load the CPU last while maintaining the original device priority

* not using vector for CPU

* There is no user setting affinity in MULTI, and NUMA is set for the CPU

* pass key ENABLE_HYPER_THREAD to CPU plugin and merge xiaoxia PR

* set ENABLE_HYPER_THREAD to NO

* modify log

* Modify the code according to xiaoxia and wanglei comments

* Modify the code according to bell comments
2022-11-19 02:57:47 +00:00
Roman Kazantsev
384a961793
[TF FE] Break the cycle for NextIteration (#14063)
* [TF FE] Break the cycle for NextIteration

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix code-style

* Better to cut by outputs of operation creating the cycle

* Remove extra thing

* Add test model

* Add test for conversion of TF1 While

* Apply code-review feedback: use pointers and correct error message

* Remove extra check

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-11-19 03:31:11 +03:00
Sun Xiaoxia
9d8a03f90c
Limit the scope of hybrid_aware throughput setting (#14054)
* fix custom setting nstreams doesn't work due to the logic changed in ApplyPerformanceHints

* add same limitation for latency mode

* change bind core method to binding full physical core first, then logical core

* update custom setting streams and threads

* fix corner case when threads_per_stream is 1

* fix with comments

* add condition of big core stream is zero when binding core

Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-11-19 02:26:43 +03:00
Vladislav Vinogradov
96ad308380
Avoid gold linker usage in case of cross-compilation (#14097)
It might not be available in some cross-toolchains.

Extract the code for switching to gold linker into separate
CMake utility function to avoid duplication between multiple CMake scripts.
2022-11-19 01:19:01 +04:00
Andrei Kochin
a73fe4e351
Remove test for unqiue op to fix master (#14102)
* Remove test for unqiue op

Signed-off-by: andrei.kochin <andrei.kochin@intel.com>

* Remove test empty line

Signed-off-by: andrei.kochin <andrei.kochin@intel.com>
2022-11-19 01:17:55 +04:00
Ilya Lavrenov
ae32d0e5bf
Removed duplicated pdpd test requirement (#14083)
* Removed duplicated pdpd test requirement

* Fixed path in Azure CI Windows
2022-11-18 23:11:38 +04:00
Anastasiia Pnevskaia
c56cd93a28
Pass MO meta data to RT info (#13633)
* Moved MO meta data to RT info.

* Undo wrong change.

* Reformat code.

* Code reformat.

* Corrected error message.

* Test correction.

* Test fix.

* Updated MO IR Reader.

* Added testing of meta data for MO IR reader.

* Code corrections.

* Default params removed from meta data.

* Test corrected, fixed paths cropping.

* Small fix.

* Renamed legacy_path to legacy_frontend.

* Fixed error.
2022-11-18 23:08:35 +04:00
Ilya Lavrenov
684ad26449
Removed lintian warnings for U18 (#14091) 2022-11-18 20:05:33 +04:00
Katarzyna Mitrus
26bdf1ac63
[Unique-10] Add Unique op to PythonAPI (#14036)
* Add Unique op to PythonAPI

* Add Unique op to the compatibility PythonAPI

* Clean redundant imports and style

* Clean unused type
2022-11-18 16:59:22 +01:00
Ilya Lavrenov
74eede33e5
Updated copyright files for debian (#14089) 2022-11-18 19:34:58 +04:00
Anastasia Kuporosova
2142ed9363
[Docs][PyOV] Remove obsolete documentation file (#14098) 2022-11-18 16:30:11 +01:00
Evgenya Stepyreva
507086097d
Shape Inference: Unary and First-input-shape-Passthrough operators (#13492) 2022-11-18 15:43:48 +03:00
Nadezhda Ageeva
8588603506
Revert "[BENCHMARK_APP] Show input command in output (#13402)" (#14027)
This reverts commit f893a58816.
2022-11-18 14:43:41 +03:00
Ilya Churaev
198adbf266
Add profiler to document build scripts (#14029)
* Add profiler to document build scripts

* Add script name

* Use system doxygen and try to understand the build of each cmake target

* Revert doxygen

* Try to speed up documentation build

* Try to cache results

* Added cache for sphinx

* Remove profilers

* Fix install dependencies

* Restored config options

* Added ccache

* Cache python and update sphinx

* Update packaging

* Revert sphinx upgrade

* Don't need to clone recursive

* Revert "Don't need to clone recursive"

This reverts commit 7a2043df7b.

* Change cache apt action

* Updated ccache calls

* Don't use recursice init

* Update sphinx to 4.5

* Fixed indent

* Disable all custom code in theme

* Remove quite mode

* Revert "Disable all custom code in theme"

This reverts commit 096ca2f329.

* Removed dependency on python

* Disable code analyse

* Disable common functions

* Revert edit page

* Minimize the number of cycles for li

* Fixed is none

* Try to fix build

* Disable sidebar

* Revert "Disable sidebar"

This reverts commit 64303ee94f.

* Return raw html

* Removed private information

* Avoid generation multiple artifacts

* Added additional step to collect ccache

* Small change

* Fixed typo

* Added comments
2022-11-18 15:12:35 +04:00
Irina Efode
e075785486
[API CONFORMANCE] Remove skips for ov_plugin (#13749)
* ov_plugin

* fix graphs for cache

* fix build

* CPU + Template

* GNA

* Fix test

* sjkips

* sk

* extrs

* Update skip_tests_config.cpp

* try

* try
2022-11-18 14:46:32 +04:00
Anastasiia Pnevskaia
8f05bab594
PartialShape -> str methods alignment (MO, ov::core). (#13613)
* Added PartialShape from str constructor, added to_string() method.

* Small corrections.

* Moved shape parsing to PartialShape and Dimension classes.

* Fixed errors.

* Added tests for shapes with comma separator.

* Fixed tests.

* Test fixed.

* Fixed test.

* Fixed tests.

* Small fix.

* Removed usage of depricated method.

* Fix in MO IR reader.

* Tests fixed.

* Fix in MO IR reader.

* Test fixed.

* Shape class alignment.

* Code fixes.

* Code fixes.

* Used unnamed namespace.

* Undo change of Shape attribute adapter.

* Undo change of Shape attribute adapter.

* Removed unnecessary includes.

* Removed unnecessary code.

* Test fixed.

* Fix in MO IR reader.

* Moved check_all_digits() to ov::util.

* Moved check_all_digits() to src/core/src/.

* Clang format.

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Removed dimension_util file.

* Removed wrong change.

* Removed extra spaces from string representation of Shape.

* Test fixed.

* Added support of comma separator for value. Updated help.

* Returned old format shape serializing.

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-11-18 14:38:11 +04:00
Irina Efode
a1c9043b01
[CONFORMANCE] Fix Conformance runner -> Call Serialize (#14077) 2022-11-18 11:17:52 +01:00
Yuan Hu
ee47ffbab6
[CPU] Fixed creating a descriptor for a dilated convolution forward propagation primitive (#12276) 2022-11-18 14:17:02 +04:00
Tomasz Dołbniak
5ff0f5d84c
Unique-10 reference implementation (#13945)
* Basic Unique impl

* Shape inference tests

* More type prop tests

* Dynamic input tests

* Visitor tests

* Code formatting

* Minor corrections

* Modern c++ trick to make MSVC happy

* Refactor

* Code review

* More tests with dynamic shapes

* Op check test for Unique

* Well, a whitespace

* Different way of out shape calculation

* Spec

* Axis values constraint in the docs

* Zero-dim handling

* opset10_dump test adjustment

* 0D implementation and some test infra adjustments

* More coverage for scalar inputs

* type dependent test case generators

* A working version for 1D with all outputs

* Tensor shape calculation helper

* 1D handling with sorted mode included

* Handling of no-axis cases

* Some tests for no-axis case

* Unique's evaluate method

* A working fallback for the CPU plugin

* evaluate() removal

* Corrected shape inference

* More type prop fixes

* Unified axis extraction helpers

* Cleanup and preparation for slices processing

* Slice descriptor struct

* Static shapes generation with axis

* N-D solution with axis handling

* Slices comparison impl

* Fix Windows compilation errors

* Apply defaulting principles

Co-authored-by: Tomasz Jankowski <tomasz1.jankowski@intel.com>
2022-11-18 10:12:09 +01:00
Min, Byungil
bc90ed740f
[GPU] Modify perferred format of Reduce (#13977)
+ Do not select a planar format if keep_dims is false and blocked axis is reduced.

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-11-18 17:17:57 +09:00
guozhong wang
711feac6d8
disable SetPropertyOverwriteTestNoThrow for MULTI and AUTO (#14079) 2022-11-18 11:54:03 +04:00
Sergey Shlyapnikov
be277ab977
[GPU] Move device memory allocation from preprocessing stage to runtime for usm memory type (#13697)
* [GPU] Move device memory allocation from preprocessing stage to runtime to fix incorrect behaviour in case of tensor swapping

* [GPU] Apply review comments

* Replace source of dynamic layout cheking
2022-11-17 21:49:28 +03:00
Ilya Lavrenov
3c8578fd5b
Check debian packages buil (#14075) 2022-11-17 22:09:31 +04:00
Xuejun Zhai
0bc67ce1a7
[C API][DOC][PPP] Extend user documentation for new preproprocess api (#14008)
* [C API][DOC] correct the doxy group for ppp

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][DOC] improve the C API doc with new PPP interface

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2022-11-17 19:23:08 +03:00
Paul Youngsoo Ahn
094db2b3ae
[GPU] Fix cl kernel hang issue when x_block_size is 1 at the depthwise convolution(#14037) (#14037) 2022-11-17 19:11:56 +04:00
Liubov Talamanova
8d360ea3e6
[POT] Keep original out names in statistics collection (#14042) 2022-11-17 17:36:14 +04:00
Smirnova Maria
5cf6ceaf83
Fix db push for stresstest and timetests (#13964)
* Fix db push

* Fix log info for new data

* Check if file exists

* Remove _id field

* Add error message print
2022-11-17 12:52:21 +01:00
Ilya Lavrenov
0a08cfe2d6
Fixed post-commit on MacOS (#14040)
* Fixed post-commit on MacOS

* Removed unused function
2022-11-17 15:36:19 +04:00
Chenhu Wang
ade90b2043
[CPU] MVN nspc kernel optimization (#13268) 2022-11-17 15:31:08 +04:00
Ilya Churaev
807279276b
Removed PKGCONFIG_OpenVINO_REQUIRES_PRIVATE (#14033)
* Removed PKGCONFIG_OpenVINO_REQUIRES_PRIVATE

* Removed redundant call

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-11-17 12:40:33 +03:00
Ivan Tikhonov
5c0225d358
Enable conversions to LSTM/GRU/RNN Sequence in MOC (#13470)
* Enable SequenceFusion, TensorIteratorToSequence, GRUCellFusion transformation in MOC, the transformations have been deleted from plugin pipelines

* clean-up: delete augru transformation header

* Temporary disabled TensorIterator IR reader tests

* temporary disable tests, it's not TI issue, usqueeze doesn't have reference impl for fp64 and bf16

* Update ConvertTensorItearatorToSequence transformations: add Unsqueeze to pattern

* Codestyle

* Specify negative values for LSTM/GRU/RNN Sequence ops

* fix conflicts with master branch

* Insert ShapeOf subgraph in ConvertSequencesToTensorIterator transformation in case of dynamic input shape

* codestyle

* fix conflict with master branch

* fix onednn version

* Update low latency v2 to support GRU/RNN/LSTM Sequence ops, fix accuracy issue

* fix tensor names

* fix tensor name issue on gna

* fix transformation tests, fix copying rt_info in the transformation

* fix warning, enable bf16, f64 ti tests

* codestyle

* fix functional tests

* EliminateDuplicateTIInputs transformation, fix copy_with_new_inputs method of TI op

* move EliminateDuplicateTIInputs transformation

* codestyle
2022-11-17 13:27:20 +04:00
Sun Xiaoxia
0cab188059
fix num_cores is all threads with numactl command on two sockets platform (#13487) 2022-11-17 13:11:18 +04:00
Wang, Yang
678b90a661
[AUTO] Update property setting rules (#13848)
* [AUTO] update property setting logic.

* Update core::set_property() logic to only support primary property for AUTO and MULTI.
* Separate AUTO and MULTI supported properties.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* 1. revert the changes for ie core.
2. Enable AUTO/MULTI only accepting its own properties.
3. Enable AUTO/MULTI accepting device properties passed from loadnetwork().

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Revert "[AUTO]Update the incorrect config test for Myriad (#13271)"

This reverts commit 0552d98802.

* MULTI only accepts its own properties that is same as AUTO currently.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add test cases for AUTO/MULTI property test.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update to enable MULTI supporting hw primary property setting throw the compile_model().

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Remove the added test case for setting secondary property through set_property().

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* 1. For AUTO/MULTI, property setting will be passed via core::compile_model() instead of core::set_property().
2. update the logic to infer precision setting that will transform into secondary property setting to each hw device.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* set default value for nstreams when -d AUTO/MULTI and no nstreams setting from command line.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update code format.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Enable BA to support if -d AUTO:MULTI,xxx/MULTI:AUTO,xxx. while AUTO Plugin need to update the logic of generating supported config list to virtual device.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* move device configuration handling outside form function main.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Revert "move device configuration handling outside form function main."

This reverts commit ef77bfc602.

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Setting property performance hint to 'THROUGHPUT' and passing to executable network if no setting for of AUTO/MULTI.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2022-11-17 16:38:47 +08:00
Oleg Pipikin
7c4b7355e6
Delete serialization tests from ieFuncTests (#13804)
* Delete serialization tests from ieFuncTests

* Extend visitor tests to improve coverage

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2022-11-17 11:48:45 +04:00
Evgenya Stepyreva
7d670c5e5f
Restore quantized Group Convolution weights (#13659)
* Introduce allow_fold

* Update ShapeOfConstFolding.py

* Update ShapeOfConstFolding.py

* Update ShapeOfConstFolding.py
2022-11-17 11:12:55 +04:00
Chen Xu
e7c8d6fe63
[CPU] Fix incorrect offset to rsp in BF16 DW Convolution kernel (#13669) 2022-11-17 10:21:47 +04:00
Zhang Yi
7860d3bf78
[CPU] Int8 Interaction node support (#13486) 2022-11-17 10:13:16 +04:00
Ilya Lavrenov
c51ee524ad
Tuned wheels build (#14038) 2022-11-17 00:03:34 +04:00
Ruslan Nugmanov
af7adf2d46
removes frontend lib paths (#14030) 2022-11-16 19:51:05 +04:00
Przemyslaw Wysocki
4cb0c73cef
[PyOV] Update supported Python versions on PyPI pages (#13151) 2022-11-16 13:23:50 +01:00
Ilya Churaev
a410157b67
Fixed macOS stress_tests build with PKG config (#14004) 2022-11-16 15:27:01 +04:00
Eddy Kim
8a2b1c9cf9
updated memory accessor (#14020) 2022-11-16 14:07:26 +03:00
Ilya Churaev
6da7ee3431
Updated documentation for serialize model (#14022) 2022-11-16 14:50:59 +04:00