Commit Graph

8793 Commits

Author SHA1 Message Date
Anastasiia Pnevskaia
74758c0ca5
copy() and deepcopy() methods for PartialShape. (#14136)
* Added copy and deepcopy methods for PartialShape.

* Clang format.
2022-11-23 01:09:30 +04:00
Anastasiia Pnevskaia
256b27c381
Fix for MO IR reader loading old meta data. (#14171)
* Fix for IR reader loading.

* Condition fix.
2022-11-22 22:06:32 +04:00
Anastasiia Pnevskaia
83e41d5d88
Fixed layout parsing. (#14157)
* Fixed layout parsing.

* Small fix.

* Test fixed.
2022-11-22 22:06:22 +04:00
Maxim Vafin
580c0c6b90
Fix squeeze shape infer to not change axis value (#13975)
* Fix squeeze shape infer to not change axis value

* Fix TensorIterator

* Revert Unsqueeze changes
2022-11-22 21:24:03 +04:00
Felix Dohyun Kim
2176e8f13c
[GPU][DG2] Add fuse_count_onednn in test parameter (#14106) 2022-11-23 00:32:35 +09:00
Ilya Churaev
55b672b3dd
Fixed link to developer documentation (#14149) 2022-11-22 18:02:02 +04:00
Asthestarsfalll
2edb9f7775
add paddle box coder (#12394)
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2022-11-22 15:20:46 +03:00
Mikhail Ryzhov
7244f1227d
Removed unnecessary convertation nodes to output (#14125) 2022-11-22 11:25:07 +01:00
Ryszard Jezierski
e205538129
[GNA plugin] Fix issues from static code analysis (#13432)
* fix static code analysis

* reverted manual ostream flags reset
2022-11-22 11:24:09 +01:00
hyunback kim
c1bb0b59e7
[GPU] Fix kernel build failed issue (#14007)
* [GPU] Fix kernel build failed issue

redefinition of 'eltwise0_data0' FUSED_OPS_PRELOAD
Target model: cocosnet/onnx/INT8

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-11-22 19:03:21 +09:00
Eddy Kim
0b1e36600b
[GPU] Graph serialization for GPU #2 (#13986)
* moved serialization include path

* quiet onednn-gpu patching

* save and load kernels in _impls

* changed to use OPENVINO_ASSERT

* fix errata

* updated to follow OpenVINO naming convention

* updated error messages

* binary buffer by vector<uint8_t>

* partial_shape serialization

* removed object_type

* added a new storage class for primitive_type_string and id

* updated to throw an exception when _node is null in build_deps().

* removed redundant memory_pool clearing

* added a new net_id creator

* newline at eof

* updated CLDNN with GPU

* added cache blob descriptions

* updated output allocation logic  in serialization

* added ov::device::architecture in supported properties

* overrided save and load in data_inst and mutable_data_inst

* removed save and load functions in mutable_data

* baseline for serialization unit tests

* added serialization unit tests

* added serialization unit tests

* updated not to execute build_deps when deserialized

* make_data without namespace

* updated to use default layout c-tor

* updated get_unique_net_id()

* updated get_type_id() to a pure virtual method

* updated ov::caching_properties

* added [GPU] tags

* updated network c-tor

* updated unit tests
2022-11-22 12:43:50 +03:00
Vitaliy Urusovskij
97878dee34
Load plugin libraries safely (#14034)
For security purposes load plugin libraries only by absolute path to prevent
search from environment variables, working directory etc.
2022-11-22 12:44:56 +04:00
Xuejun Zhai
1910f42179
[C API DOC][DG] C API developer documentation (#13499)
* [C API DOC] add c api docs

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Update OpenVINO_Runtime_C_API_User_Guide.md

Add mapping relationship about C++ API 2.0 and C API

* [C API][DG] Add some roles for developping C API

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API DOC][DG] Implement the developer guide

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API DOC][DG] Fix comments

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API DOC][DG] Fix format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][DG] Fix review issues including add reference link, clear description

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][DOC] Fix review comments

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][DOC] remove the mapping relationship of interface & object

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][DOC] Fix review comments

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][DOC] add descriptions for unit test

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2022-11-22 10:38:17 +04:00
Fang Xu
8786fbe0c3
update tbb linux and mac binaries (#14080)
Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-11-22 14:33:52 +08:00
Mateusz Tabaka
47acda3476
Cleanup in Split mask propagation transformation (#14119)
* Cleanup in Split mask propagation transformation

* review comments
2022-11-22 10:25:58 +04:00
Ivan Tikhonov
81c579fd2a
fix inference of some with TensorIterator (#14108) 2022-11-22 10:17:58 +04:00
River Li
bf5b7a5fec
[DOC] Add developer guide for conditional compilation (#13852)
* Add developer guide for conditional compilation

Change-Id: If769ce1afc045e678b5816ed6ae903ba48a5a320

* Use reference to real code as example

Change-Id: I21f6aa47dfdf4ab7e92424a3ccc3d7524cc4b762

* Add table for macros

Change-Id: I9503d801ebe67ea5c6e525e02a21a7295ba56bc6

* Update for more clear description

Change-Id: I83b39f4a2462fb47ad1537e9747a2bb4a031dab9

* Use refer link replace code snippet

Change-Id: I5e63302718ab02eb4bd7a28ae994c8e5e26e0e02

* Add README.md for CC

Change-Id: I90abe73297deb5f55f219c15b093a02a30f9e8b5

* Update README.md

Change-Id: I8199252cb24fdacba16ea8b9fac63f6f47e4f1e3

* Add link list to doc

Change-Id: Id9a512cf8998cf18795cc0ac096fbbf89b28941c
2022-11-22 09:28:01 +04:00
Vladimir Paramuzov
dfb31f485b
[GPU] Insert reorder for eltwise const dependency (#14013)
* [GPU] Insert reorder for eltwise const dependency

* [GPU] Fixes for const reorder logic. Updated one codegnerator config
2022-11-22 09:10:00 +04:00
Oleg Pipikin
6b4b01aecf
Move transformation and lp transformations tests from IeFuncTests and IeUnitTests (#14096)
* Move transformation and lp transformations tests from IeFuncTests and IeUnitTests

* Enable tests in Azure CI

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2022-11-22 07:46:19 +04:00
Taylor Yeonbok Lee
dc3d5755cf
[GPU] Fix dynamic shape accuracy issue w.r.t crop (#14104)
* Fix wrong dependency issue to split/variadic split issue

* Added variadic split test

* minor changes
2022-11-22 06:21:26 +03:00
Sungeun Kim
9bcc730bec
check prev is next's dep(0). (#14107) 2022-11-22 12:05:28 +09:00
Jade Cho
4c0b8e6ebd
[GPU] Prevent that tanh is fused (#13976) 2022-11-22 10:33:48 +09:00
Mateusz Bencer
a693f4efac
[ONX FE][Quantize/DeQuantize] Ignore the axis attribute for scalar scale/zero_point (#14049) 2022-11-22 03:34:30 +03:00
Katarzyna Mitrus
adea538ba7
Fix Unique op python tests (#14118) 2022-11-22 02:50:08 +03:00
Katarzyna Mitrus
052a32be57
Add default to switch (#14110) 2022-11-21 23:59:23 +04:00
Oleg Pipikin
8134eba818
Fix typo in test executable (#14116) 2022-11-21 23:59:09 +04:00
Ilya Lavrenov
bbd6c03817
Fixed manylinux2014 with system TBB (#14126) 2022-11-21 20:43:22 +04:00
Egor Duplenskii
2d01ad3f18
[CPU] Fix seg fault in oneDNN 'parallel' with ITT built (#14048) 2022-11-21 20:11:03 +04:00
Irina Efode
68b6b273c5
[CONFORMANCE] Fix API Conformance run according changed functions (#14112)
* [CONFORMANCE] Fix API Conformance run according changed functions

* def para
2022-11-21 18:49:44 +03:00
Jan Iwaszkiewicz
abdcaef36d
[PyOV] Add README.md and align structure-showing style (#14093)
* [PyOV] Add README.md and align structure-showing style

* First batch of review changes

* Remove README from compatibility files

* Add note about coding style rules

* Add note about coding style rules pt2

* Update Components

* Apply fixes
2022-11-21 16:42:36 +01:00
Min, Byungil
0cf319f855
[GPU] Apply cached_blob to make engine (#13781)
+ Updated oneDNN to use cache_blob
+ Updated oneDNN to fix group conv failure
+ Add g_os_iyx_osv8 format and relevant reorder to support oneDNN update
+ Used cached_blob to make engine if cache_dir config is used

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-11-21 22:52:18 +09:00
Evgeny Kotov
0846bdb67e
Transpose sinking on passes for Concat, Split and binary eltwise operations (#13718)
* initial

* clang cleanup fixes

* remove TrasposeAxis function; cleanup namespaces

* fix TransposeInputsInfo spell

* one_input_transpose spell

* cleanup speel

* spell

* decompose forward sinking

* decompose backward sink

* use NodeVector

* clang cleanup

* decomposite transformations into different files

* decompose unit tests

* clang cleanup

* azure build fixes

* code review fixes

* clang cleanup fixes
2022-11-21 16:24:26 +04:00
Mateusz Tabaka
738d7bb09f
Remove ov::JsonConfigExtension (#14087)
Ticket: 96278

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-11-21 15:06:08 +04:00
Luo Cheng
cf7b174bf9
[CPU] Use brgconv1x1 instead of inner product in some cases (#13715) 2022-11-21 15:00:49 +04:00
Tomasz Adamowicz
47e80200dd
[GNA] Add 1DConv validator for GNA 3.5 (#13866)
* [GNA] Add 1DConv validator for GNA 3.5

* Improve gna lib version parser

* [GNA] Enable exec target=GNA_TARGET_3_5 testing
2022-11-21 09:01:07 +00:00
Alina Kladieva
0b97ab48a3
Revert "Fixed manylinux2014 with system TBB (#14076)" (#14113)
This reverts commit cfb21de775.
2022-11-21 09:56:24 +01:00
Ilya Lavrenov
cfb21de775
Fixed manylinux2014 with system TBB (#14076)
Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-11-21 09:54:57 +01:00
Luo Cheng
40089bdef7
[CPU] MergeTransposeAndReorder incorrectly removed const (#14067) 2022-11-21 11:18:57 +03:00
Xuejun Zhai
05ed3e218b
[C Sample][Readme] correct C sample read me (#14052)
* [C Sample][Readme] correct C sample read me

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [C API][Sample] modify readme about api list

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2022-11-21 08:03:53 +04:00
Xiuchuan Zhai
9680617333
[CPU][Paddle] support paddle reverse op mapping and unittest (#12822)
* support paddle reverse op mapping and unittest

* Update reverse.cpp
2022-11-21 07:05:16 +04:00
Sungeun Kim
9d4d4888b2
[GPU] avoid to fuse reorder if the reorder could be fused. (#14019)
- Don't fuse reorder if the reorder is not input 0.
* add errta data types.

-add test cases
-get next.dep(0) only
2022-11-21 10:08:28 +09:00
Xiping Yan
2a7dc5404b
[Core/CC]Verify add_matcher scope for Conditinal Compilation. (#13148)
* My verification:
libopenvino.so original size: 10799560
After adding this patch, new size: 10684744

Reduce: (10799560 - 10684744)/1024.0 = 112.125K.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* try to fix clang issue

* Merge xuejun/cc_test

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Test

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* TEST1

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* TEST2

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Complete Add_matcher wraper.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* register_pass rebase

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix clang issue.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix some replace error.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* 1: Rename ADD_MATCHER_SCOPE_WITH_OBJ -> ADD_MATCHER_SCOPE;
2: Remove debug info;
3: Fix bug: REGISTER_PASS_WITH_FALSE_

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add ADD_MATCHER_SCOPE_WITHOUT_NSPACE macro

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix macro define issue.

* Add register_pass for cnn_network_ngraph_impl.cpp

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Try to fix vpux plugin fail issue.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix clang issue

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Merge macro "REGISTER_PASS_MODEL_SCOPE" and "REGISTER_PASS_FUNCTION_SCOPE" to "REGISTER_PASS_SCOPE"

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Rename "REGISTER_PASS_SCOPE_WITH_FALSE" to "REGISTER_DISABLED_PASS_SCOPE_WITH"

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Rename ADD_MATCHER_SCOPE_WITHOUT_OBJ to ADD_MATCHER_SCOPE_FOR_THIS
ADD_MATCHER_SCOPE_WITHOUT_NSPACE to ADD_MATCHER_SCOPE_FOR_THIS_WITHOUT_NSPACE

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* In order to implement CC, I have to move "StridesOptimization()" constructor to cpp file.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove "SCOPE" in macro.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Recover changes to fix clang issue.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove "REGISTER_PASS_MODEL_IF"

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* 1: Remove "ADD_MATCHER_FOR_THIS_WITHOUT_NSPACE";
2: Remove param "nspace" in Macro, replace with "using namespace " in local.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix missing update.

* For MACRO REGISTER_PASS:
1: Only keep a external macro define;
2: Judge 3 possibilities, if one of them is true, it will be disable;

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Optimize ADD_MATCHER_FOR_THIS.
-#    define ADD_MATCHER_FOR_THIS(region, ...)        add_matcher<region>(__VA_ARGS__);
+#    define ADD_MATCHER_FOR_THIS(region, ...)        ADD_MATCHER(this, region, __VA_ARGS__)

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Update src/common/conditional_compilation/include/openvino/cc/pass/itt.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/common/conditional_compilation/include/openvino/cc/pass/itt.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/common/conditional_compilation/include/openvino/cc/pass/itt.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/common/conditional_compilation/include/openvino/cc/pass/itt.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* clang format

* Update OR defiation in MACRO, increasing code scalability.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix window compiles error.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
Co-authored-by: xuejun <Xuejun.Zhai@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-11-20 19:02:42 +03:00
Anastasiia Pnevskaia
80b9a5eeae
compress_to_fp16 parameter in MO. (#13832)
* Added convert_to_fp16 param in MO.

* Deprecated data_type.

* Renamed param, made value optional.

* Docs update.

* Docs update.

* Docs update.

* Changed param description.

* Conflict fixed.

* Apply suggestions from code review

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>

* Param description correction.

* Corrected docs.

* Apply suggestions from code review

Co-authored-by: Pavel Esir <pavel.esir@gmail.com>

* Fixed docs.

* Small correction.

* Update docs/MO_DG/prepare_model/FP16_Compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/MO_DG/prepare_model/FP16_Compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/MO_DG/Deep_Learning_Model_Optimizer_DevGuide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update tools/mo/openvino/tools/mo/utils/cli_parser.py

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/MO_DG/prepare_model/Model_Optimizer_FAQ.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/get_started/get_started_demos.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/MO_DG/prepare_model/Model_Optimizer_FAQ.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
Co-authored-by: Pavel Esir <pavel.esir@gmail.com>
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2022-11-19 13:57:15 +00:00
Anastasiia Pnevskaia
558714ccdd
Support of passing model from memory to mo.convert_model() (#13457)
* convert() method added.

* Moved conversion to convert() method.

* Fixed commits.

* Output dir fix.

* Added objects support for extesions param.

* Added support for transformations_config extension objects.

* Input to str unit tests.

* Added tests, added comments.

* Updated BOM.

* Removed commented code.

* Fixed extension passing.

* Small corrections.

* Fixed for python 3.6.

* Small fix.

* Moved dir creating to ov.serialize(), removed mo.serialize(), small fixes.

* Small fix.

* Small correction.

* Removed coping of params, moved convert implemetation to separate module.

* Import fixes.

* Moved hiding of exceptions to main().

* Updated comment.

* Fixed unit tests.

* Comment changed.

* Fixed dir creating.

* Tests fixed.

* Small fixes.

* Test fix.

* Added meta data generation, removed printing of execution time for silent mode.

* Import fix.

* Conflict fix.

* Fixed error.

* Fix for custom config.

* Added version, data_type params to help.

* Added mo.convert() full-functional tests.

* Small corrections.

* Comment correction.

* Moved convert to openvino package, moved LayotMap and InputCutInfo to openvino.convert.

* Added help param.

* Wrong change removed.

* Small fix.

* Removed unnecessary comments.

* Removed .xml extension check from append_ir_info.

* Added missed file.

* Fixed error.

* Fix for bool value in InputCutInfo.

* Moved InputCutInfo, LayoutMap to openvino.tools.mo.

* Moved InputCutInfo, LayoutMap to openvino.tools.mo.

* Moved check and read_model to emit_ir.

* Small correction.

* Added comment.

* Added unit_tests with convert().

* Small corrections.

* Removed convert alias from openvino.

* Fixed conflicting unit tests.

* Removed unnecessary warnings.

* Params check fix.

* Small correction.

* Added paths checks.

* Added negative tests for to_str methods, fixed errors.

* Added tuples support in input parameter.

* Added direct support of BytesIO and TF1 graph def.

* Moved reminders to update OV and use API 2.0 to main().

* Fixed keras loading.

* Returned .mapping file generating.

* Added positional input_model param.

* Added test for unnamed input_model.

* Optimize imports.

* Added more informative error for brackets syntax in --input.

* Keras direct model support.

* Keras direct model support.

* Small fix.

* Conflict fix.

* Conflict fix.

* Added direct support of BytesIO and TF1 graph def.

* Fixed keras loading.

* Keras direct model support.

* Keras direct model support.

* Small fix.

* Tests for importing from memory.

* Support of other tf/pytorch formats.

* Updated mo_convert extensions tests to use ov models.

* Removed debug output.

* Implemented PyTorch converting logic.

* Small corrections.

* Small corrections.

* Added comments.

* Fixed for single input case.

* Added switching between save to file and BytesIO.

* Small fixes.

* Rename convert() to convert_model().

* Added env variable to disable converting to onnx.

* Tests refactoring.

* Add MO Python API tests to precommit.

* Add MO Python API tests to precommit.

* Added PyTorch to layer tests requirements.

* Added supported formats description.

* Fixed errors, added tests.

* Fixed bugs, added support of numpy and ov.Tensor sample_input.

* Added more torch.Size tests.

* Small correction.

* Renamed sample_input->example_inputs.

* Tests refactoring.

* Code style.

* Added support of dict in example_inputs.

* Small correction.

* Added removing of tmp onnx model in case of conversion error.

* Fix for lists of tensors in example_inputs.

* Support of dynamic axes for Keras layer, Keras module.

* Removed disabling of eager execution.

* Tests fixed.

* Added pytest requirement for layer tests.

* Added convert_model to openvino.runtime, fixed test runs.

* Small fix.

* Tests fix.

* Better help message.

* Error fixed.

* Renamed example_inputs->example_input.

* Small fix.

* Added support of list of layouts.

* Removed wrong change.

* Added tuple support for --layout.

* Removed convert_model from openvino.runtime.

* Use of default onnx opset version.

* Added support of dynamic input shapes without example_input.

* Made better error message.

* Removed stack trace from exceptions.

* Fixed tests.

* Small fix.

* Removed wrong change.

* Added import model from memory tests in unit tests.

* Replaced compare_functions() with MO IR reader compare.

* Removed test.

* Removed not needed change.

* Fixed conflicts.
2022-11-19 11:21:44 +03:00
Ivan Tikhonov
68e7f062c5
LowLatency v2 tests + resolving the review comments from PR 93758 (#14084)
* Enable SequenceFusion, TensorIteratorToSequence, GRUCellFusion transformation in MOC, the transformations have been deleted from plugin pipelines

* clean-up: delete augru transformation header

* Temporary disabled TensorIterator IR reader tests

* temporary disable tests, it's not TI issue, usqueeze doesn't have reference impl for fp64 and bf16

* Update ConvertTensorItearatorToSequence transformations: add Unsqueeze to pattern

* Codestyle

* Specify negative values for LSTM/GRU/RNN Sequence ops

* fix conflicts with master branch

* Insert ShapeOf subgraph in ConvertSequencesToTensorIterator transformation in case of dynamic input shape

* codestyle

* fix conflict with master branch

* fix onednn version

* Update low latency v2 to support GRU/RNN/LSTM Sequence ops, fix accuracy issue

* fix tensor names

* fix tensor name issue on gna

* fix transformation tests, fix copying rt_info in the transformation

* fix warning, enable bf16, f64 ti tests

* codestyle

* fix functional tests

* EliminateDuplicateTIInputs transformation, fix copy_with_new_inputs method of TI op

* move EliminateDuplicateTIInputs transformation

* codestyle

* add LLTv2 tests, resolve review comments

* resolve conflicts with master

Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
2022-11-19 10:57:44 +03:00
Nikita Malinin
ed643b3f74
[POT] Added GNA3.5 to the POT's devices list (#14071)
* Added GNA3.5 to the special devices list

* Remove cpp device filtration
2022-11-19 06:35:33 +03:00
guozhong wang
42b816ace7
set cpu affinity to numa in MULTI situation (#13407)
* change gpunum to 3

* hold threads for GPU for MULTI:GPU,CPU

* need to first check if there is a CPU in the device list

* use getNumberOfCPUCores to get CPU cores

* load GPU first

* assign the correct value to multiSContext->_devicePriorities

* load GPU first and load CPU last and set numa for CPU

* MULTI set CPU affinity to “NUMA” during load network

* Load the CPU last while maintaining the original device priority

* not using vector for CPU

* There is no user setting affinity in MULTI, and NUMA is set for the CPU

* pass key ENABLE_HYPER_THREAD to CPU plugin and merge xiaoxia PR

* set ENABLE_HYPER_THREAD to NO

* modify log

* Modify the code according to xiaoxia and wanglei comments

* Modify the code according to bell comments
2022-11-19 02:57:47 +00:00
Roman Kazantsev
384a961793
[TF FE] Break the cycle for NextIteration (#14063)
* [TF FE] Break the cycle for NextIteration

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix code-style

* Better to cut by outputs of operation creating the cycle

* Remove extra thing

* Add test model

* Add test for conversion of TF1 While

* Apply code-review feedback: use pointers and correct error message

* Remove extra check

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-11-19 03:31:11 +03:00
Sun Xiaoxia
9d8a03f90c
Limit the scope of hybrid_aware throughput setting (#14054)
* fix custom setting nstreams doesn't work due to the logic changed in ApplyPerformanceHints

* add same limitation for latency mode

* change bind core method to binding full physical core first, then logical core

* update custom setting streams and threads

* fix corner case when threads_per_stream is 1

* fix with comments

* add condition of big core stream is zero when binding core

Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-11-19 02:26:43 +03:00
Vladislav Vinogradov
96ad308380
Avoid gold linker usage in case of cross-compilation (#14097)
It might not be available in some cross-toolchains.

Extract the code for switching to gold linker into separate
CMake utility function to avoid duplication between multiple CMake scripts.
2022-11-19 01:19:01 +04:00