Wanglei Shen
0974cb10bc
add socket id initialization in MacOS ( #18717 )
2023-07-21 18:49:36 +00:00
Mikhail Ryzhov
85ca561546
[GNA] Transpose compressing ( #18608 )
2023-07-21 14:36:30 +00:00
Ekaterina Aidova
40e9ad106e
Fix PyTorch FE build with clang compiler ( #18709 )
...
* fix build
* Update src/frontends/pytorch/src/op/rand.cpp
* fix code style
---------
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-07-21 18:08:24 +04:00
Wanglei Shen
98026d420f
update proc_type_table for MacOS ( #18702 )
2023-07-21 21:13:28 +08:00
Sofya Balandina
12a7ed9bdd
[apiConformance] Fix run_confoormance fails after exclusion opset tests ( #18710 )
2023-07-21 16:57:09 +04:00
Sergey Lyalin
329200cc62
New save_model function (C++, Python) ( #18656 )
...
* Draft version of save_model function (C++, Python)
* Fixed code style.
* Fixed incorrect test model construction for Python save_model tests
* Minor improvements in code readability
* Minor adjustment based on PR review
2023-07-21 16:03:53 +04:00
Ilya Churaev
44cae128cc
Restore information about Blob layout for new plugins ( #18696 )
...
* Restore information about Blob layout for new plugins
* Save legacy names
2023-07-21 14:28:55 +04:00
Piotr Krzemiński
e076ed4726
[PT FE] Quantized Add, Add_ReLU, Mul, Hardswish ( #18510 )
...
* Support GetAttr with packed params
* Apply suggestions from code review
* [PT FE] Add quantized types as normal types to decoder
* [PT FE] Add decoder dequantize, add dtypes to quantize
* [PT FE] Add dequantize example
* [PT FE] Implement replacer for quantized nodes
* [PT FE] Register replacer for quantize/dequantize
* [PT FE] Remove unwanted junk from previous version
* [PT FE] Fix building mistakes for frontend
* [PT FE] Clang fix
* [PT FE] Ease of use upgrade to quantize funcs
* [PT FE] Clang format
* [PT FE] Introduce new version of quantize/dequantize
* [PT FE] Remove unwanted files from new version
* [PT FE] Fix style
* [PT FE] Add QuantizedPtNode replacer, fix accuracy error
* [PT FE] Quantized add
* [PT FE] Add improved version of quantize/dequantize with shared_ptrs
* [PT FE] Quantized Add Relu
* [PT FE] Fix utils shared ptr reference error
* [PT FE] Quantized Hardswish & tests
* [PT FE] Add quantized_add_relu test
* [PT FE] Quantize now takes correct input for operations
* [PT FE] Add dtype to tests
* [PT FE] Increase matrix size in the tests to cover more edge cases
* [PT FE] Upgrade quantize method
* [PT FE] Add BFS for dequantize, add quantize_per_channel
* [PT FE] Add missing replacer to frontend, improve tests
* [PT FE] Rename replacer -> remover, remove unwanted header files
* [PT FE] Change function declarations to return ov::Output instead of shared ptr
* [PT FE] Add missing context mark node
* [PT FE] Remove unknown modifications to ie_c_api
* [PT FE] Remove fp16 support, turn off int32 tests
* [PT FE] Clang format
* [PT FE] Fix quantize_per_tensor
* [PT FE] Minor fixes from review
* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead
* [PT FE] Rename Replacer to Remover for dequantize nodes
* [PT FE] Clang format
* [PT FE] Move comments to header files, minor import fixes
* [PT FE] Enable add, add_relu, mul, hardswish with newest quantize ops
* [PT FE] Fix clang format
* [PT FE] Fix dtype issue
* [PT FE] Reenable hardswish tests
* [PT FE] Fix building error for quantized ops
* [PT FE] Tests now use rand instead of randn
* [PT FE] Remove int32 support from tests
* [PT FE] Fix quantize_per_channel tests
* Apply suggestions from code review
Removing sporadic tests from precommit
* Apply suggestions from code review
* [PT FE] Mark qint32 with skip, remove precommit flag due to sporadic errors
* [PT FE] Introduce quantized test for PytorchTestClass
* [PT FE] Add missing tensor size in the errors count computation
* Update pytorch_layer_test_class.py
* [PT FE] Apply suggestions from review - remove contexts, log100 for errors, add precommit flags
* Apply suggestions from code review
* [PT FE] Fix quantize per channel test after merge
* Update tests/layer_tests/pytorch_tests/pytorch_layer_test_class.py
* Update pytorch_layer_test_class.py
* Update test_quantize.py
* Apply suggestions from code review
* [PT FE] Fix quantized mul by changing default quantization dtype
* Update pytorch_layer_test_class.py
* Update tests/layer_tests/pytorch_tests/pytorch_layer_test_class.py
* Update src/frontends/pytorch/src/utils_quantize.cpp
* Update src/frontends/pytorch/src/utils_quantize.cpp
* Update tests/layer_tests/pytorch_tests/test_quantized_mul.py
---------
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-07-21 10:27:35 +00:00
Ekaterina Aidova
a6e25d69ac
[PT FE] supoort aten::rand, aten::randn, aten::rand_like, aten::randn_like ( #18616 )
...
* support aten::rand, aten::randn, aten::rand_like, aten::randn_like
* fixes
2023-07-21 13:27:48 +04:00
Irina Efode
0ff70a0649
[CONFORMANCE] Extend SubgraphsDumper by graph cache + subgraph extractors ( #18398 )
...
* New Subgraph Dumper -> Cache + Meta
* iCache tests
* tests_meta
* OpCache tests
* Move & refactor matchers
* fix all tests and refactor meta
* Prepare for review
* Add caching types
* Model testing + improvement
* Add ignored ports. Add tests for node utils
* [CONFORMANCE] MOVE conformance runner to new subgraphsDumper
* fix build
* Fix compilation error
* fix compilation of deprecated subgraphs dumper
* fix build
* arm
* fix win?
* temp commit
* revert
* Add w/a to save const
* [IE TESTS][CONFORMANCE] Fix data generation
* fix cpu tests
* CPP Lint
* Update ranges.hpp
* change start_from and range according typo
* Update constant.hpp
* Update constant.hpp
* fix ci build
* Update deformable_convolution.cpp
* cleanup
* clenup
* Merge
e Changes to be committed:
* Fix tests -> change start_from type
* Initial commit to dump subgraphs
* try to collect graphs usong fused_names
* Correct graph generation based on fused_names
* addition
* Define SubgraphMatchers
* Add new matcher structure
* fix buils commit
* repeat
* repeat pattern
* finalize
* Move to extractors
* extract_body
* cleanup_cache
* replace big constant by params
* Replace constants by param in serialization
* Add tests for matchers
* add model-tests
* fix model tests
* Extend tests
* fix extractors test
* fix model recover test
* Remove extra
* remove extra
* return old name to tests
* remove subgraphs extractors -> move them to other PR
2023-07-21 12:21:29 +03:00
Ilya Lavrenov
6d86a9b25f
Revert "[PyOV] Pin version of Cython for API 1.0 ( #18604 )" ( #18681 )
...
* Revert "[PyOV] Pin version of Cython for API 1.0 (#18604 )"
This reverts commit 787796d88f
2023-07-21 13:09:30 +04:00
Ilya Lavrenov
bbd592b530
Don't use -Wl,--allow-shlib-undefined on macOS ( #18683 )
2023-07-21 13:08:26 +04:00
Fang Xu
e478964695
merge loadnetwork and importnetwork for cpu plugin ( #18024 )
...
* merget loadnetwork and importnetwork for cpu plugin
* fix testcase
* remove multithreading config saving
* modify test case
* separate function
* modify function name
* save model_prefer_threads to cache
* remove function encapsulation for config
2023-07-21 14:02:11 +08:00
Andrew Kwangwoong Park
53b2a02a0e
[GPU] Dynamism support for DetectionOutput ( #18625 )
...
* Update op creation for DetectionOutput-8 w/o num_classes attribute
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Update DetectionOutput to use ngraph shape inference
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add dynamic TCs for ov_gpu_func_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix issues for detection output cpu impl selection on dynamic shape
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Update detection_output primitive API and funcs for serialization
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add shape infer TCs for ov_gpu_unit_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix build failure in azure pipeline
Signed-off-by: Andrew Park <andrew.park@intel.com>
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-20 16:49:09 -07:00
Maxim Vafin
12b1df5db3
Disable sporadically failing tests ( #18694 )
2023-07-20 21:34:43 +00:00
Anastasiia Pnevskaia
8d5a0b1d53
OVC cleanup. ( #18649 )
...
* WIP: parameters cleanup
* Removed debug output, fixed CLI
* Fixed python objects conversion
* Finally renamed mmap to share_weights
* Fixed TF conversion from a file or a directory
* Fixed obvious errors in unit tests
* Deleted layouts from OVC. Fixed most of the fails in ovc unit tests (there are still failures)
* Clenaup other references to layouts and fixed --version
* Fixed case when two model files are passed in TF case
* Fixed multiple model parts passing in ovc command line
* Tests fixed, support of unnamed input in cli parser.
* Remove convert_model from runtime.
* Changed silent to verbose.
* Removed transform param.
* Removed example_input, share_weights from ovc cli tool.
* Remove wrong change.
* Test fix.
* Code corrections.
* Returned comment.
* WA to fix process hanging after extension loading.
* Removed not needed code.
* Added comment.
---------
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
2023-07-20 20:11:28 +00:00
Ilya Lavrenov
1ce744a00f
Fixed Debian package build ( #18691 )
2023-07-20 22:23:39 +04:00
Mateusz Mikolajczyk
bc261424ef
[PT FE] Add quantized::conv2d and quantized::conv2d_relu ( #18651 )
...
* Add quantized conv2d
* Fix schema
* Remove mark_output
* Remove tests from pre-commit
2023-07-20 15:35:11 +00:00
Sun Xiaoxia
2dfb537bcb
Xiaoxia/add get_socket_id interface based on threading2.0 ( #18264 )
...
* add streams_info_table init in the constructor of config
* add refresh _proc_type_table
* add get_org_proc_type_table
* add numa_node per stream in reserve_available_cpus()
* fix warning
* remove log
* fix code style
* fix gpu test build failed issue, modify debug info
* fix code style
* fix build failed on macos
* fix code style
* select socket in reserve cpu on 2 sockets platform
* fix build failed on macos
* modify numa node selecting in reserve_cpu_by_streams_info
* add test case
* fix code style
* modify test case
* fix core dump
* fix core dumped on pin=NUMA
* fix test failed on macos
* fix reserve cpu is wrong when streams_info_table=[1 1 36] proc_type_table=[36 18 0 18]
* add test case in LinuxCpuReserve
* modify test case
* add test case in cpu_reserve_test
* add cpu_stream_info_test
* modify enum
* fix test failed
* change int to size_t
* remove invalid code, fix running failed on macos
* modify LinuxCpuStreamType test case, move ie_cpu_streams_info.hpp to openvino/runtime/threading/
* fix code sytle
* modify enum name
* add comments in test case
* fix build issue
* change IE_ASSERT to OPENVINO_ASSERT
* fix test failed on macos and windows
* updated test cases due to the cpu mapping is changed
* enable numa_node_id and socket_id in streams_info_table
* fix code style issue
* fix document issue
* add get socket id interface
* fix segment fault on machine enabled socket_id=1 with numactl command
* fix numactl failed on four numa nodes machine
* remove compile warning
* fix numa_node_id=-1
* fix test case failed on macos
* fix test failed on macos
* fix numa_node_id=0 on macos
* Solve conflicts with master branch
* separate test cases for Linux and Mac/Windows
* update code style for windows compiler
* fix comments
* fix code style
* fix code style
* remove _plugin_mutex, fix comments
* fix code style
* fix code style
* add get_num_sockets
* fix cpu reserve issue in latency mode,ANY core on RPL machine
* add cpu reserve test case
---------
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-07-20 23:34:21 +08:00
bstankix
1911b09a75
[DOCS] Bugfix newsletter validation
2023-07-20 16:44:26 +02:00
bstankix
dd358fc95a
[DOCS] Features update ( #18676 )
...
* Update newsletter to work with new footer
* Update footer
* Add carousel in homepage banner
* Update banner carousel
2023-07-20 15:48:44 +02:00
Ilya Lavrenov
4df6ef3a26
Removed ie, ngraph and core_tools cpack components ( #18636 )
...
* Removed ie, ngraph cpack components
* Introduced new components
2023-07-20 17:46:16 +04:00
Chenhu Wang
b5b11f3b29
[CPU]Shape agnostic jit kernel for MVN ( #17988 )
2023-07-20 13:40:37 +00:00
Ilya Lavrenov
b2d361fcca
Fixed install paths for test MO FE ( #18654 )
2023-07-20 15:00:34 +04:00
Mateusz Tabaka
fe8b8a96ff
Handle sequence ops with non constant W, R, B inputs ( #18138 )
...
* Handle sequence ops with non constant W, R, B inputs
Ticket: CVS-49207
* fix tests
* tests
* fix gna tests
* add include
* change type for seqLenIdx
* rename is_constfoldable to is_on_constant_path
---------
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-20 14:48:41 +04:00
Mikhail Ryzhov
3b8f58f1af
[GNA] Added Reshape support to TS patterns ( #18391 )
...
* Added Reshape support to TS patterns
* fixed unit test
* replaced duplicated code
2023-07-20 12:08:02 +02:00
Kelvin Choi
9254c74362
[GPU] Set offsets of variadic split for static ( #18469 )
2023-07-20 09:26:42 +00:00
Mateusz Mikolajczyk
b315880cc3
[PT FE] Add quantized::linear ( #18570 )
...
* Support GetAttr with packed params
* Apply suggestions from code review
* [PT FE] Add quantized types as normal types to decoder
* [PT FE] Add decoder dequantize, add dtypes to quantize
* [PT FE] Add dequantize example
* [PT FE] Implement replacer for quantized nodes
* [PT FE] Register replacer for quantize/dequantize
* [PT FE] Remove unwanted junk from previous version
* [PT FE] Fix building mistakes for frontend
* [PT FE] Clang fix
* [PT FE] Ease of use upgrade to quantize funcs
* [PT FE] Clang format
* [PT FE] Introduce new version of quantize/dequantize
* [PT FE] Remove unwanted files from new version
* [PT FE] Fix style
* [PT FE] Add QuantizedPtNode replacer, fix accuracy error
* [PT FE] Add improved version of quantize/dequantize with shared_ptrs
* [PT FE] Fix utils shared ptr reference error
* [PT FE] Quantize now takes correct input for operations
* [PT FE] Upgrade quantize method
* [PT FE] Add BFS for dequantize, add quantize_per_channel
* [PT FE] Add missing replacer to frontend, improve tests
* [PT FE] Rename replacer -> remover, remove unwanted header files
* [PT FE] Change function declarations to return ov::Output instead of shared ptr
* [PT FE] Add missing context mark node
* [PT FE] Remove unknown modifications to ie_c_api
* [PT FE] Remove fp16 support, turn off int32 tests
* [PT FE] Clang format
* [PT FE] Fix quantize_per_tensor
* [PT FE] Minor fixes from review
* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead
* [PT FE] Rename Replacer to Remover for dequantize nodes
* [PT FE] Clang format
* [PT FE] Move comments to header files, minor import fixes
* [PT FE] Fix clang format
* [PT FE] Fix dtype issue
* [PT FE] Fix quantize_per_channel tests
* Add quantized::linear
* Update quantized_linear.cpp
* add contructors
* Improve tests
* Add requested checks
---------
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: Roboreptile <piotr.krzeminski@intel.com>
2023-07-20 11:25:56 +02:00
Piotr Krzemiński
6d8dcb059d
[PT FE] Fix conversion for aten::quantize_per_channel ( #18646 )
...
* Support GetAttr with packed params
* Apply suggestions from code review
* [PT FE] Add quantized types as normal types to decoder
* [PT FE] Add decoder dequantize, add dtypes to quantize
* [PT FE] Add dequantize example
* [PT FE] Implement replacer for quantized nodes
* [PT FE] Register replacer for quantize/dequantize
* [PT FE] Remove unwanted junk from previous version
* [PT FE] Fix building mistakes for frontend
* [PT FE] Clang fix
* [PT FE] Ease of use upgrade to quantize funcs
* [PT FE] Clang format
* [PT FE] Introduce new version of quantize/dequantize
* [PT FE] Remove unwanted files from new version
* [PT FE] Fix style
* [PT FE] Add QuantizedPtNode replacer, fix accuracy error
* [PT FE] Add improved version of quantize/dequantize with shared_ptrs
* [PT FE] Fix utils shared ptr reference error
* [PT FE] Quantize now takes correct input for operations
* [PT FE] Upgrade quantize method
* [PT FE] Add BFS for dequantize, add quantize_per_channel
* [PT FE] Add missing replacer to frontend, improve tests
* [PT FE] Rename replacer -> remover, remove unwanted header files
* [PT FE] Change function declarations to return ov::Output instead of shared ptr
* [PT FE] Add missing context mark node
* [PT FE] Remove unknown modifications to ie_c_api
* [PT FE] Remove fp16 support, turn off int32 tests
* [PT FE] Clang format
* [PT FE] Fix quantize_per_tensor
* [PT FE] Minor fixes from review
* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead
* [PT FE] Rename Replacer to Remover for dequantize nodes
* [PT FE] Clang format
* [PT FE] Move comments to header files, minor import fixes
* [PT FE] Fix clang format
* [PT FE] Fix dtype issue
* [PT FE] Fix quantize_per_channel tests
* Apply suggestions from code review
Removing sporadic tests from precommit
* Apply suggestions from code review
* [PT FE] Fix conversion errors for aten::quantize_per_channel
* [PT FE] Mark axis 2 as xfail
---------
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-07-20 10:49:20 +02:00
Oleg Pipikin
60a8c2bc7a
Extend data_utils to work with ov::Tensor ( #18142 )
...
* Extend data_utils to work with ov::Tensor. Update SplitConcatMemory tests
* Fix1
* Apply comments
* Apply comments 2
* Apply comments 3
* Apply comments 4
2023-07-20 08:29:47 +00:00
Ilya Churaev
3f675ce396
Extend Proxy tests to cover cache_dir with auto batch ( #18632 )
...
* Added new tests to reproduce issue with auto batch
* Remove cache dir
* Fixed tests with auto batch
* Fixed check
* Added comment
* Remove try catch
* Remove comment
* Revert "Remove comment"
This reverts commit 99e26de4ca08b478c070
2023-07-20 11:11:41 +04:00
yanlan song
a51d9494fa
support context in auto and re-enable tests ( #18554 )
...
wrap hardware remote context to compiled model
Signed-off-by: fishbell <bell.song@intel.com>
2023-07-20 06:53:07 +00:00
Taylor Yeonbok Lee
7167473744
[GPU] Reduce clfinish io and allow input reorder to use device mem ( #18596 )
2023-07-20 10:39:39 +04:00
Anton Voronov
60e40843c0
[CPU] f16 constant folding on cpu plug-in side for MatMul only ( #18079 )
2023-07-20 08:58:46 +04:00
River Li
0e76496acc
[WA] performance issue for plugin api 2.0 ( #18509 )
...
* [WA] performance issue for plugin api 2.0
* Avoid onnx failure
* Avoid ov_template_func_tests failure
[ RUN ] smoke_BehaviorTests/OVRemoteTest.inferWithRemoteNoThrow/element_type=f32targetDevice=TEMPLATE__context_parameters=__tensor_parameters=
MEM_USAGE=400336KB
/mnt/data1_1c41/river/openvino_master/openvino/src/tests/functional/plugin/shared/src/behavior/ov_plugin/remote.cpp:107: Failure
Expected: infer_request.set_input_tensor(0, input_remote_tensor) doesn't throw an exception.
Actual: it throws.
[ FAILED ] smoke_BehaviorTests/OVRemoteTest.inferWithRemoteNoThrow/element_type=f32targetDevice=TEMPLATE__context_parameters=__tensor_parameters=, where GetParam() = (f32, "TEMPLATE", {}, ({}, {})) (76 ms)
2023-07-20 08:22:31 +04:00
Mingyu Kim
b7b740beb5
[GPU] Disable permute_f_y_axis because of accuracy issue ( #18647 )
...
* [GPU] Disable permute_f_y_axis because of accuracy issue
* [GPU] Disable tests too
2023-07-20 04:10:42 +00:00
Xuejun Zhai
ba76b45194
[AUTO BATCH PLUGIN] enable api 2.0 for auto batch plugin ( #18172 )
...
* [AUTO BATCH PLUGIN] enable API 2.0 for auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] disenable auto batch plugin unite test for tmp
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] remove test with ov::auto_batch_timeout(-1), cause the variable is unsigned int
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler error caused by std::atomic_uint32_t
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [Remote Context] fix revew comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler warnings
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler warnings
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix test error
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI test error in cpu func test case, caused by batched model lost rt info
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI build error, caused by unused variable
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] using ov::threading
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] clear code in batched req share buffer with non-batched req
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] clean code & fix format issue
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] clean code & fix format issue
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add api implementation about get_default_context() & create_context() and remove the test config with AUTO_BATCH_TIMEOUT(-1)
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix gpu test with auto btch failed
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix warning
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix get_default_context() issue
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix using namespace redundancy
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] modify variable naming style
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI test error, cause by tensor reference in virtual plugin
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] implement get_profiling()
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] remove get_context() from auto batch compiled model using the interface from parent class
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] implement create_context() & get_default_context for auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix format issue
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] implement auto batch remote context
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix error after merge with master
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler error caused by update master
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] refact remote context in auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add unite test cases for auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI warning caused by unused variable & add unite of remote context
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add virtual property for get_context() in icompiled_model & implement it in auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add ov::loaded_from_cache support
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix error caused by updating with master
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix unite test error
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix conflict
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix error caused by update master
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
---------
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <xuejun.zhai@intel.com>
2023-07-20 07:02:45 +04:00
Ilya Lavrenov
9cd39455fc
Removed explicit linkage to protobuf in ONNX ( #18650 )
2023-07-19 21:41:28 +04:00
Ekaterina Aidova
61504bbfc2
[PT FE]: support nested inputs in example_inputs and arg dicts with d… ( #18492 )
...
* [PT FE]: support nested inputs in example_inputs and arg dicts with different argtypes
* accept hande lists as inputs
* Update tools/ovc/openvino/tools/ovc/moc_frontend/pytorch_frontend_utils.py
* update tests and add comments in code
* fix for custom types in annotations and duplicate in mo
* Update tools/mo/openvino/tools/mo/moc_frontend/pytorch_frontend_utils.py
2023-07-19 17:01:22 +02:00
Marcin Kusmierski
186b1b6bfc
Gna 3 5 as default target with transpose fixes ( #18373 )
...
* [GNA] Set GNA 3.5 as default target and add 3.5 to properties
* [GNA] fix release version to 2023.1.
Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>
* [GNA] Fix E2E Tests for Kaldi Framework
* added fix for InsertConvolutionTransposeHW
---------
Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
2023-07-19 14:48:01 +02:00
Mircea-Aurelian Dan
5397e299fd
[EISW-81712] Rename VPUX to VPU in openvino codebase ( #17949 )
...
* Change `VPUX` occurrences to `VPU`
* Switch `VPU` library name
* Change remaining references to `VPUX`
2023-07-19 15:55:24 +04:00
Ilya Lavrenov
04cb55c37d
Moved BA from openvino-dev to openvino ( #18571 )
2023-07-19 14:36:47 +04:00
Evgenya Stepyreva
b51069dd79
Eliminates Nop Broadcast/Tile and Slice Before GatherElements ( #18614 )
2023-07-19 14:12:13 +04:00
Sofya Balandina
53fe969773
[apiConformance] Move related to core tests from api to ov_inference_functional_tests ( #18349 )
2023-07-19 12:01:52 +03:00
Sofya Balandina
8ac00677a9
[apiConformance] Move related to core tests from api to ov_inference_functional_tests ( #18349 )
2023-07-19 12:01:26 +03:00
Sofya Balandina
d08b424935
Change comparation ( #18515 )
2023-07-19 12:01:09 +03:00
Ilya Churaev
e600a8e45a
Revert "Revert "Revert "Fixed cases if cast data from Tensor to compatible type ( #18479 )" ( #18539 )" ( #18599 )" ( #18631 )
...
This reverts commit ea84e73282
2023-07-19 12:20:11 +04:00
Vitaliy Urusovskij
f470825faf
Revert "Remove extra model from CompiledModelDesc" ( #18612 )
...
* Revert "Remove extra `model` from `CompiledModelDesc`"
This reverts commit fb07fd7b82
2023-07-19 12:05:24 +04:00
Edward Shogulin
38dec7b8cf
[CPU] Fixed zero-point fusion transformation ( #18435 )
...
Proper hanlding for subgraphs where ZP parent node has more than one output port
2023-07-19 11:30:21 +04:00
Nesterov Alexander
510f578aab
[ARM CPU] ACL TBB scheduler ( #17445 )
2023-07-19 10:01:31 +04:00
