River Li
0e76496acc
[WA] performance issue for plugin api 2.0 ( #18509 )
...
* [WA] performance issue for plugin api 2.0
* Avoid onnx failure
* Avoid ov_template_func_tests failure
[ RUN ] smoke_BehaviorTests/OVRemoteTest.inferWithRemoteNoThrow/element_type=f32targetDevice=TEMPLATE__context_parameters=__tensor_parameters=
MEM_USAGE=400336KB
/mnt/data1_1c41/river/openvino_master/openvino/src/tests/functional/plugin/shared/src/behavior/ov_plugin/remote.cpp:107: Failure
Expected: infer_request.set_input_tensor(0, input_remote_tensor) doesn't throw an exception.
Actual: it throws.
[ FAILED ] smoke_BehaviorTests/OVRemoteTest.inferWithRemoteNoThrow/element_type=f32targetDevice=TEMPLATE__context_parameters=__tensor_parameters=, where GetParam() = (f32, "TEMPLATE", {}, ({}, {})) (76 ms)
2023-07-20 08:22:31 +04:00
Mingyu Kim
b7b740beb5
[GPU] Disable permute_f_y_axis because of accuracy issue ( #18647 )
...
* [GPU] Disable permute_f_y_axis because of accuracy issue
* [GPU] Disable tests too
2023-07-20 04:10:42 +00:00
Xuejun Zhai
ba76b45194
[AUTO BATCH PLUGIN] enable api 2.0 for auto batch plugin ( #18172 )
...
* [AUTO BATCH PLUGIN] enable API 2.0 for auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] disenable auto batch plugin unite test for tmp
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] remove test with ov::auto_batch_timeout(-1), cause the variable is unsigned int
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler error caused by std::atomic_uint32_t
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [Remote Context] fix revew comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler warnings
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler warnings
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix test error
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI test error in cpu func test case, caused by batched model lost rt info
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI build error, caused by unused variable
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] using ov::threading
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] clear code in batched req share buffer with non-batched req
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] clean code & fix format issue
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] clean code & fix format issue
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add api implementation about get_default_context() & create_context() and remove the test config with AUTO_BATCH_TIMEOUT(-1)
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix gpu test with auto btch failed
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix warning
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix get_default_context() issue
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix using namespace redundancy
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] modify variable naming style
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI test error, cause by tensor reference in virtual plugin
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] implement get_profiling()
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] remove get_context() from auto batch compiled model using the interface from parent class
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] implement create_context() & get_default_context for auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix format issue
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] implement auto batch remote context
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix error after merge with master
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler error caused by update master
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] refact remote context in auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add unite test cases for auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI warning caused by unused variable & add unite of remote context
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add virtual property for get_context() in icompiled_model & implement it in auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add ov::loaded_from_cache support
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix error caused by updating with master
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix unite test error
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix conflict
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix error caused by update master
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
---------
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <xuejun.zhai@intel.com>
2023-07-20 07:02:45 +04:00
Ilya Lavrenov
9cd39455fc
Removed explicit linkage to protobuf in ONNX ( #18650 )
2023-07-19 21:41:28 +04:00
Ekaterina Aidova
61504bbfc2
[PT FE]: support nested inputs in example_inputs and arg dicts with d… ( #18492 )
...
* [PT FE]: support nested inputs in example_inputs and arg dicts with different argtypes
* accept hande lists as inputs
* Update tools/ovc/openvino/tools/ovc/moc_frontend/pytorch_frontend_utils.py
* update tests and add comments in code
* fix for custom types in annotations and duplicate in mo
* Update tools/mo/openvino/tools/mo/moc_frontend/pytorch_frontend_utils.py
2023-07-19 17:01:22 +02:00
Marcin Kusmierski
186b1b6bfc
Gna 3 5 as default target with transpose fixes ( #18373 )
...
* [GNA] Set GNA 3.5 as default target and add 3.5 to properties
* [GNA] fix release version to 2023.1.
Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>
* [GNA] Fix E2E Tests for Kaldi Framework
* added fix for InsertConvolutionTransposeHW
---------
Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
2023-07-19 14:48:01 +02:00
Mircea-Aurelian Dan
5397e299fd
[EISW-81712] Rename VPUX to VPU in openvino codebase ( #17949 )
...
* Change `VPUX` occurrences to `VPU`
* Switch `VPU` library name
* Change remaining references to `VPUX`
2023-07-19 15:55:24 +04:00
Ilya Lavrenov
04cb55c37d
Moved BA from openvino-dev to openvino ( #18571 )
2023-07-19 14:36:47 +04:00
Evgenya Stepyreva
b51069dd79
Eliminates Nop Broadcast/Tile and Slice Before GatherElements ( #18614 )
2023-07-19 14:12:13 +04:00
Sofya Balandina
53fe969773
[apiConformance] Move related to core tests from api to ov_inference_functional_tests ( #18349 )
2023-07-19 12:01:52 +03:00
Sofya Balandina
8ac00677a9
[apiConformance] Move related to core tests from api to ov_inference_functional_tests ( #18349 )
2023-07-19 12:01:26 +03:00
Sofya Balandina
d08b424935
Change comparation ( #18515 )
2023-07-19 12:01:09 +03:00
Ilya Churaev
e600a8e45a
Revert "Revert "Revert "Fixed cases if cast data from Tensor to compatible type ( #18479 )" ( #18539 )" ( #18599 )" ( #18631 )
...
This reverts commit ea84e73282
2023-07-19 12:20:11 +04:00
Vitaliy Urusovskij
f470825faf
Revert "Remove extra model from CompiledModelDesc" ( #18612 )
...
* Revert "Remove extra `model` from `CompiledModelDesc`"
This reverts commit fb07fd7b82
2023-07-19 12:05:24 +04:00
Edward Shogulin
38dec7b8cf
[CPU] Fixed zero-point fusion transformation ( #18435 )
...
Proper hanlding for subgraphs where ZP parent node has more than one output port
2023-07-19 11:30:21 +04:00
Nesterov Alexander
510f578aab
[ARM CPU] ACL TBB scheduler ( #17445 )
2023-07-19 10:01:31 +04:00
Ekaterina Aidova
c867c23bb6
[PT FE]: support upsamle2d bilinear and bicubic with antialias ( #18617 )
2023-07-19 09:36:11 +04:00
Pavel Durandin
9d28dfd79d
[GPU] Reorder weights refactoring ( #17787 ) ( #18540 )
...
* [GPU] Reorder weights refactoring (#17787 )
* [GPU] Fix DG2 with weights optimization
* [GPU] Fix DG2 with weights optimization
* [GPU] Fix DG2 with weights optimization
* [GPU] Fix DG2 with weights optimization
* [GPU] Fix inner order description for some of formats
* [GPU] Fix expected number of primitives in test
---------
Co-authored-by: Roman Lyamin <Roman.Lyamin@intel.com>
Co-authored-by: Sergey Shlyapnikov <sergey.shlyapnikov@intel.com>
2023-07-19 09:26:02 +04:00
Mateusz Bencer
d363660e67
Deprecate old ONNX API ( #18587 )
2023-07-18 20:45:39 +00:00
Ilya Churaev
ea84e73282
Revert "Revert "Fixed cases if cast data from Tensor to compatible type ( #18479 )" ( #18539 )" ( #18599 )
...
This reverts commit 3daa387692
2023-07-18 19:57:32 +00:00
OlehKravchyshyn
f0abd468a2
[GPU] Permute f and y axes ( #13561 )
...
* [GPU] Permute f and y axes
It is supported cases where y and f (and X if it is not equal 1) axes size divisible by 4,8 or 16.
added kernel to switch f and y axes in 4d model blocked and planar formats
added test fot tests
* Added subgroup read/write to THREE_DIM_TRANSPOSE kernel case.
* Better checking of is SIMD size supported.
* Added support for long type to subgroup read/write.
* Added subgroup read/write support to 2d permute.
* Fixed win build issue.
* Changed f and y indexes in iteration.
* Added vector read/write.
* Fixed j_times calculation.
* Better naming.
* Rollback test logic.
* Fixed fusion logic.
* Accept only supported blocked layouts and SIMD sizes.
---------
Co-authored-by: Mykhailo Hnap <mykhailo.hnap@capgemini.com>
Co-authored-by: Wilson Seok <wilson.seok@intel.com>
2023-07-18 11:48:25 -07:00
Pawel Raasz
568d3371d7
Improve file macro trim on windows ( #18600 )
...
* On windows try trim forward slash in __FILE__
* Improve exception relative path test assertion
check path with OS native and forward slash
2023-07-18 20:09:26 +04:00
Karol Blaszczak
fe7b19af6a
[DOCS] new benchmark data ( #18532 )
2023-07-18 18:03:25 +02:00
Ilya Lavrenov
700677c5c6
Less argressive chages ( #18591 )
2023-07-18 19:54:00 +04:00
Ilya Lavrenov
2f3d4df342
Ability to use old API and old cmake config files ( #18558 )
2023-07-18 19:50:19 +04:00
Mateusz Bencer
85ef310e65
Changed name of enable_mmap flag for MO/OVC + implemented missing passing flag for mo/moc_frontend/pipeline.py ( #18618 )
2023-07-18 15:30:34 +00:00
Oleg Pipikin
cdef86c366
Move unit and func test utils ( #18423 )
...
* Move unit and func test utils. Rename targets
* Fix1
2023-07-18 16:23:58 +02:00
Karol Blaszczak
a7b76522a6
[DOCS] minor MO fixes ( #18603 )
2023-07-18 16:22:34 +02:00
Sebastian Golebiewski
b7e8338e29
update ( #18615 )
2023-07-18 14:51:23 +02:00
Chen Xu
9334ad0790
[CPU] Reduce node supports fp16 precision ( #18227 )
2023-07-18 12:49:25 +00:00
bstankix
8a49cf14ee
[DOCS] Add newsletter form ( #18605 )
...
* Add newsletter modal
2023-07-18 14:46:42 +02:00
Mateusz Bencer
144c1ffd7b
[ONNX FE] Enable two-steps importing (convert_partially + normalize) ( #18440 )
2023-07-18 12:37:02 +00:00
Jan Iwaszkiewicz
ec26537b3e
[PyOV][DOCS] Update inference documentation with shared memory flags ( #18561 )
2023-07-18 13:15:10 +02:00
Maciej Smyk
d21296bcc1
Update configurations-for-intel-gpu.md ( #18611 )
2023-07-18 12:35:37 +02:00
Anastasiia Pnevskaia
e67850a186
Use GA4 telemetry backend in MO and OVC. ( #18584 )
2023-07-18 11:50:04 +04:00
Pawel Raasz
ff5b56ee07
Improve node validation failure message for shape infer ( #18520 )
...
* Add NODE_SHAPE_INFER_CHECK macro
throws NodeValidationFailure for shape inference
* Use NODE_SHAPE_INFER_CHECK in topk shape inference
* Move description to header file
* export NodeValidationFailure::create function
2023-07-18 11:41:19 +04:00
Jan Iwaszkiewicz
787796d88f
[PyOV] Pin version of Cython for API 1.0 ( #18604 )
2023-07-18 11:35:03 +04:00
Jade Cho
4d777bd65b
[GPU] Copy from usm_host memory to cl_mem memory. ( #18555 )
2023-07-18 11:27:21 +09:00
Vladislav Golubev
42d2c130c2
[Snippets] ExtractReshapesFromMHA transformation ( #18477 )
2023-07-17 20:42:18 +02:00
Sergey Shlyapnikov
3958f771da
[GPU] Add oneDNN primitives profiling support ( #17785 )
...
* [GPU] Add oneDNN primitives profiling support
* [GPU] Add stream.wait() method to prevent caches flushing and other possible impacts of finish() call
* Add comment for wait() usage
2023-07-17 19:17:31 +04:00
Mateusz Bencer
5464216404
Fix IRDFT for 1D complex input in debug mode ( #18525 )
2023-07-17 16:45:21 +02:00
Ilya Lavrenov
3a92054cf4
Updated pybind11 to v2.11 version ( #18580 )
2023-07-17 18:18:02 +04:00
Ilya Lavrenov
b89bf8c280
Updated ITTAPI to v3.24.2 ( #18581 )
2023-07-17 18:17:38 +04:00
Zlobin Vladimir
06bfbd7f28
becnhmark_app/python: revert TODO application because it's not 23.3 yet ( #18577 )
2023-07-17 18:12:40 +04:00
Alexandra Sidorova
440c05d5b9
[CI][NVIDIA] Fixed test names ( #18585 )
2023-07-17 17:47:19 +04:00
Anastasiia Pnevskaia
e434285445
Fixed temporary directory creating in test_save_and_restore_with_converts(). ( #18569 )
...
* Fixed temporary dir creating in test_save_and_restore_with_converts().
* Small correction.
2023-07-17 17:26:16 +04:00
Katarzyna Mitrus
019723a05d
[ONNX] Use ov::v12::pad in ONNX FE Pad ( #18460 )
...
* Update ONNX FE Pad to use Pad-12
* Add negative pads test
* Use default_opset(opset12) for Pad
2023-07-17 15:02:45 +02:00
Zlobin Vladimir
a5880ee1eb
Report dynamic -data_shape ( #18457 )
...
Ticket 112256
Python check was already there
2023-07-17 14:32:01 +02:00
Pawel Raasz
c1fde50cd9
Improve __FILE__ trim on windows builds ( #18573 )
2023-07-17 14:29:40 +02:00
Vitaliy Urusovskij
ef56b53a3f
Remove excess ov::Model clone in Hetero ( #18576 )
2023-07-17 12:27:33 +00:00
