Chenhu Wang
b5b11f3b29
[CPU]Shape agnostic jit kernel for MVN ( #17988 )
2023-07-20 13:40:37 +00:00
Ilya Lavrenov
b2d361fcca
Fixed install paths for test MO FE ( #18654 )
2023-07-20 15:00:34 +04:00
Mateusz Tabaka
fe8b8a96ff
Handle sequence ops with non constant W, R, B inputs ( #18138 )
...
* Handle sequence ops with non constant W, R, B inputs
Ticket: CVS-49207
* fix tests
* tests
* fix gna tests
* add include
* change type for seqLenIdx
* rename is_constfoldable to is_on_constant_path
---------
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-20 14:48:41 +04:00
Mikhail Ryzhov
3b8f58f1af
[GNA] Added Reshape support to TS patterns ( #18391 )
...
* Added Reshape support to TS patterns
* fixed unit test
* replaced duplicated code
2023-07-20 12:08:02 +02:00
Kelvin Choi
9254c74362
[GPU] Set offsets of variadic split for static ( #18469 )
2023-07-20 09:26:42 +00:00
Mateusz Mikolajczyk
b315880cc3
[PT FE] Add quantized::linear ( #18570 )
...
* Support GetAttr with packed params
* Apply suggestions from code review
* [PT FE] Add quantized types as normal types to decoder
* [PT FE] Add decoder dequantize, add dtypes to quantize
* [PT FE] Add dequantize example
* [PT FE] Implement replacer for quantized nodes
* [PT FE] Register replacer for quantize/dequantize
* [PT FE] Remove unwanted junk from previous version
* [PT FE] Fix building mistakes for frontend
* [PT FE] Clang fix
* [PT FE] Ease of use upgrade to quantize funcs
* [PT FE] Clang format
* [PT FE] Introduce new version of quantize/dequantize
* [PT FE] Remove unwanted files from new version
* [PT FE] Fix style
* [PT FE] Add QuantizedPtNode replacer, fix accuracy error
* [PT FE] Add improved version of quantize/dequantize with shared_ptrs
* [PT FE] Fix utils shared ptr reference error
* [PT FE] Quantize now takes correct input for operations
* [PT FE] Upgrade quantize method
* [PT FE] Add BFS for dequantize, add quantize_per_channel
* [PT FE] Add missing replacer to frontend, improve tests
* [PT FE] Rename replacer -> remover, remove unwanted header files
* [PT FE] Change function declarations to return ov::Output instead of shared ptr
* [PT FE] Add missing context mark node
* [PT FE] Remove unknown modifications to ie_c_api
* [PT FE] Remove fp16 support, turn off int32 tests
* [PT FE] Clang format
* [PT FE] Fix quantize_per_tensor
* [PT FE] Minor fixes from review
* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead
* [PT FE] Rename Replacer to Remover for dequantize nodes
* [PT FE] Clang format
* [PT FE] Move comments to header files, minor import fixes
* [PT FE] Fix clang format
* [PT FE] Fix dtype issue
* [PT FE] Fix quantize_per_channel tests
* Add quantized::linear
* Update quantized_linear.cpp
* add contructors
* Improve tests
* Add requested checks
---------
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: Roboreptile <piotr.krzeminski@intel.com>
2023-07-20 11:25:56 +02:00
Piotr Krzemiński
6d8dcb059d
[PT FE] Fix conversion for aten::quantize_per_channel ( #18646 )
...
* Support GetAttr with packed params
* Apply suggestions from code review
* [PT FE] Add quantized types as normal types to decoder
* [PT FE] Add decoder dequantize, add dtypes to quantize
* [PT FE] Add dequantize example
* [PT FE] Implement replacer for quantized nodes
* [PT FE] Register replacer for quantize/dequantize
* [PT FE] Remove unwanted junk from previous version
* [PT FE] Fix building mistakes for frontend
* [PT FE] Clang fix
* [PT FE] Ease of use upgrade to quantize funcs
* [PT FE] Clang format
* [PT FE] Introduce new version of quantize/dequantize
* [PT FE] Remove unwanted files from new version
* [PT FE] Fix style
* [PT FE] Add QuantizedPtNode replacer, fix accuracy error
* [PT FE] Add improved version of quantize/dequantize with shared_ptrs
* [PT FE] Fix utils shared ptr reference error
* [PT FE] Quantize now takes correct input for operations
* [PT FE] Upgrade quantize method
* [PT FE] Add BFS for dequantize, add quantize_per_channel
* [PT FE] Add missing replacer to frontend, improve tests
* [PT FE] Rename replacer -> remover, remove unwanted header files
* [PT FE] Change function declarations to return ov::Output instead of shared ptr
* [PT FE] Add missing context mark node
* [PT FE] Remove unknown modifications to ie_c_api
* [PT FE] Remove fp16 support, turn off int32 tests
* [PT FE] Clang format
* [PT FE] Fix quantize_per_tensor
* [PT FE] Minor fixes from review
* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead
* [PT FE] Rename Replacer to Remover for dequantize nodes
* [PT FE] Clang format
* [PT FE] Move comments to header files, minor import fixes
* [PT FE] Fix clang format
* [PT FE] Fix dtype issue
* [PT FE] Fix quantize_per_channel tests
* Apply suggestions from code review
Removing sporadic tests from precommit
* Apply suggestions from code review
* [PT FE] Fix conversion errors for aten::quantize_per_channel
* [PT FE] Mark axis 2 as xfail
---------
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-07-20 10:49:20 +02:00
Oleg Pipikin
60a8c2bc7a
Extend data_utils to work with ov::Tensor ( #18142 )
...
* Extend data_utils to work with ov::Tensor. Update SplitConcatMemory tests
* Fix1
* Apply comments
* Apply comments 2
* Apply comments 3
* Apply comments 4
2023-07-20 08:29:47 +00:00
Ilya Churaev
3f675ce396
Extend Proxy tests to cover cache_dir with auto batch ( #18632 )
...
* Added new tests to reproduce issue with auto batch
* Remove cache dir
* Fixed tests with auto batch
* Fixed check
* Added comment
* Remove try catch
* Remove comment
* Revert "Remove comment"
This reverts commit 99e26de4ca08b478c070
2023-07-20 11:11:41 +04:00
yanlan song
a51d9494fa
support context in auto and re-enable tests ( #18554 )
...
wrap hardware remote context to compiled model
Signed-off-by: fishbell <bell.song@intel.com>
2023-07-20 06:53:07 +00:00
Taylor Yeonbok Lee
7167473744
[GPU] Reduce clfinish io and allow input reorder to use device mem ( #18596 )
2023-07-20 10:39:39 +04:00
Anton Voronov
60e40843c0
[CPU] f16 constant folding on cpu plug-in side for MatMul only ( #18079 )
2023-07-20 08:58:46 +04:00
River Li
0e76496acc
[WA] performance issue for plugin api 2.0 ( #18509 )
...
* [WA] performance issue for plugin api 2.0
* Avoid onnx failure
* Avoid ov_template_func_tests failure
[ RUN ] smoke_BehaviorTests/OVRemoteTest.inferWithRemoteNoThrow/element_type=f32targetDevice=TEMPLATE__context_parameters=__tensor_parameters=
MEM_USAGE=400336KB
/mnt/data1_1c41/river/openvino_master/openvino/src/tests/functional/plugin/shared/src/behavior/ov_plugin/remote.cpp:107: Failure
Expected: infer_request.set_input_tensor(0, input_remote_tensor) doesn't throw an exception.
Actual: it throws.
[ FAILED ] smoke_BehaviorTests/OVRemoteTest.inferWithRemoteNoThrow/element_type=f32targetDevice=TEMPLATE__context_parameters=__tensor_parameters=, where GetParam() = (f32, "TEMPLATE", {}, ({}, {})) (76 ms)
2023-07-20 08:22:31 +04:00
Mingyu Kim
b7b740beb5
[GPU] Disable permute_f_y_axis because of accuracy issue ( #18647 )
...
* [GPU] Disable permute_f_y_axis because of accuracy issue
* [GPU] Disable tests too
2023-07-20 04:10:42 +00:00
Xuejun Zhai
ba76b45194
[AUTO BATCH PLUGIN] enable api 2.0 for auto batch plugin ( #18172 )
...
* [AUTO BATCH PLUGIN] enable API 2.0 for auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] disenable auto batch plugin unite test for tmp
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] remove test with ov::auto_batch_timeout(-1), cause the variable is unsigned int
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler error caused by std::atomic_uint32_t
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [Remote Context] fix revew comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler warnings
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler warnings
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix test error
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI test error in cpu func test case, caused by batched model lost rt info
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI build error, caused by unused variable
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] using ov::threading
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] clear code in batched req share buffer with non-batched req
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] clean code & fix format issue
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] clean code & fix format issue
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add api implementation about get_default_context() & create_context() and remove the test config with AUTO_BATCH_TIMEOUT(-1)
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix gpu test with auto btch failed
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix warning
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix get_default_context() issue
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix using namespace redundancy
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] modify variable naming style
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI test error, cause by tensor reference in virtual plugin
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] implement get_profiling()
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] remove get_context() from auto batch compiled model using the interface from parent class
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] implement create_context() & get_default_context for auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix format issue
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] implement auto batch remote context
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix error after merge with master
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix compiler error caused by update master
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] refact remote context in auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add unite test cases for auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix CI warning caused by unused variable & add unite of remote context
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add virtual property for get_context() in icompiled_model & implement it in auto batch plugin
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] add ov::loaded_from_cache support
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix error caused by updating with master
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix unite test error
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix conflict
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix error caused by update master
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* [AUTO BATCH PLUGIN] fix review comments
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
---------
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <xuejun.zhai@intel.com>
2023-07-20 07:02:45 +04:00
Ilya Lavrenov
9cd39455fc
Removed explicit linkage to protobuf in ONNX ( #18650 )
2023-07-19 21:41:28 +04:00
Ekaterina Aidova
61504bbfc2
[PT FE]: support nested inputs in example_inputs and arg dicts with d… ( #18492 )
...
* [PT FE]: support nested inputs in example_inputs and arg dicts with different argtypes
* accept hande lists as inputs
* Update tools/ovc/openvino/tools/ovc/moc_frontend/pytorch_frontend_utils.py
* update tests and add comments in code
* fix for custom types in annotations and duplicate in mo
* Update tools/mo/openvino/tools/mo/moc_frontend/pytorch_frontend_utils.py
2023-07-19 17:01:22 +02:00
Marcin Kusmierski
186b1b6bfc
Gna 3 5 as default target with transpose fixes ( #18373 )
...
* [GNA] Set GNA 3.5 as default target and add 3.5 to properties
* [GNA] fix release version to 2023.1.
Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>
* [GNA] Fix E2E Tests for Kaldi Framework
* added fix for InsertConvolutionTransposeHW
---------
Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
2023-07-19 14:48:01 +02:00
Mircea-Aurelian Dan
5397e299fd
[EISW-81712] Rename VPUX to VPU in openvino codebase ( #17949 )
...
* Change `VPUX` occurrences to `VPU`
* Switch `VPU` library name
* Change remaining references to `VPUX`
2023-07-19 15:55:24 +04:00
Ilya Lavrenov
04cb55c37d
Moved BA from openvino-dev to openvino ( #18571 )
2023-07-19 14:36:47 +04:00
Evgenya Stepyreva
b51069dd79
Eliminates Nop Broadcast/Tile and Slice Before GatherElements ( #18614 )
2023-07-19 14:12:13 +04:00
Sofya Balandina
53fe969773
[apiConformance] Move related to core tests from api to ov_inference_functional_tests ( #18349 )
2023-07-19 12:01:52 +03:00
Sofya Balandina
8ac00677a9
[apiConformance] Move related to core tests from api to ov_inference_functional_tests ( #18349 )
2023-07-19 12:01:26 +03:00
Sofya Balandina
d08b424935
Change comparation ( #18515 )
2023-07-19 12:01:09 +03:00
Ilya Churaev
e600a8e45a
Revert "Revert "Revert "Fixed cases if cast data from Tensor to compatible type ( #18479 )" ( #18539 )" ( #18599 )" ( #18631 )
...
This reverts commit ea84e73282
2023-07-19 12:20:11 +04:00
Vitaliy Urusovskij
f470825faf
Revert "Remove extra model from CompiledModelDesc" ( #18612 )
...
* Revert "Remove extra `model` from `CompiledModelDesc`"
This reverts commit fb07fd7b82
2023-07-19 12:05:24 +04:00
Edward Shogulin
38dec7b8cf
[CPU] Fixed zero-point fusion transformation ( #18435 )
...
Proper hanlding for subgraphs where ZP parent node has more than one output port
2023-07-19 11:30:21 +04:00
Nesterov Alexander
510f578aab
[ARM CPU] ACL TBB scheduler ( #17445 )
2023-07-19 10:01:31 +04:00
Ekaterina Aidova
c867c23bb6
[PT FE]: support upsamle2d bilinear and bicubic with antialias ( #18617 )
2023-07-19 09:36:11 +04:00
Pavel Durandin
9d28dfd79d
[GPU] Reorder weights refactoring ( #17787 ) ( #18540 )
...
* [GPU] Reorder weights refactoring (#17787 )
* [GPU] Fix DG2 with weights optimization
* [GPU] Fix DG2 with weights optimization
* [GPU] Fix DG2 with weights optimization
* [GPU] Fix DG2 with weights optimization
* [GPU] Fix inner order description for some of formats
* [GPU] Fix expected number of primitives in test
---------
Co-authored-by: Roman Lyamin <Roman.Lyamin@intel.com>
Co-authored-by: Sergey Shlyapnikov <sergey.shlyapnikov@intel.com>
2023-07-19 09:26:02 +04:00
Mateusz Bencer
d363660e67
Deprecate old ONNX API ( #18587 )
2023-07-18 20:45:39 +00:00
Ilya Churaev
ea84e73282
Revert "Revert "Fixed cases if cast data from Tensor to compatible type ( #18479 )" ( #18539 )" ( #18599 )
...
This reverts commit 3daa387692
2023-07-18 19:57:32 +00:00
OlehKravchyshyn
f0abd468a2
[GPU] Permute f and y axes ( #13561 )
...
* [GPU] Permute f and y axes
It is supported cases where y and f (and X if it is not equal 1) axes size divisible by 4,8 or 16.
added kernel to switch f and y axes in 4d model blocked and planar formats
added test fot tests
* Added subgroup read/write to THREE_DIM_TRANSPOSE kernel case.
* Better checking of is SIMD size supported.
* Added support for long type to subgroup read/write.
* Added subgroup read/write support to 2d permute.
* Fixed win build issue.
* Changed f and y indexes in iteration.
* Added vector read/write.
* Fixed j_times calculation.
* Better naming.
* Rollback test logic.
* Fixed fusion logic.
* Accept only supported blocked layouts and SIMD sizes.
---------
Co-authored-by: Mykhailo Hnap <mykhailo.hnap@capgemini.com>
Co-authored-by: Wilson Seok <wilson.seok@intel.com>
2023-07-18 11:48:25 -07:00
Pawel Raasz
568d3371d7
Improve file macro trim on windows ( #18600 )
...
* On windows try trim forward slash in __FILE__
* Improve exception relative path test assertion
check path with OS native and forward slash
2023-07-18 20:09:26 +04:00
Karol Blaszczak
fe7b19af6a
[DOCS] new benchmark data ( #18532 )
2023-07-18 18:03:25 +02:00
Ilya Lavrenov
700677c5c6
Less argressive chages ( #18591 )
2023-07-18 19:54:00 +04:00
Ilya Lavrenov
2f3d4df342
Ability to use old API and old cmake config files ( #18558 )
2023-07-18 19:50:19 +04:00
Mateusz Bencer
85ef310e65
Changed name of enable_mmap flag for MO/OVC + implemented missing passing flag for mo/moc_frontend/pipeline.py ( #18618 )
2023-07-18 15:30:34 +00:00
Oleg Pipikin
cdef86c366
Move unit and func test utils ( #18423 )
...
* Move unit and func test utils. Rename targets
* Fix1
2023-07-18 16:23:58 +02:00
Karol Blaszczak
a7b76522a6
[DOCS] minor MO fixes ( #18603 )
2023-07-18 16:22:34 +02:00
Sebastian Golebiewski
b7e8338e29
update ( #18615 )
2023-07-18 14:51:23 +02:00
Chen Xu
9334ad0790
[CPU] Reduce node supports fp16 precision ( #18227 )
2023-07-18 12:49:25 +00:00
bstankix
8a49cf14ee
[DOCS] Add newsletter form ( #18605 )
...
* Add newsletter modal
2023-07-18 14:46:42 +02:00
Mateusz Bencer
144c1ffd7b
[ONNX FE] Enable two-steps importing (convert_partially + normalize) ( #18440 )
2023-07-18 12:37:02 +00:00
Jan Iwaszkiewicz
ec26537b3e
[PyOV][DOCS] Update inference documentation with shared memory flags ( #18561 )
2023-07-18 13:15:10 +02:00
Maciej Smyk
d21296bcc1
Update configurations-for-intel-gpu.md ( #18611 )
2023-07-18 12:35:37 +02:00
Anastasiia Pnevskaia
e67850a186
Use GA4 telemetry backend in MO and OVC. ( #18584 )
2023-07-18 11:50:04 +04:00
Pawel Raasz
ff5b56ee07
Improve node validation failure message for shape infer ( #18520 )
...
* Add NODE_SHAPE_INFER_CHECK macro
throws NodeValidationFailure for shape inference
* Use NODE_SHAPE_INFER_CHECK in topk shape inference
* Move description to header file
* export NodeValidationFailure::create function
2023-07-18 11:41:19 +04:00
Jan Iwaszkiewicz
787796d88f
[PyOV] Pin version of Cython for API 1.0 ( #18604 )
2023-07-18 11:35:03 +04:00
Jade Cho
4d777bd65b
[GPU] Copy from usm_host memory to cl_mem memory. ( #18555 )
2023-07-18 11:27:21 +09:00
