Commit Graph
11797 Commits
Author SHA1 Message Date
Ilya Lavrenov 5792bba6d1 Disabled multi_isa in ARM CPU plugin (#18737) 2023-07-25 11:48:54 +04:00
yanlan song ff3399a87a enable auto handle GPU.invalid_index case (#18658)
* let auto handle GPU.valid_index case

Signed-off-by: fishbell <bell.song@intel.com>

* resolve merge conflict

Signed-off-by: fishbell <bell.song@intel.com>

* add suppress macro

Signed-off-by: fishbell <bell.song@intel.com>

* revert changes

Signed-off-by: fishbell <bell.song@intel.com>

* update case

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
2023-07-25 15:31:53 +08:00
Andrei Gorbachev 02ebdcbb8f [Coverity] fix uninitialized scalar field (#18751)
* fix Uninitialized scalar variable

* fix CVS-116194

* a few fix

* fix Uninitialized scalar variable

* fix CVS-116194

* a few fix

* rm dead code
2023-07-25 10:57:28 +04:00
Maciej Smyk 393b3b1545 background fix for images (#18756) 2023-07-25 08:45:06 +02:00
cecilia peng 7fbd3a7ebf [CPU] Zero-copy optimizations for model outputs (#18476)
- Implement zero-copy output between plugin graph and infer request, thus eliminate memory copy overhead and optimize performance
- Implement double buffer for InferRequest outputs
2023-07-25 10:33:48 +04:00
Wang KaiandIlya Churaev fdfafbb7d2 removing redundant statement in ov::descriptor::Tensor::Tensor (#18098)
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-07-25 07:55:42 +02:00
Ilya Churaev e7cd113a47 Add to_string() method to ov::element::Type (#18697)
* Add to_string() method to ov::element::Type

* Fixed Python legacy API

* Fixed typo
2023-07-25 09:22:16 +04:00
Ilya Churaev 29ca4b99c5 Add property to configure internal name under the proxy plugin (#18727) 2023-07-25 09:22:02 +04:00
Katarzyna Mitrus 99557e3356 Enable ScatterElementsUpdate test for reduction mean (#18682)
* Enable scatter elements test for reduction mean

* Remove remaining comment
2023-07-25 06:45:05 +02:00
Xuejun Zhai 5efdbf57ad [AUTO BATCH PLUGIN] fix review comments (#18660)
* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] add get property ov::device::properties & ov::auto_batch_timeout

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-07-25 07:19:04 +04:00
Wang, YangandChen Peter 1be4b21905 [AUTO] Set property optimal_number_of_infer_requests to hw device with default value (#17848)
* Query the property optimal_number_of_infer_requests from plugin first if plugin supported.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Query the property ov::optimal_number_of_infer_request of actual device first and use it as the result of AutoExecutableNetwork property.

* Updated.

* Updated.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-07-25 10:05:18 +08:00
Wang, YangandChen Peter 85f514788e [AUTO] Clean up the logic of AUTO device priorities (#18557)
* Update selection logic for 3rd part devices within AUTO plugin.

* Remove MYRAID from AUTO test case.

* Update.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-07-25 10:03:14 +08:00
Andrew Kwangwoong Park dfb1493f2f [GPU] Update ReorgYolo to use nGraph shape inference (#18663)
* Update ReorgYolo to use ngraph shape infer

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add dynamic TCs for ov_gpu_func_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add shape infer TCs for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply comments

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix clang-format

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix conflict

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-25 02:47:27 +02:00
Taylor Yeonbok Lee ce729761d6 Add new debug config "DisableRuntimeBufferFusing" (#18726) 2023-07-24 23:56:21 +02:00
Irina Efode f70ef8be5b [CONFORMANCE] Extend Graph Cache by repeats in models (#18602)
* Add Repeat extractor

* fix build
2023-07-24 23:24:15 +02:00
Oleg Pipikin bf4a2a462a Refactor common_test_utils (#18693)
* Refactor common_test_utils

* Apply comments
2023-07-24 21:23:42 +02:00
Sergey Shlyapnikov 42237bcbdb [GPU] Optimize update_shape synchronization for OOOQ and prohibit memory reuse for shape_of-subgraph nodes (#18742) 2023-07-24 11:34:19 -07:00
Paul Youngsoo Ahn 080ae32a8b [GPU] Fix cl kernel build error (#18513)
* [GPU] Fix cl kernel build error(#18513)

* [GPU] Rollback cl kernel code change and add type converions to activatino function)

* [GPU] Use output data type instead of unit type in MakeActivationJitConstants

* [GPU] remove unused code and add comments
- add unit test
2023-07-24 10:45:02 -07:00
Ekaterina Aidova 016eb43741 [PT FE]: fix issues with squeeze producing dynamic rank (#18748)
* [PT FE]: fix issues with squeeze producing dynamic rank

* Update test_squeeze.py

* Update test_squeeze.py

* Update test_slice.py

* Apply suggestions from code review
2023-07-24 20:10:20 +04:00
Ilya Lavrenov de2675c381 Added cpack calls in python tools (#18754) 2023-07-24 19:55:07 +04:00
Ilya Lavrenov afc563cfc6 Changed the component for conda-forge downloads stat (#18755) 2023-07-24 18:49:13 +04:00
Evgeny KotovandIvan Tikhonov 6ecbdaea08 fix TSGatherForward transformation (#18537)
* add comment

* rewrite new_order generation code

* add unit tests

* code review fix

* fix windows build

* code review fixes

---------

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-24 14:18:22 +00:00
Pawel Raasz 5eab1be682 Migrate shape infers to new IStaticShapeInfer API (#18579)
* Add static shape adapter
- Adapters holds CPU dimension which can be reference to it or vector
- Add ov::optional for holding optional result from shape inference
- Add new `infer` function in `IStaticShapeInfer`

* Temporary support of StaticShape

* Minor corrections in ShapeInferenceTA

* Migrate shape_infer to new interface version

* Replace StaticShape by adapter implementation

* Replace IShapeInferCommon by IStaticShapeInfer

* Correct code formatting

* Fix build issues

* NodeValidationFailure::create for StaticShapeRef
2023-07-24 15:59:18 +02:00
Mang Guo ec8fe6353a Allow weight sharing across NUMA nodes inside one socket (#17989)
* Allow weight sharing across NUMA nodes inside one socket

* Fix comments

* Add WA for MacOS
2023-07-24 20:49:46 +08:00
Ilya Lavrenov 86c68fffe4 Removed Intel Myriad headers from new API (#18736)
* Removed Intel Myriad from new API

* Renamed GPU unit tests
2023-07-24 16:20:08 +04:00
Irina Efode 1d3dec9e99 [CONFORMANCE] Extend Graph Cache by Fused names based extractor (#18601)
* Add fused names based subgraph extractor

* fix test build
2023-07-24 13:52:00 +02:00
Maxim Vafin bc734dfaaa [PT FE] Enable quantized conv and linear tests (#18723) 2023-07-24 13:33:11 +02:00
bstankix 7e1d8283f2 Update newsletter with filtered form fields (#18740) 2023-07-24 13:23:00 +02:00
Karol Blaszczak bfe3faca1e [DOCS] conformance update (#18732)
conformance table
fix Add in ONNX layers
2023-07-24 11:43:33 +02:00
Egor Duplenskii 5833f32c22 [CPU][ARM] Fix perf issues of oneDNN 3.2 migration (#18589) 2023-07-24 13:01:59 +04:00
Mateusz Bencer 24c428326a Align mmap offset with page size for Linux (#18678)
* Align mmap offset with page size for Linux

* removed aligned_size

* reverted aligned_size + added proper unit test
2023-07-24 12:53:33 +04:00
yanlan song 73147e3968 profiling info tests not instantiated (#18408)
* test not run in ci

Signed-off-by: fishbell <bell.song@intel.com>

* skip unsupported case in batch

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
2023-07-24 11:51:16 +04:00
Andrew Kwangwoong Park 581d12965b [GPU] Minor fix for dynamic model (#18715)
Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-24 09:33:30 +04:00
Wilson Seok 90e3e85233 fix null impl case for optimized concat (#18714) 2023-07-23 21:55:53 -07:00
Andrew Kwangwoong Park 2c889c8b5e [GPU] Update RegionYolo to use nGraph shape inference (#18657)
* Update RegionYolo to use ngraph shape infer

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add dynamic TCs for ov_gpu_func_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add shape infer TCs for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-23 21:55:21 -07:00
Wang KaiandIlya Churaev 74b5f8673c fixing typo (#18041)
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-07-24 06:07:25 +02:00
Wang, Yang 68c0711758 [AUTO] Update Auto unit test cases (#18634)
* 1. Setting property ov::compilation_num_threads for actual device (not CPU) selected by AUTO.
2. Add the test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* check if the selected device supports this property before enabling this property.

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Updated.

* Updated.

* Using the ov::device::properties, instead of the device name, to check if secondary property is set for hardware device.

* Update.

* Update.

* Update.

* Update the  property handling logic to support the ov::device::properties setting.

* Update.

* Update.

* Update the case to check if the secondary propery has high priority.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2023-07-24 11:54:16 +08:00
Wilson Seok 627d5e6135 [GPU] PriorBox dynamic shape support (#18494)
* initial commit

* add func test case

* add func test file

* add runtime update of output_size and img_size

* fix cl kernel build error

* fix functional test bug

* add func test cases

* fix compile error

* use simple value instead of tensor

* remove redundency code

* removed mutable and add comment

* fix typo

* fix cpplint error

* simplified priorbox constructor

* removed redundant include

* update vector handling for impl_param.output_size and img_size
2023-07-23 17:59:28 -07:00
Maxim Vafin f96f021920 [PT FE] Add helper for regular ops on quantized values (#18692)
* Add helper for regular ops

* Update op_table.cpp

* Support ops with more then 1 output

* Uncheck ops that return integer/boolean type
2023-07-22 16:47:44 +02:00
Andrew Kwangwoong Park 7fc1fd155d [GPU] Add debug config for disabled dynamic implementation (#18661)
* Add debug config for disabled dynamic impl

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply comment

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-21 16:33:44 -07:00
Anastasiia Pnevskaia 66094836d6 Corrected telemetry imports, increased telemetry version in requirements. (#18712) 2023-07-22 02:38:43 +04:00
Irina Efode 1affc6e66f [CONFORMANCE] Fix compilation on Debian Post-commit (#18720) 2023-07-22 02:02:07 +04:00
Mykhailo Hnap 7f183f0e2f [GPU] Added TopK-11 operation support. (#18294)
* Added TopK-11 operation support.

* Created separate GPU test.
2023-07-21 13:36:43 -07:00
Wanglei Shen 0974cb10bc add socket id initialization in MacOS (#18717) 2023-07-21 18:49:36 +00:00
Mikhail Ryzhov 85ca561546 [GNA] Transpose compressing (#18608) 2023-07-21 14:36:30 +00:00
Ekaterina AidovaandIlya Lavrenov 40e9ad106e Fix PyTorch FE build with clang compiler (#18709)
* fix build

* Update src/frontends/pytorch/src/op/rand.cpp

* fix code style

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-07-21 18:08:24 +04:00
Wanglei Shen 98026d420f update proc_type_table for MacOS (#18702) 2023-07-21 21:13:28 +08:00
Sofya Balandina 12a7ed9bdd [apiConformance] Fix run_confoormance fails after exclusion opset tests (#18710) 2023-07-21 16:57:09 +04:00
Sergey Lyalin 329200cc62 New save_model function (C++, Python) (#18656)
* Draft version of save_model function (C++, Python)

* Fixed code style.

* Fixed incorrect test model construction for Python save_model tests

* Minor improvements in code readability

* Minor adjustment based on PR review
2023-07-21 16:03:53 +04:00
Ilya Churaev 44cae128cc Restore information about Blob layout for new plugins (#18696)
* Restore information about Blob layout for new plugins

* Save legacy names
2023-07-21 14:28:55 +04:00