IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,196 Commits 38 Branches 54 Tags 1.1 GiB
eaeeea9c54
Commit Graph

12196 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yanlan song
ff3399a87a
enable auto handle GPU.invalid_index case (#18658) 
* let auto handle GPU.valid_index case

Signed-off-by: fishbell <bell.song@intel.com>

* resolve merge conflict

Signed-off-by: fishbell <bell.song@intel.com>

* add suppress macro

Signed-off-by: fishbell <bell.song@intel.com>

* revert changes

Signed-off-by: fishbell <bell.song@intel.com>

* update case

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-07-25 15:31:53 +08:00
Andrei Gorbachev
02ebdcbb8f
[Coverity] fix uninitialized scalar field (#18751) 
* fix Uninitialized scalar variable

* fix CVS-116194

* a few fix

* fix Uninitialized scalar variable

* fix CVS-116194

* a few fix

* rm dead code
 2023-07-25 10:57:28 +04:00
Maciej Smyk
393b3b1545
background fix for images (#18756) 2023-07-25 08:45:06 +02:00
cecilia peng
7fbd3a7ebf
[CPU] Zero-copy optimizations for model outputs (#18476) 
- Implement zero-copy output between plugin graph and infer request, thus eliminate memory copy overhead and optimize performance
- Implement double buffer for InferRequest outputs
 2023-07-25 10:33:48 +04:00
Wang Kai
fdfafbb7d2
removing redundant statement in ov::descriptor::Tensor::Tensor (#18098) 
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
 2023-07-25 07:55:42 +02:00
Ilya Churaev
e7cd113a47
Add to_string() method to ov::element::Type (#18697) 
* Add to_string() method to ov::element::Type

* Fixed Python legacy API

* Fixed typo
 2023-07-25 09:22:16 +04:00
Ilya Churaev
29ca4b99c5
Add property to configure internal name under the proxy plugin (#18727) 2023-07-25 09:22:02 +04:00
Katarzyna Mitrus
99557e3356
Enable ScatterElementsUpdate test for reduction mean (#18682) 
* Enable scatter elements test for reduction mean

* Remove remaining comment
 2023-07-25 06:45:05 +02:00
Xuejun Zhai
5efdbf57ad
[AUTO BATCH PLUGIN] fix review comments (#18660) 
* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] add get property ov::device::properties & ov::auto_batch_timeout

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
 2023-07-25 07:19:04 +04:00
Wang, Yang
1be4b21905
[AUTO] Set property optimal_number_of_infer_requests to hw device with default value (#17848) 
* Query the property optimal_number_of_infer_requests from plugin first if plugin supported.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Query the property ov::optimal_number_of_infer_request of actual device first and use it as the result of AutoExecutableNetwork property.

* Updated.

* Updated.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-07-25 10:05:18 +08:00
Wang, Yang
85f514788e
[AUTO] Clean up the logic of AUTO device priorities (#18557) 
* Update selection logic for 3rd part devices within AUTO plugin.

* Remove MYRAID from AUTO test case.

* Update.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-07-25 10:03:14 +08:00
Andrew Kwangwoong Park
dfb1493f2f
[GPU] Update ReorgYolo to use nGraph shape inference (#18663) 
* Update ReorgYolo to use ngraph shape infer

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add dynamic TCs for ov_gpu_func_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add shape infer TCs for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply comments

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix clang-format

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix conflict

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
 2023-07-25 02:47:27 +02:00
Taylor Yeonbok Lee
ce729761d6
Add new debug config "DisableRuntimeBufferFusing" (#18726) 2023-07-24 23:56:21 +02:00
Irina Efode
f70ef8be5b
[CONFORMANCE] Extend Graph Cache by repeats in models (#18602) 
* Add Repeat extractor

* fix build
 2023-07-24 23:24:15 +02:00
Oleg Pipikin
bf4a2a462a
Refactor common_test_utils (#18693) 
* Refactor common_test_utils

* Apply comments
 2023-07-24 21:23:42 +02:00
Sergey Shlyapnikov
42237bcbdb
[GPU] Optimize update_shape synchronization for OOOQ and prohibit memory reuse for shape_of-subgraph nodes (#18742) 2023-07-24 11:34:19 -07:00
Paul Youngsoo Ahn
080ae32a8b
[GPU] Fix cl kernel build error (#18513) 
* [GPU] Fix cl kernel build error(#18513)

* [GPU] Rollback cl kernel code change and add type converions to activatino function)

* [GPU] Use output data type instead of unit type in MakeActivationJitConstants

* [GPU] remove unused code and add comments
- add unit test
 2023-07-24 10:45:02 -07:00
Ekaterina Aidova
016eb43741
[PT FE]: fix issues with squeeze producing dynamic rank (#18748) 
* [PT FE]: fix issues with squeeze producing dynamic rank

* Update test_squeeze.py

* Update test_squeeze.py

* Update test_slice.py

* Apply suggestions from code review
 2023-07-24 20:10:20 +04:00
Ilya Lavrenov
de2675c381
Added cpack calls in python tools (#18754) 2023-07-24 19:55:07 +04:00
Ilya Lavrenov
afc563cfc6
Changed the component for conda-forge downloads stat (#18755) 2023-07-24 18:49:13 +04:00
Evgeny Kotov
6ecbdaea08
fix TSGatherForward transformation (#18537) 
* add comment

* rewrite new_order generation code

* add unit tests

* code review fix

* fix windows build

* code review fixes

---------

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
 2023-07-24 14:18:22 +00:00
Pawel Raasz
5eab1be682
Migrate shape infers to new IStaticShapeInfer API (#18579) 
* Add static shape adapter
- Adapters holds CPU dimension which can be reference to it or vector
- Add ov::optional for holding optional result from shape inference
- Add new `infer` function in `IStaticShapeInfer`

* Temporary support of StaticShape

* Minor corrections in ShapeInferenceTA

* Migrate shape_infer to new interface version

* Replace StaticShape by adapter implementation

* Replace IShapeInferCommon by IStaticShapeInfer

* Correct code formatting

* Fix build issues

* NodeValidationFailure::create for StaticShapeRef
 2023-07-24 15:59:18 +02:00
Mang Guo
ec8fe6353a
Allow weight sharing across NUMA nodes inside one socket (#17989) 
* Allow weight sharing across NUMA nodes inside one socket

* Fix comments

* Add WA for MacOS
 2023-07-24 20:49:46 +08:00
Ilya Lavrenov
86c68fffe4
Removed Intel Myriad headers from new API (#18736) 
* Removed Intel Myriad from new API

* Renamed GPU unit tests
 2023-07-24 16:20:08 +04:00
Irina Efode
1d3dec9e99
[CONFORMANCE] Extend Graph Cache by Fused names based extractor (#18601) 
* Add fused names based subgraph extractor

* fix test build
 2023-07-24 13:52:00 +02:00
Maxim Vafin
bc734dfaaa
[PT FE] Enable quantized conv and linear tests (#18723) 2023-07-24 13:33:11 +02:00
bstankix
7e1d8283f2
Update newsletter with filtered form fields (#18740) 2023-07-24 13:23:00 +02:00
Karol Blaszczak
bfe3faca1e
[DOCS] conformance update (#18732) 
conformance table
fix Add in ONNX layers
 2023-07-24 11:43:33 +02:00
Egor Duplenskii
5833f32c22
[CPU][ARM] Fix perf issues of oneDNN 3.2 migration (#18589) 2023-07-24 13:01:59 +04:00
Mateusz Bencer
24c428326a
Align mmap offset with page size for Linux (#18678) 
* Align mmap offset with page size for Linux

* removed aligned_size

* reverted aligned_size + added proper unit test
 2023-07-24 12:53:33 +04:00
yanlan song
73147e3968
profiling info tests not instantiated (#18408) 
* test not run in ci

Signed-off-by: fishbell <bell.song@intel.com>

* skip unsupported case in batch

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-07-24 11:51:16 +04:00
Andrew Kwangwoong Park
581d12965b
[GPU] Minor fix for dynamic model (#18715) 
Signed-off-by: Andrew Park <andrew.park@intel.com>
 2023-07-24 09:33:30 +04:00
Wilson Seok
90e3e85233
fix null impl case for optimized concat (#18714) 2023-07-23 21:55:53 -07:00
Andrew Kwangwoong Park
2c889c8b5e
[GPU] Update RegionYolo to use nGraph shape inference (#18657) 
* Update RegionYolo to use ngraph shape infer

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add dynamic TCs for ov_gpu_func_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add shape infer TCs for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
 2023-07-23 21:55:21 -07:00
Wang Kai
74b5f8673c
fixing typo (#18041) 
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
 2023-07-24 06:07:25 +02:00
Wang, Yang
68c0711758
[AUTO] Update Auto unit test cases (#18634) 
* 1. Setting property ov::compilation_num_threads for actual device (not CPU) selected by AUTO.
2. Add the test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* check if the selected device supports this property before enabling this property.

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Updated.

* Updated.

* Using the ov::device::properties, instead of the device name, to check if secondary property is set for hardware device.

* Update.

* Update.

* Update.

* Update the  property handling logic to support the ov::device::properties setting.

* Update.

* Update.

* Update the case to check if the secondary propery has high priority.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
 2023-07-24 11:54:16 +08:00
Wilson Seok
627d5e6135
[GPU] PriorBox dynamic shape support (#18494) 
* initial commit

* add func test case

* add func test file

* add runtime update of output_size and img_size

* fix cl kernel build error

* fix functional test bug

* add func test cases

* fix compile error

* use simple value instead of tensor

* remove redundency code

* removed mutable and add comment

* fix typo

* fix cpplint error

* simplified priorbox constructor

* removed redundant include

* update vector handling for impl_param.output_size and img_size
 2023-07-23 17:59:28 -07:00
Maxim Vafin
f96f021920
[PT FE] Add helper for regular ops on quantized values (#18692) 
* Add helper for regular ops

* Update op_table.cpp

* Support ops with more then 1 output

* Uncheck ops that return integer/boolean type
 2023-07-22 16:47:44 +02:00
Andrew Kwangwoong Park
7fc1fd155d
[GPU] Add debug config for disabled dynamic implementation (#18661) 
* Add debug config for disabled dynamic impl

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply comment

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
 2023-07-21 16:33:44 -07:00
Anastasiia Pnevskaia
66094836d6
Corrected telemetry imports, increased telemetry version in requirements. (#18712) 2023-07-22 02:38:43 +04:00
Irina Efode
1affc6e66f
[CONFORMANCE] Fix compilation on Debian Post-commit (#18720) 2023-07-22 02:02:07 +04:00
Mykhailo Hnap
7f183f0e2f
[GPU] Added TopK-11 operation support. (#18294) 
* Added TopK-11 operation support.

* Created separate GPU test.
 2023-07-21 13:36:43 -07:00
Wanglei Shen
0974cb10bc
add socket id initialization in MacOS (#18717) 2023-07-21 18:49:36 +00:00
Mikhail Ryzhov
85ca561546
[GNA] Transpose compressing (#18608) 2023-07-21 14:36:30 +00:00
Ekaterina Aidova
40e9ad106e
Fix PyTorch FE build with clang compiler (#18709) 
* fix build

* Update src/frontends/pytorch/src/op/rand.cpp

* fix code style

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
 2023-07-21 18:08:24 +04:00
Wanglei Shen
98026d420f
update proc_type_table for MacOS (#18702) 2023-07-21 21:13:28 +08:00
Sofya Balandina
12a7ed9bdd
[apiConformance] Fix run_confoormance fails after exclusion opset tests (#18710) 2023-07-21 16:57:09 +04:00
Sergey Lyalin
329200cc62
New save_model function (C++, Python) (#18656) 
* Draft version of save_model function (C++, Python)

* Fixed code style.

* Fixed incorrect test model construction for Python save_model tests

* Minor improvements in code readability

* Minor adjustment based on PR review
 2023-07-21 16:03:53 +04:00
Ilya Churaev
44cae128cc
Restore information about Blob layout for new plugins (#18696) 
* Restore information about Blob layout for new plugins

* Save legacy names
 2023-07-21 14:28:55 +04:00
Piotr Krzemiński
e076ed4726
[PT FE] Quantized Add, Add_ReLU, Mul, Hardswish (#18510) 
* Support GetAttr with packed params

* Apply suggestions from code review

* [PT FE] Add quantized types as normal types to decoder

* [PT FE] Add decoder dequantize, add dtypes to quantize

* [PT FE] Add dequantize example

* [PT FE] Implement replacer for quantized nodes

* [PT FE] Register replacer for quantize/dequantize

* [PT FE] Remove unwanted junk from previous version

* [PT FE] Fix building mistakes for frontend

* [PT FE] Clang fix

* [PT FE] Ease of use upgrade to quantize funcs

* [PT FE] Clang format

* [PT FE] Introduce new version of quantize/dequantize

* [PT FE] Remove unwanted files from new version

* [PT FE] Fix style

* [PT FE] Add QuantizedPtNode replacer, fix accuracy error

* [PT FE] Quantized add

* [PT FE] Add improved version of quantize/dequantize with shared_ptrs

* [PT FE] Quantized Add Relu

* [PT FE] Fix utils shared ptr reference error

* [PT FE] Quantized Hardswish & tests

* [PT FE] Add quantized_add_relu test

* [PT FE] Quantize now takes correct input for operations

* [PT FE] Add dtype to tests

* [PT FE] Increase matrix size in the tests to cover more edge cases

* [PT FE] Upgrade quantize method

* [PT FE] Add BFS for dequantize, add quantize_per_channel

* [PT FE] Add missing replacer to frontend, improve tests

* [PT FE] Rename replacer -> remover, remove unwanted header files

* [PT FE] Change function declarations to return ov::Output instead of shared ptr

* [PT FE] Add missing context mark node

* [PT FE] Remove unknown modifications to ie_c_api

* [PT FE] Remove fp16 support, turn off int32 tests

* [PT FE] Clang format

* [PT FE] Fix quantize_per_tensor

* [PT FE] Minor fixes from review

* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead

* [PT FE] Rename Replacer to Remover for dequantize nodes

* [PT FE] Clang format

* [PT FE] Move comments to header files, minor import fixes

* [PT FE] Enable add, add_relu, mul, hardswish with newest quantize ops

* [PT FE] Fix clang format

* [PT FE] Fix dtype issue

* [PT FE] Reenable hardswish tests

* [PT FE] Fix building error for quantized ops

* [PT FE] Tests now use rand instead of randn

* [PT FE] Remove int32 support from tests

* [PT FE] Fix quantize_per_channel tests

* Apply suggestions from code review

Removing sporadic tests from precommit

* Apply suggestions from code review

* [PT FE] Mark qint32 with skip, remove precommit flag due to sporadic errors

* [PT FE] Introduce quantized test for PytorchTestClass

* [PT FE] Add missing tensor size in the errors count computation

* Update pytorch_layer_test_class.py

* [PT FE] Apply suggestions from review - remove contexts, log100 for errors, add precommit flags

* Apply suggestions from code review

* [PT FE] Fix quantize per channel test after merge

* Update tests/layer_tests/pytorch_tests/pytorch_layer_test_class.py

* Update pytorch_layer_test_class.py

* Update test_quantize.py

* Apply suggestions from code review

* [PT FE] Fix quantized mul by changing default quantization dtype

* Update pytorch_layer_test_class.py

* Update tests/layer_tests/pytorch_tests/pytorch_layer_test_class.py

* Update src/frontends/pytorch/src/utils_quantize.cpp

* Update src/frontends/pytorch/src/utils_quantize.cpp

* Update tests/layer_tests/pytorch_tests/test_quantized_mul.py

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
 2023-07-21 10:27:35 +00:00