Commit Graph

11786 Commits

Author SHA1 Message Date
Wang, Yang
85f514788e
[AUTO] Clean up the logic of AUTO device priorities (#18557)
* Update selection logic for 3rd part devices within AUTO plugin.

* Remove MYRAID from AUTO test case.

* Update.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-07-25 10:03:14 +08:00
Andrew Kwangwoong Park
dfb1493f2f
[GPU] Update ReorgYolo to use nGraph shape inference (#18663)
* Update ReorgYolo to use ngraph shape infer

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add dynamic TCs for ov_gpu_func_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add shape infer TCs for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply comments

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix clang-format

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix conflict

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-25 02:47:27 +02:00
Taylor Yeonbok Lee
ce729761d6
Add new debug config "DisableRuntimeBufferFusing" (#18726) 2023-07-24 23:56:21 +02:00
Irina Efode
f70ef8be5b
[CONFORMANCE] Extend Graph Cache by repeats in models (#18602)
* Add Repeat extractor

* fix build
2023-07-24 23:24:15 +02:00
Oleg Pipikin
bf4a2a462a
Refactor common_test_utils (#18693)
* Refactor common_test_utils

* Apply comments
2023-07-24 21:23:42 +02:00
Sergey Shlyapnikov
42237bcbdb
[GPU] Optimize update_shape synchronization for OOOQ and prohibit memory reuse for shape_of-subgraph nodes (#18742) 2023-07-24 11:34:19 -07:00
Paul Youngsoo Ahn
080ae32a8b
[GPU] Fix cl kernel build error (#18513)
* [GPU] Fix cl kernel build error(#18513)

* [GPU] Rollback cl kernel code change and add type converions to activatino function)

* [GPU] Use output data type instead of unit type in MakeActivationJitConstants

* [GPU] remove unused code and add comments
- add unit test
2023-07-24 10:45:02 -07:00
Ekaterina Aidova
016eb43741
[PT FE]: fix issues with squeeze producing dynamic rank (#18748)
* [PT FE]: fix issues with squeeze producing dynamic rank

* Update test_squeeze.py

* Update test_squeeze.py

* Update test_slice.py

* Apply suggestions from code review
2023-07-24 20:10:20 +04:00
Ilya Lavrenov
de2675c381
Added cpack calls in python tools (#18754) 2023-07-24 19:55:07 +04:00
Ilya Lavrenov
afc563cfc6
Changed the component for conda-forge downloads stat (#18755) 2023-07-24 18:49:13 +04:00
Evgeny Kotov
6ecbdaea08
fix TSGatherForward transformation (#18537)
* add comment

* rewrite new_order generation code

* add unit tests

* code review fix

* fix windows build

* code review fixes

---------

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-24 14:18:22 +00:00
Pawel Raasz
5eab1be682
Migrate shape infers to new IStaticShapeInfer API (#18579)
* Add static shape adapter
- Adapters holds CPU dimension which can be reference to it or vector
- Add ov::optional for holding optional result from shape inference
- Add new `infer` function in `IStaticShapeInfer`

* Temporary support of StaticShape

* Minor corrections in ShapeInferenceTA

* Migrate shape_infer to new interface version

* Replace StaticShape by adapter implementation

* Replace IShapeInferCommon by IStaticShapeInfer

* Correct code formatting

* Fix build issues

* NodeValidationFailure::create for StaticShapeRef
2023-07-24 15:59:18 +02:00
Mang Guo
ec8fe6353a
Allow weight sharing across NUMA nodes inside one socket (#17989)
* Allow weight sharing across NUMA nodes inside one socket

* Fix comments

* Add WA for MacOS
2023-07-24 20:49:46 +08:00
Ilya Lavrenov
86c68fffe4
Removed Intel Myriad headers from new API (#18736)
* Removed Intel Myriad from new API

* Renamed GPU unit tests
2023-07-24 16:20:08 +04:00
Irina Efode
1d3dec9e99
[CONFORMANCE] Extend Graph Cache by Fused names based extractor (#18601)
* Add fused names based subgraph extractor

* fix test build
2023-07-24 13:52:00 +02:00
Maxim Vafin
bc734dfaaa
[PT FE] Enable quantized conv and linear tests (#18723) 2023-07-24 13:33:11 +02:00
bstankix
7e1d8283f2
Update newsletter with filtered form fields (#18740) 2023-07-24 13:23:00 +02:00
Karol Blaszczak
bfe3faca1e
[DOCS] conformance update (#18732)
conformance table
fix Add in ONNX layers
2023-07-24 11:43:33 +02:00
Egor Duplenskii
5833f32c22
[CPU][ARM] Fix perf issues of oneDNN 3.2 migration (#18589) 2023-07-24 13:01:59 +04:00
Mateusz Bencer
24c428326a
Align mmap offset with page size for Linux (#18678)
* Align mmap offset with page size for Linux

* removed aligned_size

* reverted aligned_size + added proper unit test
2023-07-24 12:53:33 +04:00
yanlan song
73147e3968
profiling info tests not instantiated (#18408)
* test not run in ci

Signed-off-by: fishbell <bell.song@intel.com>

* skip unsupported case in batch

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
2023-07-24 11:51:16 +04:00
Andrew Kwangwoong Park
581d12965b
[GPU] Minor fix for dynamic model (#18715)
Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-24 09:33:30 +04:00
Wilson Seok
90e3e85233
fix null impl case for optimized concat (#18714) 2023-07-23 21:55:53 -07:00
Andrew Kwangwoong Park
2c889c8b5e
[GPU] Update RegionYolo to use nGraph shape inference (#18657)
* Update RegionYolo to use ngraph shape infer

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add dynamic TCs for ov_gpu_func_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add shape infer TCs for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-23 21:55:21 -07:00
Wang Kai
74b5f8673c
fixing typo (#18041)
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-07-24 06:07:25 +02:00
Wang, Yang
68c0711758
[AUTO] Update Auto unit test cases (#18634)
* 1. Setting property ov::compilation_num_threads for actual device (not CPU) selected by AUTO.
2. Add the test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* check if the selected device supports this property before enabling this property.

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Updated.

* Updated.

* Using the ov::device::properties, instead of the device name, to check if secondary property is set for hardware device.

* Update.

* Update.

* Update.

* Update the  property handling logic to support the ov::device::properties setting.

* Update.

* Update.

* Update the case to check if the secondary propery has high priority.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2023-07-24 11:54:16 +08:00
Wilson Seok
627d5e6135
[GPU] PriorBox dynamic shape support (#18494)
* initial commit

* add func test case

* add func test file

* add runtime update of output_size and img_size

* fix cl kernel build error

* fix functional test bug

* add func test cases

* fix compile error

* use simple value instead of tensor

* remove redundency code

* removed mutable and add comment

* fix typo

* fix cpplint error

* simplified priorbox constructor

* removed redundant include

* update vector handling for impl_param.output_size and img_size
2023-07-23 17:59:28 -07:00
Maxim Vafin
f96f021920
[PT FE] Add helper for regular ops on quantized values (#18692)
* Add helper for regular ops

* Update op_table.cpp

* Support ops with more then 1 output

* Uncheck ops that return integer/boolean type
2023-07-22 16:47:44 +02:00
Andrew Kwangwoong Park
7fc1fd155d
[GPU] Add debug config for disabled dynamic implementation (#18661)
* Add debug config for disabled dynamic impl

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply comment

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-21 16:33:44 -07:00
Anastasiia Pnevskaia
66094836d6
Corrected telemetry imports, increased telemetry version in requirements. (#18712) 2023-07-22 02:38:43 +04:00
Irina Efode
1affc6e66f
[CONFORMANCE] Fix compilation on Debian Post-commit (#18720) 2023-07-22 02:02:07 +04:00
Mykhailo Hnap
7f183f0e2f
[GPU] Added TopK-11 operation support. (#18294)
* Added TopK-11 operation support.

* Created separate GPU test.
2023-07-21 13:36:43 -07:00
Wanglei Shen
0974cb10bc
add socket id initialization in MacOS (#18717) 2023-07-21 18:49:36 +00:00
Mikhail Ryzhov
85ca561546
[GNA] Transpose compressing (#18608) 2023-07-21 14:36:30 +00:00
Ekaterina Aidova
40e9ad106e
Fix PyTorch FE build with clang compiler (#18709)
* fix build

* Update src/frontends/pytorch/src/op/rand.cpp

* fix code style

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-07-21 18:08:24 +04:00
Wanglei Shen
98026d420f
update proc_type_table for MacOS (#18702) 2023-07-21 21:13:28 +08:00
Sofya Balandina
12a7ed9bdd
[apiConformance] Fix run_confoormance fails after exclusion opset tests (#18710) 2023-07-21 16:57:09 +04:00
Sergey Lyalin
329200cc62
New save_model function (C++, Python) (#18656)
* Draft version of save_model function (C++, Python)

* Fixed code style.

* Fixed incorrect test model construction for Python save_model tests

* Minor improvements in code readability

* Minor adjustment based on PR review
2023-07-21 16:03:53 +04:00
Ilya Churaev
44cae128cc
Restore information about Blob layout for new plugins (#18696)
* Restore information about Blob layout for new plugins

* Save legacy names
2023-07-21 14:28:55 +04:00
Piotr Krzemiński
e076ed4726
[PT FE] Quantized Add, Add_ReLU, Mul, Hardswish (#18510)
* Support GetAttr with packed params

* Apply suggestions from code review

* [PT FE] Add quantized types as normal types to decoder

* [PT FE] Add decoder dequantize, add dtypes to quantize

* [PT FE] Add dequantize example

* [PT FE] Implement replacer for quantized nodes

* [PT FE] Register replacer for quantize/dequantize

* [PT FE] Remove unwanted junk from previous version

* [PT FE] Fix building mistakes for frontend

* [PT FE] Clang fix

* [PT FE] Ease of use upgrade to quantize funcs

* [PT FE] Clang format

* [PT FE] Introduce new version of quantize/dequantize

* [PT FE] Remove unwanted files from new version

* [PT FE] Fix style

* [PT FE] Add QuantizedPtNode replacer, fix accuracy error

* [PT FE] Quantized add

* [PT FE] Add improved version of quantize/dequantize with shared_ptrs

* [PT FE] Quantized Add Relu

* [PT FE] Fix utils shared ptr reference error

* [PT FE] Quantized Hardswish & tests

* [PT FE] Add quantized_add_relu test

* [PT FE] Quantize now takes correct input for operations

* [PT FE] Add dtype to tests

* [PT FE] Increase matrix size in the tests to cover more edge cases

* [PT FE] Upgrade quantize method

* [PT FE] Add BFS for dequantize, add quantize_per_channel

* [PT FE] Add missing replacer to frontend, improve tests

* [PT FE] Rename replacer -> remover, remove unwanted header files

* [PT FE] Change function declarations to return ov::Output instead of shared ptr

* [PT FE] Add missing context mark node

* [PT FE] Remove unknown modifications to ie_c_api

* [PT FE] Remove fp16 support, turn off int32 tests

* [PT FE] Clang format

* [PT FE] Fix quantize_per_tensor

* [PT FE] Minor fixes from review

* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead

* [PT FE] Rename Replacer to Remover for dequantize nodes

* [PT FE] Clang format

* [PT FE] Move comments to header files, minor import fixes

* [PT FE] Enable add, add_relu, mul, hardswish with newest quantize ops

* [PT FE] Fix clang format

* [PT FE] Fix dtype issue

* [PT FE] Reenable hardswish tests

* [PT FE] Fix building error for quantized ops

* [PT FE] Tests now use rand instead of randn

* [PT FE] Remove int32 support from tests

* [PT FE] Fix quantize_per_channel tests

* Apply suggestions from code review

Removing sporadic tests from precommit

* Apply suggestions from code review

* [PT FE] Mark qint32 with skip, remove precommit flag due to sporadic errors

* [PT FE] Introduce quantized test for PytorchTestClass

* [PT FE] Add missing tensor size in the errors count computation

* Update pytorch_layer_test_class.py

* [PT FE] Apply suggestions from review - remove contexts, log100 for errors, add precommit flags

* Apply suggestions from code review

* [PT FE] Fix quantize per channel test after merge

* Update tests/layer_tests/pytorch_tests/pytorch_layer_test_class.py

* Update pytorch_layer_test_class.py

* Update test_quantize.py

* Apply suggestions from code review

* [PT FE] Fix quantized mul by changing default quantization dtype

* Update pytorch_layer_test_class.py

* Update tests/layer_tests/pytorch_tests/pytorch_layer_test_class.py

* Update src/frontends/pytorch/src/utils_quantize.cpp

* Update src/frontends/pytorch/src/utils_quantize.cpp

* Update tests/layer_tests/pytorch_tests/test_quantized_mul.py

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-07-21 10:27:35 +00:00
Ekaterina Aidova
a6e25d69ac
[PT FE] supoort aten::rand, aten::randn, aten::rand_like, aten::randn_like (#18616)
* support aten::rand, aten::randn, aten::rand_like, aten::randn_like

* fixes
2023-07-21 13:27:48 +04:00
Irina Efode
0ff70a0649
[CONFORMANCE] Extend SubgraphsDumper by graph cache + subgraph extractors (#18398)
* New Subgraph Dumper -> Cache + Meta

* iCache tests

* tests_meta

* OpCache tests

* Move & refactor matchers

* fix all tests and refactor meta

* Prepare for review

* Add caching types

* Model testing + improvement

* Add ignored ports. Add tests for node utils

* [CONFORMANCE] MOVE conformance runner to new subgraphsDumper

* fix build

* Fix compilation error

* fix compilation of deprecated subgraphs dumper

* fix build

* arm

* fix win?

* temp commit

* revert

* Add w/a to save const

* [IE TESTS][CONFORMANCE] Fix data generation

* fix cpu tests

* CPP Lint

* Update ranges.hpp

* change start_from and range according typo

* Update constant.hpp

* Update constant.hpp

* fix ci build

* Update deformable_convolution.cpp

* cleanup

* clenup

* Merge

e Changes to be committed:

* Fix tests -> change start_from type

* Initial commit to dump subgraphs

* try to collect graphs usong fused_names

* Correct graph generation based on fused_names

* addition

* Define SubgraphMatchers

* Add new matcher structure

* fix buils commit

* repeat

* repeat pattern

* finalize

* Move to extractors

* extract_body

* cleanup_cache

* replace big constant by params

* Replace constants by param in serialization

* Add tests for matchers

* add model-tests

* fix model tests

* Extend tests

* fix extractors test

* fix model recover test

* Remove extra

* remove extra

* return old name to tests

* remove subgraphs extractors -> move them to other PR
2023-07-21 12:21:29 +03:00
Ilya Lavrenov
6d86a9b25f
Revert "[PyOV] Pin version of Cython for API 1.0 (#18604)" (#18681)
* Revert "[PyOV] Pin version of Cython for API 1.0 (#18604)"

This reverts commit 787796d88f.

* Suppressed clang warning
2023-07-21 13:09:30 +04:00
Ilya Lavrenov
bbd592b530
Don't use -Wl,--allow-shlib-undefined on macOS (#18683) 2023-07-21 13:08:26 +04:00
Fang Xu
e478964695
merge loadnetwork and importnetwork for cpu plugin (#18024)
* merget loadnetwork and importnetwork for cpu plugin

* fix testcase

* remove multithreading config saving

* modify test case

* separate function

* modify function name

* save model_prefer_threads to cache

* remove function encapsulation for config
2023-07-21 14:02:11 +08:00
Andrew Kwangwoong Park
53b2a02a0e
[GPU] Dynamism support for DetectionOutput (#18625)
* Update op creation for DetectionOutput-8 w/o num_classes attribute

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update DetectionOutput to use ngraph shape inference

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add dynamic TCs for ov_gpu_func_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix issues for detection output cpu impl selection on dynamic shape

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update detection_output primitive API and funcs for serialization

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add shape infer TCs for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix build failure in azure pipeline

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-20 16:49:09 -07:00
Maxim Vafin
12b1df5db3
Disable sporadically failing tests (#18694) 2023-07-20 21:34:43 +00:00
Anastasiia Pnevskaia
8d5a0b1d53
OVC cleanup. (#18649)
* WIP: parameters cleanup

* Removed debug output, fixed CLI

* Fixed python objects conversion

* Finally renamed mmap to share_weights

* Fixed TF conversion from a file or a directory

* Fixed obvious errors in unit tests

* Deleted layouts from OVC. Fixed most of the fails in ovc unit tests (there are still failures)

* Clenaup other references to layouts and fixed --version

* Fixed case when two model files are passed in TF case

* Fixed multiple model parts passing in ovc command line

* Tests fixed, support of unnamed input in cli parser.

* Remove convert_model from runtime.

* Changed silent to verbose.

* Removed transform param.

* Removed example_input, share_weights from ovc cli tool.

* Remove wrong change.

* Test fix.

* Code corrections.

* Returned comment.

* WA to fix process hanging after extension loading.

* Removed not needed code.

* Added comment.

---------

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
2023-07-20 20:11:28 +00:00
Ilya Lavrenov
1ce744a00f
Fixed Debian package build (#18691) 2023-07-20 22:23:39 +04:00
Mateusz Mikolajczyk
bc261424ef
[PT FE] Add quantized::conv2d and quantized::conv2d_relu (#18651)
* Add quantized conv2d

* Fix schema

* Remove mark_output

* Remove tests from pre-commit
2023-07-20 15:35:11 +00:00