IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,759 Commits 38 Branches 54 Tags 1.1 GiB
f96f021920
Commit Graph

11759 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Maxim Vafin
f96f021920
[PT FE] Add helper for regular ops on quantized values (#18692) 
* Add helper for regular ops

* Update op_table.cpp

* Support ops with more then 1 output

* Uncheck ops that return integer/boolean type
 2023-07-22 16:47:44 +02:00
Andrew Kwangwoong Park
7fc1fd155d
[GPU] Add debug config for disabled dynamic implementation (#18661) 
* Add debug config for disabled dynamic impl

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply comment

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
 2023-07-21 16:33:44 -07:00
Anastasiia Pnevskaia
66094836d6
Corrected telemetry imports, increased telemetry version in requirements. (#18712) 2023-07-22 02:38:43 +04:00
Irina Efode
1affc6e66f
[CONFORMANCE] Fix compilation on Debian Post-commit (#18720) 2023-07-22 02:02:07 +04:00
Mykhailo Hnap
7f183f0e2f
[GPU] Added TopK-11 operation support. (#18294) 
* Added TopK-11 operation support.

* Created separate GPU test.
 2023-07-21 13:36:43 -07:00
Wanglei Shen
0974cb10bc
add socket id initialization in MacOS (#18717) 2023-07-21 18:49:36 +00:00
Mikhail Ryzhov
85ca561546
[GNA] Transpose compressing (#18608) 2023-07-21 14:36:30 +00:00
Ekaterina Aidova
40e9ad106e
Fix PyTorch FE build with clang compiler (#18709) 
* fix build

* Update src/frontends/pytorch/src/op/rand.cpp

* fix code style

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
 2023-07-21 18:08:24 +04:00
Wanglei Shen
98026d420f
update proc_type_table for MacOS (#18702) 2023-07-21 21:13:28 +08:00
Sofya Balandina
12a7ed9bdd
[apiConformance] Fix run_confoormance fails after exclusion opset tests (#18710) 2023-07-21 16:57:09 +04:00
Sergey Lyalin
329200cc62
New save_model function (C++, Python) (#18656) 
* Draft version of save_model function (C++, Python)

* Fixed code style.

* Fixed incorrect test model construction for Python save_model tests

* Minor improvements in code readability

* Minor adjustment based on PR review
 2023-07-21 16:03:53 +04:00
Ilya Churaev
44cae128cc
Restore information about Blob layout for new plugins (#18696) 
* Restore information about Blob layout for new plugins

* Save legacy names
 2023-07-21 14:28:55 +04:00
Piotr Krzemiński
e076ed4726
[PT FE] Quantized Add, Add_ReLU, Mul, Hardswish (#18510) 
* Support GetAttr with packed params

* Apply suggestions from code review

* [PT FE] Add quantized types as normal types to decoder

* [PT FE] Add decoder dequantize, add dtypes to quantize

* [PT FE] Add dequantize example

* [PT FE] Implement replacer for quantized nodes

* [PT FE] Register replacer for quantize/dequantize

* [PT FE] Remove unwanted junk from previous version

* [PT FE] Fix building mistakes for frontend

* [PT FE] Clang fix

* [PT FE] Ease of use upgrade to quantize funcs

* [PT FE] Clang format

* [PT FE] Introduce new version of quantize/dequantize

* [PT FE] Remove unwanted files from new version

* [PT FE] Fix style

* [PT FE] Add QuantizedPtNode replacer, fix accuracy error

* [PT FE] Quantized add

* [PT FE] Add improved version of quantize/dequantize with shared_ptrs

* [PT FE] Quantized Add Relu

* [PT FE] Fix utils shared ptr reference error

* [PT FE] Quantized Hardswish & tests

* [PT FE] Add quantized_add_relu test

* [PT FE] Quantize now takes correct input for operations

* [PT FE] Add dtype to tests

* [PT FE] Increase matrix size in the tests to cover more edge cases

* [PT FE] Upgrade quantize method

* [PT FE] Add BFS for dequantize, add quantize_per_channel

* [PT FE] Add missing replacer to frontend, improve tests

* [PT FE] Rename replacer -> remover, remove unwanted header files

* [PT FE] Change function declarations to return ov::Output instead of shared ptr

* [PT FE] Add missing context mark node

* [PT FE] Remove unknown modifications to ie_c_api

* [PT FE] Remove fp16 support, turn off int32 tests

* [PT FE] Clang format

* [PT FE] Fix quantize_per_tensor

* [PT FE] Minor fixes from review

* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead

* [PT FE] Rename Replacer to Remover for dequantize nodes

* [PT FE] Clang format

* [PT FE] Move comments to header files, minor import fixes

* [PT FE] Enable add, add_relu, mul, hardswish with newest quantize ops

* [PT FE] Fix clang format

* [PT FE] Fix dtype issue

* [PT FE] Reenable hardswish tests

* [PT FE] Fix building error for quantized ops

* [PT FE] Tests now use rand instead of randn

* [PT FE] Remove int32 support from tests

* [PT FE] Fix quantize_per_channel tests

* Apply suggestions from code review

Removing sporadic tests from precommit

* Apply suggestions from code review

* [PT FE] Mark qint32 with skip, remove precommit flag due to sporadic errors

* [PT FE] Introduce quantized test for PytorchTestClass

* [PT FE] Add missing tensor size in the errors count computation

* Update pytorch_layer_test_class.py

* [PT FE] Apply suggestions from review - remove contexts, log100 for errors, add precommit flags

* Apply suggestions from code review

* [PT FE] Fix quantize per channel test after merge

* Update tests/layer_tests/pytorch_tests/pytorch_layer_test_class.py

* Update pytorch_layer_test_class.py

* Update test_quantize.py

* Apply suggestions from code review

* [PT FE] Fix quantized mul by changing default quantization dtype

* Update pytorch_layer_test_class.py

* Update tests/layer_tests/pytorch_tests/pytorch_layer_test_class.py

* Update src/frontends/pytorch/src/utils_quantize.cpp

* Update src/frontends/pytorch/src/utils_quantize.cpp

* Update tests/layer_tests/pytorch_tests/test_quantized_mul.py

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
 2023-07-21 10:27:35 +00:00
Ekaterina Aidova
a6e25d69ac
[PT FE] supoort aten::rand, aten::randn, aten::rand_like, aten::randn_like (#18616) 
* support aten::rand, aten::randn, aten::rand_like, aten::randn_like

* fixes
 2023-07-21 13:27:48 +04:00
Irina Efode
0ff70a0649
[CONFORMANCE] Extend SubgraphsDumper by graph cache + subgraph extractors (#18398) 
* New Subgraph Dumper -> Cache + Meta

* iCache tests

* tests_meta

* OpCache tests

* Move & refactor matchers

* fix all tests and refactor meta

* Prepare for review

* Add caching types

* Model testing + improvement

* Add ignored ports. Add tests for node utils

* [CONFORMANCE] MOVE conformance runner to new subgraphsDumper

* fix build

* Fix compilation error

* fix compilation of deprecated subgraphs dumper

* fix build

* arm

* fix win?

* temp commit

* revert

* Add w/a to save const

* [IE TESTS][CONFORMANCE] Fix data generation

* fix cpu tests

* CPP Lint

* Update ranges.hpp

* change start_from and range according typo

* Update constant.hpp

* Update constant.hpp

* fix ci build

* Update deformable_convolution.cpp

* cleanup

* clenup

* Merge

e Changes to be committed:

* Fix tests -> change start_from type

* Initial commit to dump subgraphs

* try to collect graphs usong fused_names

* Correct graph generation based on fused_names

* addition

* Define SubgraphMatchers

* Add new matcher structure

* fix buils commit

* repeat

* repeat pattern

* finalize

* Move to extractors

* extract_body

* cleanup_cache

* replace big constant by params

* Replace constants by param in serialization

* Add tests for matchers

* add model-tests

* fix model tests

* Extend tests

* fix extractors test

* fix model recover test

* Remove extra

* remove extra

* return old name to tests

* remove subgraphs extractors -> move them to other PR
 2023-07-21 12:21:29 +03:00
Ilya Lavrenov
6d86a9b25f
Revert "[PyOV] Pin version of Cython for API 1.0 (#18604)" (#18681) 
* Revert "[PyOV] Pin version of Cython for API 1.0 (#18604)"

This reverts commit 787796d88f.

* Suppressed clang warning
 2023-07-21 13:09:30 +04:00
Ilya Lavrenov
bbd592b530
Don't use -Wl,--allow-shlib-undefined on macOS (#18683) 2023-07-21 13:08:26 +04:00
Fang Xu
e478964695
merge loadnetwork and importnetwork for cpu plugin (#18024) 
* merget loadnetwork and importnetwork for cpu plugin

* fix testcase

* remove multithreading config saving

* modify test case

* separate function

* modify function name

* save model_prefer_threads to cache

* remove function encapsulation for config
 2023-07-21 14:02:11 +08:00
Andrew Kwangwoong Park
53b2a02a0e
[GPU] Dynamism support for DetectionOutput (#18625) 
* Update op creation for DetectionOutput-8 w/o num_classes attribute

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update DetectionOutput to use ngraph shape inference

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add dynamic TCs for ov_gpu_func_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix issues for detection output cpu impl selection on dynamic shape

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update detection_output primitive API and funcs for serialization

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add shape infer TCs for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix build failure in azure pipeline

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
 2023-07-20 16:49:09 -07:00
Maxim Vafin
12b1df5db3
Disable sporadically failing tests (#18694) 2023-07-20 21:34:43 +00:00
Anastasiia Pnevskaia
8d5a0b1d53
OVC cleanup. (#18649) 
* WIP: parameters cleanup

* Removed debug output, fixed CLI

* Fixed python objects conversion

* Finally renamed mmap to share_weights

* Fixed TF conversion from a file or a directory

* Fixed obvious errors in unit tests

* Deleted layouts from OVC. Fixed most of the fails in ovc unit tests (there are still failures)

* Clenaup other references to layouts and fixed --version

* Fixed case when two model files are passed in TF case

* Fixed multiple model parts passing in ovc command line

* Tests fixed, support of unnamed input in cli parser.

* Remove convert_model from runtime.

* Changed silent to verbose.

* Removed transform param.

* Removed example_input, share_weights from ovc cli tool.

* Remove wrong change.

* Test fix.

* Code corrections.

* Returned comment.

* WA to fix process hanging after extension loading.

* Removed not needed code.

* Added comment.

---------

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
 2023-07-20 20:11:28 +00:00
Ilya Lavrenov
1ce744a00f
Fixed Debian package build (#18691) 2023-07-20 22:23:39 +04:00
Mateusz Mikolajczyk
bc261424ef
[PT FE] Add quantized::conv2d and quantized::conv2d_relu (#18651) 
* Add quantized conv2d

* Fix schema

* Remove mark_output

* Remove tests from pre-commit
 2023-07-20 15:35:11 +00:00
Sun Xiaoxia
2dfb537bcb
Xiaoxia/add get_socket_id interface based on threading2.0 (#18264) 
* add streams_info_table init in the constructor of config

* add refresh _proc_type_table

* add get_org_proc_type_table

* add numa_node per stream in reserve_available_cpus()

* fix warning

* remove log

* fix code style

* fix gpu test build failed issue, modify debug info

* fix code style

* fix build failed on macos

* fix code style

* select socket in reserve cpu on 2 sockets platform

* fix build failed on macos

* modify numa node selecting in reserve_cpu_by_streams_info

* add test case

* fix code style

* modify test case

* fix core dump

* fix core dumped on pin=NUMA

* fix test failed on macos

* fix reserve cpu is wrong when streams_info_table=[1 1 36] proc_type_table=[36 18 0 18]

* add test case in LinuxCpuReserve

* modify test case

* add test case in cpu_reserve_test

* add cpu_stream_info_test

* modify enum

* fix test failed

* change int to size_t

* remove invalid code, fix running failed on macos

* modify LinuxCpuStreamType test case, move ie_cpu_streams_info.hpp to openvino/runtime/threading/

* fix code sytle

* modify enum name

* add comments in test case

* fix build issue

* change IE_ASSERT to OPENVINO_ASSERT

* fix test failed on macos and windows

* updated test cases due to the cpu mapping is changed

* enable numa_node_id and socket_id in streams_info_table

* fix code style issue

* fix document issue

* add get socket id interface

* fix segment fault on machine enabled socket_id=1 with numactl command

* fix numactl failed on four numa nodes machine

* remove compile warning

* fix numa_node_id=-1

* fix test case failed on macos

* fix test failed on macos

* fix numa_node_id=0 on macos

* Solve conflicts with master branch

* separate test cases for Linux and Mac/Windows

* update code style for windows compiler

* fix comments

* fix code style

* fix code style

* remove _plugin_mutex, fix comments

* fix code style

* fix code style

* add get_num_sockets

* fix cpu reserve issue in latency mode,ANY core on RPL machine

* add cpu reserve test case

---------

Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
 2023-07-20 23:34:21 +08:00
bstankix
1911b09a75
[DOCS] Bugfix newsletter validation 2023-07-20 16:44:26 +02:00
bstankix
dd358fc95a
[DOCS] Features update (#18676) 
* Update newsletter to work with new footer

* Update footer

* Add carousel in homepage banner

* Update banner carousel
 2023-07-20 15:48:44 +02:00
Ilya Lavrenov
4df6ef3a26
Removed ie, ngraph and core_tools cpack components (#18636) 
* Removed ie, ngraph cpack components

* Introduced new components
 2023-07-20 17:46:16 +04:00
Chenhu Wang
b5b11f3b29
[CPU]Shape agnostic jit kernel for MVN (#17988) 2023-07-20 13:40:37 +00:00
Ilya Lavrenov
b2d361fcca
Fixed install paths for test MO FE (#18654) 2023-07-20 15:00:34 +04:00
Mateusz Tabaka
fe8b8a96ff
Handle sequence ops with non constant W, R, B inputs (#18138) 
* Handle sequence ops with non constant W, R, B inputs

Ticket: CVS-49207

* fix tests

* tests

* fix gna tests

* add include

* change type for seqLenIdx

* rename is_constfoldable to is_on_constant_path

---------

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
 2023-07-20 14:48:41 +04:00
Mikhail Ryzhov
3b8f58f1af
[GNA] Added Reshape support to TS patterns (#18391) 
* Added Reshape support to TS patterns

* fixed unit test

* replaced duplicated code
 2023-07-20 12:08:02 +02:00
Kelvin Choi
9254c74362
[GPU] Set offsets of variadic split for static (#18469) 2023-07-20 09:26:42 +00:00
Mateusz Mikolajczyk
b315880cc3
[PT FE] Add quantized::linear (#18570) 
* Support GetAttr with packed params

* Apply suggestions from code review

* [PT FE] Add quantized types as normal types to decoder

* [PT FE] Add decoder dequantize, add dtypes to quantize

* [PT FE] Add dequantize example

* [PT FE] Implement replacer for quantized nodes

* [PT FE] Register replacer for quantize/dequantize

* [PT FE] Remove unwanted junk from previous version

* [PT FE] Fix building mistakes for frontend

* [PT FE] Clang fix

* [PT FE] Ease of use upgrade to quantize funcs

* [PT FE] Clang format

* [PT FE] Introduce new version of quantize/dequantize

* [PT FE] Remove unwanted files from new version

* [PT FE] Fix style

* [PT FE] Add QuantizedPtNode replacer, fix accuracy error

* [PT FE] Add improved version of quantize/dequantize with shared_ptrs

* [PT FE] Fix utils shared ptr reference error

* [PT FE] Quantize now takes correct input for operations

* [PT FE] Upgrade quantize method

* [PT FE] Add BFS for dequantize, add quantize_per_channel

* [PT FE] Add missing replacer to frontend, improve tests

* [PT FE] Rename replacer -> remover, remove unwanted header files

* [PT FE] Change function declarations to return ov::Output instead of shared ptr

* [PT FE] Add missing context mark node

* [PT FE] Remove unknown modifications to ie_c_api

* [PT FE] Remove fp16 support, turn off int32 tests

* [PT FE] Clang format

* [PT FE] Fix quantize_per_tensor

* [PT FE] Minor fixes from review

* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead

* [PT FE] Rename Replacer to Remover for dequantize nodes

* [PT FE] Clang format

* [PT FE] Move comments to header files, minor import fixes

* [PT FE] Fix clang format

* [PT FE] Fix dtype issue

* [PT FE] Fix quantize_per_channel tests

* Add quantized::linear

* Update quantized_linear.cpp

* add contructors

* Improve tests

* Add requested checks

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: Roboreptile <piotr.krzeminski@intel.com>
 2023-07-20 11:25:56 +02:00
Piotr Krzemiński
6d8dcb059d
[PT FE] Fix conversion for aten::quantize_per_channel (#18646) 
* Support GetAttr with packed params

* Apply suggestions from code review

* [PT FE] Add quantized types as normal types to decoder

* [PT FE] Add decoder dequantize, add dtypes to quantize

* [PT FE] Add dequantize example

* [PT FE] Implement replacer for quantized nodes

* [PT FE] Register replacer for quantize/dequantize

* [PT FE] Remove unwanted junk from previous version

* [PT FE] Fix building mistakes for frontend

* [PT FE] Clang fix

* [PT FE] Ease of use upgrade to quantize funcs

* [PT FE] Clang format

* [PT FE] Introduce new version of quantize/dequantize

* [PT FE] Remove unwanted files from new version

* [PT FE] Fix style

* [PT FE] Add QuantizedPtNode replacer, fix accuracy error

* [PT FE] Add improved version of quantize/dequantize with shared_ptrs

* [PT FE] Fix utils shared ptr reference error

* [PT FE] Quantize now takes correct input for operations

* [PT FE] Upgrade quantize method

* [PT FE] Add BFS for dequantize, add quantize_per_channel

* [PT FE] Add missing replacer to frontend, improve tests

* [PT FE] Rename replacer -> remover, remove unwanted header files

* [PT FE] Change function declarations to return ov::Output instead of shared ptr

* [PT FE] Add missing context mark node

* [PT FE] Remove unknown modifications to ie_c_api

* [PT FE] Remove fp16 support, turn off int32 tests

* [PT FE] Clang format

* [PT FE] Fix quantize_per_tensor

* [PT FE] Minor fixes from review

* [PT FE] Remove dequantize, remove helpers, replacer now removes nodes instead

* [PT FE] Rename Replacer to Remover for dequantize nodes

* [PT FE] Clang format

* [PT FE] Move comments to header files, minor import fixes

* [PT FE] Fix clang format

* [PT FE] Fix dtype issue

* [PT FE] Fix quantize_per_channel tests

* Apply suggestions from code review

Removing sporadic tests from precommit

* Apply suggestions from code review

* [PT FE] Fix conversion errors for aten::quantize_per_channel

* [PT FE] Mark axis 2 as xfail

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
 2023-07-20 10:49:20 +02:00
Oleg Pipikin
60a8c2bc7a
Extend data_utils to work with ov::Tensor (#18142) 
* Extend data_utils to work with ov::Tensor. Update SplitConcatMemory tests

* Fix1

* Apply comments

* Apply comments 2

* Apply comments 3

* Apply comments 4
 2023-07-20 08:29:47 +00:00
Ilya Churaev
3f675ce396
Extend Proxy tests to cover cache_dir with auto batch (#18632) 
* Added new tests to reproduce issue with auto batch

* Remove cache dir

* Fixed tests with auto batch

* Fixed check

* Added comment

* Remove try catch

* Remove comment

* Revert "Remove comment"

This reverts commit 99e26de4ca.

* Revert "Remove try catch"

This reverts commit 08b478c070.
 2023-07-20 11:11:41 +04:00
yanlan song
a51d9494fa
support context in auto and re-enable tests (#18554) 
wrap hardware remote context to compiled model

Signed-off-by: fishbell <bell.song@intel.com>
 2023-07-20 06:53:07 +00:00
Taylor Yeonbok Lee
7167473744
[GPU] Reduce clfinish io and allow input reorder to use device mem (#18596) 2023-07-20 10:39:39 +04:00
Anton Voronov
60e40843c0
[CPU] f16 constant folding on cpu plug-in side for MatMul only (#18079) 2023-07-20 08:58:46 +04:00
River Li
0e76496acc
[WA] performance issue for plugin api 2.0 (#18509) 
* [WA] performance issue for plugin api 2.0

* Avoid onnx failure

* Avoid ov_template_func_tests failure

[ RUN      ] smoke_BehaviorTests/OVRemoteTest.inferWithRemoteNoThrow/element_type=f32targetDevice=TEMPLATE__context_parameters=__tensor_parameters=

MEM_USAGE=400336KB
/mnt/data1_1c41/river/openvino_master/openvino/src/tests/functional/plugin/shared/src/behavior/ov_plugin/remote.cpp:107: Failure
Expected: infer_request.set_input_tensor(0, input_remote_tensor) doesn't throw an exception.
  Actual: it throws.
[  FAILED  ] smoke_BehaviorTests/OVRemoteTest.inferWithRemoteNoThrow/element_type=f32targetDevice=TEMPLATE__context_parameters=__tensor_parameters=, where GetParam() = (f32, "TEMPLATE", {}, ({}, {})) (76 ms)
 2023-07-20 08:22:31 +04:00
Mingyu Kim
b7b740beb5
[GPU] Disable permute_f_y_axis because of accuracy issue (#18647) 
* [GPU] Disable permute_f_y_axis because of accuracy issue

* [GPU] Disable tests too
 2023-07-20 04:10:42 +00:00
Xuejun Zhai
ba76b45194
[AUTO BATCH PLUGIN] enable api 2.0 for auto batch plugin (#18172) 
* [AUTO BATCH PLUGIN] enable API 2.0 for auto batch plugin

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] disenable auto batch plugin unite test for tmp

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] remove test with ov::auto_batch_timeout(-1), cause the variable is unsigned int

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix compiler error caused by std::atomic_uint32_t

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remote Context] fix revew comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix compiler warnings

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix compiler warnings

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix test error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix CI test error in cpu func test case, caused by batched model lost rt info

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix CI build error, caused by unused variable

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] using ov::threading

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] clear code in batched req share buffer with non-batched req

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] clean code & fix format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] clean code & fix format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] add api implementation about get_default_context() & create_context() and remove the test config with AUTO_BATCH_TIMEOUT(-1)

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix gpu test with auto btch failed

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix warning

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix get_default_context() issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix using namespace redundancy

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] modify variable naming style

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix CI test error, cause by tensor reference in virtual plugin

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] implement get_profiling()

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] remove get_context() from auto batch compiled model using the interface from parent class

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] implement create_context() & get_default_context for auto batch plugin

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] implement auto batch remote context

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix error after merge with master

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix compiler error caused by update master

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] refact remote context in auto batch plugin

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] add unite test cases for auto batch plugin

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix CI warning caused by unused variable & add unite of remote context

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] add virtual property for get_context() in icompiled_model & implement it in auto batch plugin

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] add ov::loaded_from_cache support

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix error caused by updating with master

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix unite test error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix conflict

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix error caused by update master

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <xuejun.zhai@intel.com>
 2023-07-20 07:02:45 +04:00
Ilya Lavrenov
9cd39455fc
Removed explicit linkage to protobuf in ONNX (#18650) 2023-07-19 21:41:28 +04:00
Ekaterina Aidova
61504bbfc2
[PT FE]: support nested inputs in example_inputs and arg dicts with d… (#18492) 
* [PT FE]: support nested inputs in example_inputs and arg dicts with different argtypes

* accept hande lists as inputs

* Update tools/ovc/openvino/tools/ovc/moc_frontend/pytorch_frontend_utils.py

* update tests and add comments in code

* fix for custom types in annotations and duplicate in mo

* Update tools/mo/openvino/tools/mo/moc_frontend/pytorch_frontend_utils.py
 2023-07-19 17:01:22 +02:00
Marcin Kusmierski
186b1b6bfc
Gna 3 5 as default target with transpose fixes (#18373) 
* [GNA] Set GNA 3.5 as default target and add 3.5 to properties

* [GNA] fix release version to 2023.1.

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

* [GNA] Fix E2E Tests for Kaldi Framework

 * added fix for InsertConvolutionTransposeHW

---------

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
 2023-07-19 14:48:01 +02:00
Mircea-Aurelian Dan
5397e299fd
[EISW-81712] Rename VPUX to VPU in openvino codebase (#17949) 
* Change `VPUX` occurrences to `VPU`

* Switch `VPU` library name

* Change remaining references to `VPUX`
 2023-07-19 15:55:24 +04:00
Ilya Lavrenov
04cb55c37d
Moved BA from openvino-dev to openvino (#18571) 2023-07-19 14:36:47 +04:00
Evgenya Stepyreva
b51069dd79
Eliminates Nop Broadcast/Tile and Slice Before GatherElements (#18614) 2023-07-19 14:12:13 +04:00
Sofya Balandina
53fe969773
[apiConformance] Move related to core tests from api to ov_inference_functional_tests (#18349) 2023-07-19 12:01:52 +03:00
Sofya Balandina
8ac00677a9
[apiConformance] Move related to core tests from api to ov_inference_functional_tests (#18349) 2023-07-19 12:01:26 +03:00