Commit Graph

5887 Commits

Author SHA1 Message Date
Milana Shhanukova
eb90272331
[POT] Remove gitlab mention (#9079)
* change in installation

* develop mode

* change in install guide

* style change

* change declare
2021-12-22 13:45:37 +00:00
Ivan Tikhonov
fc689699eb
Delete ngraph doxygen file (#9365) 2021-12-22 16:23:20 +03:00
Artur Kulikowski
186f601699
For the ONNX frontend find nodes by tensor name (#9345) 2021-12-22 13:14:48 +01:00
Liubov Talamanova
e20a97acbc
Support old import system in POT (#9331)
* Support old import system in POT

* Fixed comments

* Update imports in samples
2021-12-22 14:55:48 +03:00
Ilya Znamenskiy
eca9ff6981
[GPU] Fixed gemm_tiled_opt fusing error and code refactoring in fusing tests (#9303) 2021-12-22 14:38:24 +03:00
Katarzyna Mitrus
b7750f8f0d
[ONNX][PYTHON API] FLOAT_LIKE_xfail - Enable bfloat16 onnx tests (#9291) 2021-12-22 12:23:50 +01:00
Dmitrii Khurtin
2ec04f9faf
AddressSanitizer: heap-buffer-overflow in PwlApply32 (#9256)
* fixed bug related to AddressSanitizer

* changed the way of calculation of input bytes of pooling layer if a previous layer is convolution
2021-12-22 13:31:01 +03:00
Wang, Yang
8c746fd52c
Align AUTO/MULTI/HETERO wording (#8884)
* Align AUTO's behavior to parent Epic.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* update wording.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update wprding in hetero plugin.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Change "metric" to  "metric key".

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2021-12-22 12:21:08 +03:00
Min, Byungil
0e3c4cc103
Modify padding checking logic to enable new model (#9310)
+ Modified a way to add padding in prepare_padding
+ Changed condition of assertion for onednn padding

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2021-12-22 18:17:08 +09:00
Ivan Tikhonov
0bbda24186
Paddle FrontEnd Refactoring (#9157)
* Refactor PaddlePaddle FrontEnd

* Codestyle

* FrontEnd,InputModel,Place base classes -> abstract, renamed model file

* Fix unit tests

* fix unit tests

* ngraph:: to ov::

* Rename frontends dir to frontend

* Rename paddlepaddle to paddle; pdpd to paddle

* add missing file

* codestyle

* Remove local change

* paddlepaddle -> paddle for azure configs and .md files

* fix package name, fix config files

* Fix win build

* Revert Broadcast/AutoBroadcast changes

* codestyle

* fix FronEnd class

* fix ngraph_cpp_api.config

* codestyle

* merge master

* fix build

* refactoring; revert broadcast/autobroadcast changes

* codestyle

* fix MacOS config
2021-12-22 11:20:54 +03:00
Gleb Kazantaev
2daafec53d
Update RIC Fusion for known Gathers (#9354)
* RIC Fusion for dynamic case

* Code style
2021-12-22 11:08:24 +03:00
Bartek Szmelczynski
8a1fd76124
[PYTHON] Expose get_rt_info method for input/output nodes (#9211)
* expose get_rt_info method for input/output nodes

* expose rt_info

* add tests with rf_info update

* remvoe redundant import

* rename PyRTMap to RTMap
2021-12-22 10:55:57 +03:00
Mang Guo
5fada94504
Mang/shape inference (#8412)
* Implement DFT and IDFT shape inference

* Implement CTCLoss shape inference

* Fix error message.

* Refactor test case.

* Apply review comments

* Apply review comments

* Fix clang format error

* Fix merge error

* Remove axes_vector.
2021-12-22 07:47:44 +03:00
Tingqian Li
b8e6b6368c
[Shape inference] Pad_1/Topk_3/Split_1/VariadicSplit_1/ExperimentalDetectronROIFeatureExtractor_6/Bucketize_3/EmbeddingBagOffsetsSum_3/EmbeddingSegmentsSum_3/Range_4/RegionYolo_0/ReorgYolo_0 (#8413)
* [shape_infer] add shape_infer for ExperimentalDetectronROIFeatureExtractor op

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* add test

* Use compatible & merge for intersection checks

* Update

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* Add perf_test

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* Initial commit

* fix compile issue

* Add test

* fix clang format issue

* support for pads_begin/pads_end with different sizes

* fix bug in EDGE mode checking

* fix padding mode checks

* fix according to jane's review comment

* fix const reference

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* Initial commit

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* fix bugs

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* Switch to use single generic code with small helper template

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* Initial commit on Split

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* Convolution update

* Adds pragma once

* Reductions shape infer

* Shape nodes

* style

* Update

* add exp detectron roi feature

* Update

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* Use get_data_as_int64 + constant_data

* Add test

* Add utils.hpp into cpuUnit shape inference test

* avoid using friend template function

* fix topk axis bug

* Add bucketize

* Add embeddingbag offsets sum

* Add embedding segments sum

* fix code style issue

* Add Range_4

* Update tests

* Add range

* Add region Yolo

* Add reorg

* fix according to Globev's comment

* call shape_infer in evaluate_variadic_split()

* fix CI issue

* fix CI issue

* fix CI issue, topk change revert

* fix flake8 E302

* fix myriad smoke test issue

* fix according to Vladislav's second round review

* fix format

* Add StridedSlice & Einsum

* fix pad_test.cpp build issue

* fix according to review comment

* insert directly into output shape

* revert infer_slice_shape() change since vpux compiler uses this function

* move tests

Co-authored-by: Stepyreva, Evgenya <evgenya.stepyreva@intel.com>
2021-12-22 06:54:12 +03:00
Jade Cho
7bcca1b82d
[GPU] Fix some bugs of cldnn eltwise kernel at bs_fs_yx_bsv32_fsv16 format. (#9198)
* Fix some bugs of cldnn eltwise kernel at bs_fs_yx_bsv32_fsv16 format.

+ Add a condition so that the eltwise_simple_vload8 kernel is not selected when the tensor is not aligned as bsv32_fsv16 or bsv32_fsv32.
+ Optimize gws/lws of eltwise_ref kernel for bsv32_fsv16 format.

* Check feature align of b_fs_yx_fsv32 for eltwise vload8 kernel

+ Minor fix for OV_GPU_Help option
2021-12-22 11:43:04 +09:00
Svetlana Dolinina
63121e28ca
fixed function that changes parameter but don't return it back; (#9177)
fixed return of results from transformation for case of not 1 added result (last node with several out ports)
modified test to cover case with several output ports for last node
2021-12-22 01:41:49 +03:00
Mikhail Ryzhov
3b74aa0d30
Store function inputs/outputs tensor names (#8961)
* Refactoring of input/output structures

* Added tensor names

* Updated outputs/inputs before export
2021-12-21 20:44:32 +03:00
Andrey Zaytsev
4ae6258bed
Feature/azaytsev/from 2021 4 (#9247)
* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Updated the link to software license agreements

* Revert "Updated the link to software license agreements"

This reverts commit 706dac500e.

* Docs to Sphinx (#8151)

* docs to sphinx

* Update GPU.md

* Update CPU.md

* Update AUTO.md

* Update performance_int8_vs_fp32.md

* update

* update md

* updates

* disable doc ci

* disable ci

* fix index.rst

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
# Conflicts:
#	.gitignore
#	docs/CMakeLists.txt
#	docs/IE_DG/Deep_Learning_Inference_Engine_DevGuide.md
#	docs/IE_DG/Extensibility_DG/Custom_ONNX_Ops.md
#	docs/IE_DG/Extensibility_DG/VPU_Kernel.md
#	docs/IE_DG/InferenceEngine_QueryAPI.md
#	docs/IE_DG/Int8Inference.md
#	docs/IE_DG/Integrate_with_customer_application_new_API.md
#	docs/IE_DG/Model_caching_overview.md
#	docs/IE_DG/supported_plugins/GPU_RemoteBlob_API.md
#	docs/IE_DG/supported_plugins/HETERO.md
#	docs/IE_DG/supported_plugins/MULTI.md
#	docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Caffe.md
#	docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Kaldi.md
#	docs/MO_DG/prepare_model/convert_model/Convert_Model_From_MxNet.md
#	docs/MO_DG/prepare_model/convert_model/Convert_Model_From_ONNX.md
#	docs/MO_DG/prepare_model/convert_model/Converting_Model.md
#	docs/MO_DG/prepare_model/convert_model/Converting_Model_General.md
#	docs/MO_DG/prepare_model/convert_model/Cutting_Model.md
#	docs/MO_DG/prepare_model/convert_model/pytorch_specific/Convert_RNNT.md
#	docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_EfficientDet_Models.md
#	docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_WideAndDeep_Family_Models.md
#	docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_YOLO_From_Tensorflow.md
#	docs/doxygen/Doxyfile.config
#	docs/doxygen/ie_docs.xml
#	docs/doxygen/ie_plugin_api.config
#	docs/doxygen/ngraph_cpp_api.config
#	docs/doxygen/openvino_docs.xml
#	docs/get_started/get_started_macos.md
#	docs/get_started/get_started_raspbian.md
#	docs/get_started/get_started_windows.md
#	docs/img/cpu_int8_flow.png
#	docs/index.md
#	docs/install_guides/VisionAcceleratorFPGA_Configure.md
#	docs/install_guides/VisionAcceleratorFPGA_Configure_Windows.md
#	docs/install_guides/deployment-manager-tool.md
#	docs/install_guides/installing-openvino-linux.md
#	docs/install_guides/installing-openvino-macos.md
#	docs/install_guides/installing-openvino-windows.md
#	docs/optimization_guide/dldt_optimization_guide.md
#	inference-engine/ie_bridges/c/include/c_api/ie_c_api.h
#	inference-engine/ie_bridges/python/docs/api_overview.md
#	inference-engine/ie_bridges/python/sample/ngraph_function_creation_sample/README.md
#	inference-engine/ie_bridges/python/sample/speech_sample/README.md
#	inference-engine/ie_bridges/python/src/openvino/inference_engine/ie_api.pyx
#	inference-engine/include/ie_api.h
#	inference-engine/include/ie_core.hpp
#	inference-engine/include/ie_version.hpp
#	inference-engine/samples/benchmark_app/README.md
#	inference-engine/samples/speech_sample/README.md
#	inference-engine/src/plugin_api/exec_graph_info.hpp
#	inference-engine/src/plugin_api/file_utils.h
#	inference-engine/src/transformations/include/transformations_visibility.hpp
#	inference-engine/tools/benchmark_tool/README.md
#	ngraph/core/include/ngraph/ngraph.hpp
#	ngraph/frontend/onnx_common/include/onnx_common/parser.hpp
#	ngraph/python/src/ngraph/utils/node_factory.py
#	openvino/itt/include/openvino/itt.hpp
#	thirdparty/ade
#	tools/benchmark/README.md

* Cherry-picked remove font-family (#8211)

* Cherry-picked: Update get_started_scripts.md (#8338)

* doc updates (#8268)

* Various doc changes

* theme changes

* remove font-family (#8211)

* fix  css

* Update uninstalling-openvino.md

* fix css

* fix

* Fixes for Installation Guides

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
Co-authored-by: kblaszczak-intel <karol.blaszczak@intel.com>
# Conflicts:
#	docs/IE_DG/Bfloat16Inference.md
#	docs/IE_DG/InferenceEngine_QueryAPI.md
#	docs/IE_DG/OnnxImporterTutorial.md
#	docs/IE_DG/supported_plugins/AUTO.md
#	docs/IE_DG/supported_plugins/HETERO.md
#	docs/IE_DG/supported_plugins/MULTI.md
#	docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Kaldi.md
#	docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_YOLO_From_Tensorflow.md
#	docs/install_guides/installing-openvino-macos.md
#	docs/install_guides/installing-openvino-windows.md
#	docs/ops/opset.md
#	inference-engine/samples/benchmark_app/README.md
#	inference-engine/tools/benchmark_tool/README.md
#	thirdparty/ade

* Cherry-picked: doc script changes (#8568)

* fix openvino-sphinx-theme

* add linkcheck target

* fix

* change version

* add doxygen-xfail.txt

* fix

* AA

* fix

* fix

* fix

* fix

* fix
# Conflicts:
#	thirdparty/ade

* Cherry-pick: Feature/azaytsev/doc updates gna 2021 4 2 (#8567)

* Various doc changes

* Reformatted C++/Pythob sections. Updated with info from PR8490

* additional fix

* Gemini Lake replaced with Elkhart Lake

* Fixed links in IGs, Added 12th Gen
# Conflicts:
#	docs/IE_DG/supported_plugins/GNA.md
#	thirdparty/ade

* Cherry-pick: Feature/azaytsev/doc fixes (#8897)

* Various doc changes

* Removed the empty Learning path topic

* Restored the Gemini Lake CPIU list
# Conflicts:
#	docs/IE_DG/supported_plugins/GNA.md
#	thirdparty/ade

* Cherry-pick: sphinx copybutton doxyrest code blocks (#8992)

# Conflicts:
#	thirdparty/ade

* Cherry-pick: iframe video enable fullscreen (#9041)

# Conflicts:
#	thirdparty/ade

* Cherry-pick: fix untitled titles (#9213)

# Conflicts:
#	thirdparty/ade

* Cherry-pick: perf bench graph animation (#9045)

* animation

* fix
# Conflicts:
#	thirdparty/ade

* Cherry-pick: doc pytest (#8888)

* docs pytest

* fixes
# Conflicts:
#	docs/doxygen/doxygen-ignore.txt
#	docs/scripts/ie_docs.xml
#	thirdparty/ade

* Cherry-pick: restore deleted files (#9215)

* Added new operations to the doc structure (from removed ie_docs.xml)

* Additional fixes

* Update docs/IE_DG/InferenceEngine_QueryAPI.md

Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>

* Update Custom_Layers_Guide.md

* Changes according to review  comments

* doc scripts fixes

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>

* Update Int8Inference.md

* update xfail

* clang format

* updated xfail

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>
Co-authored-by: kblaszczak-intel <karol.blaszczak@intel.com>
Co-authored-by: Yury Gorbachev <yury.gorbachev@intel.com>
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
2021-12-21 20:26:37 +03:00
Yuan Hu
0c7089acc6
[Auto plugin] remove thread_utils.hpp (#9279)
* remove thread_utils.hpp

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* disable using windows in log utils test

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2021-12-21 18:40:35 +03:00
Tomasz Jankowski
dcfaf424a0
[ONNX FE] Add support for partial shapes with boundaries (#9321) 2021-12-21 16:38:15 +01:00
Andrew Kwangwoong Park
6f437fc1bd
[GPU] Exclude peak memory usage from the result of memory statistics (#9332)
Signed-off-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>
2021-12-21 18:03:38 +03:00
Katarzyna Mitrus
132b755a46
Enable Slice-8 dynamic lower bounds serialization tests (#9323) 2021-12-21 15:57:04 +03:00
Vitaliy Urusovskij
de980b8089
Actualize DeterministicityTest: update headers and used opset (#9335) 2021-12-21 15:31:43 +03:00
Gorokhov Dmitriy
2d73eb6157
[CPU] Migration on oneDNN v2.4.4 (#9326)
Co-authored-by: Anton Voronov <anton.voronov@intel.com>
2021-12-21 14:45:44 +03:00
Ivan Tikhonov
9334f34ff0
TensorFlow FrontEnd Refactoring (#9173)
* Move tensorflow fe to openvino subfolder; renaming; refactoring

* codestyle

* delete redundant file

* fix Win build

* fix missprint
2021-12-21 14:35:58 +03:00
Indira Salyahova
0100060cd9
Update README.md (#9337) 2021-12-21 11:16:41 +00:00
Vladimir Paramuzov
5f53e6f697
[GPU] Try disabling onednn primitive cache (#9289) 2021-12-21 13:49:15 +03:00
tgubanova-lohika
f9ece370f3
[GPU] Implement RandomUniform operation (#9043)
* [GPU] Implement Random Uniform kernel

* [GPU] Add random uniform kernel selector

* [GPU] Add random uniform primitive

* [GPU] Add random uniform instantiation helpers

* [GPU] Implement unit test for the random uniform operation

* [GPU] Add random uniform operation builder in cldnn_engine plugin

* [GPU] Add single layer tests for the random uniform operation

* [GPU] Add conversion for Random Uniform output type

* [GPU] Add RTTI macroses to RandomUniform operation
2021-12-21 13:24:07 +03:00
Aleksandr Korolev
4b0a2c9127
[VPU] Coverity fixes (#9214)
Some coverity fixes
2021-12-21 12:58:05 +03:00
Ilya Churaev
ec858fcffd
Add OV developer config (#9298)
* Introduced OV developer package config

* Remove new targets from old configs

* Fixed python build

* Removed OpenVINO_SOURCE_DIR from developer config
2021-12-21 12:25:07 +03:00
Maxim Shevtsov
3032f20e03
brushed the #streams logic when #requests is limited (#9184) 2021-12-21 12:07:59 +03:00
Milana Shhanukova
0262d05a77
[POT] Ports in input nodes in BC (#8643)
* Make ports visible in names in BC algo

* mistypes

* updates in regards to lstm

* lstm update

* delete code dublication

* mistype in get_node_data_type
2021-12-21 10:58:20 +03:00
Krzysztof Bruniecki
6c92ce48c1
Remove non official code (#9315)
- feature to export for embedded GNA3 which is not in fact supported.
    - SW emulation modes like SSE etc, which are not useful and are undocumented.
2021-12-21 09:44:06 +03:00
Vitaliy Urusovskij
cf15cbd301
Save Parameters order during IR deserialization (#9286)
* Save Parameters order during IR deserialization

* Add test to check inputs/outputs in IR
2021-12-21 06:45:14 +03:00
Ilya Churaev
b5238e55e1
Removed inference_engine, ngraph, transformations libraries (#9309) 2021-12-21 05:27:53 +03:00
Maxim Gordeev
3c93c3e766
Hello classification, classification_async, hello_reshape_ssd python samples with API 2.0 (#9091)
* Hello classification python with API 2.0

* Update samples/python/hello_classification/hello_classification.py

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>

* Update samples/python/hello_classification/hello_classification.py

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>

* changed linters processing

* Update samples/python/hello_classification/hello_classification.py

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>

* Update samples/python/hello_classification/hello_classification.py

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>

* Update samples/python/hello_classification/hello_classification.py

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>

* Update samples/python/hello_classification/hello_classification.py

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>

* Update samples/python/hello_classification/hello_classification.py

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>

* updated import

* Moved classification_sample_async to new API 2.0

* moved hello_reshape_ssd sample to new API 2.0

* [classification_sample_async] refactoring

* [hello_classification] refactoring

* [hello_reshape_ssd] refactoring

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>
Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>
Co-authored-by: Dmitry Pigasin <dmitry.pigasin@intel.com>
2021-12-21 01:33:12 +03:00
Zlobin Vladimir
4f9d908c1e
Catch up https://github.com/openvinotoolkit/open_model_zoo/pull/3002 (#9324) 2021-12-21 00:44:47 +03:00
Mikhail Nosov
b7ffbe5459
Leftover: Added tests for fix for PR #8546 (#9313)
Added more preprocessing unit tests for fix of PR #8546
Testing: revert changes for the fix. Verify that new tests are failed
2021-12-20 23:32:14 +03:00
Tomasz Dołbniak
29eb83d904
MO: adding extra tensor names during the graph modification (#9292) 2021-12-20 23:23:03 +03:00
Vladimir Zinoviev
be0e77304f
[LPT] getDequantization: INT4 input support to avoid ConvertSubtract transformation (#9288) 2021-12-20 22:51:44 +03:00
Ivan Novoselov
fa9434494f
[Snippets][CPU] Eltwise subgraphs code generation (#7936) 2021-12-20 22:45:01 +03:00
Alexander Zhogov
c10a27f601
github_org_control: Update to the latest version (#9322) 2021-12-20 21:04:28 +03:00
Tomasz Dołbniak
46c9755b6e
ONNX FE tests: fix after a conflicting merge of 2 PRs (#9320)
* Fix after a conflicting merge of 2 PRs

* Even more alignment
2021-12-20 20:46:15 +03:00
Wang, Yang
808d6a3dc1
Add default device value for ie.LoadNetwork (#8956)
* [Auto Plugin] Change LoadNetwork api with default deviceName "AUTO" and add corrresponding test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Remove the changes for ImportNetwork API.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update LoadNetwork API.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update compile_network API for OV2.0.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Modify the visable scope of global value 'DEFAULT_DEVICE_NAME'.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update the test case for compile_model wit the default device.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Replace the pointer with the string object as the default name of device.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add a new test case for compile_model to defatul device.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add a new test case for compile_model loading network to defatul device.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add a new test case for compile_model loading network to defatul device.

Signed-off-by: ywang2 <yang4.wang@intel.com>

* Update tese case for LoadNetwork and compile_model.

Signed-off-by: ywang2 <yang4.wang@intel.com>
2021-12-20 19:48:54 +03:00
Elizaveta Lobanova
d4fdbba7d8
[GNA] Fixed a bug with channel multiplier for int8 weights quantization (#9234) 2021-12-20 18:12:56 +03:00
song, bell
1901f33bd3
auto dynamic shape (#8731)
* initial commit

Signed-off-by: fishbell <bell.song@intel.com>

* overwrite GetBlob/SetBlob to support dynamic shape when needed

Signed-off-by: fishbell <bell.song@intel.com>

* extend workers

Signed-off-by: fishbell <bell.song@intel.com>

* clean up code

Signed-off-by: fishbell <bell.song@intel.com>

* fix lock and add case for CPU,GPU

Signed-off-by: fishbell <bell.song@intel.com>

* fix mem leak

Signed-off-by: fishbell <bell.song@intel.com>

* clean up allocated worker

Signed-off-by: fishbell <bell.song@intel.com>

* fix test case failure

Signed-off-by: fishbell <bell.song@intel.com>

* enable case for chaining

Signed-off-by: fishbell <bell.song@intel.com>

* fix arm compile issue

Signed-off-by: fishbell <bell.song@intel.com>

* clang format, fix potential threading issue

Signed-off-by: fishbell <bell.song@intel.com>

* clean up idle request queue if infer request destroyed

Signed-off-by: fishbell <bell.song@intel.com>

* keep multi legacy behavior

Signed-off-by: fishbell <bell.song@intel.com>

* elegant way to handle recycling

Signed-off-by: fishbell <bell.song@intel.com>

* avoid the exception with set output blob in auto dynamic case

Signed-off-by: fishbell <bell.song@intel.com>

* remove increase workers logic

Signed-off-by: fishbell <bell.song@intel.com>

* formatting

Signed-off-by: fishbell <bell.song@intel.com>

* remove the irrelevant code to dynamic shape

Signed-off-by: fishbell <bell.song@intel.com>

* filter target device to CPU in the case of dynamic shape

Signed-off-by: fishbell <bell.song@intel.com>

* fix logic in selectdevice, add case for GPU

Signed-off-by: fishbell <bell.song@intel.com>

* add case for AUTO:GPU

Signed-off-by: fishbell <bell.song@intel.com>

* fix build error

Signed-off-by: fishbell <bell.song@intel.com>

* add comment for skipped cases

Signed-off-by: fishbell <bell.song@intel.com>

* fix the case failure caused by naming conflict

Signed-off-by: fishbell <bell.song@intel.com>

* move file to new folder

Signed-off-by: fishbell <bell.song@intel.com>

* change to 2.0 API in plugin

Signed-off-by: fishbell <bell.song@intel.com>

* refactor mkldnn code change

Signed-off-by: fishbell <bell.song@intel.com>

* formatting

Signed-off-by: fishbell <bell.song@intel.com>
2021-12-20 18:06:50 +03:00
Yuan Hu
cf92c54a12
[Auto plugin] select logic need to check CPU precision (#9259)
* cpu also need to check precision

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix test case failed issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2021-12-20 17:32:00 +03:00
Piotr Szmelczynski
513867e168
[PYTHON] Rename arg names python api (#9209) 2021-12-20 14:31:48 +01:00
Gleb Kazantaev
249e1266fb
MO: --transform Pruning option (#9304) 2021-12-20 15:55:50 +03:00
Vladislav Golubev
191b15a228
build fix (#9311) 2021-12-20 14:58:04 +03:00