Commit Graph

6153 Commits

Author SHA1 Message Date
Ilya Lavrenov
fdee2d5728
Disabled dynamic Windows build in Azure (#9568) 2022-01-13 15:44:04 +03:00
Alexander Zhogov
04c9a55b45
Revert "Deprecate GNA_LIB_N_THREADS and SINGLE_THREAD parameters (#9486)" (#9632)
This reverts commit c06d4e7fb7.
2022-01-13 15:41:15 +03:00
Roman Kazantsev
a53a4da3a2
[MO, Frontends] Implement ChangePlaceholderType as Offline Transformation (#8245)
* [Common FrontEnd] Implement ChangePlaceholderType transformation with OldApiMap

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add ChangePlaceholderType pass into frontend normalize

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add a comment about the transformation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code review comments: remove ngraph namespace rountine, etc.

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove use of extra Node object in set_old_api_map call

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Create separate pass for legacy nGraph transformations for MO with new frontend

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build for ieFuncTests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue with namespace conflicts

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Revert "Fix build issue with namespace conflicts"

This reverts commit 50a189f4e5.

* Move legacy transformations to ngraph namespace

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue with unresolved MOCLegacyTransformation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Adjust code to new OldApiMap API

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Resolve merge conflicts

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Do not set legacy type for parameter in case user defined type

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2022-01-13 15:29:51 +03:00
Ilya Churaev
f74b9caabb
Removed old dynamism API from infer request (#9557)
* Removed old dynamism API from infer request

* Fixed segfault

* Fixed some tests

* Added method to set inputs, outputs

* Fix python tests

* Try to fix window build
2022-01-13 14:54:14 +03:00
Ilya Lavrenov
9fe5165ffa
Support of clang-11 (#9620) 2022-01-13 14:31:25 +03:00
Nadezhda Ageeva
c06d4e7fb7
Deprecate GNA_LIB_N_THREADS and SINGLE_THREAD parameters (#9486) 2022-01-13 14:30:41 +03:00
Maxim Andronov
2b996c32ad
[CPU] FullyConnected dynamism support (#9380) 2022-01-13 13:18:02 +03:00
Gorokhov Dmitriy
c36afa495e
Temporarily disable onnx_if_inside_if unit test on CPU (#9624) 2022-01-13 13:14:37 +03:00
Mikhail Nosov
fc6eff048f
Python bindings: expose InputTensorInfo::set_memory_type (#9608)
* Exposing set_memory_type method

* Update quotes
2022-01-13 12:48:26 +03:00
Steve Yoo
a23a398dc0
Add SLT to Template Plugin: NonMaxSuppression-4,3,1 (#9511)
* Add SLT to Template Plugin: NonMaxSuppression-4

* Add SLT to Template Plugin: NonMaxSuppression-4,3,1
2022-01-13 12:42:56 +03:00
Jade Cho
35bcb77182
[GPU] Merge reorder into next onednn conv (#9601)
+ When the format of onednn convolution is bs_fs_yx_bsv32_fsv32, the reorder for dependency primitive of fused eltwise sum is removed.
2022-01-13 18:32:50 +09:00
Sergey Shlyapnikov
bd12648ec0
[GPU] Fix users invalidation and output layout recalculation in graph dump mode (#9439) 2022-01-13 12:29:43 +03:00
mei, yang
6ae0ba481e
fix build issue on android on shutdown protobuf (#9615)
* fix build issue on android on shutdown protobuf

* add ie_dependent_option for shutdown protobuf
2022-01-13 11:47:54 +03:00
Mateusz Bencer
080477aa9c
MO fallback to old path if some features are not supported yet (#9034) 2022-01-13 09:39:14 +01:00
Vladimir Dudnik
28fb55dffe
[IE Samples][OV2.0] final clean up of old API headers (#9494)
* final clean up of old API headers, compile_tool separated from samples

* make cpplint happy
2022-01-13 11:12:20 +03:00
Jade Cho
113014161d
Add a gpu func test to compare with ngraph runtime (#9591)
+ Compare conv result of gpu plugin with ngraph result.
2022-01-13 11:03:52 +03:00
Vladimir Paramuzov
ef3df6de03
[GPU] Fixed uninit axis field in pooling prim (#9598) 2022-01-13 10:53:20 +03:00
Vladimir Paramuzov
f68dd90413
[GPU] Get rid of PreAllocator usages to allow setShape (#9576) 2022-01-13 10:52:59 +03:00
Chen Xu
e329baef04
[CPU] Cache for Reduce node (#9519) 2022-01-13 10:42:24 +03:00
Vladislav Golubev
456347e1b6
[Transformations] ConvertDivide disabled transformation for divide ops from precision sensitive subgraphs (#9561)
* [Transformations] Skip ConvertDivide if Divide is on fp16 shapeOf subgraph

* lambda definition moved out of loop

* review fixes
2022-01-13 10:32:44 +03:00
song, bell
282f37cdae
fix sporadic crash (#9616)
Signed-off-by: fishbell <bell.song@intel.com>
2022-01-13 10:25:53 +03:00
Zhang Yi
6d3f99c7db
[CPU] Pooling & FakeQuantize cache (#9503)
* [CPUCache]Impl FakeQuantize

* [CPUCache]Impl Pooling

* [CPUCache]Fix Pooling ==

* [CpuCache]apply review comments

* [CpuCache]fix pooling ==
2022-01-13 10:25:39 +03:00
Mikhail Znamenskiy
5b40f381cb
Fix for benchmark_app: set model stream flags (#9609) 2022-01-13 10:15:33 +03:00
Chenhu Wang
ac45196ce2
[CPU] Interpolate runtime params cache (#9524) 2022-01-13 10:01:02 +03:00
Mang Guo
f562e5572f
[CPU] Enable cache for LRN (#9589) 2022-01-13 09:54:00 +03:00
Ilya Lavrenov
c3d2af7501
Fixed CVS-75003 (#9552)
* Fixed CVS-75003

* Allow dynamic shapes
2022-01-13 06:46:52 +03:00
Mingyu Kim
3ae3c8dfb5
[GPU] Enable a network with onednn deconv (#9597) 2022-01-13 12:03:08 +09:00
Indira Salyahova
c597bc8928
[POT] requirements install telemetry library (#9605)
* Update telemetry.py

* Update setup.py

* Update test_telemetry.py

* Update telemetry.py
2022-01-13 03:30:58 +03:00
Ilya Lavrenov
f222814f0c
Updated documentation for OV Inference Runtime (#9573)
* Updated documentation for OV Inference Runtime

* Updated documentation

* Fixed comments
2022-01-13 01:05:17 +03:00
Eugeny Volosenkov
00da13b058
Support TF ScatterND and CenterNet (#9257)
* add ScatterND for tf

* Fix ApplyPermutation

* fix description of TFScatterNDDecomposition

* fix permutation

* fix package_POM

* fix pom file

* fix BOM file

* fix bom file

* Added layer tests for TF ScatterND

* fix comments

* fix bom file

* Add additional tests

* Add additional tests

* Added ConvertLike to ScatterND decomposition
2022-01-12 23:15:45 +03:00
Mikhail Nosov
896532ace2
[OV2.0] PrePostProcessor dump to output stream for debugging purposes (#9580)
* Calculate model layout based on 'tensor' layout and convert steps

Previously, 'model layout' is set to '...' by default,
thus no shape conversion happened when tensor layout is set to 'NHWC', then there was explicit convert_layout "NCHW"

Now "model layout" is calculated based on tensor layout and conversion steps:
Examples:
 1) Tensor: NHWC, Convert: NCHW. Result: NCHW
 2) Tensor: NHWC, Convert: 0312. Result: NCHW

* Initial move of tensor data calculation

* Moved 'impls' to new file

* Postprocessing + unit tests

* clang-format fix

* Added more details to preprocessing nodes
- Mean/Scale - will print mean/scale values
- Convert type - will print type
- Convert layout - will print destination layout
- Convert color - will print destination color

It is needed to troubleshoot the problems. If error occurs, message will not display last op's target shape/layout/type

* Add python bindings

* update tests

* Added memory type to dump if set

* Code style fix

* unity build fix

* Dump tensor if only memory type is set

* Added debug print

* Fix Param->Result case

Previously, layout was set by preprocessing set to old parameter as well
This is incorrect because in case of exception layout info will not be reverted

In this case old Result pointed to old Parameter and was able to preserve runtime info

After fixing of this, case Param->Result was broken if revalidation is not triggerred

Fix is to detect 'Result' as a consumer of some parameter and force revalidation in this case

* Revert occasionally committed line

* And one more line
2022-01-12 22:00:32 +03:00
Ilya Churaev
e78ada1178
Introduce dev_api for core component (#9571)
* Introduce dev_api for core component

* Fixed CPU plugin for static build

* Fixed comments
2022-01-12 20:23:18 +03:00
Vladislav Golubev
01689ee408
[CommonOptimizations] SimplifySecondInputOfReshape fix (#9210)
* [CommonOptimizations] SimplifySecondInputOfReshape fix

* GroupedGatherElimination: added Gather v8 support
2022-01-12 17:50:49 +03:00
Alexey Lebedev
4a6575b4b7
[PYTHON API] fix direct access to model input shape (#9562)
* Copy port shape to avoid direct access to shape buffer

* Add __eq__ for shape

* Add tests

* Fix getters

* add __setitem__

* Add a note about copy
2022-01-12 17:48:10 +03:00
Zlobin Vladimir
6840d945c7
omz: catch up https://github.com/openvinotoolkit/open_model_zoo/pull/3060 (#9602) 2022-01-12 17:23:19 +03:00
Alexey Lebedev
0a85417896
[tools] some fixes for python benchmark (#9584)
* rename inference_engine to OpenVINO

* correct exception for batch

* check all inputs to find batch dimension before throwing exception

* correct warning about batch

* avoid set_shape in static case

* refactoring latency output

* message about benchmarking mode

* use new precision naming

* use pass manager instead offline_transformations
2022-01-12 17:22:58 +03:00
Andrey Somsikov
9cf3359958
Add openvino_contrib to coverity scan (#9253) 2022-01-12 16:56:34 +03:00
Maxim Vafin
9fb9e19efa
Fix output layout of tf yolo models converted with transformations config (#9583) 2022-01-12 16:25:35 +03:00
Nikita Malinin
cf344a3b73
Change rename_node for fq (#9599) 2022-01-12 12:44:58 +00:00
Mang Guo
171863e3ce
[CPU] Enable CPU Plugin cache for roi_pooling (#9502) 2022-01-12 15:21:51 +03:00
Vladimir Zinoviev
b6d60a2c82
[LPT] Support FakeQuantize with convert on intervals (#9579)
* [LPT] Support FakeQuantize with convert on intervals

* [LPT] GPU tests
2022-01-12 14:50:19 +03:00
Ilya Churaev
12d92dfa2d
Fixed itt_collector build (#9596) 2022-01-12 14:47:24 +03:00
Nikolay Tyukaev
2990049c93
doc-versions-from-server (#9437) 2022-01-12 14:40:07 +03:00
Mikhail Nosov
a6c9f9aeab
Move 'NV12toRGB/BGR' reference evaluates to template plugin (#9548)
* Move 'NV12toRGB/BGR' reference evaluates to template plugin

CPU doesn't need this fallback, so implementation can be moved to reduce core binary size

* Moved evaluate_nv12 to 'runtime::reference'

* Fix arm build
2022-01-12 14:29:03 +03:00
Mateusz Tabaka
8ef08292a6
Reduce number of Reshape operations in RNN sequences decomposition (#9495)
Move Squeeze/Unsqueeze for hidden and cell state outside of tensor
iterator's body. So it's executed once per sequence instead of once
per cell.
2022-01-12 12:10:18 +01:00
Yury Gaydaychuk
b06c0b5c32
[CPU] DS support for Deformable Convolution (#8986) 2022-01-12 14:08:24 +03:00
mei, yang
613facafde
ShutdownProtobufLibrary when unload paddle frontend dynmaic library t… (#9442)
* ShutdownProtobufLibrary when unload paddle frontend dynmaic library to fix probuf memory leak

* ShutdownProtobufLibrary if the frontend libraries use protobuf

* make shutdown_protobuf a library
2022-01-12 13:07:51 +03:00
Luwei Zhou
84bf5fa178
[CPU] Enable CPU plugin cache for DepthToSpace. (#9492)
* Enable CPU plugin RT cache for DepthToSpace.

* Applied review comments.

* Applied review comments.

* Apply reivew comments.
2022-01-12 11:43:24 +03:00
Wang, Yang
4546df5091
Enable THROUGHPUT by default for all the devices. (#9107)
* Set THROUGHPUT as the default configration for all the plugin and display the config of the plugin.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* updated format.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update benchmark python API.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Replace str 'THROUGHPUT' with CONFIG_VALUE(THROUGHPUT).

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Using CONFIG_VALUE(THROUGHPUT) replace 'THROUGHPUT' string.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* update code style.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Move the setting output code into the try block.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2022-01-12 11:09:54 +03:00
Mikhail Nosov
26a78fcb5d
[OV2.0] Calculate model layout based on 'tensor' layout and convert steps (#9550)
* Calculate model layout based on 'tensor' layout and convert steps

Previously, 'model layout' is set to '...' by default,
thus no shape conversion happened when tensor layout is set to 'NHWC', then there was explicit convert_layout "NCHW"

Now "model layout" is calculated based on tensor layout and conversion steps:
Examples:
 1) Tensor: NHWC, Convert: NCHW. Result: NCHW
 2) Tensor: NHWC, Convert: 0312. Result: NCHW

* Fix for set_shape + resize case
2022-01-12 10:52:02 +03:00