Commit Graph

6140 Commits

Author SHA1 Message Date
Wang, Yang
c7d216db13
passing by reference to fix performance inefficiencies. (#9590)
* passing by reference to fix performance inefficiencies.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Passing by const reference.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2022-01-14 15:33:58 +03:00
Jade Cho
9e01cbd532
[GPU] fix a minor bug of dump graph (#9659) 2022-01-14 15:06:58 +03:00
Tomasz Dołbniak
8b1514d49e
Set additional tensor names only if necessary (#9652) 2022-01-14 12:44:50 +01:00
Anton Dudchenko
eb299f819e
[IE][VPU] Rename and move VPU plugin to src/plugins (#9110)
* [IE][VPU] Rename and move VPU plugin to src/plugins

* Update some dependencies

* Change .md

* Update some dependencies

* Update some dependencies (again)

* I'll rename this one

* Remove ENABLE_MYRIAD arg

* Update XLink.cmake

* Update thirdparty CMakeList

* Minor fixes
2022-01-14 14:02:08 +03:00
Edward Shogulin
bd97d1edc6
[LPT] SharedValueAttribute extending (#9534)
* [LPT] SharedValueAttribute extending

* [LPT] tests + comments
2022-01-14 13:33:07 +03:00
Sergey Lyubimtsev
0ff88458f9
fix PyPI upload error: Invalid value for classifiers. Error: Classifier 'OSI Approved :: Apache Software License' is not a valid classifier. (#9656) 2022-01-14 13:09:12 +03:00
Anton Chetverikov
f4b0d40cd0
[MO] Skip rt_info in old graph comparator (#9638)
* Skip rt_info while graph comparing

* Remove incorrect comparing for rt_info
2022-01-14 12:49:12 +03:00
Anton Pankratov
790f02c0b1
Hetero creates single result node (#9572) 2022-01-14 12:26:39 +03:00
Nadezhda Ageeva
12ab842970
[GNA] Deprecate GNA_LIB_N_THREADS and SINGLE_THREAD parameters + sample update (#9637)
* Deprecate GNA_LIB_N_THREADS and SINGLE_THREAD parameters

* Remove deprecated options from sample

* Fix speech sample test

* Adds doxy deprecated comment
2022-01-14 12:20:36 +03:00
Mingyu Kim
645c44459c
[GPU] Add formats for crop (#9660) 2022-01-14 12:19:18 +03:00
Vladislav Golubev
c734100ec5
[Transformations] SkipGather transformation (#9627)
* [Transformations] SkipGather transformation implemented

* review fixes
2022-01-14 12:17:03 +03:00
dependabot[bot]
29d57ad0a8
Bump tox from 3.23.1 to 3.24.5 in /src/bindings/python (#9497)
Bumps [tox](https://github.com/tox-dev/tox) from 3.23.1 to 3.24.5.
- [Release notes](https://github.com/tox-dev/tox/releases)
- [Changelog](https://github.com/tox-dev/tox/blob/master/docs/changelog.rst)
- [Commits](https://github.com/tox-dev/tox/compare/3.23.1...3.24.5)

---
updated-dependencies:
- dependency-name: tox
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-01-14 11:55:53 +03:00
Mateusz Tabaka
954172a010
[GPU] Don't optimize crop if its user is a reshape that can be optimized (#9537)
Crop uses more eltwise assign kernel which yields better performance than reshape_ref.
2022-01-14 11:51:02 +03:00
Vitaliy Urusovskij
583d97314a
Remove skip for smoke_SetBlobCPU*PrecisionInNet=BOOL* (#9655) 2022-01-14 11:09:35 +03:00
Nikita Demashov
1df9f958e2
[LPT]MoveFakeQuantize resolved minor comments (#9614)
* Q/DQ + mulichannel support

backup

fix interval

mfk_functiun.cpp

WIP moveDequantizationBefore

add moveDequantizationBefore function

add cpu and gpu tests

attribute cmp false

attribute cmp false

rm temp line

mkl-dnn update

concat with multichanels for mOve_fake_quantize_function, bad runtime info for q/dq

rm extra qualification

fix run time info for q/dq

add support of multichanel fakequantize, bad test for it

work tests for multi chanel FQ

rm workaround

cpplint fix

cpplint fix

don't worl Variadic split

ieFuncTest work

cpuFuncTest work

Fix benchmark_app build (#7577)

[GPU] Added onednn dependency. (#6564)

cpp lint

cpplint

fix get_shape

fix fq constants

cpp lint

some fix in mfk.cpp

resolve conversations, add spil_nodes function

add new tests for multi-chanels, rename NetworkHelper::split_consts_before_concat()

fix get fq constants

* add new multi-chanels test and use constant_fold to split constant

* remove extra spaces

fix namespase terminated

fix namespase terminated

* resolved minor comments

* added check for convert_q
2022-01-14 10:40:10 +03:00
Nikolay Shchegolev
77c2c5fab3
[CPU] RNN node kernel caching. (#9588) 2022-01-14 09:28:05 +03:00
Luwei Zhou
d5fb0a0c24
[CPU] Enable Reorder node run time cache. (#9490) 2022-01-14 09:20:18 +03:00
Tomasz Dołbniak
320c89f0ab
Obsolete xfail for 38722 (#9653) 2022-01-14 08:25:26 +03:00
Luo Cheng
68d8ca8060
MulticlassNms/MatrixNms: ngraph op support FP16 output (#9481)
* recover overwritten code in #8520

* support fp16

* update spec

* apply review comments

* support dynamic type check
2022-01-14 07:54:32 +03:00
Pavel Zamelin
2e59029e68
Fix build error with -DBUILD_SHARED_LIBS=OFF (#9639)
* Add _ov_frontends_hpp dependency to frontend_common_obj

* Move _ov_frontends_hpp dependency to frontend_common_obj
2022-01-14 07:53:14 +03:00
Ilya Lavrenov
9ef48cbe6d
Moved NCC check to U20 (#9631) 2022-01-14 07:50:55 +03:00
Ilya Lavrenov
5affdc3284
Added NCC support for source files (#9630) 2022-01-14 07:50:30 +03:00
Vladislav Golubev
1f241277f4
[ngraph] Add UnsqueezeConcatReduceFusion transformation (#9183)
* [ngraph] Add UnsqueezeConcatReduceFusion transformation

* Quick refactoring & build fix

* Transformation disabled in the GNA Plugin

* Review comments applied

* codestyle fix

* test fix

Co-authored-by: Aleksandr Pertovsky <aleksandr.pertovsky@intel.com>
2022-01-14 07:36:55 +03:00
mei, yang
e6d062e395
remove option ENABLE_SHUTDOWN_PROTOBUF (#9619)
* remove option ENABLE_SHUTDOWN_PROTOBUF

* shutdown protobuf library is enabled automatically if protobuf is used in frontend
2022-01-14 05:02:26 +03:00
Mingyu Kim
11cb8ebf55
[GPU] New debug option to serialize execution of inferences (#9510) 2022-01-14 10:24:40 +09:00
Mateusz Tabaka
508af22c66
Add CompressQuantizeWeights transformation (#7538)
* Add CompressQuantizeWeights transformation

It's based on model-optimizer/extensions/back/compress_quantized_weights.py

* handle dequantization subgraph after quantization

* fix scale shift calculation

* remove TRANSFORMATIONS_API from CompressQuantizeWeights

* ZeroPointOptimizer

* add CompressQuantizeWeights pass to to ApplyMOCTransformations

* add comment

* fix code style

* cleanup

* ambiguous copy_runtime_info

* ambigous call

* fix case when zero_point is close to zero

* fix cf test case

* move files

* update tests

* add tests for evaluate_subgraph

* Address review comments

* make params static
2022-01-13 23:38:39 +01:00
Fedor Zharinov
6c69535d6c
Benchmark_app batch calculation fix (#9554)
* BenchmarkApp - batch size calculation fix

* stylefix

* -ip/op fix

* stylefix
2022-01-13 23:34:38 +03:00
Fedor Zharinov
6a126ac6bb
avg statistics calculation fix (#9612) 2022-01-13 22:57:20 +03:00
Anastasia Kuporosova
2944f39bac
[Python API] Remove extra version info from get_version (#9645) 2022-01-13 22:38:02 +03:00
Maksim Proshin
ec0dd6051a
[POT] Minor correction about OpenSource (#9625)
* Update README.md

* Update README.md
2022-01-13 20:10:34 +03:00
Mateusz Tabaka
8ba339d16f
Eliminate no-op elementwise operations (#8840)
* Eliminate no-op elementwise operations

This change adds EliminateEltwise pass to NopElimination.
EliminateEltwise removes:
- Subtract with zero
- Multiply with one
- Divide by one

* add Add support to EliminateEltwise

* fix unit test

* use get_all_data_elements_bitwise_identical instead of get_single_value

* fix are_all_data_elements_bitwise_identical for constant created from HostTensor

* fix lpt tests

* check for mul in is_dequantization_subgraph function

* optimize fetching constant value

* apply review comments
2022-01-13 20:05:47 +03:00
Liubov Talamanova
cde61f2411
[POT] Fix bug with git (#9604)
* [POT] Fix bug with git

* Add UNKNOWN_VERSION constant
2022-01-13 19:56:18 +03:00
Nikita Malinin
0166cb8f5c
[POT] New IE API integration (#9004)
* Initial commit for integration

* Apply latest updates

* Update ie_engine for multi input models

* Update reference, pylint fixed, method replacement

* Change for AC 2.0 support

* Update aac_engine with raw data processing

* Update for pylint

* Update model utils

* Disable pylint check

* Update ac_engine with the processing

* Using tensor names instead of friendly names

* Tensor names for all statistics

* BiasCorrection with tensor names

* Remove debug info usage

* Fix for sequential stats

* Fix for the scalar stats

* Update with comments

* Update tests & builder

* Update tests

(cherry picked from commit 5022ce4a4fac230ac11db68f14cd58971fe9b2a2)

* Executable_model -> compiled_model

(cherry picked from commit 0d447ff4917f764df76d9c0c0068277e5e090f3b)

* Update with PartialShapes for reshape

* Update async mode

* Update refs

* Update BC Parameter dtype

* Update simplified with inferqueue

* Disable ssd512 nightly

* BC renaming

* Revert OMZ commit

* Update references

* Update BC algo with the parameter selection

* Update AC config filter

* Pylint fixes

* Update async data

* Update pylint for ie_engine

* Update ie_engine

* Revert refs changes

(cherry picked from commit 4d3530216b3d79c33c3437a7dfcc1140693320c8)

* Update OMZ submodule
2022-01-13 19:21:37 +03:00
Chenhu Wang
b33dcd02c6
fix windows debug test failure (#9635) 2022-01-13 18:53:20 +03:00
Vladimir Paramuzov
20d9d551eb
[GPU] Layout API improvement to replace direct named dimension usages from tensor (#9056) 2022-01-13 17:02:13 +03:00
Dawid Kożykowski
5059184789
remove unnecessary warning (#9243) 2022-01-13 14:50:56 +01:00
Vasily Shamporov
b7e8ef910d
Fix a paragraph in LPT docs w.r.t mixed precision (#9570) 2022-01-13 15:58:14 +03:00
Ilya Lavrenov
fdee2d5728
Disabled dynamic Windows build in Azure (#9568) 2022-01-13 15:44:04 +03:00
Alexander Zhogov
04c9a55b45
Revert "Deprecate GNA_LIB_N_THREADS and SINGLE_THREAD parameters (#9486)" (#9632)
This reverts commit c06d4e7fb7.
2022-01-13 15:41:15 +03:00
Roman Kazantsev
a53a4da3a2
[MO, Frontends] Implement ChangePlaceholderType as Offline Transformation (#8245)
* [Common FrontEnd] Implement ChangePlaceholderType transformation with OldApiMap

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add ChangePlaceholderType pass into frontend normalize

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add a comment about the transformation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code review comments: remove ngraph namespace rountine, etc.

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove use of extra Node object in set_old_api_map call

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Create separate pass for legacy nGraph transformations for MO with new frontend

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build for ieFuncTests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue with namespace conflicts

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Revert "Fix build issue with namespace conflicts"

This reverts commit 50a189f4e5.

* Move legacy transformations to ngraph namespace

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue with unresolved MOCLegacyTransformation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Adjust code to new OldApiMap API

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Resolve merge conflicts

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Do not set legacy type for parameter in case user defined type

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2022-01-13 15:29:51 +03:00
Ilya Churaev
f74b9caabb
Removed old dynamism API from infer request (#9557)
* Removed old dynamism API from infer request

* Fixed segfault

* Fixed some tests

* Added method to set inputs, outputs

* Fix python tests

* Try to fix window build
2022-01-13 14:54:14 +03:00
Ilya Lavrenov
9fe5165ffa
Support of clang-11 (#9620) 2022-01-13 14:31:25 +03:00
Nadezhda Ageeva
c06d4e7fb7
Deprecate GNA_LIB_N_THREADS and SINGLE_THREAD parameters (#9486) 2022-01-13 14:30:41 +03:00
Maxim Andronov
2b996c32ad
[CPU] FullyConnected dynamism support (#9380) 2022-01-13 13:18:02 +03:00
Gorokhov Dmitriy
c36afa495e
Temporarily disable onnx_if_inside_if unit test on CPU (#9624) 2022-01-13 13:14:37 +03:00
Mikhail Nosov
fc6eff048f
Python bindings: expose InputTensorInfo::set_memory_type (#9608)
* Exposing set_memory_type method

* Update quotes
2022-01-13 12:48:26 +03:00
Steve Yoo
a23a398dc0
Add SLT to Template Plugin: NonMaxSuppression-4,3,1 (#9511)
* Add SLT to Template Plugin: NonMaxSuppression-4

* Add SLT to Template Plugin: NonMaxSuppression-4,3,1
2022-01-13 12:42:56 +03:00
Jade Cho
35bcb77182
[GPU] Merge reorder into next onednn conv (#9601)
+ When the format of onednn convolution is bs_fs_yx_bsv32_fsv32, the reorder for dependency primitive of fused eltwise sum is removed.
2022-01-13 18:32:50 +09:00
Sergey Shlyapnikov
bd12648ec0
[GPU] Fix users invalidation and output layout recalculation in graph dump mode (#9439) 2022-01-13 12:29:43 +03:00
mei, yang
6ae0ba481e
fix build issue on android on shutdown protobuf (#9615)
* fix build issue on android on shutdown protobuf

* add ie_dependent_option for shutdown protobuf
2022-01-13 11:47:54 +03:00