Commit Graph

5185 Commits

Author SHA1 Message Date
Ilya Lavrenov
031e998a15
Fixed headers compilation with strict flags (#8403)
* Fixed headers compilation with strict flags

* Fixed Windows

* Fix

* Fix2
2021-11-08 18:48:19 +03:00
Nikita Malinin
8cb7824c21
[POT] Update for the Results quantization & tests (#8324)
* Update rule for multi-results quantization

(cherry picked from commit d94fe7d758)

* Update tests with lstm cases

(cherry picked from commit 16fe385117)

* Update lstm reference

* Fix pylint issue
2021-11-08 16:28:54 +03:00
Dmitry Pigasin
763859d082
[IE Samples] Enable a custom build output folder (#8263)
* Enable a custom build output folder

* Add the option to set a sample install directory

* Fix code style issues

* Exclude samples_bin from default build

* Make an installation directory dependent on a build type

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>

* Remove old msbuild version support

* Use cmake to build samples

* Use targets to install samples

* Use targets to install dlls: `format_reader` and `opencv_c_wrapper`

* Add `LIBRARY DESTINATION` for `format_reader` and `opencv_c_wrapper` install commands

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>
2021-11-08 14:15:30 +03:00
Ivan Tikhonov
5dacaa386f
[TF FE] Port operation loaders and refactor preliminary versions (#8150)
* Migrate POC for TensorFlow frontend

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Refactor InputModelTensorFlow API

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Repack POC to official API

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove tensorflow API from public include

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Make TF frontend work from MO and clean-up code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply codestyle

* Fix win biuld

* Fix Linux build

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Implement Place class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Determine outputs from graph

* Implement all Place classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Make small clean-up

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code-style corrections

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Determine cut nodes

* Apply codestyle

* Rework to use places

* Fix conversion issue

* Fix build

* Fix conversion

* Small fixes

* Add test for tf frontend

* Add tests

* Implement partial conversion

* Use dynamic type in TFFrameworkNode

* Fix build on Linux

* Implement InputModelTF class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix code by replacing InputModelTensorFlow to InputModelTF

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix to pass getPlaceByTensorName test

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Refactor and clean the code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Finalize refactoring code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Support freezing inputs

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add support for pruning input ports as new model output

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code-style fixes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* move op convertors to separate files, refactoring

* openvino codestyle

* openvino codestyle

* fix crash of layer tests

* fix missprint

* Implement TensorFlow NodeContext and DecoderTFProto classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Switch to new NodeContext

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove ngraph_builder class and node_context_impl class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Move decoder/graph_iterator to separate files and remove old files

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Document Decoder, GraphIterator, and NodeContext classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove empty file graph_iterator_proto.cpp and redundant comments

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use base class for GraphIterator in model class and correct exception class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use ends_with from util library

* Remain only InputModelTF constructor with GraphIterator and adopt other code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Correct code after merge

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix code based on feedback: delete extra namespace usage, etc.

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* refactoring of tf FrontEnd: rename namespaces, delete default opset

* codestyle

* fix e2e tests

* change namespaces of external classes

* resolve review comment

* codestyle

* Enable translators for Size,Shape,Rank,Range,Reshape ops

* Add translators for MatMul,Reciprocal,Square,XdivY ops

* enable Translators for Where,Log1p, Transpose, ZerosLike, Pack ops

* Enable Split,IsFinite,Tile ops, refactor Reduce ops

* Add Reverse,Round ops

* fix codestyle

* Enable Unpack, L2Loss ops

* Add LRN, GatherND, TopK ops, fix Reduce ops

* codestyle

* Revising of StridedSlice,SplitV,SpaceToDepth ops

* Add Concat,FusedBatchNormEx,Slice,SpaceToDepth ops

* Add Interpolate,BatchToSpaceNd,SpaceToBatchNd,NonMaxSuppression ops support

* codestyle

* Port CropAndResize,FakeQuantMinMaxVars,FusedDepthwiseConv2d

* fix translators

* codestyle

* Resolve review remarks

* fix wrong merge

* fix incorrect merge, refactoring

* add LeakyRelu op

* codestyle

* Add LogicalXor operation

* Add support for Swish op, set correct tensor names, refactoring

* fix incorrect merge

* codestyle

* fix unit tests

* fix build

* Refactoring

* codestyle

* fix win build

* fix reduce op

* Investigate failures on Windows

* add debug prints

* debug prints

* debug prints

* Delete debug prints

* clean up

* clean up

* codestyle

* delete debug changes

* Delete redandant comments

* rename utils functions

* rename translators

* rename layout convertors

* resolve review comments

* resolve review comments:

* codestyle

* rename NodeContext methods

* add todo comment

* Remove internal tf ops from op_table

* fix decode

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2021-11-08 13:46:19 +03:00
Ilya Lavrenov
279d905011
Fixed interpolate to work with int32 axes, target_shapes (#8379) 2021-11-08 13:40:54 +03:00
Tagir Rakipov
7db0973ba7
fixed fq scaling bug in layerwise tuning (#8346) 2021-11-08 12:57:13 +03:00
Krzysztof Bruniecki
a693859d8b
[GNA] Fix potential nullptr dereference (#8125)
* Fix potential nullptr dereference

* Apply review
2021-11-08 11:50:19 +03:00
mei, yang
b2523b1c01
remove paddle mul op converter (#8190) 2021-11-08 07:16:12 +03:00
Dawid Kożykowski
9731d9a295
fix throwing exception for bool type (#8172) 2021-11-05 14:15:28 +01:00
Edward Shogulin
5f7e3cdfb9
[LPT] isAsymmetricQuantization & isAsymmetricOnWeights validation (#8316)
* [LPT] isAsymmetricQuantization & isAsymmetricOnWeights

* [LPT] isAsymmetricOnWeights tests

* [LPT] tests improvements: comments fixes
2021-11-05 13:24:18 +03:00
Alina Kladieva
2ed4e9c05f
Temporarily pin setuptools version (#8416)
Due to https://github.com/pypa/setuptools/issues/2849 introduced with the latest setutools
2021-11-04 14:11:21 +03:00
Paul Youngsoo Ahn
d544787254
[GPU] Fix default value of KEY_GPU_MODEL_PRIORITY (#8398) 2021-11-04 12:49:00 +03:00
Ilya Lavrenov
e14ead8dd3
Don't use global objects during CPU plugin nodes registration (#8367)
* Load CPU plugin as extension as well

* Fixed linkage issues

* Added static linux build

* Disabled GPU

* Fix for CPU nodes registration

* Disabled GPU

* Disabled GPU

* Disabled GPU

* Disabled GPU

* Disabled HETERO synthetic tests in static case

* Fixed dependencies

* Proper fix
2021-11-04 12:39:28 +03:00
Smirnov Grigorii
23c50323eb
Update existing functional tests to use pass::Manager (#8173) 2021-11-04 12:28:19 +03:00
Smirnov Grigorii
9d8636a362
fix /clone_with_new_inputs/ method in PadIE operation (#8333) 2021-11-04 11:59:57 +03:00
Sergey Shlyapnikov
8ae47bfc9f
[GPU] Fix incorrect memory reuse for output in case of fused eltwise (#8400) 2021-11-03 23:50:44 +03:00
Yury Gaydaychuk
4abc053ab4
[CPU][DS] NonZero node with dynamic shapes (#7957) 2021-11-03 22:02:05 +03:00
Tomasz Dołbniak
b5f0ca5d10
Offline transformations exposed to python with pybind11 (#7987)
* New approach to offline transformations

* Include paths fix

* Imports fix

* offline_transformations target dependency simplification

* MakeStatefulTransformation exposed to python

* Python bindings build configuration fix

* Test variable name refactor

* Stop crying (snow)flake

* Snake cased offline transformations API

* Removal of old offline transformations from python

* Imports adaptation to new code style

* offline_transformations as a part of the common wheel

* Cmake simplification and refactor

* Correct transform invocation

* CI fix

* Proper dependency check in MO

* _pyngraph as a dependency of MO in cmake

* IR serialization fix in MO

* POT adaptation to the new API

* Revert "Removal of old offline transformations from python"

This reverts commit f9a0551ead.

* Merge of old& new bindings for offline_transformations

* Revert "POT adaptation to the new API"

This reverts commit 499554e68c.

* Obsolete cmake line removal

* Missing comma and merge conflict fix

* Offline transformations tests fix

* IE imports removal from check_ie_bindings

* Installation of opevino/__init__.py fix

* Obsolete line removal

* MO serialization switched to the new API

* Revert of preliminary MO adaptation to the new API

* Another magic spell that will hopefully make CI pass

* Python api cmake dependencies reorg

* Temporary solution for the CI/cpack errors

* Installation fix and code formatting

* ie_api & pyopenvino dependency removal

* Explicit cpack configuration for the new API

* cpack configuration adaptation

* Revert of obsolete cpack changes

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2021-11-03 20:00:14 +03:00
Michał Karzyński
db27dcce94
Remove NGRAPH_USE_PROTOBUF_LITE option, always use Lite (#8286) 2021-11-03 18:22:20 +03:00
Vladimir Zinoviev
aa00ae8b43
[LPT] AddTransformation: inconsistent element types when subtract on fullPath is empty (#8277) 2021-11-03 18:00:06 +03:00
Evgeny Kotov
9999b786ac
add comment (#7867) 2021-11-03 17:06:37 +03:00
song, bell
5617d48d72
enable itt trace for AUTO (#8139)
* enable itt trace for AUTO

Signed-off-by: fishbell <bell.song@intel.com>

* set itt to real loadnetwork path

Signed-off-by: fishbell <bell.song@intel.com>

* refine itt tracing

Signed-off-by: fishbell <bell.song@intel.com>

* formatting

Signed-off-by: fishbell <bell.song@intel.com>
2021-11-03 16:43:01 +03:00
Maxim Andronov
9871747bc6
[CPU] NonMaxSuppression dynamic done (#8303) 2021-11-03 16:07:03 +03:00
Mateusz Tabaka
0be6ed752d
[LPT] optimize Subtract with zero_point == 0 when it's not a direct C… (#8159)
* [LPT] optimize Subtract with zero_point == 0 when it's not a direct Constant

zero_point may be a Constant, but also it may come in form of
Constant->Convert(from low to high precision) subgraph.
If we handle both cases, we can reduce redundant Subtract node
e.g. between weights and Convolution which makes Convolution
to work fully on low precision inputs which significantly improves
performance.

* don't round shift if it's already in low precision
2021-11-03 15:58:48 +03:00
Michał Karzyński
165ce3eeea
Add support for ONNX RandomNormal and RandomNormalLike operators (#8024)
Co-authored-by: Tomasz Dołbniak <tomasz.dolbniak@intel.com>
Co-authored-by: Tomasz Jankowski <tomasz1.jankowski@intel.com>
2021-11-03 15:50:35 +03:00
Tatiana Troilova
fb5c9caa4d
Update third party files (#8382) 2021-11-03 15:29:42 +03:00
Mikhail Letavin
28706c34a1
[GPU] Fix sporadic fails in canRun3SyncRequestsConsistentlyFromThreads test (#8377) 2021-11-03 14:59:38 +03:00
Milana Shhanukova
5d9a76d2f8
Update node name to make ports visible (#8218) 2021-11-03 14:46:33 +03:00
Mateusz Tabaka
3fc210af21
Reimplement Extension.OnnxModelWith* cases w/o model in source code (#8112)
Ticket: 62567
2021-11-03 14:43:44 +03:00
Aleksei Kruglov
4e4e179d67
[VPUX] Updated config's parser (#7974)
Updated config's parser for compile_tool
The parser can read value containing spaces
2021-11-03 12:14:13 +03:00
Paul Youngsoo Ahn
ece45630f0
[GPU] Set affinity TBB using CPUStreamsExecutor (#7738) (#7738) 2021-11-03 11:50:55 +03:00
Mateusz Tabaka
65c3b4c357
Fix 'cannot estimate element if precision is UNSPECIFIED' error cause… (#7748)
* Fix 'cannot estimate element if precision is UNSPECIFIED' error caused by LPT

In some models after ConvMulFusion and FakeQuantizeMulFusion, output_low contains
denorms. That is problematic since LayerTransformation::getPrecisionDetails function checks
if output_low is close to zero and if it is - the function sets 'signedPrecision' flag to false.
In that case, both 'signedPrecision' and 'unsignedPrecision' are set to false and that makes
getPrecisionDetails return element::undefined.
This patch changes zeroThreshold to handle denorms.

Ticket: 65375

* fix FakeQuantizeTransformation tests
2021-11-03 11:39:52 +03:00
Vladimir Paramuzov
da33abca3a
[GPU] Fixed allocatin type for optimized out outputs (#8349) 2021-11-03 11:09:11 +03:00
Vladislav Golubev
6e3c2dd3ec
[LPT] LP Transformations: security fixes (#8357) 2021-11-03 10:56:23 +03:00
Andrey Somsikov
24aec7928c
Fix fuzz test failure (#8380)
Fuzz test execution fails with:
import_pdpd-fuzzer: symbol lookup error: runtime/lib/intel64/libngraph.so: undefined symbol:
__sancov_lowest_stack
2021-11-03 10:35:19 +03:00
Ilya Znamenskiy
0ed285ceb6
[GPU] Removed unneeded bias into quantize shift optimization (#8369) 2021-11-03 10:23:21 +03:00
Anastasia Popova
8d44a37f40
Added TID to Telemetry initialization. (#8194)
* Added TID to telemetry initialization.

* Moved TID to separate file.
2021-11-03 10:01:49 +03:00
Maxim Andronov
553403496c
[CPU] General fixes for dynamic shapes (#8205) 2021-11-03 09:11:28 +03:00
Vladislav Golubev
983d55fba5
[CPU] MatMulToFullyConnected transformation temporary disabled (#8364) 2021-11-03 09:10:35 +03:00
Steve Yoo
e3f1813e5c
Migrate Movement 2 (GatherElements-6, GatherND-5) (#8282) 2021-11-03 08:02:19 +03:00
Steve Yoo
bd756df2f5
Migrate ngraph backend test of constant operation (#7996)
* Add test cases for PReLU in cpu plugin

* For case when slope is vector

* Add Constant template plugin reference tests

* Update CMakeLists.txt and delete constant.in.cpp

* Add tests of tensor_2constant and constant_multi_use

* Add test of constant_equality_bool

* Remove wrong comments

* Remove some of strange if

* Merge to one CreateFunction

* Remove test names and update test for types

* Add bf16 and f64 tests

* Add missing type tests

* Clear actualOutData to allow multiple use of Validate()

* Update SetUp and CreateFunction to support CentOS CI

* Remove inputData = {}
2021-11-03 07:52:59 +03:00
Julia Kamelina
7c56155dae
[Python Tools] Align namespace for cross_check_tool (#7786)
* align openvino namespace

* update README
2021-11-03 01:55:27 +03:00
Artyom Anokhov
f20f4d024c
Deployment Manager CFGs: Added paddlepaddle_ngraph_frontend lib as core part (#8322) 2021-11-02 18:23:48 +03:00
Evgeny Talanin
0b0202b90c
Revert "[GPU] Fix some performance degradations from breaking GPU pipeline into explicit stages (#8084)" (#8372)
This reverts commit 03106e0cd9.
2021-11-02 17:35:37 +03:00
Ilya Lavrenov
384eea4eda
Static version: plugin registration as extension (#8365)
* Load CPU plugin as extension as well

* Fixed linkage issues

* Added static linux build

* Disabled GPU
2021-11-02 16:07:45 +03:00
Anna Khakimova
0071abffdf
Workaround for fluid's color conversion tests failures.Part 2. (#8293) 2021-11-02 15:03:20 +03:00
Vladislav Volkov
680e53a005
[Doc] Optimization guide update (#8359)
* [Doc] Optimization guide update

* brushing the freq locking section a bit

Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
2021-11-02 14:35:21 +03:00
Alexander Zhogov
c02d96d17e
CODEOWNERS: Add /tools/pot/ @openvinotoolkit/openvino-pot-maintainers 2021-11-02 13:55:02 +03:00
Victor Kuznetsov
8a46ead91b
add pytest-timeout (#8352) 2021-11-02 13:44:02 +03:00
Liubov Batanina
6686f3c052
Remove excess content from POT distribution (#8300) 2021-11-02 13:34:27 +03:00