Commit Graph

5204 Commits

Author SHA1 Message Date
Egor Shulman
c8b44b275c
[CPU] BatchToSpace dynamic done (#8222) 2021-11-10 09:56:10 +03:00
Alexandra Sidorova
841e56c317
[CPU] Added execution for RandomUniform node in each inference (#8122) 2021-11-10 09:55:18 +03:00
Ilya Churaev
512db063a8
New extension serialization (#8252)
* Fixed custom op serialization

* Deprecate old serialize constructor
2021-11-10 07:15:30 +03:00
Ilya Churaev
97a4b944b1
Fixed coverity issues (#8448) 2021-11-10 06:17:43 +03:00
Gleb Kazantaev
ce51b62b70
Fix PartialShape Iterators to reset cache (#8453) 2021-11-09 21:11:54 +03:00
Vladimir Paramuzov
234b8a82b5
[GPU] Fixed uninitialized vairable in infer request (#8410) 2021-11-09 21:11:21 +03:00
Gleb Kazantaev
d21f0ed242
Fix TransposeReduce Transformation (#8291) 2021-11-09 21:10:18 +03:00
Gleb Kazantaev
eb2b149fca
Fix RTInfo Deserialization for multiple key occurances (#8455) 2021-11-09 21:09:48 +03:00
Maxim Vafin
34886b650d
Add model compression to FP16 weights (#7588)
* Add model compression to FP16 weights

* Fix build

* Fix build

* Fix build

* Add wrapper over ConvertPrecision

* Add documentation to attributes

* Fix MO IR Reader

* Fix build

* Return DisableDecompressionConvertConstantFolding call in CommonOptimizations

* Temporarily disable old_api map

* Fix TI Convert issue

* Apply review feedback

* Fix build

* Fix build

* Fix build
2021-11-09 19:37:41 +03:00
Artur Paniukov
a9b9e14bf4
Add input to file mappings to python benchmark tool (#8210)
* Add inputs-to-files path to benchmark_tool

* Add inputs-to-files path to benchmark_tool

* Add inputs-to-files path to benchmark_tool

* Remove `<>`

* Fix binary input fill

* Remove redundant checks

Change `:` delimiter to `::`

* Delete print

* Change delimiter to `:`
Add support for list of files

* Add warning if some inputs filled with random values
2021-11-09 16:56:37 +03:00
Sergey Lyubimtsev
6c3e68a8d1
Add openvino-dev wheel build from opensource (#8174)
* Add openvino-dev wheel build from opensource

* fix path to OMZ tools

* fix for working directory

* change order

* pull out requirements to requirements.txt for snyk scans

* fix patterns

* fix patterns

* fix AttributeError: : 'PosixPath' object has no attribute 'startswith'
2021-11-09 14:37:17 +03:00
Alexander Zhogov
1c3d7cea83
Azure CI: exclude docs from mac trigger 2021-11-09 13:47:30 +03:00
Aleksandr Pertovsky
0feecd4450
[IE Transformations] Disable pull_transpose_through_fq transformation for activations path (#8178)
* [IE Transformations] Disable pull_transpose_through_fq transformation for activations path

* Update MO part

* Replace TEST to TEST_F

* Fix tests with fixture.

Remove dynamic shapes tests due to the fact that there is always a constant at the input
2021-11-09 13:26:07 +03:00
Victor Kuznetsov
b807800321
upd precommit res for memcheck (#8447) 2021-11-09 13:09:17 +03:00
Tomasz Dołbniak
6780dfcba7
Update of ONNX submodule to v1.10.2 (#8383)
* Update of ONNX submodule to v1.10.0

* Update of ONNX to 1.10.2

* Adaptation of the ONNX FE to ONNX 1.10

* ConstantOfShape XFAIL removal

* SCEL reference model updated to the new ONNX functions expansion behavior

* UnXFAIL more ONNX tests

* UnXFAIL even more ONNX tests
2021-11-09 12:53:34 +03:00
Alexander Zhogov
2b9b30f6b5
Azure CI: exclude docs from required pipelines triggers (#8468)
* Azure CI: exclude docs from required pipelines triggers

* Exclude master trigger of linux_onnxruntime
2021-11-09 12:33:22 +03:00
Vladislav Golubev
62b084a524
FullyConnectedNode: deserialization fix (#8345)
* FullyConnected deserialization fix

* Added test-case with MatMul to caching tests

* postreview fixes
2021-11-09 12:14:36 +03:00
Ilya Lavrenov
9057c15e92
CVS-68483: added CPU extensions by default to CPU plugin (#8407)
* FullyConnected deserialization fix

* Added test-case with MatMul to caching tests

* Fix

* Extensions

* Fix

* Revert "Added test-case with MatMul to caching tests"

This reverts commit eb69888896.

* Revert "FullyConnected deserialization fix"

This reverts commit 95bc22f065.

Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
2021-11-09 11:52:27 +03:00
Alexander Zhogov
37e3a0419f
Azure CI: exclude docs from trigger (#8459)
* Azure CI: exclude docs from trigger

* Add Windows

* Try docs/*

* Fix Windows
2021-11-09 10:11:37 +03:00
Ilya Lavrenov
031e998a15
Fixed headers compilation with strict flags (#8403)
* Fixed headers compilation with strict flags

* Fixed Windows

* Fix

* Fix2
2021-11-08 18:48:19 +03:00
Nikita Malinin
8cb7824c21
[POT] Update for the Results quantization & tests (#8324)
* Update rule for multi-results quantization

(cherry picked from commit d94fe7d758)

* Update tests with lstm cases

(cherry picked from commit 16fe385117)

* Update lstm reference

* Fix pylint issue
2021-11-08 16:28:54 +03:00
Dmitry Pigasin
763859d082
[IE Samples] Enable a custom build output folder (#8263)
* Enable a custom build output folder

* Add the option to set a sample install directory

* Fix code style issues

* Exclude samples_bin from default build

* Make an installation directory dependent on a build type

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>

* Remove old msbuild version support

* Use cmake to build samples

* Use targets to install samples

* Use targets to install dlls: `format_reader` and `opencv_c_wrapper`

* Add `LIBRARY DESTINATION` for `format_reader` and `opencv_c_wrapper` install commands

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>
2021-11-08 14:15:30 +03:00
Ivan Tikhonov
5dacaa386f
[TF FE] Port operation loaders and refactor preliminary versions (#8150)
* Migrate POC for TensorFlow frontend

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Refactor InputModelTensorFlow API

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Repack POC to official API

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove tensorflow API from public include

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Make TF frontend work from MO and clean-up code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply codestyle

* Fix win biuld

* Fix Linux build

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Implement Place class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Determine outputs from graph

* Implement all Place classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Make small clean-up

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code-style corrections

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Determine cut nodes

* Apply codestyle

* Rework to use places

* Fix conversion issue

* Fix build

* Fix conversion

* Small fixes

* Add test for tf frontend

* Add tests

* Implement partial conversion

* Use dynamic type in TFFrameworkNode

* Fix build on Linux

* Implement InputModelTF class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix code by replacing InputModelTensorFlow to InputModelTF

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix to pass getPlaceByTensorName test

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Refactor and clean the code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Finalize refactoring code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Support freezing inputs

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add support for pruning input ports as new model output

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code-style fixes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* move op convertors to separate files, refactoring

* openvino codestyle

* openvino codestyle

* fix crash of layer tests

* fix missprint

* Implement TensorFlow NodeContext and DecoderTFProto classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Switch to new NodeContext

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove ngraph_builder class and node_context_impl class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Move decoder/graph_iterator to separate files and remove old files

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Document Decoder, GraphIterator, and NodeContext classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove empty file graph_iterator_proto.cpp and redundant comments

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use base class for GraphIterator in model class and correct exception class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use ends_with from util library

* Remain only InputModelTF constructor with GraphIterator and adopt other code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Correct code after merge

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix code based on feedback: delete extra namespace usage, etc.

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* refactoring of tf FrontEnd: rename namespaces, delete default opset

* codestyle

* fix e2e tests

* change namespaces of external classes

* resolve review comment

* codestyle

* Enable translators for Size,Shape,Rank,Range,Reshape ops

* Add translators for MatMul,Reciprocal,Square,XdivY ops

* enable Translators for Where,Log1p, Transpose, ZerosLike, Pack ops

* Enable Split,IsFinite,Tile ops, refactor Reduce ops

* Add Reverse,Round ops

* fix codestyle

* Enable Unpack, L2Loss ops

* Add LRN, GatherND, TopK ops, fix Reduce ops

* codestyle

* Revising of StridedSlice,SplitV,SpaceToDepth ops

* Add Concat,FusedBatchNormEx,Slice,SpaceToDepth ops

* Add Interpolate,BatchToSpaceNd,SpaceToBatchNd,NonMaxSuppression ops support

* codestyle

* Port CropAndResize,FakeQuantMinMaxVars,FusedDepthwiseConv2d

* fix translators

* codestyle

* Resolve review remarks

* fix wrong merge

* fix incorrect merge, refactoring

* add LeakyRelu op

* codestyle

* Add LogicalXor operation

* Add support for Swish op, set correct tensor names, refactoring

* fix incorrect merge

* codestyle

* fix unit tests

* fix build

* Refactoring

* codestyle

* fix win build

* fix reduce op

* Investigate failures on Windows

* add debug prints

* debug prints

* debug prints

* Delete debug prints

* clean up

* clean up

* codestyle

* delete debug changes

* Delete redandant comments

* rename utils functions

* rename translators

* rename layout convertors

* resolve review comments

* resolve review comments:

* codestyle

* rename NodeContext methods

* add todo comment

* Remove internal tf ops from op_table

* fix decode

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2021-11-08 13:46:19 +03:00
Ilya Lavrenov
279d905011
Fixed interpolate to work with int32 axes, target_shapes (#8379) 2021-11-08 13:40:54 +03:00
Tagir Rakipov
7db0973ba7
fixed fq scaling bug in layerwise tuning (#8346) 2021-11-08 12:57:13 +03:00
Krzysztof Bruniecki
a693859d8b
[GNA] Fix potential nullptr dereference (#8125)
* Fix potential nullptr dereference

* Apply review
2021-11-08 11:50:19 +03:00
mei, yang
b2523b1c01
remove paddle mul op converter (#8190) 2021-11-08 07:16:12 +03:00
Dawid Kożykowski
9731d9a295
fix throwing exception for bool type (#8172) 2021-11-05 14:15:28 +01:00
Edward Shogulin
5f7e3cdfb9
[LPT] isAsymmetricQuantization & isAsymmetricOnWeights validation (#8316)
* [LPT] isAsymmetricQuantization & isAsymmetricOnWeights

* [LPT] isAsymmetricOnWeights tests

* [LPT] tests improvements: comments fixes
2021-11-05 13:24:18 +03:00
Alina Kladieva
2ed4e9c05f
Temporarily pin setuptools version (#8416)
Due to https://github.com/pypa/setuptools/issues/2849 introduced with the latest setutools
2021-11-04 14:11:21 +03:00
Paul Youngsoo Ahn
d544787254
[GPU] Fix default value of KEY_GPU_MODEL_PRIORITY (#8398) 2021-11-04 12:49:00 +03:00
Ilya Lavrenov
e14ead8dd3
Don't use global objects during CPU plugin nodes registration (#8367)
* Load CPU plugin as extension as well

* Fixed linkage issues

* Added static linux build

* Disabled GPU

* Fix for CPU nodes registration

* Disabled GPU

* Disabled GPU

* Disabled GPU

* Disabled GPU

* Disabled HETERO synthetic tests in static case

* Fixed dependencies

* Proper fix
2021-11-04 12:39:28 +03:00
Smirnov Grigorii
23c50323eb
Update existing functional tests to use pass::Manager (#8173) 2021-11-04 12:28:19 +03:00
Smirnov Grigorii
9d8636a362
fix /clone_with_new_inputs/ method in PadIE operation (#8333) 2021-11-04 11:59:57 +03:00
Sergey Shlyapnikov
8ae47bfc9f
[GPU] Fix incorrect memory reuse for output in case of fused eltwise (#8400) 2021-11-03 23:50:44 +03:00
Yury Gaydaychuk
4abc053ab4
[CPU][DS] NonZero node with dynamic shapes (#7957) 2021-11-03 22:02:05 +03:00
Tomasz Dołbniak
b5f0ca5d10
Offline transformations exposed to python with pybind11 (#7987)
* New approach to offline transformations

* Include paths fix

* Imports fix

* offline_transformations target dependency simplification

* MakeStatefulTransformation exposed to python

* Python bindings build configuration fix

* Test variable name refactor

* Stop crying (snow)flake

* Snake cased offline transformations API

* Removal of old offline transformations from python

* Imports adaptation to new code style

* offline_transformations as a part of the common wheel

* Cmake simplification and refactor

* Correct transform invocation

* CI fix

* Proper dependency check in MO

* _pyngraph as a dependency of MO in cmake

* IR serialization fix in MO

* POT adaptation to the new API

* Revert "Removal of old offline transformations from python"

This reverts commit f9a0551ead.

* Merge of old& new bindings for offline_transformations

* Revert "POT adaptation to the new API"

This reverts commit 499554e68c.

* Obsolete cmake line removal

* Missing comma and merge conflict fix

* Offline transformations tests fix

* IE imports removal from check_ie_bindings

* Installation of opevino/__init__.py fix

* Obsolete line removal

* MO serialization switched to the new API

* Revert of preliminary MO adaptation to the new API

* Another magic spell that will hopefully make CI pass

* Python api cmake dependencies reorg

* Temporary solution for the CI/cpack errors

* Installation fix and code formatting

* ie_api & pyopenvino dependency removal

* Explicit cpack configuration for the new API

* cpack configuration adaptation

* Revert of obsolete cpack changes

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2021-11-03 20:00:14 +03:00
Michał Karzyński
db27dcce94
Remove NGRAPH_USE_PROTOBUF_LITE option, always use Lite (#8286) 2021-11-03 18:22:20 +03:00
Vladimir Zinoviev
aa00ae8b43
[LPT] AddTransformation: inconsistent element types when subtract on fullPath is empty (#8277) 2021-11-03 18:00:06 +03:00
Evgeny Kotov
9999b786ac
add comment (#7867) 2021-11-03 17:06:37 +03:00
song, bell
5617d48d72
enable itt trace for AUTO (#8139)
* enable itt trace for AUTO

Signed-off-by: fishbell <bell.song@intel.com>

* set itt to real loadnetwork path

Signed-off-by: fishbell <bell.song@intel.com>

* refine itt tracing

Signed-off-by: fishbell <bell.song@intel.com>

* formatting

Signed-off-by: fishbell <bell.song@intel.com>
2021-11-03 16:43:01 +03:00
Maxim Andronov
9871747bc6
[CPU] NonMaxSuppression dynamic done (#8303) 2021-11-03 16:07:03 +03:00
Mateusz Tabaka
0be6ed752d
[LPT] optimize Subtract with zero_point == 0 when it's not a direct C… (#8159)
* [LPT] optimize Subtract with zero_point == 0 when it's not a direct Constant

zero_point may be a Constant, but also it may come in form of
Constant->Convert(from low to high precision) subgraph.
If we handle both cases, we can reduce redundant Subtract node
e.g. between weights and Convolution which makes Convolution
to work fully on low precision inputs which significantly improves
performance.

* don't round shift if it's already in low precision
2021-11-03 15:58:48 +03:00
Michał Karzyński
165ce3eeea
Add support for ONNX RandomNormal and RandomNormalLike operators (#8024)
Co-authored-by: Tomasz Dołbniak <tomasz.dolbniak@intel.com>
Co-authored-by: Tomasz Jankowski <tomasz1.jankowski@intel.com>
2021-11-03 15:50:35 +03:00
Tatiana Troilova
fb5c9caa4d
Update third party files (#8382) 2021-11-03 15:29:42 +03:00
Mikhail Letavin
28706c34a1
[GPU] Fix sporadic fails in canRun3SyncRequestsConsistentlyFromThreads test (#8377) 2021-11-03 14:59:38 +03:00
Milana Shhanukova
5d9a76d2f8
Update node name to make ports visible (#8218) 2021-11-03 14:46:33 +03:00
Mateusz Tabaka
3fc210af21
Reimplement Extension.OnnxModelWith* cases w/o model in source code (#8112)
Ticket: 62567
2021-11-03 14:43:44 +03:00
Aleksei Kruglov
4e4e179d67
[VPUX] Updated config's parser (#7974)
Updated config's parser for compile_tool
The parser can read value containing spaces
2021-11-03 12:14:13 +03:00
Paul Youngsoo Ahn
ece45630f0
[GPU] Set affinity TBB using CPUStreamsExecutor (#7738) (#7738) 2021-11-03 11:50:55 +03:00