Commit Graph
2730 Commits
Author SHA1 Message Date
Ilya Lavrenov a952540edf Openvino cmake config (#7419)
* Added OpenVINOConfig.cmake

* OpenVINOConfig.cmake part 2

* Trying to fix cmake generation

* Fixes

* Export frontends as well

* Fixed condition

* Added OpenVINO cmake package usage: docs, C samples

* Use more OpenVINO config

* Install OpenVINOConfig.cmake

* Trying to fix private plugins

* Trying to fix .tox

* Trying to fix ARM

* Fixed samples build

* Explicit ngraph duplicated targets

* Fixed fuzzing tests build

* Added IR frontend installation

* Removed install directory for IE reader

* Removed IR frontend from export list

* Reverted ngraph_DIR

* Try to fix .tox

* Fixed ieFuncTests with ONNX extensions

* Attempt #2

* Trying to fix ngraph setup.py

* Fix

* Trying to fix ONNX ngraph .tox CI

* Trying to remove spaces

* Fixed ngraph_DIR -> OpenVINO_DIR

* Removed junk files

* Try to fix ngraph wheel

* Try to fix ie_wheel

* Try to fix ngraph wheel
2021-09-10 15:31:27 +03:00
Gabriele Galiero Casay deeb96440f Revise GatherTree reference implementation (#7275)
* Add visitor api test

* Review ngraph op shell with type_prop tests

* Add op to list of trusted operations

* Change name of struct with information of inputs

* Add include of array data structure to fix windowds compilation error

* Add template plugin test class

* Remove usage of CoordinateTransform index function call from reference implementation

* Rename SLT test suite

* Add template plugin unit test

* Add serialization SLTs

* Add indentation on GatherTreeParams class data members
2021-09-10 14:02:49 +03:00
Anton Dudchenko 288a7633bf [IE][VPU] Fix execTimeMcs for VPU (#7442)
When serializing execGraph, milliseconds were actually written to the execTimeMcs field
2021-09-10 13:08:13 +03:00
Anton Pankratv 305b86fe4a Added openvino executable network API (#7230) 2021-09-10 11:55:52 +03:00
Fengyi Sun 2a0140d960 [CPU] Fixed sort port bug (#6812)
if port > port_num, the behavior of res[port] is undefined.

Signed-off-by: fengyi.sun <fengyi.sun@intel.com>
Reviewed-by: Wu, Jiangming <jiangming.wu@intel.com>]
2021-09-09 15:32:58 +03:00
Vladislav Golubev f5767d4a5b [LPT][Transformations] Dynamic shapes support: functional issues fixes (#7159)
* [LPT] ReshapeTransformation fix

* [LPT] FQDequantization::empty() fix

* [LPT] ConcatTransformation fix

* [LPT] MVNTransformation quick refactoring

* [TESTS] AddTransformation functional tests: removed unused param

* [nGraph] TypeRelaxed::evaluate

* [nGraph] Tile fix

* [nGraph] Intervals addition: overflow handling

* [LPT] MultiplyTransformation: canBeTransformed fix

* [TESTS] TypeRelaxed::evaluate: added test

* [LPT] MVNTransformation compilation error fix

* TypeRelaxed: evaluate fix

* macos fix

* TypeRelaxed::evaluate: postreview fixes

* ConcatTransformation: postreview fix
2021-09-09 13:05:32 +03:00
Tomasz Dołbniak f5089912e4 MaxPool-8 python API (#7170) 2021-09-09 11:45:47 +02:00
Andrew Kwangwoong Park c33856b31f [GPU] Improve memory usage management to distinguish allocation type (#7318)
Signed-off-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>
2021-09-09 07:19:07 +03:00
Anton Pankratv 1c1401b069 Added default exec network result (#7352) 2021-09-08 23:33:12 +03:00
f89b3d770b [IE PYTHON] dynamic shape api for python (#7282)
* Added nGraph as a public dependency

* Fixed Windows warning

* Fixed CMake

* Fixed constant op

* Fixed typo

* Added reshape to PartialShape to CNNNetwork

* Added SetShape to InferRequest

* Enable support of DynamicShape in IE Data

* Add support of dynamic shapes to template plugin

* Fixed build

* Enable support dynamic rank

* Fixed test for dynamic rank

* Fixed some tests

* Fix preprocess tests

* Fixed SetBlob

* Fixed code style

* Add more tests

* Fixed accuracy tests

* Fixed documentation

* Added tests for custom operation

* Added new tests

* WIP: move setShape from infer request to Blob

* Returned isApplicable check back

* Removed obsolete tests for InferRequest::SetShape and add new test for Blob::setShape (a trivial one)

* Fixed artifacts

* Break code style

* Revert "Break code style"

This reverts commit 71ee638cd0.

* Added -j8 for fix_all

* Applied code style fixes

* Adde doxygen items

* Fixed style

* Applied codestyle patch

* Reverted unrelevant commit with template extension

* Fixed cmake file for shared func tests (pick from master)

* Revert all changes in template_extension

* Deleted some old stuff that commented and won't be used

* Fixed wrong exception throwing

* Code style fix

* Fixed preprocessing part

* Fixed incorrect blob reshape in GetBlob

* Deleted incorrect assert in GAPI that prevents passing some tests in Debug

* Fixed issues identified during review

* Removed SetShape, replace getLayoutByDims by getLayoutByRank and removed problematic modification from IE preprocessing

* Fixed comments

* Removed obsolete setShape

* [VPU] Fixed allocating dynamic blobs in myriad_infer_request

* Fixed comments

* Fixed CNNNgraphImpl and comments

* add partial reshape for IENetwork

* Add getPartialShape

* Add setShape for Blob

* Add tests

* Add partial_shape property for CDataPtr

* Add partial_shape property for data

* Fix code style

* Fix code style

* Fix test

* Fix code style

* Fix code style

* Fix code style

* Add tests

* Add new lines

* Mark tests

* Fix tests

* call set_shape implicit  only for dynamic inputs

* skip tests on ARM

* remove ngraph dependence from ie_api.pyx

* expand only shape, not array in expand_dims_to_corresponding_layout

* Mark ngraph dependent tests

* remove skip inside test

* code refactoring

* add new line

* Add docstring

* Fix code style

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Lyalin, Sergey <sergey.lyalin@intel.com>
Co-authored-by: Polina <polina.brzezinskaya@intel.com>
2021-09-08 19:41:20 +03:00
Sergey Lyubimtsev 42b93bed42 Add support of pkgutil-style namespace packages (#7422)
* Add support of pkgutil-style namespace packages

* fix linter issue (mypy)

* fix linter issue (mypy)

* ignore # mypy issue #1422

* E261 at least two spaces before inline comment
2021-09-08 19:28:00 +03:00
Elizaveta Lobanova 66a14f1ac3 [GNA] Fixed scale factors propagation for Eltwise with very different inputs ranges (#7305)
* [GNA] Fix scale factors propogation for Eltwise with very different inputs ranges

* [GNA] Added test

* [GNA] Added exception for scale factor <= 0

* [GNA] Disable tests with integer weights

* [GNA] Added assert for CNNLayer in getScaleFactor()

* [GNA] Added check if scale factor is inf

* [GNA] Fixed legacy tests
2021-09-08 10:48:05 +03:00
Maksim Kutakov 5096fe19f1 [CPU] Dynamic shapes support using fallback on reference (#6882) 2021-09-08 10:33:20 +03:00
Alexey Lebedev d5e063d435 Mark ngraph dependent tests (#7392) 2021-09-07 22:28:57 +03:00
322c874113 Feature/azaytsev/cherry picks from 2021 4 (#7389)
* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Updated the link to software license agreements

* Revert "Updated the link to software license agreements"

This reverts commit 706dac500e.

* Updated legal info (#6409)

# Conflicts:
#	thirdparty/ade

* Cherry-pick 4833c8db72

[DOCS]Changed DL WB related docs and tips (#6318)

* changed DL WB related docs and tips

* added two tips to benchmark and changed layout

* changed layout

* changed links

* page title added

* changed tips

* ie layout fixed

* updated diagram and hints

* changed tooltip and ref link

* changet tooltip link

* changed DL WB description

* typo fix
# Conflicts:
#	docs/doxygen/ie_docs.xml
#	thirdparty/ade

* Cherry-pick 6405

Feature/azaytsev/mo devguide changes (#6405)

* MO devguide edits

* MO devguide edits

* MO devguide edits

* MO devguide edits

* MO devguide edits

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Additional edits

* Additional edits

* Updated the workflow diagram

* Minor fix

* Experimenting with videos

* Updated the workflow diagram

* Removed  Prepare_Trained_Model, changed the title for Config_Model_Optimizer

* Rolled back

* Revert "Rolled back"

This reverts commit 6a4a3e1765.

* Revert "Removed  Prepare_Trained_Model, changed the title for Config_Model_Optimizer"

This reverts commit 0810bd534f.

* Fixed ie_docs.xml, Removed  Prepare_Trained_Model, changed the title for Config_Model_Optimizer

* Fixed ie_docs.xml

* Minor fix

* <details> tag issue

* <details> tag issue

* Fix <details> tag issue

* Fix <details> tag issue

* Fix <details> tag issue
# Conflicts:
#	thirdparty/ade

* Cherry-pick #6419

* [Runtime] INT8 inference documentation update

* [Runtime] INT8 inference documentation: typo was fixed

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Table of Contents was removed

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
# Conflicts:
#	docs/IE_DG/Int8Inference.md
#	thirdparty/ade

* Cherry pick (#6437)

* Q2 changes

* Changed Convert_RNNT.md

Co-authored-by: baychub <cbay@yahoo.com>
# Conflicts:
#	docs/IE_DG/Int8Inference.md
#	docs/install_guides/installing-openvino-conda.md
#	docs/install_guides/pypi-openvino-dev.md
#	thirdparty/ade

* Cherry-pick (#6447)

* Added benchmark page changes

* Make the picture smaller

* Added Intel® Iris® Xe MAX Graphics

* Changed the TIP about DL WB

* Added Note on the driver for Intel® Iris® Xe MAX Graphics

* Fixed formatting

* Added the link to Intel® software for general purpose GPU capabilities

* OVSA ovsa_get_started updates

* Fixed link
# Conflicts:
#	thirdparty/ade

* Cherry-pick #6450

* fix layout

* 4
# Conflicts:
#	thirdparty/ade

* Cherry-pick #6466

* Cherry-pick #6548

* install docs fixes

* changed video width

* CMake reference added

* fixed table

* added backtics and table formating

* new table changes

* GPU table changes

* added more backtics and changed table format

* gpu table changes

* Update get_started_dl_workbench.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
# Conflicts:
#	thirdparty/ade

* [Runtime] INT8 inference documentation update (#6419)

* [Runtime] INT8 inference documentation update

* [Runtime] INT8 inference documentation: typo was fixed

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Table of Contents was removed

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
# Conflicts:
#	docs/IE_DG/Int8Inference.md
#	thirdparty/ade

* Cherry-pick #6651

* Edits to MO

Per findings spreadsheet

* macOS changes

per issue spreadsheet

* Fixes from review spreadsheet

Mostly IE_DG fixes

* Consistency changes

* Make doc fixes from last round of review

* Add GSG build-all details

* Fix links to samples and demos pages

* Make MO_DG v2 changes

* Add image view step to classify demo

* Put MO dependency with others

* Edit docs per issues spreadsheet

* Add file to pytorch_specific

* More fixes per spreadsheet

* Prototype sample page

* Add build section

* Update README.md

* Batch download/convert by default

* Add detail to How It Works

* Minor change

* Temporary restored topics

* corrected layout

* Resized

* Added white background into the picture

* fixed link to omz_tools_downloader

* fixed title in the layout

Co-authored-by: baychub <cbay@yahoo.com>
Co-authored-by: baychub <31420038+baychub@users.noreply.github.com>
# Conflicts:
#	docs/doxygen/ie_docs.xml

* Cherry-pick  (#6789) [59449][DOCS] GPU table layout change

* changed argument display

* added br tag to more arguments

* changed argument display in GPU table

* changed more arguments

* changed Quantized_ models display
# Conflicts:
#	thirdparty/ade

* Sync doxygen-ignore

* Removed ref to FPGA.md

* Fixed link to ONNX format doc

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Edward Shogulin <edward.shogulin@intel.com>
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>
2021-09-07 19:21:41 +03:00
Irina Efode c0a3cebe0b [IE TESTS] Enable Opset8 in Conformance report (#7369) 2021-09-07 14:05:44 +03:00
Ilya Lavrenov 72fb7d207c Merge tools and inference_engine/tools folders (#7359)
* Merge tools folders

* Fixed docs

* Moved deployment_manager

* Fixed path to benchmark_tool docs

* python_tools -> python_tools_benchmark
2021-09-07 12:43:33 +03:00
Anastasiia Urlapova f890b12fd5 [XXX-55386] Change nets version to v10 (#7289)
* CVS-56144 Enable all OMZ scope

* [CVS-55368] Change nets version to v10

* [CVS-55386] Fix some coments

* [CVS-55386] Added float param to LSTM net

* Updated nets

* [CVS-55386] Change to ngraph way
2021-09-07 12:13:12 +03:00
Mateusz Tabaka 5d6ef444a5 Reenable AddFakeQuantizeFusion and MulFakeQuantizeFusion (#5574)
* Reenable AddFakeQuantizeFusion and MulFakeQuantizeFusion

* remove unused variable

* is_single_value simplify

* skip transformations for low precision types

* add comment regarding restriction in AddFakeQuantizeFusion

* remove fp16 test

* remove negative const handling
2021-09-07 11:14:25 +03:00
Evgeny Kotov 8985feff6f [GNA] Rewrite RemoveSingleInputConcatPass using ngraph (#7208)
* initial matcher pass

* write test implementation; + add unit tests

* base

* add unit tests

* code review fixes

* code review fixes

* fix

* fix

* move RemoveSingleInputConcat before opset to legacy conversion
2021-09-07 10:56:41 +03:00
Gabriele Galiero Casay 15bef9ec70 Remove deprecated mvn class for SLTs (#7340) 2021-09-06 13:32:05 +03:00
Anastasia PopovaandIlya Churaev d82fed9527 RandomUniform reference implementation. (#7012)
* Added RandomUniform reference implementation.

* Corrected comments.

* Small correction.

* Code style correction.

* Added has_evaluate() method.

* Added comments, added names to consts.

* Small fix.

* Replaced arrays with vectors.

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Code refactoring.

* Corrected tests, code style.

* Added comment.

* Added comments.

* Temporarily added debug output.

* Temporarily added debug output.

* Removed debug output.

* Added comment.

* Added comment.

* Enabled state saving for RandomUniform.

* Code style.

* Used to template to convert types.

* Added comments.

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2021-09-06 11:49:27 +03:00
Sergey Lyubimtsev 4978e8e6f8 Fix setup.py paths (#7345)
* fix paths & setup.py install

* fix linter issues

* remove extra spaces

* fix CI issues

* remove extra lines

* fix indent
2021-09-06 11:08:26 +03:00
bb84d11313 [IE Python Speech Sample] Add --scale_factor and --performance_counter options (#6663)
* Adds perf counters, and scale factor args

* Adding defined choices for arch type for -a/--arch option

* changing print to logger, frequencies are now global consts

* change to log info formatting

* Fix style issues

* doc: Update inference-engine/ie_bridges/python/sample/speech_sample/README.md

* doc: Update inference-engine/ie_bridges/python/sample/speech_sample/README.md

* doc: Update inference-engine/ie_bridges/python/sample/speech_sample/arg_parser.py

* doc: Update inference-engine/ie_bridges/python/sample/speech_sample/arg_parser.py

Co-authored-by: Koyanagi, Ken <ken.koyanagi@intel.com>
Co-authored-by: Kate Generalova <kate.generalova@intel.com>
2021-09-03 23:23:00 +03:00
Ilya Lavrenov 005e7da325 Removed auto plugin (#7310)
* Try to remove auto plugin

* Auto is registered as MULTI

* Register MultiDevicePlugin as AUTO

* More explicit config
2021-09-03 22:01:18 +03:00
Dmitry PigasinandKate Generalova 6fa6e48893 [IE Python Speech Sample] Enable -oname for a imported model (-rg option) (#7254)
* Enable `-oname` for a imported model

* Refactor `get_output_layer_list` func

* refactor: Update inference-engine/ie_bridges/python/sample/speech_sample/speech_sample.py

Co-authored-by: Kate Generalova <kate.generalova@intel.com>
2021-09-03 18:50:13 +03:00
Krzysztof Bruniecki 6dd14bfe91 [GNA] Fixes for GNA 3.0 library (#7236)
* Cherry-picked (PR #7180) (ce21344585) from releases/2021/4 branch
* Pass compileTarget to am_intel_dnn
* Enable tests for GNA lib version prefix 3.0
* Fix conv split transform for 2d cnn tests
* Apply review
2021-09-03 12:56:51 +03:00
Egor Duplensky bf8113c056 [CPU] Fix graph serialization, use ngraph serialization directly (#7261) 2021-09-03 11:05:20 +03:00
Michał Karzyński d748f2aa99 Remove references to prototxt from documentation and docstrings (#7346) 2021-09-03 08:32:43 +03:00
Dawid Kożykowski e0c178e431 Update SLT classes functions to use parameters passed by reference (#7256)
* update single layer tests

* add missing update to squeeze_unsqueeze
2021-09-03 07:28:21 +03:00
Ilya Churaev b78f228fa5 Moved op utils to ov namespace (#7274)
* Moved ngraph::Node to ov namespace

* Fixed code style

* Fixed VPU

* Fixed GNA

* Fixed tests

* Added aliases for backward compatibility

* Fix clDNN

* Try to fix build

* Fixed comment

* Renamed RTTI macros

* Moved op utils to ov namespace

* Fixed ngraph library build

* Fixed unit-tests

* Changed src folder

* Fixed recurrent_sequence

* Changed low latency

* Fixed serialize

* Fixed ieFuncTests

* Try to fix windows

* Remove custom operator<< from tests

* Fixed build
2021-09-03 00:58:26 +03:00
Ilya Lavrenov 46646059f8 Removed speech demo docs (#7350) 2021-09-02 23:14:56 +03:00
Kelvin Choi 30adf04d31 [GPU] Fuse reorder to convolution (#6396) 2021-09-02 20:02:16 +03:00
Mikhail Ryzhov 2cf7065f6e [GNA] Fixed import of model with several inputs (#7277) 2021-09-02 17:48:07 +03:00
Evgeny Kotov 6cbeb18b0e use 1D convolution (#7291) 2021-09-02 17:09:34 +03:00
Elizaveta Lobanova 98eaa9359f [GNA] Fixed accuracy degradation caused by the input quantization restriction (#7258)
* [GNA] Fixed accuracy degradation caused by the input quantization restriction

* [GNA] Put scale factor calculation into a separate function
2021-09-02 14:35:49 +03:00
Irina Efode fc92eea000 [IE TESTS] Remove verified refs highlighting from report (#7285)
* [IE TESTS] Remove verified refs from report

* Remove from header
2021-09-02 14:31:48 +03:00
Ilya Churaev 9eca6ba9d5 Move pass pattern to ov (#7255)
* Moved ngraph::Node to ov namespace

* Fixed code style

* Fixed VPU

* Fixed GNA

* Fixed tests

* Added aliases for backward compatibility

* Fix clDNN

* Try to fix build

* Fixed comment

* Renamed RTTI macros

* Add new headers

* Fixed ngraph build

* Fixed unit tests

* Try to fix Serialize
2021-09-02 10:03:04 +03:00
Ilya Lavrenov e07ac53300 Removed speech demo (#7298) 2021-09-01 18:41:15 +03:00
Ilya Churaev 2e626f502d Remove redundant header aftter PR #6969 (#7320) 2021-09-01 15:25:36 +03:00
Evgeny Lazarev 3775dad345 MO dynamic shapes support (#5918)
* Allow MO to generate IR with -1 in dimensions

* Some fixes to support -1 for StridedSlice operation

* Updated TensorArrayGatherV3 shape infer to support dynamic output shape

* Several fixes to support undefined dimensions in the Broadcast,Reshape,Slice and Tile

* Fixed bug in the normalization transformation of TF NMS to opset NMS

* Updated shape infer functions related to StridedSlice and NMS

* Updated Select shape inference function to use common shape broadcasting function supporting dynamism

* Fixed operation TFResize shape infer function to work correctly for case when model is converted with --disable_nhwc_to_nchw

* Dynamic Range and update asserts in NMS

* Changed the way how dynamic dimensions are specified. Refactored shape inference functions and common places to use new approach

* More fixes to support dynamic shapes

* More fixes for support of dynamic shapes

* Fixed generation of IR with dynamic dimensions

* Allow reading IRs with undefined dimensions

* More changes in the IE to support dynamic dimensions

* Fixes for Switch, Merge, Concat shape and value infer related to dynamism

* Fixed TensorArray related ops to properly handle dynamic dimensions. Fixed StridedSlice infer for case with new_axis

* Fixed shape_for_layout function to generate masked array

* Fixed shape inference for Convolution and Poolings to support dynamic spatial dimensions

* Updated shape infer functions for CTCGreedyDecotder, CTCLoss and Enter

* Fixed shape inference with dynamic dimensions for MatMul, Split, Upsample, SpaceToBatch, some fixes for the TI

* Fixes for undefined dimensions support for Proposal and DetectionOutput

* Fixed ExtractImagePatches, DepthToSpace and RegionYolo shape infer functions to work with partially dynamic dimensions

* Changes in tf_window_op_pad_infer to better work with dynamic dimensions

* Fixed output shape calculation for StridedSlice operation

* More StridedSlice fixes

* Fixed resolve_convolution_with_group

* Fixed unit tests

* Fixed unit tests

* Fixed Switch op unit tests

* Fixed shape inference for Upsample operation

* Updated unit tests for the Concat operation

* Fixed eltwise shape infer unit tests

* Fixed shape infer tests for Convolution and DetectionOutput ops

* Fixed Crop shape infer function tests

* Fixed Slice op unit test and minor fix in the shape inference. Fixed emitter

* Updated unit test for telemetry and match_shape function for dynamism

* Fixed unit test for the DetectionOutput

* Added support for the TF ClipByValue operation

* Fixed GatherND shape inference for dynamic shapes support

* Dynamic shapes support for the MO IR Reader

* Fixed BlockLSTM operation to not work as an extractor

* Allow to serialize IRs with partially defined shapes

* Updated SelectBroadcast transformation to not check shape values

* Fixed MO IR comparator

* Fixed SS value propagation when slices are dynamic

* Do not re-run graph clean-up for ProposalMutation

* Fixed InterpolateSequenceToInterpolate transformation to support dynamic dimensions

* Fixed Loop iteration count calculation and reading IteratorGetNext shapes

* Fixed unit test for serialization

* Fixed serialization test

* Fixed RandomUniform shape infer

* Fixed several transformations related to RNN to respect dynamic output shapes

* Fixed Deconvolutin shape calculation for dynamic batch. Eltwise shape infer improvements

* Fixed shape infer functions for ExperimentalDetectron ops, reverted changes for NonZero and removed debug prints

* Fixed check for dynamism of a list, fixed value propagation for Concat op and remove redundant shape infer for reshape

* Update Eltwise value propagation to use np.ma

* Fixed ExpandDims shape infer function

* Shape infer functions fixes and improvements

* Remove Accum op from the MO

* Updated activation functions shape infer

* Removed unsupported operation Correlation

* Fixed shape infers for several functions

* Removed unsupported DataAugmentation operation

* Fixed shape infer functions for several ops in extensions directory

* Removed not-support operation PowerFile

* Removed unsupported SpatialTransformer,SimplerNMS and PredictionHeatmap operations

* More shape infer functions updates

* Merge shape infer fix

* Fixed typo

* Fixed TensorArraySize shape infer function

* Fixed VariadicSplit and Squeeze shape infer

* Fixed ONNX models Parameter extractor

* Updated Select value propagation for the dynamic case

* Fixed ReorgYolo shape infer and test

* Removed unnecessary tests

* Fixed Tile shape infer

* Fixed SparseFillEmptryRows unit tests

* Fixed package bom

* Added extractor for the TF operation Mod

* Fixed value propagation for MatMul operation

* Updated Parameter extender to generate shape_array when shape is partially defined only

* Fixed BOM file

* Fixed issue with the TF OD API models and DetectionOutput op. Now the shape infer function for the DO do not re-infer "num_classes" attribute value if it is already known

* Fixed unit test for the DO infer

* Fixed num classes calculation for the DO generation for Faster/Mask-RCNN models

* Changed NMS op to produce static output shape

* Restore dynamic output shape calculation for the NMS for NMS-5

* Fixed CellNormalizer transformation. It should work for static shapes only

* RNNCell Op class fixes

* Revert some changes

* Updated documentation with a list of supported operations

* Revert changes

* Fixes for the ConstantFill op

* Removed redundant SequenceLengthToMask transformation

* TensorArray* ops shape infer code style and refactoring

* Reverse some unnecessary changes in the ConvolutionNormalizer

* Fixes and unit tests for shape_array, compare_shapes, is_fully_defined functions

* Implemented shape_insert, shape_delete functions and tests for them

* Modified code to use shape_delete function

* Added usage of shape_insert function where necessary

* Use shape_insert function in many places

* Some fixes in shape inference for various ops

* Updated shape_delete function to support negative indices

* Changes and unit tests for the MatMul infer function

* Removed strange code from the TF Merge infer function

* Merge op shape infer fixes

* Fixed value propagation in the transformation EltwiseInputReshape.py for the dynamic dimension case

* Code cleanup

* Updated GatherND to support dynamic dimensions

* Minor fixes

* Fixed shape_insert and shape_delete to support np.int64 and np.int32 types

* Updated Upsample operation unit tests with dynamic input shapes

* Minor change in the extensions/back/ConvolutionNormalizer.py to make sure that input dimensions are static

* Fixed ConvertGroupedStridedSlice transformation and added unit tests

* Revert debug changes

* Fixed value propagation for Unsqueeze to work with partially defined input values

* Typo fix

* Added unit tests for the Unsqueeze op shape infer

* broadcasting functions changes and unit tests

* Fixed Tile value inference for partially defined input tensor

* Unit tests for Split and VariadicSplit ops

* Fixes for the Concat infer + unit tests

* Removed redundant tf_pack shape infer

* Fixed Concat value infer and added unit tests

* Fixed StridedSlice shape inference for case with dynamic slices

* Fixes related to StridedSlice shape infer, changes in tests

* Unit tests for the eltwise shape and value infer

* Fixed Pad op value propagation to allow dynamic input values to be propagated

* Unit test for Pooling dynamic input shape infer

* Squeeze op unit tests for dynamic input shape

* Added assert to the Squeeze op shape infer for case when squeeze dimension is dynamic value

* Added message to the MO when input shapes are dynamic

* Convolution dynamic unit test

* Removed redundant transformation GroupedConvWeightsNormalize

* Removed non-ascii character from the message

* Fixed typo in the BOM file

* Code style and comment fixes

* Fixed copy-paste issue in the DO shape infer function

* Fixed setting dynamic shape in the MO command line

* Added function to compare tensor with dynamic values. Fixes in the unit tests and shape infer functions

* Improved Reshape shape infer + added unit tests

* Fixed value propagation for Select op

* Renamed several internal functions, minor code fixes.

* Code style fixes

* Modified condition in the _set_shape method of the Port class to not check shape if the "override_output_shape" attribute is specified

* Fixed constant value propagation for ReduceOps when inputs have dynamic values. Added unit test

* Fixed shape infer for the Loop for dynamic dimensions case

* Fix in the NMS shape infer to avoid ragged numpy array generation. Fixed Scatter shape infer validation

* Improved shapes infer for eltwise ops with respect to dynamic dimensions

* Changed code comments

* Renamed tensor names in the ClipByValueTFTransformation

* Changed np.ma.allequal to strict_compare_tensors in the Merge op infer

* Chanded np.ma.allequal with strict_compare_tensor.

* Fixed Merge op value infer

* Fixed debug code

* Removed commented line

* Updated condition to check for dynamic shapes in the Partial infer to not fail for MxNet models

* Improvements to the get_shape_from_slice and is_dynamic_slice functions

* Reverted change in the `normalize_slices_attr` for ellipsis mask case

* Updated shape conditions in the ScatterNDBase op to support dynamic dimensions

* Crop op file refactoring

* Set "type" attribute to None for SparseFillEmptyRows op which is not from any opset

* Removed unnecessary extractor test

* Restored Crop operation type

* Removed "type" attribute from the Crop operation and updated the MO code to find Crop by "op" attribute

* Fixed If shape infer function to produce dynamic dimensions

* Updated If shape and value infer to properly work when condition is static

* Fixed fusing transformation check to work with dynamic dimensions. Change comparison in the shape_inference function to not use strict shapes comparison

* Optimize imports in the LayerNorm

* ConvertGroupedStridedSlice minor fixes related to dynamism support

* Fixed ConvertGroupedStridedSlice to properly check if the dimension is sliced
2021-09-01 14:35:06 +03:00
Dawid Kożykowski 3081fac758 Unify SLTs classes of Convert and ConvertLike operations (#7129)
* update comparisiofiles to use const ref param

* introduce conversion layer test definitions

* adapt old tests to the new format

* remove old duplicated conversion tests

* fix "convertion" typo to "conversion"

* fix style issues and abandon unnecessary changes

* fix include order

* update remaining conversion tests to use introduced class

* fix gpu class test naming

* bring back convert.hpp and convert_like.hpp files

* bring back convert.hppcppd convert_like.cpp files

* bring back single_layer_tests/convert.hpp file

* add missing copyright info

* fix issue with braces initiator for conversion types

* add missing convert_like tests

* add deprecated code macros

* update deprecated code macro message

* add missing space in deprecated code macro message

* update skip ConvertLike tests ticket

* update deprecated code to  use IE macros

* update remaining ngraph_deprecated macros to use IE macros
2021-09-01 14:19:38 +03:00
Evgenya Stepyreva 8550579b60 Signature dumping while reshaping (#7316) 2021-09-01 12:50:18 +03:00
Gabriele Galiero Casay 70e6565619 Refactor backend test suite of Reduction ops into template plugin tests (#6930)
* Refactor visitor test of reduce operations to include operation name

* Add template plugin tests for reduction operations

* Remove backent unit tests of reduction operations

* Use Tensor utility to instantiate tests

* Use std::for_each instead of raw for loop to produce test case instances

* Cover remaining backend tests in manifest by SLTs cases

* Fix regex to skip cpu test failing in centos build with precision u64
2021-09-01 11:22:46 +03:00
bfae017cf2 Dynamic plugin reshape blob (#6969)
* Added nGraph as a public dependency

* Fixed Windows warning

* Fixed CMake

* Fixed constant op

* Fixed typo

* Added reshape to PartialShape to CNNNetwork

* Added SetShape to InferRequest

* Enable support of DynamicShape in IE Data

* Add support of dynamic shapes to template plugin

* Fixed build

* Enable support dynamic rank

* Fixed test for dynamic rank

* Fixed some tests

* Fix preprocess tests

* Fixed SetBlob

* Fixed code style

* Add more tests

* Fixed accuracy tests

* Fixed documentation

* Added tests for custom operation

* Added new tests

* WIP: move setShape from infer request to Blob

* Returned isApplicable check back

* Removed obsolete tests for InferRequest::SetShape and add new test for Blob::setShape (a trivial one)

* Fixed artifacts

* Break code style

* Revert "Break code style"

This reverts commit 71ee638cd0.

* Added -j8 for fix_all

* Applied code style fixes

* Adde doxygen items

* Fixed style

* Applied codestyle patch

* Reverted unrelevant commit with template extension

* Fixed cmake file for shared func tests (pick from master)

* Revert all changes in template_extension

* Deleted some old stuff that commented and won't be used

* Fixed wrong exception throwing

* Code style fix

* Fixed preprocessing part

* Fixed incorrect blob reshape in GetBlob

* Deleted incorrect assert in GAPI that prevents passing some tests in Debug

* Fixed issues identified during review

* Removed SetShape, replace getLayoutByDims by getLayoutByRank and removed problematic modification from IE preprocessing

* Fixed comments

* Removed obsolete setShape

* [VPU] Fixed allocating dynamic blobs in myriad_infer_request

* Fixed comments

* Fixed CNNNgraphImpl and comments

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Polina <polina.brzezinskaya@intel.com>
2021-09-01 10:59:42 +03:00
Edward Shogulin b7deb11d6a [LPT] Legacy restrictions removal: dequantization operations (#6974)
* [LPT] Legacy restrictions removal: dequantization operations

* [LPT] not used tests removal
2021-09-01 09:59:29 +03:00
Vladimir Paramuzov 781c1aecff Revert "[GPU] Fixed default device id (#7155)" (#7308)
This reverts commit b235f5e452.
2021-08-31 18:45:56 +03:00
Vladislav Golubev 82442c8324 [LPT] SubMulToMulAdd transformation: naming fix (#7195)
* [LPT] SubMulToMulAddTransformation: naming fix

* [LPT] Refactoring and legacy code removed

* [TESTS] SubMulToMulAdd: added check on unique friendly names
2021-08-31 13:50:54 +03:00
Evgeny Kotov 1eea4a5e0b Unroll Tensor Iterator using ngraph pass (#7205)
* use ngraph-based unroll-ti as default

* use isNgraphPassesUsed for legacy code

* code review fixes

* code review fixes
2021-08-31 11:03:11 +03:00
Vladimir Paramuzov b235f5e452 [GPU] Fixed default device id (#7155) 2021-08-30 18:47:57 +03:00