Commit Graph

604 Commits

Author SHA1 Message Date
Ilya Churaev
55fb542bc6 Added OpenVINO util library (#7481)
* Added OpenVINO util library

* Fixed code style

* Fixed build

* Fixed build

* Added methods from IE utils

* Fixed style

* Fixed Windows build

* Fixed linux build

* Fixed windows build

* Try to fix dladdr

* Try to fix windows

* Fixed typo

* Fixed detection dynamic libs from static library

* Revert some changes

* Revert changes in windows loader

* Revert network reader

* Removed some methods from plugin API

* Fixed fluid tests

* Fixed typo

* Fixed include

* Try to fix CI

* Try to fix centos

* fix typo
2021-09-20 18:37:32 +03:00
Ilya Churaev
850c526e3b Moved graph validation utils to ov (#7529) 2021-09-20 10:40:14 +03:00
Ilya Churaev
d2333cc012 Introduced template for OV2.0 migration guide (#7360)
* Introduced template for OV2.0 migration guide

* Fixed comments

* Fixed comments
2021-09-17 03:53:39 +03:00
David Nam
790ecd54c8 Add atan to template plugin test (#7509)
* Add atan to template plugin reference test

* Remove atan.in.cpp from backend test

* Remove boolean type from atan evaluation
2021-09-16 09:33:27 +03:00
Ilya Lavrenov
0df7dab345 New IRC package structure (#6255)
* OV new package structure

* Fixes

* More fixes

* Fixed code style in ngraph tests

* Fixes

* Paths to setupvars inside demo scripts

* Fixed demo_security_barrier_camera.sh

* Added setupvars.sh to old location as well

* Fixed path

* Fixed MO install path in .co

* Fixed install of public headers

* Fixed frontends installation

* Updated DM config files

* Keep opencv in the root

* Improvements

* Fixes for demo scripts

* Added path to TBB

* Fix for MO unit-tests

* Fixed tests on Windows

* Reverted arch

* Removed arch

* Reverted arch back: second attemp

* System type

* Fix for Windows

* Resolve merge conflicts

* Fixed path

* Path for Windows

* Added debug for Windows

* Added requirements_dev.txt to install

* Fixed wheel's setup.py

* Fixed lin build

* Fixes after merge

* Fix 2

* Fixes

* Frontends path

* Fixed deployment manager

* Fixed Windows

* Added cldnn unit tests installation

* Install samples

* Fix samples

* Fix path for samples

* Proper path

* Try to fix MO hardcodes

* samples binary location

* MO print

* Added install for libopencv_c_wrapper.so

* Added library destination

* Fixed install rule for samples

* Updated demo scripts readme.md

* Samples

* Keep source permissions for Python samples

* Fixed python

* Updated path to fast run scripts

* Fixed C samples tests

* Removed debug output

* Small fixes

* Try to unify prefix
2021-09-15 16:49:11 +03:00
Dmitry Pigasin
715769a31b Remove demo_security_barrier_camera and update relevant docs (#7494)
* Remove demo_security_barrier_camera

* rename demo to samples, update python version

* update get_started docs

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>
2021-09-15 11:02:38 +03:00
Anastasia Popova
bfc6e617a7 Updated RandomUniform spec to align with the implementation. (#7491) 2021-09-15 10:26:39 +03:00
Egor Shulman
bdaa44d0be Fixed Minimum op if u8/16/32/64 data type is used (#6665) 2021-09-15 07:52:46 +03:00
Anastasia Popova
cf48792134 Random Uniform MO implementation (#6694)
* Added RandomUniform operation.

* Conflicts fix.

* Fix conflicts.

* Fix conflicts.

* Added ONNX extractor, fixed FP16 conversion, added double implementation.

* int32, int64 types.

* Added initial type attribute.

* Added extractors for MxNet and TF for RandomUniformInt.

* Fixed ChangeRandomUniformOutputType transformation.

* Corrected ONNX, MxNetextractors.

* Fixed extender.

* Code style corrected, updated BOM file.

* Small correction.

* Code reformat.

* Fixed type check.

* Small corrections, code style.

* Added RandomUniform tests to manifest file.

* Include fixed.

* Code style.

* Small corrections.

* Tests fixed.

* Manifest file updated.

* Removed initial type attribute.

* Small correction.

* Fixed problem with Const types change.

* Update ngraph/core/include/ngraph/op/random_uniform.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update ngraph/core/src/op/random_uniform.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update ngraph/core/src/op/random_uniform.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Applied comments to shell implementation.

* Applied comments to shell implementation.

* Moved shell and reference to separate PR.

* Moved shell and reference to separate PR.

* Corrected comments, code refactoring.

* Fixed seed attributes.

* Corrected mxnet extractor.

* Returned RandomUniform onnx extractor.

* Small fix.

* Used generator in tests, fixed input ports count in AttributedRandomUniform.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Moved DropoutWithRandomUniformReplacer to ngraph, removed debug output.

* Fixed wrong change.

* Fixed wrong change.

* Added check that RandomUniform is in ShapeOf subgraph.

* Added layer tests, updated supported operations list.

* Small correction.

* Fix conflicts.

* Fix conflicts.

* Small fix.

* Used const for not changing values.

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Added IR check in layer tests.

* Fixed error.

* Fixed test.

* Update inference-engine/src/transformations/include/transformations/common_optimizations/dropout_with_random_uniform_replacer.hpp

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Removed ShapeOf and Mul from DropoutWithRandomUniformReplacer.

* Replaced register_new_node with make_shared.

* Added fp16 test.

* Extended for RandomUniform->Convert case.

* Used modf().

* Removed modf().

* Update inference-engine/src/transformations/src/transformations/common_optimizations/dropout_with_random_uniform_replacer.cpp

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Added negative tests, added nullptr check for add_const_value.

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
2021-09-14 21:26:57 +03:00
Ilya Lavrenov
b373cb844b Removed information about FPGA plugin (#7474) 2021-09-13 14:01:49 +03:00
Irina Efode
b3d6d11a99 [IE TESTS] Move SKIP macro from test bodies to SetUp() in InferRequestCancelation & Move Infer_Request_dynamic tests to the correct folder (#7299)
* try to fix behavior

* Try

* Revert changes

* Update behavior_test_utils.hpp

* Move Deynamic_tests

* fix build

* fix

* Init
2021-09-13 10:09:36 +03:00
Szymon Durawa
c50c0d59bb Add default constructor for op. (#7368)
* Add default constructor for op.

* Apply correct format.

* Apply correct format for py files.

* Remove underscore prefix, add create overlaod method.

* Resolve use cases for parameter arguments in create fucntion.

* Resolve myoy issue.

* Remove underscore for getter and setter functions.

* Restore check when arguments is None.

* Add tests covering raising errors and get_attributes() function.
2021-09-13 06:49:19 +03:00
Bartek Szmelczynski
66bad412a4 udpate scatter spec (#7086)
* udpate scatter spec

* add info about udpates tensor rank

* update updates type

* add values to example, minor style change

* udpate spec style

* add spaces for the better formatting

* Update docs/ops/movement/ScatterUpdate_3.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/ops/movement/ScatterUpdate_3.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/ops/movement/ScatterUpdate_3.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/ops/movement/ScatterUpdate_3.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/ops/movement/ScatterUpdate_3.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2021-09-13 06:44:20 +03:00
Ilya Lavrenov
a952540edf Openvino cmake config (#7419)
* Added OpenVINOConfig.cmake

* OpenVINOConfig.cmake part 2

* Trying to fix cmake generation

* Fixes

* Export frontends as well

* Fixed condition

* Added OpenVINO cmake package usage: docs, C samples

* Use more OpenVINO config

* Install OpenVINOConfig.cmake

* Trying to fix private plugins

* Trying to fix .tox

* Trying to fix ARM

* Fixed samples build

* Explicit ngraph duplicated targets

* Fixed fuzzing tests build

* Added IR frontend installation

* Removed install directory for IE reader

* Removed IR frontend from export list

* Reverted ngraph_DIR

* Try to fix .tox

* Fixed ieFuncTests with ONNX extensions

* Attempt #2

* Trying to fix ngraph setup.py

* Fix

* Trying to fix ONNX ngraph .tox CI

* Trying to remove spaces

* Fixed ngraph_DIR -> OpenVINO_DIR

* Removed junk files

* Try to fix ngraph wheel

* Try to fix ie_wheel

* Try to fix ngraph wheel
2021-09-10 15:31:27 +03:00
Gabriele Galiero Casay
deeb96440f Revise GatherTree reference implementation (#7275)
* Add visitor api test

* Review ngraph op shell with type_prop tests

* Add op to list of trusted operations

* Change name of struct with information of inputs

* Add include of array data structure to fix windowds compilation error

* Add template plugin test class

* Remove usage of CoordinateTransform index function call from reference implementation

* Rename SLT test suite

* Add template plugin unit test

* Add serialization SLTs

* Add indentation on GatherTreeParams class data members
2021-09-10 14:02:49 +03:00
Ilya Lavrenov
171f6a62d5 Removed FPGA related deprecated documentation (#7348) 2021-09-10 13:03:00 +03:00
Gabriele Galiero Casay
c862abae03 GatherTree specification refactored (#7326)
* GatherTree specification refactored

* Fix typos
2021-09-10 06:31:35 +03:00
Nikita Semaev
3c22b2af95 Revise NotEqual (#7198)
* Hiding the problem, Validate() changes 'function'

* Template plugin tests

* Undo the changes that are not necessary

* Align code style

* Added \n at end of file

* Removing an unused implementation

* New version with Code Style checking

* Cleaning backend tests

* Reworked the tests the right way

* Removed visit_attributes()

* Removed visit_attributes() in source file

* Added NGRAPH_CHECK macros to evaluate()

* Removed zero_sized_not_equal mention from unit_test.manifest

* Added function name to the constants.py

* Revert "Added function name to the constants.py"

This reverts commit 5b7478056f.

* Return visit_attributes() for op::v1::NotEqual due to NotEqual being moved to another location
2021-09-08 11:30:40 +03:00
Maksim Kutakov
5096fe19f1 [CPU] Dynamic shapes support using fallback on reference (#6882) 2021-09-08 10:33:20 +03:00
Evgeny Lazarev
4547818fb1 Move TF OD API docs to code + several fixes for TF OD API models conversion (#7377)
* Refactored code, updated comments and documentation related to TF OD API models pre-processing.

* Improved MO messages related to pre-processor block removal during conversion of the TD OD API models. Remove mean/scale if padding is used and mean/scale is applied before resize

* Updated TF OD API transformation and documentation for SSD models

* Updated comments and documentation for the ObjectDetectionAPIMaskRCNNSigmoidReplacement transformation

* Updated comments and documentation for the ObjectDetectionAPIMaskRCNNROIPoolingSecondReplacement transformation

* Updated comments and documentation for the ObjectDetectionAPIPSROIPoolingReplacement transformation

* Updated comments and documentation for the ObjectDetectionAPIProposalReplacement transformation

* Updated comments and documentation for the ObjectDetectionAPIDetectionOutputReplacement transformation

* Minor code style fixes

* Fixed unit tests for ObjectDetectionAPIPreprocessor2Replacement transformation

* Improved unit test for pipeline.config parser. Fixed very long bug with incorrect test data for the PipelineConfig parser class

* Code style fixes

* Get rid of "coordinates_swap_method" parameter in the JSON configuration file for TF OD API models

* Code style fixes and minor refactoring

* Simplied code related to swapping Proposal coordinates

* Removed incorrectly removed code

* Fixed code review comments about the code comments
2021-09-08 10:03:01 +03:00
Andrey Zaytsev
322c874113 Feature/azaytsev/cherry picks from 2021 4 (#7389)
* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Updated the link to software license agreements

* Revert "Updated the link to software license agreements"

This reverts commit 706dac500e.

* Updated legal info (#6409)

# Conflicts:
#	thirdparty/ade

* Cherry-pick 4833c8db72

[DOCS]Changed DL WB related docs and tips (#6318)

* changed DL WB related docs and tips

* added two tips to benchmark and changed layout

* changed layout

* changed links

* page title added

* changed tips

* ie layout fixed

* updated diagram and hints

* changed tooltip and ref link

* changet tooltip link

* changed DL WB description

* typo fix
# Conflicts:
#	docs/doxygen/ie_docs.xml
#	thirdparty/ade

* Cherry-pick 6405

Feature/azaytsev/mo devguide changes (#6405)

* MO devguide edits

* MO devguide edits

* MO devguide edits

* MO devguide edits

* MO devguide edits

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Experimenting with videos

* Additional edits

* Additional edits

* Updated the workflow diagram

* Minor fix

* Experimenting with videos

* Updated the workflow diagram

* Removed  Prepare_Trained_Model, changed the title for Config_Model_Optimizer

* Rolled back

* Revert "Rolled back"

This reverts commit 6a4a3e1765.

* Revert "Removed  Prepare_Trained_Model, changed the title for Config_Model_Optimizer"

This reverts commit 0810bd534f.

* Fixed ie_docs.xml, Removed  Prepare_Trained_Model, changed the title for Config_Model_Optimizer

* Fixed ie_docs.xml

* Minor fix

* <details> tag issue

* <details> tag issue

* Fix <details> tag issue

* Fix <details> tag issue

* Fix <details> tag issue
# Conflicts:
#	thirdparty/ade

* Cherry-pick #6419

* [Runtime] INT8 inference documentation update

* [Runtime] INT8 inference documentation: typo was fixed

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Table of Contents was removed

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
# Conflicts:
#	docs/IE_DG/Int8Inference.md
#	thirdparty/ade

* Cherry pick (#6437)

* Q2 changes

* Changed Convert_RNNT.md

Co-authored-by: baychub <cbay@yahoo.com>
# Conflicts:
#	docs/IE_DG/Int8Inference.md
#	docs/install_guides/installing-openvino-conda.md
#	docs/install_guides/pypi-openvino-dev.md
#	thirdparty/ade

* Cherry-pick (#6447)

* Added benchmark page changes

* Make the picture smaller

* Added Intel® Iris® Xe MAX Graphics

* Changed the TIP about DL WB

* Added Note on the driver for Intel® Iris® Xe MAX Graphics

* Fixed formatting

* Added the link to Intel® software for general purpose GPU capabilities

* OVSA ovsa_get_started updates

* Fixed link
# Conflicts:
#	thirdparty/ade

* Cherry-pick #6450

* fix layout

* 4
# Conflicts:
#	thirdparty/ade

* Cherry-pick #6466

* Cherry-pick #6548

* install docs fixes

* changed video width

* CMake reference added

* fixed table

* added backtics and table formating

* new table changes

* GPU table changes

* added more backtics and changed table format

* gpu table changes

* Update get_started_dl_workbench.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
# Conflicts:
#	thirdparty/ade

* [Runtime] INT8 inference documentation update (#6419)

* [Runtime] INT8 inference documentation update

* [Runtime] INT8 inference documentation: typo was fixed

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Table of Contents was removed

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
# Conflicts:
#	docs/IE_DG/Int8Inference.md
#	thirdparty/ade

* Cherry-pick #6651

* Edits to MO

Per findings spreadsheet

* macOS changes

per issue spreadsheet

* Fixes from review spreadsheet

Mostly IE_DG fixes

* Consistency changes

* Make doc fixes from last round of review

* Add GSG build-all details

* Fix links to samples and demos pages

* Make MO_DG v2 changes

* Add image view step to classify demo

* Put MO dependency with others

* Edit docs per issues spreadsheet

* Add file to pytorch_specific

* More fixes per spreadsheet

* Prototype sample page

* Add build section

* Update README.md

* Batch download/convert by default

* Add detail to How It Works

* Minor change

* Temporary restored topics

* corrected layout

* Resized

* Added white background into the picture

* fixed link to omz_tools_downloader

* fixed title in the layout

Co-authored-by: baychub <cbay@yahoo.com>
Co-authored-by: baychub <31420038+baychub@users.noreply.github.com>
# Conflicts:
#	docs/doxygen/ie_docs.xml

* Cherry-pick  (#6789) [59449][DOCS] GPU table layout change

* changed argument display

* added br tag to more arguments

* changed argument display in GPU table

* changed more arguments

* changed Quantized_ models display
# Conflicts:
#	thirdparty/ade

* Sync doxygen-ignore

* Removed ref to FPGA.md

* Fixed link to ONNX format doc

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Edward Shogulin <edward.shogulin@intel.com>
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>
2021-09-07 19:21:41 +03:00
Ilya Lavrenov
72fb7d207c Merge tools and inference_engine/tools folders (#7359)
* Merge tools folders

* Fixed docs

* Moved deployment_manager

* Fixed path to benchmark_tool docs

* python_tools -> python_tools_benchmark
2021-09-07 12:43:33 +03:00
Katarzyna Mitrus
5f1ffc527d Propose new Slice-8 operation - update (#7257)
* Propose new Slice-8 operation

(cherry picked from commit a44ed32a6f)

* Align category

* Update detailed descripiton

* Update Inputs/Outputs description

* Add no attributes info

* Precise range of axis values

* Update descriptions

* More details about negative steps and slicing backwards

* Add more details

* Add examples

* Change step input to Required

* Apply spell check comments

* Add missing commas

* Add separate T_AXIS type for axis input

* Make example data 2D

* Remove duplicated example

* Apply review suggestions

Co-authored-by: Michal Karzynski <michal.karzynski@intel.com>
2021-09-06 13:47:23 +03:00
Anastasia Popova
d82fed9527 RandomUniform reference implementation. (#7012)
* Added RandomUniform reference implementation.

* Corrected comments.

* Small correction.

* Code style correction.

* Added has_evaluate() method.

* Added comments, added names to consts.

* Small fix.

* Replaced arrays with vectors.

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Code refactoring.

* Corrected tests, code style.

* Added comment.

* Added comments.

* Temporarily added debug output.

* Temporarily added debug output.

* Removed debug output.

* Added comment.

* Added comment.

* Enabled state saving for RandomUniform.

* Code style.

* Used to template to convert types.

* Added comments.

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2021-09-06 11:49:27 +03:00
Michał Karzyński
d748f2aa99 Remove references to prototxt from documentation and docstrings (#7346) 2021-09-03 08:32:43 +03:00
Ilya Lavrenov
46646059f8 Removed speech demo docs (#7350) 2021-09-02 23:14:56 +03:00
Tomasz Dołbniak
28075fb7fc MaxPool 8 reference implementation (#7115) 2021-09-01 19:14:45 +03:00
Evgeny Lazarev
3775dad345 MO dynamic shapes support (#5918)
* Allow MO to generate IR with -1 in dimensions

* Some fixes to support -1 for StridedSlice operation

* Updated TensorArrayGatherV3 shape infer to support dynamic output shape

* Several fixes to support undefined dimensions in the Broadcast,Reshape,Slice and Tile

* Fixed bug in the normalization transformation of TF NMS to opset NMS

* Updated shape infer functions related to StridedSlice and NMS

* Updated Select shape inference function to use common shape broadcasting function supporting dynamism

* Fixed operation TFResize shape infer function to work correctly for case when model is converted with --disable_nhwc_to_nchw

* Dynamic Range and update asserts in NMS

* Changed the way how dynamic dimensions are specified. Refactored shape inference functions and common places to use new approach

* More fixes to support dynamic shapes

* More fixes for support of dynamic shapes

* Fixed generation of IR with dynamic dimensions

* Allow reading IRs with undefined dimensions

* More changes in the IE to support dynamic dimensions

* Fixes for Switch, Merge, Concat shape and value infer related to dynamism

* Fixed TensorArray related ops to properly handle dynamic dimensions. Fixed StridedSlice infer for case with new_axis

* Fixed shape_for_layout function to generate masked array

* Fixed shape inference for Convolution and Poolings to support dynamic spatial dimensions

* Updated shape infer functions for CTCGreedyDecotder, CTCLoss and Enter

* Fixed shape inference with dynamic dimensions for MatMul, Split, Upsample, SpaceToBatch, some fixes for the TI

* Fixes for undefined dimensions support for Proposal and DetectionOutput

* Fixed ExtractImagePatches, DepthToSpace and RegionYolo shape infer functions to work with partially dynamic dimensions

* Changes in tf_window_op_pad_infer to better work with dynamic dimensions

* Fixed output shape calculation for StridedSlice operation

* More StridedSlice fixes

* Fixed resolve_convolution_with_group

* Fixed unit tests

* Fixed unit tests

* Fixed Switch op unit tests

* Fixed shape inference for Upsample operation

* Updated unit tests for the Concat operation

* Fixed eltwise shape infer unit tests

* Fixed shape infer tests for Convolution and DetectionOutput ops

* Fixed Crop shape infer function tests

* Fixed Slice op unit test and minor fix in the shape inference. Fixed emitter

* Updated unit test for telemetry and match_shape function for dynamism

* Fixed unit test for the DetectionOutput

* Added support for the TF ClipByValue operation

* Fixed GatherND shape inference for dynamic shapes support

* Dynamic shapes support for the MO IR Reader

* Fixed BlockLSTM operation to not work as an extractor

* Allow to serialize IRs with partially defined shapes

* Updated SelectBroadcast transformation to not check shape values

* Fixed MO IR comparator

* Fixed SS value propagation when slices are dynamic

* Do not re-run graph clean-up for ProposalMutation

* Fixed InterpolateSequenceToInterpolate transformation to support dynamic dimensions

* Fixed Loop iteration count calculation and reading IteratorGetNext shapes

* Fixed unit test for serialization

* Fixed serialization test

* Fixed RandomUniform shape infer

* Fixed several transformations related to RNN to respect dynamic output shapes

* Fixed Deconvolutin shape calculation for dynamic batch. Eltwise shape infer improvements

* Fixed shape infer functions for ExperimentalDetectron ops, reverted changes for NonZero and removed debug prints

* Fixed check for dynamism of a list, fixed value propagation for Concat op and remove redundant shape infer for reshape

* Update Eltwise value propagation to use np.ma

* Fixed ExpandDims shape infer function

* Shape infer functions fixes and improvements

* Remove Accum op from the MO

* Updated activation functions shape infer

* Removed unsupported operation Correlation

* Fixed shape infers for several functions

* Removed unsupported DataAugmentation operation

* Fixed shape infer functions for several ops in extensions directory

* Removed not-support operation PowerFile

* Removed unsupported SpatialTransformer,SimplerNMS and PredictionHeatmap operations

* More shape infer functions updates

* Merge shape infer fix

* Fixed typo

* Fixed TensorArraySize shape infer function

* Fixed VariadicSplit and Squeeze shape infer

* Fixed ONNX models Parameter extractor

* Updated Select value propagation for the dynamic case

* Fixed ReorgYolo shape infer and test

* Removed unnecessary tests

* Fixed Tile shape infer

* Fixed SparseFillEmptryRows unit tests

* Fixed package bom

* Added extractor for the TF operation Mod

* Fixed value propagation for MatMul operation

* Updated Parameter extender to generate shape_array when shape is partially defined only

* Fixed BOM file

* Fixed issue with the TF OD API models and DetectionOutput op. Now the shape infer function for the DO do not re-infer "num_classes" attribute value if it is already known

* Fixed unit test for the DO infer

* Fixed num classes calculation for the DO generation for Faster/Mask-RCNN models

* Changed NMS op to produce static output shape

* Restore dynamic output shape calculation for the NMS for NMS-5

* Fixed CellNormalizer transformation. It should work for static shapes only

* RNNCell Op class fixes

* Revert some changes

* Updated documentation with a list of supported operations

* Revert changes

* Fixes for the ConstantFill op

* Removed redundant SequenceLengthToMask transformation

* TensorArray* ops shape infer code style and refactoring

* Reverse some unnecessary changes in the ConvolutionNormalizer

* Fixes and unit tests for shape_array, compare_shapes, is_fully_defined functions

* Implemented shape_insert, shape_delete functions and tests for them

* Modified code to use shape_delete function

* Added usage of shape_insert function where necessary

* Use shape_insert function in many places

* Some fixes in shape inference for various ops

* Updated shape_delete function to support negative indices

* Changes and unit tests for the MatMul infer function

* Removed strange code from the TF Merge infer function

* Merge op shape infer fixes

* Fixed value propagation in the transformation EltwiseInputReshape.py for the dynamic dimension case

* Code cleanup

* Updated GatherND to support dynamic dimensions

* Minor fixes

* Fixed shape_insert and shape_delete to support np.int64 and np.int32 types

* Updated Upsample operation unit tests with dynamic input shapes

* Minor change in the extensions/back/ConvolutionNormalizer.py to make sure that input dimensions are static

* Fixed ConvertGroupedStridedSlice transformation and added unit tests

* Revert debug changes

* Fixed value propagation for Unsqueeze to work with partially defined input values

* Typo fix

* Added unit tests for the Unsqueeze op shape infer

* broadcasting functions changes and unit tests

* Fixed Tile value inference for partially defined input tensor

* Unit tests for Split and VariadicSplit ops

* Fixes for the Concat infer + unit tests

* Removed redundant tf_pack shape infer

* Fixed Concat value infer and added unit tests

* Fixed StridedSlice shape inference for case with dynamic slices

* Fixes related to StridedSlice shape infer, changes in tests

* Unit tests for the eltwise shape and value infer

* Fixed Pad op value propagation to allow dynamic input values to be propagated

* Unit test for Pooling dynamic input shape infer

* Squeeze op unit tests for dynamic input shape

* Added assert to the Squeeze op shape infer for case when squeeze dimension is dynamic value

* Added message to the MO when input shapes are dynamic

* Convolution dynamic unit test

* Removed redundant transformation GroupedConvWeightsNormalize

* Removed non-ascii character from the message

* Fixed typo in the BOM file

* Code style and comment fixes

* Fixed copy-paste issue in the DO shape infer function

* Fixed setting dynamic shape in the MO command line

* Added function to compare tensor with dynamic values. Fixes in the unit tests and shape infer functions

* Improved Reshape shape infer + added unit tests

* Fixed value propagation for Select op

* Renamed several internal functions, minor code fixes.

* Code style fixes

* Modified condition in the _set_shape method of the Port class to not check shape if the "override_output_shape" attribute is specified

* Fixed constant value propagation for ReduceOps when inputs have dynamic values. Added unit test

* Fixed shape infer for the Loop for dynamic dimensions case

* Fix in the NMS shape infer to avoid ragged numpy array generation. Fixed Scatter shape infer validation

* Improved shapes infer for eltwise ops with respect to dynamic dimensions

* Changed code comments

* Renamed tensor names in the ClipByValueTFTransformation

* Changed np.ma.allequal to strict_compare_tensors in the Merge op infer

* Chanded np.ma.allequal with strict_compare_tensor.

* Fixed Merge op value infer

* Fixed debug code

* Removed commented line

* Updated condition to check for dynamic shapes in the Partial infer to not fail for MxNet models

* Improvements to the get_shape_from_slice and is_dynamic_slice functions

* Reverted change in the `normalize_slices_attr` for ellipsis mask case

* Updated shape conditions in the ScatterNDBase op to support dynamic dimensions

* Crop op file refactoring

* Set "type" attribute to None for SparseFillEmptyRows op which is not from any opset

* Removed unnecessary extractor test

* Restored Crop operation type

* Removed "type" attribute from the Crop operation and updated the MO code to find Crop by "op" attribute

* Fixed If shape infer function to produce dynamic dimensions

* Updated If shape and value infer to properly work when condition is static

* Fixed fusing transformation check to work with dynamic dimensions. Change comparison in the shape_inference function to not use strict shapes comparison

* Optimize imports in the LayerNorm

* ConvertGroupedStridedSlice minor fixes related to dynamism support

* Fixed ConvertGroupedStridedSlice to properly check if the dimension is sliced
2021-09-01 14:35:06 +03:00
Dawid Kożykowski
3081fac758 Unify SLTs classes of Convert and ConvertLike operations (#7129)
* update comparisiofiles to use const ref param

* introduce conversion layer test definitions

* adapt old tests to the new format

* remove old duplicated conversion tests

* fix "convertion" typo to "conversion"

* fix style issues and abandon unnecessary changes

* fix include order

* update remaining conversion tests to use introduced class

* fix gpu class test naming

* bring back convert.hpp and convert_like.hpp files

* bring back convert.hppcppd convert_like.cpp files

* bring back single_layer_tests/convert.hpp file

* add missing copyright info

* fix issue with braces initiator for conversion types

* add missing convert_like tests

* add deprecated code macros

* update deprecated code macro message

* add missing space in deprecated code macro message

* update skip ConvertLike tests ticket

* update deprecated code to  use IE macros

* update remaining ngraph_deprecated macros to use IE macros
2021-09-01 14:19:38 +03:00
Gabriele Galiero Casay
70e6565619 Refactor backend test suite of Reduction ops into template plugin tests (#6930)
* Refactor visitor test of reduce operations to include operation name

* Add template plugin tests for reduction operations

* Remove backent unit tests of reduction operations

* Use Tensor utility to instantiate tests

* Use std::for_each instead of raw for loop to produce test case instances

* Cover remaining backend tests in manifest by SLTs cases

* Fix regex to skip cpu test failing in centos build with precision u64
2021-09-01 11:22:46 +03:00
Sergey Lyalin
bfae017cf2 Dynamic plugin reshape blob (#6969)
* Added nGraph as a public dependency

* Fixed Windows warning

* Fixed CMake

* Fixed constant op

* Fixed typo

* Added reshape to PartialShape to CNNNetwork

* Added SetShape to InferRequest

* Enable support of DynamicShape in IE Data

* Add support of dynamic shapes to template plugin

* Fixed build

* Enable support dynamic rank

* Fixed test for dynamic rank

* Fixed some tests

* Fix preprocess tests

* Fixed SetBlob

* Fixed code style

* Add more tests

* Fixed accuracy tests

* Fixed documentation

* Added tests for custom operation

* Added new tests

* WIP: move setShape from infer request to Blob

* Returned isApplicable check back

* Removed obsolete tests for InferRequest::SetShape and add new test for Blob::setShape (a trivial one)

* Fixed artifacts

* Break code style

* Revert "Break code style"

This reverts commit 71ee638cd0.

* Added -j8 for fix_all

* Applied code style fixes

* Adde doxygen items

* Fixed style

* Applied codestyle patch

* Reverted unrelevant commit with template extension

* Fixed cmake file for shared func tests (pick from master)

* Revert all changes in template_extension

* Deleted some old stuff that commented and won't be used

* Fixed wrong exception throwing

* Code style fix

* Fixed preprocessing part

* Fixed incorrect blob reshape in GetBlob

* Deleted incorrect assert in GAPI that prevents passing some tests in Debug

* Fixed issues identified during review

* Removed SetShape, replace getLayoutByDims by getLayoutByRank and removed problematic modification from IE preprocessing

* Fixed comments

* Removed obsolete setShape

* [VPU] Fixed allocating dynamic blobs in myriad_infer_request

* Fixed comments

* Fixed CNNNgraphImpl and comments

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Polina <polina.brzezinskaya@intel.com>
2021-09-01 10:59:42 +03:00
Denis Orlov
e6482037aa [GNA] Include documentation for GNA3 QoS (#7046) (#7302)
* [GNA] Include documentation for GNA3 QoS

* Fix according to review

* Fix the driver version
2021-08-31 19:50:27 +03:00
Bartosz Lesniewski
4a9ac22787 Revise ScatterElementsUpdate Op (#7162)
* Use ngraph rtti macros

* Add visitor test

* Add SSLT

* Add hardcoded refs tests for ScatterElementsUpdate

* Add ScatterElementsUpdate to trusted ops list

* Add i16 case to backend tests

* Add typed testcase generation, check for all supported types

* Remove redundant parameters from generateScatterParams
2021-08-30 13:47:30 +03:00
Dmitry Kurtaev
148bdf638e [Docs] CPU_BIND_THREADS -> CPU_BIND_THREAD (#7079)
* [Docs] CPU_BIND_THREADS -> CPU_BIND_THREAD

* Update docs/optimization_guide/dldt_optimization_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2021-08-27 11:18:48 +03:00
Piotr Szmelczynski
81c8cd711b Revise logical not (#6942)
* update spec

* remove backend tests and create op_reference test

* add logicalNot to constants

* add NGRAPH CHECK for number of inputs and outputs

* create type_prop tests

* create visitor test

* add type_op and visitor tests to CMakeLists

* remove backend test from CMakeList

* update T to T_BOOL

* update outputs part in spec

* fix type in the spec

* fixed conflicts in CMakeList

* update ReferenceLogicalLayerTest to also work with unary logical operator

* update logical_not op_reference test to use ReferenceLogicalLayerTest

* fix style

* fix style

* resolve conflict

* resolve conflict

* remove typo

* fix style

* Update ReferenceLogicalLayerTest class tto take input as a vector

* Create makeLogical function that takes ParameterVector as parameter

* update op_reference logical tests to take input as a vector

* Replace elem_type with input.type

* update getTestCaseName method
2021-08-27 06:55:19 +03:00
Mateusz Bencer
0e521a1e22 Use ONNX Frontend instead of ONNX Reader (#7031)
* added get_name

* add support to supported_impl

* remove debug code

* review remarks

* changed name to onnx_experimental

* fixed test

* revert onnx_experimental name

* integrate reader and fe api

* add unit tests

* removed prototxt from model_validator

* reader refactor

* add supress

* Update inference-engine/src/readers/onnx_reader/ie_onnx_reader.cpp

Co-authored-by: Tomasz Dołbniak <tomasz.dolbniak@intel.com>

* fix segfaults

* removed onnx reader

* handle istringstream

* wstring support

* removed saving path

* styles applied

* changed name to onnx experimental

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* skip onnx_experimental frontend in mo.py

* add support of wstring paths

* fix wstring ctor of InputModelONNX

* added NGRAPH_SUPPRESS

* make one instance of manager

* change onnx_experimental name to onnx

* creation frontend manager refactor

Co-authored-by: Tomasz Dołbniak <tomasz.dolbniak@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2021-08-26 11:50:53 +03:00
Irina Efode
841c3531fb [IE TESTS] Behavior2.0 -> InferRequest() (#6559)
* Need to remove

* Preprocessing + InferRequest

* infer_request_callback

* tmp commit

* InferRequest

* tst

* tetet

* Fix template

* SetBlobType

* InferRequest Conformance

* Add prc

* Remove prc

* Fix paths

* commit

* Fixes for review

* Dynamic Batch

* fix

* fiz

* Try

* fkf

* Fix azure

* Centos

* skip

* conformance fix

* fix template

* Small fix

* small fix in print

* Fixes
2021-08-25 14:43:19 +03:00
Piotr Szmelczynski
ac53316f49 Revise greater equal (#7111)
* update spec

* create op_reference test

* add greateEqual to constants.py

* add ngraph_check for number of inputs and outputs

* add include

* fix style

* add information about broadcast in examples in spec

* Remove redundant reegistration of a new test class

* Remove visit_attributes method

* update outputs part in Greater and GreaterEqual spec

* fix typos in spec
2021-08-25 11:35:58 +03:00
Gabriele Galiero Casay
4d56803ce7 Revise ReverseSequence reference implementation (#7117)
* ReverseSequence ngraph op shell revision with type_prop tests

* Add attribute count check in visitor test

* Refactor backend tests to template plugin test with reference values

* Rename cpu SLT instances

* Add op to list of trusted operations

* Rewrite validation check for input type due to backward compatibility

* Reference implementation speed up by replacing index function call of CoordinateTransform by precalculated strides
2021-08-25 07:09:41 +03:00
Anton Chetverikov
f8e90f0c56 [MO] Add transformation for single CTCGreedyDecoder operation (#7023)
* Add transformation for single CTCGreedyDecoder operation

* Fix style in op specification

* Update transformation logic

* refactor old tests and add tests for new transformation

* Move tf specific front transformations to tf folder

* Update transformation logic and comments

* Add run_after function and update comments

* Add output_sparse_format attribute to extractor

* Update transformation conditions and tests

* Fix incorrect comment

* Move sparse_to_dense_replacer to front/tf folder to fix problems with class registration

* Update import

* Update output ports handling in transformation

* Update test

* Fix BOM file

* Update pattern for ctcloss transformation

* Fix and refactor tests for ctcloss transform

* Update transformation conditions
2021-08-24 15:42:27 +03:00
Pavel Esir
29193982d4 [IE] Convert to unsigned NMS:0 ->Gather path (#6474)
* inserted Convert to unsigned

* moved declarations from hpp into cpp, specification corrected

* added static const modifier

* updated convert specification

* minor corrections

* split into 3 passes(Init, Propogate, Update), renamed final pass to ConvertNmsGatherPathToUnsigned

* added description why transformation is needed

* added matcher for several NMS versions, removed TRANSFORMATIONS_API macros from cpp

* applied comments:
- used GraphRewrite instead of FunctionPass
- simplified some expressions
- corrected case when Converts output goes to multiple nodes
- added to MOC transformations
- other minor corrections

* removed redundant namespace prefixes

* fixed #include <ngraph/pass/graph_rewrite.hpp>

* removed matcher_scope, debug code, and redundant dynamic_cast
2021-08-23 18:35:37 +03:00
Gabriele Galiero Casay
8d4e850356 Fix op category section in operations spec (#7130) 2021-08-23 13:12:46 +03:00
Anastasia Popova
ef84c90367 Updated list of supported operations. (#6981)
* Updated list of supported layers.

* Removed Crop, softsign from Kaldi list.

* Updated limitations.

* Corrected limitations.

* Updated limitations.

* Added Einsum, corrected Where.

* Apply suggestions from code review

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
2021-08-20 17:03:36 +03:00
Gabriele Galiero Casay
211ea3c63c ReverseSequence specification refactored (#7112)
* ReverseSequence specification refactored

* Change attribute description to avoid confusion

* Allow seq_lenghts input to be of floating-point precision
2021-08-20 11:58:16 +03:00
Katarzyna Mitrus
551b17db81 CumSum reference implementation revision (#6915)
* New CumSum implementation init

* Unified ndim approach

* Move transpose to separate function

* Move transpose to original to separate function

* Move slice_count calculation to function

* Negative axes support

* Refactor redundant copy

* Changed copy to move

* Temp more backend tests

* Add const to shape arg

* Use span for slices calculation

* Remove unused headers

* CumSum new ref tests

* Add more ref tests

* Add all cumsum modes ref tests

* new optimized cum_sum reference

* Add reverse mode

* Optimized cumsum ref

* Remove deprecated cumsum backend tests

* Add more CumSum reference tests

* Simplify CumSum shared layer tests SetUp

* Replace auto to size_t in loop

* Change static_cast to T{}
2021-08-20 09:50:09 +03:00
Katarzyna Mitrus
7aeec6ffe4 CumSum spec revision (#6966)
* Update detailed description

* Update exclusive attribute description

* Update Inputs/Outpu description

* Update types

* Update descriptions

* Update data input rank info
2021-08-20 06:55:13 +03:00
Bartosz Lesniewski
9c5e7654d9 Revise CTCLoss OP (#6953)
* Add visitor test to CTCLoss

* Add CTC Loss SSLT

* Add CTC Loss template tests

* Use ngraph rtti macros

* Code style fix
2021-08-20 06:53:37 +03:00
Nikita Semaev
184b3cbe42 Review/update spec for NotEqual operation (#6797)
* Hiding the problem, Validate() changes 'function'

* Review/update spec for NotEqual operation

* Remove unnecessary edits not related to the ticket

* Removing the extra word binary for the short description

* Re-writing detailed description

* Correcting punctuation docs/ops/comparison/NotEqual_1.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Specifying auto_broadcast in the short description is similar to Equal spec

* The range of values for auto_brodcast is similar to Equal spec and includes the missing pdpd

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2021-08-19 21:54:18 +03:00
Liu Bo
26c96a44cc add doc:'Paddle_Support.md' (#7122)
* add doc:'Paddle_Support.md'

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Apply suggestions from code review

* Update docs/IE_DG/Paddle_Support.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2021-08-19 12:55:27 +03:00
Daria Mityagina
ed9b4ada23 Remove deprecated option and enable compilation without device (#6022) 2021-08-18 12:31:19 +03:00