Commit Graph

417 Commits

Author SHA1 Message Date
Eunsoo Sheen
d05c3c63b5 [IE CLDNN] Add an initial loop primitive for fixed length sequence (#4954) 2021-05-28 11:55:48 +03:00
Tomasz Socha
87a47aa117 🦒Nonzero-adjustment (#5863) 2021-05-27 17:42:52 +03:00
Gabriele Galiero Casay
6b66f8f47f Reduction operations specification refactoring (#5612)
* Reduction operations specification refactoring

* Change axes input element type to any supported integer

* Address review comments related to wording
2021-05-27 16:38:51 +03:00
Anton Pankratv
d899606493 Merged plugin and exec network internal implementation (#4923)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-05-27 13:33:09 +03:00
Sergey Lyubimtsev
5adf2ee80e [DOCS] Inconsistence between Python versions supported in OpenVINO (#5790)
* [DOCS] Inconsistence between Python versions supported in OpenVINO and Anaconda

* colon

* split
2021-05-26 19:19:03 +03:00
Ilya Lavrenov
26bfa6f0ac Tests for dynamic preprocessing in SetBlob (#5798)
* Corrected tests to match CVS-53713

* Fixed tests configs

* Skip tests on GPU

* Commented condition inside main SetBlob because of MYRIAD

* Adopted tests
2021-05-26 18:07:08 +03:00
Maxim Shevtsov
fa48c91cc8 Additional images to explain streams. also brushed the media referenc… (#5775)
* Additional images to explain streams. also brushed the media references/example

* Update dldt_optimization_guide.md

* Update dldt_optimization_guide.md

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
2021-05-26 14:12:17 +03:00
Evgenya Stepyreva
74c8bd272b Low Precision IR documentation (#5791)
* Low Precision IR documentation

* Apply suggestions from code review

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
2021-05-25 16:43:42 +02:00
Ilya Churaev
7a31e29517 Fixed typo in snippets (#5781) 2021-05-25 11:45:10 +03:00
Ilya Churaev
cc810297f4 Align style doc with samples (#5709)
* Added clang-format config

* Fixed style

* Fixed code-style for snippets and fixed build

* Disable clang-format for snippets

* Fixed comments
2021-05-25 10:32:48 +03:00
Anastasiya Ageeva
52f1e8ced5 Fixed CVS-52338 (#5445)
* Fixed CVS-52338

* Minor fixes
2021-05-24 16:45:46 +03:00
Ilya Churaev
25999222b4 Added has_evauate to Node API (#5708) 2021-05-24 14:57:27 +03:00
Alexandra Sidorova
a74ba7b18e Fixed Softplus ref (#5755) 2021-05-24 14:34:12 +03:00
Piotr Szmelczynski
4b860890ed Revise floor (#5618)
* create type_prop tests

* add visitors test

* fix bug in visitor test

* add RTTI macro

* fix bug in visitors test

* add newline

* update spec

* update spec

* update RTTI definition

* move RTTI definitioion to the top of he file

* Remove broadcast from attribute tests.

* Add Floor-1 to summarize.py report.

Co-authored-by: jdanieck <jozef.daniecki@intel.com>
2021-05-21 07:55:26 +03:00
Ilya Lavrenov
0a629716de Follow up for PR #5645 (#5702) 2021-05-20 07:31:34 +03:00
Ilya Lavrenov
bc15656a32 Template set precision for output (#5693) 2021-05-19 22:58:03 +03:00
Anton Chetverikov
538f407829 Fix errors for VariadicSplit layer restored from serialized IR (#5613)
* Fix errors in VariadicSplit layer restored from serialized IR

* Update VariadicSplit specification and error message to allow 1D tensors on 1st input

* Update spec

* Resolve comments

* Apply comments, add unit tests

* Update unit tests
2021-05-19 19:03:58 +03:00
Ilya Lavrenov
181ad06668 Auto (#5645)
* Added LoadNetwork(filename) to AUTO

* Added more files

* So pointer can be used without loading

* Changed InferencePlugin, ICore to return internal interfaces

* Added SoPointers for InferRequest, ExecutableNetwork

* Fixed Windows

* Fixed KMB

* Fixes for KMB

* Removed dereference operator

* Play with include files

* Fixed compilation with older compilers

* Fixed comments

* Fixed win build

* Try  to fix Windows

* Try  to fix Windows 2

* Fixed windows

* Fixed windows

* Removed SOPointer as a base class

* Reverted back SOPointer split

* Code review

Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
2021-05-19 13:18:58 +03:00
Sergey Lyubimtsev
b835c6e60a Added Troubleshooting section (#5625)
* Added Troubleshooting section

* correct gamma
2021-05-18 12:28:42 +03:00
Sergey Lyubimtsev
bcbc3fe8cd Update EULA link for PyPI install guides (#5452) 2021-05-18 12:25:37 +03:00
Gabriele Galiero Casay
6a8f8a0761 Enable zero epsilon attribute in BatchNormInference operation (#5657) 2021-05-18 07:30:10 +03:00
Patryk Elszkowski
8300e9d5a1 update reshape spec (#5575)
* update reshape spec

* fix input description

* use T_SHAPE instead T_INT

Co-authored-by: Patryk Elszkowski <patryk.elszkowki@intel.com>
2021-05-17 13:44:31 +03:00
Szymon Durawa
d5a8861475 Update specification for ConvolutionBackpropData. (#4679)
* Update specification for ConvolutionBackpropData.

* Add backticks to attribute types, changed layout description for input, filter and output.

* Correct xml example.

* Add new examples.

* Add link with convolution backprop description.

* Repleace additional link with argxiv website.

* Insert enumeration for examples.

* Fix example with output_shape input.
2021-05-17 09:21:07 +03:00
Ilya Naumov
3e076a88aa Align MO pip requirements (#5171)
* Align MO pip requirements

* fix missing mxnet on platforms other than Windows or Linux

* remove spaces near environment markers
2021-05-14 16:05:25 +03:00
Vladislav Volkov
d2c9bddff1 Convert operation optimization for FP16 -> INT8 and FP32 -> INT8 (#5275)
Improvements for ConvertPrecision transformation pass
2021-05-14 13:48:02 +03:00
Pavel Esir
5fa899a39e [nG] Gather-7 update for negative batch_dims (#5522)
* corrected negative batch_dims normalization, some improvements in dynamism for Gather_7

* corrected transformation

* added batch_dims and axis normalization for reference

* updated INTERPRETER backend tests; replaced sizet_t -> int64_t in Gather evaluate

* returned back size_t in reference

* made Gather-1 source compatible with previous ngraph library versions

* added unittest for v7->v1, with nonzero batch_dims transformation should not be executed

* fix axis validation error message

* fix batch_dims gettter

* fixed v7->v1 unittest for nonzero batch_dims
2021-05-14 10:31:36 +03:00
Ilya Lavrenov
07a49184c0 Fixed typo in length (#5611) 2021-05-13 07:52:55 +03:00
Pavel Esir
0383b44776 added RNN-t conversion doc (#5139)
* added RNN-t conversion doc

* applied review comments

* a couple of corrections

* added pip3 everywhere

* fixed a typo

* applied review comments

* title name fix

* applied Tatiana's comments round 2

* fixed a typo for 'inference'

* fixed typo in MLCommons name

* moved to PyTorch* specific, applied comments

* pytorch_specific typo

* froze MLCommons revision to r1.0; fixed typo in MLCommons relative path
2021-05-12 22:49:40 +03:00
Taylor Yeonbok Lee
6ecadc1548 [IE CLDNN] Add description for new CLDNN plugin configuration MAX_NUM_THREADS (#5582) 2021-05-12 12:33:24 +03:00
Vladimir Paramuzov
0dc161ad82 [IE CLDNN] Added CACHE_DIR option into docs (#5592) 2021-05-11 16:55:33 +03:00
Maksim Proshin
d11c5e4c9d Moving POT to Optimization section in index.md and replacing Toolkit by Tool in a few places (#4272)
* Update get_started_dl_workbench.md

POToolkit => POTool

* Update QuantizedNetworks.md

POToolkit => POTool

* Moving POT to optimizations section

Moving POT to optimizations section
2021-05-11 14:35:33 +03:00
Bartosz Lesniewski
af0aa5f430 Revise Unsqueeze op - specification (#5526)
* Revise unsqueeze op spec

* Second input value boundaries fix

* adjust first input description
2021-05-07 17:03:25 +03:00
Gabriele Galiero Casay
b9812a4275 ConvertLike specification refactoring (#5534)
* ConvertLike specification refactoring

* Corrected typos and clean up

* Changed supported types of Convert to align with ConvertLike
2021-05-07 14:53:49 +02:00
Gabriele Galiero Casay
b9fe465cf0 BatchNormInference specification refactoring (#5489)
* BatchNormInference specification refactoring

* Address review comments

 * Remove he term Transform from definition
 * Add title of the paper where this operation is introduced
 * Add missing backticks
 * Remove redundant information in attribute epsilon range of values

* Refinement of spec

Remove more mentions to transformation to avoid confusion

* Corrected typos and added changes to improve readability

* Use third person to express operation steps
2021-05-07 14:06:28 +03:00
Gabriele Galiero Casay
edfec9171f ReduceSum specification refactoring (#5527) 2021-05-07 12:58:06 +03:00
Sergey Lyubimtsev
d339cbebfb Updated list of supported OS for PyPi (#5525)
* Updated list of supported OS for PyPi

* merge of Helena branch

* 55103: add instructions to install Microsoft* Visual C++ Redistributable Package
2021-05-07 12:04:51 +03:00
Vladimir Gavrilov
0c288d506c MO support for operations DFT and IDFT (#5197)
* Written MO classes for DFT and IDFT operations.

* Added class to read TF (I)FFT operations.

* Written extractors for TF operations FFT, FFT2D, FFT3D, IFFT, IFFT2D, IFFT3D.

* Written MO Roll operation and TF Roll operation extractor.

* Started to write needed transformations.

* Written transformation StridedSlices + Complex + Roll + (i)FFTxD + Roll + (Imag, Real) + Pack -> Roll + (I)DFT + Roll.

* Written transformation for Complex + ComplexAbs.

* Written correction of axes of Roll.

* Small fix.

* Small fix.

* Some fixes.

* Some changes.

* Now TF Roll is read as TFRoll. Written inserting Transposes before and after (I)DFT.

* Small fix.

* Written tests for the transformation TFRollToRoll.

* Added comments to some transformations.

* Deleted redundant import.

* Written tests for the transformation TransposeDFT.

* Fixes in MO IR Reader to read/write (I)DFT.

* Fixes in the list of supported TF layers.

* Started to write tests for SSliceComplexRolledFFTPackBlockReplacement transformation.

* Written tests for the MO transformation SSliceComplexRolledFFTPackBlockReplacement.

* Written tests for the MO transformation ComplexAbs.

* Tests for transformations were moved into unit_tests directory.

* All extractors for (I)FFTxD are in one file now.

* Deleted redundant transformations.

* Fixed extractor for TF Roll: now this operation is read as MO Roll.

* Added comments to TFFFT operation.

* The method insert_transpose of classes TransposeDFT and LayoutChangeForGatherND was moved into the separate function in the file model-optimizer/extensions/middle/InsertLayoutPropagationTransposes.py.

* Fixed comment for the transformation TransposeDFT.

* Small fix.

* Some fixes.

* Deleted shape infer function for the operation TFFFT. Sorted imports in complex_abs.py.

* Small fixes.

* Deleted redundant import.

* Fixes in some asserts.

* Small fix.

* Added names for created nodes in the transformation ComplexAbs.

* Added comments to the method canonicalize_axes.

* The transformation SSliceComplexRolledFFTPackBlockReplacement was split into the sequence of transformations SSliceComplexRollReplacement -> RollRealImagPackReplacement -> TFFFTToDFT.

* Written tests for the transformation SSliceComplexRollReplacement.

* Written tests for the transformation RollRealImagPackReplacement.

* Written tests for the transformation TFFFTToDFT.

* Deleted commented code.

* Fixed types of constants in the transformation ComplexAbs.

* Written tests for canonicalization of signal_size value.

* Deleted 'Replacement' from names of files and classes.

* Used comarison of ids, not names.

* replace_sub_graph was replaced with find_and_replace_pattern.

* Now the transformation RollRealImagPack is executed before running transformation model-optimizer/extensions/front/Pack.py.

* The body of the function create_dft_from_tffft is a part of the transformation TFFFTToDFT body now.

* Now method correct_roll_axes of classes RollRealImagPack and SSliceComplexRoll is moved to the function in mo/front/tf/graph_utils.py.

* Small changes.

* Added comment before mark_input_as_in_correct_layout(roll, 2).

* Now the functions correct_roll_axes generates sub-graph in the input port 2 of Roll.

* Corrected tests for the transformation SSliceComplexRoll.

* Corrected tests for the transformation RollRealImagPack.

* Deleted commented code.

* Some renaming.

* Added decomposition of the separate operation ComplexAbs (without Complex before it).

* Added comment to the transformation ComplexAbsAfterComplex.

* Optimized imports for the transformation TFFFTToDFT.

* The transformation SSliceComplexRoll was split into the sequence SSliceComplex -> CorrectRollAxes and disabled.

* Written tests for the transformation ComplexAbs.

* Written tests for the transformation SSliceComplex.

* Written tests for the transformation CorrectRollAxes.

* Deleted the transformation SSliceComplexRoll.

* Deleted renaming nodes.

* Fixed comment.

* Small fixes.

* Small fix.

* The attribute need_correction was renamed as input_rank_changed.

* Small fixes.

* Deleted commented code.

* Now we iterate over all complex_node.out_port(0).get_connection().get_destinations() input ports and mark the corresponding nodes with the marker attribute.

* Added the attribute 'in_ports_count' into the class FFTBase.

* Tests for the transformation TransposeDFT were rewritten using helper functions.

* Now the transformation RollRealImagPack uses existing Roll node instead of creating new one.

* Small fixes.

* Fix in the documentation.

* Written class to read MxNet (I)FFT operations. Written corresponding extractors.

* Corrected shape infer function for MXFFT operation. Written transformation to convert MXFFT to (I)DFT.

* Fixed shape infer function.

* Fixed the conversion MXFFT to (I)DFT.

* Written tests for the transformation MXFFTToDFT.

* The function correct_roll_axes was replaced with more generic function add_constant_to_negative_values.

* Fixes in classes TFFFT, FFTBase, DFT, IDFT, MXFFT.

* Added asserts in constructors of operations TFFFT and MXFFT.

* Refactored transformation MXFFTToDFT: conversion of DFT and IDFT were moved into separated functions.

* Moved some commented code.

* Fixed BOM file.

* Written function convert_ifft_to_dft.

* Started to rewrite tests for MXFFTToDFT transformations, in the case is_inverse=False.

* Small fixes.

* Fixes in the transformation RollRealImagPack.

* Renaming tests class for the transformation SSliceComplex.

* Fixes in the function compare_graphs. Now we get all output nodes of op node, and these output nodes are sorted by names.

* Fixed tests for the transformation MXFFTToDFT.

* Fix in the transformation ThresholdedReluDecomposition: added disconnect for trelu input port.

* Fixes in test for the transformation TFSliceToSlice.

* Small fix in the transformation ObjectDetectionAPIPreprocessor2Replacement.

* Small fix in comment.

* Optimized imports.

* Used remove_node in the transformation ThresholdedReluDecomposition and remove_nodes_from in the transformation RollRealImagPack, instead of ports disconnection.

* Deleted commented code.

* Deleted test case test_slice_replacer_begin_with_2_inputs.
2021-05-07 09:44:24 +03:00
Jozef Daniecki
2896b3af8c Convert op specification refactoring. (#5530)
* Convert op specification refactoring.

* Minor readability improvements.

* Fixed 'category' formatting.
2021-05-06 17:16:52 +03:00
Anton Chetverikov
e86b9b17b0 Update Gather-7 specification (#5441)
* Allow nagative values for batch_dims

* Update formula

* Update spec according to comments

* clarified cases when batch_dims and axis less than zero and enhanced restriction for index types

Co-authored-by: Pavel Esir <pavel.esir@intel.com>
2021-05-06 16:01:53 +03:00
Andrey Zaytsev
5e4cd1127b Integrate UAT fixes (#5517)
* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Edits to MO

Per findings spreadsheet

* macOS changes

per issue spreadsheet

* Fixes from review spreadsheet

Mostly IE_DG fixes

* Consistency changes

* Make doc fixes from last round of review

* integrate changes from baychub/master

* Update Intro.md

* Update Cutting_Model.md

* Update Cutting_Model.md

* Fixed link to Customize_Model_Optimizer.md

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
Co-authored-by: baychub <cbay@yahoo.com>
2021-05-06 15:37:13 +03:00
Yegor Kruglov
abb1ca657e Implementation of ArgMin ONNX + TF extractors (#5126)
* implement argmin extractors

* reconsidering argmax to topk

* arg ops refactoring

* rename ArgMaxToTopK

* added unittests

* update docs

* move unittest file to new folder

* conversations resolving

* revert changes with argmax.py, move argmin op to a new file

* rename ArgMaxSqueeze

* updated BOM file

* little fix

* code refactoring in ArgMaxOp, updated unittests

Co-authored-by: yegor.kruglov <ykruglov@nnlvdp-mkaglins.inn.intel.com>
2021-05-06 13:41:49 +03:00
Mikhail Nosov
dde837c4eb Add InferenceEngine::Core::LoadNetwork(modelPath, deviceName) to API_Changes (#5514) 2021-05-05 19:20:38 +03:00
Patryk Elszkowski
dc49035eaa update tanh v1 spec (#5413)
* update tanh v1 spec

* Apply review suggestions

* add rounding info

* Move Tanh to activation functions

* reorganize spec and add rounding rule for integers

* back to arithemtic functions

* Update `short description` to adjust with new EW description template

Co-authored-by: Patryk Elszkowski <patryk.elszkowki@intel.com>
2021-05-05 14:27:51 +03:00
Ilya Lavrenov
b47d11e31e Removed useless iostream include (#5357)
* Removed useless iostream include

* Fixed samples compilation

* Klockwork fixes for template plugin
2021-05-03 17:12:00 +03:00
Alexandra Sidorova
03ca3d1ef7 [CPU] Fixed SoftPlus for large positive values (#4932) 2021-04-30 13:34:33 +03:00
Ilya Lavrenov
8b1b900591 CVS-44774: Fixed preprocessing for template plugin (#4118)
* Fixed preprocessing for template plugin

* Added more tests instances

* Split common transformation to smaller ones which can be used by plugins

* Moved preprocessing transformation to Plugin API

* Added PreprocessConversionTest tests

* Disabled tests on GPU: CVS-51764

* Disabled some tests on VPU and TEMPLATE

* Support for input layout conversions in TEMPLATE plugin

* Improvements in Template Plugin

* Fixed compilation

* Fixes

* Disables some tests

* Fixed compilation on Windows

* Fixed docs
2021-04-30 10:47:29 +03:00
Katarzyna Mitrus
cec1e4ae1c Remove new line symbol (#5459) 2021-04-30 09:53:32 +03:00
Ilya Lavrenov
c350f61a42 Move all base wrapper classes from Plugin API to source folder (#5419)
* Small refactoring in TEMPLATE plugin

* Fixed compilation on Windows

* Fixed code style

* Hide CALL_STATUS_FNC helpers to private API

* Moved some base classes to private place from plugin_api

* Updates for VariableState creation

* Take Jane's changes for Demension names

* Revert "Take Jane's changes for Demension names"

This reverts commit 9f6c8fa5a6.

* Removed ICNNNetwork include

* removed more icnnnetwork includes

* Added missed include with ie_input_info.hpp

* Fixed GNA plugin to provide names w/o \0
2021-04-29 19:50:46 +03:00
Gabriele Galiero Casay
2062a648a7 Gelu-7 specification refactoring (#5439)
* Review spec of Gelu-7 operation

* Address review comments

 * Modified formulas
 * Changed type from `T` to *T*
2021-04-29 19:21:45 +03:00
Svetlana Dolinina
7b52e3155a Tdnnf (#5255)
* initial changes (IR not generated)

* extractor fix

* convert tdnnf (with correct infer)

* refactoring + comments in code

* added unit tests + couple fixes based on tests

* change order for old convolutions

* fix pylint

* small refactoring

* added if to remove changes in old irs

* doc updated

* fix layout and kernel shapes for old convolutions

* fixed test

* moved test

* fix import in test

* fixed backward compatibility

* review fixes
2021-04-29 14:38:08 +03:00