* added Kaldi dropoutmask extraction and Kaldi lstmNonlinearity replacer extended for dropout case
(cherry picked from commit 0dd05f8053)
* fixed frame time calculation for Kaldi models with shapeof branches
* fix bug in frame time calculation for Kaldi models with shapeOf paths
* remove incorrect attribute from transformation
* refactoring based on review, couple more checks
* minor review fixes
* Change sort functions to fix incorrect order
* Add separate sorts for different cases
* Update sort function to correct control flow edges handling
* Refactor all sorts for dictionary ordering
* Update build_graph function for correct control_flow edges creation
* Add tests for nodes and ports sort equality
* Fix wrong port value
* Add direct conversion from bool to int
* Use .replace instead of .strip
* Add test with both control_flow and ordinary edges, refactored edges lists filling
* Refactored nodes dict filling
* Delete unused test code
* updated FasterRCNN and SSD analysis patterns
* updated tf od api conditions
* updated ssd patterns
* added more ssd topologies
* move preprocessor to tf od api condition
* update TF OD API conditions
* refactoring
* specify data type
* Fix return valuese for lift_up_through func
* Update unit test
* Refactoring code according to code review
* Fix revers outputs
* Fix unit test
* Fix comment
* Add multioutput support
* Add unit test for cace with several output from ReverseChannel op
* Fix distinantion connect
* Refactored code, updated comments and documentation related to TF OD API models pre-processing.
* Improved MO messages related to pre-processor block removal during conversion of the TD OD API models. Remove mean/scale if padding is used and mean/scale is applied before resize
* Updated TF OD API transformation and documentation for SSD models
* Updated comments and documentation for the ObjectDetectionAPIMaskRCNNSigmoidReplacement transformation
* Updated comments and documentation for the ObjectDetectionAPIMaskRCNNROIPoolingSecondReplacement transformation
* Updated comments and documentation for the ObjectDetectionAPIPSROIPoolingReplacement transformation
* Updated comments and documentation for the ObjectDetectionAPIProposalReplacement transformation
* Updated comments and documentation for the ObjectDetectionAPIDetectionOutputReplacement transformation
* Minor code style fixes
* Fixed unit tests for ObjectDetectionAPIPreprocessor2Replacement transformation
* Improved unit test for pipeline.config parser. Fixed very long bug with incorrect test data for the PipelineConfig parser class
* Code style fixes
* Get rid of "coordinates_swap_method" parameter in the JSON configuration file for TF OD API models
* Code style fixes and minor refactoring
* Simplied code related to swapping Proposal coordinates
* Removed incorrectly removed code
* Fixed code review comments about the code comments
* Allow MO to generate IR with -1 in dimensions
* Some fixes to support -1 for StridedSlice operation
* Updated TensorArrayGatherV3 shape infer to support dynamic output shape
* Several fixes to support undefined dimensions in the Broadcast,Reshape,Slice and Tile
* Fixed bug in the normalization transformation of TF NMS to opset NMS
* Updated shape infer functions related to StridedSlice and NMS
* Updated Select shape inference function to use common shape broadcasting function supporting dynamism
* Fixed operation TFResize shape infer function to work correctly for case when model is converted with --disable_nhwc_to_nchw
* Dynamic Range and update asserts in NMS
* Changed the way how dynamic dimensions are specified. Refactored shape inference functions and common places to use new approach
* More fixes to support dynamic shapes
* More fixes for support of dynamic shapes
* Fixed generation of IR with dynamic dimensions
* Allow reading IRs with undefined dimensions
* More changes in the IE to support dynamic dimensions
* Fixes for Switch, Merge, Concat shape and value infer related to dynamism
* Fixed TensorArray related ops to properly handle dynamic dimensions. Fixed StridedSlice infer for case with new_axis
* Fixed shape_for_layout function to generate masked array
* Fixed shape inference for Convolution and Poolings to support dynamic spatial dimensions
* Updated shape infer functions for CTCGreedyDecotder, CTCLoss and Enter
* Fixed shape inference with dynamic dimensions for MatMul, Split, Upsample, SpaceToBatch, some fixes for the TI
* Fixes for undefined dimensions support for Proposal and DetectionOutput
* Fixed ExtractImagePatches, DepthToSpace and RegionYolo shape infer functions to work with partially dynamic dimensions
* Changes in tf_window_op_pad_infer to better work with dynamic dimensions
* Fixed output shape calculation for StridedSlice operation
* More StridedSlice fixes
* Fixed resolve_convolution_with_group
* Fixed unit tests
* Fixed unit tests
* Fixed Switch op unit tests
* Fixed shape inference for Upsample operation
* Updated unit tests for the Concat operation
* Fixed eltwise shape infer unit tests
* Fixed shape infer tests for Convolution and DetectionOutput ops
* Fixed Crop shape infer function tests
* Fixed Slice op unit test and minor fix in the shape inference. Fixed emitter
* Updated unit test for telemetry and match_shape function for dynamism
* Fixed unit test for the DetectionOutput
* Added support for the TF ClipByValue operation
* Fixed GatherND shape inference for dynamic shapes support
* Dynamic shapes support for the MO IR Reader
* Fixed BlockLSTM operation to not work as an extractor
* Allow to serialize IRs with partially defined shapes
* Updated SelectBroadcast transformation to not check shape values
* Fixed MO IR comparator
* Fixed SS value propagation when slices are dynamic
* Do not re-run graph clean-up for ProposalMutation
* Fixed InterpolateSequenceToInterpolate transformation to support dynamic dimensions
* Fixed Loop iteration count calculation and reading IteratorGetNext shapes
* Fixed unit test for serialization
* Fixed serialization test
* Fixed RandomUniform shape infer
* Fixed several transformations related to RNN to respect dynamic output shapes
* Fixed Deconvolutin shape calculation for dynamic batch. Eltwise shape infer improvements
* Fixed shape infer functions for ExperimentalDetectron ops, reverted changes for NonZero and removed debug prints
* Fixed check for dynamism of a list, fixed value propagation for Concat op and remove redundant shape infer for reshape
* Update Eltwise value propagation to use np.ma
* Fixed ExpandDims shape infer function
* Shape infer functions fixes and improvements
* Remove Accum op from the MO
* Updated activation functions shape infer
* Removed unsupported operation Correlation
* Fixed shape infers for several functions
* Removed unsupported DataAugmentation operation
* Fixed shape infer functions for several ops in extensions directory
* Removed not-support operation PowerFile
* Removed unsupported SpatialTransformer,SimplerNMS and PredictionHeatmap operations
* More shape infer functions updates
* Merge shape infer fix
* Fixed typo
* Fixed TensorArraySize shape infer function
* Fixed VariadicSplit and Squeeze shape infer
* Fixed ONNX models Parameter extractor
* Updated Select value propagation for the dynamic case
* Fixed ReorgYolo shape infer and test
* Removed unnecessary tests
* Fixed Tile shape infer
* Fixed SparseFillEmptryRows unit tests
* Fixed package bom
* Added extractor for the TF operation Mod
* Fixed value propagation for MatMul operation
* Updated Parameter extender to generate shape_array when shape is partially defined only
* Fixed BOM file
* Fixed issue with the TF OD API models and DetectionOutput op. Now the shape infer function for the DO do not re-infer "num_classes" attribute value if it is already known
* Fixed unit test for the DO infer
* Fixed num classes calculation for the DO generation for Faster/Mask-RCNN models
* Changed NMS op to produce static output shape
* Restore dynamic output shape calculation for the NMS for NMS-5
* Fixed CellNormalizer transformation. It should work for static shapes only
* RNNCell Op class fixes
* Revert some changes
* Updated documentation with a list of supported operations
* Revert changes
* Fixes for the ConstantFill op
* Removed redundant SequenceLengthToMask transformation
* TensorArray* ops shape infer code style and refactoring
* Reverse some unnecessary changes in the ConvolutionNormalizer
* Fixes and unit tests for shape_array, compare_shapes, is_fully_defined functions
* Implemented shape_insert, shape_delete functions and tests for them
* Modified code to use shape_delete function
* Added usage of shape_insert function where necessary
* Use shape_insert function in many places
* Some fixes in shape inference for various ops
* Updated shape_delete function to support negative indices
* Changes and unit tests for the MatMul infer function
* Removed strange code from the TF Merge infer function
* Merge op shape infer fixes
* Fixed value propagation in the transformation EltwiseInputReshape.py for the dynamic dimension case
* Code cleanup
* Updated GatherND to support dynamic dimensions
* Minor fixes
* Fixed shape_insert and shape_delete to support np.int64 and np.int32 types
* Updated Upsample operation unit tests with dynamic input shapes
* Minor change in the extensions/back/ConvolutionNormalizer.py to make sure that input dimensions are static
* Fixed ConvertGroupedStridedSlice transformation and added unit tests
* Revert debug changes
* Fixed value propagation for Unsqueeze to work with partially defined input values
* Typo fix
* Added unit tests for the Unsqueeze op shape infer
* broadcasting functions changes and unit tests
* Fixed Tile value inference for partially defined input tensor
* Unit tests for Split and VariadicSplit ops
* Fixes for the Concat infer + unit tests
* Removed redundant tf_pack shape infer
* Fixed Concat value infer and added unit tests
* Fixed StridedSlice shape inference for case with dynamic slices
* Fixes related to StridedSlice shape infer, changes in tests
* Unit tests for the eltwise shape and value infer
* Fixed Pad op value propagation to allow dynamic input values to be propagated
* Unit test for Pooling dynamic input shape infer
* Squeeze op unit tests for dynamic input shape
* Added assert to the Squeeze op shape infer for case when squeeze dimension is dynamic value
* Added message to the MO when input shapes are dynamic
* Convolution dynamic unit test
* Removed redundant transformation GroupedConvWeightsNormalize
* Removed non-ascii character from the message
* Fixed typo in the BOM file
* Code style and comment fixes
* Fixed copy-paste issue in the DO shape infer function
* Fixed setting dynamic shape in the MO command line
* Added function to compare tensor with dynamic values. Fixes in the unit tests and shape infer functions
* Improved Reshape shape infer + added unit tests
* Fixed value propagation for Select op
* Renamed several internal functions, minor code fixes.
* Code style fixes
* Modified condition in the _set_shape method of the Port class to not check shape if the "override_output_shape" attribute is specified
* Fixed constant value propagation for ReduceOps when inputs have dynamic values. Added unit test
* Fixed shape infer for the Loop for dynamic dimensions case
* Fix in the NMS shape infer to avoid ragged numpy array generation. Fixed Scatter shape infer validation
* Improved shapes infer for eltwise ops with respect to dynamic dimensions
* Changed code comments
* Renamed tensor names in the ClipByValueTFTransformation
* Changed np.ma.allequal to strict_compare_tensors in the Merge op infer
* Chanded np.ma.allequal with strict_compare_tensor.
* Fixed Merge op value infer
* Fixed debug code
* Removed commented line
* Updated condition to check for dynamic shapes in the Partial infer to not fail for MxNet models
* Improvements to the get_shape_from_slice and is_dynamic_slice functions
* Reverted change in the `normalize_slices_attr` for ellipsis mask case
* Updated shape conditions in the ScatterNDBase op to support dynamic dimensions
* Crop op file refactoring
* Set "type" attribute to None for SparseFillEmptyRows op which is not from any opset
* Removed unnecessary extractor test
* Restored Crop operation type
* Removed "type" attribute from the Crop operation and updated the MO code to find Crop by "op" attribute
* Fixed If shape infer function to produce dynamic dimensions
* Updated If shape and value infer to properly work when condition is static
* Fixed fusing transformation check to work with dynamic dimensions. Change comparison in the shape_inference function to not use strict shapes comparison
* Optimize imports in the LayerNorm
* ConvertGroupedStridedSlice minor fixes related to dynamism support
* Fixed ConvertGroupedStridedSlice to properly check if the dimension is sliced
* Add transformation for single CTCGreedyDecoder operation
* Fix style in op specification
* Update transformation logic
* refactor old tests and add tests for new transformation
* Move tf specific front transformations to tf folder
* Update transformation logic and comments
* Add run_after function and update comments
* Add output_sparse_format attribute to extractor
* Update transformation conditions and tests
* Fix incorrect comment
* Move sparse_to_dense_replacer to front/tf folder to fix problems with class registration
* Update import
* Update output ports handling in transformation
* Update test
* Fix BOM file
* Update pattern for ctcloss transformation
* Fix and refactor tests for ctcloss transform
* Update transformation conditions
* added reinterp_shape parameter to tf ss extractor
* removed reinterp_shape
* added transformation to replace ss
* updated bom
* fix for e2e tests
* updated a case when shrink_axis_mask and new_axis_mask are both initialized
* unittests
* added comments
* updated graph_condition
* comments resolving
* updated the case, when shrink_axis_mask and new_axis_mask are both initialized
* added layer tests for squeeze/unsqueeze cases
* remove case when shrink and new axis masks are both set
* initial changes to support nested loop
* fixed issues
* fixed nested loop extraction
* added comments
* removed unneeded comments
* review fix
* added tests
* turned off loop tests on GPU
* set xfail for TF tests
* removed TF test to move it in another repo
* fix typo in comment
* move duplicated code to separate functions;
added asserts
* add function for onnx constant creation;
add function to create body of loop
add comments to test
* move main change for nested loop to separate function
* turned on MarkingSubgraphsWithCorrectLayout for TF NCHW
* restricted MarkSubgraphsWithCorrectLayout.py only to TF
* added comments why need to MarkSubgraphsWithCorrectLayout even for TF NCHW models
* gather-8 upgrade/downgrade transforms
* bump to opset8
* add Gather-8 to MO
* fix permutation for Gather
* added TF layer tests, ONNX layer tests for negative indices, and nG python api unit-tests for negative indices
* typo fix, disable downgrading transformation
* disable downgrade in clDNN, line width style fix
* all Gathers are converted to 7th version, transformations will be enabled/disabled while op will be added into plugins
* disabled Gather8LayerTest on GPU
* added common function for Op replacement
* concretized meaning of negative indices, fixed some typos
* applied review comments: left only meaningful layer tests
* removed op replacing functions from common utils
* returned back transformations without subroutines
* corrected style, added comments to common_optimizations.cpp
* Fixes in the transformation ExpandRangeConstant.
* Fixed test.
* Now we use use ShapeOf for both inputs of Broadcast.
* Now the transformation ExpandRangeConstant uses two Gather layers.
* Deletec commented code.
* Fixed tests for the transformation ExpandRangeConstant.
* Rewritten the transformation ExpandRangeConstant using Select.
* Draft version of new approach for Proposal sub-graph conversion for TF OD API models
* Added clip_after_nms = True for Proposal sub-graph being replaced with DetectionOutput
* Refactored code to insert DetectionOutput instead of Proposal operation
* Code cleanup
* Added separate function to insert DetectionOutput instead of Proposal operation
* Updated transformation configuration files for the TF OD API models with Proposal transformation
* Code refactoring
* Code refactoring
* Fix for the condition
* Fixed transformation
* Fixed transformation. One more time
* Updated document about conversion of the TF OD API models
* Update code comments
* Implement transformation for TensorFlow 2 Map Function primitive
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add a description for get_external_node_by_internal_id function
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Correct a name for get_external_nodes_by_internal_id function
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix a description for get_external_nodes_by_internal_id function
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add logging and fix indentation
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Use skip_nodes_by_condition to by-pass StopGradient nodes for tf.map_fn
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix recovery of output subscript in Einsum implicit mode
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix code style
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Correct layout adjustment for Einsum inputs and output
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Correct a comment in the unit-test
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Setup correct transformation dependencies for LayoutChangeForEinsum
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove split-concat subgraph before pad op
* Fix unit tests
* Add unit tests for PadNormalizer
* Fix according to review
* add propagation up for Pad
* Fix value propogation
* Remove PadMormolizer
* Refactoring according to review
* Enable common optimizations on MO
* Added tensor name tracking; updated tests
* Disable DilatedConvolution transform
* Fix TopK3 transformation
* Codestyle fix
* Update tensor name logic
* Fix scatter nd shape inference for dynamic shape
* Update FrameworkNode to propagate dynamic output shape
* Enable HSwish in MO that is missing in nGrpah
* Cleanup MO and IE code
* Fix review comments
* Fix unit test
* Implement way to provide keep_output_port attribute to add_opoutput function
* Update tests
* Update comment
* Fake commit to pictures merge problem
* Change default value
* Add type
* Revert "Fake commit to pictures merge problem"
This reverts commit 41850765e0.
* Updated conversion of TF OD API 2.4 SSD models
* Fixed issue when more Conv2D nodes were selected for weights permutation when converting TF OD API models
* Code style fixes
* Fixed code comments
* add priors to loader and counts transformation
* fixes in select insertion for case with context gathering - LSTM - context gathering
fix for edge parallel to ReadValue
extend counts option to case of priors inside mdl model file
* fixed tests
* fixed typo
* fixed issue with input names
* fix priors loading + comments
* fix e2e test: error with not found transformation
* print debug info for dependency graph - should be reverted
* should be reverted: debug commit
* Revert "fix e2e test: error with not found transformation"
This reverts commit 8320fa99bf.
* revert debug commits
* fixes after review
* review fixes
* review change
* review changes
* Add ShapeOfConstFolding transform
* Add unit tests
* Update bom file
* Update transform file
* Hot fix
* Fix midle replaser
* Update unit tests
* Fix get value
* Refactoring Const Folding transformation. Move to back
* Update bom file
* Remove unuse code
* Add some unit tests
* Refactoring unit test
* Hot fix
* Add support resize with 2 inputs
* Add unit tests
* Hot fix
* Change resize check from port count to connected num port conditions
* Fix conditions
* Refactoring code according to review
* Fix according to review
* Change onnresize11 input condition
* added new transformation to check the uniqueness of nodes names
* added unittest
* remove redundant line
* conversation resolving
* updated unittest
* added new unittest, added check for uniqueness of new node name
* added a description
* added renaming of several results with the same name and unittest for this case
* another implementation, updated unittests
* added a comment
* updated comments
* added comment to the nodes_with_equal_names func
* added a condition
* added a result name check in unittests
* fix marking of nodes with shape values: corrected 'leaky' starting condition
* cleaned up code
* fixed t2t type collision error: removed strict assert from Pow; now type_infer is same as for other eltwise ops; added warnings about type alignment
* type cast for Pow according to ONNX spec
* fix highlight in dump_graph_for_graphviz
* soft_get('op')
* Revert "soft_get('op')"
This reverts commit cadfe18f
* Revert "type cast for Pow according to ONNX spec"
This reverts commit bf85ebf8
* applied review comments
* comment for ShapeOf bfs, removed Error from elementwise op
* reverted back dump_graph_for_graphviz: fill_color -> node_attrs
* applied last review comments: returned back Error, added type_infer into unit-test utils
* Added extractor for ONNX operation Size
* Moved transformation of Size operation from TF specific to generic front phase
* Updated list of supported ONNX operation
* Moved unit test for Size decomposition to a new location
* Added operation ConvertLike to the MO
* Fixed transformations with Pad which insert Const with pad value of incorrect type
* Added constant folding to ConvertLike operation
* Fixed unit tests for Pad transformations to include ConverLike operations
* Update copyright year
* nGraph code style fix
