This change adds full support for asymmetric quantization to optimized
depthwise convolution, adds slm optimization and other minor
improvements.
Issue: CVS-25122
* unroll ti transformation, lstm sequence ie, rnn sequence ie
* Update unroll ti transformation, added GRUSequenceIE op, fixed several ti e2e tests
* apply ngraph codestyle
* fix naming after unroll transformation
* Added default constructor for RNNCellBase, fix conversions
* copy runtime info
* added UnrollTI unit tests
* clean up, move sequence ops in a separate PR
* clean up, ngraph code style
* temporary disable ngraph reader unit tests for ti
* fix unit tests on windows
* naming: use name of tensor after unroll tensor iteration transformation
* apply transformations to tensor iterator body, separate pass for ti transformations, fix naming issue
* fix build
* remove TensorIterationTransformations pass
* fix includes
* resolve conflicts
* fix build: incorrect includes
* remove split/concat for single iteration of TI, update to opset4, unit tests
* use matcher pass instead of graph rewrite
* try to enable UnrollTI transformation for all plugins
* disable unrollTI transformation for cpu plugin
* resolve review comments, enable unit tests
* update transformation description
* fix unit tests
* update transformation pipeline
* clean up
* clean up
* resolve review comments
* Separate MO configuration for TensorFlow 2 model conversion
Also, it updates documentation including steps to convert
TF2 model with a custom layer in Keras H5 format into SavedModel
* Do fixes based on the first-round code review
In one of the network it was the following pipeline:
```
FullyConnected -> Reshape -> FullyConnected
```
And the output of Reshape wasn't in the same order as input for this
layer. I found that the problem was connected with format of the layers.
During optimization passes this pipeline was transformed to the
following:
```
FullyConnected -> Reorder -> Reshape -> Reorder -> FullyConnected
```
Both `FullyConnected` layers works with `yxfb` format. This is why
Reorder layer after the Reshape has output layout with format `yxfb` and
`reshape_in_layout.format` returns `yxfb` format. But in this case we
have to convert Reshape to `bfyx` format because in this case we won't
change the order of elements.
I replaced `reshape_in_layout.format` (which returns `yxfb`) and
explicitly set `bfyx` format.
JIRA: 35288
* Draft version of the Swish nGraph operation and fusing transformations for different approaches to express the operation
* Swish fusing transformation refactoring
* Added Swish operation and extractor for TF. Removed unfolding transformation for the operation.
* Added SwishIE. Implemented transformation to convert Swish to SwishIE.
* Code style fixes
* Updated Swish reference implementation. Added tests for shape and value inference
* Fixed code style for Python API
* Fixed unit test
* Apply review comments
* Use matcher_pass_callback
* Make m_alpha attribute protected in the SwishIE operation
* Fixed Swish op PythonAPI test
* Added Caffe Slice_ext
* Added TFSlice, AttributedSlice (both with extractors and replacers), corrected SliceConverter and added unittests for all cases
* added comments to each type of Slice operation; optimized shape inference; moved mxlice inside of slice.py; renamed slice_replacers
* removed type annotation for get_shape_after_slice routine
* replaced zeros_like with zeros
* Corrected preserving node names, renamed attributes names, added tests fro slice_replacer onnx phase
* Renamed slice_replacers.py
* added more unittest cases
* added type annotations, moved to more relevant place routines for shape calculation, and some other minor corrections
* corrected a typo `normalize_slice_indices` comment
* corrected shape calculation for Nonconstant inputs
* corrected a few typos
* corrected type declarations
* corrected shape inference with rounding
* refactored unit-tests for front transforms of Slice
* added error raising for negative and zero shapes
* removed magic_num
* corrected AttributedSlice, clarified comments
* fixed unit-test for AttributedSliceToSlice
* typo in type hints corrected
* removed supported_attrs
* returned back default None for attrs of Slice
