* Added transposes insertion for Parameter and Result.
* Separated into several transformations.
* Corrected runtime_info format.
* Fixed runtime info serialization.
* Code refactoring.
* Corrected checks.
* Added debug output.
* Added check.
* Fixed unit tests.
* Changed old api map format, removed debug output.
* Moved serialize to rt_info property, code corrections.
* Refactored RTInfo class.
* Small corrections.
* Small corrections.
* Removed redurant import.
* Added tests, added undefined default type.
* Code reformat.
* Fixed serialization unit tests.
* Added comment.
* Added comment.
* Small test correction.
* Changed default values of old_api_map to values from old API IR.
* np.array -> int64_array
* Update MO to use FE to read IR; Swith MO IR version to 11
* Preserve output node name when inserting Transpose
* Codestyle
* Fix layer tests
* Pylint fix
* Disable ref_graphs comparision in layer tests
* codestyle
* Updated MO IR reader.
* Moved version initialization to constructor of OldApiMap.
* Added shape infer after transpose insertion.
* Fixed Pylint
* Removed wrong attribute removal.
* Added transposes insertion for Parameter and Result.
* Separated into several transformations.
* Corrected runtime_info format.
* Fixed runtime info serialization.
* Code refactoring.
* Corrected checks.
* Added debug output.
* Added check.
* Fixed unit tests.
* Changed old api map format, removed debug output.
* Moved serialize to rt_info property, code corrections.
* Refactored RTInfo class.
* Small corrections.
* Small corrections.
* Removed redurant import.
* Added tests, added undefined default type.
* Code reformat.
* Fixed serialization unit tests.
* Added comment.
* Added comment.
* Small test correction.
* Changed default values of old_api_map to values from old API IR.
* np.array -> int64_array
* Update MO to use FE to read IR; Swith MO IR version to 11
* Preserve output node name when inserting Transpose
* Codestyle
* Fix layer tests
* Pylint fix
* Disable ref_graphs comparision in layer tests
* codestyle
* Updated MO IR reader.
* Moved version initialization to constructor of OldApiMap.
* Added shape infer after transpose insertion.
* Fixed Pylint
* Removed wrong attribute removal.
* Serialize fix.
Co-authored-by: Gleb Kazantaev <gleb.kazantaev@intel.com>
* 1. Removed explicit SHARED from libraries
2. Fixed double definition for ie_layer_validators
* Fixed SEG in unit-test: order of initialization for global vars
* Added an ability to find plugins.xml from static IE
* Fixes in unit-test
* Migrated to new macro for import / export
* Minimized number of custom dllexport
* Don't use IR v7 for static libraries
* Revert for merge
* Don't enable tests with dlopen for static libraries
* Code style
* Added condition for export
* Revert format_reader
* Removed forward decalaration with external linkage
* Fixed IE linkage on Windows
* Reverted back 2 flags
* fixed dealing with None values in then/else branches of Select
* generalized solution when condition is non one elemental
* fix when both branches are None
* minor corrections
* rewritten Select unit-tests; fixed for condition with [True] mask
* removed mutable default arg from build_graph, added a few more test cases with masked condition, other minor corrections
* corrected output_shape calculation when broadcasting is off
* layer tests fixed: relaxed assert for condition shape to let pass TF Select
* corrected shape calculation when condition is not elementwise equal, calculated calculation for TF, corrected calculation of shape when values are not set
* fixed a typo for Select from TF Where
* Migrate POC for TensorFlow frontend
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Refactor InputModelTensorFlow API
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Repack POC to official API
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove tensorflow API from public include
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Make TF frontend work from MO and clean-up code
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply codestyle
* Fix win biuld
* Fix Linux build
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement Place class
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Determine outputs from graph
* Implement all Place classes
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Make small clean-up
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply code-style corrections
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Determine cut nodes
* Apply codestyle
* Rework to use places
* Fix conversion issue
* Fix build
* Fix conversion
* Small fixes
* Add test for tf frontend
* Add tests
* Implement partial conversion
* Use dynamic type in TFFrameworkNode
* Fix build on Linux
* Implement InputModelTF class
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix code by replacing InputModelTensorFlow to InputModelTF
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix to pass getPlaceByTensorName test
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Refactor and clean the code
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Finalize refactoring code
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Support freezing inputs
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add support for pruning input ports as new model output
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply code-style fixes
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* move op convertors to separate files, refactoring
* openvino codestyle
* openvino codestyle
* fix crash of layer tests
* fix missprint
* Implement TensorFlow NodeContext and DecoderTFProto classes
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Switch to new NodeContext
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove ngraph_builder class and node_context_impl class
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Move decoder/graph_iterator to separate files and remove old files
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Document Decoder, GraphIterator, and NodeContext classes
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply code style
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove empty file graph_iterator_proto.cpp and redundant comments
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Use base class for GraphIterator in model class and correct exception class
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Use ends_with from util library
* Remain only InputModelTF constructor with GraphIterator and adopt other code
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Correct code after merge
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply code style
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix code based on feedback: delete extra namespace usage, etc.
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Make legacy TF frontend default in MO and avoid reading tf models from ReadNetwork
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix build issue with FrameworkNode after upstream merge
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Correct frontend name in test and clean the code
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* refactoring of tf FrontEnd: rename namespaces, delete default opset
* codestyle
* fix e2e tests
* change namespaces of external classes
* resolve review comment
* codestyle
* Clean useless comments and fix tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add copyright for proto files
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Make op translators a part of FrontEndTF
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Align CMakeLists.txt file with other frontends
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add job_pool into CMakeLists.txt for tensorflow tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove cout and WA in ie_network_reader.cpp
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Correct DecoderBase and FrontEndTF methods, clean the code from if 0, utility.hpp, ngraph_conversions.hpp
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Clean operation translator code and remove empty implementation
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Extend cmake template files with tensorflow frontend
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply code-style
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix build issues on MacOS and apply review feedback
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove ConstantFolding pass, add destructors for DecoderBase, GraphIterator, and fix Win build
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix Windows build issue
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply code-style fix
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix issues with code style: remove virtual keyword, OpMap removal
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Resolve review remarks
* Resolve review remarks
* codestyle
* resolve review remarks
* fix copyright
* resolve review comments
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
* Initial change to allow saving graphto IR without meta_info
* Update saving and restoring functions, add more comments
* Add unit tests for define_data_type() function
* Fix wrong name
* Update condition
* Update meta_data checks
* Update data_type restoretion and missed outpurt ports handling
* Update and add new test
* Update comments
* Remove commented code
* Rename function
* Update temporary Result operations processing
* Remove define_data_type function
* Move node_normalize_output function to Op class methods
* Update comments
* Update comments
* Add MO coveragerc to tests install pkg
* Use directory install with FILES_MATCHING
* Coveragerc to tools folder
* Update CMakeLists.txt
* Use tests/model_optimizer folder
* Init rt info deserialization
* Add RT Info attributes deserialization
* Add RT Info attributes serialization
* Add Serialization and Deserialization tests
* Code style
* Fix AttributeAdapter place
* Extended rt_info section; added support for multi-field attrs; use version for attr serialization/deserialization
* Align attributes and their usage
* Fix LPT
* Add missing #pragma one
* Fix build
* Change version delimiter to have valid xml
* Fix PromitivesPriority
* Fix tests
* Fix test
* Fix IR Reader; remove empty rt_info
* More explicit attribute name and version representation
* Replace 'quantized' with 'compressed' in MO help
Signed-off-by: Andrei Kochin <andrei.kochin@intel.com>
* Add UG changes to reflect new help text
Signed-off-by: Andrei Kochin <andrei.kochin@intel.com>
* added Kaldi dropoutmask extraction and Kaldi lstmNonlinearity replacer extended for dropout case
(cherry picked from commit 0dd05f8053)
* fixed frame time calculation for Kaldi models with shapeof branches
* fix bug in frame time calculation for Kaldi models with shapeOf paths
* remove incorrect attribute from transformation
* refactoring based on review, couple more checks
* minor review fixes
* Change sort functions to fix incorrect order
* Add separate sorts for different cases
* Update sort function to correct control flow edges handling
* Refactor all sorts for dictionary ordering
* Update build_graph function for correct control_flow edges creation
* Add tests for nodes and ports sort equality
* Fix wrong port value
* Add direct conversion from bool to int
* Use .replace instead of .strip
* Add test with both control_flow and ordinary edges, refactored edges lists filling
* Refactored nodes dict filling
* Delete unused test code
* updated FasterRCNN and SSD analysis patterns
* updated tf od api conditions
* updated ssd patterns
* added more ssd topologies
* move preprocessor to tf od api condition
* update TF OD API conditions
* refactoring
* specify data type
* Fix return valuese for lift_up_through func
* Update unit test
* Refactoring code according to code review
* Fix revers outputs
* Fix unit test
* Fix comment
* Add multioutput support
* Add unit test for cace with several output from ReverseChannel op
* Fix distinantion connect
* Refactored code, updated comments and documentation related to TF OD API models pre-processing.
* Improved MO messages related to pre-processor block removal during conversion of the TD OD API models. Remove mean/scale if padding is used and mean/scale is applied before resize
* Updated TF OD API transformation and documentation for SSD models
* Updated comments and documentation for the ObjectDetectionAPIMaskRCNNSigmoidReplacement transformation
* Updated comments and documentation for the ObjectDetectionAPIMaskRCNNROIPoolingSecondReplacement transformation
* Updated comments and documentation for the ObjectDetectionAPIPSROIPoolingReplacement transformation
* Updated comments and documentation for the ObjectDetectionAPIProposalReplacement transformation
* Updated comments and documentation for the ObjectDetectionAPIDetectionOutputReplacement transformation
* Minor code style fixes
* Fixed unit tests for ObjectDetectionAPIPreprocessor2Replacement transformation
* Improved unit test for pipeline.config parser. Fixed very long bug with incorrect test data for the PipelineConfig parser class
* Code style fixes
* Get rid of "coordinates_swap_method" parameter in the JSON configuration file for TF OD API models
* Code style fixes and minor refactoring
* Simplied code related to swapping Proposal coordinates
* Removed incorrectly removed code
* Fixed code review comments about the code comments
* Allow MO to generate IR with -1 in dimensions
* Some fixes to support -1 for StridedSlice operation
* Updated TensorArrayGatherV3 shape infer to support dynamic output shape
* Several fixes to support undefined dimensions in the Broadcast,Reshape,Slice and Tile
* Fixed bug in the normalization transformation of TF NMS to opset NMS
* Updated shape infer functions related to StridedSlice and NMS
* Updated Select shape inference function to use common shape broadcasting function supporting dynamism
* Fixed operation TFResize shape infer function to work correctly for case when model is converted with --disable_nhwc_to_nchw
* Dynamic Range and update asserts in NMS
* Changed the way how dynamic dimensions are specified. Refactored shape inference functions and common places to use new approach
* More fixes to support dynamic shapes
* More fixes for support of dynamic shapes
* Fixed generation of IR with dynamic dimensions
* Allow reading IRs with undefined dimensions
* More changes in the IE to support dynamic dimensions
* Fixes for Switch, Merge, Concat shape and value infer related to dynamism
* Fixed TensorArray related ops to properly handle dynamic dimensions. Fixed StridedSlice infer for case with new_axis
* Fixed shape_for_layout function to generate masked array
* Fixed shape inference for Convolution and Poolings to support dynamic spatial dimensions
* Updated shape infer functions for CTCGreedyDecotder, CTCLoss and Enter
* Fixed shape inference with dynamic dimensions for MatMul, Split, Upsample, SpaceToBatch, some fixes for the TI
* Fixes for undefined dimensions support for Proposal and DetectionOutput
* Fixed ExtractImagePatches, DepthToSpace and RegionYolo shape infer functions to work with partially dynamic dimensions
* Changes in tf_window_op_pad_infer to better work with dynamic dimensions
* Fixed output shape calculation for StridedSlice operation
* More StridedSlice fixes
* Fixed resolve_convolution_with_group
* Fixed unit tests
* Fixed unit tests
* Fixed Switch op unit tests
* Fixed shape inference for Upsample operation
* Updated unit tests for the Concat operation
* Fixed eltwise shape infer unit tests
* Fixed shape infer tests for Convolution and DetectionOutput ops
* Fixed Crop shape infer function tests
* Fixed Slice op unit test and minor fix in the shape inference. Fixed emitter
* Updated unit test for telemetry and match_shape function for dynamism
* Fixed unit test for the DetectionOutput
* Added support for the TF ClipByValue operation
* Fixed GatherND shape inference for dynamic shapes support
* Dynamic shapes support for the MO IR Reader
* Fixed BlockLSTM operation to not work as an extractor
* Allow to serialize IRs with partially defined shapes
* Updated SelectBroadcast transformation to not check shape values
* Fixed MO IR comparator
* Fixed SS value propagation when slices are dynamic
* Do not re-run graph clean-up for ProposalMutation
* Fixed InterpolateSequenceToInterpolate transformation to support dynamic dimensions
* Fixed Loop iteration count calculation and reading IteratorGetNext shapes
* Fixed unit test for serialization
* Fixed serialization test
* Fixed RandomUniform shape infer
* Fixed several transformations related to RNN to respect dynamic output shapes
* Fixed Deconvolutin shape calculation for dynamic batch. Eltwise shape infer improvements
* Fixed shape infer functions for ExperimentalDetectron ops, reverted changes for NonZero and removed debug prints
* Fixed check for dynamism of a list, fixed value propagation for Concat op and remove redundant shape infer for reshape
* Update Eltwise value propagation to use np.ma
* Fixed ExpandDims shape infer function
* Shape infer functions fixes and improvements
* Remove Accum op from the MO
* Updated activation functions shape infer
* Removed unsupported operation Correlation
* Fixed shape infers for several functions
* Removed unsupported DataAugmentation operation
* Fixed shape infer functions for several ops in extensions directory
* Removed not-support operation PowerFile
* Removed unsupported SpatialTransformer,SimplerNMS and PredictionHeatmap operations
* More shape infer functions updates
* Merge shape infer fix
* Fixed typo
* Fixed TensorArraySize shape infer function
* Fixed VariadicSplit and Squeeze shape infer
* Fixed ONNX models Parameter extractor
* Updated Select value propagation for the dynamic case
* Fixed ReorgYolo shape infer and test
* Removed unnecessary tests
* Fixed Tile shape infer
* Fixed SparseFillEmptryRows unit tests
* Fixed package bom
* Added extractor for the TF operation Mod
* Fixed value propagation for MatMul operation
* Updated Parameter extender to generate shape_array when shape is partially defined only
* Fixed BOM file
* Fixed issue with the TF OD API models and DetectionOutput op. Now the shape infer function for the DO do not re-infer "num_classes" attribute value if it is already known
* Fixed unit test for the DO infer
* Fixed num classes calculation for the DO generation for Faster/Mask-RCNN models
* Changed NMS op to produce static output shape
* Restore dynamic output shape calculation for the NMS for NMS-5
* Fixed CellNormalizer transformation. It should work for static shapes only
* RNNCell Op class fixes
* Revert some changes
* Updated documentation with a list of supported operations
* Revert changes
* Fixes for the ConstantFill op
* Removed redundant SequenceLengthToMask transformation
* TensorArray* ops shape infer code style and refactoring
* Reverse some unnecessary changes in the ConvolutionNormalizer
* Fixes and unit tests for shape_array, compare_shapes, is_fully_defined functions
* Implemented shape_insert, shape_delete functions and tests for them
* Modified code to use shape_delete function
* Added usage of shape_insert function where necessary
* Use shape_insert function in many places
* Some fixes in shape inference for various ops
* Updated shape_delete function to support negative indices
* Changes and unit tests for the MatMul infer function
* Removed strange code from the TF Merge infer function
* Merge op shape infer fixes
* Fixed value propagation in the transformation EltwiseInputReshape.py for the dynamic dimension case
* Code cleanup
* Updated GatherND to support dynamic dimensions
* Minor fixes
* Fixed shape_insert and shape_delete to support np.int64 and np.int32 types
* Updated Upsample operation unit tests with dynamic input shapes
* Minor change in the extensions/back/ConvolutionNormalizer.py to make sure that input dimensions are static
* Fixed ConvertGroupedStridedSlice transformation and added unit tests
* Revert debug changes
* Fixed value propagation for Unsqueeze to work with partially defined input values
* Typo fix
* Added unit tests for the Unsqueeze op shape infer
* broadcasting functions changes and unit tests
* Fixed Tile value inference for partially defined input tensor
* Unit tests for Split and VariadicSplit ops
* Fixes for the Concat infer + unit tests
* Removed redundant tf_pack shape infer
* Fixed Concat value infer and added unit tests
* Fixed StridedSlice shape inference for case with dynamic slices
* Fixes related to StridedSlice shape infer, changes in tests
* Unit tests for the eltwise shape and value infer
* Fixed Pad op value propagation to allow dynamic input values to be propagated
* Unit test for Pooling dynamic input shape infer
* Squeeze op unit tests for dynamic input shape
* Added assert to the Squeeze op shape infer for case when squeeze dimension is dynamic value
* Added message to the MO when input shapes are dynamic
* Convolution dynamic unit test
* Removed redundant transformation GroupedConvWeightsNormalize
* Removed non-ascii character from the message
* Fixed typo in the BOM file
* Code style and comment fixes
* Fixed copy-paste issue in the DO shape infer function
* Fixed setting dynamic shape in the MO command line
* Added function to compare tensor with dynamic values. Fixes in the unit tests and shape infer functions
* Improved Reshape shape infer + added unit tests
* Fixed value propagation for Select op
* Renamed several internal functions, minor code fixes.
* Code style fixes
* Modified condition in the _set_shape method of the Port class to not check shape if the "override_output_shape" attribute is specified
* Fixed constant value propagation for ReduceOps when inputs have dynamic values. Added unit test
* Fixed shape infer for the Loop for dynamic dimensions case
* Fix in the NMS shape infer to avoid ragged numpy array generation. Fixed Scatter shape infer validation
* Improved shapes infer for eltwise ops with respect to dynamic dimensions
* Changed code comments
* Renamed tensor names in the ClipByValueTFTransformation
* Changed np.ma.allequal to strict_compare_tensors in the Merge op infer
* Chanded np.ma.allequal with strict_compare_tensor.
* Fixed Merge op value infer
* Fixed debug code
* Removed commented line
* Updated condition to check for dynamic shapes in the Partial infer to not fail for MxNet models
* Improvements to the get_shape_from_slice and is_dynamic_slice functions
* Reverted change in the `normalize_slices_attr` for ellipsis mask case
* Updated shape conditions in the ScatterNDBase op to support dynamic dimensions
* Crop op file refactoring
* Set "type" attribute to None for SparseFillEmptyRows op which is not from any opset
* Removed unnecessary extractor test
* Restored Crop operation type
* Removed "type" attribute from the Crop operation and updated the MO code to find Crop by "op" attribute
* Fixed If shape infer function to produce dynamic dimensions
* Updated If shape and value infer to properly work when condition is static
* Fixed fusing transformation check to work with dynamic dimensions. Change comparison in the shape_inference function to not use strict shapes comparison
* Optimize imports in the LayerNorm
* ConvertGroupedStridedSlice minor fixes related to dynamism support
* Fixed ConvertGroupedStridedSlice to properly check if the dimension is sliced
* Add transformation for single CTCGreedyDecoder operation
* Fix style in op specification
* Update transformation logic
* refactor old tests and add tests for new transformation
* Move tf specific front transformations to tf folder
* Update transformation logic and comments
* Add run_after function and update comments
* Add output_sparse_format attribute to extractor
* Update transformation conditions and tests
* Fix incorrect comment
* Move sparse_to_dense_replacer to front/tf folder to fix problems with class registration
* Update import
* Update output ports handling in transformation
* Update test
* Fix BOM file
* Update pattern for ctcloss transformation
* Fix and refactor tests for ctcloss transform
* Update transformation conditions
* added reinterp_shape parameter to tf ss extractor
* removed reinterp_shape
* added transformation to replace ss
* updated bom
* fix for e2e tests
* updated a case when shrink_axis_mask and new_axis_mask are both initialized
* unittests
* added comments
* updated graph_condition
* comments resolving
* updated the case, when shrink_axis_mask and new_axis_mask are both initialized
* added layer tests for squeeze/unsqueeze cases
* remove case when shrink and new axis masks are both set
* initial changes to support nested loop
* fixed issues
* fixed nested loop extraction
* added comments
* removed unneeded comments
* review fix
* added tests
* turned off loop tests on GPU
* set xfail for TF tests
* removed TF test to move it in another repo
* fix typo in comment
* move duplicated code to separate functions;
added asserts
* add function for onnx constant creation;
add function to create body of loop
add comments to test
* move main change for nested loop to separate function
* turned on MarkingSubgraphsWithCorrectLayout for TF NCHW
* restricted MarkSubgraphsWithCorrectLayout.py only to TF
* added comments why need to MarkSubgraphsWithCorrectLayout even for TF NCHW models
* Add support for unregistred operations in MO IR Reader
* Remove commented lines
* Add shapes equality check
* Update comments
* Update groupconv_to_conv function to support case with multiple destinations
* Add ir_data_attrs attribute to restored layers
* Update copy_shape_infer function to new graph api
* Add attribute IE to unsuppurted operations to save their attributes
* Fix wrong attribute name
* Update commentary
* Partially revert updating to new Graph API to fix regression, add appropriate comments
* Update code comments
* Rename copy_shape_infer function and add more comments
* gather-8 upgrade/downgrade transforms
* bump to opset8
* add Gather-8 to MO
* fix permutation for Gather
* added TF layer tests, ONNX layer tests for negative indices, and nG python api unit-tests for negative indices
* typo fix, disable downgrading transformation
* disable downgrade in clDNN, line width style fix
* all Gathers are converted to 7th version, transformations will be enabled/disabled while op will be added into plugins
* disabled Gather8LayerTest on GPU
* added common function for Op replacement
* concretized meaning of negative indices, fixed some typos
* applied review comments: left only meaningful layer tests
* removed op replacing functions from common utils
* returned back transformations without subroutines
* corrected style, added comments to common_optimizations.cpp
* MO: Support of discovering of suitable MOC frontend if --framework is not specified
* Ready for review
* Fix: don't use FrontEndManager if framework is not in list of available frontends
* Apply review comments
