* Commit.
* Started to write nGraph operation ExperimentalDetectronDetectionOutput. Written draft of the header file.
* Written draft of the cpp-file for nGraph operation ExperimentalDetectronDetectionOutput.
* Small fix.
* Added reading of ExperimentalDetectronDetectionOutput as nGraph operation.
* Some fix.
* Unregistered old shape infer function of the operation ExperimentalDetectronDetectionOutput.
* Written the header file for the operation ExperimentalDetectronPriorGridGenerator.
* Small refactoring.
* Small fix.
* Added set_output_size(3) into op::ExperimentalDetectronDetectionOutput::validate_and_infer_types().
* Added check for number of inputs of ExperimentalDetectronDetectionOutput.
* Reverted some changes.
* Changed IR for ExperimentalDetectronDetectionOutput serialization test.
* Written cpp-file of nGraph operation ExperimentalDetectronPriorGridGenerator.
* Small fix.
* Some fixes.
* Fixes in type and shape infer functions of the MO operation ExperimentalDetectronDetectionOutput.
* Now ExperimentalDetectronPriorGridGenerator is readed as nGraph operation.
* Fixed the infer function of the nGraph operation ExperimentalDetectronPriorGridGenerator.
* Started to write tests for the shape infer function of the nGraph operation ExperimentalDetectronDetectionOutput.
* Written the draft of the test for the shape infer function of the nGraph operation ExperimentalDetectronDetectionOutput.
* Small fix.
* Fixed ngraph/test/CMakeLists.txt.
* Started to write tests for the shape infer function of the nGraph operation ExperimentalDetectronPriorGridGenerator.
* Now the shape infer function of the nGraph operation ExperimentalDetectronPriorGridGenerator performs correctly case dynamic input shapes with static ranks.
* Continued to write test for the nGraph operation ExperimentalDetectronPriorGridGenerator.
* Small fixes.
* Written tests for the shape infer function of the nGraph operation ExperimentalDetectronPriorGridGenerator (case when input shapes are partially dynamic).
* Added test for reading ExperimentalDetectronDetectionOutput as an operation from opset6.
* Some fixes.
* Added some debug outputs.
* Deleted inserted debug output.
* Small fixes.
* Small fix.
* Small fix.
* Small change.
* Added comments to attributes of ExperimentalDetectronDetectionOutput.
* Reverted changes.
* Deleted shape infer for output port 3.
* Small fixes.
* Deleted redundant keyword 'virtual'.
* Deleted redundant usings in header files of nGraph operations ExperimentalDetectronDetectionOutput and ExperimentalDetectronPriorGridGenerator.
* Some fixes.
* Small change.
* Now GridGenerator::validate takes three args (input partial shapes).
* Small fix.
* Deleted some usings.
* Small code style fix.
* Reverted changes in validate_and_infer_types() and validate() of op::v6::ExperimentalDetectronPriorGridGenerator.
* Added description of the class ExperimentalDetectronDetectionOutput.
* Added some comments into the header file of the nGraph operation ExperimentalDetectronPriorGridGenerator.
* Some fixes.
* Added some comments to the class of the nGraph operation ExperimentalDetectronPriorGridGenerator.
* Now the MO operation ExperimentalDetectronDetectionOutput has the attribute 'version' as 'opset6'.
* Now the MO operation ExperimentalDetectronPriorGridGenerator has the attribute 'version' as 'opset6'.
* Some fixes in the MO class ExperimentalDetectronDetectionOutput.
* Fixes in the shape infer function of the nGraph operation ExperimentalDetectronPriorGridGenerator.
* Renamed test XML model for ExperimentalDetectronDetectionOutput serialization tests.
* Added validation of input shapes for the nGraph operation ExperimentalDetectronDetectionOutput.
* Small fixes in the XML models for serialization testing of ExperimentalDetectronDetectionOutput.
* Added tests of shape infer function of the nGraph operation ExperimentalDetectronDetectionOutput for the case when input shapes are partially dynamic.
* Added tests of shape infer function of the nGraph operation ExperimentalDetectronDetectionOutput for the case when some input shapes have dynamic ranks.
* Small fixes.
* Small fix in the MO operation ExperimentalDetectronDetectionOutput shape infer function.
* Fixes in op::v6::ExperimentalDetectronDetectionOutput::validate_and_infer_types().
* Code style fix.
* Small refactoring.
* Added NGRAPH_OP_SCOPE into ExperimentalDetectronDetectionOutput nGraph class.
* Added NGRAPH_OP_SCOPE to the nGraph class ExperimentalDetectronPriorGridGenerator.
* Small fixes.
* Some refactoring.
* Small fix.
* Small fixes.
* Reverted some changes in ExperimentalDetectronDetectionOutput::validate_and_infer_type().
* Now VPU reads the attribute class_agnostic_box_regression of ExperimentalDetectronDetectionOutput as Bool.
* Now MO generates attribute 'class_agnostic_box_regression' of ExperimentalDetectronDetectionOutput only with values false or true.
* Small fix.
* Tabs were replaced by spaces in some XMLs.
* Fixed copyrights.
* Refactoring in op::v6::ExperimentalDetectronDetectionOutput::validate_and_infer_types().
* Refactoring in op::v6::ExperimentalDetectronPriorGridGenerator::validate_and_infer_types().
* Small fixes.
* Started to write ExperimentalDetectronPriorGridGenerator shape infer tests for the case when dynamic input dimensions are intervals.
* Deleted redundant 'return'.
* Written tests for interval values of input shapes of op::v6::ExperimentalDetectronPriorGridGenerator.
* Code style fix.
* Code style fix.
* Added offline transformations library
* Added python API for calling MOCTransformations
* Added CF flag for MOC Transformations
* Divided offline api to separate independent module
* Update MOC pipeline to execute only fusions
* Disable CF for PriorBox ops
* Clean-up
* Added python test
* Removed transformation pipeline as it is not ready yet
* Remove not related to this PR changes
* Fixed build for dev package case; renamed to offline_transformations_api
* Removed unrelated changes
* Removed excess exports from cmake
* Removed useless custom command from cmake
* Bucketize: Revise op class and add type_prop unit tests
* Bucketize: Develop reference implementation
* Bucketize: Add unit tests
* Bucketize: Add single layer test and cpu instantiation
* Bucketize: Add unit test with empty buckets for INTERPRETER
* Bucketize: Typo in buckets element type check
* Bucketize: Add custom generated inputs in single layer test class
* Bucketize: Use random_device to generate seed for data blob
* Bucketize: Remove unsupported f64 precision
* Bucketize: Add function description
* Bucketize: Remove randomness of inputs generation by using static seed
* Bucketize: Support different precisions for data and bucket inputs
* Bucketize: Refactor type_prop tests and improve backend unit test coverage
Enable tests including rectangular kernel and multiple kernels
Pad filters to 16B
Fix style space after if before ( needed
Fix PRETTY_FUNCTION double def
Fix canMatchWith1AsyncThread
Fix ifdefs for gna 2.0
Add and fix mock
Simplify and fix condition for Rotate features
Refine commnets in GNA CONV tests file
Apply review, Refactor ConvolutionPrimitive
Refine CNN enforce legacy
Add debug print
Move debug dump definitions
Add new metric for GNA library version
Add coments on FP32
* regionyolo do_softmax attribute
* add serialization single layer tests for normalizel2 and reshape
* add prelu sslt, change letter size in op name to align with MO
* add shufflechanels sslt, add workaround to serialize the op with proper opset number
* add broadcast sslt, change attribute string representations to lowercase
* add pad sslt, change attribute string representations to lowercase
* Unify sslt name prefixes
* add prelu name translation for serialization
* change expected type of regionyolo do_softmax attribute to bool
* transform autobcast type attr to lowercase, add unit test, add special opset mapping in serialization
* style fix
* fix indentation
* fix indentation 2
* Possibility of different opset assignment for different op versions
* Update header dates in modified files
* Match special opset to type_info_t instead of a string
* Adjust the comment to match the code
* Release mo dev guide refactoring (#3266)
* Updated MO extension guide
* Minor change and adding svg images
* Added additional information about operation extractors. Fixed links and markdown issues
* Added missing file with information about Caffe Python layers and image for MO transformations dependencies graph
* Added section with common graph transformations attributes and diagram with anchor transformations. Added list of available front phase transformations
* Added description of front-phase transformations except the scope-defined and points defined. Removed legacy document and examples for such transformations.
* Added sections about node name pattern defined front phase transformations. Copy-pasted the old one for the points defined front transformation
* Added description of the rest of front transformations and and all middle and back phase transformations
* Refactored Legacy_Mode_for_Caffe_Custom_Layers and updated the Customize_Model_Optimizer with information about extractors order
* Added TOC for the MO Dev guide document and updated SVG images with PNG ones
* Fixed broken link. Removed redundant image
* Fixed broken links
* Added information about attributes 'run_not_recursively', 'force_clean_up' and 'force_shape_inference' of the transformation
* Code review comments
* Added a section about `Port`s
* Extended Ports description with examples
* Added information about Connections
* Updated MO README.md and removed a lot of redundant and misleading information
* Updates to the Customize_Model_Optimizer.md
* More updates to the Customize_Model_Optimizer.md
* Final updates for the Customize_Model_Optimizer.md
* Fixed some broken links
* More fixed links
* Refactored Custom Layers Guide: removed legacy and incorrect text, added up-to-date.
* Draft implementation of the Custom layer guide example for the MO part
* Fixed broken links using #. Change layer->operation in extensibility documents
* Updated Custom operation guide with IE part
* Fixed broken links and minor updates to the Custom Operations Guide
* Updating links
* Layer->Operation
* Moved FFTOp implementation to the template extension
* Update the CMake for template_extension to build the FFT op conditionally
* Fixed template extension compilation
* Fixed CMake for template extension
* Fixed broken snippet
* Added mri_demo script and updated documentation
* One more compilation error fix
* Added missing header for a demo file
* Added reference to OpenCV
* Fixed unit test for the template extension
* Fixed typos in the template extension
* Fixed compilation of template extension for case when ONNX importer is disabled
Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
- Added linear_onnx mode support into resample_opt kernel.
- Fixed byxf layout check.
- Added Resample + Eltwise fusing support
- Update dequantize merge pass to work with eltwise instead of scale
- Fixed uninitialized m_maxBatch value for query mode
- Fixed missing AddPrimitiveToProfiler for DeformablePSRoiPooling
- Fixed 0d gather
- Added WA for Resample+Eltwise fusing
Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
Remove protocol checks for updating memType and watchdog flag. This has been verified by Microsoft on their target platform with 2 ma2085 over PCIE. The target was able to run openVino sample with these changes.
* Update the spec
* add unit-tests
* add avgPool unit-tests to CMakelist
* Remove second constructor and change the first one to take default values for rounding_type and pad_type
* add type_prop test for default values
* add 5d input single layer test instances
* add type_prop tests
* Require input to be 4D or 5D
* add validation check for pads size
* Update few tests to take 5D input instead of 6D
* Update validate_and_infer_types method
* Update infer_batched_pooling_forward and try_apply_auto_padding methods
* Update auto_padding_spatial_dims_dynamic type_prop test for binary_conv, conv, deformable_conv, group_conv and max_pool
* style-apply
* add validation check for kernel size
* add xfail for avgpool python backend test
* style-apply
* remove avgpool backend test from xfail list
* Update spec
* Allow the 3D input
* Update type_prop test with 3D input
* style-apply
* Remove xfail_issue_38709
* fix typo
* Update spec
* Update outputs section in spec
* Update spec
* fix typo
* clean file
* Update detailed description and fix xml examples
* fix exclude-type typo
* fix typo in outputs section
* [IE][nGraph]: Enables begin/end iterators for PartialShape
It's convenient to be able to use STL algorithms on
PartialShape since semantically PartialShape is a
sequence of Dimensions.
* [IE][VPU][nGraph]: Introduces tree utilities
Introduces Depth-First-Search and Breadth-First-Search
utilities for tree traversal. Templated arguments
makes them extensible for different use-case scenarios.
BFS is designed in way to make it possible to guarantee
node will be visited only after all its predecessors
have been visited:
a
/ \
b c
| |
d |
\ /
e
There with accordingly provided functors (NumEntries) it's
guaranteed node "e" will be visited after "d" and "c".
Such a property is important for nodes depth evaluation.
* [IE][VPU][nGraph]: Fixes printTo for nGraph type
For some reason if printTo for nGraph type is
usual function it's not picked up by VPU_THROW_UNLESS
triggered inside DynamicToStaticShape transformations.
Making it template specialization does the job.
* [IE][VPU]: Introduces SliceConfiguration class
SliceConfiguration is a class that's intended
to express the result of operation slicing by
batch. The result of slicing is configuration
that specifies what to do with each data object
associated with operation. There are two options
defined: Slice and Unchanged. Typical slice
scenario is Slice, when operation has the same
batch for all inputs and outputs, so all
corresponding data object will be "sliced"
(replaced with copy where batch equal to 1).
At some cases, data object should not sliced
(ex. if operation has constant input which
is the same for all input data batches and
so, does not have batch - Add of 2 tensors
with shapes [10, 1000] and [1000]). To
represent such cases there is option
"Unchanged".
At cases when operation should not be sliced
at all (ex. does not have batch, have different
batch for inputs and outputs, has static
batch and so on) SliceConfiguration object will
return false for "hasSlice" method call. In
these cases inputs and outputs methods calls
will throw an exception.
* [IE][VPU][nGraph]: Enables MatMul operation slice
In case of static batch, operation is not going to be sliced,
since for handling such cases other transformation is used.
Such approach allows both passes to co-exist while one is
being replaced with another.
If data input has other dynamic dimension than batch error
will be thrown since Myriad-X plugin does not support
convolutions (HW accelerated operations) with dynamism in
spatial dimensions.
* [IE][VPU][nGraph]: Enables Convolution operations slice
In case of static batch, operation is not going to be sliced,
since for handling such cases other transformation is used.
Such approach allows both passes to co-exist while one is
being replaced with another.
If data input has other dynamic dimension than batch error
will be thrown since Myriad-X plugin does not support
convolutions (HW accelerated operations) with dynamism in
spatial dimensions.
* [IE][VPU][nGraph]: Enables unary eltwise slice
Since extract dynamic batch transformation will handle
dynamism only by batch (so requires body loop to be static)
operations with dynamism in dimension other than batch should
not be covered by loop.
In case of dynamism in dimension other than batch eltwise
will be considered unsupported for sub-graph extraction.
* [IE][VPU][nGraph]: Enables binary eltwise slice
Since extract dynamic batch transformation will handle
dynamism only by batch (so requires body loop to be static)
operations with dynamism in dimension other than batch should
not be covered by loop.
In case of dynamism in dimension other than batch eltwise
will be considered unsupported for sub-graph extraction.
It's template function since different binary eltwise
operations have the same broadcasting rules.
* [IE][VPU][nGraph]: Enables extract dynamic batch transformation
General approach is following:
1. Extracted sub-graphs should have exactly one input and output
operation. Otherwise, it's possible that memory consumption of
model will be increased since loops implementation on Myriad-X
requires to keep all inputs and outputs of loop to be alive
along with memory used by loop body. In layout consolidation
scenario it reflects intention to use minimized amount of
permutations.
2. Extracted sub-graph should not have external connections (
the only nodes that allowed to have predecessor or successor
outside of sub-graph are input and output). Otherwise, it's
possible that memory consumption of model will be increased
for the same reason as in previous point.
To make sure this restriction is met transformation looks
for leaves in both directions, finds corresponding LCA
(Lowest Common Ancestor) and checks if such sub-graph has
external connections. If so, it repeats leaves search
procedure stopping if it approaches leaves from previous
iteration and finds LCA again. It is repeated until
sub-graph without external connections is found (it exists,
at least source itself forms it).
Leaf in current context is a node which satisfies one of
the following conditions (depending on direction):
Top:
1. It has no predecessors which are neither Parameter,
nor Constant
2. It's unknown how to slice this operation
3. It could not be sliced (different batch for inputs and
outputs)
Bottom:
1. It has no successors which are not Result
2. It's unknown how to slice this operation
3. It could not be sliced (different batch for inputs and
outputs)
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
This change fixes the error
Input blob size is not equal network input size (1!=0)
seen when passing a scalar input to a model in the case of VPU plugins.
* Update firmware
* Add the test case from the network
* Disable fp32 case, because in this case the network has output Convert which receives non-inner stride in its input which is not supported now.
* Support FP16 comparator.
* Add `USE_BUILD_TYPE_SUBFOLDER` CMake option to append
`CMAKE_BUILD_TYPE` to output binary directory.
Initialize it to `ON` for UNIX to keep current behavior.
* Remove forced `CMAKE_CONFIGURATION_TYPES` initialization,
use user provided value instead.
This will allow to use single config generators (like Ninja) on Windows
with MSVC compilers and get binaries in per-config sub-folders in the same
way as on UNIX.
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Partially removed cmake duplication with IE cmake
* Deprecated API usage: fixed or suppressed
* Fix for TypeRelaxed
* Canonical form for ngraph includes
* Removed extra visibilit settings; removed graphviz find_package
* Removed var_functions module; canonical includes for ngraph::reference
* Fixed deprecated API in ngraph tests
* Re-use standard cmake macro for shared libs
* Trying to fix ONNX importer tests
Vladimir Gavrilov
Alexander Perepelkin
Ilya Lavrenov
Maxim Vafin
Aleksandr Korolev
Gleb Kazantaev
Liubov Batanina
Gabriele Galiero Casay
Mateusz Tabaka
Krzysztof Bruniecki
Maksim Makridin
Anastasia Kuporosova
Nikita Kudriavtsev
Bartosz Lesniewski
Sergey Lyubimtsev
Evgeny LazarevandAlexander Zhogov
Vladimir ParamuzovandGleb Kazantaev
Vladislav Volkov
Krishna Prabhakaran
Gorokhov Dmitriy
Elizaveta Lobanova
Elizaveta Gerashchenko
Piotr Szmelczynski
Vladislav Vinogradov
Gladilov, Gleb
Mikhail Novozhilov
Abhishek Kulkarni
Dmitry Kurtaev
Andrew Bakalin
Anton Dudchenko
Anton Pankratv
Andrey Sokolov
Pavel Esir
Daria Mityagina