* corrected negative batch_dims normalization, some improvements in dynamism for Gather_7
* corrected transformation
* added batch_dims and axis normalization for reference
* updated INTERPRETER backend tests; replaced sizet_t -> int64_t in Gather evaluate
* returned back size_t in reference
* made Gather-1 source compatible with previous ngraph library versions
* added unittest for v7->v1, with nonzero batch_dims transformation should not be executed
* fix axis validation error message
* fix batch_dims gettter
* fixed v7->v1 unittest for nonzero batch_dims
* Add visitor test, separate backend test from common fused op file
* Add SSLT, separate empty axes squeeze case in SLT
* Add unsqueeze to trusted op list
* removing trailing whitespaces
* Add missing newlines at file end
* Review comments - actually running backend tests, fixed typo in visitor test
* add type_prop and backend tests for gelu op
* add visitor test for gelu op
* add additional type_prop and backend tests and remove gelu from manifest
* resolve conflicts
* fix indentation and remove unecessary includes
* remove gelu from manifests
* Add serialization single layer tests for reduction operations
* Add ReduceSum to the list of trusted ops
* Minor changes in single layer tests for reduction ops
* Implement AUTO plugin
Usage:
1. -d AUTO
2. -d ""
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Add tests for AUTO plugin
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* cleaned impl, that was incorrect from the async perspective, ansl also capturing the blobs in the constructor
* Revert benchmark_app modification
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Address reviewer's comments: need CI tests to verify
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
Co-authored-by: myshevts <maxim.y.shevtsov@intel.com>
* revise unsqueeze op class
* Added checks and tests for second input incorrect type and shape
* Remove axes type constraints to keep backward compatibility
* Reference implementation init
* Backend tests
* Single layer tests
* Update offset range in layer tests
* Align int types with ng op
* Update spatial bins type
* Type update
* Fix sub bin calculation in mkldnn plugin
* Update summarize py file
* Align result type
* Refactoring
* Apply review comments
* Add serialize layar tests
* Adjust int comparison
* Adjust code style
* Use clamp reference
* Unify style
* Additional check for negative output dim
* Set tensor output shape in evaluate
* Add visit attributes test
* Small refactor
* Code style (namespace comments)
* Fix CommonTestsUtils::fill_data_roi usage.
This function was generalized in PR #5432 and its siganutre has changed.
* Update licenese header with mention about original authors.
* Replace MIT SPDX full license name with short identifier.
* Fix sub bin calculation in mkldnn plugin
Co-authored-by: jdanieck <jozef.daniecki@intel.com>
* Execute MO stages inside subprocess to have single IE check
* Add --transform key
* Updated ofline transformations to execute user specified passes; updated logic to raise when --transform is used
* Parametrize LowLatency transformation with num_iterations key
* Fixed MO and IE versions comparision
* Use subprocess for offline transformations execution to catch errors
* remove ie_is_available from IR; fixed typo
* Fix for old IE versions
* Update parse_transform key unit tests
* Show available transformations
* Fixed typo
* Fix review comments
* Fix python2 compatibility
* Fixed review comments
* Fixed __main__ import
Some C++ Standard Library headers have been changed in gcc 11 to no
longer include other headers that they do need to depend on.
Include exception explicitly to avoid:
| inference-engine/src/plugin_api/ie_system_conf.h:21:31: error: 'exception_ptr' in namespace 'std' does not name a type; did you mean 'exception'?
| 21 | INFERENCE_ENGINE_API_CPP(std::exception_ptr&) CurrentException();
| | ^~~~~~~~~~~~~
Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
* Fix python_tools benchmark installation location
Before this fix, when running "make install", the benchmark python files
would be installed under <python_dest_dir>/openvino/tools, instead of
<python_dest_dir>/openvino/tools/benchmark. This commit fixes this.
* Alternative implementation
* Add Serialization SLT for Convert op.
* Add comment with explanaition to convert ref impl.
* Refactored backend tests for Convert operation.
* Give better names to backend tests.
* Add more backend unit tests.
* Fixed tests related to u1/u4/i4 types.
* Refactor backend tests
* Rewrite reference implementation
* Align ref impl signature with order of inputs in v5
* Remove legacy code for training and backprop
* BarchNorminference operation class review
* Use reference to const in helpers to validate input shapes
* Refactor type_prop tests to cover v0 and v5
* Add type_prop tests
* epsilon attribute test with invalid value
* invalid integer input types
* Add serialization single layer test
* Add attribute visitor test
* Fix arm plugin test failure with dynamic element type
* Remove CoordinateTransform index call
* Add attribute count to visitor test
* nG Python api for Gather and IE IR reader tests
* also included old IE IR reader test for Gather1
* added a blank line before Gather
* style corrections
* applied review comments
* removed blank line
* removed xfailed for Gather7 with batch_dims since CPU was moved to nGraph (...allows to fallback node execution on ngraph evaluate() method in case if optimized implementation is absent)
* added new visitor tests
* [CPU] Do not set BF16 on input port for Eltwise after Input
Since Eltwise supports conversion to BF16
Thus unnecessary Reorder is avoided
* Create a separate function for enforcing BF16 on ports
* Add test to verify that no extra Reorder is inserted
Also:
- update legacy test
- remove extra code which is not applicable anymore
* Correct expected precision in legacy test
* Enhance dynamic shape inference of validate and infer types method
* Review op class of DeformableConvolution
* Add node validation checks into validate and infer types specific to element type and shape of inputs
* Refactor validate and infer types method to use common function to validate conv parameters and infer output shape
* Apply these changes to Convolution and BinaryConvolution for alignment
* Add type_prop unit tests
* Add node validation checks for deformable values spatial dimensions
* Fix type_prop and python api shapes
* Fix deformable values spatial dimensions
* Add validation checks in reference implementation
* Address review comments
* Remove reference to const for basic types in ref impl
* Update comment with ticket to add check for u1
* Change deformable values to offset to align with spec
* Add ngraph visitor tests for reduction operations
* Add check for number of expected attributes
* Add ReduceL1 and ReduceL2 to visitor test typed case of reduce ops
* Instantiate reduce operation type in separate file
* initial solution
* added unit-tests + some corrections
* axis getting improvements
* fixed MO IR reader for old IR's
* a couple of corrections
* applied review comments
* corrected negative batch_dims normalization for shape calculation, for IR original negative values are kept
* added additional checks and negative tests