Commit Graph
1862 Commits
Author SHA1 Message Date
Mikhail Letavin 5d5bf97280 [IE CLDNN] Add sub-device support to GPU plugin (#4984) 2021-04-08 11:35:27 +03:00
Vladislav Golubev 0b116620e2 [LPT] Split/VariadicSplit support (#5132)
* [LPT] Split support in ConcatTransformation

* [LPT] fixing functional problems after enabling Split/VariadicSplit transformations

* [LPT] added test case for StridedSliceTransformation, enabled tests with split

* [LPT] ConcatTransformation refactoring

* ConcatTransformation: added axis check

* [LPT] Added foldDequantizationConstant to NetworkHelper & SplitTransformation refactoring

* [LPT] Subgraph: returned and refactored quantizationPerChannel

* [LPT] foldDequantizationConstant refactoring

* [LPT] SplitTransformation refactoring

* [LPT] hbonets fix & ConcatTrasnformation refactoring

* [LPT] ConcatTransformation functional tests quick fix
2021-04-08 08:42:59 +03:00
Mateusz Tabaka c17c92a72d Disable AddFakeQuantizeFusion and MulFakeQuantizeFusion (#5127) 2021-04-07 23:07:36 +03:00
Alexandra Sidorova 325b5564f3 [CPU] Added GELU-7 support (#4800) 2021-04-07 16:01:47 +03:00
Anton Potapov 54b6c77202 [PP] Support for FP16 in Reorder cases (#4427)
- added basic support for FP16 (plain wrapper over int16_t)
 - extended Split/Merge operations to support it
 - tests
2021-04-07 14:57:52 +03:00
Szymon Irzabek 2486c5b90a GNA low precision (#4109)
* [GNA] Add low precision support for some layers (affine, eltwise, ReLU, sigmoid)

* [GNA] Fix convolution and scaleshift regression fail

* [GNA] Fix const scale factor calc

* [GNA] Fix extra whitespace

* [GNA] Eltwise padding and low precision primitive creation support

* [GNA] Changes after review

* [GNA] Remove INPUT_PRECISION GNA flag

Remove INPUT_PRECISION flag, all references to it
and tests using it. Other minor stylistic changes and cleanup.
2021-04-07 14:28:24 +03:00
Edward Shogulin 7f3d715f5d Revert "[LPT] Split & VariadicSplit support (#4195)" (#5129)
This reverts commit 7877287301.
2021-04-07 12:12:34 +03:00
Vladislav Golubev 7877287301 [LPT] Split & VariadicSplit support (#4195)
* [LPT] Split support in ConcatTransformation

* [LPT] fixing functional problems after enabling Split/VariadicSplit transformations

* [LPT] added test case for StridedSliceTransformation, enabled tests with split

* [LPT] ConcatTransformation refactoring

* ConcatTransformation: added axis check

* [LPT] Added foldDequantizationConstant to NetworkHelper & SplitTransformation refactoring

* [LPT] Subgraph: returned and refactored quantizationPerChannel

* [LPT] foldDequantizationConstant refactoring

* [LPT] SplitTransformation refactoring

* [LPT] hbonets fix & ConcatTrasnformation refactoring
2021-04-07 11:02:43 +03:00
hyunback kim 6c290a506f [IE CLDNN] Support broadcasting in etlwise b_fs_yx_fsv16 (#4996) 2021-04-07 09:28:53 +03:00
Gabriele Galiero Casay 91a8de127d Convolution group operations alignment (#4387)
* Convolution: Enhance dynamic shape inference of validate and infer types method

* Convolution: Change onnx test with dynamic shapes to float element type

* Convolution: Remove test instances with integer precision

* Convolution: Add backticks to types in spec

* Convolution: Change element type variable for output element type

* GroupConvolution: Add backticks to types in spec

* GroupConvolution: Enhance dynamic shape inference of validate and infer types method

* GroupConvolution: Remove serialization test instances with integer precision

* GroupConvolutionBackpropData: Remove serialization test instances with integer precision

* GroupConvolutionBackpropData: Enhance dynamic shape inference of validate and infer types method

* Convolution: Add helper function to validate convolution parameters in ref impl

* Convolution: Rewrite lambda to capture spatial dims of filters in validate and infer types

* GroupConvolution: Refactor reference implementation

* Remove call to old implementation of convolution using dilations
* Added validation method to validate shapes

* GroupConvolutionBackpropData: Add more type_prop unit test and refactor test names

* Convolution: Extended validation of convolution parameters in reference implementation

* GroupConvolution: Extended validation of group convolution parameters in reference implementation

* GroupConvolutionBackpropData: Add helper function to validate convolution backprop parameters in ref impl

* Clean up unnecessary lines

* BinaryConvolution: Use validate helper function from convolution ref impl

* Convolution: Refactor validate and infer types to improve readability

* BinaryConvolution: Refactor validate and infer types to improve readability

* Convolution: Add explicit tensor shape dims for inputs and outputs in spec

* BinaryConvolution: Add explicit tensor shape dims for inputs and outputs in spec

* GroupConvolution: Add explicit tensor shape dims for inputs and outputs in spec

* Add helper function to infer convolution forward output shape

* Convolution: Refactor validate and infer types to use helpers to infer output shape

* BinaryConvolution: Refactor validate and infer types to use helpers to infer output shape

* GroupConvolutionBackpropData: Fix formula to calculate output shape in validation functions

* Remove symbol to export convolution output shape inference function

* GroupConvolution: Add validation checks for input channels dim of data batch and filter shape

* GroupConvolutionBackpropData: clean up type prop tests

* Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes

* GroupConvolutionBackpropData: Correct layout of filters input

* GroupConvolution: Deduce groups from inputs shape during output shape inference

* Change spec supported types of convolution operations to any numeric type

* Revert "GroupConvolution: Remove serialization test instances with integer precision"

This reverts commit 781c2570d6.

* Revert "GroupConvolutionBackpropData: Remove serialization test instances with integer precision"

This reverts commit 9a6ac23968.

* Revert "Convolution: Remove test instances with integer precision"

This reverts commit 0b07052a62.

* Revert "Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes"

This reverts commit c9f5944b6b.

* Revert "Convolution: Change onnx test with dynamic shapes to float element type"

This reverts commit 1f4202b010.

* Allow integral types in validate and infer types method for convolution group of operations

* Add i32 precision in single layer tests for convolution group of operations

* BinaryConvolution: Fix shape of input and output tensors in spec

* Address nitpick comments
2021-04-06 14:36:12 +03:00
Elizaveta Gerashchenko 1bb5a5871a [IE CLDNN] Improved undef generation (#4762) 2021-04-06 12:59:52 +03:00
Vladislav Golubev a478475386 [LPT] Concat*Transformation: handled FQ with unexpected quantization levels (#5111)
* [LPT] TRANSFORMATION_EXCEPTION segfault fix

* [LPT] Concat*Transformation: handled FQ with unexpected quantization levels

* [TESTS] Concat*Transformation: added test-cases with unexpected quant levels
2021-04-06 12:13:47 +03:00
Sergey Lyubimtsev f438a3a321 Add entry point for model optimizer as 'mo' alias (#5052)
* Add entry point for model optimizer as 'mo' alias

* Add entry point for mo package
2021-04-06 10:41:44 +03:00
Kelvin Choi 9c11f38aba [IE CLDNN] ScatterNDUpdate: Fix Klocwork issue (#5027)
Signed-off-by: Kelvin Choi <kelvin.choi@intel.com>
2021-04-06 09:15:21 +03:00
Anna Khakimova 26801c14e9 * SIMD opt for the Resize 32F1C (#5025) 2021-04-05 19:00:25 +03:00
Vladimir Zinoviev e2ada66826 [LPT] Mixed precision GPU Plugin tests (#4498) 2021-04-05 18:04:34 +03:00
Irina Efode 7d0cc01c1b Update merge_xmls.py (#5103) 2021-04-05 14:51:26 +03:00
Evgenya StepyrevaandGleb Kazantaev 4673cc2d25 [ Transpose sinking ] Transpose->FQ->Reduce (#5026)
* Utils: make_try_fold, clone_try_fold. Template node creation and attempt to fold it

* RTTI for ArithmeticReduction(KeepDims)

* Enriched ngraph::get_default_order overloads with ones for dynamic shape and rank

* [ Transpose sinking ] Transpose->FQ->Reduce to FQ->Reduce->Transpose

* Style: deleted empty line

* RTTI in Reduction operations

* RTTI for LogicalReductionKeepDims

* Transpose: optimizations moved from algebraic simplification to TransposeSinking

* renamed file

* Fix test

* keep_dims is always initialized

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
2021-04-05 13:29:21 +03:00
Yunji Kim 71d56ee149 [IE CLDNN] lower the tolerance of scatter elements update fusing test from 1 to 1e-5 (#4953) 2021-04-05 09:54:56 +03:00
Katarzyna Mitrus 69cd2deb2c DefromablePSROIPooling shape inference update (#4897)
* Test dynamic interval batch dim propagation

* Fix interval batch dim propagation

* Additional shape and attributes checks

* Update type_prop tests

* Comment update

* Update ngraph_reader test

* Revert group_size dims check

* Update class docs

* Fix mode init value

* Add new ngraph reader test with correct pooling mode

* Comments update

* Update error messages

* Update rank checks to use compatible

* Add newline at EOF

* Update ngraphReader test names
2021-04-03 20:19:28 +03:00
Alexey Suhov 6a16b70e0e setupvars and demos: Fix getting script dir on macOS 10.15 with with default zsh shell (#5094) 2021-04-02 21:37:21 +03:00
Irina Efode 812175268a [IE TESTS] Fix conformance test names (#5095)
* [IE TESTS] Fix conformance test names

* sdl;

* APPLY COMMENTS FROM MIKHAIL
2021-04-02 17:46:50 +03:00
Alexey Lebedev 3a6fba913c [IE Tools] replace .format on f-string (#4970)
* replace .format on f-string in cross_check_tool

* Replace f-string on .format in utils.py

* replace f-string in benchmark tool

* Replace .format on f-string in benchmark tool

* Add f-string after update

* Fix some lines

* Fix utils
2021-04-02 14:50:57 +03:00
Mikhail Treskinanddependabot[bot] 89b876b592 Add constant subgrpahs handling in extractor (#5079)
* Initial summary dumper implementation

* Handle Tensoriterator body + add parser script

* Bump tox from 3.20.1 to 3.21.2 in /ngraph/python (#32)

Bumps [tox](https://github.com/tox-dev/tox) from 3.20.1 to 3.21.2.
- [Release notes](https://github.com/tox-dev/tox/releases)
- [Changelog](https://github.com/tox-dev/tox/blob/master/docs/changelog.rst)
- [Commits](https://github.com/tox-dev/tox/compare/3.20.1...3.21.2)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Remove extra main files

* Fix constant subgraphs on operation ports handling

* Rollback accident change of GPU device name in test_constants.hpp

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-04-02 12:58:45 +03:00
Vladislav Golubev d7a2d13152 [LPT] AddTransformation fix (#5022)
* [LPT] AddTransformation fix

* [LPT][TESTS] FunctionalTests: added test-case with AddTransformation without convert
2021-04-02 12:41:53 +03:00
Irina Efode bf1b7ef19c [IE TESTS] Fix input generation for reduce ops (conformance) (#5070)
* [IE TESTS] Fix input generation for reduce ops (conformance)

* Apply review
2021-04-02 11:50:43 +03:00
Elizaveta Lobanova df5e0d68aa [GNA] Enable convolution in height dimension for NHWC native models (#4864) 2021-04-02 09:35:50 +03:00
Artemy Skrebkov dca99aed64 Fix benchmark_app to update app_inputs_info correctly (#4994)
* Fix benchmark_app to set app_inputs_info

* Keep U8 precision only for images by default

* Review fixes

* Fix a typo
2021-04-01 19:20:33 +03:00
Elizaveta Lobanova 27268f008e [GNA] Fix transformation from NCHW to NHWC for 4d concat (#4852)
Add additional checks for transformation from NCHW to NHWC
2021-04-01 18:38:30 +03:00
Mikhail Nosov 4021cb7519 Caching support of multi-device scenario (#5040)
* Caching support of multi-device scenario

- IE_CORE: introduce CacheGuard which can create locks for specific cache identified by 'hash'
- Added functional tests for it

Fixes of Thread Sanitizer failures:
- ngraph::Serialize - m_ref[i] can create new element, casted to 'const' to avoid this
- ngraph::get_opset oprations: reworked to use std::call_once instead of double bool check

* Added docs for ie_cache_guard.hpp

* Fix Debian 9 compilation issue

* Fix build for CentOS 6

Added assert to verify that table of locked hashes is empty on destruction

* Fixed review comments
2021-04-01 14:42:48 +03:00
Aleksandr Korolev ce5aa7dc1b [IE][VPU]: fixing wrong threads behavior in mvnc_api.c (#5053)
Lock global mutexes while locking all inferences to prevent unlocking all inferences on all devices including just opened
2021-04-01 14:17:29 +03:00
Mikhail Ryzhov 8c50c3d155 [PyPI] Fixed dependency conflict (#5013)
* Minimize dependencies for openvino-dev package

* Changed numpy version to satisfy opencv-python dependency
2021-04-01 13:25:22 +03:00
Sergey Lyubimtsev b55be5594b compression.configs.hardware config to package_data (#5044) 2021-04-01 12:20:20 +03:00
Kate Generalova 26adcd1a61 doc: update README for C samples, add comments (#4780)
* doc: update README for C samples, add comments

* samples: revert extension library settings for CPU only

* add validated image formats to samples README

* add output to c samples README

* add device check for xml config option
2021-04-01 11:11:49 +03:00
Krzysztof Bruniecki 77d4fbc286 [GNA] Disable AddFakeQuantizeFusion (#5037)
* issue 52034
   * as per-channel quantization not supported in FQ layer in GNAPlugin
2021-03-31 18:21:04 +03:00
Sergey Nesterov 542a35794f Remove old code which isn't needed anymore (#5024) 2021-03-31 15:56:20 +03:00
Szymon Irzabek 1128a0c2e6 [GNA] Remove HW version enforcement when exporting a model (#5005)
* [GNA] Remove HW version enforcement when exporting a model

* [GNA] Use output index constant instead of literal
2021-03-31 14:11:57 +03:00
Bartosz Lesniewski 5363c8dc70 Compression of constants during serialization (#4846) 2021-03-31 13:10:24 +02:00
Mikhail Letavin e05e05ccf3 [IE CLDNN] Add normalizing reshapes after LSTMCell outputs (#4755) 2021-03-31 14:01:22 +03:00
Taylor Yeonbok LeeandDonghyeon Jeong b58c648d2d [IE CLDNN] Build time optimization for OCL kernels (#4725)
Build OCL kernel batches of different buckets in parallel

Co-authored-by: Donghyeon Jeong <donghyeon.jeong@intel.com>
2021-03-31 10:22:19 +03:00
Patryk ElszkowskiandPatryk Elszkowski 61f7791b16 fix not initialized value - reported by klocwork (#4998)
Co-authored-by: Patryk Elszkowski <patryk.elszkowki@intel.com>
2021-03-30 17:31:45 +03:00
Mateusz Tabaka 0c38a9e4d3 Fix MulFakeQuantizeFusion with output low/high other than f16 (#5006)
Ticket: 51964
2021-03-30 16:53:59 +03:00
Mateusz Tabaka acf778d655 Disallow SoftmaxFusion when input rank is greater than 5 (#5028) 2021-03-30 14:43:35 +02:00
Anastasia Kuporosova a26aad1cfa [Python API] Skip several tests if device is ARM (#4646) 2021-03-30 15:16:48 +03:00
Liubov Batanina 2f257a2955 Added GenerateInput to Reduce tests (#5004)
* Added GenerateInput to Reduce tests

* Skip ReduceProd CPU tests
2021-03-30 15:06:36 +03:00
Irina Efode b4a2ac9d1c [IE TESTS] Fix issue with report merge (#5031) 2021-03-30 12:14:35 +03:00
Anastasia Kuporosovaandanastasia.kuporosova 38bb66741f [Python API] use parametrize in blob tests (#5020)
Co-authored-by: anastasia.kuporosova <akuporos@akuporos.inn.intel.com>
2021-03-30 11:45:05 +03:00
Gabriele Galiero Casay 902a89b582 Revise Clamp reference implementation (#4813)
* Operation class review

* Remove clamp from FusedOp
* Add node validation checks
* Add type_prop unit tests

* Move backend unit tests into a separate file

* Remove unnecessary includes

* Add support for i8, i16, u8, u16 and bf16 precisions

* Refactor backend unit tests

   * Remove instance with f64 precision
   * Move dynamic shape tests to op_eval
   * Group failing tests into manifest

* Add single layer tests and serialization tests

* Skip tests with conversion due to plugin misbehavior

* Add unit tests fails to manifest with documented issues

* Fix centos7 test to skip slt cpu instances of integer precision

* Enable dynamic test for float element type

* Address review comments
2021-03-29 22:53:34 +03:00
Anton Voronov 4d112b1f90 [CPU] returned old behavior for fp32 avx2 1x1 conv with dw conv fusing (#4484) 2021-03-29 13:55:13 +03:00
Ilya Churaev de50ecfa32 Fix int4 conversion (#4983)
* Fix int4 conversion

* Simplify logic
2021-03-29 10:28:30 +03:00