Commit Graph

4739 Commits

Author SHA1 Message Date
Egor Shulman
bdaa44d0be
Fixed Minimum op if u8/16/32/64 data type is used (#6665) 2021-09-15 07:52:46 +03:00
Anastasia Popova
0d76993429
Fixed issue with memcpy(). (#7416)
* Fixed Klocwork issue with memcpy().

* Code style.
2021-09-15 07:51:03 +03:00
Piotr Szmelczynski
ffef5bdff2
Avg pool bug fix (#7493)
* modify avg_pool ref impl to work with n_elements = 0

* add avg_pool backend test

* fix bug with division by 0
2021-09-15 07:50:30 +03:00
Katarzyna Mitrus
f5cd75a084
New Slice-8 ngraph op shell (#7304)
* init Slice ng op

* Init Slice op tests

* Add visitors test

* Output shape inference

* Add default axes calculation

* Add static output shape tests

* Remove default axes input injection

* Update default axes calculation

* Dynamic data rank case

* Update unordered axes case

* Add support for out dim bounds for unknown input values

* Add more tests

* Update headers and namespace

* Add step value check

* Full dynamic shapes support

* Fix type in attribute tests

* More typeprop tests

* Move Slice-8 to openvino api

* More validation cases

* Update opset8 operations count test
2021-09-15 07:25:42 +03:00
Anastasia Popova
cf48792134
Random Uniform MO implementation (#6694)
* Added RandomUniform operation.

* Conflicts fix.

* Fix conflicts.

* Fix conflicts.

* Added ONNX extractor, fixed FP16 conversion, added double implementation.

* int32, int64 types.

* Added initial type attribute.

* Added extractors for MxNet and TF for RandomUniformInt.

* Fixed ChangeRandomUniformOutputType transformation.

* Corrected ONNX, MxNetextractors.

* Fixed extender.

* Code style corrected, updated BOM file.

* Small correction.

* Code reformat.

* Fixed type check.

* Small corrections, code style.

* Added RandomUniform tests to manifest file.

* Include fixed.

* Code style.

* Small corrections.

* Tests fixed.

* Manifest file updated.

* Removed initial type attribute.

* Small correction.

* Fixed problem with Const types change.

* Update ngraph/core/include/ngraph/op/random_uniform.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update ngraph/core/src/op/random_uniform.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update ngraph/core/src/op/random_uniform.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Applied comments to shell implementation.

* Applied comments to shell implementation.

* Moved shell and reference to separate PR.

* Moved shell and reference to separate PR.

* Corrected comments, code refactoring.

* Fixed seed attributes.

* Corrected mxnet extractor.

* Returned RandomUniform onnx extractor.

* Small fix.

* Used generator in tests, fixed input ports count in AttributedRandomUniform.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Moved DropoutWithRandomUniformReplacer to ngraph, removed debug output.

* Fixed wrong change.

* Fixed wrong change.

* Added check that RandomUniform is in ShapeOf subgraph.

* Added layer tests, updated supported operations list.

* Small correction.

* Fix conflicts.

* Fix conflicts.

* Small fix.

* Used const for not changing values.

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Added IR check in layer tests.

* Fixed error.

* Fixed test.

* Update inference-engine/src/transformations/include/transformations/common_optimizations/dropout_with_random_uniform_replacer.hpp

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Removed ShapeOf and Mul from DropoutWithRandomUniformReplacer.

* Replaced register_new_node with make_shared.

* Added fp16 test.

* Extended for RandomUniform->Convert case.

* Used modf().

* Removed modf().

* Update inference-engine/src/transformations/src/transformations/common_optimizations/dropout_with_random_uniform_replacer.cpp

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Added negative tests, added nullptr check for add_const_value.

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
2021-09-14 21:26:57 +03:00
Alina Kladieva
fda3f5d237
[requirements] Set TF to 2.5.0 (#6620)
* [requirements] Set TF to 2.5.0

* [ngraph|paddlepaddle|requirements] Gast to 0.4.0

(required for TensorFlow 2.5)

* [ stress_tests/scripts/requirements] Upd versions

* [time_tests/test_runner/requirements] Upd versions

* [ngraph|paddle|requirements] Paddle strict major

* Gast version to 0.3.3

* Update requirements_dev.txt
2021-09-14 18:05:18 +03:00
Andrey Somsikov
ae64b5e202
Exclude 3rd party python packages from lsan (#7489)
When executed with PYTHONMALLOC=malloc lot of leaks
reported on the 3rd parties of the python tests.
Muting those leaks.
2021-09-14 17:48:23 +03:00
Aleksandr Pertovsky
a4b75b7b67
[CPU] Add check for MKLDNNDeconvolutionNode for int8 execution (#7201) 2021-09-14 17:38:13 +03:00
Vladislav Volkov
c06a51f2bf
[CPU] Models cache for CPU plugin (#6403) 2021-09-14 16:02:47 +03:00
Ilya Churaev
7ea1960b99
Revert shape renaming (#7490)
* Rename ov::Shape to ov::PartiaShape

* Rename StaticShape to Shape

* Fixed code style

* Fixed merge conflict
2021-09-14 15:10:05 +03:00
Mateusz Tabaka
2c4009e3d8
Add support for com.microsoft.BiasGelu operator (#7480) 2021-09-14 13:02:31 +02:00
Dmitrii Khurtin
ba34a1989c
[GNA] Expanding transformations: swap_input_matmul and handle_transposes_around_matmul (#7333)
* Expanding transformations: swap_input_matmul and handle_transposes_around_matmul

* insert_reshape_around_matmul

* fixed failed of smoke tests
2021-09-14 13:39:33 +03:00
Mateusz Tabaka
39120a7f62
Add MulConvFusion transformation (#6951)
* Add MulConvFusion transformation

This transformation is applied to a following graph:

```
   +-------+   +----------+
   | Input |   | Constant |
   +-------+   +----------+
       |            |
       ------  ------
            |  |
            v  v
         +----------+            +---------+
         | Multiply |            | Weights |
         +----------+            +---------+
              |                       |
              -----------    ----------
                        |    |
                        v    v
                   +----------------+
                   | Convolution Op |
                   +----------------+
```

and converts it to:
```

                           +---------+   +----------+
                           | Weights |   | Constant |
                           +---------+   +----------+
                                |            |
                                ------  ------
                                     |  |
                                     v  v
          +-------+              +----------+
          | Input |              | Multiply |
          +-------+              +----------+
              |                       |
              -----------    ----------
                        |    |
                        v    v
                   +----------------+
                   | Convolution Op |
                   +----------------+

```

Since 'Weights' are constants in most cases, the right hand side gets constant folded,
and we eliminate Multiply node.

Ticket: 52283

* Handle GroupConvolution, ConvolutionBackpropData, GroupConvolutionBackpropData in separate transformations

* Handle dequantization subgraph

* add namespace

* add more ngraph namespace

* address review comments
2021-09-14 12:52:27 +03:00
Anton Pankratv
5e6896d03a
Reverted to Remote Context (#7453) 2021-09-14 12:49:24 +03:00
Elizaveta Lobanova
651f07b4ff
[GNA] Fix permute precision handling (#7466)
* [GNA] Fixed precision handling for permute

* [GNA] Functional test is added

* Applying comments
2021-09-14 12:43:34 +03:00
Henry Fuheng Wu
7328ee1e35
fix build issue due to implicit-const-int-float-conversion and remove unused lambda function (#7470)
* fix build issue due to implicit-const-int-float-conversion and remove unused lambda function

* just remove it instead of commenting out

Co-authored-by: FuhengWu@Oracle <fuheng.wu@oracle.com>
2021-09-14 11:14:44 +03:00
Ilya Sharikov
4aad638d15
Fixed test runner (#7498) 2021-09-14 11:07:21 +03:00
Mikhail Nosov
2236c6105b
[OV20] Layout class implementation - basic API (#7452)
* Draft

* More tests

* to_string + advanced_syntax + more tests

* Coding style

* Add mean/scale - vector version with layout support

Vector version requires layout to be set

* Added comments to LayoutRank

* Removed unnecessary public API
- Removed setters
- Removed LayoutRank from public classes

* Review comments:
- Rename 'layouts' namespace to 'layout'
- 'get_index_by_name' - specify throw exception type
2021-09-13 19:02:22 +03:00
Maxim Shevtsov
3bec32449f
OV Performance Hints (CPU and GPU logic for selecting the actual configs), while AUTO/MULTI are passing them thru) (#6993)
* rebasing the perf-modes-2021.3 to the 2021.4

Caveats:
the (explicit) setting #streams is not disabled (as it was before for experiments with DLBenchmark), and the logic slighlty differ (streamsSet)

(cherry picked from commit 1ae1edc0ed)

* overriding streams (to force the TPUT mode to the DLBenchnark)

(cherry picked from commit 7f506cda31)

* disabling reducing #streams to fully mimic baseline c4df94d42d of the 2021.3 (before experiments)

(cherry picked from commit 85073dd1dd)

* clang/identation

(cherry picked from commit 050a4155a9)

* splitting the Transformation to general and CPU specific.

Now hopefully,this fully mimics the  baseline c4df94d42d of the 2021.3 (before experiments), as the streams reduce num (as well as early exit on GRU/LSTM/TensorIterator) is deisabled

(cherry picked from commit e98b2c1a67)

* disabling GRU/LSTM/TI + reducing of streams + 5D considered compute-limited only for int8

(cherry picked from commit 32b8d80dee)

* refactored to avoid compute_limited_ratio, reverted the reducing #streams, removed LSTM from limitations

(cherry picked from commit f2b972171b)

* isa-based threshold logic

(cherry picked from commit b218457e1a)

* mode->hint

(cherry picked from commit ec20aa8eca)

* optional PERFORMANCE_HINT_NUM_REQUESTS

(cherry picked from commit 5a3883e3f3)

* moving the perfHints to the common OV config class + initial tests (CPU only, as the actual AUTO/MULTI should be accommodated on the master)

(cherry picked from commit (then fixed)45bafe7d527f466507dea0693aeed51be4ebf776)

* AUTO support for PerfHints

* MULTI support for PerfHints

* Enabling Perf hints for the GPU plugin

* brushing settings output a bit

* disabling "throughput" perf hint being default (until OV 2.0)

* uncommenting the logic which was disabled to force the DLBenchmark to use the throughput mode by default

* removing dead and experimental code, and debug printfs

* clang/code-style

* code-review remarks

* Moved the output of the actual params that the hint produced to the right place

* aligning MULTI's GetConfig beh to HETERO's as captured in the preso (CVS-59960) ratified with the ArchForum

* clang

* benchmark_app brushing

* Update inference-engine/samples/benchmark_app/README.md

* propagating the perf hints thru one more scenario in the merged AUTO-MULTI

* fixed mispint

* Python benchmark_app update for perf hints

* addresssing reviewers comments on the python benchmark_app

* simplifying/brushing logic a bit

* refactor the heuristic to the separate file (to be shared with iGPU soon)

* refactor conversion of modes to the specific GPU config per feedback from Vladimir
2021-09-13 15:40:36 +03:00
Anton Pankratv
2793963e6f
added openvino runtime plugin (#7259) 2021-09-13 14:25:52 +03:00
Ilya Lavrenov
b373cb844b
Removed information about FPGA plugin (#7474) 2021-09-13 14:01:49 +03:00
serhii-pavlovskyi-altran
b11b1d44cb
Use one set of parentheses around gcc attribute deprecated arg (#7413)
Double parentheses break some other compilers which pretend to be gcc.
Single set doesn't seem to break anything.
2021-09-13 13:56:43 +03:00
Evgeny Talanin
10505809ec
Add apt update (#7483) 2021-09-13 13:39:42 +03:00
Ilya Lavrenov
47aad8e67e
Small fixes in cmake (#7472) 2021-09-13 12:57:10 +03:00
Valentin Dymchishin
07a3dc6b36
[47750] Validate conditional compilation with models from OMZ (#7207)
* [47750] Validate conditional compilation with models from OMZ

* [47750] Remove model

* [47750] Use generator expression

* [47750] Use f-strings

* [47750] Use resolve() instead of abs_path()

* [47750] Use cmd_exec() instead of subprocess.check_output()

* [47750] Use download_models fixture in test_cc_collect, test_verify

* [47750] Update prepare_models

* [47750] Update test_infer

* [47750] Add models

* [47750] Use custom logger

* [47750] Refactor prepare_models usage

* [47750] Rename model_struct to model

* [47750] Update help description

* [47750] Add function description for prepare_models, prepare_omz_model

* [47750] Move OMZ_NUM_ATTEMPTS to global scope

* [47750] Rename models to model

* [47750] Add "type" property in model

* [47750] Add default path for cache

* [47750] Remove conversion to str

* [47750] Rename prepare_models to prepared_models

* [47750] Remove redundant expand_env_vars call

* [47750] Use lower case "omz" in test_config; do not use default value

* [47750] Use only prepared_models in tests, without models in arguments

* [47750] Remove "framework" property in test_config

* [47750] Use omz_path and omz_cache_dir fixtures

* [47750] Make omz_cache_dir optional

* [47750] Remove validate_path_arg for omz_cache_dir

* [47750] Add validate_path_arg and log.warning for omz_cache_dir

* [47750] Add default value for omz_repo

* [47750] Use OMZ_MODELS_PATH environment variable

* [47750] Use tmpdir instead of OMZ_MODELS_PATH; use precision in test_id_list

* [47750] Update README.md

* [47750] Remove model_path variable

* [47750] Remove try/except for omz_path

* [47750] Rename omz_path to omz_repo
2021-09-13 11:47:04 +03:00
Luo Cheng
11c42885be
StridedSlice beg/end_mask should be a non empty list (#7396) 2021-09-13 11:22:02 +03:00
Ivan Novoselov
cb0d6db4c5
[CPU] Disable NotImpelmented exceptions mechanism for generic node. (#7242) 2021-09-13 11:20:43 +03:00
Chenhu Wang
2093af4f8a
[CPU] DO optimization (#6360) 2021-09-13 11:12:03 +03:00
Victor Kuznetsov
92445d4b80
add new exec with vpu compiler option (set config with MLIR compiler) (#7420) 2021-09-13 10:52:06 +03:00
Victor Kuznetsov
8fa386b9ad
[Memory tests] Add new tests (#7306)
* add memory_tests

* change readme, add versions to requirements file
2021-09-13 10:47:30 +03:00
Alexandra Sidorova
eae448e74a
[CPU] Added inplace support for concat with axis != 1 (#6864) 2021-09-13 10:30:39 +03:00
Irina Efode
b3d6d11a99
[IE TESTS] Move SKIP macro from test bodies to SetUp() in InferRequestCancelation & Move Infer_Request_dynamic tests to the correct folder (#7299)
* try to fix behavior

* Try

* Revert changes

* Update behavior_test_utils.hpp

* Move Deynamic_tests

* fix build

* fix

* Init
2021-09-13 10:09:36 +03:00
Ilya Sharikov
f44369ce4e
Updated requirements (#7397) 2021-09-13 08:50:23 +03:00
Zhang Yi
f1f737636e
[Frontend][Paddle]Handle Exception in Op Conversion. (#7296)
* [Frontend][Paddle]Handle Exception in Op Conversion.

* [Frontend][Paddle]revise comments

* [Frontend][Paddle]add tests for error handling

* [Frontend]fix typo

* [Frontend][Paddle]relax model version check to 2.0.0

* [Frontend][Paddle]fix typo
2021-09-13 08:23:15 +03:00
Dawid Kożykowski
0bc17a2f55
update subgraph test classes (#7383) 2021-09-13 07:19:30 +03:00
Dawid Kożykowski
3afc0342eb
update shared tests classes (#7385) 2021-09-13 07:18:48 +03:00
Ilya Lavrenov
13321e4ab6
Trying to re-use OpenVINOConfig.cmake (#7467)
* Trying to re-use OpenVINOConfig.cmake

* Add ngraph
2021-09-13 07:12:07 +03:00
Szymon Durawa
c50c0d59bb
Add default constructor for op. (#7368)
* Add default constructor for op.

* Apply correct format.

* Apply correct format for py files.

* Remove underscore prefix, add create overlaod method.

* Resolve use cases for parameter arguments in create fucntion.

* Resolve myoy issue.

* Remove underscore for getter and setter functions.

* Restore check when arguments is None.

* Add tests covering raising errors and get_attributes() function.
2021-09-13 06:49:19 +03:00
Bartek Szmelczynski
66bad412a4
udpate scatter spec (#7086)
* udpate scatter spec

* add info about udpates tensor rank

* update updates type

* add values to example, minor style change

* udpate spec style

* add spaces for the better formatting

* Update docs/ops/movement/ScatterUpdate_3.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/ops/movement/ScatterUpdate_3.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/ops/movement/ScatterUpdate_3.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/ops/movement/ScatterUpdate_3.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/ops/movement/ScatterUpdate_3.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2021-09-13 06:44:20 +03:00
Anastasiya Koryachikhina
021639a044
Remove optimization for sea_itt_lib (#7463) 2021-09-11 16:34:56 +03:00
Yegor Kruglov
9d53b3536d
[MO] Updating MO to detect TF 2.X OD API models (#6983)
* updated FasterRCNN and SSD analysis patterns

* updated tf od api conditions

* updated ssd patterns

* added more ssd topologies

* move preprocessor to tf od api condition

* update TF OD API conditions

* refactoring

* specify data type
2021-09-10 17:44:42 +03:00
Anastasiia Urlapova
754ee2eb1a
Change PowerIE to ops chain (#7439) 2021-09-10 16:55:11 +03:00
Mateusz Bencer
3ea74bd8f8
Add PlaceOpONNX and some missing Place's methods (#7269) 2021-09-10 16:20:41 +03:00
Ilya Lavrenov
a952540edf
Openvino cmake config (#7419)
* Added OpenVINOConfig.cmake

* OpenVINOConfig.cmake part 2

* Trying to fix cmake generation

* Fixes

* Export frontends as well

* Fixed condition

* Added OpenVINO cmake package usage: docs, C samples

* Use more OpenVINO config

* Install OpenVINOConfig.cmake

* Trying to fix private plugins

* Trying to fix .tox

* Trying to fix ARM

* Fixed samples build

* Explicit ngraph duplicated targets

* Fixed fuzzing tests build

* Added IR frontend installation

* Removed install directory for IE reader

* Removed IR frontend from export list

* Reverted ngraph_DIR

* Try to fix .tox

* Fixed ieFuncTests with ONNX extensions

* Attempt #2

* Trying to fix ngraph setup.py

* Fix

* Trying to fix ONNX ngraph .tox CI

* Trying to remove spaces

* Fixed ngraph_DIR -> OpenVINO_DIR

* Removed junk files

* Try to fix ngraph wheel

* Try to fix ie_wheel

* Try to fix ngraph wheel
2021-09-10 15:31:27 +03:00
Gabriele Galiero Casay
deeb96440f
Revise GatherTree reference implementation (#7275)
* Add visitor api test

* Review ngraph op shell with type_prop tests

* Add op to list of trusted operations

* Change name of struct with information of inputs

* Add include of array data structure to fix windowds compilation error

* Add template plugin test class

* Remove usage of CoordinateTransform index function call from reference implementation

* Rename SLT test suite

* Add template plugin unit test

* Add serialization SLTs

* Add indentation on GatherTreeParams class data members
2021-09-10 14:02:49 +03:00
Anton Dudchenko
288a7633bf
[IE][VPU] Fix execTimeMcs for VPU (#7442)
When serializing execGraph, milliseconds were actually written to the execTimeMcs field
2021-09-10 13:08:13 +03:00
Ilya Lavrenov
171f6a62d5
Removed FPGA related deprecated documentation (#7348) 2021-09-10 13:03:00 +03:00
Anton Pankratv
305b86fe4a
Added openvino executable network API (#7230) 2021-09-10 11:55:52 +03:00
Gabriele Galiero Casay
c862abae03
GatherTree specification refactored (#7326)
* GatherTree specification refactored

* Fix typos
2021-09-10 06:31:35 +03:00
Alexey Suhov
b282c74386
[README.md] change latest release to 2021.4.1 2021-09-10 00:25:55 +03:00