Commit Graph

1751 Commits

Author SHA1 Message Date
Maxim Shevtsov
4871e1802d
fix for hetero example (https://jira.devtools.intel.com/browse/CVS-33836) NB: the FPGA (even though deprecated) continues to be the only viable example foir the HETERO plugin, so leaving that (#2982) 2020-11-09 14:42:18 +03:00
Rafal Blaczkowski
046183251a
Fix versions (#3027)
Have some concerns on numpy version, probably should be revisited further
2020-11-09 12:55:15 +03:00
Maxim Andronov
e0d25e492f
[CPU] Refactored pushInput (#2910) 2020-11-09 08:52:54 +03:00
Ilya Churaev
e7d121f173
Remove legacy files (licenses and some scripts) (#2952)
* Remove legacy files (licenses and some scripts)

* Removed LISENSE and install rules for licenses
2020-11-09 06:39:52 +03:00
Vladimir Gavrilov
da47cb05be
Extend MO for the operation NonMaxSuppression-5 (#2356)
* Commit.

* Written draft of NonMaxSuppression-5 class.

* Written conversion of the value of the second output  of MO NonMaxSuppression-5 into TF format.

* Fixed type infer for the port 1 of NonMaxSuppression-5.

* Added Reshape to [1] for 0D inputs of NMS-5.

* Small fix.

* Corrected assert for number of inputs.

* Fixed docstrings for transformations TFNonMaxSuppressionNormalize and NonMaxSuppressionNormalize.

* Now the transformation TFNonMaxSuppressionNormalize uses find_and_replace_pattern().

* Moved model-optimizer/extensions/front/onnx/non_max_suppression_normalize.py to model-optimizer/extensions/front/non_max_suppression_normalize.py, to delete duplicate code.

* Deleted commented code.

* Fixed BOM-file.

* Deleted out_ports_count from NMS.

* Fixes in type_infer of NMS-5.

* Small changes.

* Added some comment.

* Small fix.

* Some fixes.
2020-11-06 21:00:55 +03:00
Vladimir Gavrilov
e935d0bd22
Enable NonMaxSuppression-5 operation and various transformations (#2450)
* Some code style fixes.

* Started to write the method v5::NonMaxSuppression::evaluate().

* Started to write nGraph reference implementation of NMS-5.

* Some additions.

* Written preprocessing of boxes data.

* Started to write the function non_max_suppression() that calculates NonMaxSuppression-5 operation.

* Written postprocessing of the evaluate().

* Small fixes.

* Small fix.

* Added include for ngraph/shape.hpp.

* Written the function intersectionOverUnion.

* Some additions.

* Small fix.

* Continued to write the function non_max_suppression().

* Small fixes.

* Small fixes.

* Some changes.

* Some additions.

* Some replacements size_t by int64_t.

* Added casts to float in the construction of selected_score variable.

* Code style fixes.

* Written draft of NMS-5 nGraph reference implementation.

* Code style fixes.

* Started to write tests for void op::v5::NonMaxSuppression::validate_and_infer_types().

* Added tests for scalars/nonscalars.

* Fixes in the test type_prop.nms_v5_output_shape.

* Fixes in tests nms_v5_output_shape_2 and nms_v5_output_shape.

* Written tests for validate_and_infer_types() of NMS-5.

* Code style fixes.

* Now NMS-5 evaluate() can have outputs with calculated shapes.

* Small fixes.

* Corrected tests for NMS-5 validate_and_infer_type().

* Code style fixes.

* Started to write inner version of NMS-5 with static output shapes.

* Written draft of the inner operation NonMaxSuppressionIE3.

* Started to write conversion of op::v5::NonMaxSuppression into NonMaxSuppressionIE3.

* Small changes.

* Some additions.

* Small fixes.

* Fixed typo.

* Fixed typos.

* Written draft of the transformation ConvertNMS5ToLegacyMatcher that converts ngraph::opset5::NonMaxSuppression into op::NonMaxSuppressionIE3.

* Written header file for the transformations from NMS-1, NMS-3, NMS-4 to NMS-5.

* Started to write conversion of NMS-4 to NMS-5.

* Added include for ngraph/opsets/opset4.hpp.

* Started to write conversion of NMS-3 to NMS-5.

* Small fixes.

* Written draft of the conversion of NMS-3 into NMS-5.

* Fixed typo.

* Started to write conversion of NMS-1 to NMS-5.

* Written draft of the conversion NMS-1 to NMS-5.

* Started to write tests for the conversion nGraph NMS-5 to inner NMS.

* Started to write the test ConvertNMS5ToNMSIEStatic.

* Written tests for conversion of nGraph NMS-5 to inner NMSIE3.

* Started to write tests for conversion of previous NMS to nGraph NMS-5.

* Written tests for conversion of old nGraph NMS to NMS-5.

* Started to write tests for opset5::NonMaxSuppression::evaluate().

* Some additions.

* Small fix.

* Written tests for op::v5::NonMaxSuppression::evaluate().

* Used NGRAPH_RTTI_DECLARATION for NonMaxSuppressionIE3.

* Used NGRAPH_RTTI_DECLARATION for NMS-5.

* All static local constants and functions for NMS-5 were moved into non-named namespace.

* Some code style fixes.

* Moved some file.

* Small fix.

* Code style fix.

* Now NMS-5 supports all floating types in inputs 0 and 1.

* Moved some files.

* Fixed include directive in the file convert_nms_5_to_legacy.cpp with transformations NMS-1, 3, 4 -> NMS-5.

* Small changes.

* Deleted conversion NMS-3 -> legacy.

* Small changes.

* Fix in op::v5::NonMaxSuppression::evaluate: output shape [1] instead of [] in the output port 2.

* Code style fixes.

* Deleted conversion of NMS-4 into legacy NMS.

* Deleted redundant ifs.

* Added NMS-5 to Python API.

* Code style fix.

* Small change.

* Fixed element type for constants in the conversion of NMS-5 to NMSIE3.

* Deleted support of f64 in NMS-5.

* Added checks for input element types for inputs #0, #1, #3, #4, #5.

* Small change.

* Now get_floats throws an exception for unsupported types.

* Now nGraph NMS-5 supports 0D and 1D tensors in inputs #2, #3, #4, #5.

* Small fix in test_non_max_suppression.

* Deleted using namespace std

* Fixes in test_non_max_suppression().

* Small fixes.

* Added 'import PartialShape' in test_reduction.py.

* Deleted creating fake inputs in the ctor of op::v5::NonMaxSuppression.

* Deleted creating fake inputs in op::v5::NonMaxSuppression::clone_with_new_inputs.

* Corrections in int64_t op::v5::NonMaxSuppression::max_boxes_output_from_input() const.

* Corrected functions float op::v5::NonMaxSuppression::soft_nms_sigma_from_input() const, float op::v5::NonMaxSuppression::score_threshold_from_input() const,  float op::v5::NonMaxSuppression::iou_threshold_from_input() const.

* Small fixes.

* Deleted commented code.

* Fixes in nms_v5_scalar_inputs_check.

* Some changes.

* Small fixes.

* Code style fixes.

* Small changes.

* Small changes.

* Small fix.

* Deleted commented code.

* Some refactoring in ConvertNMS4ToNMS5 ctor.

* Small fix.

* Common part of conversions NMS-1 -> NMS-5, NMS-3 -> NMS-5, NMS-4 -> NMS-5 was moved into the separate function.

* Now conversions NMS-1 -> NMS-5, NMS-3 -> NMS-5, NMS-4 -> NMS-5 support both 2 inputs, and 5 inputs.

* Now transformations NMS-1 -> NMS-5, NMS-3 -> NMS-5, NMS-4 -> NMS-5 are called from 'umbrella' transformation.

* Now the transformation ConvertNMS5ToLegacyMatcher supports NMS-5 with 2, 3, 4, 5, or 6 inputs.

* The transformation ConvertNMS5ToLegacyMatcher was rewritten using Reshape instead of Unsqueeze.

* Started to rewrite tests for the transformation ConvertNMS5ToLegacyMatcher.

* Some fixes.

* Small fixes.

* Corrected tests for the transformation NMS-5 -> NMSIE3.

* Small formatting fix.

* Now methods max_boxes_output_from_input(), iou_threshold_from_input(), score_threshold_from_input(), soft_nms_sigma_from_input() of op::v5::NunMaxSuppression are public.

* Started to move op::v5::NonMaxSuppression::evaluate() into ngraph/test/runtime/interpreter.

* Added NMS-5 to ngraph/test/runtime/interpreter/int_executable.

* Small fixes.

* Code style fixes.

* Written draft test nonmaxsuppression_center_point_box_format_backend in ngraph/test/backend.

* Small fix.

* Written draft tests of NonMaxSuppression in ngraph/test/runtime.

* Some changes.

* Small changes.

* Disabled IE_CPU tests for NMS-5.

* Deleted op_eval tests for NMS-5.

* Deleted evaluate() method of NMS-5.

* Now all nGraph functions in tests of the transformation NMS-5 -> NMSIE3 have one output.

* Now preprocessing and postprocessing of the calculation of NMS-5 in reference implementation.

* Code style fixes.

* Some fixes in tests for the transformation NMS-5 -> NMSIE3.

* Replaced precision i64 -> i32 for some constants in tests for the transformation NMS-5 -> NMSIE3.

* Written creating CNNLayer for NMS-5.

* Added creating CNNLayer for NonMaxSuppressionIE3.

* some changes.

* Now conversions NMS-1, NMS-3, NMS-4 -> NMS-5  and NMS-5 -> NMSIE3 generate NMS nodes with 5 inputs.

* Fixed ctor in MKLDNN NonMaxSuppressionImpl: validation of number of output edges.

* Added conversion of output_type for NMS-5.

* Fixes in the transformation NMS5 -> NMSIE3.

* Fixes in the conversion of NMS-5 to NMSIE3.

* Fixes in MKLDNN NMS ctor.

* Small fix.

* Fixed tests for the transformation NMS5 -> NMSIE3.

* Fixed tests for conversions NMS-1, NMS-3, NMS-4 -> NMS-5.

* Small fixes in MKLDNN NMS ctor.

* Rewritten create_layer() functions for NMS-5 and NMSIE3 as addSpecificCreator() functions.

* Disabled tests for IE IR reader for NMS-4.

* Deleted debug code.

* Added comment about disabling tests IE_CPU.nonmaxsuppression.

* Written IE IR Reader test for NMS-4.

* Deleted function float_from_constant_node.

* Small fixes.

* Deleted functions function_from_model and construct_weights.

* Small fix.

* Replaced push_back with emplace_back in the conversion of NMS-5 to legacy.

* Small changes.

* Some fixes.

* Refactored reference implementation of NMS-5.

* Moved structure NMSAttributes to unnamed namespace.

* Code style fixes.

* Small fix.
2020-11-06 19:11:04 +03:00
Maxim Vafin
9f0b26e14c
Fix the NHWC->NCHW transformation for dynamic weights (#2848)
* Fix the NHWC->NCHW transformation when weights and data comes from same input

* Simplify code
2020-11-06 19:04:46 +03:00
Katarzyna Mitrus
15d7919817
MatMul spec update (#2765)
Aligned specification with nGraph MatMul shape inference operation. Affects description of the behavior for 1D tensors.
2020-11-06 18:41:36 +03:00
Edward Shogulin
0f00e7f703
[LPT] integration branch: Reshape fix, Concat generalization, runtime info usage extending (#2930)
* [LPT] Concat transformation generalization

* [LPT] Reshape transformation fix

* [LPT] Legacy callback fix

* [LPT] * added rt_info propagation
      * functional tests: added rt_info
      * functional tests: added MoveDequatnizationAfter tests

Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
2020-11-06 16:15:27 +03:00
Ivan Tikhonov
1c3208ffe0
Low Latency transformation (#2869)
* initial draft of adding sinks to ngraph::Function

* style fixes

* code style fixes

* code style fixes

* code style fix

* review fix+build fix

* code style fix

* fix build

* API changed according to latest discussion

* review fixes

* review fixes + tests

* initial draft of adding sinks to ngraph::Function

* style fixes

* code style fixes

* code style fixes

* code style fix

* review fix+build fix

* code style fix

* fix build

* API changed according to latest discussion

* review fixes

* review fixes + tests

* added 1 more ctor

* style fixes

* used new api in ir parser

* fixed build

* update low latency transformation, fix unroll transformation, add unit tests, modify subgraph tests

* fix low latency transformation

* Update low latency transformation, unit and sub-graph tests

* update LowLatency transformation and tests

* ngraph codestyle

* fix build, update description

* resolve review remarks

Co-authored-by: Svetlana Dolinina <svetlana.a.dolinina@intel.com>
2020-11-06 14:11:11 +03:00
Maxim Kurin
c97db3f4de
[OpenCL] movi-cltools-20.09.2 (#2912) 2020-11-06 13:45:45 +03:00
Alexandra Sidorova
d622c08580
[CPU] Added LogSoftmax-5 support (#2743) 2020-11-06 13:22:02 +03:00
Mateusz Tabaka
731065031d
Remove deprecated v0::TopK (#2947)
* Remove deprecated v0::TopK

* Remove using SortType and using Mode from TopK

* apply code format

* Revert "Remove using SortType and using Mode from TopK"

This reverts commit ee2f99ea89.
2020-11-06 11:36:33 +03:00
Mateusz Tabaka
f6332c702d
Remove deprecated v0::Softmax (#2917) 2020-11-06 11:34:23 +03:00
Andrey Zaytsev
b86f908247
Feature/azaytsev/layout updates (#2985)
* Reconfigured the layouts with importing the dedicated POT layout and Accuracy Checker and Model Downloader items from the OMZ layout

* updated

* test

* test

* Moved the Model Downloader from ie_docs.xml to openvino_docs.xml

* Renamed optimization_docs.xml --> pot_docs.xml

* Added Model Server to the layout

* Minor fixes
2020-11-06 11:07:53 +03:00
Vladimir Paramuzov
ccee30e733
[IE CLDNN] Removed unused conv kernels (#2995) 2020-11-06 10:24:48 +03:00
Maxim Andronov
32c48b1087
[CPU] Added support NMS-5 (#2768) 2020-11-06 08:59:23 +03:00
Vladimir Paramuzov
6e7db6fb37
[IE CLDNN] Plugin-side kernels caching (#2871) 2020-11-05 23:44:45 +03:00
Trawinski, Dariusz
c0f64e7761
ovms doc fix (#2988)
* added OpenVINO Model Server

* ovms doc fixes
2020-11-05 21:19:54 +03:00
Evgeny Lazarev
67e039340e
Added support for the Loop operation in the MO IR Reader (#2971)
* Added support for the Loop operation in the MO IR Reader
2020-11-05 20:53:44 +03:00
Anna Alberska
be406fd7a6
[GNA] support for 3D [1,1,X] import/output (#2893)
* [GNA] support for 3D [1,1,X] import/output

* [GNA] add check for C == 1 and H == 1

* [GNA] fix input dimensions restrictions for 3d
2020-11-05 19:31:55 +03:00
Alexey Ershov
d5daf9d873
[IE][VPU] Proposal stage: fixed check for optional 2nd output (#2980)
Fixed check for omitted 2nd optional output
2020-11-05 19:05:37 +03:00
Gleb Kazantaev
022ea97f18
Fixed disable/enable logic in PassConfig (#2940)
* Fixed disable/enable logic in PassConfig

* Removed set_pass_config method for Manager; added comments
2020-11-05 17:34:32 +03:00
Artyom Anokhov
24ed4133dd
setupvars.bat: Fixed names for major and minor python version vars (#2986) 2020-11-05 14:48:09 +03:00
Alexey Suhov
3139eb230f
[install_prerequisites.sh] remove libgfortran5, add framework to venv folder name (#2969) 2020-11-05 14:19:47 +03:00
Emmanuel Attia
71bb8135b9
Fix ngraph core opset createinsensitive (#2961)
* Fix: ITT_INCLUDE_DIR was not correctly detected

* Map find result not compared with the right iterator.

* Force recheck
2020-11-05 13:42:09 +03:00
Andrew Bakalin
e758d2b325
[IE][VPU] Fix NMS DTS (#2880)
Add a new constructor to fix absent NMS-5 inputs that will be introduced after #2450 will be merged.
2020-11-05 13:33:16 +03:00
Rafal Blaczkowski
935ac543ac
Update ONNX models preprocessing script (#2936)
* Update onnx zoo models

* Update xfail list

* Update xfails
2020-11-05 12:40:48 +03:00
Ilya Lavrenov
7dc40dc69f
Moved find_package(TBB) inside set_ie_threading_interface_for (#2966) 2020-11-05 11:32:46 +03:00
Ilya Lavrenov
5be7f32f95
Enable LTO only for Release (#2968) 2020-11-05 11:31:32 +03:00
Ilya Lavrenov
307182af69
Multi process build for MSVC (#2974) 2020-11-05 11:31:02 +03:00
Rafal Blaczkowski
fbf7cc70ab
Update xfails (#2979) 2020-11-05 10:12:51 +03:00
Mateusz Tabaka
0ee774eb92
Remove obsoleted v0::Sum op (#2938) 2020-11-05 09:13:12 +03:00
Mateusz Tabaka
d7d60b401e
Remove obsoleted v0::Slice and v0::Split ops (#2908)
* Remove obsoleted v0::Slice op

* Remove deprecated v0::Split op

* Fix build_graph tests
2020-11-05 09:11:45 +03:00
Mateusz Tabaka
43d47d780e
Remove obsoleted v0::QuantizedConvolution op (#2958) 2020-11-05 09:10:51 +03:00
Jozef Daniecki
5d7f83f399
Fix testcase CheckExecGraphInfoSerialization (#2973)
* Generate unique output file names in CheckExecGraphInfoSerialization testcase.

When multiple instances of this test were executed in parallel the same
file was accessed by multiple threads which was the cause of flakiness.

* Enable ExecGraphTests.CheckExecGraphInfoSerialization on GPU
2020-11-05 07:16:24 +03:00
Zoe Cayetano
c68858760a
Update Custom_Layers_Guide.md (#2964)
Update misspelling on ONNX
2020-11-05 07:01:21 +03:00
Jozef Daniecki
ac658fb500
Fix serialization of execution graph. (#2901)
* Fix serialization of execution graph.

* Add exec graph comparison.

* Align execution graph serialization to old aproach.

* Revise error massages.

* Fixed execution graph comparison.

Now only attribute names are compared since values can differ on
different devices.

* Readability refactoring.

* Refactoring regarding readability.
2020-11-05 06:52:08 +03:00
Vladimir Paramuzov
7c1690951c
[IE CLDNN] Added inference precision into execution graph (#2913) 2020-11-05 00:13:49 +03:00
Nikolay Shchegolev
d3ecfe56d4
[CPU] CTCLoss sporadic issue. (#2934)
* [CPU] CTCLoss sporadic issue.

* [Tests] Enable CTCLoss tests.
2020-11-04 21:16:53 +03:00
Jedrzej Hajduczenia
fbae10a235
[IE CLDNN] Add asymmetric quantization support to fsv16 imad general convolution kernel (#2778) 2020-11-04 17:31:40 +03:00
Sergey Shlyapnikov
9c509e5f41
[IE CLDNN] Convolutition optimizations for small channels count (#2849) 2020-11-04 14:41:12 +03:00
Tomasz Socha
7c6794344c
[ONNX][PyTests] Fix result datatype missmatch (#2596) 2020-11-04 12:19:40 +01:00
Michał Karzyński
23188e1b04
Expand ONNX functions to sub-graphs before import (#2733)
Co-authored-by: Bartosz Sledz <bartosz.sledz@intel.com>
2020-11-04 10:48:34 +01:00
Alexander Zhogov
df49a2b987
Azure CL: Improve yaml (#2951)
* Azure CL: Improve yaml

* Fix installing requirements

* Add run onnxImporterUnitTests
2020-11-03 21:20:53 +03:00
Rafik Saliev
d225ba6e53
[IE] Add batched blob support (#2203)
* [IE] Add batched blob support

New `class BatchedBlob : public CompoundBlob` defined to allow to pass multiple blobs as 1 InferRequest input.

Motivation: There is the special user case when a number of plain images (e.g. `NV12Blob`) should be passed as one input for network which batch size > 1.

`class CompoundBlob` is not applicable for such cases due to:
1. `NV12Blob` is `CompoundBlob` which prevents to combine multiple NV12 images to a CompoundBlob
2. The default behavior in most of plugins - do not accept generic CompoundBlob as `SetBlob()` argument

Adding `SetBlob(name, vector<Blob::Ptr>...)` to `class IInferRequest`, `class InferRequest`, `class IInferRequestInternal`, ...  - is not effective solution due to limited and specific use cases for `batched inputs`.

+ Apply rule-of-zero to CompoundBlob and inherited classes.

* Add "BATCHED_BLOB" optimization capability metric

* Add BatchedBlob usage to hello_nv12_input_classification

* Apply offline code review outcome:

1. Revert CompoundBlob public .ctors signatures
2. Remove 'workaround' .ctor for `BatchedBlob`
3. Revert tensor descriptors of `I420Blob` `NV12Blob` back to the 'fake' value.

* Code review fix

* Add functional tests for CPU, GPU, MULTI, HETERO

* update doc comment

* Apply code review change requests.
2020-11-03 21:19:26 +03:00
Evgeny Lazarev
d682950e64
Updated requirements dependency (#2950) 2020-11-03 18:26:11 +03:00
Piotr Szmelczynski
c8bd92ac0d
Sigmoid revise (#2942)
* remove sigmoid_backprop

* Update Sigmoid spec

* Update Sigmoid spec
2020-11-03 18:16:16 +03:00
Irina Efode
a66c728a46
[IE TESTS] Fix reg exp for issue 42029 (#2957) 2020-11-03 18:12:24 +03:00
Mikhail Ryzhov
1144130b50
Aligned python read_network() with C/C++ behaviour (#2916)
Aligned python read_network() with C/C++ behaviour

Excluded mandatory check of weights file, it is redundant

* Added unit tests
2020-11-03 16:18:43 +03:00