Commit Graph

4492 Commits

Author SHA1 Message Date
Bartek Szmelczynski
c963136453
Revise less equal (#6720)
* update spec, add visitors, backend test

* remove visitors test as it is implemented in another PR

* remove visitors test from CMakeLists

* remove old backend tests, refactor minor parts of the code

* add namespace

* refaactor template test for less_equal op
2021-08-04 03:18:25 +03:00
Alexander Zhogov
e220b5754e
Azure CI: Move Linux check to Ubuntu 20.04 (#6907)
* Azure CI: Move Linux check to Ubuntu 20.04

* Fix onnx

* Fix onnx docker install

* add dockerd-rootless-setuptool.sh install

* add uidmap

* sudo docker
2021-08-03 19:49:25 +03:00
Piotr Szmelczynski
a30bd0c9bb
Revise logical and (#6731)
* update docs

* add host tensors validation

* create type_prop tests

* create serialization single layer test

* create visitor test

* create op_reference test

* add logicalAnd to constants.py

* create additional op_reference tests

* add check for number of visited attributes in visitor test

* update auto_broadcast description

* remoove backend test

* update LogicalNot params name

* remove backend test from CMakeList

* create util function for type_prop tests

* update op_reference tests

* remove typo in docs

* remove unsupported types from evaluate

* fix bug in op_reference test

* refactor visitor test

* update math formula in the spec

* update has_evaluate types
2021-08-03 19:37:16 +03:00
cecilia peng
950d7b8597
pdpd frontend: enable deformable_conv, enable multiclass_nms and matrix_nms. (#6833) 2021-08-03 18:58:56 +03:00
Ilya Lavrenov
344e063002
Removed name from ngraph tensors (#6446) 2021-08-03 14:47:30 +03:00
Alexander Zhogov
ebd86e31e8
Azure CI: Move openvino-lin to Ubuntu 20.04 (#6898)
* Move to Ubuntu 20.04

* Fix pytest
2021-08-03 13:00:59 +03:00
Ilya Churaev
8a612fa55e
Moved current IE API to separate folder (#6735)
* Moved current IE API to separate folder

* Fix install

* Fix documentation

* Fixed install path

* Try to fix CI

* Changed installation path

* Use ONNXRuntime rel-1.8.1 version
2021-08-03 12:24:05 +03:00
Ilya Sharikov
26c8b29b35
Added missing modules for timetests (#6896) 2021-08-03 12:19:40 +03:00
Szymon Irzabek
063c240ed6
[GNA] Add decompose 2D convolutions transformation (#6382)
* [GNA] Add decompose 2D convolutions transformation

* [GNA] Use constant folding instead of creating copies

* [GNA] Enable more tests

* [GNA] Align ngraph opset
2021-08-03 10:33:11 +03:00
Szymon Durawa
bba7155fb7
CVS-60706 add cosh to int test. (#6718) 2021-08-03 08:43:04 +03:00
Tomasz Dołbniak
e000c52125
Maxpool-8 shell (#6332)
* Initial version of v8::MaxPool op class

* Type instead of Type_t to indicate element type

* Attribute visitor test

* Common MaxPoolBase base class

* More refactoring

* v8::MaxPool cleanup

* Pooling ops inference helper extension - window dilation

* New MaxPool 3D type prop tests

* Common part of MaxPool validation part extracted to the base class

* MaxPool-8 shape inference with base class utils

* infer_batched_pooling_forward arguments reorder to avoid compilation errors

* Align the rounding type attribute name for both MaxPool version

* MaxPool-8 axis attribute

* Missing attributes

* Code formatting

* PR feedback

* MaxPool-1 RTTI definition adjustment
2021-08-03 08:37:17 +03:00
Alexander Zhogov
57c2fe24f1
CI onnx try (#23) (#6889)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-08-03 08:08:01 +03:00
Ilya Lavrenov
9ad668a8d7
Fixing cmake command removing temp data for ie_wheel (#6893)
* Fixing cmake command removing temp data for ie_wheel

* rm -> remove_directory

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2021-08-03 08:07:09 +03:00
Ilya Churaev
e89ffa7718
Added nGraph as a public dependency (#6071)
* Added nGraph as a public dependency

* Fixed Windows warning

* Fixed CMake

* Fixed constant op

* Fixed typo

* Fixed comments

* Revert ngraph libraries

* Fixed build

* Fixed IE::ngraph

* Fixed git merge
2021-08-02 18:48:16 +03:00
Ilya Lavrenov
eabec388e2
Enabled LTO for ONNX FE (#6878)
* Fixed Windows public precommit

* ONNX LTO
2021-08-02 13:48:33 +03:00
Michal Papaj
0af234b799
Update to speech demo python dependencies: (#6740)
- removed obsolete dependencies.
2021-08-02 12:57:55 +03:00
Gleb Kazantaev
cc5f63d87a
Fix Pruning for case with INT8 GroupConvolution operation (#6872) 2021-08-02 12:36:51 +03:00
Pavel Esir
bfca47ad5e
[MO] Range output_type correction for FP16 (#6590)
* added ChangeRangeOutputType.py

* applied review comments

* corrected error message - warn user to use FP32

* renamed ChangeCastOutputType.py et ell.

* merged ChangeRangeOutputType.py, ChangeCastOutputType.py into a singe file

* corrections

* typo fix

* applied comments: faster find_and_replace loop, wording correction
2021-08-02 11:41:12 +03:00
Ilya Lavrenov
a177eb2f2e
Fixed Windows public precommit (#6877) 2021-08-02 10:22:37 +03:00
Maksim Kutakov
35696ca1db
[CPU] Unified memory descriptor (#6328) 2021-08-02 09:19:15 +03:00
Evgeny Lazarev
d28ecc4f2f
New approach for Proposal sub-graph conversion for TF OD API models (#5847)
* Draft version of new approach for Proposal sub-graph conversion for TF OD API models

* Added clip_after_nms = True for Proposal sub-graph being replaced with DetectionOutput

* Refactored code to insert DetectionOutput instead of Proposal operation

* Code cleanup

* Added separate function to insert DetectionOutput instead of Proposal operation

* Updated transformation configuration files for the TF OD API models with Proposal transformation

* Code refactoring

* Code refactoring

* Fix for the condition

* Fixed transformation

* Fixed transformation. One more time

* Updated document about conversion of the TF OD API models

* Update code comments
2021-08-01 10:17:22 +03:00
Ilya Lavrenov
c38f08b777
Use protobuf-lite for ONNX FE by default (#6829) 2021-07-31 17:21:35 +03:00
Evgeny Lazarev
5bafab9e72
Allow partially defined dimensions to read/serialize from/to IR (#6819)
* Allow to read and serialize IRs with -1 in dimensions (partially defined shape)

* Added unit test for reading/writing IR with partially defined shapes

* Added missing xml file with test IR

* Remove copy-paste issue

* Output message fix

* Restored statification of the output shapes during IR serialization

* Try to make dynamic shapes static with upper bound

* Code style changes
2021-07-30 22:53:43 +03:00
Maxim Vafin
9dbc71063c
Improve model cutting (#6835)
* Improve model cutting

* If part of model is cut, conversion rules must not run on it

* Add incorrect cut test

* Fix code style

* Fix test

* Fix codestyle

* Do not change op places graph on convert

* Assert output has producer

* Fix code style
2021-07-30 19:42:55 +03:00
Luo Cheng
86bb056dbf
MulticlassNms/MatrixNms: transformations and CPU implementation (#6653)
* init version, need revise: opset7

* add convert testcase

* multiclass_nms support spec

* init version

* matrixnms support spec

* init support for matrix_nms

* impl matirx_nms

* implemented multiclass_nms reference.

TODO: more test cases.

* support dynamic shape in test

* update to spec 0611

* update to spec 0611

* fixes.

* fix: now sort by class_id and score work.

* fix clang check error

* more test cases verified.

* fixes in ref impl.

* attribute nms_eta works

* test cross_batch and output_type i32.

* enable multiclass-nms cpu plugin fallback ngraph

* keep topk typo

* enable matrix-nms cpu plugin fallback ngraph

* support sort_result_across_batch

* Add matrix_nms unit test

* Add cross batch test cases

* fix typo

* move multiclass to opset8

* move matrixnms to opset8

* Reference implementations for MulticlassNms and MatrixNms ops

* fix name conflict

* remove unused var
sort_result_across_batch default set to false

* avoid float overflow

* fix clang check error

* info for mac fail

* change testcase due to unstable sort

* nms add 'normalized' attribute

* multiclass cpu test support 'normalized'

* nms add 'normalized' attribute

* fixes: 1. normalized support. 2. sort by score before keep_top_k inside a batch.

* fixes: 1. normalized support. 2. sort by score before keep_top_k inside a batch.

* fix sort order in matrix_nms

* fix review comments

* add matrix_nms MKLDNN extension layer

* parallel in matirx nms

* separate filtered_box

* separate class_nms result

* parallel in class

* parallel in batch

* partial new nms

* partial remove useless function

* debug & fix

* debug in indexing

* fix test cases

* remove logging

* fix code-style

* fix typo

* add matrix_nms extension

* nms python api

* remove unused testcases

* refactor transformation

* transform dynamic shape to static shape

* Update inference-engine/src/transformations/include/ngraph_ops/nms_static_shape_ie.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* remove register_pass call

* [MKLDNN]migrate matrix_nms to MKLDNNNode

* bug fix in matrix_nms

* padding on matrix_nms

* remove logging

* test case refine

* merged transform_matrix_nms branch

* refine matrixnms testcase

* multiclass nms cpu plugin implement for static shape, rebased on Reference implementations PR

* rebase to new multi-classs transform provided by lc

* Name style algin with matrix-nms

* static shape padding style to batch inside,new unit test method, real classnum shape

* fix format

* fix ci error

* multi-class NMS modification based on PR reviewer opinion: code format, copyright, delete unused include and funciton way

* explicit template instantiation due to mac ci fail

* Yi3/fix review (#16)

* fix coding style

* use parallel_for2d

* fix ci fail

* unify 'copyright 2021'

* mkldnn_multiclass_nms node update based on PR review (#17)

* [MKLDNN] apply suggestion for matrix_nms (#18)

* fix bug

* apply review comments

* apply review comments

* apply review comments

* apply review comments

* skip only Nms test, not MatrixNms MulticlassNms test

Co-authored-by: Zhang Yi3 <yi3.zhang@intel.com>
Co-authored-by: jialipen <cecilia.peng@intel.com>
Co-authored-by: mangguo <mang.guo@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
Co-authored-by: liubo-intel <bo4.liu@intel.com>
2021-07-30 15:45:44 +03:00
Mateusz Tabaka
c0c2f2da7e
Add LeakyReluFusion transformation (#6816) 2021-07-30 13:04:52 +02:00
Ilya Lavrenov
518ec79cb0
Updated samples compile options (#6818)
* Don't warn about obsolete cmake usage

* Removed build flags for samples

* Fixed ngraph with -Wpedantic

* cmake for 3rdparty
2021-07-30 13:54:09 +03:00
Zhang Yi
81377a71d0
[FrontEnd]enable PDPD 16 ops conversion Part2 (#6632)
* [FrontEnd]enable 16 ops conversion

* [FrontEnd]fix typo in interpolate

* param support tensor (#3)

* Update hard_sigmoid.cpp (#4)

* Yi3/fix paddle part2

* fix paddle conversion

* ops forward declaration

* use tile instead of broadcast

* Add validation check in dropout (#8)

* fix conflict

* fix code style

* fix transpose2

* use perm size in transpose2

* remove check in transpose2

Co-authored-by: Luo Cheng <cheng.luo@intel.com>
Co-authored-by: Mang Guo <mang.guo@intel.com>
2021-07-30 13:53:39 +03:00
Maxim Vafin
9a36e77f50
Accept stream pointer instead of shared_ptr in paddle frontend (#6807)
* Accept stream pointer instead of shared_ptr

* Fix build

* Fix build tests on centos
2021-07-30 12:58:17 +03:00
Gabriele Galiero Casay
c1d8c23d48
Remove deprecated reduce logical reference implementation signatures (#6850) 2021-07-30 12:38:17 +03:00
Roman Kazantsev
032cebb9da
Implement transformation for TensorFlow 2 Map Function (aka tf.map_fn) (#6836)
* Implement transformation for TensorFlow 2 Map Function primitive

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add a description for get_external_node_by_internal_id function

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Correct a name for get_external_nodes_by_internal_id function

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix a description for get_external_nodes_by_internal_id function

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add logging and fix indentation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use skip_nodes_by_condition to by-pass StopGradient nodes for tf.map_fn

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2021-07-30 12:10:59 +03:00
Mateusz Bencer
44bcc702e8
Fixed problem with model_inputs method in ONNX Editor (#6860) 2021-07-30 10:55:45 +02:00
Maxim Andronov
2b871eb582
[CPU] prohibit fusing if dropped node contain > 1 child edges (#6705) 2021-07-30 11:47:47 +03:00
Aleksandr Voron
e3e2ee4d74
Update dependencies.cmake (#6861) 2021-07-30 11:27:16 +03:00
Anastasiya Koryachikhina
4d7f6c54ef
Change logic for using multiple models in cc tests (#6618)
* Change logic for using multiple models in cc tests

* removed extra key

* moved multiple infer to main function

* moved multiple infer to main function

* change test_config.yml and work with this file

* change test_config.yml and work with this file

* removed extra key

* changed separator symbol

* removed extra param from output

* Rollback comments in test_config.yml

* removed extra key in yml config file, change logic to save .npz for all model seperate instead of common npz file, change logic in parser arg

* removed extra key in yml config file, change logic to save .npz for all model seperate instead of common npz file, change logic in parser arg

* changed save path for infer result, deleted extra param

* updated test_config.yml

* rollback old way to get bin_path

* changed work with save path for inference result

* add empty line in the end for config file

* rollback line order

* removed extra param allow_pickle=True in loading .npz file

* removed mkdir in run_infer

* uncomment resnet model

* added empty line

* changed save folder for cc result
2021-07-30 10:30:38 +03:00
Ivan Tikhonov
bc06279825
Fix clone_function: clone ngraph::Variables (#6804)
* fix clone function

* ngraph codestyle

* fix copy function for assign/read value v3

* add unit test
2021-07-30 10:19:12 +03:00
Maxim Vafin
5920cf849d
Implement paddle frontend methods for partial conversion (#6784)
* Implement paddle frontend methods for partial conversion

* Apply feedback

* Fix codestyle

* Remove normalize implementation and change convert signature for partialModel case

* Apply review feedback

* Apply review feedback

* Fix onnx importer convert signature

* Fix codestyle

* Add test of unsupported op

* Fix code style

* Remove "normalize()" tests

* Fix onnx tests

* Fix build

* Fix merge conflicts
2021-07-30 10:14:18 +03:00
Patryk Elszkowski
0861a5c910
Validate speedup (#6779)
* Add minor speedup changes.

* inline clip

* reduce clip calls

* more Interval::size - move to header

* terminate instead of throwing exception

* back to throw exception when element type was not found

* rename variable
2021-07-30 08:59:36 +03:00
Yury Gaydaychuk
7ab92b5845
[CPU] Adaptive pooling implementation (#6594) 2021-07-29 20:41:24 +03:00
Anastasia Popova
e70e7e1e9d
Shell implementation for RandomUniform. (#6782)
* Added shell implementation for RandomUniform.

* Small correction.

* Small correction.

* Corrected wrong type.

* Corrected error message, corrected setters.
2021-07-29 18:19:54 +03:00
Gleb Kazantaev
a3d9f00d98
Enable LinOpFusion To MO Backend (#6838) 2021-07-29 18:16:49 +03:00
Gleb Kazantaev
0a1cad52ab
Avoid Constant data copy inside Reshape constant folding (#6410)
* Avoid Constant data copy inside Reshape constant folding

* Fix Codestyle

* Updated Squeeze, Unsqueeze cf

* Deprecate set_data_shape method

* Fix Pruning
2021-07-29 17:51:25 +03:00
Egor Shulman
ab8d046642
[CPU] NormalizeL2 - unsorted axes are not supported (#6602) 2021-07-29 17:30:38 +03:00
Xie Zhengtian
513a7504a6
[AUTO] Update Auto-device plugin selection logic (#6335)
* Update selecting device logic to support Myriad and VPUX for auto-device plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>

* Update selecting logic in auto-device plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>
2021-07-29 15:57:45 +03:00
Andrey Somsikov
d498653d1f
Fix clang sanitizer build (#6853) 2021-07-29 15:45:27 +03:00
Mikhail Nosov
d65dbd1200
Fix Windows_2019 CI (#6854) 2021-07-29 14:55:33 +03:00
Alexey Lebedev
4c0c184d3f
[IE PYTHON] Release GIL in some functions (#6236)
* Release GIL in load_network

* release gil in infer, wait and get_idle_request_id

* release gil in read_network and IECore.__cinit__

* release GIL in properties

* Release GIL in infer_async

* Add test

* Fix test

* Fix test
2021-07-29 14:28:11 +03:00
Ivan Tikhonov
6673a90659
MO DeformableConv: fix a set of attributes (#6806)
* MO DeformableConv: fix a set of attributes

* codestyle

* resolve review comments

* resolve review comments
2021-07-29 13:49:12 +03:00
Ilya Churaev
233bc540ef
Do not throw an exception if we have 2 result op for one tensor (#6844) 2021-07-29 13:16:20 +03:00
Mikhail Nosov
868fad33ab
[MO] Add support to moc_frontend of ":" as delimiter for --input and --output (#6543)
* [MO] Add support to moc_frontend of ":" as delimiter for --input

Additions:
Changed default logic for 'Place::get_in(out)put_port' to return nullptr
Changed default logic for 'InputModel::get_place_by_tensor(operation)_name' to return nullptr

* Corrected comments in code

* Missing empty line

* Clang format fixes

* Fix review comments

* Updated test to verify review comments fixes

* Update unit tests after rebase

* Apply review comments
2021-07-29 13:09:51 +03:00