Commit Graph

4552 Commits

Author SHA1 Message Date
Ilya Lavrenov
eabec388e2
Enabled LTO for ONNX FE (#6878)
* Fixed Windows public precommit

* ONNX LTO
2021-08-02 13:48:33 +03:00
Michal Papaj
0af234b799
Update to speech demo python dependencies: (#6740)
- removed obsolete dependencies.
2021-08-02 12:57:55 +03:00
Gleb Kazantaev
cc5f63d87a
Fix Pruning for case with INT8 GroupConvolution operation (#6872) 2021-08-02 12:36:51 +03:00
Pavel Esir
bfca47ad5e
[MO] Range output_type correction for FP16 (#6590)
* added ChangeRangeOutputType.py

* applied review comments

* corrected error message - warn user to use FP32

* renamed ChangeCastOutputType.py et ell.

* merged ChangeRangeOutputType.py, ChangeCastOutputType.py into a singe file

* corrections

* typo fix

* applied comments: faster find_and_replace loop, wording correction
2021-08-02 11:41:12 +03:00
Ilya Lavrenov
a177eb2f2e
Fixed Windows public precommit (#6877) 2021-08-02 10:22:37 +03:00
Maksim Kutakov
35696ca1db
[CPU] Unified memory descriptor (#6328) 2021-08-02 09:19:15 +03:00
Evgeny Lazarev
d28ecc4f2f
New approach for Proposal sub-graph conversion for TF OD API models (#5847)
* Draft version of new approach for Proposal sub-graph conversion for TF OD API models

* Added clip_after_nms = True for Proposal sub-graph being replaced with DetectionOutput

* Refactored code to insert DetectionOutput instead of Proposal operation

* Code cleanup

* Added separate function to insert DetectionOutput instead of Proposal operation

* Updated transformation configuration files for the TF OD API models with Proposal transformation

* Code refactoring

* Code refactoring

* Fix for the condition

* Fixed transformation

* Fixed transformation. One more time

* Updated document about conversion of the TF OD API models

* Update code comments
2021-08-01 10:17:22 +03:00
Ilya Lavrenov
c38f08b777
Use protobuf-lite for ONNX FE by default (#6829) 2021-07-31 17:21:35 +03:00
Evgeny Lazarev
5bafab9e72
Allow partially defined dimensions to read/serialize from/to IR (#6819)
* Allow to read and serialize IRs with -1 in dimensions (partially defined shape)

* Added unit test for reading/writing IR with partially defined shapes

* Added missing xml file with test IR

* Remove copy-paste issue

* Output message fix

* Restored statification of the output shapes during IR serialization

* Try to make dynamic shapes static with upper bound

* Code style changes
2021-07-30 22:53:43 +03:00
Maxim Vafin
9dbc71063c
Improve model cutting (#6835)
* Improve model cutting

* If part of model is cut, conversion rules must not run on it

* Add incorrect cut test

* Fix code style

* Fix test

* Fix codestyle

* Do not change op places graph on convert

* Assert output has producer

* Fix code style
2021-07-30 19:42:55 +03:00
Luo Cheng
86bb056dbf
MulticlassNms/MatrixNms: transformations and CPU implementation (#6653)
* init version, need revise: opset7

* add convert testcase

* multiclass_nms support spec

* init version

* matrixnms support spec

* init support for matrix_nms

* impl matirx_nms

* implemented multiclass_nms reference.

TODO: more test cases.

* support dynamic shape in test

* update to spec 0611

* update to spec 0611

* fixes.

* fix: now sort by class_id and score work.

* fix clang check error

* more test cases verified.

* fixes in ref impl.

* attribute nms_eta works

* test cross_batch and output_type i32.

* enable multiclass-nms cpu plugin fallback ngraph

* keep topk typo

* enable matrix-nms cpu plugin fallback ngraph

* support sort_result_across_batch

* Add matrix_nms unit test

* Add cross batch test cases

* fix typo

* move multiclass to opset8

* move matrixnms to opset8

* Reference implementations for MulticlassNms and MatrixNms ops

* fix name conflict

* remove unused var
sort_result_across_batch default set to false

* avoid float overflow

* fix clang check error

* info for mac fail

* change testcase due to unstable sort

* nms add 'normalized' attribute

* multiclass cpu test support 'normalized'

* nms add 'normalized' attribute

* fixes: 1. normalized support. 2. sort by score before keep_top_k inside a batch.

* fixes: 1. normalized support. 2. sort by score before keep_top_k inside a batch.

* fix sort order in matrix_nms

* fix review comments

* add matrix_nms MKLDNN extension layer

* parallel in matirx nms

* separate filtered_box

* separate class_nms result

* parallel in class

* parallel in batch

* partial new nms

* partial remove useless function

* debug & fix

* debug in indexing

* fix test cases

* remove logging

* fix code-style

* fix typo

* add matrix_nms extension

* nms python api

* remove unused testcases

* refactor transformation

* transform dynamic shape to static shape

* Update inference-engine/src/transformations/include/ngraph_ops/nms_static_shape_ie.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* remove register_pass call

* [MKLDNN]migrate matrix_nms to MKLDNNNode

* bug fix in matrix_nms

* padding on matrix_nms

* remove logging

* test case refine

* merged transform_matrix_nms branch

* refine matrixnms testcase

* multiclass nms cpu plugin implement for static shape, rebased on Reference implementations PR

* rebase to new multi-classs transform provided by lc

* Name style algin with matrix-nms

* static shape padding style to batch inside,new unit test method, real classnum shape

* fix format

* fix ci error

* multi-class NMS modification based on PR reviewer opinion: code format, copyright, delete unused include and funciton way

* explicit template instantiation due to mac ci fail

* Yi3/fix review (#16)

* fix coding style

* use parallel_for2d

* fix ci fail

* unify 'copyright 2021'

* mkldnn_multiclass_nms node update based on PR review (#17)

* [MKLDNN] apply suggestion for matrix_nms (#18)

* fix bug

* apply review comments

* apply review comments

* apply review comments

* apply review comments

* skip only Nms test, not MatrixNms MulticlassNms test

Co-authored-by: Zhang Yi3 <yi3.zhang@intel.com>
Co-authored-by: jialipen <cecilia.peng@intel.com>
Co-authored-by: mangguo <mang.guo@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
Co-authored-by: liubo-intel <bo4.liu@intel.com>
2021-07-30 15:45:44 +03:00
Mateusz Tabaka
c0c2f2da7e
Add LeakyReluFusion transformation (#6816) 2021-07-30 13:04:52 +02:00
Ilya Lavrenov
518ec79cb0
Updated samples compile options (#6818)
* Don't warn about obsolete cmake usage

* Removed build flags for samples

* Fixed ngraph with -Wpedantic

* cmake for 3rdparty
2021-07-30 13:54:09 +03:00
Zhang Yi
81377a71d0
[FrontEnd]enable PDPD 16 ops conversion Part2 (#6632)
* [FrontEnd]enable 16 ops conversion

* [FrontEnd]fix typo in interpolate

* param support tensor (#3)

* Update hard_sigmoid.cpp (#4)

* Yi3/fix paddle part2

* fix paddle conversion

* ops forward declaration

* use tile instead of broadcast

* Add validation check in dropout (#8)

* fix conflict

* fix code style

* fix transpose2

* use perm size in transpose2

* remove check in transpose2

Co-authored-by: Luo Cheng <cheng.luo@intel.com>
Co-authored-by: Mang Guo <mang.guo@intel.com>
2021-07-30 13:53:39 +03:00
Maxim Vafin
9a36e77f50
Accept stream pointer instead of shared_ptr in paddle frontend (#6807)
* Accept stream pointer instead of shared_ptr

* Fix build

* Fix build tests on centos
2021-07-30 12:58:17 +03:00
Gabriele Galiero Casay
c1d8c23d48
Remove deprecated reduce logical reference implementation signatures (#6850) 2021-07-30 12:38:17 +03:00
Roman Kazantsev
032cebb9da
Implement transformation for TensorFlow 2 Map Function (aka tf.map_fn) (#6836)
* Implement transformation for TensorFlow 2 Map Function primitive

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add a description for get_external_node_by_internal_id function

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Correct a name for get_external_nodes_by_internal_id function

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix a description for get_external_nodes_by_internal_id function

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add logging and fix indentation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use skip_nodes_by_condition to by-pass StopGradient nodes for tf.map_fn

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2021-07-30 12:10:59 +03:00
Mateusz Bencer
44bcc702e8
Fixed problem with model_inputs method in ONNX Editor (#6860) 2021-07-30 10:55:45 +02:00
Maxim Andronov
2b871eb582
[CPU] prohibit fusing if dropped node contain > 1 child edges (#6705) 2021-07-30 11:47:47 +03:00
Aleksandr Voron
e3e2ee4d74
Update dependencies.cmake (#6861) 2021-07-30 11:27:16 +03:00
Anastasiya Koryachikhina
4d7f6c54ef
Change logic for using multiple models in cc tests (#6618)
* Change logic for using multiple models in cc tests

* removed extra key

* moved multiple infer to main function

* moved multiple infer to main function

* change test_config.yml and work with this file

* change test_config.yml and work with this file

* removed extra key

* changed separator symbol

* removed extra param from output

* Rollback comments in test_config.yml

* removed extra key in yml config file, change logic to save .npz for all model seperate instead of common npz file, change logic in parser arg

* removed extra key in yml config file, change logic to save .npz for all model seperate instead of common npz file, change logic in parser arg

* changed save path for infer result, deleted extra param

* updated test_config.yml

* rollback old way to get bin_path

* changed work with save path for inference result

* add empty line in the end for config file

* rollback line order

* removed extra param allow_pickle=True in loading .npz file

* removed mkdir in run_infer

* uncomment resnet model

* added empty line

* changed save folder for cc result
2021-07-30 10:30:38 +03:00
Ivan Tikhonov
bc06279825
Fix clone_function: clone ngraph::Variables (#6804)
* fix clone function

* ngraph codestyle

* fix copy function for assign/read value v3

* add unit test
2021-07-30 10:19:12 +03:00
Maxim Vafin
5920cf849d
Implement paddle frontend methods for partial conversion (#6784)
* Implement paddle frontend methods for partial conversion

* Apply feedback

* Fix codestyle

* Remove normalize implementation and change convert signature for partialModel case

* Apply review feedback

* Apply review feedback

* Fix onnx importer convert signature

* Fix codestyle

* Add test of unsupported op

* Fix code style

* Remove "normalize()" tests

* Fix onnx tests

* Fix build

* Fix merge conflicts
2021-07-30 10:14:18 +03:00
Patryk Elszkowski
0861a5c910
Validate speedup (#6779)
* Add minor speedup changes.

* inline clip

* reduce clip calls

* more Interval::size - move to header

* terminate instead of throwing exception

* back to throw exception when element type was not found

* rename variable
2021-07-30 08:59:36 +03:00
Yury Gaydaychuk
7ab92b5845
[CPU] Adaptive pooling implementation (#6594) 2021-07-29 20:41:24 +03:00
Anastasia Popova
e70e7e1e9d
Shell implementation for RandomUniform. (#6782)
* Added shell implementation for RandomUniform.

* Small correction.

* Small correction.

* Corrected wrong type.

* Corrected error message, corrected setters.
2021-07-29 18:19:54 +03:00
Gleb Kazantaev
a3d9f00d98
Enable LinOpFusion To MO Backend (#6838) 2021-07-29 18:16:49 +03:00
Gleb Kazantaev
0a1cad52ab
Avoid Constant data copy inside Reshape constant folding (#6410)
* Avoid Constant data copy inside Reshape constant folding

* Fix Codestyle

* Updated Squeeze, Unsqueeze cf

* Deprecate set_data_shape method

* Fix Pruning
2021-07-29 17:51:25 +03:00
Egor Shulman
ab8d046642
[CPU] NormalizeL2 - unsorted axes are not supported (#6602) 2021-07-29 17:30:38 +03:00
Xie Zhengtian
513a7504a6
[AUTO] Update Auto-device plugin selection logic (#6335)
* Update selecting device logic to support Myriad and VPUX for auto-device plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>

* Update selecting logic in auto-device plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>
2021-07-29 15:57:45 +03:00
Andrey Somsikov
d498653d1f
Fix clang sanitizer build (#6853) 2021-07-29 15:45:27 +03:00
Mikhail Nosov
d65dbd1200
Fix Windows_2019 CI (#6854) 2021-07-29 14:55:33 +03:00
Alexey Lebedev
4c0c184d3f
[IE PYTHON] Release GIL in some functions (#6236)
* Release GIL in load_network

* release gil in infer, wait and get_idle_request_id

* release gil in read_network and IECore.__cinit__

* release GIL in properties

* Release GIL in infer_async

* Add test

* Fix test

* Fix test
2021-07-29 14:28:11 +03:00
Ivan Tikhonov
6673a90659
MO DeformableConv: fix a set of attributes (#6806)
* MO DeformableConv: fix a set of attributes

* codestyle

* resolve review comments

* resolve review comments
2021-07-29 13:49:12 +03:00
Ilya Churaev
233bc540ef
Do not throw an exception if we have 2 result op for one tensor (#6844) 2021-07-29 13:16:20 +03:00
Mikhail Nosov
868fad33ab
[MO] Add support to moc_frontend of ":" as delimiter for --input and --output (#6543)
* [MO] Add support to moc_frontend of ":" as delimiter for --input

Additions:
Changed default logic for 'Place::get_in(out)put_port' to return nullptr
Changed default logic for 'InputModel::get_place_by_tensor(operation)_name' to return nullptr

* Corrected comments in code

* Missing empty line

* Clang format fixes

* Fix review comments

* Updated test to verify review comments fixes

* Update unit tests after rebase

* Apply review comments
2021-07-29 13:09:51 +03:00
Mikhail Nosov
a95d59014c
Rename "pdpd" frontend to "paddle" (#6842)
* Rename "pdpd" frontend to "paddle"
Also renamed mo_pdpd.py+main_pdpd.py to mo_paddle.py+main_paddle.py

Class names were not renamed

* Update package_BOM.txt
2021-07-29 11:43:07 +03:00
Patryk Elszkowski
0f6e4afa71
update FakeQuantizeLayerTest - add broadcast (#6813) 2021-07-29 07:46:19 +03:00
Alexandra Sidorova
709d7b8aab
[CPU] Added separate inference for pc, splitted nodes (#6511) 2021-07-28 22:42:51 +03:00
Ilya Churaev
62ed84e880
Avoid copy of data when create Constant from HostTensor (#3388)
* Avoid copy of data when create Constant from HostTensor

* Fixed build
2021-07-28 18:27:27 +03:00
Mikhail Nosov
5d3ab3108f
Paddlepaddle unit tests CI fixes (#6820)
Win+Lin: add "clean build dir" step to ensure generated test models are taken from install
Windows fix: execute "pip show" on same drive where python is installed
Windows: execute tests with FE_TEST_MODELS env variable
2021-07-28 17:34:30 +03:00
Alexandra Sidorova
1aa58b4c7d
[CPU] Enabled MatMul+Transpose transformations and reduced MatMul inference overheads (#6570) 2021-07-28 16:11:41 +03:00
Bartosz Lesniewski
1471095bdb
Revise Less (#6728)
* Revise spec

* Comparison backend test POC

* Split Comparison ops tests into separate files

* remove comparison.cpp, remove unused imports, replace for_each with range based for

* remove unnecessary ngraph:: prefixes

* Fix links in spec

* Add Less to trusted ops list

* Add missing ','

* Use builder in backend tests

* Remove old backend tests for less, equal
2021-07-28 15:36:07 +03:00
Ilya Sharikov
6ee9285fe5
Added Windows OS support to MemCheckTests (#6684)
* Added Windows OS support to MemCheckTests

* Move system headers to cpp file

* Moved includes for windows to cpp file. Was rewrited function to get memory info

* Was rewrite functions for getting information about memory

* Moved implementation run_in_process to cpp file

* Fixed implementation of run_in_process
2021-07-28 13:06:16 +03:00
Edward Shogulin
c0eb700024
[LPT] Exception fix (#6824) 2021-07-28 00:08:23 +03:00
Yury Gaydaychuk
1f24cc9cea
[CPU] nms disabled (#6822) 2021-07-27 21:16:13 +03:00
Andrey Somsikov
2e26dfd4dd
Fix sanitizer build (#6790)
Use default linker for sanitizer builds

Compiler out of memory tracking variables in GPU tests.
This trigger recompilation without tracking. Disabling
tracking globally as not required option.

UBSan build is failing on maybe uninitialized variable.
Temporarily disable the check.
2021-07-27 15:29:34 +03:00
Alexander Zhogov
16dc8d4c52
Azure CI: Add building Python API on Windows (#6799)
* Azure CI: Add building Python API on Windows

* Add Python requirements

* Fix Python ver

* Fix
2021-07-27 13:34:33 +03:00
Maksim Kutakov
e47a85b427
[CPU] Get/Set Blob overhead has been eliminated. (#6737) 2021-07-27 13:22:09 +03:00
Mateusz Bencer
dc5f44e929
Integration ONNX Editor with FE API (#6773) 2021-07-27 12:20:39 +02:00