Commit Graph

2571 Commits

Author SHA1 Message Date
Sergey Shlyapnikov
79e9190838 [GPU] Fix incorrect fusions indexes for eltwise ref kernel (#6936) 2021-08-05 13:40:52 +03:00
Egor Duplensky
f584cf9727 [CPU] Update batch limit right after setting it (#6513)
Seem to be more convenient than checking and updating batch limit
in scope of Infer request call.
2021-08-05 08:21:16 +03:00
Yuan Hu
a913950039 revise tan op (#6567)
* revise tan op

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* update doc

add examples in desciption
add the unit of measure
clear input type

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add template plugin test case for int type

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add template plugin test case for uint and float

remove the float test in backend

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* modify document

change type to any supported numeric type

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix compile error in openvino-lin

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2021-08-05 07:48:58 +03:00
Ilya Churaev
031381dc07 Small api changes (#6923)
* Deprecate specialize_function

* Changed RTMap

* Fixed python build
2021-08-04 21:34:11 +03:00
hyunback kim
f00dabc184 Add input image scale option in benchmark App (#5848)
* Add input image scale flag in benchmark app.

- user set input image scale with -iscale.
  input is divided by scale.

Signed-off-by: hyunback <hyunback.kim@intel.com>

* Apply image scale, mean parameter in benchmark APP

Means and sacles values per channel

Signed-off-by: hyunback <hyunback.kim@intel.com>

* Fix clang-format

Signed-off-by: hyunback <hyunback.kim@intel.com>

* fix clang-format issue2.

Signed-off-by: hyunback <hyunback.kim@intel.com>

* Update benchmark tool to align the format of mean and sacle values with MO arguments.

Signed-off-by: hyunback <hyunback.kim@intel.com>

* Remove debug print.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2021-08-04 19:51:46 +03:00
Anastasia Kuporosova
585f211e0a [IE Python API] fix test query state write buffer (#6928) 2021-08-04 19:43:41 +03:00
Aleksandr Voron
cad700444e Update CMakeLists.txt (#6840) 2021-08-04 17:58:20 +03:00
Vladimir Paramuzov
29b527353a [GPU] Replace internal TBlobs with mappable ClBlobs in all InferRequests to ensure correct work on discrete GPUs (#6922)
Co-authored-by: Mikhail Letavin <mikhail.letavin@intel.com>
2021-08-04 16:53:56 +03:00
Gleb Kazantaev
73e8e91ffd Enable NopEliminatoin inside MO Backend (#6874)
* Refactor NopElimination; Execute NopEliminatoin inside MOC Backend

* Add missing header

* Refactor tests; use weak_ptr to avoid excess consumers for node

* Add test to check number of shared_ptr usages for graph nodes during Manager execution

* Remove AlgebraicSimplification forewer
2021-08-04 13:53:06 +03:00
Anton Romanov
0acfc8b5ae Update weights size (#6909) 2021-08-04 13:37:24 +03:00
Anastasia Kuporosova
dd742de105 [Python API] removal of deprecated python api (#6282)
* [Python API] removal of deprecated python api

* [Python API] removal of deprecated python api
2021-08-04 11:46:39 +03:00
Anton Pankratv
4d8825e4f8 Stream executor config returns strings (#6830) 2021-08-04 11:09:30 +03:00
Mateusz Tabaka
8c4cee1b58 [GPU] Handle negative axis in concat op (#6839)
* [clDNN] Handle negative axis in concat op

That enables following models for onnx importer path:
yolact-resnet50-fpn-pytorch
yolact-resnet101-fpn-pytorch
yolact-darknet53-fpn-pytorch
swin-tiny-patch4-window7-224
action-recognition-mkinetics-res34-mhsa
driver-action-recognition-adas-0002-decoder
horizontal-text-detection-0001

* Add tests for negative axis in Concat op
2021-08-04 10:44:22 +03:00
Vladimir Paramuzov
8f5d9a8b78 [GPU] Refactored network/program/topology classes (#6800) 2021-08-04 10:17:59 +03:00
Ilya Lavrenov
b9b0a8b34a Fixed compilation with clang (#6917) 2021-08-04 09:28:20 +03:00
Bartek Szmelczynski
c963136453 Revise less equal (#6720)
* update spec, add visitors, backend test

* remove visitors test as it is implemented in another PR

* remove visitors test from CMakeLists

* remove old backend tests, refactor minor parts of the code

* add namespace

* refaactor template test for less_equal op
2021-08-04 03:18:25 +03:00
Piotr Szmelczynski
a30bd0c9bb Revise logical and (#6731)
* update docs

* add host tensors validation

* create type_prop tests

* create serialization single layer test

* create visitor test

* create op_reference test

* add logicalAnd to constants.py

* create additional op_reference tests

* add check for number of visited attributes in visitor test

* update auto_broadcast description

* remoove backend test

* update LogicalNot params name

* remove backend test from CMakeList

* create util function for type_prop tests

* update op_reference tests

* remove typo in docs

* remove unsupported types from evaluate

* fix bug in op_reference test

* refactor visitor test

* update math formula in the spec

* update has_evaluate types
2021-08-03 19:37:16 +03:00
Ilya Churaev
8a612fa55e Moved current IE API to separate folder (#6735)
* Moved current IE API to separate folder

* Fix install

* Fix documentation

* Fixed install path

* Try to fix CI

* Changed installation path

* Use ONNXRuntime rel-1.8.1 version
2021-08-03 12:24:05 +03:00
Szymon Irzabek
063c240ed6 [GNA] Add decompose 2D convolutions transformation (#6382)
* [GNA] Add decompose 2D convolutions transformation

* [GNA] Use constant folding instead of creating copies

* [GNA] Enable more tests

* [GNA] Align ngraph opset
2021-08-03 10:33:11 +03:00
Szymon Durawa
bba7155fb7 CVS-60706 add cosh to int test. (#6718) 2021-08-03 08:43:04 +03:00
Ilya Lavrenov
9ad668a8d7 Fixing cmake command removing temp data for ie_wheel (#6893)
* Fixing cmake command removing temp data for ie_wheel

* rm -> remove_directory

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2021-08-03 08:07:09 +03:00
Ilya Churaev
e89ffa7718 Added nGraph as a public dependency (#6071)
* Added nGraph as a public dependency

* Fixed Windows warning

* Fixed CMake

* Fixed constant op

* Fixed typo

* Fixed comments

* Revert ngraph libraries

* Fixed build

* Fixed IE::ngraph

* Fixed git merge
2021-08-02 18:48:16 +03:00
Gleb Kazantaev
cc5f63d87a Fix Pruning for case with INT8 GroupConvolution operation (#6872) 2021-08-02 12:36:51 +03:00
Ilya Lavrenov
a177eb2f2e Fixed Windows public precommit (#6877) 2021-08-02 10:22:37 +03:00
Maksim Kutakov
35696ca1db [CPU] Unified memory descriptor (#6328) 2021-08-02 09:19:15 +03:00
Ilya Lavrenov
c38f08b777 Use protobuf-lite for ONNX FE by default (#6829) 2021-07-31 17:21:35 +03:00
Evgeny Lazarev
5bafab9e72 Allow partially defined dimensions to read/serialize from/to IR (#6819)
* Allow to read and serialize IRs with -1 in dimensions (partially defined shape)

* Added unit test for reading/writing IR with partially defined shapes

* Added missing xml file with test IR

* Remove copy-paste issue

* Output message fix

* Restored statification of the output shapes during IR serialization

* Try to make dynamic shapes static with upper bound

* Code style changes
2021-07-30 22:53:43 +03:00
Luo Cheng
86bb056dbf MulticlassNms/MatrixNms: transformations and CPU implementation (#6653)
* init version, need revise: opset7

* add convert testcase

* multiclass_nms support spec

* init version

* matrixnms support spec

* init support for matrix_nms

* impl matirx_nms

* implemented multiclass_nms reference.

TODO: more test cases.

* support dynamic shape in test

* update to spec 0611

* update to spec 0611

* fixes.

* fix: now sort by class_id and score work.

* fix clang check error

* more test cases verified.

* fixes in ref impl.

* attribute nms_eta works

* test cross_batch and output_type i32.

* enable multiclass-nms cpu plugin fallback ngraph

* keep topk typo

* enable matrix-nms cpu plugin fallback ngraph

* support sort_result_across_batch

* Add matrix_nms unit test

* Add cross batch test cases

* fix typo

* move multiclass to opset8

* move matrixnms to opset8

* Reference implementations for MulticlassNms and MatrixNms ops

* fix name conflict

* remove unused var
sort_result_across_batch default set to false

* avoid float overflow

* fix clang check error

* info for mac fail

* change testcase due to unstable sort

* nms add 'normalized' attribute

* multiclass cpu test support 'normalized'

* nms add 'normalized' attribute

* fixes: 1. normalized support. 2. sort by score before keep_top_k inside a batch.

* fixes: 1. normalized support. 2. sort by score before keep_top_k inside a batch.

* fix sort order in matrix_nms

* fix review comments

* add matrix_nms MKLDNN extension layer

* parallel in matirx nms

* separate filtered_box

* separate class_nms result

* parallel in class

* parallel in batch

* partial new nms

* partial remove useless function

* debug & fix

* debug in indexing

* fix test cases

* remove logging

* fix code-style

* fix typo

* add matrix_nms extension

* nms python api

* remove unused testcases

* refactor transformation

* transform dynamic shape to static shape

* Update inference-engine/src/transformations/include/ngraph_ops/nms_static_shape_ie.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* remove register_pass call

* [MKLDNN]migrate matrix_nms to MKLDNNNode

* bug fix in matrix_nms

* padding on matrix_nms

* remove logging

* test case refine

* merged transform_matrix_nms branch

* refine matrixnms testcase

* multiclass nms cpu plugin implement for static shape, rebased on Reference implementations PR

* rebase to new multi-classs transform provided by lc

* Name style algin with matrix-nms

* static shape padding style to batch inside,new unit test method, real classnum shape

* fix format

* fix ci error

* multi-class NMS modification based on PR reviewer opinion: code format, copyright, delete unused include and funciton way

* explicit template instantiation due to mac ci fail

* Yi3/fix review (#16)

* fix coding style

* use parallel_for2d

* fix ci fail

* unify 'copyright 2021'

* mkldnn_multiclass_nms node update based on PR review (#17)

* [MKLDNN] apply suggestion for matrix_nms (#18)

* fix bug

* apply review comments

* apply review comments

* apply review comments

* apply review comments

* skip only Nms test, not MatrixNms MulticlassNms test

Co-authored-by: Zhang Yi3 <yi3.zhang@intel.com>
Co-authored-by: jialipen <cecilia.peng@intel.com>
Co-authored-by: mangguo <mang.guo@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
Co-authored-by: liubo-intel <bo4.liu@intel.com>
2021-07-30 15:45:44 +03:00
Mateusz Tabaka
c0c2f2da7e Add LeakyReluFusion transformation (#6816) 2021-07-30 13:04:52 +02:00
Ilya Lavrenov
518ec79cb0 Updated samples compile options (#6818)
* Don't warn about obsolete cmake usage

* Removed build flags for samples

* Fixed ngraph with -Wpedantic

* cmake for 3rdparty
2021-07-30 13:54:09 +03:00
Maxim Andronov
2b871eb582 [CPU] prohibit fusing if dropped node contain > 1 child edges (#6705) 2021-07-30 11:47:47 +03:00
Maxim Vafin
5920cf849d Implement paddle frontend methods for partial conversion (#6784)
* Implement paddle frontend methods for partial conversion

* Apply feedback

* Fix codestyle

* Remove normalize implementation and change convert signature for partialModel case

* Apply review feedback

* Apply review feedback

* Fix onnx importer convert signature

* Fix codestyle

* Add test of unsupported op

* Fix code style

* Remove "normalize()" tests

* Fix onnx tests

* Fix build

* Fix merge conflicts
2021-07-30 10:14:18 +03:00
Yury Gaydaychuk
7ab92b5845 [CPU] Adaptive pooling implementation (#6594) 2021-07-29 20:41:24 +03:00
Gleb Kazantaev
a3d9f00d98 Enable LinOpFusion To MO Backend (#6838) 2021-07-29 18:16:49 +03:00
Gleb Kazantaev
0a1cad52ab Avoid Constant data copy inside Reshape constant folding (#6410)
* Avoid Constant data copy inside Reshape constant folding

* Fix Codestyle

* Updated Squeeze, Unsqueeze cf

* Deprecate set_data_shape method

* Fix Pruning
2021-07-29 17:51:25 +03:00
Egor Shulman
ab8d046642 [CPU] NormalizeL2 - unsorted axes are not supported (#6602) 2021-07-29 17:30:38 +03:00
Xie Zhengtian
513a7504a6 [AUTO] Update Auto-device plugin selection logic (#6335)
* Update selecting device logic to support Myriad and VPUX for auto-device plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>

* Update selecting logic in auto-device plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>
2021-07-29 15:57:45 +03:00
Mikhail Nosov
d65dbd1200 Fix Windows_2019 CI (#6854) 2021-07-29 14:55:33 +03:00
Alexey Lebedev
4c0c184d3f [IE PYTHON] Release GIL in some functions (#6236)
* Release GIL in load_network

* release gil in infer, wait and get_idle_request_id

* release gil in read_network and IECore.__cinit__

* release GIL in properties

* Release GIL in infer_async

* Add test

* Fix test

* Fix test
2021-07-29 14:28:11 +03:00
Ilya Churaev
233bc540ef Do not throw an exception if we have 2 result op for one tensor (#6844) 2021-07-29 13:16:20 +03:00
Mikhail Nosov
a95d59014c Rename "pdpd" frontend to "paddle" (#6842)
* Rename "pdpd" frontend to "paddle"
Also renamed mo_pdpd.py+main_pdpd.py to mo_paddle.py+main_paddle.py

Class names were not renamed

* Update package_BOM.txt
2021-07-29 11:43:07 +03:00
Patryk Elszkowski
0f6e4afa71 update FakeQuantizeLayerTest - add broadcast (#6813) 2021-07-29 07:46:19 +03:00
Alexandra Sidorova
709d7b8aab [CPU] Added separate inference for pc, splitted nodes (#6511) 2021-07-28 22:42:51 +03:00
Alexandra Sidorova
1aa58b4c7d [CPU] Enabled MatMul+Transpose transformations and reduced MatMul inference overheads (#6570) 2021-07-28 16:11:41 +03:00
Bartosz Lesniewski
1471095bdb Revise Less (#6728)
* Revise spec

* Comparison backend test POC

* Split Comparison ops tests into separate files

* remove comparison.cpp, remove unused imports, replace for_each with range based for

* remove unnecessary ngraph:: prefixes

* Fix links in spec

* Add Less to trusted ops list

* Add missing ','

* Use builder in backend tests

* Remove old backend tests for less, equal
2021-07-28 15:36:07 +03:00
Edward Shogulin
c0eb700024 [LPT] Exception fix (#6824) 2021-07-28 00:08:23 +03:00
Yury Gaydaychuk
1f24cc9cea [CPU] nms disabled (#6822) 2021-07-27 21:16:13 +03:00
Maksim Kutakov
e47a85b427 [CPU] Get/Set Blob overhead has been eliminated. (#6737) 2021-07-27 13:22:09 +03:00
Gleb Kazantaev
9acedbdacf Enable TransposeSyncinc and BroadcastElementwiseFusion in MOC Backend (#6796) 2021-07-27 12:24:28 +03:00
Yury Gaydaychuk
e5a990e356 [CPU] RoiPooling handles border proposals correctly (#6199) 2021-07-26 23:35:27 +03:00