Commit Graph

4979 Commits

Author SHA1 Message Date
Maxim Vafin
25c2d5c6c4
[MO] Fix axes in FusedBatchNorm -> MVN transformation (#7679) (#7913) 2021-10-12 16:47:29 +03:00
Ilya Churaev
c323775f2c
Add input/output to ov ExecNetwork (#7650)
* Added template for new tests

* Fixed simple test

* Added output tests

* Removed get_result/get_parameter methods

* Fixed documentation

* Fixed functional tests

* Fixed caching tests

* Added new test for import

* Added new tests

* Fixed code style

* Fixed comments

* Fixed tests

* Fixed code style

* Save version in the function
Fixed pre-post processing

* Change IR version

* Fixed documentation

* Fixed MockICore

* HETERO almost works

* Fixed tests and core logic

* Disabled some CPU tests

* Tmp disable fp16 for template

* Fixed tests and clang-format

* Small fixes

* Fix

* Simplified code in templatePlugin

* Added IE precisions checks

* Simplified hetero plugin

* Added ieImportExportedFunction test

* Added MYRIAD test

* Skip tests directly in tests

* More correct filter for CPU

* Fixed CPU tests

* Template plugin tests

* Some comments

* FIxed clanf-format

* Removed myriad tests

* Fixed comment

* small changes

* Fixed condition

* Fixed unit tests

* clang-format

* Comment

* Hetero plugin update

* Fixed tests

* Moved re-create under ig

* Fixed clang-format

* Fixed some caching_tests

* Disable some caching_tests

* Fixed setLayout with dynamic case

* Fixed clang-format

* Disable execution graph

* Disabled one more CPU test

* Simplified regex

* Disabled GNA tests

Co-authored-by: y <ilya.lavrenov@intel.com>
2021-10-12 13:11:25 +03:00
Mateusz Bencer
29eaa0af60
Handle PlaceOpONNX and PlaceOutputEdgeONNX by extract_subgraph (#7908) 2021-10-12 11:54:41 +02:00
Sergey Lyubimtsev
a10f40d6d4
Set scikit-image~=0.18.3 for python versions >=3.7 (#7910)
* Set scikit-image~=0.18.3 for python versions >=3.7

* Set scikit-image>=0.17.2 (0.17.2 is not available for >=3.7)
2021-10-12 11:49:42 +03:00
Vladimir Dudnik
1ba4f4caf6
print hint option (#7876) 2021-10-12 11:48:04 +03:00
Vladimir Dudnik
d790204575
fix typos in README.md (#7887) 2021-10-12 00:45:31 +03:00
Vladislav Volkov
6d322722c6
[CPU] Fix for possible uninitialized variable in MKLDNNInputNode constructor (#7882) 2021-10-11 09:59:04 +03:00
Gleb Kazantaev
b80b87b2d9
Split Transformations between MOC and Common pipelines (#7580)
* Split Transformations between MOC and Common pipelines

* Test

* Split passes

* Fix int8 issue

* Small refactoring
2021-10-08 19:07:41 +03:00
Maxim Shevtsov
492fdadba9
Resetting the GPU hints baseline to let the validation switch the perf tetsing to these (and see no delta first) (#7868) 2021-10-08 17:26:11 +03:00
Wilson Seok
d50ba1129b
Migration convolution ngraph backend test (#7846)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add convolution reference test and ngraph backend test

* fix location of ngraph visitor convolution.cpp
2021-10-08 16:52:00 +03:00
Mikhail Nosov
2592856200
[OV2.0] Leftovers for Preprocessing/input/output (#7893)
* Pre-process:
- Implicit conversions for element type and layout
- 'convert_element_type' with default argument to network
- Convert_element_type - don't add ops if dst and src types are same
- Convert_layout - don't add ops if dst and src layouts are same
- Custom step - use Output<Node> instead of shared_ptr<Node>
- Support of addressing input by tensor name

Post-process:
- Avoid duplication of tensor names after post-processing

* Fixed IE tests
2021-10-08 12:58:29 +03:00
Piotr Szmelczynski
d8c6591249
Pszmel/get place by operation name and output port (#7863)
* update description of get_place_by_operation_name_and_input_port

* create implementation for get_place_operation_name_and_output_port

* fix typo

* updatget_place_by_operation_name_and_input_port and get_place_by_operation_name_and_output_port

* add tests for get_place_by_operation_name_and_input_port and get_place_by_operation_name_and_output_port

* fix style
2021-10-08 12:33:54 +03:00
Jade Cho
15c98bbf8c
[GPU] Merge prepare_buffer_fusing updates (#7878)
* [GPU] Merge prepare_buffer_fusing updates

+ Disable choosing implementation using TBB if immad is supported

* [GPU] Apply comments
2021-10-08 15:31:51 +09:00
Ilya Churaev
ff31ac553a
Introduce new evaluate API (#7848)
* Introduce new evaluate API

* Removed redundant pointers from new API

* Fixed eval tests

* Fixed comments

* Enable evaluate_lover/upper methods
2021-10-08 07:29:25 +03:00
Irina Efode
a3a651ff97
[IE TESTS] Remove functionRefs from all tests and add it in necessary places (#7873)
* gna

* [IE TESTS] Remove functionRefs from some places
2021-10-08 00:29:00 +03:00
Andrey Somsikov
5eaf029723
Fix coverity linux pipeline (#7879)
Exclude python, contrib, and samples from the build.
Clean up unnecessary dependencies installation.
Publish artifacts.
2021-10-07 22:00:39 +03:00
Ilya Lavrenov
ec126c6252
old / new API precisions conversions, old_api_map applying (#7853)
* Enabled support of IR v11 in IR frontend

* Enabled serialization to v11

* Added indexes for Inputs/Outputs

* Fixed typo

* Fixed code style

* Fixed deserialization tests

* FIxed typo

* Avoid changes in the original serialized function

* Split IRv7 and IRv10 code

* Added preprocessing steps to read network

* Added preprocessing for new API for IR v10

* clang-format

* Updates for compiler flags

* Reverted some changes

* Fixed TI tests

* Removed version from the function and indexes from parameters/results

* Restore function version

* Clone function rt info

* Removed v11 version

* Added serialization of old API map in ngraph.

* Changed order type to int64_t.

* Fixed uint64_t error, added comments.

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Read old_api_map

* Added tests with undefined type and empty order.

* Fixed reprocessing

* Updated gitignore

* Updated serialize / deserialize tests

* Added set, get and has methods.

* Fix in tests.

* Applied old_api_map tests

* Fixed empty convert_layout

* Allow Layout from empty string

* Fixed clang-format

* Export FEM::load_by_model

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Made inline methods, changed to shared_ptr.

* Small fix.

* Moved methods to header file.

* Small fix.

* Applied post-processing

* Fixed review comments

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>
Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2021-10-07 18:59:24 +03:00
Eugeny Volosenkov
05cd830de5
Move eval tests to template tests (#7132)
* Add If implementation with reference

* fix test

* fix comments

* Fix validate_and_INFER_TYPES

* rewrite tests for dynamic cases

* Fix ci failed

* add comentaries for validate_and_infer_types

* fix api

* Added ngraph checks and delete copied op from opset8

* code style fix

* fix code style

* add checkers to reference

* add has_evaluate

* fix eval

* Fix code style

* fix code style

* Add template plugin tests

* fix code style

* delete boolean

* fix IfParams

* Fix comments

* intermediate commit

* delete eval test

* add common header

* Fix codestyle

* fix set_invariant_input/set_body_output

* fix code_style

* fix codestyle

* delete validate_and_infer_types from type prop tests

* delete comments
2021-10-07 18:40:57 +03:00
Egor Duplensky
465304a108
[CPU] Remove get_friendly_name WA (#7589)
The ngraph issue has been fixed.
WA is not needed anymore.
2021-10-07 18:32:09 +03:00
Anton Dudchenko
bdc8208dd3
[IE][VPU] Update FW (#7499)
Update FW with revert changes for 256MB
2021-10-07 15:57:13 +03:00
Bartek Szmelczynski
cfe18d289c
Scatter update ref impl revision (#7476)
* add template tests for scatter_update

* rm CT from ref impl

* fix namings

* minor code refactor

* fix style

* change ref impl

* add lambda func

* new tests

* remove CT from reference implementation, add template tests

* fix cpu IE

* refactor template tests

* split template tests
2021-10-07 14:40:15 +03:00
Mateusz Tabaka
126943800e
Add support for ONNX op "com.microsoft.EmbedLayerNormalization" (#7837) 2021-10-07 11:28:27 +02:00
Dmitrii Khurtin
f856ac0203
[GNA] Added ConcatAlignFilter support for Accuracy Aware mode (#7834)
* Added ConcatAlignFilter support for Accuracy Aware mode

* fails after reviewing and added tests

* moved the test to gna/scale_factors_tests; added comments to test
2021-10-07 12:25:18 +03:00
Dmitrii Khurtin
6f43b8d0af
[GNA] Fixed failed to inserting reshape around MatMul (#7833)
* Fixed failed to inserting reshape around MatMul.

* remove unnecessary

* added comments
2021-10-07 12:18:22 +03:00
Alina Kladieva
d11ff04130
Update skip_tests_config.cpp (#7874) 2021-10-07 12:09:22 +03:00
Yury Gaydaychuk
4c80b110d0
[CPU] Deformable convolution improvements (#7168)
* jit impl. optimized

* reviewed

* reviewed
2021-10-07 11:31:08 +03:00
Ilya Znamenskiy
94d5d81961
[GPU] Quantize scale shift opt optimizations (#7770) 2021-10-07 10:30:07 +03:00
Anastasia Popova
623117fe24
Serialization of old API map in nGraph. (#7840)
* Added serialization of old API map in ngraph.

* Changed order type to int64_t.

* Fixed uint64_t error, added comments.

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Added tests with undefined type and empty order.

* Added set, get and has methods.

* Fix in tests.

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Made inline methods, changed to shared_ptr.

* Small fix.

* Moved methods to header file.

* Small fix.

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2021-10-06 23:15:45 +03:00
Mikhail Nosov
e20cefb620
PrePostProcessor.output() - first implementation of post-processing (#7866)
* PrePostProcessor.output() - first implementation of post-processing
Supported convert_layout, convert_element_type and custom operations

* Fix review comments

* Added test for pre and post processing together
Fix clang-format

* Move 'validate_and_infer_types' before post-processing
2021-10-06 21:17:10 +03:00
Dawid Kożykowski
a4788989f2
disable failing test (#7872) 2021-10-06 18:16:58 +03:00
Dawid Kożykowski
cddfeda4dd
disable matmul integer ie tests (#7870) 2021-10-06 17:53:20 +03:00
Paul Youngsoo Ahn
606fdc2ec5
[IE] Add new API to return the number of logical cores (#7688) (#7688)
- Add functional tests
2021-10-06 15:29:14 +03:00
Mikhail Nosov
f57dc05c66
[OV20] Convert NV12 to RGB operation + preprocessing (#7508)
* # Conflicts:
#	docs/template_plugin/tests/functional/op_reference/convert_color_nv12.cpp
#	inference-engine/tests/functional/plugin/cpu/shared_tests_instances/single_layer_tests/convert_color_nv12.cpp
#	inference-engine/tests/functional/shared_test_classes/include/shared_test_classes/single_layer/convert_color_nv12.hpp
#	inference-engine/tests/functional/shared_test_classes/src/single_layer/convert_color_nv12.cpp
#	ngraph/core/include/openvino/core/preprocess/input_tensor_info.hpp
#	ngraph/core/include/openvino/core/preprocess/preprocess_steps.hpp
#	ngraph/core/include/openvino/op/nv12_to_bgr.hpp
#	ngraph/core/include/openvino/op/nv12_to_rgb.hpp
#	ngraph/core/src/op/nv12_to_bgr.cpp
#	ngraph/core/src/op/nv12_to_rgb.cpp
#	ngraph/core/src/preprocess/pre_post_process.cpp
#	ngraph/core/src/preprocess/preprocess_steps_impl.hpp
#	ngraph/test/CMakeLists.txt

* Added more test to cover 100% of code
Allow convert element type for 'multi-plane' color format

* Inherit tensor names for 'convert_color'

* Clang

* Fix tests

* Disable 'int8' preprocessing resize test

* Fix review comments

* Add more restrictions and tests for planes sub-names

* 1) Added check for uniqueness of tensor names generated for nodes
Raise error if user's plane sub-name conflicts with some node in a function
2) Added exception safety to preprocess build. Before, when input #2 fail, only one preprocess will be applied to function and it will be corrupted
Exception guard will restore function to original state if exception occurs

* Fix clang-format
2021-10-06 15:22:05 +03:00
Dawid Kożykowski
659daf610f
[ONNX] MatMulInteger (#7825) 2021-10-06 13:53:47 +02:00
Andrey Sapozhnikov
9add27fd74
[GNA] Adding missed ifdef's (#7167)
* Added missed ifdef

* Moved ifdef's to avoid unused variables and unclosed scopes

* lower string number for ifdefs
2021-10-06 14:44:09 +03:00
Krzysztof Bruniecki
11516bb2b2
[GNA] Remove WA for undefined reference in GCC (#7842) 2021-10-06 14:34:59 +03:00
Ilya Churaev
80e0bed855
Remove ngraph from new API (#7838) 2021-10-06 14:17:27 +03:00
Liu Bo
cd675a56a4
Paddle Op conversion for SSD-MobileNetV3: exp, stack (#7547)
* Paddle Op conversion for SSD-MobileNetV3: exp, stack

* apply review comments

* remove fp64 type check of exp

* use default_opset

* add axis check

* apply review comments
2021-10-06 12:46:00 +03:00
Liu Bo
f83cf4b765
[FrontEnd]Paddle_Op_Conversion_prior_box (#7639)
* Paddle_Op_Conversion_prior_box

* use default_opset

* apply review comments

* const type variables modification
2021-10-06 12:43:24 +03:00
Gleb Kazantaev
5ef3472bee
Fix FrameworkNodeAttr Deserialization (#7854) 2021-10-06 12:40:26 +03:00
Egor Duplensky
faeeedf141
[CPU] [DEBUG_CAPS] Execute all the nodes to have debug info available (#7809)
Otherwise Reshape / Output / etc nodes are missed in verbose log
And blobs from Output nodes are node dumped
2021-10-06 11:58:46 +03:00
Ilya Znamenskiy
17dc82a00a
[GPU] Num threads per eu update (#7823) 2021-10-06 11:44:49 +03:00
Andrey Somsikov
b5499f6573
Fix coverity_linux Azure pipeline error (#7857) 2021-10-06 10:39:18 +03:00
Egor Duplensky
3455dd973f
[CPU] Replace sgemm with MatMul primitive (#6785) 2021-10-06 09:57:57 +03:00
Jade Cho
d29648164a
[GPU] Merge activation_ref kernel update. (#7767)
+ Support b_fs_yx_fsv32, bs_fs_yx_bsv32_fsv32 and bs_fs_yx_bsv32_fsv16 format.
2021-10-06 12:38:54 +09:00
Ivan Tikhonov
dffe4a4251
If-8 operation: Serializer and Reader parts (#7545)
* added ir reader

* add serializer

* fix code style

* fix code style

* fix code style

* fix codestyle

* update IR reader for IF op

* move Function comparator to ngraph tests utils, update unit tests

* update tests

* cleanup

* update unit tests

* fix build issue

* ngraph codestyle

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

Co-authored-by: Eugeny Volosenkov <eugeny.volosenkov@intel.com>
Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
2021-10-05 18:45:17 +03:00
Andrey Somsikov
275d4838c5
Add coverity pipeline (#7828)
* Add pipeline for OSS coverity scan

* Intercept and submit the build to coverity

* Remove tests

* Remove test dependencies installation
2021-10-05 17:43:10 +03:00
Mikhail Letavin
58e8893a26
[GPU] Separate async pipeline into explicit stages (#7197) 2021-10-05 16:04:42 +03:00
Anton Chetverikov
a56d81345d
[MO] IR Reader meta_info using update (#7133)
* Initial change to allow saving graphto IR without meta_info

* Update saving and restoring functions, add more comments

* Add unit tests for define_data_type() function

* Fix wrong name

* Update condition

* Update meta_data checks

* Update data_type restoretion and missed outpurt ports handling

* Update and add new test

* Update comments

* Remove commented code

* Rename function

* Update temporary Result operations processing

* Remove define_data_type function

* Move node_normalize_output function to Op class methods

* Update comments

* Update comments
2021-10-05 15:07:44 +03:00
Anastasia Kuporosova
cdb3e17763
[New Python API] Add new python API based on pybind11 (#7752)
* Mk/ov pybind poc (#48)

* Move _pyngraph module to ngraph.pyngraph

* Stub for IECore and IENetwork classes

* Additional API classes

* passing test, extended functions and added blob

* worksave

* [POC Python API] Add IECore methods

* [POC Python API] Add iecore tests

* ienetwork

* ienet, input_info, dataptr

* irequest and exeecnet

* adapted benchmark

* Move _pyngraph module to ngraph.pyngraph

* Stub for IECore and IENetwork classes

* Additional API classes

* passing test, extended functions and added blob

* worksave

* [POC Python API] Add IECore methods

* [POC Python API] Add iecore tests

* ienetwork

* ienet, input_info, dataptr

* irequest and exeecnet

* adapted benchmark

* Added suport for InputInfo bindings

* Add Blob support for different types

* fix typo

* Fixed InputInfo maps

* Add keys() to inputs maps

* add uint8 blob

* return read_network as it should be

* return read_network as it should be

* fix blob buffer

* remove const input_info files and fix codestyle

* add mode parameter in benchmark app

* return _pyngraph

* delete benchmark copy

* return pyngraph as in master

* fix benchmark working

* add comment with api which need to implement

* remove unnecessary code from benchmark

* remove hardcoded path from setup.py

* Rename vars in setup.py

* working wheel

* fix wheel building

* Revert "working wheel"

This reverts commit 11d03a1833.

* fix tests

* Added async infer

* pass by ref

* add ccompiler to requirements

* fix blob creation and view

* replace abscent method with working code in benchmark

* fix building

* worksave

* worksave queue

* no-deadlock async infer

* add lock handle in waitAll

* fix building issues with includes

* update of setup and cmakelist

* fix setup.py way of building

* add new methods for ie_core

* add ienetwork methods: serizlize and getfunction

* add methods for exec net and infer request class

* remove ccompiler from requirements

* remove set from cmake

* Update Blob class with precisions

* Rewrite test_write_numpy_scalar_int64

* Generic Blob casting in infer queue

* implementation of preprocess_info

* update license

* add set_blob method

* worksave

* added template for setblob

* Added blob convert in infer request

* move blob casting to common namespace

* add_outputs method

* work with func from pyopenvino

* add user_id to callbacks

* remove hardcoded root dir

* refactor code and comments

* [Python API] use parametrize in blob tests

* move common functions to conftest file

* Add tests for blob

* Update test_blob and test_network

* add parametrize in blob tests

* blob refactoring

* Fix sync in InferQueue and add default callbacks

* patch for protobuf cmake

* blob refactoring

* rename convert_to_blob to cast_to_blob

* rename to cast_to_blob in infer queue

* add missing cast_to_blob

* remove boost

* change license

* undo in cmake

* fix building

* [IE PYTHON API POC] Add fixed InferQueue and modification in async part of benchmark

* Add read_network(model,blob)

* Add blob_from_file helper

* Add read from Path

* Add tests

* Add read_network from bytes

* Error throwing in Common IE functions

* Cleaning samples

* Changes in ConstInputInfoWrapper class

* Add StatusCode to callback function for InferRequest

* Add random image generation and model path getting

* Move example model to examples path

* Adapt sync and async examples to new helpers

* Return request info containing StatusCode and ID from InferQueue for top idle request.

* Update benchmark app to use new API with request info

* Update examples to use two different approaches to InferQueue

* reset new line

* Add is_ready() to InferQueue

* fix building

* remove benchmark

* temporary add separate flag for building poc

* refactoring

* Remove GIL acquire in default callback and latencies

* Adapt benchmark to Core()

* Codestyle

* fix building

* [Python API] Move ngraph python api to the new destination

* fix building tests

* fix code-style checks

* building in azure

* fix building wheels

* apply fixes

* new structure

* fix building

* Add support for InferRequest::Cancel in pyopenvino

* fixes

remove gil release
add async infer after cancel

* remove extra files

* remove examples and benchmark

* fix code style

* fix building

* fix tests

* merge inits from old and new api

* fix azure ci

* fix setup.py

* fix setup.py building

* try to fix mac

Co-authored-by: Michal Karzynski <michal.karzynski@intel.com>
Co-authored-by: jiwaszki <jan.iwaszkiewicz@intel.com>
Co-authored-by: anastasia.kuporosova <akuporos@akuporos.inn.intel.com>
Co-authored-by: Alexey Lebedev <alexey.lebedev@intel.com>
Co-authored-by: Mateusz Tabaka <mateusz.tabaka@intel.com>

* Fix comments

* fix comments: cmakelist

* fix building on arm

* permission for merge script

* permission for merge script

Co-authored-by: Michal Karzynski <michal.karzynski@intel.com>
Co-authored-by: jiwaszki <jan.iwaszkiewicz@intel.com>
Co-authored-by: anastasia.kuporosova <akuporos@akuporos.inn.intel.com>
Co-authored-by: Alexey Lebedev <alexey.lebedev@intel.com>
Co-authored-by: Mateusz Tabaka <mateusz.tabaka@intel.com>
2021-10-05 13:55:54 +03:00