Commit Graph

4921 Commits

Author SHA1 Message Date
Maxim Shevtsov
492fdadba9
Resetting the GPU hints baseline to let the validation switch the perf tetsing to these (and see no delta first) (#7868) 2021-10-08 17:26:11 +03:00
Wilson Seok
d50ba1129b
Migration convolution ngraph backend test (#7846)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add convolution reference test and ngraph backend test

* fix location of ngraph visitor convolution.cpp
2021-10-08 16:52:00 +03:00
Mikhail Nosov
2592856200
[OV2.0] Leftovers for Preprocessing/input/output (#7893)
* Pre-process:
- Implicit conversions for element type and layout
- 'convert_element_type' with default argument to network
- Convert_element_type - don't add ops if dst and src types are same
- Convert_layout - don't add ops if dst and src layouts are same
- Custom step - use Output<Node> instead of shared_ptr<Node>
- Support of addressing input by tensor name

Post-process:
- Avoid duplication of tensor names after post-processing

* Fixed IE tests
2021-10-08 12:58:29 +03:00
Piotr Szmelczynski
d8c6591249
Pszmel/get place by operation name and output port (#7863)
* update description of get_place_by_operation_name_and_input_port

* create implementation for get_place_operation_name_and_output_port

* fix typo

* updatget_place_by_operation_name_and_input_port and get_place_by_operation_name_and_output_port

* add tests for get_place_by_operation_name_and_input_port and get_place_by_operation_name_and_output_port

* fix style
2021-10-08 12:33:54 +03:00
Jade Cho
15c98bbf8c
[GPU] Merge prepare_buffer_fusing updates (#7878)
* [GPU] Merge prepare_buffer_fusing updates

+ Disable choosing implementation using TBB if immad is supported

* [GPU] Apply comments
2021-10-08 15:31:51 +09:00
Ilya Churaev
ff31ac553a
Introduce new evaluate API (#7848)
* Introduce new evaluate API

* Removed redundant pointers from new API

* Fixed eval tests

* Fixed comments

* Enable evaluate_lover/upper methods
2021-10-08 07:29:25 +03:00
Irina Efode
a3a651ff97
[IE TESTS] Remove functionRefs from all tests and add it in necessary places (#7873)
* gna

* [IE TESTS] Remove functionRefs from some places
2021-10-08 00:29:00 +03:00
Andrey Somsikov
5eaf029723
Fix coverity linux pipeline (#7879)
Exclude python, contrib, and samples from the build.
Clean up unnecessary dependencies installation.
Publish artifacts.
2021-10-07 22:00:39 +03:00
Ilya Lavrenov
ec126c6252
old / new API precisions conversions, old_api_map applying (#7853)
* Enabled support of IR v11 in IR frontend

* Enabled serialization to v11

* Added indexes for Inputs/Outputs

* Fixed typo

* Fixed code style

* Fixed deserialization tests

* FIxed typo

* Avoid changes in the original serialized function

* Split IRv7 and IRv10 code

* Added preprocessing steps to read network

* Added preprocessing for new API for IR v10

* clang-format

* Updates for compiler flags

* Reverted some changes

* Fixed TI tests

* Removed version from the function and indexes from parameters/results

* Restore function version

* Clone function rt info

* Removed v11 version

* Added serialization of old API map in ngraph.

* Changed order type to int64_t.

* Fixed uint64_t error, added comments.

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Read old_api_map

* Added tests with undefined type and empty order.

* Fixed reprocessing

* Updated gitignore

* Updated serialize / deserialize tests

* Added set, get and has methods.

* Fix in tests.

* Applied old_api_map tests

* Fixed empty convert_layout

* Allow Layout from empty string

* Fixed clang-format

* Export FEM::load_by_model

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Made inline methods, changed to shared_ptr.

* Small fix.

* Moved methods to header file.

* Small fix.

* Applied post-processing

* Fixed review comments

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>
Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2021-10-07 18:59:24 +03:00
Eugeny Volosenkov
05cd830de5
Move eval tests to template tests (#7132)
* Add If implementation with reference

* fix test

* fix comments

* Fix validate_and_INFER_TYPES

* rewrite tests for dynamic cases

* Fix ci failed

* add comentaries for validate_and_infer_types

* fix api

* Added ngraph checks and delete copied op from opset8

* code style fix

* fix code style

* add checkers to reference

* add has_evaluate

* fix eval

* Fix code style

* fix code style

* Add template plugin tests

* fix code style

* delete boolean

* fix IfParams

* Fix comments

* intermediate commit

* delete eval test

* add common header

* Fix codestyle

* fix set_invariant_input/set_body_output

* fix code_style

* fix codestyle

* delete validate_and_infer_types from type prop tests

* delete comments
2021-10-07 18:40:57 +03:00
Egor Duplensky
465304a108
[CPU] Remove get_friendly_name WA (#7589)
The ngraph issue has been fixed.
WA is not needed anymore.
2021-10-07 18:32:09 +03:00
Anton Dudchenko
bdc8208dd3
[IE][VPU] Update FW (#7499)
Update FW with revert changes for 256MB
2021-10-07 15:57:13 +03:00
Bartek Szmelczynski
cfe18d289c
Scatter update ref impl revision (#7476)
* add template tests for scatter_update

* rm CT from ref impl

* fix namings

* minor code refactor

* fix style

* change ref impl

* add lambda func

* new tests

* remove CT from reference implementation, add template tests

* fix cpu IE

* refactor template tests

* split template tests
2021-10-07 14:40:15 +03:00
Mateusz Tabaka
126943800e
Add support for ONNX op "com.microsoft.EmbedLayerNormalization" (#7837) 2021-10-07 11:28:27 +02:00
Dmitrii Khurtin
f856ac0203
[GNA] Added ConcatAlignFilter support for Accuracy Aware mode (#7834)
* Added ConcatAlignFilter support for Accuracy Aware mode

* fails after reviewing and added tests

* moved the test to gna/scale_factors_tests; added comments to test
2021-10-07 12:25:18 +03:00
Dmitrii Khurtin
6f43b8d0af
[GNA] Fixed failed to inserting reshape around MatMul (#7833)
* Fixed failed to inserting reshape around MatMul.

* remove unnecessary

* added comments
2021-10-07 12:18:22 +03:00
Alina Kladieva
d11ff04130
Update skip_tests_config.cpp (#7874) 2021-10-07 12:09:22 +03:00
Yury Gaydaychuk
4c80b110d0
[CPU] Deformable convolution improvements (#7168)
* jit impl. optimized

* reviewed

* reviewed
2021-10-07 11:31:08 +03:00
Ilya Znamenskiy
94d5d81961
[GPU] Quantize scale shift opt optimizations (#7770) 2021-10-07 10:30:07 +03:00
Anastasia Popova
623117fe24
Serialization of old API map in nGraph. (#7840)
* Added serialization of old API map in ngraph.

* Changed order type to int64_t.

* Fixed uint64_t error, added comments.

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Added tests with undefined type and empty order.

* Added set, get and has methods.

* Fix in tests.

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Made inline methods, changed to shared_ptr.

* Small fix.

* Moved methods to header file.

* Small fix.

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2021-10-06 23:15:45 +03:00
Mikhail Nosov
e20cefb620
PrePostProcessor.output() - first implementation of post-processing (#7866)
* PrePostProcessor.output() - first implementation of post-processing
Supported convert_layout, convert_element_type and custom operations

* Fix review comments

* Added test for pre and post processing together
Fix clang-format

* Move 'validate_and_infer_types' before post-processing
2021-10-06 21:17:10 +03:00
Dawid Kożykowski
a4788989f2
disable failing test (#7872) 2021-10-06 18:16:58 +03:00
Dawid Kożykowski
cddfeda4dd
disable matmul integer ie tests (#7870) 2021-10-06 17:53:20 +03:00
Paul Youngsoo Ahn
606fdc2ec5
[IE] Add new API to return the number of logical cores (#7688) (#7688)
- Add functional tests
2021-10-06 15:29:14 +03:00
Mikhail Nosov
f57dc05c66
[OV20] Convert NV12 to RGB operation + preprocessing (#7508)
* # Conflicts:
#	docs/template_plugin/tests/functional/op_reference/convert_color_nv12.cpp
#	inference-engine/tests/functional/plugin/cpu/shared_tests_instances/single_layer_tests/convert_color_nv12.cpp
#	inference-engine/tests/functional/shared_test_classes/include/shared_test_classes/single_layer/convert_color_nv12.hpp
#	inference-engine/tests/functional/shared_test_classes/src/single_layer/convert_color_nv12.cpp
#	ngraph/core/include/openvino/core/preprocess/input_tensor_info.hpp
#	ngraph/core/include/openvino/core/preprocess/preprocess_steps.hpp
#	ngraph/core/include/openvino/op/nv12_to_bgr.hpp
#	ngraph/core/include/openvino/op/nv12_to_rgb.hpp
#	ngraph/core/src/op/nv12_to_bgr.cpp
#	ngraph/core/src/op/nv12_to_rgb.cpp
#	ngraph/core/src/preprocess/pre_post_process.cpp
#	ngraph/core/src/preprocess/preprocess_steps_impl.hpp
#	ngraph/test/CMakeLists.txt

* Added more test to cover 100% of code
Allow convert element type for 'multi-plane' color format

* Inherit tensor names for 'convert_color'

* Clang

* Fix tests

* Disable 'int8' preprocessing resize test

* Fix review comments

* Add more restrictions and tests for planes sub-names

* 1) Added check for uniqueness of tensor names generated for nodes
Raise error if user's plane sub-name conflicts with some node in a function
2) Added exception safety to preprocess build. Before, when input #2 fail, only one preprocess will be applied to function and it will be corrupted
Exception guard will restore function to original state if exception occurs

* Fix clang-format
2021-10-06 15:22:05 +03:00
Dawid Kożykowski
659daf610f
[ONNX] MatMulInteger (#7825) 2021-10-06 13:53:47 +02:00
Andrey Sapozhnikov
9add27fd74
[GNA] Adding missed ifdef's (#7167)
* Added missed ifdef

* Moved ifdef's to avoid unused variables and unclosed scopes

* lower string number for ifdefs
2021-10-06 14:44:09 +03:00
Krzysztof Bruniecki
11516bb2b2
[GNA] Remove WA for undefined reference in GCC (#7842) 2021-10-06 14:34:59 +03:00
Ilya Churaev
80e0bed855
Remove ngraph from new API (#7838) 2021-10-06 14:17:27 +03:00
Liu Bo
cd675a56a4
Paddle Op conversion for SSD-MobileNetV3: exp, stack (#7547)
* Paddle Op conversion for SSD-MobileNetV3: exp, stack

* apply review comments

* remove fp64 type check of exp

* use default_opset

* add axis check

* apply review comments
2021-10-06 12:46:00 +03:00
Liu Bo
f83cf4b765
[FrontEnd]Paddle_Op_Conversion_prior_box (#7639)
* Paddle_Op_Conversion_prior_box

* use default_opset

* apply review comments

* const type variables modification
2021-10-06 12:43:24 +03:00
Gleb Kazantaev
5ef3472bee
Fix FrameworkNodeAttr Deserialization (#7854) 2021-10-06 12:40:26 +03:00
Egor Duplensky
faeeedf141
[CPU] [DEBUG_CAPS] Execute all the nodes to have debug info available (#7809)
Otherwise Reshape / Output / etc nodes are missed in verbose log
And blobs from Output nodes are node dumped
2021-10-06 11:58:46 +03:00
Ilya Znamenskiy
17dc82a00a
[GPU] Num threads per eu update (#7823) 2021-10-06 11:44:49 +03:00
Andrey Somsikov
b5499f6573
Fix coverity_linux Azure pipeline error (#7857) 2021-10-06 10:39:18 +03:00
Egor Duplensky
3455dd973f
[CPU] Replace sgemm with MatMul primitive (#6785) 2021-10-06 09:57:57 +03:00
Jade Cho
d29648164a
[GPU] Merge activation_ref kernel update. (#7767)
+ Support b_fs_yx_fsv32, bs_fs_yx_bsv32_fsv32 and bs_fs_yx_bsv32_fsv16 format.
2021-10-06 12:38:54 +09:00
Ivan Tikhonov
dffe4a4251
If-8 operation: Serializer and Reader parts (#7545)
* added ir reader

* add serializer

* fix code style

* fix code style

* fix code style

* fix codestyle

* update IR reader for IF op

* move Function comparator to ngraph tests utils, update unit tests

* update tests

* cleanup

* update unit tests

* fix build issue

* ngraph codestyle

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

Co-authored-by: Eugeny Volosenkov <eugeny.volosenkov@intel.com>
Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
2021-10-05 18:45:17 +03:00
Andrey Somsikov
275d4838c5
Add coverity pipeline (#7828)
* Add pipeline for OSS coverity scan

* Intercept and submit the build to coverity

* Remove tests

* Remove test dependencies installation
2021-10-05 17:43:10 +03:00
Mikhail Letavin
58e8893a26
[GPU] Separate async pipeline into explicit stages (#7197) 2021-10-05 16:04:42 +03:00
Anton Chetverikov
a56d81345d
[MO] IR Reader meta_info using update (#7133)
* Initial change to allow saving graphto IR without meta_info

* Update saving and restoring functions, add more comments

* Add unit tests for define_data_type() function

* Fix wrong name

* Update condition

* Update meta_data checks

* Update data_type restoretion and missed outpurt ports handling

* Update and add new test

* Update comments

* Remove commented code

* Rename function

* Update temporary Result operations processing

* Remove define_data_type function

* Move node_normalize_output function to Op class methods

* Update comments

* Update comments
2021-10-05 15:07:44 +03:00
Anastasia Kuporosova
cdb3e17763
[New Python API] Add new python API based on pybind11 (#7752)
* Mk/ov pybind poc (#48)

* Move _pyngraph module to ngraph.pyngraph

* Stub for IECore and IENetwork classes

* Additional API classes

* passing test, extended functions and added blob

* worksave

* [POC Python API] Add IECore methods

* [POC Python API] Add iecore tests

* ienetwork

* ienet, input_info, dataptr

* irequest and exeecnet

* adapted benchmark

* Move _pyngraph module to ngraph.pyngraph

* Stub for IECore and IENetwork classes

* Additional API classes

* passing test, extended functions and added blob

* worksave

* [POC Python API] Add IECore methods

* [POC Python API] Add iecore tests

* ienetwork

* ienet, input_info, dataptr

* irequest and exeecnet

* adapted benchmark

* Added suport for InputInfo bindings

* Add Blob support for different types

* fix typo

* Fixed InputInfo maps

* Add keys() to inputs maps

* add uint8 blob

* return read_network as it should be

* return read_network as it should be

* fix blob buffer

* remove const input_info files and fix codestyle

* add mode parameter in benchmark app

* return _pyngraph

* delete benchmark copy

* return pyngraph as in master

* fix benchmark working

* add comment with api which need to implement

* remove unnecessary code from benchmark

* remove hardcoded path from setup.py

* Rename vars in setup.py

* working wheel

* fix wheel building

* Revert "working wheel"

This reverts commit 11d03a1833.

* fix tests

* Added async infer

* pass by ref

* add ccompiler to requirements

* fix blob creation and view

* replace abscent method with working code in benchmark

* fix building

* worksave

* worksave queue

* no-deadlock async infer

* add lock handle in waitAll

* fix building issues with includes

* update of setup and cmakelist

* fix setup.py way of building

* add new methods for ie_core

* add ienetwork methods: serizlize and getfunction

* add methods for exec net and infer request class

* remove ccompiler from requirements

* remove set from cmake

* Update Blob class with precisions

* Rewrite test_write_numpy_scalar_int64

* Generic Blob casting in infer queue

* implementation of preprocess_info

* update license

* add set_blob method

* worksave

* added template for setblob

* Added blob convert in infer request

* move blob casting to common namespace

* add_outputs method

* work with func from pyopenvino

* add user_id to callbacks

* remove hardcoded root dir

* refactor code and comments

* [Python API] use parametrize in blob tests

* move common functions to conftest file

* Add tests for blob

* Update test_blob and test_network

* add parametrize in blob tests

* blob refactoring

* Fix sync in InferQueue and add default callbacks

* patch for protobuf cmake

* blob refactoring

* rename convert_to_blob to cast_to_blob

* rename to cast_to_blob in infer queue

* add missing cast_to_blob

* remove boost

* change license

* undo in cmake

* fix building

* [IE PYTHON API POC] Add fixed InferQueue and modification in async part of benchmark

* Add read_network(model,blob)

* Add blob_from_file helper

* Add read from Path

* Add tests

* Add read_network from bytes

* Error throwing in Common IE functions

* Cleaning samples

* Changes in ConstInputInfoWrapper class

* Add StatusCode to callback function for InferRequest

* Add random image generation and model path getting

* Move example model to examples path

* Adapt sync and async examples to new helpers

* Return request info containing StatusCode and ID from InferQueue for top idle request.

* Update benchmark app to use new API with request info

* Update examples to use two different approaches to InferQueue

* reset new line

* Add is_ready() to InferQueue

* fix building

* remove benchmark

* temporary add separate flag for building poc

* refactoring

* Remove GIL acquire in default callback and latencies

* Adapt benchmark to Core()

* Codestyle

* fix building

* [Python API] Move ngraph python api to the new destination

* fix building tests

* fix code-style checks

* building in azure

* fix building wheels

* apply fixes

* new structure

* fix building

* Add support for InferRequest::Cancel in pyopenvino

* fixes

remove gil release
add async infer after cancel

* remove extra files

* remove examples and benchmark

* fix code style

* fix building

* fix tests

* merge inits from old and new api

* fix azure ci

* fix setup.py

* fix setup.py building

* try to fix mac

Co-authored-by: Michal Karzynski <michal.karzynski@intel.com>
Co-authored-by: jiwaszki <jan.iwaszkiewicz@intel.com>
Co-authored-by: anastasia.kuporosova <akuporos@akuporos.inn.intel.com>
Co-authored-by: Alexey Lebedev <alexey.lebedev@intel.com>
Co-authored-by: Mateusz Tabaka <mateusz.tabaka@intel.com>

* Fix comments

* fix comments: cmakelist

* fix building on arm

* permission for merge script

* permission for merge script

Co-authored-by: Michal Karzynski <michal.karzynski@intel.com>
Co-authored-by: jiwaszki <jan.iwaszkiewicz@intel.com>
Co-authored-by: anastasia.kuporosova <akuporos@akuporos.inn.intel.com>
Co-authored-by: Alexey Lebedev <alexey.lebedev@intel.com>
Co-authored-by: Mateusz Tabaka <mateusz.tabaka@intel.com>
2021-10-05 13:55:54 +03:00
Ilya Churaev
3859990b1b
Introduce IR v11 (#7787)
* Enabled support of IR v11 in IR frontend

* Enabled serialization to v11

* Added indexes for Inputs/Outputs

* Fixed typo

* Fixed code style

* Fixed deserialization tests

* FIxed typo

* Avoid changes in the original serialized function

* Fixed TI tests

* Removed version from the function and indexes from parameters/results

* Restore function version

* Clone function rt info

* Removed v11 version
2021-10-05 13:09:59 +03:00
Alexey Varyzgin
617a0b0b47
[CPU] Shared weights for RNN node (#7522) 2021-10-05 13:09:52 +03:00
Jade Cho
d89b146259
[GPU] Merge mvn kernel updates (#7736)
* [GPU] Merge mvn kernel updates

+ Support bs_fs_yx_bsv32_fsv32 format for i8 and u8 dtype.
+ Support bs_fs_yx_bfv32_fsv16 format for fp16 dtype.

* [GPU] Fix a bug of resample kernel selector.

* [GPU] fix a build error of mvn unit tests
2021-10-05 16:22:33 +09:00
Alexander Zhogov
c6b98d5e9b
CODEOWNERS: Remove openvino-admins from scripts 2021-10-05 09:41:01 +03:00
Ilya Lavrenov
acb6aa01ab
Added reporting of unresolved symbols for plugins (#7810)
* Added reporting of unresolved symbols for plugins

* Added HDDL dependency

* Removed cross-compilation if

* Revert "Removed cross-compilation if"

This reverts commit da644a3afe.
2021-10-05 04:26:01 +03:00
hyunback kim
21c70f8eb5
concatenation_onednn migration (#7756)
- update concatenation_onednn
- add unit test using onednn concat

Signed-off-by: hyunback <hyunback.kim@intel.com>
2021-10-05 09:16:32 +09:00
Irina Efode
bd2b346c62
[IE Tests] Aplly some comments for dynamic shapes (#7829)
* [IE Tests] Aplly some comments for dynamic shapes

* fix tss

* fix postfix

* remove cout

* Fix crash

* fix ci
2021-10-05 02:40:21 +03:00
Ilya Lavrenov
f762751968
Deprecated dynamism in old IE API (#7812) 2021-10-05 01:06:10 +03:00