Commit Graph

5590 Commits

Author SHA1 Message Date
Alexey Suhov
fd6035c9f1
Exclude licenses for third party programs required for development from cmake install (#9015) 2021-12-06 13:18:10 +03:00
Mikhail Ryzhov
40691e9cc5
[GNA] Renamed plugin and moved it to new place (#8944)
* Renamed plugin

* Changed plugin source dir

* Fixed tests

* Renamed ENABLE_GNA to ENABLE_INTEL_GNA

* Fixed centos compile error

* One more renaming place

* HF for centos 7

* renamed the name in version api

* Fixed CI configurations

* Disabled GNA plugin for old gcc (<=5.4)

* Fixed Azure Win job
2021-12-06 13:00:35 +03:00
Sungeun Kim
86ab2e5f1b
Remove reorder after depth_to_space2 (#8289)
* Remove reorder after depth_to_space

* Remove reorder after region_yolo

* add ignore conditions

-if input node is not depth_to_space and region_yolo

* fix bug: The empty std::list causes undefined behavior.

* remove ignore_conditions flag
2021-12-06 17:35:56 +09:00
Bartek Szmelczynski
9b69705158
Serialize pass bind (#8749)
* add pass for serialize, add tests

* remove redundant code

* fix style

* add tuple functionality, clear code, add tests

* style changes

* fix style

* add runtime.Core to the imports

* add version arg to serialize pass, add tests
2021-12-06 11:10:20 +03:00
Roman Kazantsev
dcf5be9838
Specify DetectionOutput-8 operation (#8704)
* Specify DetectionOutput-8 operation

The delta is small where we just remove num_classes attribute to support OD models out of the box

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove a link to DetectionOutput-1 from opset-8

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update a list in ie_docs.xml

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2021-12-06 11:08:50 +03:00
Denis Orlov
371de1e620
[GNA] Fix comments in GNA public header and speech sample (#8395) 2021-12-06 11:00:58 +03:00
Vladimir Dudnik
355fdeec55
rm C/C++ object_detection_sample_ssd (#9020)
* rm C/C++ object_detection_sample_ssd

* fix link
2021-12-06 10:38:40 +03:00
Egor Shulman
f8c5a4abf4
Bug fixed (#7765) 2021-12-06 10:29:31 +03:00
Wang, Yang
83a7d9bda3
[AUTO Plugin] Rename Multi plugin to ov_multi_plugin and move the src files to new (#8885)
place.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2021-12-06 05:58:05 +03:00
Sergey Lyubimtsev
c11ae2d691
Add requirements files generation for installer (#9019)
* Add requirements files generation for installer (#8940) *

* remove caffe2
2021-12-06 01:15:31 +03:00
Vladimir Dudnik
642bd07ffa
rm python style_transfer_sample (#8881) 2021-12-05 18:00:11 +03:00
Vladimir Dudnik
89282e3f36
remove C++ style_transfer_sample, brings nothing new to educate OV2.0 API (#8906) 2021-12-04 15:51:54 +03:00
Yaroslav Torzuk
f1e701bd81
[GPU] DeformableConvolution-8 (#8806) 2021-12-04 13:49:51 +03:00
Dawid Kożykowski
d6094a085a
Expose missing Node API (#8852) 2021-12-03 18:53:19 +01:00
Andrey Sapozhnikov
c8a2ba851b
Negative tests layer support (#8969) 2021-12-03 15:31:03 +03:00
Evgeny Talanin
fb103e1dd0
Revert "Revert "disable debug postfix on mac (#6827)" (#8974)" (#9000)
This reverts commit e81e60b233.
2021-12-03 13:03:17 +03:00
Egor Shulman
e16e91e328
[CPU] ExperimentalDetectronTopKROIs dynamic done (#8922) 2021-12-03 09:56:44 +03:00
Mang Guo
36a3033cfe
[CPU] Fix klocwork issue (#8908) 2021-12-03 09:52:01 +03:00
Andrey Babushkin
61cae2a401
Revert "Add requirements files generation for installer (#8940)" (#8993)
This reverts commit 1d6d3ebea8.
2021-12-03 09:16:16 +03:00
Jade Cho
6d039f7eb5
Add exeception message to check available frontends. (#8914) 2021-12-03 10:47:51 +09:00
Jade Cho
a9a583eb42
[GPU] Fix graph dump issue. (#8965) 2021-12-02 17:25:20 +03:00
Alexander Zhogov
a14ac5236d
Azure CI: Add apt update before install nfs-common (#8983) 2021-12-02 16:33:03 +03:00
Alexey Lebedev
f9bd7402ff
[tools] new api and support dynamic models in python benchmark app (#8582)
* Preprocessing API - base classes

Includes API definition for trivial mean/scale operations (which don't require layout)

Mean/scale with 'layout' support will be done under separate task together
 with Layout

Current test code coverage: 100%

* Python bindings for base preprocessing API

* remove pre_post_process directory from ngraph/core

* remove files from ngraph/python dir

* move pyngraph pre_post_process files from ngraph/python to runtime

* remove pre_post_process test from CMakeList

* move include to the header

* update include path for pre_post_process

* style fix

* bind InputTensorInfo::set_layout

* cleaned test_preprocess

* fix test expected output

* remove duplicate test

* update description of set_element_type

* fix style

* move preprocess from pyngraph to pyopenvino/graph

* update test_preprocess imports and remove unnecessary test

* remove duplicate import

* update custom method

* update test

* update test

* create decorator that changes Node into Output<Node>

* create function that cast Node to Output<Node>

* update test_preprocess to use decorator for custom function

* change _cast_to_output -> _from_node

* style fix

* add tests fro scale and mean with vector input

* style fix

* add docstring for custom_preprocess_function

* bind InputInfo network method

* style fix

* bind OutputInfo

* fix description of preprocess submodule

* fix style

* update copyright year

* bind OutputTensorInfo

* bind OutputNetworkInfo and InputNetworkInfo

* Bind exec core ov (#50)

* Output const node python tests (#52)

* add python bindings tests for Output<const ov::None>

* add proper tests

* add new line

* rename ie_version to version

* Pszmel/bind infer request (#51)

* remove set_batch, get_blob and set_blob

* update InferRequest class

* change InferenceEngine::InferRequest to ov::runtime::InferRequest

* update set_callback body

* update bindings to reflect ov::runtime::InferRequest

* bind set_input_tensor and get_input_tensor

* style fix

* clen ie_infer_queue.cpp

* Bind exec core ov (#50)

* bind core, exec_net classes

* rm unused function

* add new line

* rename ie_infer_request -> infer_request

* update imports

* update __init__.py

* update ie_api.py

* Replace old containers with the new one

* create impl for create_infer_request

* comment out infer_queue to avoid errors with old infer_request

* update infer_request bind to reflect new infer_request api

* comment out inpuit_info from ie_network to avoid errors with old containers

* Register new containers and comment out InferQueue

* update infer request tests

* style fix

* remove unused imports

* remove unused imports and 2 methods

* add tests to cover all new methods from infer_request

* style fix

* add test

* remove registration of InferResults

* update name of exception_ptr parameter

* update the loops that iterate through inputs and outputs

* clean setCustomCallbacks

* style fix

* add Tensor import

* style fix

* update infer and normalize_inputs

* style fix

* rename startTime and endTime

* Create test for mixed keys as infer arguments

* update infer function

* update return type of infer

Co-authored-by: Bartek Szmelczynski <bartosz.szmelczynski@intel.com>

* fix get_version

* fix opaque issue

* some cosmetic changes

* fix codestyle in tests

* make tests green

* Extend python InferRequest

* Extend python Function

* Change return value of infer call

* Fix missing precisions conversions in CPU plugin

* Rework of runtime for new tests

* Fixed onnx reading in python tests

* Edit compatibility tests

* Edit tests

* Add FLOAT_LIKE xfails

* bind ColorFormat and ResizeAlgorithm

* clean imports

* fix typo

* [Python API] bind ProfilingInfo (#55)

* bind ProfilingInfo

* Add tests

* Fix code style

* Add property

* fix codestyle

* Infer new request method (#56)

* fix conflicts, add infer_new_request function

* remove redundant functions, fix style

* revert the unwanted changes

* revert removal of the Blob

* revert removal of isTblob

* add add_extension from path

* codestyle

* add PostProcessSteps to init

* bind PreProcessSteps

* create additional tests

* fix win build

* add inputs-outputs to function

* update infer queue

* fix code style

* Hot-fix CPU plugin with precision

* fix start_async

* add performance hint to time infer (#8480)

* Updated common migration pipeline (#8176)

* Updated common migration pipeline

* Fixed merge issue

* Added new model and extended example

* Fixed typo

* Added v10-v11 comparison

* Avoid redundant graph nodes scans (#8415)

* Refactor work with env variables (#8208)

* del MO_ROOT

* del MO_ROOT from common_utils.py

* add MO_PATH to common_utils.py

* change mo_path

* [IE Sample Scripts] Use cmake to build samples (#8442)

* Use cmake to build samples

* Add the option to set custom build output folder

* Remove opset8 from compatibility ngraph python API (#8452)

* [GPU] OneDNN gpu submodule update to version 2.5 (#8449)

* [GPU] OneDNN gpu submodule update to version 2.5

* [GPU] Updated onednn submodule and added layout optimizer fix

* Install rules for static libraries case (#8384)

* Proper cmake install for static libraries case

* Added an ability to skip template plugin

* Added install rules for VPU / GPU

* Install more libraries

* Fixed absolute TBB include paths

* Disable GNA

* Fixed issue with linker

* Some fixes

* Fixed linkage issues in tests

* Disabled some tests

* Updated CI pipelines

* Fixed Windows linkage

* Fixed custom_opset test for static casr

* Fixed CVS-70313

* Continue on error

* Fixed clanf-format

* Try to fix Windows linker

* Fixed compilation

* Disable samples

* Fixed samples build with THREADING=SEQ

* Fixed link error on Windows

* Fixed ieFuncTests

* Added static Azure CI

* Revert "Fixed link error on Windows"

This reverts commit 78cca36fd2.

* Merge static and dynamic linux pipelines

* Fixed Azure

* fix codestyle

* rename all methods in this class to snake_case

* some updates

* code style

* fix code style in tests

* update statistics reporting

* update filling inputs

* change ngraph.Type to ov.Type

* fix typo

* save work

* save work

* save work

* compute latency in callback

* save work

* Fix get_idle_request

* save work

* fix latency

* Fix code style

* update AppInputInfo

* add iteration to PatrialShape

* fix rebasing

* bind result::get_layout()

* correct mistakes

* fix setup

* use parameters/results instead inputs/outputs

* move _from_node to node_output.hpp

* add read_model from buffer

* update imports

* revert package struct

* add new line

* remove bad quotes

* update imports

* style fix

* add new line

* Fix preprocessing

* rename functin args

* set NCHW layout to image as default

* Fix input fillings

* remove Type import

* update tests

* style fix

* test clean

* remove blank line

* Add tensor_shape

* fix comments

* update PrePostProcessor init and build methods

* create test with model update tests with new PrePostProcessor init and build

* Change filling inputs

* fix preprocessing

* basic support dynamic shapes

* fix legacy mode

* rename ie to core

* fix cpp code style

* fix input files parsing

* fix binary filling

* support dynamic batch size

* process images with original shapes if no tensor shapes were given

* fix fps and number of iterations

* Add new metrics

* support pass path to folder into input mapping

* add pcseq flag

* fix resolving conflicts

* dump statistic per group

* check for compatibility with partial shape

* revert statistic report names

* code refactoring

* update parameters

* enable legacy_mode if data size less than nireq

* add serialize to offline_transformations

* Fix preprocessing import

* change log output due to ci parsing

* fix layout

* allow to pass batch size with undefined layout

* add serializer

* fix comments from jiwaszki

* Fix latency parsing for ci

* code style

* rename tensor_shape to data_shape

* add message if image is processed with original shape

* fix syntax warning

* remove default legacy_mode if requests cover all data

* rewrite all file parsing

* fix preprocessing

* Fix preprocessing #2

* Use layout instead str

* Fix file extensions

* Fix image sizes filling

* sort input files

* [Python API] quick fix of packaging

* update tests

* fix setup.py

* small fix

* small fixes according to comments

* skip mo frontend tests

* full mode is default for dynamic models only

* backward compatibility

* Fix package

* set layout in runtime

* static mode for dynamic models with all equal data shapes

* use get_tensor instead set_tensor in legacy mode

* benchmarking dynamic model available in full mode only

* fix layout detection

* use batch_size * iteration instead processed_frames in legacy mode

* fix tensor naming

* represent --inference_only

* refactoring main loop

* Fix number of iterations for full mode

Co-authored-by: Michael Nosov <mikhail.nosov@intel.com>
Co-authored-by: pszmel <piotr.szmelczynski@intel.com>
Co-authored-by: Bartek Szmelczynski <bartosz.szmelczynski@intel.com>
Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: jiwaszki <jan.iwaszkiewicz@intel.com>
Co-authored-by: Victor Kuznetsov <victor.kuznetsov@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Tomasz Jankowski <tomasz1.jankowski@intel.com>
Co-authored-by: Dmitry Pigasin <dmitry.pigasin@intel.com>
Co-authored-by: Artur Kulikowski <artur.kulikowski@intel.com>
Co-authored-by: Ilya Znamenskiy <ilya.znamenskiy@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-12-02 16:18:18 +03:00
Tingqian Li
87ea55f4d5
[CPU] Native dynamic shapes support in the Bucketize node (#8636) 2021-12-02 14:37:53 +03:00
mei, yang
0bede45eb1
Meiyang/fix cvs58539 (#8217)
* reshape conv filter with gather in ngraph paddle front end

* use unsqueeze for broadcasting in elementwise ops in ngraph paddle frontend

* support dynamic input for paddle elementwise ops

* add annotation

* use general opset in paddle elementwise op

* Revert "use general opset in paddle elementwise op"

This reverts commit ff552d2efe47286910df9876e1b0d97ff6301695.

* Revert "add annotation"

This reverts commit b2e16633c192bddfb94963465d175f98fdad1719.

* Revert "support dynamic input for paddle elementwise ops"

This reverts commit a30a93f5b80f0a88064112e498f83eb9b22aa4bd.
use general opset in paddle elementwise op

* fix clang issue

* Add annotation to get_reshaped_filter() and rename some variable in get_reshaped_filter()

* handle broadcast of paddle elementwise with AutoBroadcastType::PDPD

* link inference_engine_transformations lib to paddle frontend

* Disable op sequence fusion when PDPD broadcast

* Revert "Disable op sequence fusion when PDPD broadcast"

This reverts commit 9172078e76317fb92507025478cf06f4ddc5b87d.

* Revert "handle broadcast of paddle elementwise with AutoBroadcastType::PDPD"

This reverts commit fc8d57ecb58f68f27bed1b8ba537af9a6737a4f6.

* fix merge issue
2021-12-02 13:17:17 +03:00
Ilya Lavrenov
e81e60b233
Revert "disable debug postfix on mac (#6827)" (#8974)
This reverts commit 6f23458534.
2021-12-02 12:30:01 +03:00
Sergey Lyubimtsev
1d6d3ebea8
Add requirements files generation for installer (#8940)
* Add requirements files generation for installer

* add line

* fix build

* fix var

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-12-02 11:54:38 +03:00
Ilya Znamenskiy
607814828d
[GPU] Rollback to cldnn from onednn and some fixes and improvements (#8761) 2021-12-02 11:28:38 +03:00
Katarzyna Mitrus
9e3b9b8fbc
[Slice-8] Serialization single layer tests (#8959)
* Serialize Slice single layer tests

* Extend bounds type prop test case

* Disable tests for lower bounds serialization
2021-12-02 11:20:52 +03:00
Vladimir Paramuzov
0f667b90ff
[GPU] Renamed GPU plugin to ov_intel_gpu_plugin (#8957) 2021-12-02 11:06:00 +03:00
Dmitry Pigasin
85f5528cad
Fix infer model with non 2d tensors (#8752) 2021-12-02 10:59:53 +03:00
Evgenya Stepyreva
84ebe77f62
Shape inference 2nd batch (#8781) 2021-12-02 10:47:41 +03:00
Ivan Tikhonov
e23e6f3628
Add nlohmann json (Release 3.10.4) as submodule (#8915) 2021-12-02 10:41:36 +03:00
Vladimir Dudnik
bc8fbf530b
rm python object_detection_sample_ssd (#8880)
* remove python object_detection_sample_ssd

* rm refs to deleted python sample
2021-12-02 09:51:36 +03:00
Alexander Sesorov
4b8d6c59e3
Update sanitizer flags for windows (#8830) 2021-12-02 01:33:34 +03:00
Alexandra Sidorova
802b5bcfbb
[CPU] Reduced overheads in inference stage (#6794) 2021-12-02 01:20:07 +03:00
Mikhail Nosov
3ab533a89c
Fix array out-of-bounds error (#8966) 2021-12-02 00:07:37 +03:00
Alexey Lebedev
4e6eeea6ff
[PYTHON API] move frontend bindings to pyopenvino + move MO to use new Python API (#8301)
* move frontend folder to pyopenvino

* rename includes and add compile options

* include frontend to pyopenvino

* move __init__.py

* move tests

* remove mock from tests_compatibility

* rename import module

* Fix code style cpp

* refactor a few lines

* update few lines in mo

* Add pyopenvino to dependencies

* Fix mock

* update docstring

* Fix mo test

* remove module local

* fix code style

* update comment

* fix return type

* update docs

* fix code style

* fix building

* fix code style

* try to move MO to use new api

* Export more enum names from nrgaph

* [Python API] quick fix of packaging

* update tests

* fix setup.py

* small fix

* small fixes according to comments

* skip mo frontend tests

* update mo to new imports

* try to fix win wheel

* fix win wheel

* fix code style

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: y <ilya.lavrenov@intel.com>
2021-12-01 21:31:16 +03:00
Sergey Shlyapnikov
fa1d9867f2
[GPU] Fix incorrect output result in primitives with two outputs (#8902) 2021-12-01 19:23:38 +03:00
Eugeny Volosenkov
81b003e688
Python API for If operation (#7934)
* add if in python_api

* add test for if python api

* fix code style

* fix typr of output_desc

* move to ne api

* Revert "add if in python_api"

This reverts commit fca6e5a449.

* Revert compatibility if_op

* fix codestyle

* add new tests, disable test where bug is appear

* fix codestyle

* fix test

* rewrite interface if python_api

* fix dict_attribute_visitor.cpp

* fix codestyle

* fix codestyle

* update dict_attribute_visitor.cpp

* add comapti

* add compatibilty tests

* fix if_op description, and paths

* add compatible test

* fix comp opset

* fix opset 8 whitespace

* fix codestyle

* fix tests

* delete old tests

* Revert fixes in test_reduction.py, test_node_factory.py

* Revert fixes in test_reduction.py, test_node_factory.py

* fix tuple

* fix tuple

* fix tuple

* fix tuple

* fix test path

* fix test path
2021-12-01 18:07:02 +03:00
Mikhail Nosov
caf1f22f63
Update according to new file structure (#8235)
Reworked according to comments

Tested manually only, as there is no way to change priority frontends list on test time
2021-12-01 16:53:20 +03:00
Indira Salyahova
9d776ffc2f
feat: symmetic fq in self attention block transformer (#8616) 2021-12-01 15:34:40 +03:00
Alexey Lebedev
246e628c79
[PYTHON API] fix tensor naming (#8918)
* bind any_names

* Update src/bindings/python/src/pyopenvino/graph/node_output.hpp

Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>

* add properties and tests

Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
2021-12-01 14:57:24 +03:00
Ilya Lavrenov
5a52a8e4a3
Don't install content of openvino-dev; install wheels (#8820)
* Don't install content of openvino-dev

* Install MO in tests

* Install python's BA tool only for tests
2021-12-01 14:34:50 +03:00
Bartek Szmelczynski
f211749e15
Expose enum version (#8893)
* add version param to offline_transofmations serialize

* fix style

* fix style

* remove redundant commented code
2021-12-01 13:49:28 +03:00
Vladislav Volkov
8a1b63ec51
Memory leaks in tbbbind and onednn were fixed (#8825) 2021-12-01 12:56:29 +03:00
Alina Kladieva
0c1902b8c5
Revert "Temporarily pin setuptools version (#8416)" (#8931)
This reverts commit 2ed4e9c05f.
2021-12-01 12:22:03 +03:00
Pavel Esir
6c0fa03ca6
[MO] dynamic shape calculatoin for GatherElements, Sparse ops (#8478)
* dynamic shape calculation for GatherElements

* dynamic shape calculation for sparse_reshape, corrections for sparse_segment_mean/sqrtn/sum

* corrected dynamic_dimension_value, added two unit-test cases

* simplified solution, added missing Nones

* some corrections

* added a couple of more unit-tests
2021-12-01 12:07:01 +03:00
Alexey Suhov
89911caa5a
Add licensing folder to cmake install (#8948) 2021-12-01 11:42:52 +03:00
undef-nnov
c1515d92e8
Reverse infer (#8767) 2021-12-01 10:49:04 +03:00