Commit Graph

8242 Commits

Author SHA1 Message Date
Ilya Lavrenov
07d68b5895
Ability to build OpenVINO wheel based on OV developer package (#13197)
* Allow to compile wheel package based on OpenVINO developer package

* Added wheel specific runtime dir to avoid issues with generator expressions

* Added backward compatibility

* Trying to fix RHEL, U20

* Fixed cmake options in setup.py
2022-09-26 11:33:50 +04:00
Wang Wangwang
7bbd428e48
Docs: Update the doc on how to manually set operations affinity & fix some spelling errors (#13203)
* Docs: Fix spelling errors

* Docs: Update the doc on how to manually set operations affinity
2022-09-26 10:39:44 +04:00
Kelvin Choi
766c289e15
[GPU] Reduce to use ngraph shape infer at calc_output_layouts (#13032) 2022-09-26 09:51:21 +04:00
Ilya Lavrenov
12f1e95c3d
Improvements for OSX build (#13201)
* Hide some helper variables as internal ones

* Added an ability to test private API for TF FE

* OSX improvements

* Fixed project generation for xcode
2022-09-26 07:48:41 +04:00
Ilya Lavrenov
d82cdc39e4
Allow to extra modules by relative path (#13199) 2022-09-26 07:47:59 +04:00
Felix Dohyun Kim
2bc32a172b
[GPU] Fix DG2 FullyConnected test case (#12854)
* Enforce selection of onednn primitive for the test
* Bias size bugfix
2022-09-26 10:29:20 +09:00
Roman Kazantsev
8daae561da
[TF FE] Add a translator for Softsign (#13195)
* [TF FE] Add a translator for Softsign

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply code-style

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-09-25 22:56:00 +04:00
Roman Kazantsev
d192c1341e
[TF FE] Support BlockLSTM operation (#13170)
* [TF FE] Support BlockLSTM operation

Due to restrictions of LSTMSequence, currently we support
only concatenated hidden states from all time steps

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply feedback: opset9 use, remove redundant code, preserve tensor name

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply feedback: check for dynamic dimension, non-nullptr for decoder use

* Copy run-time info using NodeRegistry

* Prepare test placeholder for internal transformations and operations

Clean-up includes

* Implement unit-tests for BlockLSTMToLSTMSequenceOneOutput transformation

* Apply code-style changes

* Fix computation of hidden_size

* Fix output tensor name

* Revert incorrect changes

* Fix a type of hidden_size in tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-09-25 22:53:54 +04:00
Ilya Lavrenov
5c4564c214
Tensorflow func tests (#13198)
* Added auto-detect for SHUTDOWN_PROTOBUF option

* Hide some helper variables as internal ones

* Update frontends cmake files not to include tests folders

* Added an ability to test private API for TF FE

* Added an ability to test private API for TF FE

* Improved mock frontends in python tests

* Fixed compilation error

* Fixed link on WIndows
2022-09-25 16:54:26 +04:00
Liubov Talamanova
4df8ed881a
[POT] Unroll GRUCell for GNA (#12930)
* [POT] Unroll GRUCell for GNA

* Add test
2022-09-23 21:57:10 +03:00
Mingyu Kim
726de246aa
[GPU] Ignore exception that happens during layout querying (#13184)
This might happen unnecessarily because of unsupported primitive, such
as asymmetric weights.
2022-09-23 23:00:13 +09:00
Bartek Szmelczynski
d0af3bb9ee
[MO] enable ir_reader read and write Quantico model (#12515) 2022-09-23 15:35:43 +02:00
Anastasia Popova
940844e71f
mo.convert() method. (#11347)
* convert() method added.

* Moved conversion to convert() method.

* Fixed commits.

* Output dir fix.

* Added objects support for extesions param.

* Added support for transformations_config extension objects.

* Input to str unit tests.

* Added tests, added comments.

* Updated BOM.

* Removed commented code.

* Fixed extension passing.

* Small corrections.

* Fixed for python 3.6.

* Small fix.

* Moved dir creating to ov.serialize(), removed mo.serialize(), small fixes.

* Small fix.

* Small correction.

* Removed coping of params, moved convert implemetation to separate module.

* Import fixes.

* Moved hiding of exceptions to main().

* Updated comment.

* Fixed unit tests.

* Comment changed.

* Fixed dir creating.

* Tests fixed.

* Small fixes.

* Test fix.

* Added meta data generation, removed printing of execution time for silent mode.

* Import fix.

* Conflict fix.

* Fixed error.

* Fix for custom config.

* Added version, data_type params to help.

* Added mo.convert() full-functional tests.

* Small corrections.

* Comment correction.

* Moved convert to openvino package, moved LayotMap and InputCutInfo to openvino.convert.

* Added help param.

* Wrong change removed.

* Small fix.

* Removed unnecessary comments.

* Removed .xml extension check from append_ir_info.

* Added missed file.

* Fixed error.

* Fix for bool value in InputCutInfo.

* Moved InputCutInfo, LayoutMap to openvino.tools.mo.

* Moved InputCutInfo, LayoutMap to openvino.tools.mo.

* Moved check and read_model to emit_ir.

* Small correction.

* Added comment.

* Added unit_tests with convert().

* Small corrections.

* Removed convert alias from openvino.

* Fixed conflicting unit tests.

* Removed unnecessary warnings.

* Params check fix.

* Small correction.

* Added paths checks.

* Added negative tests for to_str methods, fixed errors.

* Added tuples support in input parameter.

* Moved reminders to update OV and use API 2.0 to main().

* Returned .mapping file generating.

* Added positional input_model param.

* Added test for unnamed input_model.

* Optimize imports.

* Added more informative error for brackets syntax in --input.

* Conflict fix.

* Conflict fix.
2022-09-23 17:29:00 +04:00
Ilya Churaev
5fff132611
Dev doc guide (#13163)
* Add developer guide for the documentation

* Update dev_doc_guide.md

* Update CI trigger rules

* Fixed CI run

* Fixed CI trigers

* Disable trigger for .ci

* Revert "Disable trigger for .ci"

This reverts commit a5770a61bc.

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/index.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/index.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2022-09-23 15:35:12 +04:00
yanlan song
6c1eb9d692
fix core dump when quit benchmark (#13028)
* fix core dump when quit benchmark

Signed-off-by: fishbell <bell.song@intel.com>

* enable tests

Signed-off-by: fishbell <bell.song@intel.com>

* naming change

Signed-off-by: fishbell <bell.song@intel.com>

* add macro to handle CPU not built

Signed-off-by: fishbell <bell.song@intel.com>

Signed-off-by: fishbell <bell.song@intel.com>
2022-09-23 18:22:25 +08:00
Tingqian Li
377c231458
[CPU] rnn: add pd to cache for preparing memory accordingly (#12571)
* [CPU] rnn: prepare memory according to pd of real primitive used

* Remove internalBlobDesc initialization, add node name to error message

* Add CPU functional test switching between batch sizes

* fix LSTMCell input data range

* Change W/R/B initial value ranges and abs_threshold only for dynamic batch test
2022-09-23 12:11:05 +02:00
Vladimir Paramuzov
fbb0ad197d
[GPU] Extended profiling (#13066) 2022-09-23 13:29:43 +04:00
Vladimir Paramuzov
5500aed209
[GPU] Additional pattern for GELU fusion (#12928) 2022-09-23 09:06:55 +04:00
Ivan Tikhonov
af7384f8c9
GRUCell fusion transformation (#12843)
* GRUCell fusion transformation and tests

* Enable GRUCell fusion transformation in MOC

* add missed include

* add missed include again

* fix warning in the tests

* Apply review comments

* Use NodeRegistry in GRUCellFusion transformation, apply review comments

* Add support for both formats zrh and rzh

* move additional checks to pattern, remove the transformation from MOC

* fix conflict with master branch

* apply review comments

* Update src/tests/functional/inference_engine/transformations/common_optimizations/gru_cell_fusion.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* fix warning

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-09-23 07:21:13 +04:00
Andrei Kochin
55af2941f5
[DOC] Fix link to pre-computed FRCNN detectors for Caffe model (#13133)
as seems already merged to openvinotoolkit/openvino_docs#225 enabling auto-merge here
2022-09-23 01:43:21 +04:00
Felix Dohyun Kim
d9ed6d98c7
[GPU] Fix some conv and pooling unit tests for DG2 (#13016)
* change activation function for onednn
* adaptive tolerance
* higher tolerance for multiple eltwise test
* enable all eltwise_mode of postop eltwise
2022-09-22 23:54:38 +09:00
Karol Blaszczak
2e9454c77b
Docs benchmarks page update (#13162)
* update page and benchmark config data

benchmarks articles
update data tables
delete image

* hide / remove ovms benchmarks page

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2022-09-22 17:04:12 +04:00
Ilya Churaev
ce4bba6a08
Disabled Azure for documentation changes (#13171)
* Update CI trigger rules

* Fixed CI run

* Fixed CI trigers

* Disable trigger for .ci

* Revert "Disable trigger for .ci"

This reverts commit 92c812ccb0.
2022-09-22 16:04:17 +04:00
Ivan Tikhonov
77ba4ab6dd
AUGRUCell fusion transformation (#12844)
* AUGRUCell fusion transformation and tests

* add missed includes

* Apply review comments

* Apply review comments

* fix build

* Enable accuracy tests

* change supported  weights format from zrh to rzh

* update submodule version

* resolve review comments

* add additional checks to pattern

* fix conflict with master
2022-09-22 14:21:05 +03:00
Mateusz Tabaka
249df503eb
[Python] Relinquish infer request handle before handling exception (#13114)
When runtime exception was thrown during infer call, the infer
request handle was never relinquished nor condition variable notified.
That caused the get_idle_request_id function wait forever.
2022-09-22 13:00:44 +02:00
Przemyslaw Wysocki
d5a274b0e4
[PyOV] Drop Python 3.6 support (#12280)
* Drop Python 3.6

* Test dropping Python to 3.6 in py_checks.yml

* Allow Python 3.6 for open source

* Add docs on upgrading Python
2022-09-22 11:58:12 +02:00
Chenhu Wang
2e6eaa6c7e
[CPU] tails optimization for load/store emitters (#12363)
* tails optmization

* apply to store emitter

* gpr index alignment

* load_emu_method_and_threhold_update

* store_emulation_update_and_store_threshold_update

* comments apply

* fix typo
2022-09-22 10:50:48 +02:00
Georgy Krivoruchko
c8da229285
Move TF2 Keras layer tests from private repo and adapt them (#13049)
* Adding Tensorflow2 Keras tests to layer tests

* Fixed usage of use_new_frontend parameter in layer tests of
Tensorflow2 Keras

* Tests changed to use --use_old_api instead of --api_2 argument

* Added copyrights in files

* Added TF2-Keras Activation test to CI check
2022-09-22 12:36:36 +04:00
Sergey Shlyapnikov
33cda223a5
[GPU] Fix performance regression caused by surfaces_lock::create() function move (#13124) 2022-09-22 10:06:09 +04:00
hyunback kim
079021c673
[GPU] Support cross-data type from detection output (#13125)
* detection_output kernel support cross-type(fp16/fp32),
  so graph-optimization also support cross-type detection_output

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-09-22 14:07:10 +09:00
Ivan Tikhonov
f2c0e0b4d7
Upgrade broadcast from v1 to v3 in SequenceToTi transformation (#12922)
* upgrade broadcast in SequanceToTensorIterator transformation, fix broadcast serialization

* codestyle
2022-09-22 07:48:30 +04:00
RICKIE777
9d56cfd79b
[Benchmark] benchmark_app need disable auto batching if batch size is set. (#12553)
* When set batch_size, disable auto batching

* auto-batch only supprt auto plugin

* Set property allow_auto_batching for devices

* cancel static

* Clean Code

* Add test case for testing allow_auto_batching

* Fix the issue after merging latest master branch code

* Add allow_auto_batching in python benchmark_app

* Fix the quotes issue

* When load_network is set to allow-auto-batching, there is no need to read the value of global

* Fix the clang-format

* Change the location

Co-authored-by: River Li <river.li@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-09-22 09:50:30 +08:00
Nesterov Alexander
ce9751a0a4
Fix arm tests (bf16) (#13149)
Fix arm tests bf16
2022-09-22 01:17:33 +03:00
Yuan Xu
4564c92cb6
Port 2022.2 install guide to master (#13138)
* port installing from archive

* fix formatting in code

* Updating archive names in qsg (#12927)

* port 2022.2 install guide changes to master

* small fix

Co-authored-by: Artyom Anokhov <artyom.anokhov@intel.com>
2022-09-21 20:00:05 +04:00
Daniil Lyakhov
6ac2c00f83
Describe pruning transformation in MO help (#13121) 2022-09-21 16:05:48 +04:00
Georgy Krivoruchko
3e60cfb998
Fixed incorrect behavior in case incorrect arguments are passed (#13079)
or in case some arguments are missed
2022-09-21 12:54:27 +04:00
Przemyslaw Wysocki
abefedea17
[PyOV] Update docs with Python 3.10 (#13130) 2022-09-21 10:36:19 +02:00
Sebastian Golebiewski
2e354d85c0
DOCS: New Tutorials homepage (#13051)
* New Homepage for Tutorials

Modifying tutorials.md
Adding separate article for notebooks installation guide: notebooks-installation.md

Updated to version from 13.07.2022

https://repository.toolbox.iotg.sclab.intel.com/projects/ov-notebook/0.1.0-latest/20220713220805/dist/rst_files/

* Update consts.py

* Update consts.py

* Updating tutorials to version from 13.09

Adding missing notebooks:
115, 203, 219, 220, 221, 222, 223,

* Update docs/tutorials.md

* Updating meta tags

Updating meta description and keywords

* Update notebooks-installation.md

* Update tutorials.md
2022-09-21 11:31:40 +04:00
Mingyu Kim
ad933ce320
[GPU] Layout querying for onednn (#12420)
* For onednn primitives, query onednn for proper layout.
2022-09-21 14:54:43 +09:00
Vladimir Paramuzov
0ebc39fece
[GPU] Dynamic unfusing feature (#12674) 2022-09-21 08:56:32 +04:00
Ivan Tikhonov
d60a8e89df
Fix shape propagation in TI in case of dyn slice axis (#12926) 2022-09-20 23:12:32 +03:00
Alexandra Sidorova
e109bd1a32
[CPU] Added support AVX2 and SSE for jit_emu_vcvtneps2bf16 (#12718)
* [CPU] Added support AVX2 and SSE for jit_emu_vcvtneps2bf16

* Upped thresholds

* check condition

* Removed thresholds

* Added kernel test

* Fixed AVX2 and SSE impl: removed AVX512 instructions

* come back

* Fixed jit_emu_vcvtneps2bf16 sse in=out

* update store_emitter for sse

* Added I32 test and updated tests

* united avx2 and sse impls

* Fixed ymm/xmm for avx512

* United with avx512_bf16

* fixed unused variable warning

* unified float2bfloat in convert_emitter
2022-09-20 18:19:39 +02:00
Vladimir Paramuzov
a34b59d897
[GPU] Fix infer() for queue sharing case (#13102) 2022-09-20 17:13:20 +04:00
River Li
ed31a46b7b
[CAPI] improve property implement to achieve better compatibility (#12887)
* Solve some code style issues

Change-Id: I06c31ad9513463c758db96dbe33031983a8fd7a5

* Refine ov_dimension with C style structure

Use C style definition to replace opaque C++ handle:
 1). Improve partial shape
 2). Improve dimension/rank
 3). Improve shape

Change-Id: I680fd3e76c63d0c06d9d8b07c67af0440fb15bb7

* Some minor update

Change-Id: I237490a765e6ecd6f3896b1bd75d5f962304f43b

* add partial_shape_is_dynamic and update doc

Change-Id: Ief358f27de8386e35485d08847c8243d1490157f

* Rename property and add basic test cases

Change-Id: Ifbed0bbf7a5e836d2cab186763d7e5f8f2cb7d44

* address reviewer's comments

Change-Id: I9a5d1ede6d086906f3777c3d29237986a505db52

* Fix compile error

Change-Id: I72267a8dda32dd8f43c1ea1522d07b392052358f

* Use ov_any_t to replace ov_property_value_t

Change-Id: Ia4062d0da0941c901990bf5f16497ae3c8f2eb0f

* update doc for ov_model

Change-Id: I80183394f16dd1e07ff998993e26f8b903f2402e

* Property key apply string variables replace enum variable

Change-Id: I0e1699862de3913ccdc06ded5b8f8ac5a2bf8773

* Fix compiling error in windows

Change-Id: I4f9c7c746e218db94491c5f4bc5aeda1b3fde62b

* Change init/deinit method to create/free, remove unnecessary methods

Change-Id: Ibc5de039da94e92db494583ab1ff1a63e0586c73

* Pass by value for single C structure data

Change-Id: I289eb56e2ba1ab90942c8c801c585ab0f792952f

* fix dllexport issue in windows

Change-Id: I1632375e5e651fdfa076cdab2d8d1c3e83986549

* Fix static build error

Change-Id: I6633fe4887edad0b3a8b7e10730fb9d36a6ac0cd

* Use pass by value for all transparent structure

Change-Id: I652f6e70b420ef7c5af5cff3f5d482911cf0d75a

* Unify parameter order in  C APIs, input first and then output parameters

Change-Id: Ib89c77d81c314e3a81bfcec9917630abbc896f5e

* Rename preprocess api to be more readable

Change-Id: I0a8ecd005e73e4ba8e90a8f25bedf0739fe31836

* Simplfy property implement for set and get property

Change-Id: Icad41606368cef9520b1623f6207784c295f1b9f

* check string type property issue

Change-Id: Ie8ee6995dda401f1db0cc098e061ffcfd24de92a

* Fix memory leak

Change-Id: Ife8980736be320314eca6fb3f3605e019663e1da

* Check string property data

Change-Id: I542a136ff874cb345c67f7d3c1dbc74981a909df

* Fix issues caused by rebase

Change-Id: I3d675a16cf76980a6414e369a83464a46dec1e49

* Remove some redundant code

Change-Id: Iab6bf7f355ec7a7424d884e620319ed9db80ecf5

* Remove property type from interface

ov_core_set_property will have 2 cases:

1) enum type:  <const char* property_key, ov_property_xxx_e property_value>
2) other: <const char* property_key, const char* property_value>

Change-Id: Id7dec1ac40948d45c4f8baee687652aee92ea75d

* Remove redundant code

Change-Id: I66865d3313e305b0109cb63bd049772a01c0688f

* Remove exception log and update propery size argument

Change-Id: Ia1a60c07c9adf08d175d94a7d5e4298adb27bf80

* Apply string for enum property

Change-Id: I591b1db453a52b5ea9000e0cc3e11edf0ef5f790

* Add test case for MULTI_DEVICE_PRIORITIES

Change-Id: I59e4307564a2560724b4dacdb83c3ed45ea1ce8d

* Fix test issues and add more negative test case

Change-Id: Ib849fb8c098e487a537c1b1ab881f5e905871f73
2022-09-20 15:59:27 +03:00
Roman Kazantsev
08e397d571
[MO] Extend support for TF BlockLSTM with the single output, concatenated hidden states (#13095)
* [MO] Extend support for TF BlockLSTM with the single output, concatenated hidden states

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove extra comments

* Apply the code review feedback: return useful logs, more logs for asserts

* Add unit-test for shape infer

* Add unit-test for transformation

* Fix a bug with adding input port for BlockLSTM

* Apply code-review feedback: no need to create existing port, add more comments and correct

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-09-20 15:18:49 +03:00
Ruslan Nugmanov
236778aeec
Refactor of renaming ov libraries for layer tests with key --use_new_frontend (#12846)
* refactor of renaming libraries in layer tests

* 1. adds check for old API and new FE usafe
2. refactor of api_2 arg

* fix for tf_NMS test preprocessing

* take libs path from LD_LIBRARY_PATH env

* convert str to Path object

* use wheels path to libs

* print lib paths

* print lib paths

* use ov_frontend_path env

* also check if file to rename exists

* removes redundant prints

* copy instead of rename

* 1. copy instead of rename
2. adds some details to readme
2022-09-20 13:43:37 +04:00
Pawel Raasz
4f683687de
Enable mock fe tests in python api 2.0 tests (#12978)
* Building python frontend tests

* Enable mock tests in new python API:
- Fix mock_py frontend library name
- Set same destination for mock_py frontend as others frontends
- Fix importing mock_py frontend
- Minor changes in mock_py tests

* Fix flake8 issue

* Fix linking issue on windows

* Remove DISABLE_PYBIND11 option

* Build mock_py always as shared library
- put mock_py into ov::frontend namespace
- minor re-factor of mock_py

* Add mock c API fix warning on windows

* Fix installation of mock_py frontend

* Install mock_py frontend library in tests

* More detailed error message in python test
when cannot import frontend

* Restore IMPLEMENT_OPENVINO_API for windows build
of pybind_mock_frontend

* Set env paths for python API test on Azure CI
- skip tensorflow conversion ext test when not installed

* Correct skip tensorflow test decorator

* Add C API macro for mock1 frontend

* Ignore E999 error reported by flake8

* Fix conversion extension name for tf imports

* Fix flake8 issues

* Remove python3.8 path from LD_LIBRARY_PATH
on debian CI

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-09-20 11:56:46 +03:00
Irina Efode
e9681360f4
[API Conformance] Fix test instances according test requirments (#12752)
* exec_net

* ff

* plugin

* ie_plugin
2022-09-20 11:49:30 +03:00
Ilya Churaev
707a1bfe19
Fixed comments on dev doc (#13117) 2022-09-20 12:45:19 +04:00
Nico Galoppo
ec8735d5e9
Fix links to upper-level documentation (#13112) 2022-09-20 08:06:22 +03:00