Commit Graph

8269 Commits

Author SHA1 Message Date
Ivan Tikhonov
77ba4ab6dd
AUGRUCell fusion transformation (#12844)
* AUGRUCell fusion transformation and tests

* add missed includes

* Apply review comments

* Apply review comments

* fix build

* Enable accuracy tests

* change supported  weights format from zrh to rzh

* update submodule version

* resolve review comments

* add additional checks to pattern

* fix conflict with master
2022-09-22 14:21:05 +03:00
Mateusz Tabaka
249df503eb
[Python] Relinquish infer request handle before handling exception (#13114)
When runtime exception was thrown during infer call, the infer
request handle was never relinquished nor condition variable notified.
That caused the get_idle_request_id function wait forever.
2022-09-22 13:00:44 +02:00
Przemyslaw Wysocki
d5a274b0e4
[PyOV] Drop Python 3.6 support (#12280)
* Drop Python 3.6

* Test dropping Python to 3.6 in py_checks.yml

* Allow Python 3.6 for open source

* Add docs on upgrading Python
2022-09-22 11:58:12 +02:00
Chenhu Wang
2e6eaa6c7e
[CPU] tails optimization for load/store emitters (#12363)
* tails optmization

* apply to store emitter

* gpr index alignment

* load_emu_method_and_threhold_update

* store_emulation_update_and_store_threshold_update

* comments apply

* fix typo
2022-09-22 10:50:48 +02:00
Georgy Krivoruchko
c8da229285
Move TF2 Keras layer tests from private repo and adapt them (#13049)
* Adding Tensorflow2 Keras tests to layer tests

* Fixed usage of use_new_frontend parameter in layer tests of
Tensorflow2 Keras

* Tests changed to use --use_old_api instead of --api_2 argument

* Added copyrights in files

* Added TF2-Keras Activation test to CI check
2022-09-22 12:36:36 +04:00
Sergey Shlyapnikov
33cda223a5
[GPU] Fix performance regression caused by surfaces_lock::create() function move (#13124) 2022-09-22 10:06:09 +04:00
hyunback kim
079021c673
[GPU] Support cross-data type from detection output (#13125)
* detection_output kernel support cross-type(fp16/fp32),
  so graph-optimization also support cross-type detection_output

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-09-22 14:07:10 +09:00
Ivan Tikhonov
f2c0e0b4d7
Upgrade broadcast from v1 to v3 in SequenceToTi transformation (#12922)
* upgrade broadcast in SequanceToTensorIterator transformation, fix broadcast serialization

* codestyle
2022-09-22 07:48:30 +04:00
RICKIE777
9d56cfd79b
[Benchmark] benchmark_app need disable auto batching if batch size is set. (#12553)
* When set batch_size, disable auto batching

* auto-batch only supprt auto plugin

* Set property allow_auto_batching for devices

* cancel static

* Clean Code

* Add test case for testing allow_auto_batching

* Fix the issue after merging latest master branch code

* Add allow_auto_batching in python benchmark_app

* Fix the quotes issue

* When load_network is set to allow-auto-batching, there is no need to read the value of global

* Fix the clang-format

* Change the location

Co-authored-by: River Li <river.li@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-09-22 09:50:30 +08:00
Nesterov Alexander
ce9751a0a4
Fix arm tests (bf16) (#13149)
Fix arm tests bf16
2022-09-22 01:17:33 +03:00
Yuan Xu
4564c92cb6
Port 2022.2 install guide to master (#13138)
* port installing from archive

* fix formatting in code

* Updating archive names in qsg (#12927)

* port 2022.2 install guide changes to master

* small fix

Co-authored-by: Artyom Anokhov <artyom.anokhov@intel.com>
2022-09-21 20:00:05 +04:00
Daniil Lyakhov
6ac2c00f83
Describe pruning transformation in MO help (#13121) 2022-09-21 16:05:48 +04:00
Georgy Krivoruchko
3e60cfb998
Fixed incorrect behavior in case incorrect arguments are passed (#13079)
or in case some arguments are missed
2022-09-21 12:54:27 +04:00
Przemyslaw Wysocki
abefedea17
[PyOV] Update docs with Python 3.10 (#13130) 2022-09-21 10:36:19 +02:00
Sebastian Golebiewski
2e354d85c0
DOCS: New Tutorials homepage (#13051)
* New Homepage for Tutorials

Modifying tutorials.md
Adding separate article for notebooks installation guide: notebooks-installation.md

Updated to version from 13.07.2022

https://repository.toolbox.iotg.sclab.intel.com/projects/ov-notebook/0.1.0-latest/20220713220805/dist/rst_files/

* Update consts.py

* Update consts.py

* Updating tutorials to version from 13.09

Adding missing notebooks:
115, 203, 219, 220, 221, 222, 223,

* Update docs/tutorials.md

* Updating meta tags

Updating meta description and keywords

* Update notebooks-installation.md

* Update tutorials.md
2022-09-21 11:31:40 +04:00
Mingyu Kim
ad933ce320
[GPU] Layout querying for onednn (#12420)
* For onednn primitives, query onednn for proper layout.
2022-09-21 14:54:43 +09:00
Vladimir Paramuzov
0ebc39fece
[GPU] Dynamic unfusing feature (#12674) 2022-09-21 08:56:32 +04:00
Ivan Tikhonov
d60a8e89df
Fix shape propagation in TI in case of dyn slice axis (#12926) 2022-09-20 23:12:32 +03:00
Alexandra Sidorova
e109bd1a32
[CPU] Added support AVX2 and SSE for jit_emu_vcvtneps2bf16 (#12718)
* [CPU] Added support AVX2 and SSE for jit_emu_vcvtneps2bf16

* Upped thresholds

* check condition

* Removed thresholds

* Added kernel test

* Fixed AVX2 and SSE impl: removed AVX512 instructions

* come back

* Fixed jit_emu_vcvtneps2bf16 sse in=out

* update store_emitter for sse

* Added I32 test and updated tests

* united avx2 and sse impls

* Fixed ymm/xmm for avx512

* United with avx512_bf16

* fixed unused variable warning

* unified float2bfloat in convert_emitter
2022-09-20 18:19:39 +02:00
Vladimir Paramuzov
a34b59d897
[GPU] Fix infer() for queue sharing case (#13102) 2022-09-20 17:13:20 +04:00
River Li
ed31a46b7b
[CAPI] improve property implement to achieve better compatibility (#12887)
* Solve some code style issues

Change-Id: I06c31ad9513463c758db96dbe33031983a8fd7a5

* Refine ov_dimension with C style structure

Use C style definition to replace opaque C++ handle:
 1). Improve partial shape
 2). Improve dimension/rank
 3). Improve shape

Change-Id: I680fd3e76c63d0c06d9d8b07c67af0440fb15bb7

* Some minor update

Change-Id: I237490a765e6ecd6f3896b1bd75d5f962304f43b

* add partial_shape_is_dynamic and update doc

Change-Id: Ief358f27de8386e35485d08847c8243d1490157f

* Rename property and add basic test cases

Change-Id: Ifbed0bbf7a5e836d2cab186763d7e5f8f2cb7d44

* address reviewer's comments

Change-Id: I9a5d1ede6d086906f3777c3d29237986a505db52

* Fix compile error

Change-Id: I72267a8dda32dd8f43c1ea1522d07b392052358f

* Use ov_any_t to replace ov_property_value_t

Change-Id: Ia4062d0da0941c901990bf5f16497ae3c8f2eb0f

* update doc for ov_model

Change-Id: I80183394f16dd1e07ff998993e26f8b903f2402e

* Property key apply string variables replace enum variable

Change-Id: I0e1699862de3913ccdc06ded5b8f8ac5a2bf8773

* Fix compiling error in windows

Change-Id: I4f9c7c746e218db94491c5f4bc5aeda1b3fde62b

* Change init/deinit method to create/free, remove unnecessary methods

Change-Id: Ibc5de039da94e92db494583ab1ff1a63e0586c73

* Pass by value for single C structure data

Change-Id: I289eb56e2ba1ab90942c8c801c585ab0f792952f

* fix dllexport issue in windows

Change-Id: I1632375e5e651fdfa076cdab2d8d1c3e83986549

* Fix static build error

Change-Id: I6633fe4887edad0b3a8b7e10730fb9d36a6ac0cd

* Use pass by value for all transparent structure

Change-Id: I652f6e70b420ef7c5af5cff3f5d482911cf0d75a

* Unify parameter order in  C APIs, input first and then output parameters

Change-Id: Ib89c77d81c314e3a81bfcec9917630abbc896f5e

* Rename preprocess api to be more readable

Change-Id: I0a8ecd005e73e4ba8e90a8f25bedf0739fe31836

* Simplfy property implement for set and get property

Change-Id: Icad41606368cef9520b1623f6207784c295f1b9f

* check string type property issue

Change-Id: Ie8ee6995dda401f1db0cc098e061ffcfd24de92a

* Fix memory leak

Change-Id: Ife8980736be320314eca6fb3f3605e019663e1da

* Check string property data

Change-Id: I542a136ff874cb345c67f7d3c1dbc74981a909df

* Fix issues caused by rebase

Change-Id: I3d675a16cf76980a6414e369a83464a46dec1e49

* Remove some redundant code

Change-Id: Iab6bf7f355ec7a7424d884e620319ed9db80ecf5

* Remove property type from interface

ov_core_set_property will have 2 cases:

1) enum type:  <const char* property_key, ov_property_xxx_e property_value>
2) other: <const char* property_key, const char* property_value>

Change-Id: Id7dec1ac40948d45c4f8baee687652aee92ea75d

* Remove redundant code

Change-Id: I66865d3313e305b0109cb63bd049772a01c0688f

* Remove exception log and update propery size argument

Change-Id: Ia1a60c07c9adf08d175d94a7d5e4298adb27bf80

* Apply string for enum property

Change-Id: I591b1db453a52b5ea9000e0cc3e11edf0ef5f790

* Add test case for MULTI_DEVICE_PRIORITIES

Change-Id: I59e4307564a2560724b4dacdb83c3ed45ea1ce8d

* Fix test issues and add more negative test case

Change-Id: Ib849fb8c098e487a537c1b1ab881f5e905871f73
2022-09-20 15:59:27 +03:00
Roman Kazantsev
08e397d571
[MO] Extend support for TF BlockLSTM with the single output, concatenated hidden states (#13095)
* [MO] Extend support for TF BlockLSTM with the single output, concatenated hidden states

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove extra comments

* Apply the code review feedback: return useful logs, more logs for asserts

* Add unit-test for shape infer

* Add unit-test for transformation

* Fix a bug with adding input port for BlockLSTM

* Apply code-review feedback: no need to create existing port, add more comments and correct

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-09-20 15:18:49 +03:00
Ruslan Nugmanov
236778aeec
Refactor of renaming ov libraries for layer tests with key --use_new_frontend (#12846)
* refactor of renaming libraries in layer tests

* 1. adds check for old API and new FE usafe
2. refactor of api_2 arg

* fix for tf_NMS test preprocessing

* take libs path from LD_LIBRARY_PATH env

* convert str to Path object

* use wheels path to libs

* print lib paths

* print lib paths

* use ov_frontend_path env

* also check if file to rename exists

* removes redundant prints

* copy instead of rename

* 1. copy instead of rename
2. adds some details to readme
2022-09-20 13:43:37 +04:00
Pawel Raasz
4f683687de
Enable mock fe tests in python api 2.0 tests (#12978)
* Building python frontend tests

* Enable mock tests in new python API:
- Fix mock_py frontend library name
- Set same destination for mock_py frontend as others frontends
- Fix importing mock_py frontend
- Minor changes in mock_py tests

* Fix flake8 issue

* Fix linking issue on windows

* Remove DISABLE_PYBIND11 option

* Build mock_py always as shared library
- put mock_py into ov::frontend namespace
- minor re-factor of mock_py

* Add mock c API fix warning on windows

* Fix installation of mock_py frontend

* Install mock_py frontend library in tests

* More detailed error message in python test
when cannot import frontend

* Restore IMPLEMENT_OPENVINO_API for windows build
of pybind_mock_frontend

* Set env paths for python API test on Azure CI
- skip tensorflow conversion ext test when not installed

* Correct skip tensorflow test decorator

* Add C API macro for mock1 frontend

* Ignore E999 error reported by flake8

* Fix conversion extension name for tf imports

* Fix flake8 issues

* Remove python3.8 path from LD_LIBRARY_PATH
on debian CI

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-09-20 11:56:46 +03:00
Irina Efode
e9681360f4
[API Conformance] Fix test instances according test requirments (#12752)
* exec_net

* ff

* plugin

* ie_plugin
2022-09-20 11:49:30 +03:00
Ilya Churaev
707a1bfe19
Fixed comments on dev doc (#13117) 2022-09-20 12:45:19 +04:00
Nico Galoppo
ec8735d5e9
Fix links to upper-level documentation (#13112) 2022-09-20 08:06:22 +03:00
Bonhun Koo
572d00eaa2
[POT][GNA] add mixed-precision support for Accuracy Aware Quantization (#12470)
* [POT] add GNA3 mode

* [POT][GNA3] add mixed-precision support for Accuracy Aware Quantization

* [POT] add GNA AAQ sanity test with synthetic data

* [POT][GNA3] add GNA3.5 mode and minimize AAQ option

* [POT] fix pot/ci fails on config test
2022-09-20 08:47:33 +09:00
Georgy Krivoruchko
e7c91518de
Fixed issue with missing operations in SubgraphDumper (#13078)
* Fixed handling of missing "cloners" for operations

* Added missing opsets for cloners creation

Co-authored-by: Irina Efode <irina.efode@intel.com>
2022-09-19 23:27:08 +03:00
Artyom Anokhov
f8f82574ac
[Packaging] RPM generation (#12810)
* Initial

* packaging: Fixed syntax

rpm.cmake: downgraded PYOPENVINO version to 3.6 as default

* install_build_dependencies: Added rpm-build

rpm.cmake: Removed SHLIBDEPS settings for RPMs creation. Replaced CPACK_RPM_PACKAGE_HOMEPAGE with CPACK_RPM_PACKAGE_URL. Set CPACK_RPM_PACKAGE_AUTOREQPROV to ON.

* rpm_post_build.cmake: Fixed warning if rpmlint not installed

rpm.cmake: Removed SHLIBDEPS usage.

* rpm.cmake: Updated comments

* Fixed naming

* developer_package/rpm.cmake: Fixed ov_rpm_add_latest_component macro with using lower case for CPACK_COMPONENT_XXX_DEPENDS set.
2022-09-19 23:16:07 +03:00
Ilya Churaev
b7d183e6e6
Fixed comments after coverage PR (#13100) 2022-09-19 17:20:05 +03:00
Irina Efode
c349e9c3e7
QN Conf (#12798) 2022-09-19 16:04:23 +03:00
Yuan Xu
a2a4a7f946
update with external suggestions (#12791) 2022-09-19 16:50:58 +04:00
rafalxintel
0dfd409951
After changing language, redirect to home page (#12607) 2022-09-19 16:50:36 +04:00
Karol Blaszczak
b6c77d21c9
DOCS doc structure step 2 port to master (#13084)
* DOCS-doc_structure_step_2

- adjustments to the previous change based on feedback
- changes focusing on ModelOptimizer section to mitigate the removal of ONNX and PdPd articles

* remove 2 files we brought back after 22.1
2022-09-19 16:48:35 +04:00
Sebastian Golebiewski
ca8a1c4902
Porting: Change notebooks fetching link for documentation (#13043)
* Porting: Change notebooks fetching link for documentation

Porting:

https://github.com/openvinotoolkit/openvino/pull/12750/

There are newly generated files (since 30.08.2022) that seem to be fine but apparently "latest" is not build in the docs:

https://repository.toolbox.iotg.sclab.intel.com/projects/ov-notebook/0.1.0-latest/20220913220807/dist/rst_files/

The question remains, why is it so?

* Update consts.py

Updating to the most recent version from 13.09

https://repository.toolbox.iotg.sclab.intel.com/projects/ov-notebook/0.1.0-latest/20220913220807/dist/rst_files/
2022-09-19 16:48:05 +04:00
Karol Blaszczak
51cb1d9b30
change 2 images for asynch mode (#12579)
changing two screenshots in "general optimizations" to one comparison csv image
2022-09-19 16:47:39 +04:00
Karol Blaszczak
c265ae191f
one more correction of mobilnet (#13073) 2022-09-19 16:47:18 +04:00
Karol Blaszczak
2e877de934
DOCS-homepage-restyling-pt1 (#12291)
minor css changes to prepare for rst conversion
2022-09-19 16:46:34 +04:00
Ilya Churaev
dcca08763b
Added template for core dev documentation (#13091)
* Added template for core dev documentation

* Update test_coverage.md

* Update coding_style.md

* Update build.md

* Create debug_capabilities.md

* Update index.md

* Update debug_capabilities.md

* Update index.md

* Update README.md

* Create shape_propagation

* Update and rename shape_propagation to shape_propagation.md

* Update shape_propagation.md

* Create operation_enabling_flow.md

* Update index.md

* Update README.md

* Update operation_enabling_flow.md
2022-09-19 15:57:01 +04:00
Ilya Churaev
c66c7064e0
Fixed ov_coverage target (#13090)
* Fixed ov_coverage target

* Added all components
2022-09-19 11:04:10 +04:00
Ilya Lavrenov
b6ce6f4d39
Added support of universal2 OSX binaries (#13093)
* Added support of universal2 OSX binaries

* Fixed openvino wheel for OSX: different library name structure
2022-09-19 10:14:07 +04:00
Roman Kazantsev
939f1e77f0
[ONNX FE Tests] Fix ONNX FE tests on Debian (#13089)
* [ONNX FE Tests] Fix ONNX FE tests on Debian

Fixing error "Cannot load library libtest_builtin_extensions_1.so libopenvino_tensorflow_fe.so"

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update .ci/azure/linux_debian.yml

* Export TF FE for PDPD tests since it uses TF FE extensions

* Export TF FE for PDPD tests since it uses TF FE extensions

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-09-19 01:18:21 +04:00
Xuejun Zhai
c8e62fddb2
[C API] add more descriptions about ov_model & ov_compiled_model (#13061)
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2022-09-16 15:23:30 +03:00
Ilya Lavrenov
99b450ef52
Check ONNX installation before usage (#13069) 2022-09-16 15:18:11 +04:00
Felix Dohyun Kim
8f7c9a05f5
[GPU] Compare float value with tolerance in unit test (#12667)
* compare float value with tolerance
* Support NaN comparison
* use EXPECT_NEAR
* reduce # of testcase
2022-09-16 15:42:08 +09:00
Mateusz Tabaka
a850c8baee
[ONNX] propagate model directory path to Graph, Attribute and Tensor … (#13010)
Required by external data mechanism in ONNX standard, where Tensor object has
to be able to find external data file based on the location field and model
directory path. Previously, it was done by a transformation, but it handled
initializers only, but in order to handle Constant nodes we need one more
loop, but over all of the model's nodes. Propagating model directory path to
Tensor allows us to reduce that overhead.

Ticket: 91271
2022-09-16 06:48:33 +02:00
Tetiana Gubanova
d2e251a109
[GPU] Add blocked layouts support for Roll operation (#12125)
* Add blocked layouts support for Roll operation

* Reduce number of Roll unit tests
2022-09-15 20:23:55 -07:00
Paul Youngsoo Ahn
0bc85f820e
[GPU] Eltwise new shape infer (#12897) (#12897) 2022-09-15 19:51:52 -07:00
Asthestarsfalll
5e977fc470
【PaddlePaddle Hackathon 3】Add Paddle where_index operator (#12437)
* add paddle where_index op

* add more test cases

* add more test cases

* add more test cases and support boolen

* fix clang format

* use paddle.nonzero instead of LayerHelper

* remove opset6

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

Co-authored-by: cecilia peng <cecilia.peng@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-09-16 03:57:02 +03:00