Commit Graph

8300 Commits

Author SHA1 Message Date
Min, Byungil
24f9b33a46
[GPU] Fix issues in tc for reduce fusion (#13150)
Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-09-27 15:21:40 +09:00
Tang, Wenyi
e1ba00a8e0
[GPU] Fix filename confliction at gpu source dump (#13110) (#13111) 2022-09-27 09:46:26 +04:00
Taylor Yeonbok Lee
93c066fb14
[GPU] Fixed NonZero to have sorted result. (#13185)
* Fixed NonZero to have sorted result.
Fixed NonZero cldnn unittest to compare with ngraph reference code.

* Applied review comments

* Added more tests for 1d,2d,3d

* Fix local mem to be read from the param
2022-09-27 09:42:24 +04:00
Mateusz Tabaka
da0cb0b589
[ONNX] use stoull to fetch length and offset to external data (#13186)
Ticket: 92373
2022-09-27 04:45:00 +02:00
Roman Kazantsev
8406983849
[TF FE] Support GRUBlockCell (#13202)
* [TF FE] Support GRUBlockCell

Currently, we support only hidden state output from GRUBlockCell due to
OpenVINO GRUCell capability

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix code-style issue

* Return Softsign translator

* Add tests for GRUBlockCellReplacer

* Fix issue for bias in GRUBlockCellReplacer

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-09-27 01:30:55 +03:00
Tomasz Jankowski
e47b8858aa
Add compilation control to python test mocks (#13212) 2022-09-27 01:38:01 +04:00
Ivan Tikhonov
b6e0c80828
fix assert in gru cell fusion tests (#13181) 2022-09-27 00:08:07 +03:00
avoskoboinyk-lohika
35c4821021
[CPU] ShapeOf test: convert from LayerTestsCommon to SubgraphBaseTest and enable it (#13030)
* ShapeOf test: convert from LayerTestsCommon to SubgraphBaseTest and enable it

* Drop tail underline from description

* Rename filterCPUInfoForDevice -> filterFormatsInfoForDevice

* Use more suitable function name and reuse makeNgraphFunction
2022-09-26 10:00:00 +02:00
Ilya Lavrenov
07d68b5895
Ability to build OpenVINO wheel based on OV developer package (#13197)
* Allow to compile wheel package based on OpenVINO developer package

* Added wheel specific runtime dir to avoid issues with generator expressions

* Added backward compatibility

* Trying to fix RHEL, U20

* Fixed cmake options in setup.py
2022-09-26 11:33:50 +04:00
Wang Wangwang
7bbd428e48
Docs: Update the doc on how to manually set operations affinity & fix some spelling errors (#13203)
* Docs: Fix spelling errors

* Docs: Update the doc on how to manually set operations affinity
2022-09-26 10:39:44 +04:00
Kelvin Choi
766c289e15
[GPU] Reduce to use ngraph shape infer at calc_output_layouts (#13032) 2022-09-26 09:51:21 +04:00
Ilya Lavrenov
12f1e95c3d
Improvements for OSX build (#13201)
* Hide some helper variables as internal ones

* Added an ability to test private API for TF FE

* OSX improvements

* Fixed project generation for xcode
2022-09-26 07:48:41 +04:00
Ilya Lavrenov
d82cdc39e4
Allow to extra modules by relative path (#13199) 2022-09-26 07:47:59 +04:00
Felix Dohyun Kim
2bc32a172b
[GPU] Fix DG2 FullyConnected test case (#12854)
* Enforce selection of onednn primitive for the test
* Bias size bugfix
2022-09-26 10:29:20 +09:00
Roman Kazantsev
8daae561da
[TF FE] Add a translator for Softsign (#13195)
* [TF FE] Add a translator for Softsign

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply code-style

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-09-25 22:56:00 +04:00
Roman Kazantsev
d192c1341e
[TF FE] Support BlockLSTM operation (#13170)
* [TF FE] Support BlockLSTM operation

Due to restrictions of LSTMSequence, currently we support
only concatenated hidden states from all time steps

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply feedback: opset9 use, remove redundant code, preserve tensor name

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply feedback: check for dynamic dimension, non-nullptr for decoder use

* Copy run-time info using NodeRegistry

* Prepare test placeholder for internal transformations and operations

Clean-up includes

* Implement unit-tests for BlockLSTMToLSTMSequenceOneOutput transformation

* Apply code-style changes

* Fix computation of hidden_size

* Fix output tensor name

* Revert incorrect changes

* Fix a type of hidden_size in tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-09-25 22:53:54 +04:00
Ilya Lavrenov
5c4564c214
Tensorflow func tests (#13198)
* Added auto-detect for SHUTDOWN_PROTOBUF option

* Hide some helper variables as internal ones

* Update frontends cmake files not to include tests folders

* Added an ability to test private API for TF FE

* Added an ability to test private API for TF FE

* Improved mock frontends in python tests

* Fixed compilation error

* Fixed link on WIndows
2022-09-25 16:54:26 +04:00
Liubov Talamanova
4df8ed881a
[POT] Unroll GRUCell for GNA (#12930)
* [POT] Unroll GRUCell for GNA

* Add test
2022-09-23 21:57:10 +03:00
Mingyu Kim
726de246aa
[GPU] Ignore exception that happens during layout querying (#13184)
This might happen unnecessarily because of unsupported primitive, such
as asymmetric weights.
2022-09-23 23:00:13 +09:00
Bartek Szmelczynski
d0af3bb9ee
[MO] enable ir_reader read and write Quantico model (#12515) 2022-09-23 15:35:43 +02:00
Anastasia Popova
940844e71f
mo.convert() method. (#11347)
* convert() method added.

* Moved conversion to convert() method.

* Fixed commits.

* Output dir fix.

* Added objects support for extesions param.

* Added support for transformations_config extension objects.

* Input to str unit tests.

* Added tests, added comments.

* Updated BOM.

* Removed commented code.

* Fixed extension passing.

* Small corrections.

* Fixed for python 3.6.

* Small fix.

* Moved dir creating to ov.serialize(), removed mo.serialize(), small fixes.

* Small fix.

* Small correction.

* Removed coping of params, moved convert implemetation to separate module.

* Import fixes.

* Moved hiding of exceptions to main().

* Updated comment.

* Fixed unit tests.

* Comment changed.

* Fixed dir creating.

* Tests fixed.

* Small fixes.

* Test fix.

* Added meta data generation, removed printing of execution time for silent mode.

* Import fix.

* Conflict fix.

* Fixed error.

* Fix for custom config.

* Added version, data_type params to help.

* Added mo.convert() full-functional tests.

* Small corrections.

* Comment correction.

* Moved convert to openvino package, moved LayotMap and InputCutInfo to openvino.convert.

* Added help param.

* Wrong change removed.

* Small fix.

* Removed unnecessary comments.

* Removed .xml extension check from append_ir_info.

* Added missed file.

* Fixed error.

* Fix for bool value in InputCutInfo.

* Moved InputCutInfo, LayoutMap to openvino.tools.mo.

* Moved InputCutInfo, LayoutMap to openvino.tools.mo.

* Moved check and read_model to emit_ir.

* Small correction.

* Added comment.

* Added unit_tests with convert().

* Small corrections.

* Removed convert alias from openvino.

* Fixed conflicting unit tests.

* Removed unnecessary warnings.

* Params check fix.

* Small correction.

* Added paths checks.

* Added negative tests for to_str methods, fixed errors.

* Added tuples support in input parameter.

* Moved reminders to update OV and use API 2.0 to main().

* Returned .mapping file generating.

* Added positional input_model param.

* Added test for unnamed input_model.

* Optimize imports.

* Added more informative error for brackets syntax in --input.

* Conflict fix.

* Conflict fix.
2022-09-23 17:29:00 +04:00
Ilya Churaev
5fff132611
Dev doc guide (#13163)
* Add developer guide for the documentation

* Update dev_doc_guide.md

* Update CI trigger rules

* Fixed CI run

* Fixed CI trigers

* Disable trigger for .ci

* Revert "Disable trigger for .ci"

This reverts commit a5770a61bc.

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/index.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/index.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/dev/dev_doc_guide.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2022-09-23 15:35:12 +04:00
yanlan song
6c1eb9d692
fix core dump when quit benchmark (#13028)
* fix core dump when quit benchmark

Signed-off-by: fishbell <bell.song@intel.com>

* enable tests

Signed-off-by: fishbell <bell.song@intel.com>

* naming change

Signed-off-by: fishbell <bell.song@intel.com>

* add macro to handle CPU not built

Signed-off-by: fishbell <bell.song@intel.com>

Signed-off-by: fishbell <bell.song@intel.com>
2022-09-23 18:22:25 +08:00
Tingqian Li
377c231458
[CPU] rnn: add pd to cache for preparing memory accordingly (#12571)
* [CPU] rnn: prepare memory according to pd of real primitive used

* Remove internalBlobDesc initialization, add node name to error message

* Add CPU functional test switching between batch sizes

* fix LSTMCell input data range

* Change W/R/B initial value ranges and abs_threshold only for dynamic batch test
2022-09-23 12:11:05 +02:00
Vladimir Paramuzov
fbb0ad197d
[GPU] Extended profiling (#13066) 2022-09-23 13:29:43 +04:00
Vladimir Paramuzov
5500aed209
[GPU] Additional pattern for GELU fusion (#12928) 2022-09-23 09:06:55 +04:00
Ivan Tikhonov
af7384f8c9
GRUCell fusion transformation (#12843)
* GRUCell fusion transformation and tests

* Enable GRUCell fusion transformation in MOC

* add missed include

* add missed include again

* fix warning in the tests

* Apply review comments

* Use NodeRegistry in GRUCellFusion transformation, apply review comments

* Add support for both formats zrh and rzh

* move additional checks to pattern, remove the transformation from MOC

* fix conflict with master branch

* apply review comments

* Update src/tests/functional/inference_engine/transformations/common_optimizations/gru_cell_fusion.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* fix warning

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-09-23 07:21:13 +04:00
Andrei Kochin
55af2941f5
[DOC] Fix link to pre-computed FRCNN detectors for Caffe model (#13133)
as seems already merged to openvinotoolkit/openvino_docs#225 enabling auto-merge here
2022-09-23 01:43:21 +04:00
Felix Dohyun Kim
d9ed6d98c7
[GPU] Fix some conv and pooling unit tests for DG2 (#13016)
* change activation function for onednn
* adaptive tolerance
* higher tolerance for multiple eltwise test
* enable all eltwise_mode of postop eltwise
2022-09-22 23:54:38 +09:00
Karol Blaszczak
2e9454c77b
Docs benchmarks page update (#13162)
* update page and benchmark config data

benchmarks articles
update data tables
delete image

* hide / remove ovms benchmarks page

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2022-09-22 17:04:12 +04:00
Ilya Churaev
ce4bba6a08
Disabled Azure for documentation changes (#13171)
* Update CI trigger rules

* Fixed CI run

* Fixed CI trigers

* Disable trigger for .ci

* Revert "Disable trigger for .ci"

This reverts commit 92c812ccb0.
2022-09-22 16:04:17 +04:00
Ivan Tikhonov
77ba4ab6dd
AUGRUCell fusion transformation (#12844)
* AUGRUCell fusion transformation and tests

* add missed includes

* Apply review comments

* Apply review comments

* fix build

* Enable accuracy tests

* change supported  weights format from zrh to rzh

* update submodule version

* resolve review comments

* add additional checks to pattern

* fix conflict with master
2022-09-22 14:21:05 +03:00
Mateusz Tabaka
249df503eb
[Python] Relinquish infer request handle before handling exception (#13114)
When runtime exception was thrown during infer call, the infer
request handle was never relinquished nor condition variable notified.
That caused the get_idle_request_id function wait forever.
2022-09-22 13:00:44 +02:00
Przemyslaw Wysocki
d5a274b0e4
[PyOV] Drop Python 3.6 support (#12280)
* Drop Python 3.6

* Test dropping Python to 3.6 in py_checks.yml

* Allow Python 3.6 for open source

* Add docs on upgrading Python
2022-09-22 11:58:12 +02:00
Chenhu Wang
2e6eaa6c7e
[CPU] tails optimization for load/store emitters (#12363)
* tails optmization

* apply to store emitter

* gpr index alignment

* load_emu_method_and_threhold_update

* store_emulation_update_and_store_threshold_update

* comments apply

* fix typo
2022-09-22 10:50:48 +02:00
Georgy Krivoruchko
c8da229285
Move TF2 Keras layer tests from private repo and adapt them (#13049)
* Adding Tensorflow2 Keras tests to layer tests

* Fixed usage of use_new_frontend parameter in layer tests of
Tensorflow2 Keras

* Tests changed to use --use_old_api instead of --api_2 argument

* Added copyrights in files

* Added TF2-Keras Activation test to CI check
2022-09-22 12:36:36 +04:00
Sergey Shlyapnikov
33cda223a5
[GPU] Fix performance regression caused by surfaces_lock::create() function move (#13124) 2022-09-22 10:06:09 +04:00
hyunback kim
079021c673
[GPU] Support cross-data type from detection output (#13125)
* detection_output kernel support cross-type(fp16/fp32),
  so graph-optimization also support cross-type detection_output

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-09-22 14:07:10 +09:00
Ivan Tikhonov
f2c0e0b4d7
Upgrade broadcast from v1 to v3 in SequenceToTi transformation (#12922)
* upgrade broadcast in SequanceToTensorIterator transformation, fix broadcast serialization

* codestyle
2022-09-22 07:48:30 +04:00
RICKIE777
9d56cfd79b
[Benchmark] benchmark_app need disable auto batching if batch size is set. (#12553)
* When set batch_size, disable auto batching

* auto-batch only supprt auto plugin

* Set property allow_auto_batching for devices

* cancel static

* Clean Code

* Add test case for testing allow_auto_batching

* Fix the issue after merging latest master branch code

* Add allow_auto_batching in python benchmark_app

* Fix the quotes issue

* When load_network is set to allow-auto-batching, there is no need to read the value of global

* Fix the clang-format

* Change the location

Co-authored-by: River Li <river.li@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-09-22 09:50:30 +08:00
Nesterov Alexander
ce9751a0a4
Fix arm tests (bf16) (#13149)
Fix arm tests bf16
2022-09-22 01:17:33 +03:00
Yuan Xu
4564c92cb6
Port 2022.2 install guide to master (#13138)
* port installing from archive

* fix formatting in code

* Updating archive names in qsg (#12927)

* port 2022.2 install guide changes to master

* small fix

Co-authored-by: Artyom Anokhov <artyom.anokhov@intel.com>
2022-09-21 20:00:05 +04:00
Daniil Lyakhov
6ac2c00f83
Describe pruning transformation in MO help (#13121) 2022-09-21 16:05:48 +04:00
Georgy Krivoruchko
3e60cfb998
Fixed incorrect behavior in case incorrect arguments are passed (#13079)
or in case some arguments are missed
2022-09-21 12:54:27 +04:00
Przemyslaw Wysocki
abefedea17
[PyOV] Update docs with Python 3.10 (#13130) 2022-09-21 10:36:19 +02:00
Sebastian Golebiewski
2e354d85c0
DOCS: New Tutorials homepage (#13051)
* New Homepage for Tutorials

Modifying tutorials.md
Adding separate article for notebooks installation guide: notebooks-installation.md

Updated to version from 13.07.2022

https://repository.toolbox.iotg.sclab.intel.com/projects/ov-notebook/0.1.0-latest/20220713220805/dist/rst_files/

* Update consts.py

* Update consts.py

* Updating tutorials to version from 13.09

Adding missing notebooks:
115, 203, 219, 220, 221, 222, 223,

* Update docs/tutorials.md

* Updating meta tags

Updating meta description and keywords

* Update notebooks-installation.md

* Update tutorials.md
2022-09-21 11:31:40 +04:00
Mingyu Kim
ad933ce320
[GPU] Layout querying for onednn (#12420)
* For onednn primitives, query onednn for proper layout.
2022-09-21 14:54:43 +09:00
Vladimir Paramuzov
0ebc39fece
[GPU] Dynamic unfusing feature (#12674) 2022-09-21 08:56:32 +04:00
Ivan Tikhonov
d60a8e89df
Fix shape propagation in TI in case of dyn slice axis (#12926) 2022-09-20 23:12:32 +03:00
Alexandra Sidorova
e109bd1a32
[CPU] Added support AVX2 and SSE for jit_emu_vcvtneps2bf16 (#12718)
* [CPU] Added support AVX2 and SSE for jit_emu_vcvtneps2bf16

* Upped thresholds

* check condition

* Removed thresholds

* Added kernel test

* Fixed AVX2 and SSE impl: removed AVX512 instructions

* come back

* Fixed jit_emu_vcvtneps2bf16 sse in=out

* update store_emitter for sse

* Added I32 test and updated tests

* united avx2 and sse impls

* Fixed ymm/xmm for avx512

* United with avx512_bf16

* fixed unused variable warning

* unified float2bfloat in convert_emitter
2022-09-20 18:19:39 +02:00