Commit Graph
10337 Commits
Author SHA1 Message Date
Tomasz Jankowski 0f9583c3cf [Transformations] Nop-eliminate 1D Reshape node (#16083)
* Nop-eliminate 1D Reshape node

* Don't eliminate checking Reshape node
2023-03-15 14:43:46 +04:00
Tingqian Li fdc2664b24 fix special FQ node (#14594)
* fix special FQ with zero range in quantized models

* fix format & comments

* Add test case

* remove dot interval test case from smoke_LPT/FakeQuantizeTransformation.CompareFunctions

* Remove dot interval gpu test case because Pooling is also folded

* handle review comment

* fix code style

* update docs

* remove fold_zero_multiply
2023-03-15 10:13:29 +00:00
Katarzyna Mitrus f0c153858b [ShapeInference] EmbeddingBag-Offsets/Packed-Sum shape infer improvements (#16072)
* shape_infer

* Register EmbeddingBagPackedSum shape_nfer for CPU

* Tests

* Merge shapes to preserve 2rd input info

* More label tests

* Add emb_table size check

* rename shape infer file

* Add more tests

* Update constexpr

* Use OV_EXPECT_THROW

* Style

* Reuse emb_table for dynamic rank

* Add common util to calculate emb output shape

* Update embd shape infer to use common util

* Update embedding shape infer util
2023-03-15 11:12:57 +01:00
Katarzyna Mitrus 69ba802e03 [ShapeInference] EmbeddingSegmentsSum shape infer improvements (#16119)
* Update shape_infer

* type prop tests

* Preserve interval and label from input

* Add more tests

* Add emb table scalar check

* Update to use OV_EXPECT_THROW

* Update constexpr

* Code refactor
2023-03-15 11:05:52 +01:00
Maciej Smyk 76f29f8532 DOCS shift to rst - Installing OpenVINO (#16311) 2023-03-15 10:57:03 +01:00
Pawel Raasz bdf1923972 Review bucketize shape inference (#16136)
* Review bucketize shape inference:
- check interval dimension and label propagation
- check template shape_infer implementation
- minor refactoring and add tests

* Add missing using of namespaces
2023-03-15 10:19:57 +01:00
Karol Blaszczak ab684036f4 DOCS-image-fix (#16308) 2023-03-15 10:16:55 +01:00
Sebastian Golebiewski a3d53c0415 DOCS shift to rst - Heterogeneous execution (#16285) 2023-03-15 09:57:30 +01:00
Sebastian Golebiewski 85f80f2a03 DOCS shift to rst - Stateful Models and LowLatency articles (#16288)
Fixing directives for snippets and inline code blocks. Shifting to reST.
2023-03-15 09:56:37 +01:00
Karol Blaszczak d774cc65a9 DOCS shift to rst - cpu n gna (#16252) 2023-03-15 09:39:09 +01:00
Georgy KrivoruchkoandRoman Kazantsev 36c18e29a8 [TF FE] Added Tensorflow CTCLoss layer test (#13644)
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-03-15 08:18:29 +00:00
Maciej SmykandTatiana Savina 4b7b3fb0ae DOCS shift to rst - Openvino Ecosystem article update (#16050)
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2023-03-15 08:51:49 +01:00
Daria Ilina e4f44b19fd Mark all failed ONNX layer tests as skip (#16188)
* Mark all failed ONNX layer tests as XFail

* Add additional xfailed marks

* Add one more failed tests into XFail

* Add conditions for CPU/GPU failures

* Revert "Add conditions for CPU/GPU failures"

This reverts commit 790524c59c.

* Add failures separation for CPU/GPU

* Replace all xfail with skip
2023-03-15 12:22:32 +06:00
Vladimir Paramuzov e44fd03d2a [GPU] Shape agnostic concat kernel + refactoring (#16170) 2023-03-15 09:47:31 +04:00
Ilya Churaev 4b7d1d9f50 Remove redundant clone from Serialize pass (#16277)
* Remove redundant clone from serialize pass

* Revert padding changes in serialize pass

* Provide a class for local copy of nodes with paddigs

* Fixed comments
2023-03-15 07:23:54 +04:00
Eddy Kim e348481849 [GPU] Transformed IR serialization for dynamic models (#16169)
* IR serialization for dynamic models

* added ShapeOf1To3 transformation pass

* fixed input output type mismatch

* removed unnecessary codes

* moved ConvertShapeOf1To3 from common to GPU plugin

* updated copyright year

* fixed build errors
2023-03-14 11:03:02 -07:00
Mateusz TabakaandMichal Lukaszewski 8477bc8897 Reduce the number of validate and infer types in ConvertPrecision (#15277)
* Reduce the number of validate and infer types in ConvertPrecision

Currently, ConvertPrecision pass frequently runs validate and infer types.
This is due to the fact that it iterates over every precision pair, then over
the whole model followed by validate and infer types.
The proposed solution is to iterate over the model: for each node iterate
over precisions array, update the node if required followed by validate and
infer types.

Ticket: 81311

* use map

* clang format

* move enum hasher

* fix gpu

* revalidate

* reinvalidate if node has changed

* remove validate for input prec changes

* fix gpu

* review

* find

* fix pytorch case

* revalidate

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-03-14 21:45:24 +04:00
Maciej Smyk 7578c636b9 DOCS shift to rst - OpenVINO Security (#16280) 2023-03-14 17:23:34 +01:00
Ilya Churaev 95faa573ed Introduce ITensor instead of Blob (#16048)
* Introduce ITensor

* Added new allocator

* Hide ITensor from dev api

* Changed some python tests

* Remove deprecated API from sample

* Fixed warnings

* Skiped unsupported tests

* Fixed exception message

* Fixed template func tests

* Fixed incorrect tests

* Fixed comments and move ITensor to developer API

* Fixed CI issue

* Fixed allocated tensor

* Fixed docs and windows warning

* Fixed set shape for strided tensors

* Fixed build and some comments

* Introduce remote tensor

* Fixed code style

* Fixed build

* Remove static assert method

* Remove fail type

* Added device name API

* Try to fix GPU remote tests

* Added debug output

* Try to fix GPU tests

* Fixed comments

* Fixed build

* Added additional element type check

* Revert some comment changes
2023-03-14 19:12:27 +04:00
Ivan Tikhonov 596036a2db Transpose Sinking: refactoring (#16283)
* Add descriptions to the transformations, add additional checks

* fix a warning
2023-03-14 13:55:25 +00:00
River Li 0ca3ccb7fb [CAPI][TEST] remove testdata repository dependency (#16259)
* [CAPI][TEST] remove testdata repository dependency

Change-Id: I93798d47bcf4abf69562f76aab1469498b4e9ee1

* SCI issue

Change-Id: Ifb422fafdefe26be85a0ae8efdc1530f7f032079

* Apply TEST SUIT for C API tests

Change-Id: Ic716cdb357060e1cbf989871ae39d006f2878632

* Fix issue for static build

Change-Id: I5d33f23b48dcda4baf260553aa8d34e62c13c128
2023-03-14 12:34:33 +00:00
Tomasz Jankowski 0145e538f5 TopK v11 reference implementation (#16137)
* Stabilize ascending comparison of ref impl

* Use reference to gtest param

* Create ref impl tests

* Fix descending by index sorting

* Sort by index both ways

* Make sort by index always ascending (revert)
2023-03-14 12:13:53 +00:00
Sebastian Golebiewski 497b7885da DOCS shift to rst - Model Creation in OpenVINO RUNTIME (#16278) 2023-03-14 09:42:44 +01:00
Sebastian Golebiewski a8be566e24 DOCS shift to rst - Configuring Devices (#16247) 2023-03-14 09:41:35 +01:00
hyunback kim 164db3def9 [GPU] Fix twin tranformer functional regression. (#16111)
* [GPU] Fix twin tranformer functional regression.

gemm/FC select_preferred_format select simple format depends on out rank size.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2023-03-14 17:34:41 +09:00
Sebastian Golebiewski 1268bfdca2 DOCS shift to rst - Shape Inference and Preprocessing (#16213) 2023-03-14 09:31:44 +01:00
Taylor Yeonbok Lee 3a96e06d4c Minor fixes (#16275)
- Fix are_data_types_suitable_for_onednn not to invalidate output layout
- Fix seg fault of printing resample node info
2023-03-14 08:09:54 +00:00
Fang Xu ae37ca671c [CPU] Fix core dump issue for ENABLE_DEBUG_CAPS (#16229) 2023-03-14 10:32:57 +04:00
Roman Kazantsev dcc8a36d88 [TF FE] Test Switch and Merge support by TF FE (#16255) 2023-03-14 00:50:47 +04:00
Roman Kazantsev 3b71286f1d [TF FE] Test low-level While support by TF FE (#16257) 2023-03-14 00:50:22 +04:00
Taylor Yeonbok Lee f0f1c47063 Fix concat to use ngraph shape infer (#16226)
Fix crop to return shape of original rank
2023-03-13 20:25:23 +00:00
Anastasiia Pnevskaia 9462b3ea16 Fixed clearing of pipeline config params and TF session in convert_model() (#16191)
* Fixed pipeline config params clearing.

* Added clearing of TF session. Added tests.
2023-03-13 20:03:02 +04:00
Georgy Krivoruchko ca6ad433e4 Updated reading file (#16203) 2023-03-13 19:49:57 +04:00
Zlobin Vladimir fbc9516662 Update Open_model_zoo submodule (#16218) 2023-03-13 15:28:07 +00:00
Tomasz Adamowicz 5311ab0938 [GNA] Refactor memory alignment macro usage (#15749)
* Add possibility to use memory alignment different than 64B

* update tests for new memory api

* Remove ineffective code

* [FIX] Fix memory alignment issues for graph compiler primitives

* Update after review
2023-03-13 15:22:58 +00:00
Tingqian Li 625890c666 [CPU] Flush denormals to zero only when DAZ is off (#12315) 2023-03-13 16:04:12 +01:00
Ilya Lavrenov f080a0d9cf Added NCC style for frontends sources (#16200)
* Ability to provide several source dirs for ncc-style checks

* Fixed include headers; added NCC to TF common

* Fixed NCC for frontends

* Fixed NCC for frontends

* Extra fixes

* Fixest push --f

* Clang-format

* Apply comments

* Add an option to specify required clang-format version

* Update src/frontends/tensorflow/src/decoder_proto.cpp

* Update src/frontends/tensorflow/src/decoder_proto.cpp
2023-03-13 14:54:00 +00:00
Sebastian Golebiewski a84f87e9dc DOCS shift to rst - Preprocessing article (#16250) 2023-03-13 14:50:44 +01:00
Sebastian Golebiewski bf8c7fe668 DOCS shift to rst - Preprocessing API - details article (#16241) 2023-03-13 14:50:16 +01:00
Pawel Raasz 72566cde0d Review pooling classes for shape inference aspects (#16114)
* Review adaptive avg pool shape inference

* Review adaptive max pool shape inference

* Review AvgPool and MaxPool

* Minor improvement for StaticShape

* Update ShapeInferBaseWithPadding's infer
to be compatible with interface after rebase

* Fix build issues

* Set default pads before checks

* Fix include openvino headers
2023-03-13 12:48:44 +00:00
Ilya Churaev 63338b6e08 Introduce openvino ExecutionNode (#16242) 2023-03-13 15:45:08 +04:00
Sebastian Golebiewski e19ba8b3e2 DOCS shift to rst - Layout API Overview article (#16244)
* shift-to-rst
2023-03-13 12:13:49 +01:00
Roman KazantsevandPawel Raasz 0ffa4eb507 [Core] Allow ScatterND inputs type to be dynamic (#16236)
* Allow ScatterND inputs type to be dynamic

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update src/core/src/op/util/scatter_nd_base.cpp

Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>

* Update src/core/src/op/util/scatter_nd_base.cpp

Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>

* Update src/core/src/op/util/scatter_nd_base.cpp

* Apply code-style

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
2023-03-13 10:36:00 +00:00
Irina Efode df6cd3303a [CONFOMANCE] Add handling crashes (#16214)
* [CONFOMANCE] Add handling crashes

* Fix win paths
2023-03-13 14:23:26 +04:00
Ivan Tikhonov 8da01d4c2d TransposeSinking transformation: support new ops and fix performance issues (#15660)
* Resolve the performance issues in TransposeSinking transformation

* codestyle

* fix warning as error, fix tests failures

* fix ts for Concat and Reduce

* Fix TransposeReduceBackward

* fix the issue in TransposeFuse transformation

* fix TransposeReduce transformations

* Fix TransposeReduction, fix TransposeSinkingSplit, add unsqueeze support

* delete debug print

* Add additional validations

* fix node validation

* Fix validate for split, revert changes for concat, add BatchToSpace/SpaceToBatch

* Add SpaceToBatch/BatchToSpace

* fix TS for Interpolate + codestyle

* fix gna build

* Support TS for Interpolate, VariadicSplit, IsInf, IsNan, IsFinite + refactoring

* add the missed line

* add include

* TransposeSinking tests refactoring: part1

* TransposeSinking tests refactoring: part2

* Add limited support for StridedSlice op

* codestye

* TransposeReduction: skip the case when 2nd input for Squeeze is not provided

* Transpose sinking tests refactoring: part 3. + Revert changes in MOC.

* fix build

* codestyle

* Add tests for TS backward transformations, update TransposeSinkingFuse transformation, delete StridedSlice transformation prototype + tests refactoring

* fix unary tests

* Fix warning as error on Windows

* Add new tests for Unsqueeze/Squeeze; refactoring; remove debug code

* codestyle
2023-03-13 14:18:02 +04:00
Piotr KrzemińskiandZlobin Vladimir 2eef025773 [PYTHON] Introduce Json Statistics Report aligned with C++ version (#15692)
* [PYTHON] Introduce Json Statistics Report aligned with C++ version

* [PYTHON] Update README with new json_stats flag

* [PYTHON] Fix missing StatisticsReportConfig compilation error

* [PYTHON] Fix README formatting

* [PYTHON] Fix indent, fix pcsort error thrown for timedelta/int type mismatch, fix some compilation errors

* [PYTHON] Apply Pythonization ideas & fix JSON report showing incorrect category results

* Update tools/benchmark_tool/openvino/tools/benchmark/utils/statistics_report.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [PYHON] Align multiple-iterations behavior for reports

---------

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
2023-03-13 13:58:40 +04:00
Sebastian Golebiewski 1e757de195 [DOCS] shift to rst - OpenVINO Inference Request 2023-03-13 10:04:54 +01:00
Ilya Churaev 087c3bd0af Fixed typo in core tests (#16235) 2023-03-13 07:15:54 +00:00
Paul Youngsoo Ahn e8b108ac6b [GPU] Change lws to avoid synchronization issue in nonzero_count (#16116)
* [GPU] Change lws to avoid synchronization issue in nonzero_count (#16116)

* [GPU] Add unit test (#16116)

* [GPU] update count_nonzero_ref kernel(#16116)
- Support the case total data size exceed max work group size
- Add dynamic shape test case

* [GPU] Change input indexing calculation and add random input generator in unit test (#16116)

* [GPU] update random generation input funciton in nonzero_count (#16116)

* [GPU] update unit test (#16116)

* [GPU] cldnn unit test: update random generation function for other test failure (fusings_gpu/conv_fp32_multi_eltwise_quantization.basic/0) (#16116)
2023-03-12 23:32:20 -07:00
Zlobin Vladimir 0e91b07422 Prohibit FP16 FP32 values for cpp benchmark_app (#16217)
Ticket 100990

Python benchmark_app already prohibits FP16 and FP32.
2023-03-13 09:27:52 +04:00