Commit Graph

12673 Commits

Author SHA1 Message Date
Ilya Lavrenov
85145cd60c
Refactored Linix GHA pipeline (#20021)
* Refactored Linix GHA pipeline

* Move ONNX tests to Unit

* Install tests together with openvino

* Added checks for GNA usage in docs python snippets

* Install openssl for working pip

* Disabled onnx_dyn_shapes_expand_1_dyn_shape ONNX test

* exclude dyn shapes from onnx

* Migrated samples tests

* Fixed ONNX tests

* caches for PT tests dependencies

* Build Contrib separately from main OpenVINO

* More fixes

* Added python install for samples stage

* Installed manifests for ONNX FE tests

* Try to avoid libgl1 dependency in tests

* Clean-up

* Fixed issue with manifests in ONNX tests
2023-09-25 17:00:30 +04:00
Andrey Kashchikhin
6d3f94762e
fix (#20037) 2023-09-25 16:44:14 +04:00
Mahimai Raja J
39f6cbf259
Refactored with single dispatch generic function implementation (#19958)
* Refactored with single dispatch generic function implementation

* Resolved mypy linting warnings

* Update src/bindings/python/src/openvino/preprocess/torchvision/torchvision_preprocessing.py

* Update src/bindings/python/src/openvino/preprocess/torchvision/torchvision_preprocessing.py

---------

Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com>
2023-09-25 16:32:22 +04:00
Sofya Balandina
0dd54c8a0e
[apiConformance] Change test for ov::hint::inference_precision RW property (#19977) 2023-09-25 16:27:23 +04:00
Pawel Raasz
7d1b7b6bec
[core] Api 2.0/migrate operators without evaluate (#19988)
* Migrate ops evaluate

* Remove using ngraph and std from ops

* Use OPENVINO_ASSERT instead of NGRAPH_CHECK

* Move `shape_util.hpp` to `dev_api/openvino/core/`

* Remove visit_attributes, same as base impl

* Fix build issues

* Fix build issues
2023-09-25 14:22:59 +04:00
Piotr Krzemiński
a4e1f9dbf8
[Spec][Opset13] Multinomial specification (#19866)
* [Spec] Multinomial specification

* [Spec] Apply recommended style fixes to Multinomial_13.md

* [Spec] Add range mathematical formulation

* [Spec] Update Multinomial input types

* Update opset13.md

* Update opset.md

* Update docs/ops/generation/Multinomial_13.md

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Update Multinomial_13.md

* Update opset13.md

* Update docs/ops/generation/Multinomial_13.md

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Update Multinomial_13.md

* Update Multinomial_13.md

* Update Multinomial_13.md

* Update docs/ops/generation/Multinomial_13.md

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Update docs/ops/generation/Multinomial_13.md

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Update docs/ops/generation/Multinomial_13.md

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Update Multinomial_13.md

* [Spec] Replace 3107670 syntax with ..math

* Update Multinomial_13.md

* Update Multinomial_13.md

* Update docs/ops/opset13.md

Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>

* [Spec] Apply changes from Ref/Core PR

* Update Multinomial_13.md

---------

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>
2023-09-25 10:54:40 +02:00
Yuan Hu
ec45107723
[CPU] Fix memory leak in binconv (#19999) 2023-09-25 12:45:25 +04:00
jmacekx
9091afc26c
[DOCS] use etree to fix docs generated by doxygen (#20024) 2023-09-25 10:38:58 +02:00
Katarzyna Mitrus
37271c1e7c
[Opset13][CPP] Initialization of Opset13 (#20005)
* Opset13 init

* Update test pattern ops

* Update remaining files
2023-09-25 10:20:37 +02:00
Oleg Pipikin
f82c668d28
Refactor GatherLayerTest, GatherElementsLayerTest (#20020)
* Refactor GatherLayerTest

* Refactor GatherElementsLayerTest
2023-09-25 11:29:57 +04:00
Roman Lyamin
2e88aa0770
[GPU] Added int32 weights support for reorder_weights kernels (#20015) 2023-09-25 09:23:47 +04:00
Sun Xiaoxia
c983b464ba
enable cpu pinning on Windows by setting property affinity CORE (#19418)
* set enableCpuPinning=true by '-p YES'

* add test case of setting ov::Affinity::CORE

* add affinity=NUMA/HYBRID_AWARW

* fix build failure
2023-09-25 12:51:09 +08:00
Andrey Babushkin
3e82849f3c
[workflows/linux] Switch to self-hosted runners in Azure Kubernetes Service (#19183)
* [workflows/liux] Trying AKS runners

* Remove sudo usages

* Fix repositories path

* Well, adding debug output

* execution bit?

* more debug output

* using bash...

* We should use shell syntax for env variables in 'run' sections

* again, may be we should use bash...

* fix cloning path for openvino repo

* more debug output

* Trying to populate WORKSPACE var in other way

* Trying different WORKSPACE

* export ALL variables for samples tests

* Trying to put openvino build into correct directory

* Replace more occurences of BUILD_DIR...

* Use shell expansion instead of Actions syntax in run steps

* Skip unit test failures

* Oops, there's no pytest for MO unit tests

* Oops, typo

* Fix LAYER_TESTS_INSTALL_DIR variable expansion

* Fix LAYER_TESTS_INSTALL_DIR for new stages

* Replace all the varibles

* Comment out CCACHE_DIR

I want to test worst-case scenario

* Comment setup ccache step

* Revert "Comment out CCACHE_DIR"

This reverts commit 046663a9f1.

* Just checking something

* Update with new stages from master

* One more stage to fix

* Fix INSTALL_DIR again (new stages were merged to master?)

* Remove concurrency limit (for test purposes)

* Trigger one more pipeline

* Disable concurrency settings

* Trigger another build

* Disable ccache (for testing purposes)

* trigger another build to measure duration without ccache

* And one more test commit

* Return back ccache

* Testing new image

* Enable concurrency back

* Using new image

* And another image

* Trying build on the clean image

* Install git

Upstream ubuntu image doesn't have git

* Oops, forgot apt-get update

* Upstream Ubuntu image, but using ACR cache

* Remove debug output

* Use Ubuntu image from ACR cache for the rest of the stages

* Display version of ccache

* Swith to ubuntu 20 temporarily (I hope)

* Set CCACHE_TEMP_DIR outside of shared space

* Revert "Swith to ubuntu 20 temporarily (I hope)"

This reverts commit 2e53109d83.

* trying ccche nohardlink option

* Trying to disable ccache file cloning

* fix CCACHE_TEMPDIR

* Install git to Python unit tests stage

* Install libsnappy-dev as tests require it

* Install python to test stage

* Fix env vars syntax in few places

* Update docker image name

* Increase timeout for CPU tests

* Debug output - trying to find out what's wrong with test reports

* Change file name in debug-output 'find' command

* let's try shell syntax for upload artifact action...

It most likely won't work but I see strange output in the logs:
Error: No files were found with the provided path: /__w/openvino/openvino/install/tests/TEST*.xml
/runner/_work/openvino/openvino/install/tests/logs/failed/*.log
/runner/_work/openvino/openvino/install/tests/logs/crashed/*.log
/runner/_work/openvino/openvino/install/tests/logs/hanged/*.log
/runner/_work/openvino/openvino/install/tests/logs/interapted/*.log
/runner/_work/openvino/openvino/install/tests/logs/disabled_tests.log. No
artifacts will be uploaded.

So the first path is translated to the path inside the container
correctly and the rest are not O_o

* Revert "let's try shell syntax for upload artifact action..."

This reverts commit eb19b4f319.

* Leave just disabled_tests.log (as it is the only one present)

* Use my own directory instead of github.workspace

Inside-container path translation doesn't work for upload-artifact
actions (it works only for the first path, but not for the rest)

* Revert "Leave just disabled_tests.log (as it is the only one present)"

This reverts commit 4321827880.

* Okay, let's try hardcoded workspace path...

* Okay, path should be inside "official" workspace. Hardcode it

* Missed some variables, replace github.workspace to hard-coded value

* Remove debug output 'find' command

* Remove old-style cache setup

* Clean ccache stats after cmake

* Change docker image to the one with non-root user

* Oops, switch to Ubuntu 20

* Playing with concurrency group name

* Oops, forgot sudo for ninja installation

* Revert "Oops, forgot sudo for ninja installation"

This reverts commit a7e1730279.

* Revert "Oops, switch to Ubuntu 20"

This reverts commit 19fe75f4af.

* Revert "Change docker image to the one with non-root user"

This reverts commit 553116492d.

* Use Ubuntu 20 DockerHub image

* Trying to force apt-get packages not to wait for user input

* Make DEBIAN_FRONTED for all stages

* Update reason of skipped MO unit test

* Add DEBIAN_FRONTED to all jobs

* Fix environment variables expansion in newly-added stages

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Fix review comments

* More review comment fixes

* Remove DEBIAN_FRONTEND from Python Models job

* "Get tools versions" step is absent on master

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-23 13:02:28 +04:00
Sun Xiaoxia
678e919b13
CPU pinning on Windows (#19405)
* add cpu pinning on windows

* remove pinning limitation on windows

* only support the machine with one numa node

* fix code style

* fix build error on macos

* set mask initial value

* fix test failure on window

* fix build failure on macos, add limitation on windows machine with two sockets

* fix test failure on windows

* fix test failure

* fix comments
2023-09-23 11:28:15 +08:00
Maxim Vafin
f735999e7b
Improve testing for hf models (#20017) 2023-09-22 20:10:33 +00:00
Pawel Raasz
93f2a1947c
Reduce binary size of CumSum implementation (#20004) 2023-09-22 20:41:32 +02:00
Pawel Raasz
efb8484124
[core] Api 2.0/migrate swish op to new API (#19934)
* Migrate Swish operator to new API

* Remove `visit_attributes` as is same in base class
2023-09-22 16:38:24 +04:00
Oleg Pipikin
ce378739f0
Refactor DetectionOutputLayerTest, DFTLayerTest, EltwiseLayerTest (#19922)
* Refactor DetectionOutputLayerTest

* Refactor DFTLayerTest

* Refactor EltwiseLayerTest

* Fix

* Fix

* Disable tests
2023-09-22 16:35:20 +04:00
Vladimir Paramuzov
5611f7d65c
[GPU] Fix constants reuse (#20003) 2023-09-22 15:29:38 +04:00
Mateusz Mikolajczyk
7a2ac27f09
[Spec][Opset13] BitwiseAnd-13, BitwiseNot-13, BitwiseOr-13, BitwiseXor-13 specifications (#19798)
* [Spec] BitwiseNot-13 specification

* Improvements

* add other specifications

* Doc improvements

* Fix typos

* add opset13

* Fix typo

* add opset13

* Fix

* Improve example?

* Fix step formatting

* Apply suggestions from code review

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Add suggested changes

* Fix missing the

---------

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
2023-09-22 13:14:46 +02:00
Maciej Smyk
fb41324141
Update weight_compression.md (#20000) 2023-09-22 13:06:27 +02:00
Ekaterina Aidova
c76475288b
[PT FE]: support aten::scatter_reduce and extend aten::scatter (#19980)
* [PT FE]: support aten::scatter_reduce and extend aten::scatter out arg support

* create mapping inside function
2023-09-22 15:05:33 +04:00
Pavel Esir
9271b79540
[OVC] do not parse inputs for py_api (#19742)
* [OVC] do not parse inputs

* fix unit-tests

* remove redundant lines, add test case

* add one more unit-test

* skip None values

* replace str with List in test_mo_import_from_memory

* corrected type hints, added a safety assert
2023-09-22 15:05:21 +04:00
Oleg Pipikin
c1271d1217
Refactor EmbeddingBagOffsetsSumLayerTest, EmbeddingBagPackedSumLayerTest, EmbeddingSegmentsSumLayerTest (#19952)
* Refactor EmbeddingBagOffsetsSumLayerTest

* Refactor EmbeddingBagPackedSumLayerTest

* Refactor EmbeddingSegmentsSumLayerTest
2023-09-22 10:12:28 +00:00
Ekaterina Aidova
26d18c924b
[PT FE]: support aten::broadcast_tensors (#19994)
* broadcast tensors

* [PT FE]: support aten::broadcast_tensors

* apply review comments

* remove add
2023-09-22 13:54:44 +04:00
Maxim Vafin
2151e5f979
[PT FE] Add tests for timm models (#19997)
* Add tests for timm models

* Apply suggestions from code review

* Some improvements

* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-22 10:34:07 +02:00
Pawel Raasz
e7c1344d3c
[core] Api 2.0/migrate Add operator to new API (#19984)
* Migrate Add operator to new API

* Remove `visit_attributes` as it calls base impl

* Use shape inference to calculate broadcast shape
2023-09-22 11:57:02 +04:00
Pawel Raasz
aa293c09ac
[core]Api 2.0/migrate ceiling op to new API (#19909)
* Migrate Ceiling op to new API

* Remove f16 precision from evaluate

* Correct ceiling reference doxy comments
- correct functor arg to be const
2023-09-22 10:53:41 +04:00
Ekaterina Aidova
8d59fcd34f
[PT FE]: extend logical operations support (#19981)
* [PT FE]: extend logical operations support

* tests

* more tests
2023-09-22 10:11:36 +04:00
Egor Duplenskii
3f3d89678e
[CPU][ARM] Reorder FullyConnected weights in scope of compile_model (#19634) 2023-09-22 09:33:33 +04:00
Egor Duplenskii
6de8579b1d
[CPU][ARM] Choose eltwise layout based on model type (#19234)
Eltwise order of the supported primitive descriptors affects the
performance of the model.
Often only one of the port descriptors matches with the layout
of the parent descriptors, i.e. when two parent ports have mixed
layout "nchw nhwc".
So either nchw or nhwc layout will be used for the eltwise node
and reorder will be used for either of the ports.
The shape of the ports also can be different (when one of the inputs is
broadcasted). So reorders on different ports have different
performance impact.
The layout of the eltwise node child has an effect on the performance
as well, since it may or may not require reorder on input.
2023-09-22 09:33:16 +04:00
Egor Duplenskii
aec4c6c843
[CPU][ARM][FP16] Use Transpose executor for layout Reorder (#19227) 2023-09-22 09:32:12 +04:00
Ekaterina Aidova
fde054e4a6
[PT FE]: support aten::minimum aten::maximum (#19996) 2023-09-22 09:30:57 +04:00
Taylor Yeonbok Lee
f1b8abe55a
[GPU] Optimization for gemm & fc in iGPU. (#19780)
* Optimization for gemm & fc in iGPU.
FC: fake alignment for 16 is better in iGPU.
Gemm: permute + gemm_tiled_opt is better than transposed_input + gemm_ref kernel for unaligned shapes to 16. Note that this is an temporal optimization and will be removed once the final solution (i.e., support unaligned transposed input shape in gemm_tiled_opt kernel) is availalbe.

* Fix unittest

* Fix for model_cache

* Fix unittest
2023-09-21 22:07:53 -07:00
Pavel Esir
efe54362fd
fix f16/f32 el type mismatch for shape subgraphs: Parameter type should not be fused for precision sensitive nodes (#19959)
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-09-22 02:06:39 +04:00
Georgy Krivoruchko
10c3b60aac
Updated model_creation_sample.py (#19989)
Removed usage of ngraph in the sample
2023-09-22 02:05:24 +04:00
Maxim Vafin
058b45e608
[PT FE] Fix aten::repeat regression (#19991)
* Revert "[PT FE] Simplify repeat operation (#19926)"

This reverts commit f926e0e392.

* Fix aten::repeats regression

* Simplify

* Update src/frontends/pytorch/src/op_table.cpp

* Add impacted model
2023-09-21 23:58:09 +02:00
Oleg Pipikin
b1bf16c7cf
Refactor ConversionLayerTest, ConcatLayerTest, ConstantLayerTest, ConvertColorI420LayerTest, ConvertColorNV12LayerTest (#19777)
* Refactor ConversionLayerTest

* Refactor ConcatLayerTest

* Refactor ConstantLayerTest

* Refactor ConvertColorI420LayerTest

* Refactor ConvertColorNV12LayerTest
2023-09-21 22:56:14 +02:00
Zlobin Vladimir
e068cfc5a3
benchmark: drop python3.7 (#19972)
Ticket 118797
2023-09-21 22:03:09 +04:00
Vladislav Golubev
0e0e1b0ee6
SmartReshape: ReshapeMatMul transformations are fixed (#19987)
* SmartReshape: ReshapeMatMul transformations are fixed

* clang-format fixes
2023-09-21 19:49:07 +02:00
Maxim Vafin
d0ef28e541
Reverse infer deduce second Squeeze input (#19923)
* Reverse infer deduce second Squeeze input

* Fix build

* Fix tf tests

* Small optimization

* Fix type

* Fix tests
2023-09-21 17:37:33 +02:00
Maxim Vafin
02f5b7a7e3
[PT FE] Add huggingface hub tests (#19858)
* [PT FE] Add huggingface hub tests

* Update requirements.txt

* natten can't be installed

* Remove librosa

* Add xfail and skip marks

* Remove t5

* Free up space

* Apply suggestions from code review

* Report free space

* Clean pip cache

* Temporarily disable det2 models

* More du info

* Remove tmp info

* More du stats

* Fix du report

* Optimize du

* Ignore error

* Finalize changes

* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-21 17:30:17 +02:00
Vitaliy Urusovskij
b00fbd04c5
Fix StressMemLeaksTests with several models (#19986)
* Fix `StressMemLeaksTests` with several models

* Fix OMZ branch name in `get_testdata.py`
2023-09-21 15:59:18 +02:00
Maxim Vafin
37d54bcb42
[PT FE] Support prim::TupleIndex operation (#19978)
* [PT FE] Support prim::TupleIndex

* Update src/frontends/pytorch/src/op/tuple_index.cpp

* Update src/frontends/pytorch/src/op/tuple_index.cpp
2023-09-21 15:57:42 +02:00
Maciej Smyk
f790a3b4f2
[DOCS] Python 3.7 support removal from docs for master (#19670)
* Python update

* update

* fix

* m suffix removal
2023-09-21 15:54:10 +02:00
Vitaliy Urusovskij
318106d17d
StridedSliceLayerTest and SqueezeUnsqueezeLayerTest to API2.0 (#19955)
* `StridedSliceLayerTest` to API2.0

* `SqueezeUnsqueezeLayerTest` to API2.0

* Fix CppLint
2023-09-21 15:08:51 +02:00
Tomasz Jankowski
c4adf80ec6
[Core] Move SlicePlan to Dev API (#19971)
* Move SlicePlan to Dev API

* Recover legacy API

---------

Co-authored-by: Evgenya Nugmanova <evgeniia.nugmanova@intel.com>
2023-09-21 14:41:01 +02:00
Vitaliy Urusovskij
e5acf880ad
Slice8, ShuffleChannels, ShapeOf layer tests to API2.0 (#19975)
* `Slice8LayerTest` to API2.0

* `ShuffleChannelsLayerTest` to API2.0

* `ShapeOfLayerTest` to API2.0
2023-09-21 14:36:26 +02:00
Vitaliy Urusovskij
fc9dedfd6a
Split, SpaceToDepth, SpaceToBatch layer tests to API2.0 (#19973)
* `SplitLayerTest` to API2.0

* `SpaceToDepthLayerTest` to API2.0

* `SpaceToBatchLayerTest` to API2.0
2023-09-21 12:29:30 +00:00
Ilya Churaev
e277d48535
Move unsqueeze evaluate to new API (#19948)
* Move unsqueeze evaluate to new API

* Add new header

* Fixed comments

* Fixed build

* Revert redundant changes

* Fixed comments
2023-09-21 16:07:10 +04:00