Commit Graph

314 Commits

Author SHA1 Message Date
Mikhail Ryzhov
59e9f50ec6 [GHA] Windows pytest optimizations (#21650)
* parallel runs

* enabled pip cache

* pip cache fix
2023-12-14 16:14:51 +00:00
Evgeny Kotov
f094ef81f0 remove tests (#21654) 2023-12-14 16:54:37 +04:00
Mikhail Ryzhov
de81bbbbc2 enabled triggers for release branches (#21651) 2023-12-14 16:50:04 +04:00
Alina Kladieva
926a0591ff Add overall status check to more workflows (#21644) 2023-12-14 01:43:42 +04:00
dependabot[bot]
47939684df Bump actions/setup-python from 4 to 5 (#21515)
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4 to 5.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-13 13:42:52 +04:00
Maxim Vafin
34b2b66b69 [PT FE] Report unsupported operations with model list (#21607)
* [PT FE] Report unsupported operations with model list

* Continue on error

* Disable more models

* Check if file exists

* continue of error

* Fix on failure

* Fix file path

* Apply suggestions from code review
2023-12-12 21:25:27 +00:00
Andrey Babushkin
5a4f632680 [workflows] New path for volumes (#21604) 2023-12-13 00:56:24 +04:00
Andrey Kashchikhin
9ab0a6d2f1 change trigger (#21609) 2023-12-13 00:46:16 +04:00
Andrey Kashchikhin
79ca3d2fb9 [CI] [GHA] Introduce Coverity pipeline (#21599)
* add coverity pipeline

* report less progress

* add curl installation

* change trigger to post-commit
2023-12-12 16:55:58 +04:00
Ilya Lavrenov
8e69f2c278 Add CPU tests as required for Linux arm64 (#21562) 2023-12-11 13:16:15 +04:00
Alina Kladieva
06a27e7b31 [GHA] Add Smart CI to Windows pipeline (#21558)
* [GHA] Add Smart CI to Windows pipeline

* Remove Smart CI from Python API units due to 127101

* Rename overall GHA status check for Windows
2023-12-09 01:50:14 +04:00
Andrey Babushkin
a84d615abd Switch Windows Conditional Compilation workflow to AKS runners (#21375)
* Switch Windows Conditional Compilation workflow to AKS runners

* Fix YAML syntax

* Limit number of threads for CC build

* Split build stages to two to avoid step being successful when it's not

* Install python to conditional compilation job

* Combine both build commands into a single step

* Trying to work around sccache port issue

Sometimes build hangs and then ends by timeout. The only error message
in the logs is "sccache: error: An attempt was made to access a socket in a way forbidden by its access permissions. (os error 10013)"

* Temporary disable ctest step

* Revert "Temporary disable ctest step"

This reverts commit 8714200994.

* Disable Windows conditional compilation for PRs
2023-12-08 14:45:36 +00:00
Ilya Lavrenov
fbec7be5e0 Try to run arm64 without system tbb (#21524)
* Try to run arm64 without system tbb

* Moved files

* Moved cmake files for auto batch
2023-12-08 13:59:48 +04:00
Ilya Lavrenov
3481568a39 Fixed Linux CC (#21540) 2023-12-08 13:51:06 +04:00
dependabot[bot]
df2ff92d21 Bump actions/stale from 8 to 9 (#21535)
Bumps [actions/stale](https://github.com/actions/stale) from 8 to 9.
- [Release notes](https://github.com/actions/stale/releases)
- [Changelog](https://github.com/actions/stale/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/stale/compare/v8...v9)

---
updated-dependencies:
- dependency-name: actions/stale
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-08 12:58:56 +04:00
Andrey Kashchikhin
dfc91186a1 [CI] [GHA] Extract test jobs into reusable workflows (#21395)
* extract cpu func tests into a reusable workflow

* add needs

* check paths

* correct paths

* rm usage of setupvars

* extract samples

* use yaml string

* split mac workflow

* check variables

* try github workspace

* check full dir

* set variables

* try with sub directory

* Revert "try with sub directory"

This reverts commit d891ee3f28.

* extract c++ tests from linux

* change

* use cxx workflow in mac workflows

* add noninteractive

* extract cpu func tests

* rm unused

* enable mac

* fix reusable workflow name

* correct path for sparse-checkout

* extract python UT

* remove unnecessary asterisk

* remove another unnecessary asterisk

* use reusable action for linux cc

* add check for setupvars existence

* check with manually installed opencl

* add components input to samples workflow; rm pr triggers for mac workflows

* add missing needs

* add missing option for deps install  script

* use disables in test themselves instead of ifs in workflows

* use reusable workflow for cxx tests in linux arm

* use python reusable workflow in linux arm

* add missing endif

* use self-hosted for samples, add x86_64 constraint for jax

* check paths

* find gompby partial name

* skip failing tests on arm; correct gomp finding for ovc

* check tests

* add debian packages job; use job_ prefix for reusable workflows with jobs

* extract tf hub model tests

* extract tf model hub perf tests

* extract pytorch models tests

* do not use container on GHA runners

* extract onnx runtime

* add missing deps

* skip test for linux arm

* rm always()s

* fix quotes

* correct paths

* correct ifs, check dir for onnxruntime

* correct path for onnxruntime utils folder; install python3

* use self-hosted as input

* check for self-hosted runner via name, pass version

* skip cpu plugin unittest

* check cxx tests

* rm pr trigger
2023-12-07 23:44:45 +04:00
Mikhail Ryzhov
aa2dcb1f46 [GHA] Test command length excess (#21502)
* debug

* enabled pre-commit

* Disabled shell on Win

* remove shell length

* remove debug print
2023-12-07 18:01:19 +04:00
Sonder
6d3fbf4237 【Hackathon 5th No.113】Support paddle 2.5.1 (#20161)
* Fixed comments for linux-riscv64 GHA workflow

* Try to enable PDPD tests back

* support paddle 2.5

* fix op test errors

* fix op test errors

* recover openvino/src/core/src/op/swish.cpp

* recover thirdparty open_model_zoo

* update cmakelist

* disable some tests

* fix code style

* enable paddle ci tests

* disable some tests

* fix np.long error

* recover reverse op

* update ci config

* recover set_value test codes

* rm linux_debian.yml

* Compatible with cases where different paddle versions have different output shapes

* remove set_value tests

* recover save_model.py

* Added ctest labels for FE tests only if FW is found

* recover thirdparty

* Update CMakeLists.txt

Fixed creation of paddle_tests target two times

* update paddle v2.5.1 proto file

* recover thirdparty

* fix Paddle_Reader_Tests.LoadModelMemoryToCore error

* fix Paddle_Places test issue in v2.5.1

* support some tests for low version paddle

* fix paddle FrontEndCutModelTest issue

* fix

* support all other tests for low version paddle

* fix codestyle

* fix codestyle

* Update generate_multi_tensor_split.py

* fix build error

* add testUnloadLibBeforeDeletingDependentObject into paddle skip tests config

* remove PROTOBUF_LITE from paddle CmakeList.txt

* fix path error

* add debug info

* add debug codes

* use make_model_path

* recover

* add option optimize_for

* use FrontEndTestUtils in read_paddle_model_test.cpp

* use FrontEndTestUtils in read_paddle_model_test.cpp

* fix grid_sample error when using dynamic shape

* fix error tests for 2.4 version

* add paddle version judge for floor_div

* fix grid_sample and add tests

* fix

* fix

* recover

* recover grid_sampler

* Apply suggestions from code review

* fix

* Apply suggestions from code review

* Apply suggestions from code review

* fix build error

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: meiyang-intel <yang.mei@intel.com>
2023-12-06 13:59:50 +04:00
Andrey Kashchikhin
62f5bd6570 [CI] [GHA] Introduce the Linux ARM64 workflow (#20809)
* add arm as a matrix for build job

* uncomment

* comment

* try inside pipeline

* check location

* another dirs

* try to privide correct action path

* use corrected action

* use newer commit

* use newer commit

* use newer commit

* use newer action commit

* add setting

* rm from pipeline, adapt action iteslf

* add missing deps

* enable samples and debian jobs

* correct yml

* correct image name

* correct syntax, use self-hosted option

* enable onnx runtime and c++, use newer action

* enable Python and CPU Func tests

* add missing deps for arm64

* increase timeout for python tests

* disable some tests, add more time

* skip failing tests

* skip speech sample test on arm

* dummy chang

* skip mxnet mo on arm, run all tests

* rm quotes

* separate linux x86 and arm64 workflows

* rm unused matrix refs, add timeouts

* add skips for c++ tests and some Python tests

* correct cache keys, extend timeout

* skip more python tests

* add more skips: for python and CPU func

* extend cpu func list with skips

* disable cpu func tests and python api 2.0 tests

* rm disable job

* styling, rm pr trigger, rm always(), rm unnecessary changes

* revert

* use ifs instead of comments, provide better wording for skips
2023-12-05 12:14:02 +04:00
Mikhail Ryzhov
ba735c9149 [GHA] Updated 2-cores runner name (#21426)
* updated the name

* manual trigger
2023-12-01 16:46:20 +00:00
Mikhail Ryzhov
27adf58220 [GHA] Switched CPU functional test runner (#21346)
* switched runners to 32gb

* increased onnx timeout
2023-12-01 12:50:06 +04:00
Mikhail Ryzhov
1e959c7473 [GHA] Changed risc-v cache dir 2023-11-30 21:23:57 +01:00
Andrey Kashchikhin
6ab5ef72d5 [CI] [GHA] Skip failing tests in the Windows workflow (#21349)
* always run tests, enable pr trigger

* skip tests

* provide ticket numbers

* rm pr trigger; rm unused schedule trigger
2023-11-30 15:50:01 +04:00
jmacekx
54e61ac9f5 refactor docs build process (#21239) 2023-11-29 15:30:05 +04:00
Andrey Babushkin
a7de95a8a4 Rename AKS runners' labels for consistency (#21282) 2023-11-28 12:13:28 +00:00
Alina Kladieva
d722e42052 [GHA] Smart CI for more pipelines (#21307)
* Add Smart CI for more pipelines. Refactor logic for workflow skip

Since different workflows may have different requirements for skipping them, I suggest to move these requirements to parameters instead of hardcoding them

* Use patterns for skipping pipeline for conformance-only

* Remove path filters for Android

* Return mistakenly deleted param

* Propagate params to Python script

* Add missing outputs mapping

* Return push trigger

* Skip CC CPU func when CPU is not affected

* Fix variable name
2023-11-27 18:43:54 +04:00
Andrey Kashchikhin
ca4c276072 [CI] [GHA] Increase precommit timeouts for TF Hub jobs (#21308)
* increase timeouts

* add more
2023-11-27 18:41:11 +04:00
Evgeny Kotov
965313ba0b [TF Hub][Perf Tests]Implement performance tests in precommit to compare read_model and convert_model paths (#21023)
* begin

* fixes

* measure time and compare

* fix bug + update precommint models

* cleanup

* add wget to install requirements; add to linux.yml

* fixes + improvements

* output results to html

* remove unneeded code

* fix

* code review fixes

* store downloaded models in cache

* use 1000 runs

* use model paths from tf-hub tests

* use tf hub api to download instead of wget; measure some time stats

* small fixes

* remove unneeded files

* use own list of models

* remove uneeded if

* remove unstable models

* remove unstable models

* fix requirements

* code review fixes

* Update .github/workflows/linux.yml

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* fix round_num function

* remove unstable network

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* code review fixes

* build fix

* code review fixes

* code review fixes

* code review fixes

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* code review fixes: use autoflake

* remove unneeded tensorflow_text

* Update .github/workflows/linux.yml

* Update linux.yml

Added TensorFlow_Hub_Performance_Models_Tests to final status check

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-11-24 18:13:44 +04:00
Alina Kladieva
cf0c141e12 [GHA] Add GPU stub job to collect statistics (#21260) 2023-11-24 10:49:12 +04:00
Alina Kladieva
613e4f5fac [GHA] Rename overall status check (#21227) 2023-11-23 17:12:58 +01:00
Andrey Babushkin
57425b934f Switch Windows workflow to self-hosted runners in AKS (#20972)
* Switch Windows workflow to self-hosted runners in AKS

* Uncomment 'pull_request' event

* Fix YAML indentation

* Fix YAML indentation again

* trying to pre-create sccache dir

* Fix yaml syntax

* Add sccache blob storage prefix

* sccache directory creation seems unneeded

The issue was in the usage of bsdtar instead of GNU tar - the former
is in C:\Windows\System32, which is the first entry in the PATH

* Fix sccache --zero-stats command for Linux

* [windows] Replace ccache-action with sccache-action sccache install

We don't need to use GitHub Actions cache feature as we have sccache
and Azure Blob Storage

* Switch the rest of the stages to AKS runners

* Hardcode VS Build Tools version

* Revert "Hardcode VS Build Tools version"

This reverts commit ea9ae1fb33.

* Increase timeout for C++ Unit tests

* Increase timeout for particular step

* Further increase of timeout

* Switch Windows Conditional Compilation workflow to AKS runners

* Fix YAML syntax

* Revert "Increase timeout for C++ Unit tests"

This reverts commit e9a00c41ad.

* Revert "Fix YAML syntax"

This reverts commit ecc1b15552.

* Revert "Switch Windows Conditional Compilation workflow to AKS runners"

This reverts commit d5969d58cd.

* Disable PR trigger for Windows workflow

Let's run this in test mode on master branch only for a while
2023-11-22 16:43:14 +00:00
Irina Efode
4237de6bf1 [CONFORMANCE] Remove old-named conformance exec files (#21128)
* [CONFORMANCE] Remove old-named conformance exec files

* fix_GHA
2023-11-21 17:06:05 +04:00
Ilya Lavrenov
21a90f4e78 Smart CI: specializations for preprocessing and LPT (#21186)
* Smart CI: specializations for preprocessing and LPT

* Added PROXY component
2023-11-20 19:08:45 +04:00
Alina Kladieva
23462aea6b [GHA] Fix validation of dependent components in Smart CI config (#21187)
Use new syntax
2023-11-20 15:08:24 +01:00
Ilya Lavrenov
2ee8b29f64 Smart CI: CPU triggers tests for PT and TF FEs (#21183) 2023-11-20 15:35:40 +04:00
Alina Kladieva
7931938ea4 [GHA] Alternative way to handle required pipeline checks (#21164) 2023-11-20 11:14:58 +01:00
Alina Kladieva
f7f8636fe4 [GHA] Workaround for some non-repo components in Smart CI (#21134)
* Workaround for some non-repo components in Smart CI

* Add possibility to add all components as dependent

* Remove extra check

* Add test case for "all" key
2023-11-20 12:44:50 +04:00
Irina Efode
d1e1555f2f [CONFORMANCE] Cleaning up (#20835)
* 1. Add Op_conformance_utils lib.
2.rename targets.
3. Remove behavior folder from api conformance
4. Remove ov1.0 from opImplCheck
5. move tests and insts to one file
6. small refactoring for op conformance test names

* align namespaces, remove test_utils from subgraphs_dumper

* update target names

* Remove extra

* Fix the tests without shapes in meta

* fix failed test names

* Add attribute reader

* Fix buils

* Check the registered lib

* try

* add comparator

* Revert "try"

This reverts commit 27eaa4ea0f.

* try to fix win build

* types

* tr

* remove pragma once
2023-11-16 16:27:44 +04:00
yanlan song
f78d0950d6 resolve dependency (#21105)
Signed-off-by: fishbell <bell.song@intel.com>
2023-11-16 11:42:42 +04:00
Maxim Vafin
369831caef [PT FE] Use system model cache when running torch hub tests locally (#21047)
* Use system model cache when running torch hub tests locally

* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py

* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py
2023-11-14 11:43:06 +01:00
Alina Kladieva
f0c0bf89e2 Smart CI for docs (#21021)
* Handle Smart CI for docs

* Remove path filters

* Fix quotes

* Fix logic

* Revert unneeded change

* Add md_files_only to components configuration

* Get rid of custom output

* Try to fix condition

* Add manual handling of some docs changes

* Remove helper label
2023-11-14 00:00:51 +04:00
Alina Kladieva
e8d28f7f6d Make conformance wait for Smart CI step (#21014) 2023-11-10 12:10:36 +01:00
Irina Efode
ebf1874eee [GHA] Check OpImplCheck conformance for template plugin (to make sure that all functions are checked by conformance) (#20712)
* [CONFROMANCE] Fix Template OpImplCheck on Win

* Update windows.yml

* check win

* Update windows.yml

* remove extra changes
2023-11-10 12:39:58 +04:00
Ilya Lavrenov
d4dd169ca3 Added more smart CI conditions (#20999) 2023-11-09 23:40:26 +04:00
Alina Kladieva
51a17ba642 Workaround failing MO unit when Python API unit are skipped (#20997) 2023-11-09 18:07:57 +01:00
Alina Kladieva
fa22836cfb Fix no match files change case (#20981) 2023-11-09 12:07:47 +01:00
Ilya Lavrenov
c851d643b3 Fixed smart CI (#20980) 2023-11-09 11:28:32 +01:00
Alina Kladieva
000966660c Smart CI POC (#19825)
* Try using a custom action directly from repo

* Run smart CI under ubuntu-latest

* Set output + add a sample step

* Update linux.yml

* Add components.yml

* Add some conditions

* Just to check if reference to "needs" work in job context

* Update linux.yml

* More example cases

* Dummy change to CPU

* Fix typo

* Fix SAMPLES_AFFECTED variable

* Use more correct dependents key

* Fighting with messy GHA conditions

* No brackets and no double quotes in conditions

* Revert "Dummy change to CPU"

This reverts commit 4eae09e5b5.

* Use refactored action

* Move action implementation to openvino repo

* Extend components.yml config

* Update labeler.yml

* Dummy change to TF FE

* Fix indentation

* Add missing needs

* Add missing records

* Allow missing records for components in validation

* install_openvino_dependencies as a separate step for Python_Unit_Tests

* Improve config validation

* Revert "Dummy change to TF FE"

This reverts commit 01190864d1.

* Dummy change to model hub tests

* Update CPU component config

* Dummy change to Python API

* Dummy change to Python API

* Revert "Dummy change to Python API"

This reverts commit 3fce0bb3fb.

* Dummy change to Python API

* Simplify conditions. Cover "no components changed" case

* Update components.yml

* Update .gitignore

* Revert "Dummy change to Python API"

This reverts commit e57ea9852c.

* Fix dependencies scopes

* Add simple unit tests for smart ci functionality

* Revert "Dummy change to model hub tests"

This reverts commit c3d6837e22.

* Use ghapi module with permissive license

* Cover install_build_dependencies.sh script by labeler

* More labels

* Use ghapi. Apply review comments

* Enable dot files to be matched by labeler

* Warning instead of error in artifacts upload where smart ci is enabled

* Fix master merge

* Fix condition for TF FE common tests

* Fix condition for Pytorch FE tests

* Remove condition for pytorch model tests

* Allow any label as a component

* Refactor tests log handling

* Allow any defined label as a component

* Rearrange config structure. Fill the config with actual data

* Run full scope on changes to non-matching files

* Add missing conditions

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-11-09 11:38:58 +04:00
Alina Kladieva
f627172e5a Add separate label for docs snippets (#20966) 2023-11-08 22:19:35 +04:00
Andrey Kashchikhin
24cd7283e3 make cache space showing optional (#20962) 2023-11-08 17:28:08 +00:00