Commit Graph
325 Commits
Author SHA1 Message Date
Georgy Krivoruchko 58a3debaa7 Try to fix download issue (#21710) 2023-12-17 12:31:01 +04:00
Andrey Kashchikhin 24b414c168 [CI] [GHA] Introduce ONNX Models Tests job in Linux workflow (#21581)
* add onnx models test job

* rm sudo

* add missing update

* add missing git-lfs

* add missing package

* correct var

* correct command

* try with pytest

* provide path to models

* use mounted path

* add msft models

* use symlinks

* correct name for model

* use -h

* create and use directory for models

* use share as source for models

* fix test names, use fresh onnx repo

* return names

* fix test names

* change folder structure for onnx model downloading

* skip tests; clean up logs; adapt azure counterpart

* make skip names lowercase

* increase parallel

* add missing git-lfs

* fix dir

* install git-lfs properly

* use sudo

* use 12 parallels; rm -f

* use skip

* rm unnecessary requirements

* rm pytorch from installing

* disable test
2023-12-16 12:37:37 +04:00
Alina Kladieva 9e3b1fa7d6 [GHA] Add openvino ref input to workflow_dispatch for coverity (#21704)
Needed to be able to run coverity on a specific commit from nightly, like we did in Azure (workflow_dispatch doesn't support running workflow from sha by default).
2023-12-16 12:31:34 +04:00
Ilya LavrenovandAlina Kladieva 7a311635bd Enabled smart CI for Win CC (#21690)
* Enabled smart CI for Win CC

* Remove paths-ignore filters

---------

Co-authored-by: Alina Kladieva <alina.kladieva@intel.com>
2023-12-15 20:49:02 +04:00
Ilya Lavrenov ccc79fb691 Updated versions for upload / download artifacts actions (#21691) 2023-12-15 20:43:22 +04:00
Ilya Lavrenov 7a09894bdc Added smart CI condition for PDPD tests (#21692) 2023-12-15 15:15:34 +04:00
Ilya Lavrenov 3691f684b6 Enable Windows CC in precommit (#21680) 2023-12-15 14:09:11 +04:00
Andrey Kashchikhin 2c27d42223 rm not-existing (#21688) 2023-12-15 14:01:52 +04:00
Alina Kladieva c01f50e3ff [GHA] Set SSL_CERT_FILE for model downloading (#21668)
* [GHA] Set SSL_CERT_FILE for model downloading

* Run Win CC in precommits

* Move setting SSL_CERT_FILE before calling CMake

* Set SSL_CERT_FILE for model downloading in windows.yml

* Wording

* Revert "Run Win CC in precommits"

This reverts commit 94126aab1c.
2023-12-15 01:34:43 +04:00
Alina Kladieva 8bc724d160 [GHA] Add workflow_dispatch trigger to coverity (#21676)
To be able to trigger it via GitHub API from Jenkins nightly
2023-12-14 23:11:13 +04:00
Przemyslaw WysockiandKarol Blaszczak f4b2f950f2 [Docs] Add a single-point starter guide for contributors (#21322)
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-12-14 16:22:24 +00:00
Mikhail Ryzhov 59e9f50ec6 [GHA] Windows pytest optimizations (#21650)
* parallel runs

* enabled pip cache

* pip cache fix
2023-12-14 16:14:51 +00:00
Evgeny Kotov f094ef81f0 remove tests (#21654) 2023-12-14 16:54:37 +04:00
Mikhail Ryzhov de81bbbbc2 enabled triggers for release branches (#21651) 2023-12-14 16:50:04 +04:00
Alina Kladieva 926a0591ff Add overall status check to more workflows (#21644) 2023-12-14 01:43:42 +04:00
dependabot[bot] 47939684df Bump actions/setup-python from 4 to 5 (#21515)
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4 to 5.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-13 13:42:52 +04:00
Maxim Vafin 34b2b66b69 [PT FE] Report unsupported operations with model list (#21607)
* [PT FE] Report unsupported operations with model list

* Continue on error

* Disable more models

* Check if file exists

* continue of error

* Fix on failure

* Fix file path

* Apply suggestions from code review
2023-12-12 21:25:27 +00:00
Andrey Babushkin 5a4f632680 [workflows] New path for volumes (#21604) 2023-12-13 00:56:24 +04:00
Andrey Kashchikhin 9ab0a6d2f1 change trigger (#21609) 2023-12-13 00:46:16 +04:00
Andrey Kashchikhin 79ca3d2fb9 [CI] [GHA] Introduce Coverity pipeline (#21599)
* add coverity pipeline

* report less progress

* add curl installation

* change trigger to post-commit
2023-12-12 16:55:58 +04:00
Ilya Lavrenov 8e69f2c278 Add CPU tests as required for Linux arm64 (#21562) 2023-12-11 13:16:15 +04:00
Alina Kladieva 06a27e7b31 [GHA] Add Smart CI to Windows pipeline (#21558)
* [GHA] Add Smart CI to Windows pipeline

* Remove Smart CI from Python API units due to 127101

* Rename overall GHA status check for Windows
2023-12-09 01:50:14 +04:00
Andrey Babushkin a84d615abd Switch Windows Conditional Compilation workflow to AKS runners (#21375)
* Switch Windows Conditional Compilation workflow to AKS runners

* Fix YAML syntax

* Limit number of threads for CC build

* Split build stages to two to avoid step being successful when it's not

* Install python to conditional compilation job

* Combine both build commands into a single step

* Trying to work around sccache port issue

Sometimes build hangs and then ends by timeout. The only error message
in the logs is "sccache: error: An attempt was made to access a socket in a way forbidden by its access permissions. (os error 10013)"

* Temporary disable ctest step

* Revert "Temporary disable ctest step"

This reverts commit 8714200994.

* Disable Windows conditional compilation for PRs
2023-12-08 14:45:36 +00:00
Ilya Lavrenov fbec7be5e0 Try to run arm64 without system tbb (#21524)
* Try to run arm64 without system tbb

* Moved files

* Moved cmake files for auto batch
2023-12-08 13:59:48 +04:00
Ilya Lavrenov 3481568a39 Fixed Linux CC (#21540) 2023-12-08 13:51:06 +04:00
dependabot[bot] df2ff92d21 Bump actions/stale from 8 to 9 (#21535)
Bumps [actions/stale](https://github.com/actions/stale) from 8 to 9.
- [Release notes](https://github.com/actions/stale/releases)
- [Changelog](https://github.com/actions/stale/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/stale/compare/v8...v9)

---
updated-dependencies:
- dependency-name: actions/stale
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-08 12:58:56 +04:00
Andrey Kashchikhin dfc91186a1 [CI] [GHA] Extract test jobs into reusable workflows (#21395)
* extract cpu func tests into a reusable workflow

* add needs

* check paths

* correct paths

* rm usage of setupvars

* extract samples

* use yaml string

* split mac workflow

* check variables

* try github workspace

* check full dir

* set variables

* try with sub directory

* Revert "try with sub directory"

This reverts commit d891ee3f28.

* extract c++ tests from linux

* change

* use cxx workflow in mac workflows

* add noninteractive

* extract cpu func tests

* rm unused

* enable mac

* fix reusable workflow name

* correct path for sparse-checkout

* extract python UT

* remove unnecessary asterisk

* remove another unnecessary asterisk

* use reusable action for linux cc

* add check for setupvars existence

* check with manually installed opencl

* add components input to samples workflow; rm pr triggers for mac workflows

* add missing needs

* add missing option for deps install  script

* use disables in test themselves instead of ifs in workflows

* use reusable workflow for cxx tests in linux arm

* use python reusable workflow in linux arm

* add missing endif

* use self-hosted for samples, add x86_64 constraint for jax

* check paths

* find gompby partial name

* skip failing tests on arm; correct gomp finding for ovc

* check tests

* add debian packages job; use job_ prefix for reusable workflows with jobs

* extract tf hub model tests

* extract tf model hub perf tests

* extract pytorch models tests

* do not use container on GHA runners

* extract onnx runtime

* add missing deps

* skip test for linux arm

* rm always()s

* fix quotes

* correct paths

* correct ifs, check dir for onnxruntime

* correct path for onnxruntime utils folder; install python3

* use self-hosted as input

* check for self-hosted runner via name, pass version

* skip cpu plugin unittest

* check cxx tests

* rm pr trigger
2023-12-07 23:44:45 +04:00
Mikhail Ryzhov aa2dcb1f46 [GHA] Test command length excess (#21502)
* debug

* enabled pre-commit

* Disabled shell on Win

* remove shell length

* remove debug print
2023-12-07 18:01:19 +04:00
6d3fbf4237 【Hackathon 5th No.113】Support paddle 2.5.1 (#20161)
* Fixed comments for linux-riscv64 GHA workflow

* Try to enable PDPD tests back

* support paddle 2.5

* fix op test errors

* fix op test errors

* recover openvino/src/core/src/op/swish.cpp

* recover thirdparty open_model_zoo

* update cmakelist

* disable some tests

* fix code style

* enable paddle ci tests

* disable some tests

* fix np.long error

* recover reverse op

* update ci config

* recover set_value test codes

* rm linux_debian.yml

* Compatible with cases where different paddle versions have different output shapes

* remove set_value tests

* recover save_model.py

* Added ctest labels for FE tests only if FW is found

* recover thirdparty

* Update CMakeLists.txt

Fixed creation of paddle_tests target two times

* update paddle v2.5.1 proto file

* recover thirdparty

* fix Paddle_Reader_Tests.LoadModelMemoryToCore error

* fix Paddle_Places test issue in v2.5.1

* support some tests for low version paddle

* fix paddle FrontEndCutModelTest issue

* fix

* support all other tests for low version paddle

* fix codestyle

* fix codestyle

* Update generate_multi_tensor_split.py

* fix build error

* add testUnloadLibBeforeDeletingDependentObject into paddle skip tests config

* remove PROTOBUF_LITE from paddle CmakeList.txt

* fix path error

* add debug info

* add debug codes

* use make_model_path

* recover

* add option optimize_for

* use FrontEndTestUtils in read_paddle_model_test.cpp

* use FrontEndTestUtils in read_paddle_model_test.cpp

* fix grid_sample error when using dynamic shape

* fix error tests for 2.4 version

* add paddle version judge for floor_div

* fix grid_sample and add tests

* fix

* fix

* recover

* recover grid_sampler

* Apply suggestions from code review

* fix

* Apply suggestions from code review

* Apply suggestions from code review

* fix build error

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: meiyang-intel <yang.mei@intel.com>
2023-12-06 13:59:50 +04:00
Andrey Kashchikhin 62f5bd6570 [CI] [GHA] Introduce the Linux ARM64 workflow (#20809)
* add arm as a matrix for build job

* uncomment

* comment

* try inside pipeline

* check location

* another dirs

* try to privide correct action path

* use corrected action

* use newer commit

* use newer commit

* use newer commit

* use newer action commit

* add setting

* rm from pipeline, adapt action iteslf

* add missing deps

* enable samples and debian jobs

* correct yml

* correct image name

* correct syntax, use self-hosted option

* enable onnx runtime and c++, use newer action

* enable Python and CPU Func tests

* add missing deps for arm64

* increase timeout for python tests

* disable some tests, add more time

* skip failing tests

* skip speech sample test on arm

* dummy chang

* skip mxnet mo on arm, run all tests

* rm quotes

* separate linux x86 and arm64 workflows

* rm unused matrix refs, add timeouts

* add skips for c++ tests and some Python tests

* correct cache keys, extend timeout

* skip more python tests

* add more skips: for python and CPU func

* extend cpu func list with skips

* disable cpu func tests and python api 2.0 tests

* rm disable job

* styling, rm pr trigger, rm always(), rm unnecessary changes

* revert

* use ifs instead of comments, provide better wording for skips
2023-12-05 12:14:02 +04:00
Mikhail Ryzhov ba735c9149 [GHA] Updated 2-cores runner name (#21426)
* updated the name

* manual trigger
2023-12-01 16:46:20 +00:00
Mikhail Ryzhov 27adf58220 [GHA] Switched CPU functional test runner (#21346)
* switched runners to 32gb

* increased onnx timeout
2023-12-01 12:50:06 +04:00
Mikhail Ryzhov 1e959c7473 [GHA] Changed risc-v cache dir 2023-11-30 21:23:57 +01:00
Andrey Kashchikhin 6ab5ef72d5 [CI] [GHA] Skip failing tests in the Windows workflow (#21349)
* always run tests, enable pr trigger

* skip tests

* provide ticket numbers

* rm pr trigger; rm unused schedule trigger
2023-11-30 15:50:01 +04:00
jmacekx 54e61ac9f5 refactor docs build process (#21239) 2023-11-29 15:30:05 +04:00
Andrey Babushkin a7de95a8a4 Rename AKS runners' labels for consistency (#21282) 2023-11-28 12:13:28 +00:00
Alina Kladieva d722e42052 [GHA] Smart CI for more pipelines (#21307)
* Add Smart CI for more pipelines. Refactor logic for workflow skip

Since different workflows may have different requirements for skipping them, I suggest to move these requirements to parameters instead of hardcoding them

* Use patterns for skipping pipeline for conformance-only

* Remove path filters for Android

* Return mistakenly deleted param

* Propagate params to Python script

* Add missing outputs mapping

* Return push trigger

* Skip CC CPU func when CPU is not affected

* Fix variable name
2023-11-27 18:43:54 +04:00
Andrey Kashchikhin ca4c276072 [CI] [GHA] Increase precommit timeouts for TF Hub jobs (#21308)
* increase timeouts

* add more
2023-11-27 18:41:11 +04:00
965313ba0b [TF Hub][Perf Tests]Implement performance tests in precommit to compare read_model and convert_model paths (#21023)
* begin

* fixes

* measure time and compare

* fix bug + update precommint models

* cleanup

* add wget to install requirements; add to linux.yml

* fixes + improvements

* output results to html

* remove unneeded code

* fix

* code review fixes

* store downloaded models in cache

* use 1000 runs

* use model paths from tf-hub tests

* use tf hub api to download instead of wget; measure some time stats

* small fixes

* remove unneeded files

* use own list of models

* remove uneeded if

* remove unstable models

* remove unstable models

* fix requirements

* code review fixes

* Update .github/workflows/linux.yml

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* fix round_num function

* remove unstable network

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* code review fixes

* build fix

* code review fixes

* code review fixes

* code review fixes

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* code review fixes: use autoflake

* remove unneeded tensorflow_text

* Update .github/workflows/linux.yml

* Update linux.yml

Added TensorFlow_Hub_Performance_Models_Tests to final status check

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-11-24 18:13:44 +04:00
Alina Kladieva cf0c141e12 [GHA] Add GPU stub job to collect statistics (#21260) 2023-11-24 10:49:12 +04:00
Alina Kladieva 613e4f5fac [GHA] Rename overall status check (#21227) 2023-11-23 17:12:58 +01:00
Andrey Babushkin 57425b934f Switch Windows workflow to self-hosted runners in AKS (#20972)
* Switch Windows workflow to self-hosted runners in AKS

* Uncomment 'pull_request' event

* Fix YAML indentation

* Fix YAML indentation again

* trying to pre-create sccache dir

* Fix yaml syntax

* Add sccache blob storage prefix

* sccache directory creation seems unneeded

The issue was in the usage of bsdtar instead of GNU tar - the former
is in C:\Windows\System32, which is the first entry in the PATH

* Fix sccache --zero-stats command for Linux

* [windows] Replace ccache-action with sccache-action sccache install

We don't need to use GitHub Actions cache feature as we have sccache
and Azure Blob Storage

* Switch the rest of the stages to AKS runners

* Hardcode VS Build Tools version

* Revert "Hardcode VS Build Tools version"

This reverts commit ea9ae1fb33.

* Increase timeout for C++ Unit tests

* Increase timeout for particular step

* Further increase of timeout

* Switch Windows Conditional Compilation workflow to AKS runners

* Fix YAML syntax

* Revert "Increase timeout for C++ Unit tests"

This reverts commit e9a00c41ad.

* Revert "Fix YAML syntax"

This reverts commit ecc1b15552.

* Revert "Switch Windows Conditional Compilation workflow to AKS runners"

This reverts commit d5969d58cd.

* Disable PR trigger for Windows workflow

Let's run this in test mode on master branch only for a while
2023-11-22 16:43:14 +00:00
Irina Efode 4237de6bf1 [CONFORMANCE] Remove old-named conformance exec files (#21128)
* [CONFORMANCE] Remove old-named conformance exec files

* fix_GHA
2023-11-21 17:06:05 +04:00
Ilya Lavrenov 21a90f4e78 Smart CI: specializations for preprocessing and LPT (#21186)
* Smart CI: specializations for preprocessing and LPT

* Added PROXY component
2023-11-20 19:08:45 +04:00
Alina Kladieva 23462aea6b [GHA] Fix validation of dependent components in Smart CI config (#21187)
Use new syntax
2023-11-20 15:08:24 +01:00
Ilya Lavrenov 2ee8b29f64 Smart CI: CPU triggers tests for PT and TF FEs (#21183) 2023-11-20 15:35:40 +04:00
Alina Kladieva 7931938ea4 [GHA] Alternative way to handle required pipeline checks (#21164) 2023-11-20 11:14:58 +01:00
Alina Kladieva f7f8636fe4 [GHA] Workaround for some non-repo components in Smart CI (#21134)
* Workaround for some non-repo components in Smart CI

* Add possibility to add all components as dependent

* Remove extra check

* Add test case for "all" key
2023-11-20 12:44:50 +04:00
Irina Efode d1e1555f2f [CONFORMANCE] Cleaning up (#20835)
* 1. Add Op_conformance_utils lib.
2.rename targets.
3. Remove behavior folder from api conformance
4. Remove ov1.0 from opImplCheck
5. move tests and insts to one file
6. small refactoring for op conformance test names

* align namespaces, remove test_utils from subgraphs_dumper

* update target names

* Remove extra

* Fix the tests without shapes in meta

* fix failed test names

* Add attribute reader

* Fix buils

* Check the registered lib

* try

* add comparator

* Revert "try"

This reverts commit 27eaa4ea0f.

* try to fix win build

* types

* tr

* remove pragma once
2023-11-16 16:27:44 +04:00
yanlan song f78d0950d6 resolve dependency (#21105)
Signed-off-by: fishbell <bell.song@intel.com>
2023-11-16 11:42:42 +04:00