Commit Graph
302 Commits
Author SHA1 Message Date
Ilya Lavrenov fbec7be5e0 Try to run arm64 without system tbb (#21524)
* Try to run arm64 without system tbb

* Moved files

* Moved cmake files for auto batch
2023-12-08 13:59:48 +04:00
Ilya Lavrenov 3481568a39 Fixed Linux CC (#21540) 2023-12-08 13:51:06 +04:00
dependabot[bot] df2ff92d21 Bump actions/stale from 8 to 9 (#21535)
Bumps [actions/stale](https://github.com/actions/stale) from 8 to 9.
- [Release notes](https://github.com/actions/stale/releases)
- [Changelog](https://github.com/actions/stale/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/stale/compare/v8...v9)

---
updated-dependencies:
- dependency-name: actions/stale
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-08 12:58:56 +04:00
Andrey Kashchikhin dfc91186a1 [CI] [GHA] Extract test jobs into reusable workflows (#21395)
* extract cpu func tests into a reusable workflow

* add needs

* check paths

* correct paths

* rm usage of setupvars

* extract samples

* use yaml string

* split mac workflow

* check variables

* try github workspace

* check full dir

* set variables

* try with sub directory

* Revert "try with sub directory"

This reverts commit d891ee3f28.

* extract c++ tests from linux

* change

* use cxx workflow in mac workflows

* add noninteractive

* extract cpu func tests

* rm unused

* enable mac

* fix reusable workflow name

* correct path for sparse-checkout

* extract python UT

* remove unnecessary asterisk

* remove another unnecessary asterisk

* use reusable action for linux cc

* add check for setupvars existence

* check with manually installed opencl

* add components input to samples workflow; rm pr triggers for mac workflows

* add missing needs

* add missing option for deps install  script

* use disables in test themselves instead of ifs in workflows

* use reusable workflow for cxx tests in linux arm

* use python reusable workflow in linux arm

* add missing endif

* use self-hosted for samples, add x86_64 constraint for jax

* check paths

* find gompby partial name

* skip failing tests on arm; correct gomp finding for ovc

* check tests

* add debian packages job; use job_ prefix for reusable workflows with jobs

* extract tf hub model tests

* extract tf model hub perf tests

* extract pytorch models tests

* do not use container on GHA runners

* extract onnx runtime

* add missing deps

* skip test for linux arm

* rm always()s

* fix quotes

* correct paths

* correct ifs, check dir for onnxruntime

* correct path for onnxruntime utils folder; install python3

* use self-hosted as input

* check for self-hosted runner via name, pass version

* skip cpu plugin unittest

* check cxx tests

* rm pr trigger
2023-12-07 23:44:45 +04:00
Mikhail Ryzhov aa2dcb1f46 [GHA] Test command length excess (#21502)
* debug

* enabled pre-commit

* Disabled shell on Win

* remove shell length

* remove debug print
2023-12-07 18:01:19 +04:00
6d3fbf4237 【Hackathon 5th No.113】Support paddle 2.5.1 (#20161)
* Fixed comments for linux-riscv64 GHA workflow

* Try to enable PDPD tests back

* support paddle 2.5

* fix op test errors

* fix op test errors

* recover openvino/src/core/src/op/swish.cpp

* recover thirdparty open_model_zoo

* update cmakelist

* disable some tests

* fix code style

* enable paddle ci tests

* disable some tests

* fix np.long error

* recover reverse op

* update ci config

* recover set_value test codes

* rm linux_debian.yml

* Compatible with cases where different paddle versions have different output shapes

* remove set_value tests

* recover save_model.py

* Added ctest labels for FE tests only if FW is found

* recover thirdparty

* Update CMakeLists.txt

Fixed creation of paddle_tests target two times

* update paddle v2.5.1 proto file

* recover thirdparty

* fix Paddle_Reader_Tests.LoadModelMemoryToCore error

* fix Paddle_Places test issue in v2.5.1

* support some tests for low version paddle

* fix paddle FrontEndCutModelTest issue

* fix

* support all other tests for low version paddle

* fix codestyle

* fix codestyle

* Update generate_multi_tensor_split.py

* fix build error

* add testUnloadLibBeforeDeletingDependentObject into paddle skip tests config

* remove PROTOBUF_LITE from paddle CmakeList.txt

* fix path error

* add debug info

* add debug codes

* use make_model_path

* recover

* add option optimize_for

* use FrontEndTestUtils in read_paddle_model_test.cpp

* use FrontEndTestUtils in read_paddle_model_test.cpp

* fix grid_sample error when using dynamic shape

* fix error tests for 2.4 version

* add paddle version judge for floor_div

* fix grid_sample and add tests

* fix

* fix

* recover

* recover grid_sampler

* Apply suggestions from code review

* fix

* Apply suggestions from code review

* Apply suggestions from code review

* fix build error

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: meiyang-intel <yang.mei@intel.com>
2023-12-06 13:59:50 +04:00
Andrey Kashchikhin 62f5bd6570 [CI] [GHA] Introduce the Linux ARM64 workflow (#20809)
* add arm as a matrix for build job

* uncomment

* comment

* try inside pipeline

* check location

* another dirs

* try to privide correct action path

* use corrected action

* use newer commit

* use newer commit

* use newer commit

* use newer action commit

* add setting

* rm from pipeline, adapt action iteslf

* add missing deps

* enable samples and debian jobs

* correct yml

* correct image name

* correct syntax, use self-hosted option

* enable onnx runtime and c++, use newer action

* enable Python and CPU Func tests

* add missing deps for arm64

* increase timeout for python tests

* disable some tests, add more time

* skip failing tests

* skip speech sample test on arm

* dummy chang

* skip mxnet mo on arm, run all tests

* rm quotes

* separate linux x86 and arm64 workflows

* rm unused matrix refs, add timeouts

* add skips for c++ tests and some Python tests

* correct cache keys, extend timeout

* skip more python tests

* add more skips: for python and CPU func

* extend cpu func list with skips

* disable cpu func tests and python api 2.0 tests

* rm disable job

* styling, rm pr trigger, rm always(), rm unnecessary changes

* revert

* use ifs instead of comments, provide better wording for skips
2023-12-05 12:14:02 +04:00
Mikhail Ryzhov ba735c9149 [GHA] Updated 2-cores runner name (#21426)
* updated the name

* manual trigger
2023-12-01 16:46:20 +00:00
Mikhail Ryzhov 27adf58220 [GHA] Switched CPU functional test runner (#21346)
* switched runners to 32gb

* increased onnx timeout
2023-12-01 12:50:06 +04:00
Mikhail Ryzhov 1e959c7473 [GHA] Changed risc-v cache dir 2023-11-30 21:23:57 +01:00
Andrey Kashchikhin 6ab5ef72d5 [CI] [GHA] Skip failing tests in the Windows workflow (#21349)
* always run tests, enable pr trigger

* skip tests

* provide ticket numbers

* rm pr trigger; rm unused schedule trigger
2023-11-30 15:50:01 +04:00
jmacekx 54e61ac9f5 refactor docs build process (#21239) 2023-11-29 15:30:05 +04:00
Andrey Babushkin a7de95a8a4 Rename AKS runners' labels for consistency (#21282) 2023-11-28 12:13:28 +00:00
Alina Kladieva d722e42052 [GHA] Smart CI for more pipelines (#21307)
* Add Smart CI for more pipelines. Refactor logic for workflow skip

Since different workflows may have different requirements for skipping them, I suggest to move these requirements to parameters instead of hardcoding them

* Use patterns for skipping pipeline for conformance-only

* Remove path filters for Android

* Return mistakenly deleted param

* Propagate params to Python script

* Add missing outputs mapping

* Return push trigger

* Skip CC CPU func when CPU is not affected

* Fix variable name
2023-11-27 18:43:54 +04:00
Andrey Kashchikhin ca4c276072 [CI] [GHA] Increase precommit timeouts for TF Hub jobs (#21308)
* increase timeouts

* add more
2023-11-27 18:41:11 +04:00
965313ba0b [TF Hub][Perf Tests]Implement performance tests in precommit to compare read_model and convert_model paths (#21023)
* begin

* fixes

* measure time and compare

* fix bug + update precommint models

* cleanup

* add wget to install requirements; add to linux.yml

* fixes + improvements

* output results to html

* remove unneeded code

* fix

* code review fixes

* store downloaded models in cache

* use 1000 runs

* use model paths from tf-hub tests

* use tf hub api to download instead of wget; measure some time stats

* small fixes

* remove unneeded files

* use own list of models

* remove uneeded if

* remove unstable models

* remove unstable models

* fix requirements

* code review fixes

* Update .github/workflows/linux.yml

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* fix round_num function

* remove unstable network

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* code review fixes

* build fix

* code review fixes

* code review fixes

* code review fixes

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* code review fixes: use autoflake

* remove unneeded tensorflow_text

* Update .github/workflows/linux.yml

* Update linux.yml

Added TensorFlow_Hub_Performance_Models_Tests to final status check

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-11-24 18:13:44 +04:00
Alina Kladieva cf0c141e12 [GHA] Add GPU stub job to collect statistics (#21260) 2023-11-24 10:49:12 +04:00
Alina Kladieva 613e4f5fac [GHA] Rename overall status check (#21227) 2023-11-23 17:12:58 +01:00
Andrey Babushkin 57425b934f Switch Windows workflow to self-hosted runners in AKS (#20972)
* Switch Windows workflow to self-hosted runners in AKS

* Uncomment 'pull_request' event

* Fix YAML indentation

* Fix YAML indentation again

* trying to pre-create sccache dir

* Fix yaml syntax

* Add sccache blob storage prefix

* sccache directory creation seems unneeded

The issue was in the usage of bsdtar instead of GNU tar - the former
is in C:\Windows\System32, which is the first entry in the PATH

* Fix sccache --zero-stats command for Linux

* [windows] Replace ccache-action with sccache-action sccache install

We don't need to use GitHub Actions cache feature as we have sccache
and Azure Blob Storage

* Switch the rest of the stages to AKS runners

* Hardcode VS Build Tools version

* Revert "Hardcode VS Build Tools version"

This reverts commit ea9ae1fb33.

* Increase timeout for C++ Unit tests

* Increase timeout for particular step

* Further increase of timeout

* Switch Windows Conditional Compilation workflow to AKS runners

* Fix YAML syntax

* Revert "Increase timeout for C++ Unit tests"

This reverts commit e9a00c41ad.

* Revert "Fix YAML syntax"

This reverts commit ecc1b15552.

* Revert "Switch Windows Conditional Compilation workflow to AKS runners"

This reverts commit d5969d58cd.

* Disable PR trigger for Windows workflow

Let's run this in test mode on master branch only for a while
2023-11-22 16:43:14 +00:00
Irina Efode 4237de6bf1 [CONFORMANCE] Remove old-named conformance exec files (#21128)
* [CONFORMANCE] Remove old-named conformance exec files

* fix_GHA
2023-11-21 17:06:05 +04:00
Ilya Lavrenov 21a90f4e78 Smart CI: specializations for preprocessing and LPT (#21186)
* Smart CI: specializations for preprocessing and LPT

* Added PROXY component
2023-11-20 19:08:45 +04:00
Alina Kladieva 23462aea6b [GHA] Fix validation of dependent components in Smart CI config (#21187)
Use new syntax
2023-11-20 15:08:24 +01:00
Ilya Lavrenov 2ee8b29f64 Smart CI: CPU triggers tests for PT and TF FEs (#21183) 2023-11-20 15:35:40 +04:00
Alina Kladieva 7931938ea4 [GHA] Alternative way to handle required pipeline checks (#21164) 2023-11-20 11:14:58 +01:00
Alina Kladieva f7f8636fe4 [GHA] Workaround for some non-repo components in Smart CI (#21134)
* Workaround for some non-repo components in Smart CI

* Add possibility to add all components as dependent

* Remove extra check

* Add test case for "all" key
2023-11-20 12:44:50 +04:00
Irina Efode d1e1555f2f [CONFORMANCE] Cleaning up (#20835)
* 1. Add Op_conformance_utils lib.
2.rename targets.
3. Remove behavior folder from api conformance
4. Remove ov1.0 from opImplCheck
5. move tests and insts to one file
6. small refactoring for op conformance test names

* align namespaces, remove test_utils from subgraphs_dumper

* update target names

* Remove extra

* Fix the tests without shapes in meta

* fix failed test names

* Add attribute reader

* Fix buils

* Check the registered lib

* try

* add comparator

* Revert "try"

This reverts commit 27eaa4ea0f.

* try to fix win build

* types

* tr

* remove pragma once
2023-11-16 16:27:44 +04:00
yanlan song f78d0950d6 resolve dependency (#21105)
Signed-off-by: fishbell <bell.song@intel.com>
2023-11-16 11:42:42 +04:00
Maxim Vafin 369831caef [PT FE] Use system model cache when running torch hub tests locally (#21047)
* Use system model cache when running torch hub tests locally

* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py

* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py
2023-11-14 11:43:06 +01:00
Alina Kladieva f0c0bf89e2 Smart CI for docs (#21021)
* Handle Smart CI for docs

* Remove path filters

* Fix quotes

* Fix logic

* Revert unneeded change

* Add md_files_only to components configuration

* Get rid of custom output

* Try to fix condition

* Add manual handling of some docs changes

* Remove helper label
2023-11-14 00:00:51 +04:00
Alina Kladieva e8d28f7f6d Make conformance wait for Smart CI step (#21014) 2023-11-10 12:10:36 +01:00
Irina Efode ebf1874eee [GHA] Check OpImplCheck conformance for template plugin (to make sure that all functions are checked by conformance) (#20712)
* [CONFROMANCE] Fix Template OpImplCheck on Win

* Update windows.yml

* check win

* Update windows.yml

* remove extra changes
2023-11-10 12:39:58 +04:00
Ilya Lavrenov d4dd169ca3 Added more smart CI conditions (#20999) 2023-11-09 23:40:26 +04:00
Alina Kladieva 51a17ba642 Workaround failing MO unit when Python API unit are skipped (#20997) 2023-11-09 18:07:57 +01:00
Alina Kladieva fa22836cfb Fix no match files change case (#20981) 2023-11-09 12:07:47 +01:00
Ilya Lavrenov c851d643b3 Fixed smart CI (#20980) 2023-11-09 11:28:32 +01:00
Alina KladievaandIlya Lavrenov 000966660c Smart CI POC (#19825)
* Try using a custom action directly from repo

* Run smart CI under ubuntu-latest

* Set output + add a sample step

* Update linux.yml

* Add components.yml

* Add some conditions

* Just to check if reference to "needs" work in job context

* Update linux.yml

* More example cases

* Dummy change to CPU

* Fix typo

* Fix SAMPLES_AFFECTED variable

* Use more correct dependents key

* Fighting with messy GHA conditions

* No brackets and no double quotes in conditions

* Revert "Dummy change to CPU"

This reverts commit 4eae09e5b5.

* Use refactored action

* Move action implementation to openvino repo

* Extend components.yml config

* Update labeler.yml

* Dummy change to TF FE

* Fix indentation

* Add missing needs

* Add missing records

* Allow missing records for components in validation

* install_openvino_dependencies as a separate step for Python_Unit_Tests

* Improve config validation

* Revert "Dummy change to TF FE"

This reverts commit 01190864d1.

* Dummy change to model hub tests

* Update CPU component config

* Dummy change to Python API

* Dummy change to Python API

* Revert "Dummy change to Python API"

This reverts commit 3fce0bb3fb.

* Dummy change to Python API

* Simplify conditions. Cover "no components changed" case

* Update components.yml

* Update .gitignore

* Revert "Dummy change to Python API"

This reverts commit e57ea9852c.

* Fix dependencies scopes

* Add simple unit tests for smart ci functionality

* Revert "Dummy change to model hub tests"

This reverts commit c3d6837e22.

* Use ghapi module with permissive license

* Cover install_build_dependencies.sh script by labeler

* More labels

* Use ghapi. Apply review comments

* Enable dot files to be matched by labeler

* Warning instead of error in artifacts upload where smart ci is enabled

* Fix master merge

* Fix condition for TF FE common tests

* Fix condition for Pytorch FE tests

* Remove condition for pytorch model tests

* Allow any label as a component

* Refactor tests log handling

* Allow any defined label as a component

* Rearrange config structure. Fill the config with actual data

* Run full scope on changes to non-matching files

* Add missing conditions

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-11-09 11:38:58 +04:00
Alina Kladieva f627172e5a Add separate label for docs snippets (#20966) 2023-11-08 22:19:35 +04:00
Andrey Kashchikhin 24cd7283e3 make cache space showing optional (#20962) 2023-11-08 17:28:08 +00:00
Mikhail Ryzhov 9616c8f510 corrected timeouts (#20954) 2023-11-08 17:45:53 +01:00
Alina Kladieva f17f17acc7 Use custom labeler to label changes not matching any pattern (#20888)
Needed for Smart CI (https://github.com/openvinotoolkit/openvino/pull/19825)
2023-11-07 12:16:32 +01:00
Ilya Lavrenov c0381ab08d Updated labeler config (#20913) 2023-11-07 14:05:03 +04:00
Mikhail Ryzhov 28279013af aligned lin build timeouts (#20885) 2023-11-06 14:07:24 +04:00
Andrey Kashchikhin fda1fd9dc1 [CI] [GHA] Add missing setup-python action checkout; use custom action across all pipelines (#20863)
* use unified setup-python actions across all pipelines

* rm triggers
2023-11-04 11:58:01 +04:00
Andrey Kashchikhin eea49f3c9e [CI] [GHA] Remove full cloning of the OV repository in the Python unittests job in the Win and Mac workflows (#20810)
* rm full cloning of the OV repo in win and mac workflows

* skip tests on mac

* increase timeout for win C++ tests; skip more mac tests

* rm triggers
2023-11-01 22:20:22 +04:00
Andrey Kashchikhin 03f23ae57a [CI] [GHA] Fix openvino.test_utils imports for Mac and Win Python unittests (#20786)
* add platform-agnostic setup python action

* use specific version

* rm debug message, checkout action

* correct path

* add checkout of the action, correct paths

* correct path; enclose into brackets

* transfer linux pipelines to local setup-python action

* transfer pipelines

* use newer version

* account for fedora, add missing cache path

* correct name

* use 3.9 for fedora

* rm python install from fedora

* mv fetch and setup together, set pip_cache_dir

* correct order

* rm triggers

* add missing pythonpaths

* correct path

* add one more pythonpath

* add paths to ov package libs

* Revert "add paths to ov package libs"

This reverts commit a775881f3e.
2023-11-01 12:07:40 +04:00
Andrey Kashchikhin 703e911321 [CI] [GHA] Increase job timeouts (#20797)
* increase job timouts

* increase further
2023-10-31 16:46:52 +00:00
dependabot[bot] 7f04ad69c2 Bump awalsh128/cache-apt-pkgs-action from 1.3.0 to 1.3.1 (#20779)
Bumps [awalsh128/cache-apt-pkgs-action](https://github.com/awalsh128/cache-apt-pkgs-action) from 1.3.0 to 1.3.1.
- [Release notes](https://github.com/awalsh128/cache-apt-pkgs-action/releases)
- [Commits](https://github.com/awalsh128/cache-apt-pkgs-action/compare/v1.3.0...v1.3.1)

---
updated-dependencies:
- dependency-name: awalsh128/cache-apt-pkgs-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-31 11:33:51 +04:00
Ilya Lavrenov b13cb8ce12 Make RPM packages compatible with wide range of RHEL systems (#20762) 2023-10-31 10:25:35 +04:00
Maxim Vafin bc9b52ef7e Increase timeout for hub tests (#20764) 2023-10-30 18:27:00 +04:00
Maxim Vafin 439b7e57c7 [GHA] Add torch.compile layer tests to GHA (#20655)
* [GHA] Add torch.compile layer tests to GHA

* Update pytorch_layer_test_class.py
2023-10-30 17:23:02 +04:00