Commit Graph
225 Commits
Author SHA1 Message Date
Alina Kladieva 7931938ea4 [GHA] Alternative way to handle required pipeline checks (#21164) 2023-11-20 11:14:58 +01:00
Alina Kladieva f7f8636fe4 [GHA] Workaround for some non-repo components in Smart CI (#21134)
* Workaround for some non-repo components in Smart CI

* Add possibility to add all components as dependent

* Remove extra check

* Add test case for "all" key
2023-11-20 12:44:50 +04:00
Irina Efode d1e1555f2f [CONFORMANCE] Cleaning up (#20835)
* 1. Add Op_conformance_utils lib.
2.rename targets.
3. Remove behavior folder from api conformance
4. Remove ov1.0 from opImplCheck
5. move tests and insts to one file
6. small refactoring for op conformance test names

* align namespaces, remove test_utils from subgraphs_dumper

* update target names

* Remove extra

* Fix the tests without shapes in meta

* fix failed test names

* Add attribute reader

* Fix buils

* Check the registered lib

* try

* add comparator

* Revert "try"

This reverts commit 27eaa4ea0f.

* try to fix win build

* types

* tr

* remove pragma once
2023-11-16 16:27:44 +04:00
Maxim Vafin 369831caef [PT FE] Use system model cache when running torch hub tests locally (#21047)
* Use system model cache when running torch hub tests locally

* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py

* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py
2023-11-14 11:43:06 +01:00
Alina Kladieva f0c0bf89e2 Smart CI for docs (#21021)
* Handle Smart CI for docs

* Remove path filters

* Fix quotes

* Fix logic

* Revert unneeded change

* Add md_files_only to components configuration

* Get rid of custom output

* Try to fix condition

* Add manual handling of some docs changes

* Remove helper label
2023-11-14 00:00:51 +04:00
Alina Kladieva e8d28f7f6d Make conformance wait for Smart CI step (#21014) 2023-11-10 12:10:36 +01:00
Irina Efode ebf1874eee [GHA] Check OpImplCheck conformance for template plugin (to make sure that all functions are checked by conformance) (#20712)
* [CONFROMANCE] Fix Template OpImplCheck on Win

* Update windows.yml

* check win

* Update windows.yml

* remove extra changes
2023-11-10 12:39:58 +04:00
Ilya Lavrenov d4dd169ca3 Added more smart CI conditions (#20999) 2023-11-09 23:40:26 +04:00
Alina Kladieva 51a17ba642 Workaround failing MO unit when Python API unit are skipped (#20997) 2023-11-09 18:07:57 +01:00
Ilya Lavrenov c851d643b3 Fixed smart CI (#20980) 2023-11-09 11:28:32 +01:00
Alina KladievaandIlya Lavrenov 000966660c Smart CI POC (#19825)
* Try using a custom action directly from repo

* Run smart CI under ubuntu-latest

* Set output + add a sample step

* Update linux.yml

* Add components.yml

* Add some conditions

* Just to check if reference to "needs" work in job context

* Update linux.yml

* More example cases

* Dummy change to CPU

* Fix typo

* Fix SAMPLES_AFFECTED variable

* Use more correct dependents key

* Fighting with messy GHA conditions

* No brackets and no double quotes in conditions

* Revert "Dummy change to CPU"

This reverts commit 4eae09e5b5.

* Use refactored action

* Move action implementation to openvino repo

* Extend components.yml config

* Update labeler.yml

* Dummy change to TF FE

* Fix indentation

* Add missing needs

* Add missing records

* Allow missing records for components in validation

* install_openvino_dependencies as a separate step for Python_Unit_Tests

* Improve config validation

* Revert "Dummy change to TF FE"

This reverts commit 01190864d1.

* Dummy change to model hub tests

* Update CPU component config

* Dummy change to Python API

* Dummy change to Python API

* Revert "Dummy change to Python API"

This reverts commit 3fce0bb3fb.

* Dummy change to Python API

* Simplify conditions. Cover "no components changed" case

* Update components.yml

* Update .gitignore

* Revert "Dummy change to Python API"

This reverts commit e57ea9852c.

* Fix dependencies scopes

* Add simple unit tests for smart ci functionality

* Revert "Dummy change to model hub tests"

This reverts commit c3d6837e22.

* Use ghapi module with permissive license

* Cover install_build_dependencies.sh script by labeler

* More labels

* Use ghapi. Apply review comments

* Enable dot files to be matched by labeler

* Warning instead of error in artifacts upload where smart ci is enabled

* Fix master merge

* Fix condition for TF FE common tests

* Fix condition for Pytorch FE tests

* Remove condition for pytorch model tests

* Allow any label as a component

* Refactor tests log handling

* Allow any defined label as a component

* Rearrange config structure. Fill the config with actual data

* Run full scope on changes to non-matching files

* Add missing conditions

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-11-09 11:38:58 +04:00
Andrey Kashchikhin 24cd7283e3 make cache space showing optional (#20962) 2023-11-08 17:28:08 +00:00
Mikhail Ryzhov 9616c8f510 corrected timeouts (#20954) 2023-11-08 17:45:53 +01:00
Alina Kladieva f17f17acc7 Use custom labeler to label changes not matching any pattern (#20888)
Needed for Smart CI (https://github.com/openvinotoolkit/openvino/pull/19825)
2023-11-07 12:16:32 +01:00
Mikhail Ryzhov 28279013af aligned lin build timeouts (#20885) 2023-11-06 14:07:24 +04:00
Andrey Kashchikhin fda1fd9dc1 [CI] [GHA] Add missing setup-python action checkout; use custom action across all pipelines (#20863)
* use unified setup-python actions across all pipelines

* rm triggers
2023-11-04 11:58:01 +04:00
Andrey Kashchikhin eea49f3c9e [CI] [GHA] Remove full cloning of the OV repository in the Python unittests job in the Win and Mac workflows (#20810)
* rm full cloning of the OV repo in win and mac workflows

* skip tests on mac

* increase timeout for win C++ tests; skip more mac tests

* rm triggers
2023-11-01 22:20:22 +04:00
Andrey Kashchikhin 03f23ae57a [CI] [GHA] Fix openvino.test_utils imports for Mac and Win Python unittests (#20786)
* add platform-agnostic setup python action

* use specific version

* rm debug message, checkout action

* correct path

* add checkout of the action, correct paths

* correct path; enclose into brackets

* transfer linux pipelines to local setup-python action

* transfer pipelines

* use newer version

* account for fedora, add missing cache path

* correct name

* use 3.9 for fedora

* rm python install from fedora

* mv fetch and setup together, set pip_cache_dir

* correct order

* rm triggers

* add missing pythonpaths

* correct path

* add one more pythonpath

* add paths to ov package libs

* Revert "add paths to ov package libs"

This reverts commit a775881f3e.
2023-11-01 12:07:40 +04:00
Andrey Kashchikhin 703e911321 [CI] [GHA] Increase job timeouts (#20797)
* increase job timouts

* increase further
2023-10-31 16:46:52 +00:00
dependabot[bot] 7f04ad69c2 Bump awalsh128/cache-apt-pkgs-action from 1.3.0 to 1.3.1 (#20779)
Bumps [awalsh128/cache-apt-pkgs-action](https://github.com/awalsh128/cache-apt-pkgs-action) from 1.3.0 to 1.3.1.
- [Release notes](https://github.com/awalsh128/cache-apt-pkgs-action/releases)
- [Commits](https://github.com/awalsh128/cache-apt-pkgs-action/compare/v1.3.0...v1.3.1)

---
updated-dependencies:
- dependency-name: awalsh128/cache-apt-pkgs-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-31 11:33:51 +04:00
Ilya Lavrenov b13cb8ce12 Make RPM packages compatible with wide range of RHEL systems (#20762) 2023-10-31 10:25:35 +04:00
Maxim Vafin bc9b52ef7e Increase timeout for hub tests (#20764) 2023-10-30 18:27:00 +04:00
Maxim Vafin 439b7e57c7 [GHA] Add torch.compile layer tests to GHA (#20655)
* [GHA] Add torch.compile layer tests to GHA

* Update pytorch_layer_test_class.py
2023-10-30 17:23:02 +04:00
Andrey KashchikhinandMikhail Ryzhov b1ce297bde [CI] [GHA] Add system information print action (#20710)
* added action

* test action

* fixed typo

* move action to test flow

* fixed pipeline

* changed description

* add action to common pipeline

* changed actions path

* use bash syntax

* path

* fix

* reordered

* update

* revert unused changes

* update path

* Revert "update path"

This reverts commit bff8ac2396.

* mac and win

* print system info

* correct pathg

* use relative path

* run mac

* add print sysinfo step, enable triggers

* use win agnostic func

* rm triggers

* mv sysinfo check after checkouts; rm tools versions info printing

* correct desc

* add sysinfo dep for fedora

* mv pre-requisite installation

---------

Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
2023-10-27 11:25:01 +02:00
Ilya Lavrenovanddependabot[bot] 0d458f086d Dependabot/pip/src/bindings/python/paddlepaddle 2.5.2 (#20708)
* Bump paddlepaddle from 2.5.1 to 2.5.2 in /src/bindings/python

Bumps [paddlepaddle](https://github.com/paddlepaddle/paddle) from 2.5.1 to 2.5.2.
- [Release notes](https://github.com/paddlepaddle/paddle/releases)
- [Changelog](https://github.com/PaddlePaddle/Paddle/blob/develop/RELEASE.md)
- [Commits](https://github.com/paddlepaddle/paddle/compare/v2.5.1...v2.5.2)

---
updated-dependencies:
- dependency-name: paddlepaddle
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* Removed WA for Ubuntu 22.04 and PDPD

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-26 14:06:34 +04:00
Andrey Kashchikhin 5a1b13a069 fix parent job name (#20702) 2023-10-26 13:17:52 +04:00
Andrey Kashchikhin f86d80e14c increase timeout (#20705) 2023-10-26 13:15:52 +04:00
Mikhail RyzhovandMaxim Vafin 4078bd9c19 [GHA] Speed up PyTorch Layer unit tests (#20613)
* test

* fixed tests

* typo

* fixed tests

* rest of the tests

* fixed rsub test

* tmp fix

* Revert "tmp fix"

This reverts commit b8bf1e9492e13497895da488612c9a137ef840bc.

* fixed test params

* reset thirdparty/pugixml

* Revert "fixed rsub test"

This reverts commit 9b6be34b8666936e8124b6622fcc5185b640de92.

* fixed typo

* fixed test data

* reset test_rsub

* removed unused param

* reverrted runner

* simplified call

* fixed random

* changed logical to auto mode

* Revert "fixed random"

This reverts commit 8a4f20b24641144f823a7e1f1ff92038634acf32.

* fixed test_all

* replaced random_sample with randn

* fixed rebase issue

* reverted logical splitting

* Update tests/layer_tests/pytorch_tests/test_repeat_interleave.py

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

* Update tests/layer_tests/pytorch_tests/test_all.py

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

* Apply suggestions from code review

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

* fixed merge conflict

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-10-26 13:10:51 +04:00
Mikhail Ryzhov 00e2381d04 [GHA] Jobs timeouts (#20601)
* set linux timeouts

* set win timeouts

* other timeouts

* reverted pugixml

* fixed conformance timeout

* reset omz
2023-10-26 00:39:31 +04:00
Mikhail Ryzhov 49c5099f5e [GHA] Removed dependency on git repo in python tests (#20390)
* Removed repo deps in py tests

* fixed typo

* changed test cmd

* add test_utils to pythonpath

* set test_utils to LD_LIBRARY_PATH

* changed path

* changed path

* source python site-packages

* fixed LD_LIBRARY_PATH

* print pip dir

* changed python install path

* source all openvino dir

* isolate test_utils

* system deps

* reordered deps

* dep conflict

* tests reorder

* changed test_utils path

* cpack test dir

* rebase fix

* fixed env

* frontend tests fix

* removed already installed reqs

* debug

* debug 2

* added python action path

* test

* reset 3rdparties

* set pip install path globally

* reset 3rdparties

* removed parallel code

* moved doc snippets

* switched back 4-core runner

* removed global unused vars

* removed unused requirements.txt

* removed unused requirements

* test

* Revert "test"

This reverts commit bdf22d22fd6ec5d488930bc362bdb0741c5bea76.
2023-10-25 20:16:01 +00:00
Andrey KashchikhinandIlya Lavrenov 214e08599b [CI] [GHA] Switch Windows pipeline to dynamic build and to VS 2019 (#20630)
* build dynamic in win main; transfer win main to MSVC 2019; use toolchain for win cc

* Update windows_conditional_compilation.yml

use cmake toolchain globally in build stage

* Update windows_conditional_compilation.yml

* Update windows_conditional_compilation.yml

* use quotes

* try w/o protobuf

* do not restore cache

* return

* revert

* add missing shell

* skip Template OpImpl tests

* skip OV C API tests

* rm pr trigger

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-25 22:36:25 +04:00
68538b2b3f docs 📝 : add the take issue workflow [19006] (#19027)
* docs 📝 : add the take issue workflow

* chore: add the latest tag from action

Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com>

* Update .github/workflows/triage.yml

Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com>

* docs(readme): more descriptive message

Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com>

* docs(triage): more descriptive message in action

Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com>

* chore: .github/workflows/triage.yml

Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>

* chore:🌻 rename the file and add new secret

---------

Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com>
Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>
2023-10-25 12:50:53 +04:00
Andrey Babushkin ee6263a141 [workflows/linux] Switch to sccache and Azure Blob Storage (#20484)
* [workflows/linux] Switch to sccache and Azure Blob Storage

* Install curl

* Remove --show-config

* Add sccache to other Linux workflows

* sccache to  Android, curl to riscv and CC

* Use sccache action instead of manual install

* Oops, missed sccache manual installation in two places

* Use env vars instead of hardcoded CMAKE_C(XX)_COMPILER_LAUNCHER

* Forgot one more stage in Linux CC pipeline

* Temporarily disable Blob Storage for RISC-V

For some reason sccache has no effect on build time and show 0 hits
and 0 compilation requests despite being in CMake calls

* forgot to add sccache installation to Linux CC

* Revert "Temporarily disable Blob Storage for RISC-V"

This reverts commit b528f41dad583a38b9ef93121e38044b9dccb71b.

* Missing container option for CC build

* Remove curl installation

* Remove CCACHE* variables which have no effect on sccache

* Revert sccache changes for Linux RISC-V workflow
2023-10-24 20:52:56 +01:00
Andrey KashchikhinandIlya Lavrenov b67cff7cd5 [CI] [GHA] Introduce macOS ARM64 as a matrix parameter in the macOS pipeline (#20363)
* add m1 mac pipelines as a matrix parameter

* Update mac.yml

disable java_api because of macos arm64 - Java is not available on macOS arm64 runners

* Update mac.yml

added always condition for all tests

* Update mac.yml

* Update mac.yml

* Update mac.yml

* Update setup.py

temp commit

* Update tools/openvino_dev/setup.py

* use matrix for var

* add mxnet to extras only for x86_64

* skip failing tests

* use xfail for Python tests; add missing filter for transformations tests

* skip CPU func tests on x86_64 mac; skip some tests from CPU func tests on arm mac

* Update mac.yml

* skip tests on mac arm

* skip tests on darwin; apply review

* add more skips for python and c++ tests

* skip tf tests

* skip more tf tests; skip more Python UT stages

* rm alwayses, rm triggers, add nightly trigger

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-23 15:06:22 +04:00
Irina Efode 4fe6d5ec54 Fix OpImplCheck in GHA (#20650)
* Update mac.yml

* Update mac.yml
2023-10-23 15:04:05 +04:00
Irina Efode 6e4ec88db8 [GHA][CONFORMANCE] Enable and conformance for Template in GHA (#20604)
* [GHA][CONFORMANCE] Enable  and conformance  for Template in GHA

* apply review

* Update linux.yml
2023-10-23 10:47:15 +02:00
Andrey Kashchikhin f6aa2ab7af fix yml (#20614) 2023-10-19 19:17:16 +04:00
Andrey Kashchikhin e4a83b9b77 [CI] [GHA] Extend Win CC pipeline with tests, make it static (#20579)
* start with transferring

* add CPU fun tests stage; complete CC stage

* start tests in comd

* uncomment

* fix step

* rm restore key

* align cmake

* add tbb path setting, continue on error

* add logs; add missing dir; add extension for ov cpu test bin

* add missing slash for path; explicitely set BUILD_TYPE

* correct paths for layer tests summary files; add tbb as target

* correct path to tbb

* rm triggers; add nightly trigger; rm debug conditions

* rm comment on cache
2023-10-19 18:05:55 +04:00
Mikhail Ryzhov cf9791e3e0 [GHA] Temporary disable win workflows (#20568)
* moved win workflow to nightly

* reset redundant files

* removed redundant files
2023-10-18 20:43:46 +04:00
491454103e [Docs] fix failure of python snippet (#20516)
* [Docs] fix failure of python snippet

* trigger python snippets

* fix ga

* Update .github/workflows/linux.yml

Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>

* Update .github/workflows/linux.yml

Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>

* return back fix

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
2023-10-18 14:23:52 +00:00
Andrey Kashchikhin 755651cd34 disable pr trigger (#20497) 2023-10-16 19:21:48 +04:00
Ilya Lavrenov e812831346 Added ctest labels for FE tests only if FW is found (#20483) 2023-10-16 16:29:37 +04:00
Mikhail Ryzhov e8861fb16a extended logs (#20442) 2023-10-14 13:19:36 +04:00
Andrey Kashchikhin 2e33019e68 [CI] [GHA] Align pipelines (#20388)
* add ONNX layer tests

* add parallelism for pytest; add missing stages to win; align execution steps

* add missng shell option

* add missing dep, update marker

* align stages and execution commands; rm parallelization

* enable trigger

* add missing export; rm not-applicable stage from mac and win pipeline

* add missing requirement, rm not-applicable stage

* add missing test parameters

* try to pi onnxruntime version; skip mxnet on mac; correct vars in win

* rm constraint

* skip on win

* use xfail

* remove always(), rm trigger for mac

* return push trigger for mac
2023-10-13 23:48:15 +04:00
Ilya Lavrenov 56d74a82cb Relocatable developer package (#20327)
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU

* Initial relocatable OpenVINO Developer package

* Improvements

* Try to fix

* improvements

* Export a lot of headers

* Removed NVIDIA pipeline; make it to be a job

* Fixes

* Fixes 2

* Try ilya-lavrenov repo

* Clean-up

* More imrpovements

* Even more improvements

* Override export, install

* Override export, install

* Disable pythonwheel generation for relocatable OV dev package

* Fixed issues with versions

* Fixed android build

* Fixed android build

* Fixed NPU build

* Update src/bindings/python/CMakeLists.txt
2023-10-12 22:59:04 +00:00
Ilya Lavrenov 9e4ec43f7c Disabled sporadic test_backend.py::OnnxBackendNodeModelTest::test_div_uint8_cpu test (#20419) 2023-10-12 15:29:30 +04:00
Ilya Lavrenov 2604c33d1b Don't add mxnet extras for openvino-dev on macOS arm64 (#20403) 2023-10-12 13:23:18 +04:00
Ilya Lavrenov d41e7fcc30 Revert "[CI] [GHA] Skip test_div_uint8_cpu on macOS only; unskip test_onnx/test_backend.py in GHA workflows (#20367)" (#20402)
This reverts commit a3d6d0bca9.
2023-10-12 03:00:14 +04:00
Ilya Lavrenov 10d1862715 Updated ade submodule (#20392) 2023-10-11 23:38:00 +04:00
Andrey KashchikhinandIlya Lavrenov a3d6d0bca9 [CI] [GHA] Skip test_div_uint8_cpu on macOS only; unskip test_onnx/test_backend.py in GHA workflows (#20367)
* only skip test if mac

* unskip

* unskip trigger

* skip for onnx fe as well

* do not skip

* return skips and unskip test_backend in Python API 1.0

* rm pr trigger

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-11 14:05:12 +04:00