Commit Graph
49 Commits
Author SHA1 Message Date
Andrey KashchikhinandIlya Lavrenov 1454e77bbf [CI] [GHA] Introduce GHA macOS Pipeline (#20212)
* start transferring

* start with samples

* start with initial two stages

* change name

* skip pytorch tests; rm unused comments

* rm setupvars sourcing; make test steps similar to those in linux pipeline

* add missing options and setupvars sourcing

* add skips for mac

* install wheels directly

* add deployment target

* add skips for pytorch layer tests; experiment with samples

* do not exclude files for archives; set rpath

* apply comments; rm unnecessary stages

* Update mac.yml

fixed MO Python API tests

* Update .github/workflows/mac.yml

* Update openvino.cmake

add LC_RPATH to libopenvino.dylib

* Update src/cmake/openvino.cmake

* Update CMakeLists.txt

reverted changes in samples build

* Update openvino.cmake

removed rpath changes

* add setupvars

* disable pr trigger

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-10 14:43:09 +04:00
Ilya LavrenovandAndrey Kashchikhin ba6a676484 Aligned tests with azure linux.yml (#20304)
* Aligned tests with azure linux.yml

* Apply suggestions from code review

fixed comments

Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>

---------

Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>
2023-10-09 12:55:26 +04:00
Mikhail Ryzhov e1faf3ddd0 [GHA] Parallel test script code style (#20119)
* fixed code style

* extend logs

* fixed  comments

* comments
2023-10-09 10:23:57 +02:00
yanlan song ad41d0f52f rework auto test cases (#19862)
* initial commit

Signed-off-by: fishbell <bell.song@intel.com>

* clean up

Signed-off-by: fishbell <bell.song@intel.com>

* fix windows build failure

Signed-off-by: fishbell <bell.song@intel.com>

* enable auto func tests

Signed-off-by: fishbell <bell.song@intel.com>

* enable auto_func_test to ci

Signed-off-by: fishbell <bell.song@intel.com>

* some clean up in gpu case

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* fix build warning

Signed-off-by: fishbell <bell.song@intel.com>

* enable new tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix build warning

Signed-off-by: fishbell <bell.song@intel.com>

* enable consistency test

Signed-off-by: fishbell <bell.song@intel.com>

* try fix build error on manylinux

Signed-off-by: fishbell <bell.song@intel.com>

* enable cpplint

Signed-off-by: fishbell <bell.song@intel.com>

* enable clang-format

Signed-off-by: fishbell <bell.song@intel.com>

enable some tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix typo

Signed-off-by: fishbell <bell.song@intel.com>

* clang for unit tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix merge conflict

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
2023-10-07 14:44:25 +04:00
Mikhail Ryzhov 7e7b6482aa [GHA][HF] Switch python nightly tests to github runners (#20286)
* switched runners to GHA

* excluded timm models from nightly scope

* added sudo steps

* switched precommit too
2023-10-07 02:22:32 +04:00
Ilya Lavrenov d6c2a10b38 Merge Linux CC + static build + clang compiler (#20243)
* Merge Linux CC + static build + clang compiler

* Improvements

* Fixes
2023-10-06 00:30:11 +04:00
Andrey Kashchikhin 4ad68e8ff2 [CI] [GHA] Introduce conformance tests (#19841)
* check dirs

* cmake, build, instlll

* use make

* use build dir

* use target

* add missing

* execute conformance tests

* correct path for requirements

* setupvars

* add API conformance

* conformance as a separate job; install all necessary files

* uncomment

* merge

* install deps

* use matrix, upload expected failures to gh cache

* use 8-core

* use the same paths

* uncomment

* comment

* change

* use csv

* add exit if there are failed tests

* always upload logs

* check dir

* use another dir for expected_failures

* upload always

* rm

* new key

* rm unused

* change

* update

* update

* rm unused

* do not exit if update is set

* copy file

* do not fail in failures check

* use specific branch

* run clean

* add expected failures

* uncomment

* comment out

* correctly add failed tests to fix_priority; check for unexpected failures in case of an update

* use azure runners for conformance

* use 4-core

* uncomment

* comment out

* split deps installation

* add missing deps for setup-python

* print error

* install certs

* do not verify ssl

* add ca-certificates install

* uncomment

* comment

* pack artifacts, rm unused deps

* rm unused dep

* always pack artifacts

* rm for func tests

* use less cores

* use var

* store int

* do not exit if non-zero code

* only 4 core

* use gh runner

* use sudo

* add missing sudo

* use expected failures

* uncomment

* comment

* create fresh expected failures

* use expected failures

* use specific ref and repo

* use expected failures

* uncomment

* comment out

* check caches

* fix str

* rm unused

* restore by restore key

* create dir

* use array

* use diff path

* mv after each download

* add sleeping and more logs

* add saving of hash table

* change

* uncomment

* comment

* download cache entries

* check dir

* use better dir

* uncomment

* rm unused

* add skip configs

* update lists

* rm unused dir; add docs

* rm unused

* rm hardcoded repo ref

* rm unused options; use better name for job

* rm unnecessary dir creation
2023-10-05 14:39:28 +04:00
Andrey Kashchikhin bcd331d145 [CI] [GHA] Transfer Linux ONNX Runtime to AKS runners (#20157)
* transition to aks runners

* correct name

* incorporate onnxruntime into linux pipeline

* add missing python installation

* install build dependencies

* add path

* rm unused

* mv stage

* correct dir

* use 16-core for onnxruntime job

* rm obsolete

* rm logs

* rm unnecessary step

* rm unnecessary dir creation
2023-10-02 21:45:17 +04:00
Ilya Lavrenov 95e3096684 Added build on RedHat system to build & test RPM packages (#20134)
* Added GHA workflow for RPM packages

* Avoid rebuild for RPM / Debian packages

* Removed conditional include headers

* try only post-build

* Beautification

* Fixed testdata generation for mulit-config generators
2023-10-01 23:23:06 +04:00
Andrey Babushkin 201403ecd0 More RAM for 4 core AKS runner (#20138) 2023-09-29 15:00:52 +01:00
Mikhail RyzhovandIlya Lavrenov f85a276782 [GHA] Azure pip cache (#20029)
* switched PyTorch_Models

* fixed root issue

* upgrade pip

* set bash environments

* install pip deps

* added git installation

* added g++ deps

* added python-dev package

* get particular python-dev package

* fixed package name

* removed python-dev

* cython dep

* debug

* fixed inlude path

* test cache

* set home dir

* changed disk space calculation

* crosspipeline pip cache

* added tag for source builded deps

* immutable deps

* use commit id instead of tag

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* fixed logs upload condition

* removed pip upgrade

* changed  detectotron version

* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* changed wheel installation way

* reset onednn

* added cleanup workload

* cleanup test

* fixed reqs install

* test cache depending on pip version

* syntax fix

* env overwriting test

* test env output

* fixed set env step

* move pip cahc initialization to step

* changed pip ver regexp

* set custom pip cahce for each step

* cleanup code and enabled test cleanup job

* test cleanup 2

* speedup removal

* check existed dir

* Enabled cache for samples job

* removed debug job

* changed way how to get pip ver

* improved pip version extration

* revert omz

* switched PyTorch_Models

* fixed root issue

* upgrade pip

* set bash environments

* install pip deps

* added git installation

* added g++ deps

* added python-dev package

* get particular python-dev package

* fixed package name

* removed python-dev

* cython dep

* debug

* fixed inlude path

* test cache

* set home dir

* changed disk space calculation

* crosspipeline pip cache

* added tag for source builded deps

* immutable deps

* use commit id instead of tag

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* fixed logs upload condition

* removed pip upgrade

* changed  detectotron version

* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* changed wheel installation way

* added cleanup workload

* reset onednn

* cleanup test

* fixed reqs install

* test cache depending on pip version

* syntax fix

* env overwriting test

* test env output

* fixed set env step

* move pip cahc initialization to step

* changed pip ver regexp

* set custom pip cahce for each step

* cleanup code and enabled test cleanup job

* test cleanup 2

* speedup removal

* check existed dir

* Enabled cache for samples job

* removed debug job

* changed way how to get pip ver

* improved pip version extration

* revert omz

* review fixes

* remove  cache files using atime

* mtime->atime

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-28 22:21:32 +04:00
Mikhail Ryzhov d2ba528993 switched to 8 core runner (#20120) 2023-09-28 15:42:55 +04:00
Roman KazantsevandIlya Lavrenov 7761fc754c [Hub Tests] Move TF Hub tests to AKS runners (#20049)
* [Hub Tests] Move Hub tests to self-host runners

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Not all directories possible to clean up

* Move Hub models tests to AKS nodes

* Add install actions python setup

* Add ca-certificate deps to install

* Fix bug for PT models

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Update .github/workflows/linux.yml

* Revert changes for PT models tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Install correct version of OV

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-28 09:10:39 +00:00
Ilya Lavrenov ce7366bc90 Enabled Android arm64 GHA in precommit (#20094) 2023-09-28 01:15:36 +04:00
Ilya Lavrenov 132bada331 Enable PDPD tests build (#20078)
* Fixed comments for linux-riscv64 GHA workflow

* Try to enable PDPD tests back
2023-09-27 18:03:02 +04:00
Ilya Lavrenov a6e7bac962 Added RISC-V Conan build (#20064) 2023-09-27 12:24:20 +04:00
Ilya LavrenovandOleg Pipikin 8349849e1c Use FindPython3.cmake (#19847)
* Use FindPython3.cmake

* Fixed compilation on macOS 14 with new core development tools

* Try to use Python3_SOABI instead of PYTHON_MODULE_EXTENSION

* Use Development.Module

* Keep specifying only Python3_EXECUTABLE

* Print PYTHON_MODULE_EXTENSION

* Added check for minimal cmake version for python API

* Returned Python3_INCLUDE_DIR for cross-compilation case

* Try to allow cmake older than 3.18

* Use build python interpreter to check cython dependency

* revert changes in .ci/openvino-onnx/Dockerfile

* removed unused code

* Fixed issue with variables scope

* Experiment: remove include dirs

* Corrected docs

* Use pybind11 function to set extension

* Revert "Experiment: remove include dirs"

This reverts commit 6f7f90211c.

* Refactor ConvolutionBackpropDataLayerTest, ConvolutionLayerTest, DeformableConvolutionLayerTest (#19810)

* Refactor ConvolutionBackpropDataLayerTest

* Refactor ConvolutionLayerTest

* Refactor DeformableConvolutionLayerTest

* Apply comments

* Apply comments

* Fix

* Updated minimum cmake version for Windows

* Simplified check

* Removed useless message status

* Use puiblic option

---------

Co-authored-by: Oleg Pipikin <oleg.pipikin@intel.com>
2023-09-26 20:57:29 +02:00
Mikhail Ryzhov 6f55feb592 [GHA] concurrency fix (#20040)
* fixed cancelation issue in post-commits

* hardcoded os suffix

* added comments

* Update .github/workflows/linux.yml

* improved condition to support release branches
2023-09-26 17:35:23 +02:00
Ilya Lavrenov 5616c26d19 Debian packages on GHA (#20033)
* Refactored Linix GHA pipeline

* Move ONNX tests to Unit

* Install tests together with openvino

* Added checks for GNA usage in docs python snippets

* Install openssl for working pip

* Disabled onnx_dyn_shapes_expand_1_dyn_shape ONNX test

* exclude dyn shapes from onnx

* Migrated samples tests

* Fixed ONNX tests

* caches for PT tests dependencies

* Build Contrib separately from main OpenVINO

* More fixes

* Added python install for samples stage

* Installed manifests for ONNX FE tests

* Try to avoid libgl1 dependency in tests

* Clean-up

* Fixed issue with manifests in ONNX tests

* Try to build debian packages in GHA

* Fixed debian packages build for multi-config generators
2023-09-26 01:54:41 +04:00
Ilya Lavrenov 85145cd60c Refactored Linix GHA pipeline (#20021)
* Refactored Linix GHA pipeline

* Move ONNX tests to Unit

* Install tests together with openvino

* Added checks for GNA usage in docs python snippets

* Install openssl for working pip

* Disabled onnx_dyn_shapes_expand_1_dyn_shape ONNX test

* exclude dyn shapes from onnx

* Migrated samples tests

* Fixed ONNX tests

* caches for PT tests dependencies

* Build Contrib separately from main OpenVINO

* More fixes

* Added python install for samples stage

* Installed manifests for ONNX FE tests

* Try to avoid libgl1 dependency in tests

* Clean-up

* Fixed issue with manifests in ONNX tests
2023-09-25 17:00:30 +04:00
Andrey BabushkinandIlya Lavrenov 3e82849f3c [workflows/linux] Switch to self-hosted runners in Azure Kubernetes Service (#19183)
* [workflows/liux] Trying AKS runners

* Remove sudo usages

* Fix repositories path

* Well, adding debug output

* execution bit?

* more debug output

* using bash...

* We should use shell syntax for env variables in 'run' sections

* again, may be we should use bash...

* fix cloning path for openvino repo

* more debug output

* Trying to populate WORKSPACE var in other way

* Trying different WORKSPACE

* export ALL variables for samples tests

* Trying to put openvino build into correct directory

* Replace more occurences of BUILD_DIR...

* Use shell expansion instead of Actions syntax in run steps

* Skip unit test failures

* Oops, there's no pytest for MO unit tests

* Oops, typo

* Fix LAYER_TESTS_INSTALL_DIR variable expansion

* Fix LAYER_TESTS_INSTALL_DIR for new stages

* Replace all the varibles

* Comment out CCACHE_DIR

I want to test worst-case scenario

* Comment setup ccache step

* Revert "Comment out CCACHE_DIR"

This reverts commit 046663a9f1.

* Just checking something

* Update with new stages from master

* One more stage to fix

* Fix INSTALL_DIR again (new stages were merged to master?)

* Remove concurrency limit (for test purposes)

* Trigger one more pipeline

* Disable concurrency settings

* Trigger another build

* Disable ccache (for testing purposes)

* trigger another build to measure duration without ccache

* And one more test commit

* Return back ccache

* Testing new image

* Enable concurrency back

* Using new image

* And another image

* Trying build on the clean image

* Install git

Upstream ubuntu image doesn't have git

* Oops, forgot apt-get update

* Upstream Ubuntu image, but using ACR cache

* Remove debug output

* Use Ubuntu image from ACR cache for the rest of the stages

* Display version of ccache

* Swith to ubuntu 20 temporarily (I hope)

* Set CCACHE_TEMP_DIR outside of shared space

* Revert "Swith to ubuntu 20 temporarily (I hope)"

This reverts commit 2e53109d83.

* trying ccche nohardlink option

* Trying to disable ccache file cloning

* fix CCACHE_TEMPDIR

* Install git to Python unit tests stage

* Install libsnappy-dev as tests require it

* Install python to test stage

* Fix env vars syntax in few places

* Update docker image name

* Increase timeout for CPU tests

* Debug output - trying to find out what's wrong with test reports

* Change file name in debug-output 'find' command

* let's try shell syntax for upload artifact action...

It most likely won't work but I see strange output in the logs:
Error: No files were found with the provided path: /__w/openvino/openvino/install/tests/TEST*.xml
/runner/_work/openvino/openvino/install/tests/logs/failed/*.log
/runner/_work/openvino/openvino/install/tests/logs/crashed/*.log
/runner/_work/openvino/openvino/install/tests/logs/hanged/*.log
/runner/_work/openvino/openvino/install/tests/logs/interapted/*.log
/runner/_work/openvino/openvino/install/tests/logs/disabled_tests.log. No
artifacts will be uploaded.

So the first path is translated to the path inside the container
correctly and the rest are not O_o

* Revert "let's try shell syntax for upload artifact action..."

This reverts commit eb19b4f319.

* Leave just disabled_tests.log (as it is the only one present)

* Use my own directory instead of github.workspace

Inside-container path translation doesn't work for upload-artifact
actions (it works only for the first path, but not for the rest)

* Revert "Leave just disabled_tests.log (as it is the only one present)"

This reverts commit 4321827880.

* Okay, let's try hardcoded workspace path...

* Okay, path should be inside "official" workspace. Hardcode it

* Missed some variables, replace github.workspace to hard-coded value

* Remove debug output 'find' command

* Remove old-style cache setup

* Clean ccache stats after cmake

* Change docker image to the one with non-root user

* Oops, switch to Ubuntu 20

* Playing with concurrency group name

* Oops, forgot sudo for ninja installation

* Revert "Oops, forgot sudo for ninja installation"

This reverts commit a7e1730279.

* Revert "Oops, switch to Ubuntu 20"

This reverts commit 19fe75f4af.

* Revert "Change docker image to the one with non-root user"

This reverts commit 553116492d.

* Use Ubuntu 20 DockerHub image

* Trying to force apt-get packages not to wait for user input

* Make DEBIAN_FRONTED for all stages

* Update reason of skipped MO unit test

* Add DEBIAN_FRONTED to all jobs

* Fix environment variables expansion in newly-added stages

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Fix review comments

* More review comment fixes

* Remove DEBIAN_FRONTEND from Python Models job

* "Get tools versions" step is absent on master

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-23 13:02:28 +04:00
Maxim Vafin 02f5b7a7e3 [PT FE] Add huggingface hub tests (#19858)
* [PT FE] Add huggingface hub tests

* Update requirements.txt

* natten can't be installed

* Remove librosa

* Add xfail and skip marks

* Remove t5

* Free up space

* Apply suggestions from code review

* Report free space

* Clean pip cache

* Temporarily disable det2 models

* More du info

* Remove tmp info

* More du stats

* Fix du report

* Optimize du

* Ignore error

* Finalize changes

* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-21 17:30:17 +02:00
Mikhail Ryzhov 10dc2d8b9b [GHA] Improvement of test execution time cache (#19881)
* renamed cache

* disabled PR cache

* corrected save condition

* removed id

* fixed path in save cache action

* corrected if condition
2023-09-18 19:29:01 +04:00
Maxim VafinandRoman Kazantsev a4cbac3dee [PT FE] Add tests for detectron2 models (#19888)
* [PT FE] Add tests for detectron2 models

* Fix names of tests

* Apply suggestions from code review

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Create secondary requirements file

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-09-18 13:40:40 +02:00
Ilya Lavrenov 0b8237f508 Removed testdata repo usage (#19890) 2023-09-18 06:59:56 +04:00
2bf8d910f6 [Docs][PyOV] update python snippets (#19367)
* [Docs][PyOV] update python snippets

* first snippet

* Fix samples debug

* Fix linter

* part1

* Fix speech sample

* update model state snippet

* add serialize

* add temp dir

* CPU snippets update (#134)

* snippets CPU 1/6

* snippets CPU 2/6

* snippets CPU 3/6

* snippets CPU 4/6

* snippets CPU 5/6

* snippets CPU 6/6

* make  module TODO: REMEMBER ABOUT EXPORTING PYTONPATH ON CIs ETC

* Add static model creation in snippets for CPU

* export_comp_model done

* leftovers

* apply comments

* apply comments -- properties

* small fixes

* rempve debug info

* return IENetwork instead of Function

* apply comments

* revert precision change in common snippets

* update opset

* [PyOV] Edit docs for the rest of plugins (#136)

* modify main.py

* GNA snippets

* GPU snippets

* AUTO snippets

* MULTI snippets

* HETERO snippets

* Added properties

* update gna

* more samples

* Update docs/OV_Runtime_UG/model_state_intro.md

* Update docs/OV_Runtime_UG/model_state_intro.md

* attempt1 fix ci

* new approach to test

* temporary remove some files from run

* revert cmake changes

* fix ci

* fix snippet

* fix py_exclusive snippet

* fix preprocessing snippet

* clean-up main

* remove numpy installation in gha

* check for GPU

* add logger

* iexclude main

* main update

* temp

* Temp2

* Temp2

* temp

* Revert temp

* add property execution devices

* hide output from samples

---------

Co-authored-by: p-wysocki <przemyslaw.wysocki@intel.com>
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-09-13 21:05:24 +02:00
Mikhail RyzhovandRoman Kazantsev 0234357869 [GHA] Changed ubuntu build runner to 20.04 (#19790)
* changed OS build runner to 20.04

* fixed PR

* changed version for test jobs

* Updated title

* Update .github/workflows/linux.yml

* Update linux.yml for PT models

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-09-13 18:46:50 +04:00
Nadezhda Ageeva 3454139931 [HETERO] Hetero refactor subgraph collector. Adds unit tests. (#19656)
* [HETERO] Refactor subgraph collector. Add unit tests.

* [HETERO] Adds ov_hetero_unit_tests to azure

* [HETERO] Adds ov_hetero_unit_tests to github workflows

* Small updates

* Set CI_BUILD_NUMBER

* Fix cmake

* Fix cpplint

* STATIC -> OBJECT

* Fix .github/workflows/linux.yml

* Fix cmake

* Fix .github/workflows/linux_debian.yml

* Fix win build: separate version file
2023-09-13 12:17:32 +00:00
Maxim Vafin 3c762240f3 [PT FE] Add tests for torchvision models (#19702)
* [PT FE] Add tests for torchvision models

* Update tests/model_hub_tests/torch_tests/requirements.txt

* Apply review comments

* Clean tmp directory and make this separate job

* Update .github/workflows/linux.yml

* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py
2023-09-13 15:24:09 +04:00
Roman Kazantsev d1a8c8f914 [TF Hub] Set seed for input data generation and fix integer input data (#19765)
* [TF Hub] Set seed for input data generation and fix integer input data

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Clean-up workflow

* Update precommit model scope

* Avoid legacy generator

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-13 00:30:39 +04:00
Roman Kazantsev fc5696321a [TF Hub][GA] Separate Workflow for TF Hub Tests Validation (#19754)
* [TF Hub][GA] Use Ubuntu 20.04 for TensorFlow Hub Models validation and Separate job

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply review comments: ubuntu-20.04 use and install deps

* Simplify validation pipeline for TF Hub Models

* Remove extra deps installations

* Remove not needed code

* Try to fix

* Try 22.04

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-12 01:05:50 +04:00
Andrey Kashchikhin 3e95e48309 [CI] [GHA] Remove unnecessary steps and cmake options, use proper # of CPU cores for ARM64 pipeline (#19746)
* address comments

* rm

* use machine's # of cpu core
2023-09-11 22:37:42 +04:00
dependabot[bot] dd05c42951 Bump SimenB/github-actions-cpu-cores from 1 to 2 (#19685)
Bumps [SimenB/github-actions-cpu-cores](https://github.com/simenb/github-actions-cpu-cores) from 1 to 2.
- [Release notes](https://github.com/simenb/github-actions-cpu-cores/releases)
- [Commits](https://github.com/simenb/github-actions-cpu-cores/compare/v1...v2)

---
updated-dependencies:
- dependency-name: SimenB/github-actions-cpu-cores
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-08 11:56:18 +04:00
Roman KazantsevandAndrey Kashchikhin 63a6d4c41e [TF Hub][GA] Set correct scheduler and model scope for regular validation (#19658)
* [TF Hub][GA] Set correct scheduler and model scope for regular validation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove empty line

* Update .github/workflows/linux.yml

Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>

* Correct a path to output html report

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>
2023-09-06 22:51:31 +02:00
Andrey KashchikhinandMikhail Ryzhov 5644ca40f6 [GA] ccache: specify key (#19519)
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
2023-09-06 15:45:00 +00:00
Roman Kazantsev 4f7ac430fc [TF Hub][TF FE][GA] Establish regular validation for all TF Hub models (#19649)
* [TF Hub][TF FE] Establish regular validation for all TF Hub models

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Correct names of reports

* Simplify configuration

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-06 17:02:59 +02:00
dependabot[bot] be23ac7c26 Bump actions/checkout from 3 to 4 (#19602)
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v3...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-06 07:29:13 +04:00
Mikhail RyzhovandAndrey Kashchikhin bf5690fa7d [GA] Parallel tests (#18773)
* test job

* added script to the test package

* test call fix

* switched test to large runner

* Added option to split tests by suites

* extended logs

* enabled test cache

* fixed workload

* optimized splitting mode

* excluded disabled suites

* temroary removed parallel logs

* added failed logs

* fixed empty name in suites

* test on 4 cores

* make step optional

* fixed param

* test

* grouping suites

* set suite arg

* increase test timeout

* test commit

* test pip deps

* include requirements.txt to the test package

* fixed deps step order

* fixed test counter

* fixed smart filter for suites

* clean up

* disabled repeat failed tests

* review comments

* use runtime execution time for skipped tests

* removed disabled suites

* reduced command lines

* enabled tests results

* fixed typo

* removed unused argument pp

* Log improvements

* merge cached and runtime filters

* fixed order

* fixed init list error

* fixed cache writing

* enable windows pipeline

* changed runner for windows

* optimized balancing using heap

* Fixed test counter

* fixed windows pipeline

* extended logging

* changed pipelines

* added logs on Windows

* fixed pipelines

* debug

* removed os specific code

* fixed "#"

* fixed test results

* fixed win pipeline

* cleanup debug

* rebase fixes

* windows pip requirements

* aligned run_conformance.py

* Apply suggestions from code review

Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>

* reverted windows changes

* reverted build runner

* fixed review comments

* minor review fixes

* make help func static

* renamed test runner

* fixed merge issue

* removed unused log

* reduced command line

* fixed issue fith conformance run

* fixed typo

* set testa  as default split unit

* fixed tasks queue  with time -1

* fixed test result caculation

* reverted wrong fix

* reverted changes

* set time limitation

* reverted unused change

* fix win command lines

* reuse env variables in pipeline

* fixed install files permissions

* fixed pipeline syntax

* reset validation schema

* fixed env names

* reverted initial setting of env

* increased test runner

* fixed pathes

* reuse env path

* reset validation schema

* Revert "reuse env path"

This reverts commit 97422ac595.

* Revert "increased test runner"

This reverts commit 010aa31641.

* revert command line reduction

* made if condition clearer

---------

Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>
2023-09-05 14:23:17 +00:00
Roman Kazantsev 1d0d00bf22 [TF Hub][GitHub Actions][TF FE] Introduce TF Hub Models Validation in GitHub Actions (#19368) 2023-08-23 18:40:31 +00:00
Pavel Esir 90f6500871 [tests] switch layer tests to FP16 on pre-commit (#19090)
* switch to FP16 on layer tests on precommit; add Pytorch layer tests for precision sensitive subgraph

* remove redundant changes

* moved precision sensitive tests into test_mo_convert_pytorch.py

* remove redundant dumping

* skip layer tests with chaotic output

* add copy() to avoid side effects
2023-08-21 16:03:47 +04:00
Roman Kazantsev 5539d052b0 [JAX][TF Hub][TF FE] Introduce JAX layer tests and support of XLA operations (#19269)
* [JAX][TF Hub][TF FE] Introduce JAX layer tests and support of XLA operations

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix JAX layer tests infa

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Extend run for JAX layer tests

* Use ovc convert_model

* Fix translator and extend layer test cases

* Exclude jax testing on Windows

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-08-21 16:01:48 +04:00
62fa09a181 [PyOV] Add torchvision to OpenVINO preprocessing converter (#17934)
* Some progress

* refactoring

* Refactor tests, run black

* Refactor, flake

* Minor change

* Add support for num_output_channels

* WIP

* Add dependency

* Almost done

* Fix flake

* Add MO convert

* Minor changes

* Add interpolation mode tests

* Add requirements for preprocessing

* Fix linter

* Update tests

* Fix type error

* Introduce typing

* Rename module

* Code review

* Update src/bindings/python/src/openvino/preprocess/torchvision/torchvision_preprocessing.py

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>

* Update src/bindings/python/src/openvino/preprocess/torchvision/preprocess_converter.py

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>

* CR changes

* Fix mypy

* Minor change

* Minor change

* Fix flake

* typing change

* Update types

* Add tools to pythonpath

* Add MO reqs

* Minor change

* Fix PT FE issue

* bugfix

* Use absolute path

* Debug

* Debug req path

* Change MO to OVC

* Enable PT FE building

* Debug

* Skip some tests on ARM

* ADd ticket numbers

* Some progress

* refactoring

* Refactor tests, run black

* Refactor, flake

* Minor change

* Add support for num_output_channels

* WIP

* Add dependency

* Almost done

* Fix flake

* Add MO convert

* Minor changes

* Add interpolation mode tests

* Add requirements for preprocessing

* Fix linter

* Update tests

* Fix type error

* Introduce typing

* Rename module

* Code review

* Update src/bindings/python/src/openvino/preprocess/torchvision/torchvision_preprocessing.py

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>

* Update src/bindings/python/src/openvino/preprocess/torchvision/preprocess_converter.py

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>

* CR changes

* Fix mypy

* Minor change

* Minor change

* Fix flake

* typing change

* Update types

* Add tools to pythonpath

* Add MO reqs

* Minor change

* Fix PT FE issue

* bugfix

* Use absolute path

* Debug

* Debug req path

* Change MO to OVC

* Enable PT FE building

* Debug

* Skip some tests on ARM

* ADd ticket numbers

* Update test val

* Change pytest version

* Modify GH workflow

* Update cmake

* Update cmake

* fix cmake

* Skip tests on ARM

* Fix after OVC MO changes

* Limit torch requirements

* Raise allowed diff in test

* Debug - remove new bindings

* Debug - remove interpolation modes

* Debug - change test

* Cleanup

* Minor change

* Disable on ARM and Py<38

* Update ARM marker

* limit torchvision for ARM

---------

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: gklodkox <gracjanx.klodkowski@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-08-02 16:44:30 +04:00
Anastasia Kuporosova 6dd88d76d3 [PyOV] try to run add_extension_test (#18900)
* [PyOV] try to run add_extension_test

* rename flag

* try to run extension test on linux

* run on linux
2023-08-02 11:14:03 +04:00
Alexandra Sidorova 4bef661f7a [Snippets][CI] Added ov_snippets_func_tests validation to Azure CI (#18844)
* [Snippets][CI] Added Snippets Func Tests to Azure Windows

* [Snippets][CI] Added Snippets Func Tests to Azure Linux

* [Snippets][CI] Added Snippets Func Tests to GitHib workflow Linux

* [Snippets][CI] Added Snippets Func Tests to GitHib workflow Windows

* [Snippets][CI] Added Snippets Func Tests to Azure Linux Debian
2023-07-28 15:23:10 +00:00
Nadezhda Ageeva a930c74143 [HETERO] Fix problem with ov_hetero_unit_tests (#18794)
* [HETERO] Fix problem with ov_hetero_unit_tests

* FIX 2

* Rename ov_hetero_unit_tests -> ov_hetero_func_tests
2023-07-26 16:12:22 +04:00
Andrey Kashchikhin 7f94bd4c12 [CI] [GHA] Cancel in-progress Linux & Win pipelines in favour of that of on the latest commit in PRs (#18548)
* cancel in-progress PR pipelines in favour of the latest

* add unique vals to the concurrency

* sample change

* revert
2023-07-14 14:00:21 +04:00
Andrey Kashchikhin f1faa5f5a3 add path-ignore (#18533) 2023-07-14 00:47:06 +04:00
Andrey Kashchikhin f06e0816f7 add missing stages (#18480) 2023-07-11 21:05:55 +04:00
Andrey Kashchikhin c738899408 [CI] Introduce Linux pipeline in GitHub Actions (#18355)
* skip validation, always include cmake

* rm unconditional inclusion of zlib

* always include zlib

* correct path for builtin_extensions

* find builtin extensions recursively

* include test_utils always

* add logs for build_samples

* skip tests with dir accessing

* remove platform specification for samples build

* do not pkgconfig on win, use cmake generic on linux for samples

* rm make

* fix num_threads

* use bare numbers

* skip failing

* skip test_lrn_basic

* find zlib

* print error of downloading

* add linux pipeline

* do not save cache from PRs; add skipif only in GHA

* rm caching

* evaluate against a string

* do not include test_utils to the install dir
2023-07-11 11:54:33 +04:00