Commit Graph

101 Commits

Author SHA1 Message Date
Stefania Hergane
24f8c4105e [EISW-89824] [master] Rename VPUX to NPU (#19004)
* Change `VPUX`/`VPU` occurrences to `NPU`

* Switch `HARDWARE_AWARE_IGNORED_PATTERNS` VPU to NPU

* Rename `MYRIAD plugin`

* Rename vpu_patterns to npu_patterns in tools/pot

* Rename vpu.json to npu.json in tools/pot

* Rename restrict_for_vpu to restrict_for_npu in tools/pot

* Change keembayOptimalBatchNum to npuOptimalBatchNum

---------

Co-authored-by: Dan <mircea-aurelian.dan@intel.com>
2023-08-10 00:20:07 +04:00
Mircea-Aurelian Dan
5397e299fd [EISW-81712] Rename VPUX to VPU in openvino codebase (#17949)
* Change `VPUX` occurrences to `VPU`

* Switch `VPU` library name

* Change remaining references to `VPUX`
2023-07-19 15:55:24 +04:00
OK
f2017e8c2e Validation: Test AUTO plugin timetests (#17508)
* Validation: Test AUTO plugin

* config

* Add debug logs against AUTO

* Iteration

* iteration

* iteration

* iteration

* iter

* iteration

* iteration

* iteration

* iteration

---------

Co-authored-by: Daria Ilina <daria.ilina@intel.com>
2023-05-31 15:38:57 +02:00
Przemyslaw Wysocki
69d6ef33fc [PyOV] Align and bump numpy, further tidy up requirements (#16652)
* Align numpy

* Simplify the rest

* Minor change

* Minor change

* Restart CI

* Update paddle reqs
2023-04-12 13:14:38 +04:00
Bogdan Pereanu
73ab0dd065 Fixing run_timest python script for input and output precision (#16661)
* Fixing run_timest python script for input and output precision

* Update code according to the PR review

* Update run_timetest according to the last review

* Add input_precision and output_precision to test_timetest as well

* Set input/output precision per model
2023-04-05 12:16:27 +04:00
Ilya Churaev
1b9bd61767 Added constructor from string for element Type (#16643)
* Added constructor from string for element Type

* Fixed code style

* Removed WA for tests
2023-03-31 07:24:32 +00:00
Bogdan Pereanu
5eea99d96c Update timetest tool to support ip and op params config (#15916)
* User can set input and output precision for timetest tool

* Update run_timetest.py with the ip and op options as well

* Use only one getType function

* Add extra line at the end of the file

* Remove unused parameters

* Update comment accordingly

---------

Co-authored-by: Vitaliy Urusovskij <vitaliy.urusovskij@intel.com>
2023-03-30 11:27:51 +04:00
Przemyslaw Wysocki
591c3e61c5 [PyOV] Simplify requirement files (#15343)
* Partial progress

* Finish v1

* Cleanup

* Remove useless files

* Fix path to pdpd

* Fix onnx path

* Minor change

* Rework MO

* Minor change

* Remove some costraints

* Add MO constraints

* Update gitignore for MO

* Minor change

* Apply tech sync discussion

* Cleanup

* CR comment

* Debug ONNX FE

* simplify ONNX FE

* Update cmake

* Hardcode ONNX requirement

* Add dependency resolver to cmake

* Add constraints for openvino/tests

* Add missing pytest-html

* Fix -c path

* Revert debug changes to path

* Add cmake to copy constraints.txt

* Update dependabot

* Remove slash

* Remove cmake

* Debug prints

* Minor changes

* Move reqs check to separate file

* Add requirements parser to benchmark_tool

* Fix smoke tests constraints

* Minor fixes

* Minor change

* My fixes were apparently wrong

* Debug - self.executable_path

* Debug - add singledispatch to tests and tools

* Debug - print IE_APP_PATHs

* Revert "Debug - print IE_APP_PATHs"

This reverts commit 67ccb6d3f5.

* Revert "Debug - add singledispatch to tests and tools"

This reverts commit 3b945931e2.

* Revert "Debug - self.executable_path"

This reverts commit 3aa724eff6.

* update dependabot

* update dependabot

* Skip benchmark_app tests

* Use CMAKE_CURRENT_BINARY_DIR in cmake

* Remove debug prints

* minor change

---------

Signed-off-by: p-wysocki <przemyslaw.wysocki@intel.com>
2023-03-29 14:27:27 +04:00
Xuejun Zhai
9b97235902 Xuejun/remove api in ov any (#15667)
* [Remove APIs] remove ov::any api  &

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any api

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove interfaces in ov::any  Base* operator->() & const Base* operator->()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any interfaces Base* get() & const Base* get()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any interfaces call(const Any& any) & dynamic_pointer_cast(const ::ov::Any& any) & static_pointer_cast(const ::ov::Any& any)

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issues in ov::any

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix review issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] clear code

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix review issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* Fix variant error

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
Signed-off-by: xuejun <xuejun.zhai@intel.com>
2023-03-06 10:24:08 +04:00
Albert Angles
711e2cbab0 enable first_inference_latency (first_inference+time_to_inference) (#14829)
* add time_to_first_inference_result KPI as sum of inf latency values

* append unit time after the value

tested locally, worked

* Revert "append unit time after the value"

This reverts commit 428b8cafdc.

* remove metric

* revert 42dd271c3b

* enable { SCOPED_TIMER(first_inference_latency); }

* enable first_inference_latency

tested locally, it works

* remove trailing whitespace

Co-authored-by: Daria Ilina <daria.krupnova@intel.com>
2023-01-23 19:48:07 +03:00
Ilya Churaev
0c9abf43a9 Updated copyright headers (#15124)
* Updated copyright headers

* Revert "Fixed linker warnings in docs snippets on Windows (#15119)"

This reverts commit 372699ec49.
2023-01-16 11:02:17 +04:00
Przemyslaw Wysocki
cfac7e4ee4 [PyOV] Update requirements for Python 3.11 (#15072)
* Update reqs

* update license whitelist

* Revert gast

* Bump distro package
2023-01-13 14:49:55 +04:00
Smirnova Maria
5cf6ceaf83 Fix db push for stresstest and timetests (#13964)
* Fix db push

* Fix log info for new data

* Check if file exists

* Remove _id field

* Add error message print
2022-11-17 12:52:21 +01:00
Przemyslaw Wysocki
79d92b7d8d [PyOV] Bump pyyaml (#14010) 2022-11-16 13:10:20 +03:00
Smirnova Maria
8f97ee55fc Modify time tests so that data can be pushed to OVVP (#13636)
* Set db_api_handler for pushing to new database in timetests

* Change function of pushing to db.

Co-authored-by: Daria Ilina <daria.krupnova@intel.com>
2022-11-10 15:17:39 +01:00
Przemyslaw Wysocki
d2871fd52c [PyOV] Enable Python 3.10 on Azure CI (#12578)
* Fix mypy for numpy==1.21.6

* Apply CR changes

* Allow Python 3.6 for open source

* Attempt to silence mypy

* Revert to 3.6 in setup.pys

* Fix merge conflict

* Add newline

* Fix Python version assert

* Test Python 3.10 CI

* Try bumping up pybind to 2.10

* Link default python to python 3.10

* Add sudo to changing default python

* Bump python version in setupvars

* Fix exception in test

* Do the same for compatibility

* Apply same CI changes to other pipelines

* Attempt to fix arm and windows CIs

* Fix win py lib version and links?

* Try to fix CI

* Fix win python path

* Update win path

* Test disable PDPD

* Disable TF for testing CI

* Add sudo to rm

* Test linux

* Update requirements

* RM sudo

* Add debug step to CI on ARM

* build py from source on linux

* Remove debug step from ARM

* Fix err

* Fill num_proc

* Fic py installation

* Bump pdpd to 2.3.1

* Bump np vers

* Try to upgrade onnx to 1.12.0

* Revert onnx upgrade, enable frontends

* Build py shared

* Export library

* activate py env

* Bump scipy for py3.10

* Another scipy bump

* Fix Windows path, add nfs helper for mount

* Attempt to fix win_cc

* Batch of changes

* Try to fix ngraph-onnx-lin

* Install lsb-release for docker on ngraph-onnx-lin

* Link lsb_release

* Try bumping Ubuntu to 22.04

* Revert ubuntu change in dockerfile

* Refactor tests for onnx1.12

* Fix ONNX compatibility and numpy warnings

* Refactor tests for onnx1.12

* Fix ONNX compatibility and numpy warnings

* Upgrade ONNX to 1.12 in cpp

* Skip unsupported ops

* Revert "Fix ONNX compatibility and numpy warnings"

This reverts commit cd8a0e6b8e.

* Small changes

* Remove unnecessary changes

* Bump Python version in github workflows

* Fix flake error

* Another flake error

* Even more flake errors

* Xfail more tests

* Fix mypy errors

* Change onnx version in tests

* Bump ONNX in MO

* Fix onnx utils in comp

* Minor changes

* Import pathlib

* Add xfails to compatibility tests

* Skip segfaulting tests

* Fix onnx nametuple

* Fix flake

* Try to fix py3.6 onnx

* Switch to venv in windows

* Fix model importer and reqs

* Add __test__

* Debug print

* Fix flake

* Update linux.yml

* Update windows.yml

* Update linux.yml

* Update windows.yml

* Install python3.10

* Update windows.yml

* Update windows.yml

* Update windows.yml

* Update windows.yml

* Update windows.yml

* Update windows.yml

* Update windows.yml

* Update windows.yml

* Install py embedded

* Fix dir

* Fix curl

* Add complete file

* CP file

* Bump py ver

* Fix missing venv

* Try to install

* Disable venv

* Bump OMZ commit

* checkout omz

* Revert omz

* Bump omz

* Revert pybind bump

* Update .gitmodules

* Change pybind to fork

* change ssize_t to size_t

* Install bz2 for py build

* Bump omz

* Bump pandas requirement version

* Revert omz

* Install missing clang

* Bump omz

* Bump versions on fork

* Bump numpy in model zoo

* Fix clang

* Skip segfaulting pdpd test

* Skip another pdpd test

* Skip pdpd places.cpp

* Bump py ver in setupvars.bat

* Disable paddle tests

* Use int instead of str

* Fix requirements path

* Enable lin-cc

* Fixes in CI

* lin-cc and ngrpah-onnx changes

* Update num_proc

* Update ngraph-onnx

* Minor change

* Fix env var

* Change ubuntu to 20

* Get compiler on ngraph-onnx

* Add sudo to apt-get

* Add SSL

* Download ssl

* Different way of installing ssl

* Minor changes

* install zlib

* Fix env var

* Fix docker building error

* Revert changes

* Modify dockerfile

* Change pychecks python version

* Cleanup

* Add LayerNorm to expanded ONNX functions

* Revert previous commit

* Add LayerNorm to expanded ONNX functions

* Apply clang

* Move LayerNorm tests to skip_segfault

* Unskip pdpd tests

* Enable pdpd tests on linux

* Refactoring

* Remove 3.6 from reqs

* Refactoring

* Minor changes

* Minor changes

* Relax MO reqs

* Bump torch version

* relax pytest

* Specify pytest version

* Fix pytest pip conflict

* Bump pybind11 to v2.10.1 release tag

* Specify separate pytest version for py3.10

* Bump attrs

* Add py dependency

* Refactor versions

* Add venv activation to tf tests

* Fix fdupes

* Bump OMZ submodule

* Remove find and replace

* Change pybind to upstream fork

* Set pybind to proper commit

* Minor changes

* Try to fix scipy

* Updated exclude patterns for nlohmann json

* [PyOV] Fix wheel requirements for new package versions

* Specify CPU plugin versions

* Bump OMZ version

* Fix linter

* Fix linter 2

* Fix linter 3

* Disable linter

Co-authored-by: Mateusz <mateusz.mikolajczyk@intel.com>
Co-authored-by: jiwaszki <jan.iwaszkiewicz@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-11-08 11:38:39 +04:00
Przemyslaw Wysocki
1861609119 [PyOV] Fix nightly pip conflicts (#13387)
Signed-off-by: p-wysocki <przemyslaw.wysocki@intel.com>
2022-10-18 11:24:06 +02:00
Ilya Lavrenov
f4fb3aee10 Fixed documentation for tests (#13246) 2022-09-28 23:36:21 +04:00
Ilya Lavrenov
fb1faf8b2d Generate openvino.pc pkg-config file (#12779)
* Generate openvino.pc pkg-config file

* Added libva-dev as a dependency

* Fixed typo in install_build_dependencies.sh

* samples on CI

* Revert changes in samples; use pkg-config in tests

* Debug print

* Revert changes in fuzz tests

* Fixed TBB usage

* Fixed pkg-config usage for cross-compilation

* Fixed pkg_config_tbb_lib_dir

* Don't use PKG_CONFIG_EXECUTABLE unconditionally

* Fixed copy-patse

* Fixe

* Generate pkg-config file for Apple as well

* Fixes for ubuntu 22.04

* Disable apple
2022-09-05 13:40:21 +04:00
Victor Kuznetsov
21601398d6 Remove dynamism from time_tests (API 1.0) (#10193) 2022-02-09 19:15:16 +08:00
Victor Kuznetsov
857c0bd9dd [Time tests] Update reshape pipeline (use default inputs before reshape for data generation) (#10129) 2022-02-07 22:50:12 +08:00
Victor Kuznetsov
ed6bb8ab2d Update models folder for TimeTests (#10107)
* add performance hint to time infer

* upd time models
2022-02-04 11:33:15 +03:00
Victor Kuznetsov
0dd8d895a0 [Time tests] Add API 2.0 support (#9878)
* add performance hint to time infer

* init commit - add api 2 support

* change imInfo filling

* change copyright dates

* check hw positions to default

* add debug info

* fix mistake

* add check layout funcs for api2 time infer

* reformat code (2 -> 4)

* upd with reshape api2

* upd with master

* --

* fix fillTensors - set as template

* fix common_utils.cpp after merge master
2022-02-02 12:33:02 +03:00
Victor Kuznetsov
6f60a7d8f0 First time inference validation for dynamic shapes (#9671)
* add performance hint to time infer

* add reshape methods for time infer tool

* add func declarations to common_utils.h

* add check if node is static (reshape pipeline)

* changes in desc of reshape funcs

* fix logic operator

* add reshape utils.h | move parsing logic in main func

* add tests_shared_lib to CMakeLists.txt

* change fill blobs with setStaticShapesBlobs

* change delimiter
2022-01-24 16:19:03 +03:00
Alexey Suhov
a79830cb55 Update year to 2022 in copyright notice (#9755) 2022-01-19 01:07:49 +03:00
Victor Kuznetsov
e212a1ac83 [TimeTests] Disable VPU option, rename cache option (#9114)
* add performance hint to time infer

* Update time tests with options

* fix mistake in help

* update test conf with GPU models

* move ie configs from load plugin timer
2021-12-17 13:06:56 +03:00
Victor Kuznetsov
0f1c545a19 [Time tests] Change work with perf_hint (#9090)
* add performance hint to time infer

* upd_time_tests
2021-12-09 10:29:55 +03:00
Victor Kuznetsov
55f64a505a Expand time tests to cover CPU caching feature (#8938)
* add performance hint to time infer

* add options for vpu, cpu cache, perf hint

* change VPUX condition

* add perf hint verify

* upd perf hint usage. set as non required
2021-12-08 15:22:44 +03:00
Victor Kuznetsov
9fc64ea726 add performance hint to time infer (#8480) 2021-11-10 16:07:08 +03:00
Victor Kuznetsov
8a46ead91b add pytest-timeout (#8352) 2021-11-02 13:44:02 +03:00
Victor Kuznetsov
445292b079 change pr type (#8143) 2021-10-26 11:29:57 +03:00
Victor Kuznetsov
b754013aec fix work with query memory timeline (#8063)
* fix work with query memory timeline

* revert timeout changes

* upd readme

* change README.md
2021-10-25 16:51:53 +03:00
Victor Kuznetsov
6d9a7a108e Stress, Memory tests update to comply with new OMZ tools layout (#7886)
* work with omz: change hardcoded paths for memory_tests, fix paths for memcheck get_testdata.py script

* change paths to omz tools

* revert mo changes

* remove mo from arguments

* remove extra var from cmd string

* remove is_db_used check

* add timeout to proc_exec

* merge master
2021-10-13 10:42:00 +03:00
Ilya Lavrenov
44186c31e4 Fixed path to setupvars.sh ti readme (#7537) 2021-09-17 05:20:28 +03:00
Ilya Sharikov
5847b35ed2 Make time && stress tests independent from IEDeveloperPackage (#7411)
* Specify own CXX configuration for time && stress tests

* Included os_flags for build gflags

* Updated README

* Updated commands for build tests in README

* Use new cmake config
2021-09-16 12:54:41 +03:00
Alina Kladieva
fda3f5d237 [requirements] Set TF to 2.5.0 (#6620)
* [requirements] Set TF to 2.5.0

* [ngraph|paddlepaddle|requirements] Gast to 0.4.0

(required for TensorFlow 2.5)

* [ stress_tests/scripts/requirements] Upd versions

* [time_tests/test_runner/requirements] Upd versions

* [ngraph|paddle|requirements] Paddle strict major

* Gast version to 0.3.3

* Update requirements_dev.txt
2021-09-14 18:05:18 +03:00
Victor Kuznetsov
92445d4b80 add new exec with vpu compiler option (set config with MLIR compiler) (#7420) 2021-09-13 10:52:06 +03:00
Ilya Sharikov
f44369ce4e Updated requirements (#7397) 2021-09-13 08:50:23 +03:00
Victor Kuznetsov
4d377901bf Move all utils to common folder (#7303)
* move all utils to common folder

* add utils install in CMakeLists.txt

* revert plugin utils

* add log info: test

* add logging info: test

* test imports

* change imports: test

* fix file name
2021-09-07 23:02:10 +03:00
Michał Karzyński
d748f2aa99 Remove references to prototxt from documentation and docstrings (#7346) 2021-09-03 08:32:43 +03:00
Victor Kuznetsov
1f4664162a install necessary dirs for tests (#7044)
* install necessary dirs to tests

* rem RUNTIME from install step

* fix paths

* fix install paths

* fix install paths: add destination dirs

* add pandas

* fix requirements conflict - change pytest version to ~5

* remove comment from requirements.txt

* upd numpy version
2021-08-24 00:39:12 +03:00
Daria Ilina
5292de5338 Reorganize work with openvino/thirdparty (Copied from PR6744) (#6880)
* Copied PR6744

* Added CMakeLists.txt into gflags

* Return gflags into .gitmodules

* Added CMakeLists.txt into gtest

* fix: remove extra gflags and gtests from .gitmodules

* Change syntax in set gtest_targets

* Make gtest/CMakeLists.txt as in PR6744 for pre-commit experiment

* Update gtest/CMakeLists.txt

* Change version of gtest repo

* Return gtest info into .gitmodules

* Update gflags version to currently used
2021-08-11 11:33:52 +03:00
Ilya Sharikov
26c8b29b35 Added missing modules for timetests (#6896) 2021-08-03 12:19:40 +03:00
Ilya Sharikov
252483bb83 Common tests library for shared functionality (#6578) 2021-07-23 10:37:35 +03:00
Vitaliy Urusovskij
a92a737ba0 Develop installation rules for time and stress tests (#6649)
* Prepare `install` rule for time_tests

* Prepare `install` rule for stress tests
2021-07-16 16:30:20 +03:00
Ilya Lavrenov
fc7f80a34e CVS-34900: updated pugixml to v1.11.4 (#6301)
* Added pugixml as submodule

* CVS-34900: updated pugixml to v1.11.4

* Fixed link with pugixml

* USe pugixml::static

* Try to fix bug

* Removed GITHUB_PULL_REQUEST

* Replaced  OpenVINO_MAIN_SOURCE_DIR -> OpenVINO_SOURCE_DIR

* Removed some usages of IE_MAIN_SOURCE_DIR

* Use ngraph target directly
2021-07-02 11:36:31 +03:00
Vitaliy Urusovskij
31907e51e9 Fixed several issues in time_tests (#6481)
* Fixed return in `run_timetest`

* Fixed `parse_stats()` argument type notation

* Pass message from `timetest` exe to test error msg to be uploaded to DB
2021-07-01 16:37:23 +03:00
Ilya Lavrenov
07f94ea602 Minimized usage of IE_MAIN_SOURCE_DIR (#6422)
* Minimized IE_MAIN_SOURCE_DIR hardcode

* Used COMPILE_OPTIONS instead of COMPILE_FLAGS

* Fixed compilation

* Enabled NGRAPH_DYNAMIC_COMPONENTS_ENABLE by default

* Fixes

* Moved GNA related file

* Fixed backend compilation

* Fixed Windows for ngraph

* Fixed <root>/tests build

* More updates

* Fixed scripts install

* Fixed Windows

* Fixed Windows
2021-06-30 18:15:41 +03:00
Victor Kuznetsov
a1eb5b1fd5 Change target branch field (fix null) (#6433) 2021-06-30 12:53:17 +03:00
Ilya Lavrenov
2f432980a0 Moved gflags, preprocessing dependencies to root (#6309) 2021-06-23 09:53:18 +03:00