Commit Graph

344 Commits

Author SHA1 Message Date
Luo Cheng
0a7d1d770f [CPU] Optimize ScaledDotProductAttention performance (#21412) 2023-12-07 00:24:49 +01:00
Roman Kazantsev
abfbdd1b96 [Core] Support String Tensors (#21244)
* [Core] Support String Tensors

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add String Constant implementation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue in tests

* Add cast_vector for Constant of ov::string type

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue: ambiguous type in GNA

* Fix ambiguous build issue in GNA tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix code-style

* Fix code-style

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix ambiguous build issue in GNA tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix ambiguous build issue in TF FE tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update openvino.style for naming convention check

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix compilation error in core unit tests - need typename

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add test for new element_type

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix code-style

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update src/inference/src/dev/make_tensor.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Add support of string Tensors for Constant

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix copying string tensor value for Constant

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Complete template methods for Constant

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Improve performance for initialization and destruction of string Tensor for set_shape

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add check for string value in test

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove unused variable

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update src/inference/src/dev/make_tensor.cpp

* Fix copy_to for ITensor of string type and add tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add tests for Constant of string type and serialization

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Use memset_allocation to switch initialization

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add additional documentation for host_ptr

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update src/core/src/op/constant.cpp

* Use OPENVINO_THROW

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update src/core/include/openvino/op/constant.hpp

* Update src/core/include/openvino/op/constant.hpp

Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>

* Apply code-review feedback: use string_size

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply code-review feedback

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Recover evaluate impl for non-string type

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix code for creating of string constant for legacy non HostTensor tensor

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply code-review feedback: simplify copy_to method

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Use StringAlignedBuffer to store string Constant values

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove not needed methods in StringAlignedBuffer

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Refactor set_shape method

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
2023-12-01 11:17:53 +04:00
Georgy Krivoruchko
a8e9989383 [CMAKE] Keep frontend's folder structure for Visual Studio (#21222) 2023-11-24 13:16:10 +04:00
Ilya Lavrenov
3fbef0d498 Fixed install rules for case when only ONNX FE is enabled (#21114) 2023-11-16 16:26:05 +04:00
Ilya Lavrenov
aee4865b2f Try to fix code snippets on macOS (#21111) 2023-11-16 13:05:16 +04:00
Ilya Lavrenov
68e6484ecb Fixed version detection without git (#20951) 2023-11-08 14:30:15 +01:00
Ilya Lavrenov
b13cb8ce12 Make RPM packages compatible with wide range of RHEL systems (#20762) 2023-10-31 10:25:35 +04:00
Ilya Lavrenov
0934d2a7dd Moved all tensorflow proto files to a folder with ov prefix to avoid ODR (#20636)
conflicts
2023-10-22 01:02:32 +04:00
Ilya Lavrenov
ad9a146f94 Enabled LC_RPATH for brew (#20587) 2023-10-19 11:44:38 +04:00
Ilya Lavrenov
e812831346 Added ctest labels for FE tests only if FW is found (#20483) 2023-10-16 16:29:37 +04:00
Ilya Lavrenov
56d74a82cb Relocatable developer package (#20327)
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU

* Initial relocatable OpenVINO Developer package

* Improvements

* Try to fix

* improvements

* Export a lot of headers

* Removed NVIDIA pipeline; make it to be a job

* Fixes

* Fixes 2

* Try ilya-lavrenov repo

* Clean-up

* More imrpovements

* Even more improvements

* Override export, install

* Override export, install

* Disable pythonwheel generation for relocatable OV dev package

* Fixed issues with versions

* Fixed android build

* Fixed android build

* Fixed NPU build

* Update src/bindings/python/CMakeLists.txt
2023-10-12 22:59:04 +00:00
Ilya Lavrenov
e30f75bb4d Rpath story (#20297) 2023-10-10 06:27:26 +02:00
Ilya Lavrenov
ead4b8a0ec Moved cmake functions, variables to API 2.0 naming style (#20281)
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU
2023-10-09 22:30:32 +04:00
Przemyslaw Wysocki
9fe6be21ea [PyOV] Drop Python 3.7 in OpenVINO Runtime (#19534)
* Drop 37

* Fix linter

* Minor change

* Minor changes

* update add_lib_path

* Minor changes

* Update pypi pages

* Update pypi pages

* Fix linter

* Minor changes

---------

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-06 08:28:27 +00:00
Ilya Lavrenov
d6c2a10b38 Merge Linux CC + static build + clang compiler (#20243)
* Merge Linux CC + static build + clang compiler

* Improvements

* Fixes
2023-10-06 00:30:11 +04:00
Mikhail Ryzhov
a79c07b3a0 [GA] Enable win workflow (#19646)
* Enable win workflow and cpu parallel tests

* removed test code

* update cache naming

* extended logs collections

* Revert "extended logs collections"

This reverts commit 0dd6620832.

* revert lost code during the merge

* missed dependencies

* enabled push trigger

* changed the cache key name

* skipped failed test

* fixed github action condition and added comments

* Update src/core/tests/check.cpp

* cache generation fix

* Apply suggestions from code review

* fixed python test configuration

* Revert "cache generation fix"

This reverts commit 0feab650fe.

* debug parallel tests

* Revert "Revert "cache generation fix""

This reverts commit e385b04410.

* Revert "debug parallel tests"

This reverts commit e4459472a7.

* fixed steps conditions

* concurrency updated

* fixed test skip condition on win

* review changes

* collect debug logs

* overwrite test list

* debug commit

* Revert "debug commit"

This reverts commit 8720b87c8f.
2023-10-05 16:49:39 +04:00
Ilya Lavrenov
d5ea8d5a92 Explicitly set Python3_FIND_STRATEGY (#20215) 2023-10-03 18:43:45 +04:00
Ilya Lavrenov
d37326b37e Disable pkg-config search on Android via CMAKE_DISABLE_FIND_PACKAGE_PkgConfig (#20179) 2023-10-03 09:16:56 +04:00
Ilya Lavrenov
95e3096684 Added build on RedHat system to build & test RPM packages (#20134)
* Added GHA workflow for RPM packages

* Avoid rebuild for RPM / Debian packages

* Removed conditional include headers

* try only post-build

* Beautification

* Fixed testdata generation for mulit-config generators
2023-10-01 23:23:06 +04:00
andreyanufr
b73b2502b1 Introduce NF4 data type (#19900)
* NF4 reference initial commit

* Compilable version.

* Executable NF4.

* Fixed nf4 unpacking.

* 1) Fixed warnings with nf4.
2) Removed unused functions.

* Added one test for nf4.

* Fixed code-style errors.

* Fixed code-style errors.

* Fixed NamingConventionCheck errors.

* Fixed test with nf4.

* Fixed windows compilation.

* Fixed casting warning.

* Fixed incorrect changes.

* Changed order of elements in nf4 pack/unpack.

* 1) Made Convert only on direction nf4->other type.
2) Applied reviewers suggestions.

* Fixed code style.

* Fised code style.

* 1) Added array header.
2) Added Bitsandbytes to third-party-programs.txt.

* 1) Removed unused code.
2) Fixed style typos.
3) Revert submodule version.

* Added test for nf4 compression.

* NF4 test refactoring.

* Added cpp tests for NF4.

* Removed model compilation from NF4 tests.

* Reverted submodule version.
2023-09-28 20:56:57 +04:00
Ilya Lavrenov
a6e7bac962 Added RISC-V Conan build (#20064) 2023-09-27 12:24:20 +04:00
Ilya Lavrenov
8349849e1c Use FindPython3.cmake (#19847)
* Use FindPython3.cmake

* Fixed compilation on macOS 14 with new core development tools

* Try to use Python3_SOABI instead of PYTHON_MODULE_EXTENSION

* Use Development.Module

* Keep specifying only Python3_EXECUTABLE

* Print PYTHON_MODULE_EXTENSION

* Added check for minimal cmake version for python API

* Returned Python3_INCLUDE_DIR for cross-compilation case

* Try to allow cmake older than 3.18

* Use build python interpreter to check cython dependency

* revert changes in .ci/openvino-onnx/Dockerfile

* removed unused code

* Fixed issue with variables scope

* Experiment: remove include dirs

* Corrected docs

* Use pybind11 function to set extension

* Revert "Experiment: remove include dirs"

This reverts commit 6f7f90211c.

* Refactor ConvolutionBackpropDataLayerTest, ConvolutionLayerTest, DeformableConvolutionLayerTest (#19810)

* Refactor ConvolutionBackpropDataLayerTest

* Refactor ConvolutionLayerTest

* Refactor DeformableConvolutionLayerTest

* Apply comments

* Apply comments

* Fix

* Updated minimum cmake version for Windows

* Simplified check

* Removed useless message status

* Use puiblic option

---------

Co-authored-by: Oleg Pipikin <oleg.pipikin@intel.com>
2023-09-26 20:57:29 +02:00
Ilya Lavrenov
5616c26d19 Debian packages on GHA (#20033)
* Refactored Linix GHA pipeline

* Move ONNX tests to Unit

* Install tests together with openvino

* Added checks for GNA usage in docs python snippets

* Install openssl for working pip

* Disabled onnx_dyn_shapes_expand_1_dyn_shape ONNX test

* exclude dyn shapes from onnx

* Migrated samples tests

* Fixed ONNX tests

* caches for PT tests dependencies

* Build Contrib separately from main OpenVINO

* More fixes

* Added python install for samples stage

* Installed manifests for ONNX FE tests

* Try to avoid libgl1 dependency in tests

* Clean-up

* Fixed issue with manifests in ONNX tests

* Try to build debian packages in GHA

* Fixed debian packages build for multi-config generators
2023-09-26 01:54:41 +04:00
Ilya Lavrenov
253ca8c746 Fixed GPU plugin static build with oneDNN (#19811)
* Fixed GPU plugin static build with oneDNN

* Fixed issue with absolute paths inside installed OpenVINOConfig.cmake

* Fixed absolute paths in installed OpenVINOConfig.cmake

* Changed components for installation
2023-09-18 13:58:20 +04:00
Ilya Lavrenov
0b8237f508 Removed testdata repo usage (#19890) 2023-09-18 06:59:56 +04:00
Ilya Lavrenov
db395155b3 Removed warnings suppressions for extra modukes (#16479) 2023-09-15 02:53:32 +00:00
Ilya Lavrenov
ba67db66ae Properly enable CMAKE_COMPILE_WARNING_AS_ERROR (#19828)
* Properly enable CMAKE_COMPILE_WARNING_AS_ERROR_DEFAULT

* Properly enable CMAKE_COMPILE_WARNING_AS_ERROR
2023-09-15 01:20:00 +04:00
Ilya Lavrenov
35a0706dff Replaced several cmake utilities with new ov_ prefix (#19819)
* Replaced several cmake utilities with new ov_ prefix

* Replaced several cmake utilities with new ov_ prefix
2023-09-14 16:22:50 +04:00
Anastasia Kuporosova
2bf8d910f6 [Docs][PyOV] update python snippets (#19367)
* [Docs][PyOV] update python snippets

* first snippet

* Fix samples debug

* Fix linter

* part1

* Fix speech sample

* update model state snippet

* add serialize

* add temp dir

* CPU snippets update (#134)

* snippets CPU 1/6

* snippets CPU 2/6

* snippets CPU 3/6

* snippets CPU 4/6

* snippets CPU 5/6

* snippets CPU 6/6

* make  module TODO: REMEMBER ABOUT EXPORTING PYTONPATH ON CIs ETC

* Add static model creation in snippets for CPU

* export_comp_model done

* leftovers

* apply comments

* apply comments -- properties

* small fixes

* rempve debug info

* return IENetwork instead of Function

* apply comments

* revert precision change in common snippets

* update opset

* [PyOV] Edit docs for the rest of plugins (#136)

* modify main.py

* GNA snippets

* GPU snippets

* AUTO snippets

* MULTI snippets

* HETERO snippets

* Added properties

* update gna

* more samples

* Update docs/OV_Runtime_UG/model_state_intro.md

* Update docs/OV_Runtime_UG/model_state_intro.md

* attempt1 fix ci

* new approach to test

* temporary remove some files from run

* revert cmake changes

* fix ci

* fix snippet

* fix py_exclusive snippet

* fix preprocessing snippet

* clean-up main

* remove numpy installation in gha

* check for GPU

* add logger

* iexclude main

* main update

* temp

* Temp2

* Temp2

* temp

* Revert temp

* add property execution devices

* hide output from samples

---------

Co-authored-by: p-wysocki <przemyslaw.wysocki@intel.com>
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-09-13 21:05:24 +02:00
Ilya Churaev
1d62f0141d Rename cmake ie_ macros and ie_parallel script (#19606)
* Rename cmake ie_ macros and ie_parallel script

* Add warning messages
2023-09-05 19:31:52 +02:00
Ilya Lavrenov
3bc38695c5 A set of fixes for Conan C++ package manager (#19552) 2023-09-04 11:32:39 +04:00
Ilya Lavrenov
7173f530cc Fixed static build from build tree (#19556) 2023-09-04 08:08:50 +04:00
Ilya Lavrenov
e49b208393 Enabled debug build for Python wheels (#19197) 2023-08-17 16:45:18 +04:00
Ilya Lavrenov
11610b2cc9 Added 'openvino_req_files' component for archives (#19174) 2023-08-14 16:58:08 +04:00
Ilya Lavrenov
aebf1edec7 Fixed build without protobuf-lite (#19164) 2023-08-14 11:57:35 +04:00
Ilya Lavrenov
6067ab17ba Aligned target and files (libraries) names (#19161) 2023-08-13 11:31:44 +04:00
Ilya Lavrenov
678c2954ed Properly handle python-package in cpack exclude components (#19089) 2023-08-09 21:10:13 +04:00
Ilya Lavrenov
1ce744a00f Fixed Debian package build (#18691) 2023-07-20 22:23:39 +04:00
Ilya Lavrenov
4df6ef3a26 Removed ie, ngraph and core_tools cpack components (#18636)
* Removed ie, ngraph cpack components

* Introduced new components
2023-07-20 17:46:16 +04:00
Ilya Lavrenov
700677c5c6 Less argressive chages (#18591) 2023-07-18 19:54:00 +04:00
Pawel Raasz
c1fde50cd9 Improve __FILE__ trim on windows builds (#18573) 2023-07-17 14:29:40 +02:00
Ilya Churaev
8defcef3f1 Trim paths only for Release mode (#18552) 2023-07-16 03:00:00 +04:00
Vitaliy Urusovskij
37d055e477 Enable -pie compile option for MacOS (#18568) 2023-07-14 21:06:04 +00:00
Ilya Churaev
cba84fd763 Fixed clang format for plugin files with version (#18546) 2023-07-14 10:41:38 +04:00
Mateusz Bencer
c59746fd27 Implementation of MMAP for ONNX FE (#18026)
* Implementation of MMAP for ONNX FE

* fix win offsets

* added virtual dtor to MappedMemory

* review remarks. part.1

* added disable mmap flag to MO

* added additional checks to mmap

* remove unnecessary const

* fix pybind default value

* Added args.disable_mmap = False to MO tests

* fixed MO test

* avoid global headers

* fix casting for win

* disable mmap for legacy frontends flow

* review remarks

* Fixed passing parameters

* added doc to MappedMemory and load_mmap_object
2023-07-13 19:17:58 +00:00
Ilya Lavrenov
96d16b141d Ability to configure setup.py via env variables (#18538) 2023-07-13 23:12:07 +04:00
Pawel Raasz
2cfd259824 [core]Trim __FILE__ macro by compiler if supported (#18411)
* Trim __FILE__ macro by compiler if supported

* Use file for older version cmake
Debug messages

* Move trim compilation options to os_flags.cmake

* Fix MSVC trimming options

* Add additional trim on runtime

* Update trim function description

* Use ov implementation for ngraph::trim_file_name

* Restore ie_c_api.h

* Remove unused define

* MSVC add trim for CXX language
2023-07-13 13:42:01 +04:00
Ilya Lavrenov
df2ed95dab Fixed RPATH issue for brew (#18418) 2023-07-07 08:55:27 +04:00
Ilya Lavrenov
15e69c280a Used pip wheel to build OpenVINO wheel (#18029)
* Used pip wheel to build OpenVINO wheel

* Improvements

* Added python api properly into deb / rpm packages

* Use cmake -E variant from cmake 3.13

* Improvements to fix CI

* Some refactoring

* Don't use developer package for scripts projects

* Final fixes
2023-06-23 09:17:02 +04:00
Łukasz Mielicki
2983b6abb0 Fix duplicate -Wno-all (#18197)
Trivial fix to a duplicate flag.
2023-06-23 09:04:15 +04:00