Commit Graph

696 Commits

Author SHA1 Message Date
Nikita Malinin
3e89e7fc86 Revert "[POT] GNA - prevent an overflow in eltwise layer (#12048)" (#15639)
This reverts commit 1901087677.
2023-02-13 17:20:03 +04:00
Piotr Krzemiński
d0a97af629 [BENCHMARK_APP] Introduce Numpy array loading for C++ benchmark app/Fix a bug that would cause Python Numpy array loading to fail (#14021)
* [C++/BENCHMARK_APP] Introduce Numpy array loading for C++ benchmark app

* [DOCS/BENCHMARK_APP] Update docs to reflect changes, update list of available extensions from OpenCV, align help messages

* Update inputs_filling.cpp

* Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update samples/cpp/benchmark_app/inputs_filling.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [C++/Python] Implement quality-of-life improvements from PR comments

* [C++] Fix compilation errors, fix linter output

* [C++/PYTHON] Apply requested changes

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update samples/cpp/benchmark_app/utils.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [PYTHON] Separate loading of numpy arrays similar to images

* [PYTHON] Remove unnecessary 'Prepare xxx file' print

* Update README again because IF OPENCV.. dissapeared for some reason

* Update second README with missing IF OPENCV..

* [C++] Remove unnecessary vector print function

* [C++ Add Numpy processing function - TODO link it to the tensor filling

* Reverse OneDnn plugin modification

* [C++] Numpy array loading for C++

* [C++] Add (almost) all missing types of data

* Reverse submodule modifications

* [C++/PYTHON] Fix compilation errors, clean code

* [C++] Modify supported extensions, add numpy checking to utils, add numpy to get_image_info method

* Update samples/cpp/benchmark_app/inputs_filling.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [C++] Fix utils header file to reflect unordered set change

* [PYTHON/C++] Fix compilation errors in C++ code, fix Python dynamic shapes numpy loading

* [C++] Fix explicit instantiation of NumpyArray reader

* [C++] Clang format, minor syntax fixes

* [PYTHON/C++] Remove unnecessary data types, introduce a new approach to cast data of different types from format_rt_reader, remove uppercase types from Python precision parameters

* [PYTHON] Update README to reflect new precision settings

* [PYTHON] Fix README, fix clang format

* [C++] Clean headers

* [C++] Fix uninitialized variable error

* [C++/PYTHON] Fixed choices in Python benchmark, fixed types in C++ benchmark

* [C++] Fixed ov::float16conversion, fixed Python types map - removed redundancies

* [C++] Add back boolean support

* [C++] Fix compilation errors

---------

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
2023-02-13 12:04:23 +04:00
Roman Kazantsev
4301ede385 [MO][TF FE] Add additional fallback for Iterator operations (#15582)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-09 00:54:33 +04:00
Artyom Anokhov
8d2eae95a7 Port changes for installing GPU driver from 2022.3 branch (#15408)
* Port changes for installing GPU driver from 2022.3 branch.

* install_openvino_dependencies: Fixed syntax after ShellCheck

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-02-08 18:37:51 +04:00
Maxim Vafin
de4f9c8131 [MO] Add support for dynamic cases in legacy Broadcast shape infer (#15546)
* [MO] Add support for dynamic cases in legacy Broadcast shape infer

* Update broadcast_test.py

* Update broadcast.py

* Update broadcast_test.py

* Update broadcast_test.py
2023-02-08 13:53:43 +01:00
Anastasiia Pnevskaia
1f5faf6cee Added preserving logger state to mo.convert_model(). (#15529) 2023-02-07 18:38:33 +04:00
Roman Kazantsev
b0ffec48be [TF FE] Support TensorList operations and RNN layers (#15503)
* [TF FE] Support TensorList operations and RNN layers

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove TensorList operations from the fallback

* Fix computation of dummy tensor size

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-06 22:38:21 +00:00
Anastasiia Pnevskaia
347cd0e180 TF FE import model from memory (#15242)
* Added import model from memory for TF FE using string.

* Small correction.

* Clang format.

* Code correction.

* Implemented model importing to TF FE using temporary file.

* Removed wrong changes.

* Added check.

* Removed code duplication.

* Corrected logging of cli parameters.
2023-02-02 12:07:30 +04:00
Vitaliy Urusovskij
29b15233c7 Remove OV_FRONTEND_PATH (#15364)
* Remove "OV_FRONTEND_PATH" from `FrontEndManager`

* Remove "OV_FRONTEND_PATH" from layer_tests

* Remove "OV_FRONTEND_PATH" from find_ie_version.py

* Remove "OV_FRONTEND_PATH" from .ci/

* Move `ov::get_plugin_path` to file_util.hpp (ov::util)

* Add `register_front_end(name, path)` FEM public API

* Enable frontend/ tests

* ClangFormat

* Remove OV_FRONTEND_PATH from FE shared utils

* Add `register_front_end()` to PythonAPI

* Update Py tests with registering of "mock_py" FE

* ClangFormat

* Leftovers

* Fix SegFault with `register_front_end(name, lib_path)`

* Add FE_LIB_PRE and FE_LIB_SUFFIX to `ov_core_unit_tests`

* Fix format

* Update `testFailRegisterFEByWrongPath`
2023-02-02 08:19:35 +04:00
Pavel Esir
da9470864c [MO] add extractor for TF Any operation (#15255)
* added extractor for TF Any operation

* enabled existing 'Any' layer test for legacy TF frontend
2023-02-01 08:59:15 +04:00
Pavel Esir
1ae0b2796e [MO] fix UnaryElementwise reverse_infer (#15366)
* fix UnaryElementwise reverse_infer

* fixed tests for UnaryElementwise reverse_infer

* reverted autocorrection edits
2023-01-31 11:56:24 +04:00
Ilya Lavrenov
d092f5d7dd Setup minimum supported version for pybind11 (#15397) 2023-01-31 11:48:15 +04:00
Jack Clarke
42a417577b Print unknown argument itself instead of pointer address (#15300) 2023-01-30 14:56:37 +04:00
dependabot[bot]
0af4578189 Update fastjsonschema requirement from ~=2.15.1 to ~=2.16.2 in /tools/mo (#15292)
* Update fastjsonschema requirement from ~=2.15.1 to ~=2.16.2 in /tools/mo

Updates the requirements on [fastjsonschema](https://github.com/horejsek/python-fastjsonschema) to permit the latest version.
- [Release notes](https://github.com/horejsek/python-fastjsonschema/releases)
- [Changelog](https://github.com/horejsek/python-fastjsonschema/blob/master/CHANGELOG.txt)
- [Commits](https://github.com/horejsek/python-fastjsonschema/compare/v2.15.1...v2.16.2)

---
updated-dependencies:
- dependency-name: fastjsonschema
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Apply suggestions from code review

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-01-27 13:04:00 +04:00
Evgenya Stepyreva
0513a79a79 Tensorflow Lite frontend (#14977)
* Infrastructure for tflite

* Removed submodule flatbuffers

* Added flatbuffers submodule. Fixed version to v22.12.06 aka acf39ff

* Move headers back

* Flatbuffers integration

* Small fixes

* Started parsing the Model

* flatbuffer changes

* decoder_flatbuffer changes

* Lite Input Model -- not needed as of now but looks cool

* Rolled back inherritance from ov::frontend::tensorflow::InputModel

* Results are not treated as outputs, but its ok

* Fix missplaced input vs output

* Refactor

* Load model op-by-op. Frontend API finalized

* Debugging still, there are prints here and there. Decoder is not sane

* Convolution with all attributes is translated and quantization is applied for inputs and constatants. TODO: quantize intermediate tensors, separate decoder specific logic?

* Float ssd and posenet models are showing good accuracy

* Need to refactor but work flawlessly

* Telemetry and lightweight model cutting

* Code style and test changes. Extensions supported

* Quantization and style

* Style refinements

* Move onednn back

* New portion of operations enabled

* TFLite FE doesn't inherrit TF FE

* Moved files to another directory

* Rename header op_table.hpp to common_op_table.hpp for all files in src/frontends/tensorflow_common/src/op/

* Removed visability macroses

* CMake changes

* Unit-test execution in .ci

* Update labeler.yml

* Codeowners

* Style check and fix

* Static Build arrangement

* Addressing the comments

* install common headers to previous place

* New approach with public decoder and graph_iterator

* New approach with public decoder and graph_iterator

* Move GraphIterator back

* Comments addressed

* Comments adressed

* Preliminary TF FE README.md changes

* Added target_compile_definitions OPENVINO_STATIC_LIBRARY for static build

* Fixed conflicts and added TF to common places

* Frontends use only openvino::core::dev API

* Merged common tensorflow changes and made code build and work on selective number of models

* Style

* Rollback unnecessary changes from Tensorflow FE

* Rollback unnecessary changes from Tensorflow Common

* Minor refactor

* cmake minor refactoring

* Mixed commit

* Style and merge fix

* Low hanging fruit operations

* Fix windows build

* Refactor quantization parameters representation

* license compliance. approved by OS PDT

* copyrights in generic file

* dependabot

* labeler

* Unit Test to be triggered in CI

* cmake variables naming. corrected copyright years in copyrights/generic file

* library renamed in .ci/ calls

* Copyright year update

* Set openvino-tf-frontend-maintainers as owner of /src/frontends/tensorflow_lite/

* Fixed flatc corss-compilation

* Cleaned flatbuffers header usage

* Nitpicks solved

* Update cmake/templates/OpenVINOConfig.cmake.in

* Compile with flatbuffers headers

* Fixed "which is prefixed in the source directory"

* Fixed typo in flatbuffers cmake

* Removed flatbuffers submodule

* Added fork submodule

* Fixed static build

* Fixed cross-compilatio

* Fixed -Wshadow warning

* Fixed warning on Windows

* Use only headers from flatbuffers library

* Added LTO and fixed compilation errors on Windows

* Fixed warnings in tensorflow_common

* Move ctors implementation to cpp file

* Added information about new frontends to common FEm part

* Temporaryily disable warnings

* Fixed code style using clang-format

* Fixed Windows

* reverted changes in onnx

* Revert changes in onnx_common

* Removed pragma once frm cpp

Co-authored-by: missjane <estepyreva@gmail.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-01-27 06:27:59 +04:00
Roman Kazantsev
93ef678d75 [MO][TF FE] Correct info messages from TF FE (#15299)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-01-25 12:51:23 +00:00
Roman Kazantsev
f12ffc0428 [MO][TF FE] Switch MO to TF FE in default mode (#15100)
* [MO][TF FE] Switch MO to TF FE in default mode

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix code-style

* Extend operations for the fallback

* Fix MO unit-tests

* Check only legacy FE for read-from-memory functionality

* Fix failures in IR comparator tests

* Fallback to the legacy FE in case tensorflow_custom_operations_config_update

* Revert copyright and update

* Fix unit-test since it is oriented for the legacy FE

* Fallback to the legacy FE in case deprecated config options

* Fix value propagation from deprecated config option

* Fix the Result node name in case cutting by input port for outputs

* Set Result node name aligned with the Legacy Frontend

* Reformat a list of operations to fallback

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-01-25 07:54:56 +04:00
Przemyslaw Wysocki
163baa3c1c [PyOV] Allow numpy patch releases (#15265)
* Update reqs

* test, minor change
2023-01-24 19:13:12 +04:00
Liubov Talamanova
5fca707ebd [POT] Update CPU_SPR transformer quantization (#15241)
* [POT] Update CPU_SPR transformer quantization

* Add comments
2023-01-24 15:56:22 +04:00
Anastasiia Pnevskaia
e2943c2430 Fix of ObjectDetectionAPIProposalReplacement(). (#14869)
* Fixed ObjectDetectionAPIProposalReplacement() to get correct CropAndResize node.

* Small correction.

* Moved topological sort with start node to separate method, added tests.

* Simplified code.
2023-01-23 13:19:40 +04:00
Maksim Proshin
ae15937c44 target_device description (#14592)
Minor changes in target_device description

Co-authored-by: Alexander Kozlov <alexander.kozlov@intel.com>
2023-01-23 11:26:35 +03:00
Ilya Lavrenov
0ba9f14e60 Moved .svg files under LFS (#15249) 2023-01-23 10:49:39 +04:00
Maciej Smyk
8f8e79bb15 scheme3 (#14872) 2023-01-20 19:25:08 +04:00
Maciej Smyk
c1a9152d1c default_quantization_flow (#14848) 2023-01-20 14:24:27 +04:00
Anastasiia Pnevskaia
993686b266 convert_model() slow conversion time fix (#14666)
* Removed input_model from meta data dictionary.

* Added test.

* Changed check for more general case.

* Test fixed.

* Temporarily added debug print.

* Fixed test.

* Code corrections.

* Small correction.

* Added type check.

* Added comments, small corrections.

* Refactored MO convert_model() to have single parse_args().

* Small correction.

* Fixed PyTorch converting.

* Small correction.

* Code refactoring, added tests.
2023-01-20 14:01:53 +04:00
Sebastian Golebiewski
ffdf31fba8 DOCS: Update doxygen version (#15210)
* Update build_doc.yml

* fixing references

* fix refs

* fix branch.hpp
2023-01-20 13:22:30 +04:00
Ilya Naumov
32fce5cb40 Fix Python benchmark_app crash in case of binary input and batch > 1 (#15114) 2023-01-18 16:16:22 +04:00
Ilya Lavrenov
c4eeecfec5 Remove myriad plugin (#15131)
* Removed Intel MYRIAD plugin

* Removed Intel MYIAD from CI files

* Removed Intel MYRIAD from cmake folder

* Removed MYRIAD, HDDL from samples

* Removed MYRIAD, HDDL from scripts folder

* Removed MYRIAD from bindings folder (C and Python API)

* Removed MYRIAD tests

* Removed MYRIAD from tests folder

* Removed MYRIAD from tools folder

* Removed HDDL (VAD), MYRIAD (NSC2) from documentation

* Fixed build for AUTO unit tests

* Fixed clang code style

* Fixed comments and issues

* removed MYRIAD from AUTO tests

* Disabled MULTI tests in CI

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/get_started/get_started_demos.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/deployment/local-distribution.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2023-01-18 15:19:44 +04:00
Pavel Esir
1d5fa360d4 fix check for data nodes in emitter.py (#14802)
* fix checking if there are data nodes for operations with several outputs

* added unit-test

* added ports explicitly, removed redundant lambda

* typo in port
2023-01-17 16:11:57 +04:00
Ashley DeFlumere
daf9f0fbbf Update vpu.json (#14612)
Update POT tool configs to use unified scales for concat by default.

Co-authored-by: Alexander Kozlov <alexander.kozlov@intel.com>
Co-authored-by: Liubov Talamanova <liubov.talamanova@intel.com>
2023-01-17 12:26:36 +04:00
Ilya Churaev
0c9abf43a9 Updated copyright headers (#15124)
* Updated copyright headers

* Revert "Fixed linker warnings in docs snippets on Windows (#15119)"

This reverts commit 372699ec49.
2023-01-16 11:02:17 +04:00
Przemyslaw Wysocki
cfac7e4ee4 [PyOV] Update requirements for Python 3.11 (#15072)
* Update reqs

* update license whitelist

* Revert gast

* Bump distro package
2023-01-13 14:49:55 +04:00
Alexander Kozlov
ded9156b98 Added ignored pattern for Stable Diffusion Unet (#14925) 2023-01-13 12:51:27 +04:00
Pavel Esir
9e3b52eee0 remove deprecated cli arguments from MO (#14937)
* removed deprecated cli arguments from MO

* removed deprecated options from docs

* Update tools/legacy/benchmark_app/README.md

* removed ConcatOptimization.py, removed deprecated args from unit-tests, renamed tensorflow_use_custom_operations_config -> transformations_config; replaced using or cmd_params.data_type -> cmd_params.compress_to_fp16

* added comment why we set internal 'data_type' always to 'FP32' after introducing 'compress_to_fp16'

* removed openvino_docs_MO_DG_prepare_model_Model_Optimization_Techniques from MO_DevGuide

* returned back --data_type argument

* leftovers from recovering

* returned back to package_BOM.txt; fixed NHWC by default for TF

* recovered --disable_nhwc_to_nchw to MO args

* reverted removing --tensorflow_use_custom_operations_config

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-01-12 21:12:56 +00:00
Liubov Talamanova
b8d51a9e1b [POT] Add transformer block pattern (#15044) 2023-01-12 15:37:21 +04:00
Piotr Krzemiński
f4ff1cbdf3 [BENCHMARK_APP] Align pc reports, revert format print to previous, excel friendly (#14644)
* [Python] Align pc output in Python benchmark, update sorted output to new headers, print floats with 6-digit precision, fix date format printing to excel-friendly

* [PYTHON/C++] Change precision of raports and pc counters report, simplify code

* [C++] Align C++ benchamrk_app report to Python's by setting the precision value to 3

* [C++] Fix CsvDumper precision

* [C++/PYTHON] Align pcand pcsort outputs, merge C++ printSort methods into one

* Update samples/cpp/common/utils/include/samples/common.hpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update samples/cpp/common/utils/include/samples/common.hpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
2023-01-11 12:38:37 +04:00
Roman Kazantsev
35ed485d82 [MO] Activate pylint checker in CI (#15012)
* Fixed mo workflow

* Update pylint config with import os

* Update .github/workflows/mo.yml

* Install extras for pylint checker

* Fix pylint reported errors

* Add torch to the environment

* Add torch into whitelist

* Ignore torch

* Localize torch code

* Fix syntax error

* Remove MO unit-test from Pylint flow

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-01-11 08:07:57 +04:00
Roman Kazantsev
87d777c192 [MO][Install] Clean up setup (#15011)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-01-10 00:13:15 +04:00
Roman Kazantsev
80f0ffbb49 [Tools][MO] Clean up requirements for default installation (#14992)
* [Tools][MO] Clean up requirements for default installation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update azure config files with extras

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-01-09 15:05:37 +04:00
Alexander Kozlov
893da35826 [POT]: Requirements clean up (#14630)
* Cleaned up requirements in POT

* Fixed issue

* Removed pandas usage from POT

* Update setup.py

* Removed the upperbound for numpy in the case of Python < 3.11

* Removed numpy logic
2023-01-09 09:44:09 +00:00
Zlobin Vladimir
6c8f8df518 uint32->uint64 for RedHat gflags 2.1 failing at runtime (#14724) (#14978)
* uint32->uint64 for RedHat gflags 2.1 failing at runtime

* tools/legacy/benchmark_app: uint32->uint64 for RedHat gflags 2.1 failing at runtime

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-01-06 17:57:36 +00:00
Maxim Vafin
51fb4fd2e3 Fix ResultRename transformation to preserve output order (#14956)
* Fix ResultRename transformation to preserve output order

* Apply review feedback
2023-01-06 17:48:13 +04:00
Liubov Talamanova
ddd4f050c7 [POT] Fix precommit tests (#14972)
Co-authored-by: Alexander Kozlov <alexander.kozlov@intel.com>
2023-01-06 13:44:54 +00:00
Zlobin Vladimir
7fab95fef2 Relax OpenCV dependency (#14968)
Close https://github.com/openvinotoolkit/openvino/issues/14875
2023-01-06 14:42:43 +03:00
Tomasz Dołbniak
13d01d969b [BENCHMARK_APP] Help message cleanup (#14786) 2023-01-05 14:21:09 +01:00
Sebastian Golebiewski
3017c8d123 DOCS: Fixing broken links in documentation. (#14935) 2023-01-05 11:25:03 +04:00
Karol Blaszczak
f31ebd4947 Release doc updates_port (#14784) 2023-01-04 11:12:11 +00:00
Liubov Talamanova
39ff705a3e [POT] Update CI branch (#14916)
Co-authored-by: Alexander Kozlov <alexander.kozlov@intel.com>
2023-01-03 17:26:36 +00:00
Ilya Lavrenov
0e544e44a1 Renamed requirements.in file (#14863) 2022-12-30 18:00:36 +04:00
Roman Kazantsev
0be53a66d2 [MO][TF FE] Top-up TensorFlow Version in requirements files (#14842)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-12-28 16:31:25 +04:00