IntenseWebs/openvino
3
0 Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,337 Commits 38 Branches 54 Tags
bbb06c4f76b07441fbcd8ff9ff3f7f7d24aab6f9
Commit Graph
914 Commits
Author SHA1 Message Date
Tatiana SavinaandIlya Churaev 1f1bb6008a [DOCS] Compile tool docs change (#17460) 
* add compile tool description

* change refs

* remove page to build docs

* doc reference fix

* review comments

* fix comment

* snippet comment

* Update docs/snippets/compile_model.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* change snippet name

* create ov object

* code block fix

* cpp code block

* include change

* code test

* change snippet

* Update docs/snippets/export_compiled_model.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

---------

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
 2023-05-23 07:37:31 +04:00
Ilya Lavrenov 4c92ffa563 Build wheel arm64 packages using cross-compilation (#17635) 2023-05-23 00:31:35 +04:00
Sebastian Golebiewski e69bcdb7a5 [DOCS] Update Interactive Tutorials (#17598) 2023-05-22 14:45:54 +02:00
Xiuchuan Zhai 0b72998631 [MO][PDPD] Convert Paddle models from memory (#17005) 
* support convert_model in paddle runtime

* add convert runtime paddle test

* fix a pylint error

* fix ci error

* skip test_mo_convert_paddle.py # Ticket: 95904

* auto remove tmp file

* add docs for PDFE

* enable paddle mo test in ci

* fix docs

* fix docs

* fix the docs
 2023-05-20 18:13:21 +04:00
Pavel EsirandRoman Kazantsev 1b24e15e1e [MO] fix IR graph comparator (#17411) 
* fix graph compare (legacy python MO)

* fix failing unit-tests

* fix failing unit-tests: check that shape is defined

* added explanation comment

* Apply suggestions from code review

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* minor corrections

* add unit-tests

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
 2023-05-20 10:05:26 +04:00
Maksim ProshinAlexander SuslovTatiana Savina
 		2513db5a04 DOCS Update optimization docs with NNCF PTQ changes and deprecation of POT (#17398) 
* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update home.rst

* Update ptq_introduction.md

* Update Introduction.md

* Update Introduction.md

* Update Introduction.md

* Update ptq_introduction.md

* Update ptq_introduction.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update model_optimization_guide.md

* Update ptq_introduction.md

* Update quantization_w_accuracy_control.md

* Update model_optimization_guide.md

* Update quantization_w_accuracy_control.md

* Update model_optimization_guide.md

* Update quantization_w_accuracy_control.md

* Update model_optimization_guide.md

* Update Introduction.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update ptq_introduction.md

* Update Introduction.md

* Update model_optimization_guide.md

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update Introduction.md

* Update FrequentlyAskedQuestions.md

* Update model_optimization_guide.md

* Update Introduction.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update ptq_introduction.md

* Update ptq_introduction.md

* added code snippet (#1)

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update ptq_introduction.md

* Update model_optimization_guide.md

* Update basic_quantization_flow.md

* Update ptq_introduction.md

* Update quantization_w_accuracy_control.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update ptq_introduction.md

* Update ptq_introduction.md

* Delete ptq_introduction.md

* Update FrequentlyAskedQuestions.md

* Update Introduction.md

* Update quantization_w_accuracy_control.md

* Update introduction.md

* Update basic_quantization_flow.md code blocks

* Update quantization_w_accuracy_control.md code snippets

* Update docs/optimization_guide/nncf/ptq/code/ptq_torch.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* Update model_optimization_guide.md

* Optimization docs proofreading  (#2)

* images updated

* delete reminder

* review

* text review

* change images to original ones

* Update filter_pruning.md code blocks

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update images (#3)

* images updated

* delete reminder

* review

* text review

* change images to original ones

* Update filter_pruning.md code blocks

* update images

* resolve conflicts

* resolve conflicts

* change images to original ones

* resolve conflicts

* update images

* fix conflicts

* Update model_optimization_guide.md

* Update docs/optimization_guide/nncf/ptq/code/ptq_tensorflow.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* Update docs/optimization_guide/nncf/ptq/code/ptq_torch.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* Update docs/optimization_guide/nncf/ptq/code/ptq_onnx.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* Update docs/optimization_guide/nncf/ptq/code/ptq_aa_openvino.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* Update docs/optimization_guide/nncf/ptq/code/ptq_openvino.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* table format fix

* Update headers

* Update qat.md code blocks

---------

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
 2023-05-19 14:36:22 +00:00
Ilya Lavrenov 8b215ca363 Upgrade vresions to 2023.1 in packaging (#17626) 2023-05-19 18:07:05 +04:00
Ilya Lavrenov 84db7d0ee6 Build using conanfile.txt (#17580) 
* Build using conanfile.txt

* Update .ci/azure/linux_arm64.yml

* Several improvements

* Removed conanfile.py

* Try to use activate / deactivate

* Fixed clang-format code style

* Supported TBB version from Conan

* Added more NOMINMAX

* Fixed static build

* More improvements for static build

* Add usage of static snappy in case of static build

* More fixes

* Small fixes

* Final fixes
 2023-05-19 14:01:39 +04:00
Maciej Smyk 568f0eb21b [DOCS] Link adjustment for master (#17607) 2023-05-18 15:12:34 +00:00
Maxim Vafin db58355fad Remove posibility to export to onnx (#17442) 
* Remove posibility to export to onnx

* Add OOB pytorch convert_model test
 2023-05-17 13:39:35 +02:00
Ilya Lavrenov 04171416f4 Put mingw on gcc code path (#16101) 
* Supported mingw-w64

* Supported mingw-w64

* Supported mingw-w64
 2023-05-17 00:47:55 +04:00
Anastasia Kuporosova 75fa11c80f [PyOV] Remove deprecated (#17512) 
* [PyOV] Remove deprecated

* remove deprecated api

* remove tests

* update pot
 2023-05-16 21:48:39 +02:00
Zlobin Vladimir c378a8e912 benchmark_app/py fill batch dim correctly (#17417) 
Ticket 104401
 2023-05-10 10:45:19 +00:00
Roman Kazantsev eb178a753b [TF FE] Handle incorrect models (empty, fake) by TF FE (#17408) 
* [TF FE] Handle incorrect models (empty, fake) by TF FE

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply suggestions from code review

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
 2023-05-09 00:00:12 -07:00
Anastasiia Pnevskaia fd9d501306 Removed checks of unsatisfied dependencies in MO (#16991) 
* Fixed dependencies check, made unsatisfied dependencies show only in case of error.

* Small fix.

* Test correction.

* Small test correction.

* Temporarily added debug print.

* Debug output.

* Debug output.

* Debug output.

* Test fix.

* Removed debug output.

* Small fix.

* Moved tests to check_info_messages_test.py

* Remove dependies checks from MO.

* Small corrections.
 2023-05-08 16:54:21 +04:00
Maxim Vafin 1d59dab362 [PT FE] Improve exception when decoder cannot trace or script the model (#17338) 
* [PT FE] Improve exception when decoder cannot trace or script the model

* Add exception in convert_model

* Add test
 2023-05-04 07:58:40 +02:00
Roman Kazantsev 7464b4d396 [MO][TF FE] Recover MOC TF FE unit-tests in the pre-commit (#17233) 
* [MO][TF FE] Recover MOC TF FE unit-tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix python environment to get test_util

* Correct Python environment for MO UT tests

* Correct Python env for linux-debian

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
 2023-05-03 23:39:46 +00:00
Roman Kazantsev 35cae6251c [MO][TF FE] Handle constant with undefined value (#17311) 
Since TF 2.10 the native model freezing can produce constants with undefined value,
i.e. tensor shape can be any and value is []. In this case the tensor just fills up with
the default value (0 - for numerics, "" - for strings)

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
 2023-05-02 14:02:36 +00:00
Ilya Lavrenov 2ae23dd1ad Fixed Python API build for Ubuntu 22.04 with python3.11 (#17297) (#17298) 
* Fixed Python API build for Ubuntu 22.04 with python3.11

* Update ONNX CI docker to test python 3.11 and system pybind11
 2023-04-29 04:34:10 +04:00
Anastasiia Pnevskaia 269ed1d9cc Fix of groupconv_to_conv() in MO IR reader (#17118) 
* Fixed bug in groupconv_to_conv() method.

* Small correction.

* Test correction.
 2023-04-28 11:25:29 +04:00
Nikita Savelyev 100d56261a Added missing import keyword (#17271) 2023-04-28 00:05:20 +04:00
Maxim Vafin 1d443c6da6 Fix problems with pytorch models passed to convert_model (#17255) 
* Do eval() only for torch Module

* Add test

* Support decoder in convert_model

* Enable tests
 2023-04-27 18:33:46 +04:00
Ekaterina Aidova 82ff7e17c9 use input parameter for building example_inputs (#17207) 
* use input parameter for building example_inputs

* Update tools/mo/openvino/tools/mo/moc_frontend/pytorch_frontend_utils.py
 2023-04-26 17:58:06 +04:00
Zlobin Vladimir de30d8523d State single value is uese (#15458) 
Ticket EISW-60868
 2023-04-26 14:50:03 +04:00
Maciej Smyk 72533a7da1 DOCS shift to rst - Quantizing Models with Accuracy Control, Documentation, Get Started & Learn OpenVINO (#16997) 
* Update AccuracyAwareQuantizationUsage.md

* Update AccuracyAwareQuantizationUsage.md

* Update AccuracyAwareQuantizationUsage.md

* Update AccuracyAwareQuantizationUsage.md

* Update AccuracyAwareQuantizationUsage.md

* Update AccuracyAwareQuantizationUsage.md

* Update AccuracyAwareQuantizationUsage.md

* Update AccuracyAwareQuantizationUsage.md

* Update AccuracyAwareQuantizationUsage.md

* Update AccuracyAwareQuantizationUsage.md

* Update AccuracyAwareQuantizationUsage.md

* rst

* fixes
 2023-04-25 16:06:34 +02:00
Anastasiia PnevskaiaandRoman Kazantsev acd424bb5e Show message with suggestion to try legacy FE in case of conversion error (#17088) 
* Moved exception checks to _convert(), added suggestion to try legacy TF in case of conversion fail.

* Added test.

* Added send_conversion_result() method.

* Small correction.

* Update tools/mo/openvino/tools/mo/convert_impl.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Moved test_suggest_legacy_fe() test to check_info_messages_test.py.

* Removed not needed import.

* Small correction.

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
 2023-04-25 13:57:01 +00:00
Przemyslaw WysockiandRoman Kazantsev 923b6f297c [PyOV] Move environment markers to requirements.txt files (#17113) 
* WIP

* WIP

* Debug

* WIP

* Expand function to other setup.pies

* Revert mxnet

* Update docstring'

* restore defusedxml

* Update tools/mo/requirements.txt

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Code review

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
 2023-04-25 13:25:21 +00:00
Maxim Vafin d423491bcb Fix Scatter value infer for fully dynamic value (#17165) 
* Fix issue with dynamic Scatter in MO IR Reader

* Only normalize for 1D tensors

* Add test
 2023-04-25 16:38:49 +04:00
Georgy Krivoruchko 3f07c8b48b [TF FE] Added MetaGraph file format (#16524) 
* Separeted SavedModelVariablesIndex class from Saved Model

* Renamed SavedModelVariablesIndex class

* Enabled Tensorflow MetaGraph

* Enabled Tensorflow MetaGraph

* Covered VariableV2 and Assign nodes

* Applied review comments

* Added tests

* Added names to input/output ports too

* Fixed naming for using with MO

* Applied part of review comments

* Renamed meta.cpp and saved_model.cpp

* Applied shared_ptr for memory management of PtrNode

* Fixing CI

* Prevent cycles while passing thru graph

* Released requirement for Checkpointable Object Graph

* Changed naming approach to align port order

* Changed renaming order (before reordering)

* Added a Placeholder translator which checks updated shape

* WA missing Identity name

* Fix CI and restored lost translators after rebase

* WA for output names

* Removing unused params after cutting a model

* Prevents crash in case VariableV2 appears in freezed model

* Fixed saved model in case no variables.index found, but
variables exists

* Changed approach for handling native formats support

* Aligned behavior with freezing .meta files

* Fixed behavior for cutting a model by input tensor

* Applied review comments
 2023-04-25 13:46:06 +04:00
Nikita Malinin e37288fbcc [POT] Added inference shape for in-place statistics (#17114) 
* Added inference shape for inplace statistics

* Update graph_builder
 2023-04-25 11:14:34 +04:00
Anastasiia Pnevskaia 00847cba7d Fix of tf.GenericFunction conversion in convert_model() (#17125) 
* Added GenericFunction support, fixed tf.Function test.

* Added test, added TF version checks.

* Small correction

* Removed Trackable type support.

* Small correction.
 2023-04-24 22:57:56 +00:00
Roman Kazantsev 3830125e3b [TF FE] Report the full list of unsupported operations (#17143) 2023-04-24 21:33:07 +00:00
Ilya Lavrenov a34ef680f2 Made plugins.hpp generation to be CONFIG dependent (#17139) 2023-04-24 14:48:45 +04:00
dependabot[bot] eac265722f Update networkx requirement from <=2.8.8 to <=3.1 in /tools/pot (#16745) 
Updates the requirements on [networkx](https://github.com/networkx/networkx) to permit the latest version.
- [Release notes](https://github.com/networkx/networkx/releases)
- [Commits](https://github.com/networkx/networkx/compare/networkx-0.23...networkx-3.1)

---
updated-dependencies:
- dependency-name: networkx
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-04-24 13:37:35 +04:00
Maxim Vafin 01065338ef Fix MO IR Reader extender for StridedSlice to support empty begin and end masks (#17019) 2023-04-24 13:08:28 +04:00
Daniil Lyakhov 7997354359 POT is depricated (#16758) 2023-04-24 09:37:57 +04:00
Anastasiia Pnevskaia 50a6c88ea3 Fix of crashes of convert_model() when executed for different frameworks (#16968) 
* Fix of class conflicts in different frameworks.

* Remove commented code.

* Moved FakeQuantWithMinMaxVars to common part.

* Fixed BOM package test.

* Removed not needed code.

* Removed not needed code.
 2023-04-21 19:29:38 +04:00
Maxim VafinIlya LavrenovAndrei KochinRoman Kazantsev
 		552143c9cd [MO] Fix Interpolate-11 in MO (#17002) 
* Fix Interpolate-11 in MO

* Add forgotten file

* Fix output type of TopK-11

* Do not force precision on port 1 for mode scales

* Update tools/mo/openvino/tools/mo/ops/interpolate.py

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
 2023-04-20 09:51:38 +02:00
Anastasiia Pnevskaia 5026aa044a Removed naming of inputs in MO Python API PyTorch tests. (#17070) 
* Removed naming of inputs in MO Python API PyTorch tests.

* Fixed coping of data.

* Small correction.

* Small correction.

* Small fix.
 2023-04-20 11:49:45 +04:00
Anastasia KuporosovaandIlya Lavrenov 9f250edc7f [PyOV] use generator is multi config (#17004) 
* [PyOV]- use generator is multi config

* use ov

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
 2023-04-18 22:04:22 +00:00
Anastasiia Pnevskaia 078f28911b Fixed parsing of 'layout' param (#16999) 
* Fixed layout parsing.

* Small correction.

* Removed wrong change.
 2023-04-18 22:43:38 +04:00
Karol Blaszczak 1471a6e8de [DOCS] benchmarks new page (#16620) 2023-04-17 16:43:57 +02:00
Anastasiia Pnevskaia dc2fa65224 Support of unnamed saved_model_dir in MO Python API (#16542) 
* Added support of unnamed saved_model_dir.

* Switch TF2 layer tests for unnamed saved_model_dir.

* Added test.

* Correction of comment.

* Removed unnecessary pytest mark.

* Code correction, added comment.
 2023-04-17 17:20:27 +04:00
Przemyslaw WysockiandIlya Lavrenov d72d833a96 [PyOV] Enable Python 3.11 (#15144) 
* Bump ONNX version

* Bump protobuf

* Add xfails and skips

* Add tickets

* Skip ONNX Serialization tests

* Compile ONNX with C++17

* Force cpp17 - 2

* Use MSVC check

* Relax python reqs, enable 311 in azure

* Fix setupvars error

* Ignore watchdog error

* Update tensorflow

* Minor change

* Bump onnx to 1.13.1

* Bump protobuf to 3.20.3

* Debug test tf

* Xfail tests in comp

* Update comp tests

* Update tf reqs

* Remove deprecated ONNX function

* Align PDPD FE protobuf req with 2.4.1

* Satisfy dependency review

* Attempt to fix dependency review

* Revert pdpd protobuf

* Skip pdpd tests

* Fix MO-TF-PB test

* Skip TF test case

* Enable py311 on rest of jobs

* Try disabling pdpd req

* Exclude pdpd form cmake

* Update .ci/azure/linux.yml

Fixed unmerged merge-conflict

* CR

* Fix reqs

* Skip pdpd tests

* Disable pdpd tests building in cmake

* Skip another pdpd cmake

* Add file

* Add paddle constraint to tests

* Disable paddle reqs

* Debug prints

* Skip TF test if Python ver is 3.11

* Apply Mish cr comments

* Debug

* Debug

* Constrain tensorflow_addons

* Fix pdpd skipping

* Add debug prints

* Update skips

* Remove prints

* Minor change

* Update OMZ commit

* Fix some tests

* Minor change

* Disable pdpd at all

* Disable pdpd at all

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
 2023-04-17 13:30:17 +04:00
Roman Kazantsev 18da874c57 [MO] Remove use of mapping file and its generation (#16944) 
* [MO] Remove use of mapping file and its generation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix pylinter findings

* Remove usage of mapping file in the layer tests

* Fixing layer tests for legacy frontend

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
 2023-04-15 10:38:33 +00:00
Roman Kazantsev 4ba0ac5476 [MO][TF FE] Support delayed batch setting (#16937) 
* [TF FE] Support delayed batch setting

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Cover BOM list

* Add unit-tests for batch setting with layout

* Apply code-review: check batch size

* Apply code-review: default index for any dimension

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
 2023-04-14 22:35:43 +00:00
Liubov Talamanova 0c0aa5c997 [POT] Fix POT CI (#16955) 2023-04-14 17:21:01 +00:00
Anastasiia Pnevskaia 24c9d95779 Support of unnamed input for MO Python API. (#16373) 
* Support of unnamed input for MO Python API.

* Code correction, tests fix.

* Small fix.

* Added tests for unnamed input, code fixes.

* Small code correction.

* Removed code comment.

* Added tests, fixed bugs.

* Minor corrections, added comments.

* Code refactoring.

* Added defaults for InputCutInfo.

* Fixed error.

* Small fixes.

* Removed wrong change.

* Fixed error.

* Corrected input description.
 2023-04-14 19:37:46 +04:00
Pavel EsirandKarol Blaszczak 68f46ff9a1 [MO] compress_to_fp16=False by default (#16854) 
* compress_to_fp16=False by default

* Apply suggestions from code review

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* note abound RAM consumption for FP16 compressed models

* detailed notion about RAM usage

* update 'get_compression_message()'

* corrected get_compression_message: remove infor about RAM

* fix pytorch convert layer tests

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
 2023-04-14 01:16:41 +00:00
Shen, Wanglei 3461064507 update benchmark_app to remove setting UNDEFINED with -hint none (#16695) 
* Remove setting ov::hint::PerformanceMode::UNDEFINED from benchmark_app

* update benchmark_app

* update python code and description

* update python code

* fix code style issue

* update python code

* update c++ app
 2023-04-13 14:29:13 +00:00