IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,567 Commits 38 Branches 54 Tags
86d7c97fa976d1cdbc5b72e7565865c1325fc75f
Commit Graph

712 Commits

Author SHA1 Message Date
Wang, Yang
86d7c97fa9 Update the logic of benchmark app property setting (#16427) 
* 1. refine the logic to ov::device::properties setting.
2. the config overrides will be performed if same config setting is came from CMD line.-a

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update configuration sample file within README.md.

* Update.

* Update.

* 1. Update configuration example file within REAMDME.md for Python version.
2. implement the config DEVICE_PROPERTIES value convertation between the string type and dictionary of Python type.
3. Update the configuration file loading and dumping logic.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Update.

* Update.

* Update.

* 1. Enable configs to be interchangeable between C++ and Python.
2. Update perf_count showing logic.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Revert the logic of showing show performance counters.

* Update help msg for loading config option.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
 2023-04-12 15:32:54 +00:00
Mateusz Tabaka
bdd79fe931 CompressQuantizeWeights - use f32 precision when computing scale and zero point (#16794) 
Ticket: 101825
 2023-04-12 12:42:39 +02:00
Przemyslaw Wysocki
69d6ef33fc [PyOV] Align and bump numpy, further tidy up requirements (#16652) 
* Align numpy

* Simplify the rest

* Minor change

* Minor change

* Restart CI

* Update paddle reqs
 2023-04-12 13:14:38 +04:00
Maxim Vafin
23c90aecea Add support for opset10 and opset11 in MO IR Reader (#16742) 
* Add support for opset10 and opset11 in MO IR Reader

* Fix unique

* Refactor tests

* Fix Unique shape infer

* Update tests

* Apply suggestions from code review

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply review feedback

* Fix BOM tests

* Update tools/mo/unit_tests/mo/utils/ir_reader/ops_test.py

* Improve error log

* Fix test fails when using pytest

* Add changes forgotten in last commit

* Fix error message

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
 2023-04-12 11:35:52 +04:00
Przemyslaw Wysocki
ea213f687a Fix regex (#16850) 2023-04-12 01:06:54 +04:00
Wang, Yang
3740ba9226 [IE Sample] incorrect nstreams retrieved from plugin (#16849) 
* Retrieve the ov::num_streams through compiledModel rather than through plugin.

* Update python version.
 2023-04-12 01:06:20 +04:00
Ilya Lavrenov
feb08c408f Return benchmark_tool to openvino-dev wheel (#16834) 2023-04-10 16:34:51 +04:00
Anastasia Kuporosova
dbe051aa79 [POT] use serialize methid (#16768) 2023-04-06 15:02:24 +04:00
Anastasiia Pnevskaia
4098434233 Parameter list and descriptions for mo.convert_model() method in docstring (#16459) 
* Added convert_model() params docs.

* Added auto-generating of most cli params.

* Added auto-generating of cli params.

* Small correction.

* Removed wrong change.

* Corrected default values.

* Fixed errors, added tests.

* Small correction.

* Corrected params descriptions, moved cli specific params to separate file.

* Moved params specifics to utils/help.py.
 2023-04-05 14:48:13 +04:00
Maciej Smyk
8691ec2779 Update README.md (#16700) 2023-04-04 13:15:31 +02:00
Przemyslaw Wysocki
6237868437 Dependabot-ignore line (#16679) 2023-04-03 15:49:27 +04:00
Sebastian Golebiewski
b2e4857a64 DOCS shift to rst - AccuracyAwareQuantization Parameters (#16663) 2023-04-03 08:29:40 +02:00
Sebastian Golebiewski
02b35d7984 DOCS shift to rst - POT CLI Example (#16649) 2023-04-03 08:29:10 +02:00
Sebastian Golebiewski
3a5b819685 DOCS shift to rst - POT API examples (#16627) 2023-04-03 08:28:47 +02:00
Sebastian Golebiewski
2f5be5e81c DOCS shift to rst - Post-Training Optimization (#16621) 2023-04-03 08:28:24 +02:00
Sebastian Golebiewski
848c9e3b76 DOCS shift to rst (#16616) 2023-04-03 08:27:02 +02:00
Sebastian Golebiewski
f9ff518d16 DOCS shift to rst - Model Optimization Guide articles (#16598) 2023-03-31 11:26:04 +02:00
Pavel Esir
6d064d26cb remove deprecated MO args (#16626) 
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
 2023-03-31 12:28:04 +04:00
Sebastian Golebiewski
8fad140a02 DOCS shift to rst - Quantization articles (#16596) 2023-03-31 09:06:52 +02:00
Artyom Anokhov
2a01695370 Deployment Manager: updated configs with 2023.0.0 layout and versions (#16633) 2023-03-29 19:34:26 +02:00
Przemyslaw Wysocki
591c3e61c5 [PyOV] Simplify requirement files (#15343) 
* Partial progress

* Finish v1

* Cleanup

* Remove useless files

* Fix path to pdpd

* Fix onnx path

* Minor change

* Rework MO

* Minor change

* Remove some costraints

* Add MO constraints

* Update gitignore for MO

* Minor change

* Apply tech sync discussion

* Cleanup

* CR comment

* Debug ONNX FE

* simplify ONNX FE

* Update cmake

* Hardcode ONNX requirement

* Add dependency resolver to cmake

* Add constraints for openvino/tests

* Add missing pytest-html

* Fix -c path

* Revert debug changes to path

* Add cmake to copy constraints.txt

* Update dependabot

* Remove slash

* Remove cmake

* Debug prints

* Minor changes

* Move reqs check to separate file

* Add requirements parser to benchmark_tool

* Fix smoke tests constraints

* Minor fixes

* Minor change

* My fixes were apparently wrong

* Debug - self.executable_path

* Debug - add singledispatch to tests and tools

* Debug - print IE_APP_PATHs

* Revert "Debug - print IE_APP_PATHs"

This reverts commit 67ccb6d3f5.

* Revert "Debug - add singledispatch to tests and tools"

This reverts commit 3b945931e2.

* Revert "Debug - self.executable_path"

This reverts commit 3aa724eff6.

* update dependabot

* update dependabot

* Skip benchmark_app tests

* Use CMAKE_CURRENT_BINARY_DIR in cmake

* Remove debug prints

* minor change

---------

Signed-off-by: p-wysocki <przemyslaw.wysocki@intel.com>
 2023-03-29 14:27:27 +04:00
Roman Kazantsev
35e03d33bb [TF FE] Support frozen models in text protobuf format aka pbtxt (#16604) 
* [TF FE] Support frozen models in Text Protobuf format aka pbtxt

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix gen_wrapper.py for pbtxt

* Fix is_supported method

* Fix gen_wrapper.py script

* Adopt test_text_frozen_format unit-test

* Update src/frontends/tensorflow/src/frontend.cpp

* Update src/frontends/tensorflow/src/frontend.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
 2023-03-29 11:58:08 +04:00
Roman Kazantsev
966c47e7cd [MO] Remove Python version check (#16612) 
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
 2023-03-29 09:23:14 +04:00
Maxim Vafin
44f0419a0b Get mo version once (#16576) 2023-03-28 15:45:08 +00:00
Sebastian Golebiewski
1ca94326cb DOCS shift to rst - Benchmark Samples and Tools (#16566) 2023-03-27 18:29:05 +02:00
Ilya Lavrenov
3f3bda592b Revert "[MO] remove deprecated: data_type, disable_nhwc_to_nchw, tensorflow_use_custom_operations_config (#16394)" (#16555) 
This reverts commit 43ef89e625.
 2023-03-27 09:04:41 +04:00
Pavel Esir
43ef89e625 [MO] remove deprecated: data_type, disable_nhwc_to_nchw, tensorflow_use_custom_operations_config (#16394) 
* removed deprecated MO options: data_type, disable_nhwc_to_nchw, tensorflow_use_custom_operations_config

* fix layer_test_class.py

* data_type -> precision in layer_test_class.py

* typo fix

* corrected layer tests for compress_to_fp16 argument
 2023-03-26 21:38:15 +04:00
Ekaterina Aidova
179403ddc9 [PT FE]: improve integration into mo.convert_model (#16243) 2023-03-24 16:55:07 +01:00
Zlobin Vladimir
69cec4a5e2 py/benchmark_app: fix -hint (#16511) 
* py/benchmark_app: fix -hint

Don't warn about values which are explicitly set in -hint.
That aligns C++ and Python implementations.

Ticket 106544

* Remove extra throw

* Fix code style
 2023-03-24 10:24:08 +04:00
Przemyslaw Wysocki
52b27d82c5 Upgrade ONNX to 1.13, protobuf to 3.20.3 and relax tensorflow (#14773) 
* Bump ONNX version

* Bump protobuf

* Add xfails and skips

* Add tickets

* Skip ONNX Serialization tests

* Compile ONNX with C++17

* Force cpp17 - 2

* Use MSVC check

* Update tensorflow

* Minor change

* Bump onnx to 1.13.1

* Bump protobuf to 3.20.3

* Debug test tf

* Xfail tests in comp

* Update comp tests

* Update tf reqs

* Remove deprecated ONNX function

* Align PDPD FE protobuf req with 2.4.1

* Satisfy dependency review

* Attempt to fix dependency review

* Revert pdpd protobuf

* Skip pdpd tests

* Fix MO-TF-PB test

* Skip TF test case

* Add ticket numbers, rewrite reqs

* Fix requirements

* Minor change

* Set TF to 2.12

* Remove wrapt and skip test
 2023-03-24 00:43:01 +04:00
Anastasia Kuporosova
982e1c1192 [PyOV] Fix issues with RTMap (#15636) 
* [PyOV] Fix issues with RTMap

* update year

* some clean-up and items fix

* tests and small fixes

* Update src/bindings/python/src/pyopenvino/utils/utils.cpp

* undo changes

* fix serialization on python side

* rt_info as rt_map

* undo several changes in tests

* fix mo test

* sadd docstrings

* add tests

* fix codestyle

* try to fix win

* fix master

* apply comments
 2023-03-23 10:29:32 +01:00
Sebastian Golebiewski
5fa95ff19d DOCS shift to rst - Protecting Deep Learning Model (#16474) 2023-03-23 10:12:13 +01:00
Liubov Talamanova
d402b6ed3e [POT] Return Mul to ignored ops for transformers (except CPU_SPR) (#16407) 2023-03-21 14:53:01 +04:00
Maxim Vafin
7d56c75d65 Fix MO Reader for Squeeze without axes (#16398) 
* Fix MO Reader for Squeeze without axes

* Fix style

* Update tools/mo/openvino/tools/mo/utils/ir_reader/internal_ops/squeeze.py
 2023-03-21 10:28:58 +01:00
Ilya Lavrenov
0c99135d44 Improved properties handling between Core and plugins (#16296) 
* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Multiple improvements

* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Code style, bugfix after merging improvement

* More improvements

* Even more improvements

* Commit changes in core_impl.cpp

* Added parsing of any maps

* Fixed code-style

* Fixed AB mock tests build

* Fixed comparison

* Added new AB config key

* Improvements and fixes (#147)

* Fix BA, fix GetSupportedConfig call for virtual plugins (#148)

* Fix GPU tests (#149)

* Fix BA, fix GetSupportedConfig call for virtual plugins

* Fix GPU tests

* Code style

* Improvements 10

* Fixed incorrect tests

* Revert removal cache_dir

* Revert removal cache_dir

* Fixed clean

* Supported device ID in CPU

* More fixed tests

* clang-format

* Fix legacy GPU tests (#150)

* Removed clone_map

* clang-format

* Added clone_map back

---------

Co-authored-by: Nadezhda Ageeva <nadezhda.ageeva@intel.com>
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
 2023-03-20 12:42:40 +00:00
Sebastian Golebiewski
8b31e3aafe DOCS shift to rst - Quantizing models article (#16260) 2023-03-20 13:13:05 +01:00
Roman Kazantsev
997414c64d [MO][TF FE] Do not print TF FE message in case of fallback (#16384) 
* [MO][TF FE] Do not print TF FE message in case of fallback

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Correct test model with Switch and Merge

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
 2023-03-20 10:06:45 +00:00
Anastasiia Pnevskaia
9462b3ea16 Fixed clearing of pipeline config params and TF session in convert_model() (#16191) 
* Fixed pipeline config params clearing.

* Added clearing of TF session. Added tests.
 2023-03-13 20:03:02 +04:00
Georgy Krivoruchko
ca6ad433e4 Updated reading file (#16203) 2023-03-13 19:49:57 +04:00
Ilya Lavrenov
f080a0d9cf Added NCC style for frontends sources (#16200) 
* Ability to provide several source dirs for ncc-style checks

* Fixed include headers; added NCC to TF common

* Fixed NCC for frontends

* Fixed NCC for frontends

* Extra fixes

* Fixest push --f

* Clang-format

* Apply comments

* Add an option to specify required clang-format version

* Update src/frontends/tensorflow/src/decoder_proto.cpp

* Update src/frontends/tensorflow/src/decoder_proto.cpp
 2023-03-13 14:54:00 +00:00
Piotr Krzemiński
2eef025773 [PYTHON] Introduce Json Statistics Report aligned with C++ version (#15692) 
* [PYTHON] Introduce Json Statistics Report aligned with C++ version

* [PYTHON] Update README with new json_stats flag

* [PYTHON] Fix missing StatisticsReportConfig compilation error

* [PYTHON] Fix README formatting

* [PYTHON] Fix indent, fix pcsort error thrown for timedelta/int type mismatch, fix some compilation errors

* [PYTHON] Apply Pythonization ideas & fix JSON report showing incorrect category results

* Update tools/benchmark_tool/openvino/tools/benchmark/utils/statistics_report.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [PYHON] Align multiple-iterations behavior for reports

---------

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
 2023-03-13 13:58:40 +04:00
Roman Kazantsev
32ac952e5f [TF FE] Convert a model with Framework nodes (#16053) 
* [TF FE] Convert a model with Framework nodes

Now the conversion pipeline will convert all unsupported operations to Framework nodes
It is done with a hope that sub-graphs with Framework Nodes will be cut in later stages
like auto-pruning.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue

* Fix dynamic element type for FusedBatchNorm

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue

* Fix build issue

* Continue translation in case translator limitation

* Change undefined to dynamic type

* Have one more change to dynamic type

* Change undefined to dynamic in Const translator

* Expect MO to handle dynamic type

* Exclude TransposeSinking pass if model contains Framework nodes

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
 2023-03-12 01:42:34 +00:00
Maciej Smyk
5e406a80d3 [DOCS] OpenVINO Wiki links update - master (#16219) 
* wiki links
 2023-03-10 16:16:14 +01:00
Daria Mityagina
34bab897d6 [VPUX] - benchmark app issue fix - PERFORMANCE_HINT: UNDEFINED (#16065) 
* [VPUX] - benchmark_app issue

* [VPUX] - benchmark_app issue - review
 2023-03-10 12:46:51 +04:00
Maksim Proshin
f04507f56c Added "accuracy" value for "preset" parameter (#16016) 
Added "accuracy" value for "preset" parameter
 2023-03-09 14:59:29 +04:00
Maxim Vafin
feb448cc89 Fix MO IR Reader for Eye op (#15996) 
* Fix MO IR Reader for Eye op

* Fix eye value infer

* Remove debug output

* Add test for eye value infer

* Fix bom tests

* Fix alphabetical order
 2023-03-07 20:30:14 +04:00
Liubov Talamanova
e6ad0a5154 [POT] Removed Multiply from ignored ops for transformers (#15600) 
* [POT] Removed Multiply from ignored ops for transformers

* Add VPU to change_configurations_by_model_type
 2023-03-07 14:37:29 +00:00
Xuejun Zhai
9b97235902 Xuejun/remove api in ov any (#15667) 
* [Remove APIs] remove ov::any api  &

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any api

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove interfaces in ov::any  Base* operator->() & const Base* operator->()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any interfaces Base* get() & const Base* get()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any interfaces call(const Any& any) & dynamic_pointer_cast(const ::ov::Any& any) & static_pointer_cast(const ::ov::Any& any)

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issues in ov::any

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix review issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] clear code

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix review issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* Fix variant error

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
Signed-off-by: xuejun <xuejun.zhai@intel.com>
 2023-03-06 10:24:08 +04:00
Andrei Kochin
6a39d466a4 [MO] Update reminder message for 2023.0 (#16094) 2023-03-04 13:13:11 +04:00
Anastasiia Pnevskaia
9efdb38b96 convert_model() legacy extensions fix (#15742) 
* Fixed legacy extensions passing to MO tool.

* Added tests.

* Corrected test.

* Add debug print.

* Moved tests to layer tests.

* Added comment.

* Moved legacy ext tests to separate file. Fixed tmp .pb file cleaning.

* Small correction.

* Run MO Python API tests directory in CI.

* Small fix.

* Fix for case of splitted output.

* Corrected imports.

* Corrected imports.

* Added run of legacy extensions tests from subprocess.
 2023-03-03 09:59:30 +04:00