* [TF FE] Support conversion of models with non-standard extensions in the path
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update tools/mo/unit_tests/moc_tf_fe/conversion_basic_models.py
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update ov::hint::performance_hint UNDEFINED value from empty string to "UNDEFINED".
* Update benchmark Python version.
* Update.
* Update.
* Update.
* Update the description about hint setting within benchmark APP README and help message.
* enable --compress_to_fp16 by default in MO
* corrected docs, added warning if user did't specify --compress_to_fp16 explicitly
* fix failing MO unit-tests
* do not wipe out data_type if user defined it explicitly by cli argument
* updated warning message and docs
* corrected phrasing
* corrected phrasing in FP16_Compression.md
* set compress_to_fp16=False for convert tests
* leftover: set compress_to_fp16=False for convert tests
* minor correction
* print info message in main.py, som minor changes
* typos fix
* fix losing information whether arguments set by user or got from defaults
* returned back default values instead of None
* more selective correcting of test_mo_convert_pytorch.py; added test for cases when compression is enabled/disabled or left by default
* fix test_mo_convert_pytorch.py
* Disable set_property() to support ov::device::properties setting.
* Update benchmark APP to set device properties through compile_model() instead of through set_property().
* Update.
* Update.
* Update some test case including ov::device::properties setting via core.ser_property().
* Since core.set_property() didn't support ov::device::properties setting, just remove the test case to check compile_model() works well if setting ov::device::properties via core.set_property() first.
* Update CompileModel in test name to CompiledModel
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Add corresponding test case.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
* Update.
* Remove the changes of this commit as this modification has nothing to do
with this PR.
This reverts commit 4f04b9f085.
---------
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* [WIP]: poc: integrate pt fe to mo.convert_model
* temporaly resolve names using signature inspection
* fix logic
* move to moc frontend
* add rank and data type setting
* add input signature
* apply comments
* move after convert processing
* support work without example_input, provide parameters description
* ignore extensions on fe side
* upd tests
* more tests
* add notes about extensions support and removing onnx path
* remove debug prints
* refactoring
* update BOM
* benchmark_app: factor out advanced options
* cpp/benchmark_app: add usage word
* move api to advanced, group b/shape/data_shape/layout into Input shapes, factor out Statistics dumping options
* Factor out Device-specific performance options
* Factor out Preprocessing options
* Minor regroup
* [C++/BENCHMARK_APP] Introduce Numpy array loading for C++ benchmark app
* [DOCS/BENCHMARK_APP] Update docs to reflect changes, update list of available extensions from OpenCV, align help messages
* Update inputs_filling.cpp
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update samples/cpp/benchmark_app/inputs_filling.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [C++/Python] Implement quality-of-life improvements from PR comments
* [C++] Fix compilation errors, fix linter output
* [C++/PYTHON] Apply requested changes
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update samples/cpp/benchmark_app/utils.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON] Separate loading of numpy arrays similar to images
* [PYTHON] Remove unnecessary 'Prepare xxx file' print
* Update README again because IF OPENCV.. dissapeared for some reason
* Update second README with missing IF OPENCV..
* [C++] Remove unnecessary vector print function
* [C++ Add Numpy processing function - TODO link it to the tensor filling
* Reverse OneDnn plugin modification
* [C++] Numpy array loading for C++
* [C++] Add (almost) all missing types of data
* Reverse submodule modifications
* [C++/PYTHON] Fix compilation errors, clean code
* [C++] Modify supported extensions, add numpy checking to utils, add numpy to get_image_info method
* Update samples/cpp/benchmark_app/inputs_filling.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [C++] Fix utils header file to reflect unordered set change
* [PYTHON/C++] Fix compilation errors in C++ code, fix Python dynamic shapes numpy loading
* [C++] Fix explicit instantiation of NumpyArray reader
* [C++] Clang format, minor syntax fixes
* [PYTHON/C++] Remove unnecessary data types, introduce a new approach to cast data of different types from format_rt_reader, remove uppercase types from Python precision parameters
* [PYTHON] Update README to reflect new precision settings
* [PYTHON] Fix README, fix clang format
* [C++] Clean headers
* [C++] Fix uninitialized variable error
* [C++/PYTHON] Fixed choices in Python benchmark, fixed types in C++ benchmark
* [C++] Fixed ov::float16conversion, fixed Python types map - removed redundancies
* [C++] Add back boolean support
* [C++] Fix compilation errors
---------
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Port changes for installing GPU driver from 2022.3 branch.
* install_openvino_dependencies: Fixed syntax after ShellCheck
---------
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
* [TF FE] Support TensorList operations and RNN layers
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove TensorList operations from the fallback
* Fix computation of dummy tensor size
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Added import model from memory for TF FE using string.
* Small correction.
* Clang format.
* Code correction.
* Implemented model importing to TF FE using temporary file.
* Removed wrong changes.
* Added check.
* Removed code duplication.
* Corrected logging of cli parameters.
* Remove "OV_FRONTEND_PATH" from `FrontEndManager`
* Remove "OV_FRONTEND_PATH" from layer_tests
* Remove "OV_FRONTEND_PATH" from find_ie_version.py
* Remove "OV_FRONTEND_PATH" from .ci/
* Move `ov::get_plugin_path` to file_util.hpp (ov::util)
* Add `register_front_end(name, path)` FEM public API
* Enable frontend/ tests
* ClangFormat
* Remove OV_FRONTEND_PATH from FE shared utils
* Add `register_front_end()` to PythonAPI
* Update Py tests with registering of "mock_py" FE
* ClangFormat
* Leftovers
* Fix SegFault with `register_front_end(name, lib_path)`
* Add FE_LIB_PRE and FE_LIB_SUFFIX to `ov_core_unit_tests`
* Fix format
* Update `testFailRegisterFEByWrongPath`
* Infrastructure for tflite
* Removed submodule flatbuffers
* Added flatbuffers submodule. Fixed version to v22.12.06 aka acf39ff
* Move headers back
* Flatbuffers integration
* Small fixes
* Started parsing the Model
* flatbuffer changes
* decoder_flatbuffer changes
* Lite Input Model -- not needed as of now but looks cool
* Rolled back inherritance from ov::frontend::tensorflow::InputModel
* Results are not treated as outputs, but its ok
* Fix missplaced input vs output
* Refactor
* Load model op-by-op. Frontend API finalized
* Debugging still, there are prints here and there. Decoder is not sane
* Convolution with all attributes is translated and quantization is applied for inputs and constatants. TODO: quantize intermediate tensors, separate decoder specific logic?
* Float ssd and posenet models are showing good accuracy
* Need to refactor but work flawlessly
* Telemetry and lightweight model cutting
* Code style and test changes. Extensions supported
* Quantization and style
* Style refinements
* Move onednn back
* New portion of operations enabled
* TFLite FE doesn't inherrit TF FE
* Moved files to another directory
* Rename header op_table.hpp to common_op_table.hpp for all files in src/frontends/tensorflow_common/src/op/
* Removed visability macroses
* CMake changes
* Unit-test execution in .ci
* Update labeler.yml
* Codeowners
* Style check and fix
* Static Build arrangement
* Addressing the comments
* install common headers to previous place
* New approach with public decoder and graph_iterator
* New approach with public decoder and graph_iterator
* Move GraphIterator back
* Comments addressed
* Comments adressed
* Preliminary TF FE README.md changes
* Added target_compile_definitions OPENVINO_STATIC_LIBRARY for static build
* Fixed conflicts and added TF to common places
* Frontends use only openvino::core::dev API
* Merged common tensorflow changes and made code build and work on selective number of models
* Style
* Rollback unnecessary changes from Tensorflow FE
* Rollback unnecessary changes from Tensorflow Common
* Minor refactor
* cmake minor refactoring
* Mixed commit
* Style and merge fix
* Low hanging fruit operations
* Fix windows build
* Refactor quantization parameters representation
* license compliance. approved by OS PDT
* copyrights in generic file
* dependabot
* labeler
* Unit Test to be triggered in CI
* cmake variables naming. corrected copyright years in copyrights/generic file
* library renamed in .ci/ calls
* Copyright year update
* Set openvino-tf-frontend-maintainers as owner of /src/frontends/tensorflow_lite/
* Fixed flatc corss-compilation
* Cleaned flatbuffers header usage
* Nitpicks solved
* Update cmake/templates/OpenVINOConfig.cmake.in
* Compile with flatbuffers headers
* Fixed "which is prefixed in the source directory"
* Fixed typo in flatbuffers cmake
* Removed flatbuffers submodule
* Added fork submodule
* Fixed static build
* Fixed cross-compilatio
* Fixed -Wshadow warning
* Fixed warning on Windows
* Use only headers from flatbuffers library
* Added LTO and fixed compilation errors on Windows
* Fixed warnings in tensorflow_common
* Move ctors implementation to cpp file
* Added information about new frontends to common FEm part
* Temporaryily disable warnings
* Fixed code style using clang-format
* Fixed Windows
* reverted changes in onnx
* Revert changes in onnx_common
* Removed pragma once frm cpp
Co-authored-by: missjane <estepyreva@gmail.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* [MO][TF FE] Switch MO to TF FE in default mode
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code-style
* Extend operations for the fallback
* Fix MO unit-tests
* Check only legacy FE for read-from-memory functionality
* Fix failures in IR comparator tests
* Fallback to the legacy FE in case tensorflow_custom_operations_config_update
* Revert copyright and update
* Fix unit-test since it is oriented for the legacy FE
* Fallback to the legacy FE in case deprecated config options
* Fix value propagation from deprecated config option
* Fix the Result node name in case cutting by input port for outputs
* Set Result node name aligned with the Legacy Frontend
* Reformat a list of operations to fallback
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fixed ObjectDetectionAPIProposalReplacement() to get correct CropAndResize node.
* Small correction.
* Moved topological sort with start node to separate method, added tests.
* Simplified code.
* Removed input_model from meta data dictionary.
* Added test.
* Changed check for more general case.
* Test fixed.
* Temporarily added debug print.
* Fixed test.
* Code corrections.
* Small correction.
* Added type check.
* Added comments, small corrections.
* Refactored MO convert_model() to have single parse_args().
* Small correction.
* Fixed PyTorch converting.
* Small correction.
* Code refactoring, added tests.
* fix checking if there are data nodes for operations with several outputs
* added unit-test
* added ports explicitly, removed redundant lambda
* typo in port
* removed deprecated cli arguments from MO
* removed deprecated options from docs
* Update tools/legacy/benchmark_app/README.md
* removed ConcatOptimization.py, removed deprecated args from unit-tests, renamed tensorflow_use_custom_operations_config -> transformations_config; replaced using or cmd_params.data_type -> cmd_params.compress_to_fp16
* added comment why we set internal 'data_type' always to 'FP32' after introducing 'compress_to_fp16'
* removed openvino_docs_MO_DG_prepare_model_Model_Optimization_Techniques from MO_DevGuide
* returned back --data_type argument
* leftovers from recovering
* returned back to package_BOM.txt; fixed NHWC by default for TF
* recovered --disable_nhwc_to_nchw to MO args
* reverted removing --tensorflow_use_custom_operations_config
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* [Python] Align pc output in Python benchmark, update sorted output to new headers, print floats with 6-digit precision, fix date format printing to excel-friendly
* [PYTHON/C++] Change precision of raports and pc counters report, simplify code
* [C++] Align C++ benchamrk_app report to Python's by setting the precision value to 3
* [C++] Fix CsvDumper precision
* [C++/PYTHON] Align pcand pcsort outputs, merge C++ printSort methods into one
* Update samples/cpp/common/utils/include/samples/common.hpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update samples/cpp/common/utils/include/samples/common.hpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [Tools][MO] Clean up requirements for default installation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update azure config files with extras
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Cleaned up requirements in POT
* Fixed issue
* Removed pandas usage from POT
* Update setup.py
* Removed the upperbound for numpy in the case of Python < 3.11
* Removed numpy logic
