* Moved and merged mo/ and extensions/ into openvino/tools/mo
* edited imports
* edited docs to use mo script from entry_point
* edited MO transformations list loading and setup.py
* changed full path -> 'mo' entry point in docs (leftovers)
* corrected package_BOM
* updated resolving --transformation_config in cli_parser.py
* pkgutil-style __init__.py, added summarize_graph into entry points
* updated DOCs for the new --transformations_config
* fix select
* updated install instructions, fixed setup.py for windows and python_version < 3.8
* fixed typo in requirements.txt
* resolved conflicts
* removed creating custom __init__.py from setup.py
* corrected folder with caffe proto
* corrected loading user defined extensions
* fix openvino.tools.mo import in serialize.py
* corrected layer tests for new namespace
* fix in get_testdata.py
* moved model-optimizer into tools/
* renamed import in POT
* corrected mo.yml
* correct CMakeLists.txt for the newest tools/mo
* corrected find_ie_version.py
* docs and openvino-dev setup.py update for the newest tools/mo
* miscellaneous leftovers and fixes
* corrected CI files, pybind11_add_module in CMakeLists.txt and use of tools/mo path instead of tools/model_optimizer
* add_subdirectory pybind11 for tools/mo
* POT path fix
* updated setupvars.sh setupvars.bat
* Revert "updated setupvars.sh setupvars.bat"
This reverts commit c011142340.
* removed model-optimizer env variables from setupvars
* updated CMakeLists.txt to pack MO properly with tests component
* corrected left imports, corrected loading requirements for layer tests
* mo doc typo correction
* minor corrections in docs; removed summarize_graph from entry_points
* get_started_windows.md, MonoDepth_how_to.md corrections, mo path corrections
* initial solution
* changed namespaces from ngraph -> ov; completed unit-tests
* added Power with negative exponent into the pattern
* division to -> division by; aligned with OV new folder structure; some minor corrections
* corrected pattern
* changed get_pattern_value_map -> get_pattern_map
* Initial version (no tests)
* Added tests
* Fix centos
* Applied review comments
* Renamed 'ov::util::get_batch_size' to 'ov::pass::get_batch'. For set_batch_size update is the same
* Changed to ov::get_batch and ov::set_batch
In case of partially-dynamic shape, e.g. {?,3,?,?} shape inference
for gathering channels and reverse operations can't infer final shape to {?,3,?,?} and it becomes {?,?,?,?}
Added 'static' version of reverse-channels to preserve output shape for such cases
It can be changed in future if operations will be able to calculate shape on 'validate' phase
* Preprocessing API - base classes
Includes API definition for trivial mean/scale operations (which don't require layout)
Mean/scale with 'layout' support will be done under separate task together
with Layout
Current test code coverage: 100%
* Python bindings for base preprocessing API
* remove pre_post_process directory from ngraph/core
* remove files from ngraph/python dir
* move pyngraph pre_post_process files from ngraph/python to runtime
* remove pre_post_process test from CMakeList
* move include to the header
* update include path for pre_post_process
* style fix
* bind InputTensorInfo::set_layout
* cleaned test_preprocess
* fix test expected output
* remove duplicate test
* update description of set_element_type
* fix style
* move preprocess from pyngraph to pyopenvino/graph
* update test_preprocess imports and remove unnecessary test
* remove duplicate import
* update custom method
* update test
* update test
* create decorator that changes Node into Output<Node>
* create function that cast Node to Output<Node>
* update test_preprocess to use decorator for custom function
* change _cast_to_output -> _from_node
* move frontend folder to pyopenvino
* rename includes and add compile options
* include frontend to pyopenvino
* move __init__.py
* move tests
* remove mock from tests_compatibility
* rename import module
* Fix code style cpp
* refactor a few lines
* style fix
* update few lines in mo
* add tests fro scale and mean with vector input
* style fix
* add docstring for custom_preprocess_function
* bind InputInfo network method
* style fix
* Add pyopenvino to dependencies
* bind OutputInfo
* fix description of preprocess submodule
* fix style
* update copyright year
* Fix mock
* update docstring
* bind OutputTensorInfo
* bind OutputNetworkInfo and InputNetworkInfo
* bind ColorFormat and ResizeAlgorithm
* clean imports
* fix typo
* add PostProcessSteps to init
* bind PreProcessSteps
* create additional tests
* Fix mo test
* remove module local
* fix code style
* update comment
* fix return type
* update docs
* fix code style
* change ngraph.Type to ov.Type
* fix typo
* move _from_node to node_output.hpp
* add read_model from buffer
* update imports
* add new line
* remove bad quotes
* update imports
* style fix
* add new line
* rename functin args
* remove Type import
* update tests
* style fix
* test clean
* remove blank line
* update PrePostProcessor init and build methods
* create test with model update tests with new PrePostProcessor init and build
* # Conflicts:
# inference-engine/ie_bridges/python/src/openvino/offline_transformations/offline_transformations_api.pyx
# inference-engine/ie_bridges/python/src/openvino/offline_transformations/offline_transformations_api_impl.cpp
# inference-engine/ie_bridges/python/src/openvino/offline_transformations/offline_transformations_api_impl.hpp
# inference-engine/ie_bridges/python/src/openvino/offline_transformations/offline_transformations_api_impl_defs.pxd
# inference-engine/tests/ie_test_utils/common_test_utils/ngraph_test_utils.cpp
# inference-engine/tests/ie_test_utils/common_test_utils/ngraph_test_utils.hpp
# model-optimizer/mo/moc_frontend/serialize.py
# thirdparty/gflags/gflags
# thirdparty/gtest/gtest
* Stash
* move preprocess module from openvino.impl to openvino
* fix building
* fix code style
* try to move MO to use new api
* Intermediate commit
* try to move MO to use new api
* Test pybind11 custom holder for Preprocessing types (InputInfo and PreProcessingSteps)
* Initial code for source_target layout handling for preprocessing
Initial implementation of reverse input channels
* Use input's tensor names instead of friendly names
* Skeleton for guessing layouts and clearing it after preprocessing
* updated package_BOM.txt
* Use reference_wrapper for preprocess bindings
* Update tests
* Layout::find_permutation - support of dynamic layouts
Covered case for 'trivial convert' where no permutation is needed
It is needed for Model Optimizer for logic which will guess model's layout, like "?c??"
* Stash
* add bindings to I420_SINGLE_PLANE and I420_THREE_PLANES
* remove init from all classes except PrePostProcessor and add RGBX and BGRX to ColorFormat enum
* Guess layout so that existing mean/scale tests passed
* update test name
* Draft to guess layout for 'reverse_input_channels'
* More unit tests (error cases)
* pylint & flake8
* pylint - ignore import error
* Stash
* Moved preprocessing to 'back' folder
* More tests
* Update package_BOM
* Support layout_values with no names
Support layout set for 'outputs'
Tests
* Export more enum names from nrgaph
* Basic --layout parsing
* removed debug prints
* Further updates after rebase
* Update imports
* Removed part from 8829
* Fix imports in test code
* Minor cosmetics
* Don't guess 'C' if layout is already set by model
Expose 'Layout::empty' method
* Style fix
* Apply review comments
Restricted 'heuristics'
C++: Added 'fp16', 'fp64' support to mean/scale
* Applied review comments
* Added some dynamic test cases
* Move call of 'apply_preprocessing' to 'serialize.py'
* Unnecessary change
* Added more comments to code
Co-authored-by: pszmel <piotr.szmelczynski@intel.com>
Co-authored-by: Alexey Lebedev <alexey.lebedev@intel.com>
Co-authored-by: bszmelcz <bartosz.szmelczynski@intel.com>
Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: y <ilya.lavrenov@intel.com>
Co-authored-by: Vafin, Maxim <maxim.vafin@intel.com>
* Fix for bfyx conv performance issue.
PR 6399 was for wide palne + shallow featuremap cases.
If the plane is too small so that the increased computation due toe the alignment for block_size is relatively large, performance drops.
* Fix for bfyx conv performance issue. Use subgroup size 16 when output feature size is >= 8 instead of > 8
* Set bfyx convolution subgroup size to be 16 when output_feature size is 8 and the dtype is fp16
* hard code for num request and lantency for cpu
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* modify load count in test
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix HELP and ACTURAL IS ALL CPU issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* use max(4, MetricValueFromFirstLoadedDevice)
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* add test case
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix a logic error
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* test draft
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix test code issue
gmock will call ostreamer << ov::Any when GetMetric
this will cause core dump
add special gtest Printo function for it
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* change max from 4 to 8
add some comment for test
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* go back to origin code that not need to change
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update the comment of testconfig
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* try to fix windows compile issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* cover the case of CPU_HELP and CPU have the same config
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* add test case for latency and throughput
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* change directory
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* change sleep time from 1000ms to 100ms
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* Update model compression pass and FQ values precision
* Pylint fixes
* Fix for case with 2 or more destinations
* Update pass.py from suggestion
Co-authored-by: Anton Chetverikov <Anton.Chetverikov@intel.com>
* Update with the const condition
* Update ref
* Revert ref and update data_type for FQ consts
Co-authored-by: Anton Chetverikov <Anton.Chetverikov@intel.com>
* Implement MO part for DetectionOutput-8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement nGraph part for DetectionOutput-8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement deduction of a number of classes method
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix build
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement nGraph tests to check shape inference for DetectionOutput-8 with deduction of num_classes
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement attributes tests for DetectionOutput-8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove DetectionOutput-1 from opset8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add python bindings for DetectionOutput-8 and tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement downgrading and upgrading transformations for DetectionOutput
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement tests for downgrading and upgrading transformations for DetectionOutput
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Adopt existing reference for DetectionOutput-8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix DetectionOutput-8 reference
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add tests for DetectionOutput-8 reference
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Finish resolving merge conflict
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix python bindings after re-structuring
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix BOM package list
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix multibox_detection_test
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix python bindings for DetectionOutput-8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Insert blank line between summary and description for python binding
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply review comments: identation, for loop
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix formatting in python bindings
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix supported_attrs for DetectionOutput from opset1
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add missed imports for python if_op
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply feedback and fix Win build
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Use the same test suite name for test mixture
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix transformation tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Recover BWDCMP_RTTI for legacy use and remove unused variables in tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove unused variables in type_prop tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Recover legacy referenceDetectionOutput constructor
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix python binding for DetectionOutput
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* include api changes
* include api changes for executable_network
* Create InferVec container
* update infer method
* update infer methods in ie_api
* update runtime to work with dict
* update infer_engine test to work with infer returning dict
* remove inferMap container
* add return type to infer and infer_new_request in ie_api
* add auto to infer loops
* fix typo
* change OrderedDict to dict
* change infer methods return type to dict
* update infer methods to return py::dict
* style fix
* create helper function outputs_to_dict
* remove InferMap and InferVec
* remove unused imports
* add const to outputs
* add get_result method
* add test for get_results
* style fix
* add reference to outputs_to_dict parameters
* remove blank line
* fix style
* change get_results method to result property
* code fix in ie_api
* add f16 and bf16 support to outputs_to_dict function
* update the way of receiving keys from dict
* update the way of key receive in test_core
* add test for reslts attribute for async infer
* remove out of date comment
* add view(int16) to bf16 and f16 in outputs_to_dict() function
* [CPU][Tests] Decreased number of test cases for Interpolate, Reduce and Pad operations
* [CPU][Tests] Reduced number of DeformableConvolution smoke test cases
* Fixed review comments
* Added debug print.
* Deleted debug print.
* Written the header file of the transformation NearestNeighborUpsamplingFusion.
* Started to write an implementation of the transformation NearestNeighborUpsamplingFusion.
* Small fix.
* Some additions.
* Written a function that checks one of Concat node of the pattern.
* Code style fix.
* Small fix.
* Small fix.
* Written the function that check concat_2 node of the pattern.
* Written all checks of applicability of the transformation NearestNeighborUpsamplingFusion.
* Written the draft of the nGraph transformation NearestNeighborUpsamplingFusion.
* Some fixes.
* Started to write tests for the nGraph transformation NearestNeighborUpsamplingFusion.
* Small fix.
* Fixes in pattern.
* Fixes in test.
* Small fix.
* Added other test.
* Deleted commented code.
* Small fixes.
* Added comment about the transformation.
* Small fixes.
* Added description of the function get_scales_from_mul_const_shape().
* Small fix.
* Used input_value(0) instead of input_value(0).get_node_shared_ptr() for nodes before shapeof and reshape_1.
* Used pattern_to_output for concat_1 instead of graph traversing.
* Deleted commented code.
* Check reshape_1_node->get_input_partial_shape(0).is_dynamic() was moved into the pattern.
* Added has_static_shape() for mul_const element of the pattern.
* Added comment about the function get_new_spatial_shape_from_concat_2().
* Added the transformation NearestNeighborUpsamplingFusion into MOC transformations pipeline.
* Used type of elements of the pattern root into 'scales'.
* Moved transformation.
