Files

Andrey Zaytsev 4ae6258bed Feature/azaytsev/from 2021 4 (#9247 )

* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Updated the link to software license agreements

* Revert "Updated the link to software license agreements"

This reverts commit 706dac500e.

* Docs to Sphinx (#8151)

* docs to sphinx

* Update GPU.md

* Update CPU.md

* Update AUTO.md

* Update performance_int8_vs_fp32.md

* update

* update md

* updates

* disable doc ci

* disable ci

* fix index.rst

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
# Conflicts:
#	.gitignore
#	docs/CMakeLists.txt
#	docs/IE_DG/Deep_Learning_Inference_Engine_DevGuide.md
#	docs/IE_DG/Extensibility_DG/Custom_ONNX_Ops.md
#	docs/IE_DG/Extensibility_DG/VPU_Kernel.md
#	docs/IE_DG/InferenceEngine_QueryAPI.md
#	docs/IE_DG/Int8Inference.md
#	docs/IE_DG/Integrate_with_customer_application_new_API.md
#	docs/IE_DG/Model_caching_overview.md
#	docs/IE_DG/supported_plugins/GPU_RemoteBlob_API.md
#	docs/IE_DG/supported_plugins/HETERO.md
#	docs/IE_DG/supported_plugins/MULTI.md
#	docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Caffe.md
#	docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Kaldi.md
#	docs/MO_DG/prepare_model/convert_model/Convert_Model_From_MxNet.md
#	docs/MO_DG/prepare_model/convert_model/Convert_Model_From_ONNX.md
#	docs/MO_DG/prepare_model/convert_model/Converting_Model.md
#	docs/MO_DG/prepare_model/convert_model/Converting_Model_General.md
#	docs/MO_DG/prepare_model/convert_model/Cutting_Model.md
#	docs/MO_DG/prepare_model/convert_model/pytorch_specific/Convert_RNNT.md
#	docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_EfficientDet_Models.md
#	docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_WideAndDeep_Family_Models.md
#	docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_YOLO_From_Tensorflow.md
#	docs/doxygen/Doxyfile.config
#	docs/doxygen/ie_docs.xml
#	docs/doxygen/ie_plugin_api.config
#	docs/doxygen/ngraph_cpp_api.config
#	docs/doxygen/openvino_docs.xml
#	docs/get_started/get_started_macos.md
#	docs/get_started/get_started_raspbian.md
#	docs/get_started/get_started_windows.md
#	docs/img/cpu_int8_flow.png
#	docs/index.md
#	docs/install_guides/VisionAcceleratorFPGA_Configure.md
#	docs/install_guides/VisionAcceleratorFPGA_Configure_Windows.md
#	docs/install_guides/deployment-manager-tool.md
#	docs/install_guides/installing-openvino-linux.md
#	docs/install_guides/installing-openvino-macos.md
#	docs/install_guides/installing-openvino-windows.md
#	docs/optimization_guide/dldt_optimization_guide.md
#	inference-engine/ie_bridges/c/include/c_api/ie_c_api.h
#	inference-engine/ie_bridges/python/docs/api_overview.md
#	inference-engine/ie_bridges/python/sample/ngraph_function_creation_sample/README.md
#	inference-engine/ie_bridges/python/sample/speech_sample/README.md
#	inference-engine/ie_bridges/python/src/openvino/inference_engine/ie_api.pyx
#	inference-engine/include/ie_api.h
#	inference-engine/include/ie_core.hpp
#	inference-engine/include/ie_version.hpp
#	inference-engine/samples/benchmark_app/README.md
#	inference-engine/samples/speech_sample/README.md
#	inference-engine/src/plugin_api/exec_graph_info.hpp
#	inference-engine/src/plugin_api/file_utils.h
#	inference-engine/src/transformations/include/transformations_visibility.hpp
#	inference-engine/tools/benchmark_tool/README.md
#	ngraph/core/include/ngraph/ngraph.hpp
#	ngraph/frontend/onnx_common/include/onnx_common/parser.hpp
#	ngraph/python/src/ngraph/utils/node_factory.py
#	openvino/itt/include/openvino/itt.hpp
#	thirdparty/ade
#	tools/benchmark/README.md

* Cherry-picked remove font-family (#8211)

* Cherry-picked: Update get_started_scripts.md (#8338)

* doc updates (#8268)

* Various doc changes

* theme changes

* remove font-family (#8211)

* fix  css

* Update uninstalling-openvino.md

* fix css

* fix

* Fixes for Installation Guides

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
Co-authored-by: kblaszczak-intel <karol.blaszczak@intel.com>
# Conflicts:
#	docs/IE_DG/Bfloat16Inference.md
#	docs/IE_DG/InferenceEngine_QueryAPI.md
#	docs/IE_DG/OnnxImporterTutorial.md
#	docs/IE_DG/supported_plugins/AUTO.md
#	docs/IE_DG/supported_plugins/HETERO.md
#	docs/IE_DG/supported_plugins/MULTI.md
#	docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Kaldi.md
#	docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_YOLO_From_Tensorflow.md
#	docs/install_guides/installing-openvino-macos.md
#	docs/install_guides/installing-openvino-windows.md
#	docs/ops/opset.md
#	inference-engine/samples/benchmark_app/README.md
#	inference-engine/tools/benchmark_tool/README.md
#	thirdparty/ade

* Cherry-picked: doc script changes (#8568)

* fix openvino-sphinx-theme

* add linkcheck target

* fix

* change version

* add doxygen-xfail.txt

* fix

* AA

* fix

* fix

* fix

* fix

* fix
# Conflicts:
#	thirdparty/ade

* Cherry-pick: Feature/azaytsev/doc updates gna 2021 4 2 (#8567)

* Various doc changes

* Reformatted C++/Pythob sections. Updated with info from PR8490

* additional fix

* Gemini Lake replaced with Elkhart Lake

* Fixed links in IGs, Added 12th Gen
# Conflicts:
#	docs/IE_DG/supported_plugins/GNA.md
#	thirdparty/ade

* Cherry-pick: Feature/azaytsev/doc fixes (#8897)

* Various doc changes

* Removed the empty Learning path topic

* Restored the Gemini Lake CPIU list
# Conflicts:
#	docs/IE_DG/supported_plugins/GNA.md
#	thirdparty/ade

* Cherry-pick: sphinx copybutton doxyrest code blocks (#8992)

# Conflicts:
#	thirdparty/ade

* Cherry-pick: iframe video enable fullscreen (#9041)

# Conflicts:
#	thirdparty/ade

* Cherry-pick: fix untitled titles (#9213)

# Conflicts:
#	thirdparty/ade

* Cherry-pick: perf bench graph animation (#9045)

* animation

* fix
# Conflicts:
#	thirdparty/ade

* Cherry-pick: doc pytest (#8888)

* docs pytest

* fixes
# Conflicts:
#	docs/doxygen/doxygen-ignore.txt
#	docs/scripts/ie_docs.xml
#	thirdparty/ade

* Cherry-pick: restore deleted files (#9215)

* Added new operations to the doc structure (from removed ie_docs.xml)

* Additional fixes

* Update docs/IE_DG/InferenceEngine_QueryAPI.md

Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>

* Update Custom_Layers_Guide.md

* Changes according to review  comments

* doc scripts fixes

* Update docs/IE_DG/Int8Inference.md

Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>

* Update Int8Inference.md

* update xfail

* clang format

* updated xfail

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>
Co-authored-by: kblaszczak-intel <karol.blaszczak@intel.com>
Co-authored-by: Yury Gorbachev <yury.gorbachev@intel.com>
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>

2021-12-21 20:26:37 +03:00

22 KiB

Raw Blame History

Model Optimizer Developer Guide

@sphinxdirective

.. toctree:: :maxdepth: 1 :hidden:

openvino_docs_MO_DG_prepare_model_convert_model_Converting_Model openvino_docs_MO_DG_Additional_Optimization_Use_Cases openvino_docs_MO_DG_prepare_model_customize_model_optimizer_Customize_Model_Optimizer openvino_docs_MO_DG_prepare_model_Model_Optimizer_FAQ openvino_docs_MO_DG_Known_Issues_Limitations openvino_docs_MO_DG_Default_Model_Optimizer_Optimizations

@endsphinxdirective

Introduction

Model Optimizer is a cross-platform command-line tool that facilitates the transition between the training and deployment environment, performs static model analysis, and adjusts deep learning models for optimal execution on end-point target devices.

Model Optimizer process assumes you have a network model trained using supported deep learning frameworks: Caffe*, TensorFlow*, Kaldi*, MXNet* or converted to the ONNX* format. Model Optimizer produces an Intermediate Representation (IR) of the network, which can be inferred with the Inference Engine.

Note

: Model Optimizer does not infer models. Model Optimizer is an offline tool that runs before the inference takes place.

The scheme below illustrates the typical workflow for deploying a trained deep learning model:

The IR is a pair of files describing the model:

.xml - Describes the network topology
.bin - Contains the weights and biases binary data.

Tip

: You also can work with the Model Optimizer inside the OpenVINO™ Deep Learning Workbench (DL Workbench). DL Workbench is a web-based graphical environment that enables you to optimize, fine-tune, analyze, visualize, and compare performance of deep learning models.

Install Model Optimizer Pre-Requisites

Before running the Model Optimizer, you must install the Model Optimizer pre-requisites for the framework that was used to train the model.

@sphinxdirective .. tab:: Using configuration scripts

.. tab:: Linux

  .. tab:: All frameworks
  
     .. tab:: Install globally

        .. code-block:: sh

           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           ./install_prerequisites.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh

           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           ./install_prerequisites.shs

  .. tab:: Caffe
  
     .. tab:: Install globally

        .. code-block:: sh

           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisitess
           install_prerequisites_caffe.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh

           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_caffe.shs

  .. tab:: Tensorflow 1.x
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           install_prerequisites_tf.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_tf.sh

  .. tab:: Tensorflow 2.x
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           install_prerequisites_tf2.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_tf2.sh

  .. tab:: MXNet
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           install_prerequisites_mxnet.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_mxnet.sh

  .. tab:: ONNX
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           install_prerequisites_onnx.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_onnx.sh

  .. tab:: Kaldi
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           install_prerequisites_kaldi.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_kaldi.sh

.. tab:: Windows

  .. tab:: All frameworks
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites\
           install_prerequisites.bat
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites
           virtualenv --system-site-packages -p python .\env
           env\Scripts\activate.bat
           install_prerequisites.bat

  .. tab:: Caffe
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites\
           install_prerequisites_caffe.bat
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites
           virtualenv --system-site-packages -p python .\env
           env\Scripts\activate.bat
           install_prerequisites_caffe.bat

  .. tab:: Tensorflow 1.x
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites\
           install_prerequisites_tf.bat
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites
           virtualenv --system-site-packages -p python .\env
           env\Scripts\activate.bat
           install_prerequisites_tf.bat

  .. tab:: Tensorflow 2.x
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites\
           install_prerequisites_tf2.bat
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites
           virtualenv --system-site-packages -p python .\env
           env\Scripts\activate.bat
           install_prerequisites_tf2.bat

  .. tab:: MXNet
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites\
           install_prerequisites_mxnet.bat
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites
           virtualenv --system-site-packages -p python .\env
           env\Scripts\activate.bat
           install_prerequisites_mxnet.bat

  .. tab:: ONNX
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites\
           install_prerequisites_onnx.bat
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites
           virtualenv --system-site-packages -p python .\env
           env\Scripts\activate.bat
           install_prerequisites_onnx.bat

  .. tab:: Kaldi
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites\
           install_prerequisites_kaldi.bat
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>\deployment_tools\model_optimizer\install_prerequisites
           virtualenv --system-site-packages -p python .\env
           env\Scripts\activate.bat
           install_prerequisites_kaldi.bat

.. tab:: macOS

  .. tab:: All frameworks
  
     .. tab:: Install globally

        .. code-block:: sh

           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           ./install_prerequisites.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh

           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           ./install_prerequisites.shs

  .. tab:: Caffe
  
     .. tab:: Install globally

        .. code-block:: sh

           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisitess
           install_prerequisites_caffe.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh

           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_caffe.shs

  .. tab:: Tensorflow 1.x
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           install_prerequisites_tf.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_tf.sh

  .. tab:: Tensorflow 2.x
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           install_prerequisites_tf2.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_tf2.sh

  .. tab:: MXNet
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           install_prerequisites_mxnet.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_mxnet.sh

  .. tab:: ONNX
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           install_prerequisites_onnx.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_onnx.sh

  .. tab:: Kaldi
  
     .. tab:: Install globally

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           install_prerequisites_kaldi.sh
     
     .. tab:: Install to virtualenv

        .. code-block:: sh
           
           cd <INSTALL_DIR>/deployment_tools/model_optimizer/install_prerequisites
           virtualenv --system-site-packages -p python3 ./venv
           source ./venv/bin/activate  # sh, bash, ksh, or zsh
           install_prerequisites_kaldi.sh

.. tab:: Using manual configuration process

.. tab:: Linux

  .. tab:: All frameworks
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements.txt

  .. tab:: Caffe
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_caffe.txt

  .. tab:: Tensorflow 1.x
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_tf.txt

  .. tab:: Tensorflow 2.x
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_tf2.txt

  .. tab:: MXNet
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_mxnet.txt

  .. tab:: ONNX
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_onnx.txt

  .. tab:: Kaldi
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_kaldi.txt

.. tab:: Windows

  .. tab:: All frameworks
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>\deployment_tools\model_optimizer
        virtualenv --system-site-packages -p python .\env
        env\Scripts\activate.bat
        pip install -r requirements.txt

  .. tab:: Caffe
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>\deployment_tools\model_optimizer
        virtualenv --system-site-packages -p python .\env
        env\Scripts\activate.bat
        pip install -r requirements_caffe.txt

  .. tab:: Tensorflow 1.x
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>\deployment_tools\model_optimizer
        virtualenv --system-site-packages -p python .\env
        env\Scripts\activate.bat
        pip install -r requirements_tf.txt

  .. tab:: Tensorflow 2.x
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>\deployment_tools\model_optimizer
        virtualenv --system-site-packages -p python .\env
        env\Scripts\activate.bat
        pip install -r requirements_tf2.txt

  .. tab:: MXNet
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>\deployment_tools\model_optimizer
        virtualenv --system-site-packages -p python .\env
        env\Scripts\activate.bat
        pip install -r requirements_mxnet.txt

  .. tab:: ONNX
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>\deployment_tools\model_optimizer
        virtualenv --system-site-packages -p python .\env
        env\Scripts\activate.bat
        pip install -r requirements_onnx.txt

  .. tab:: Kaldi
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>\deployment_tools\model_optimizer
        virtualenv --system-site-packages -p python .\env
        env\Scripts\activate.bat
        pip install -r requirements_kaldi.txt

.. tab:: macOS

  .. tab:: All frameworks
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements.txt

  .. tab:: Caffe
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_caffe.txt

  .. tab:: Tensorflow 1.x
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_tf.txt

  .. tab:: Tensorflow 2.x
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_tf2.txt

  .. tab:: MXNet
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_mxnet.txt

  .. tab:: ONNX
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_onnx.txt

  .. tab:: Kaldi
  
     .. code-block:: sh
           
        cd <INSTALL_DIR>/deployment_tools/model_optimizer/
        virtualenv --system-site-packages -p python3 ./venv
        source ./venv/bin/activate
        pip3 install -r requirements_kaldi.txt

@endsphinxdirective

Run Model Optimizer

To convert the model to the Intermediate Representation (IR), run Model Optimizer:

mo --input_model INPUT_MODEL --output_dir <OUTPUT_MODEL_DIR>

You need to have have write permissions for an output directory.

Note

: Some models require using additional arguments to specify conversion parameters, such as --input_shape, --scale, --scale_values, --mean_values, --mean_file. To learn about when you need to use these parameters, refer to Converting a Model to Intermediate Representation (IR).

To adjust the conversion process, you may use general parameters defined in the Converting a Model to Intermediate Representation (IR) and framework-specific parameters for:

Videos

@sphinxdirective

.. list-table::

.. raw:: html

<iframe allowfullscreen mozallowfullscreen msallowfullscreen oallowfullscreen webkitallowfullscreen width="220"
src="https://www.youtube.com/embed/Kl1ptVb7aI8">
</iframe>

.. raw:: html

<iframe allowfullscreen mozallowfullscreen msallowfullscreen oallowfullscreen webkitallowfullscreen width="220"
src="https://www.youtube.com/embed/BBt1rseDcy0">
</iframe>

.. raw:: html

<iframe allowfullscreen mozallowfullscreen msallowfullscreen oallowfullscreen webkitallowfullscreen width="220"
src="https://www.youtube.com/embed/RF8ypHyiKrY">
</iframe>

- Model Optimizer Concept.
- Model Optimizer Basic Operation.
- Choosing the Right Precision.
- Duration: 3:56
- Duration: 2:57
- Duration: 4:18

@endsphinxdirective

22 KiB Raw Blame History

Model Optimizer Developer Guide

Introduction

Install Model Optimizer Pre-Requisites

Run Model Optimizer

Videos

22 KiB

Raw Blame History