* Update docs/OV_Runtime_UG/protecting_model_guide.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/protecting_model_guide.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/protecting_model_guide.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/protecting_model_guide.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/protecting_model_guide.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/protecting_model_guide.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/ARM_CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/ARM_CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/ARM_CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/ARM_CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/ARM_CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/ARM_CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/optimization_guide/dldt_deployment_optimization_common.md Co-authored-by: Sebastian Golebiewski <sebastianx.golebiewski@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/Device_Plugins.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU_RemoteTensor_API.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU_RemoteTensor_API.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU_RemoteTensor_API.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU_RemoteTensor_API.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU_RemoteTensor_API.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU_RemoteTensor_API.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU_RemoteTensor_API.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU_RemoteTensor_API.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU_RemoteTensor_API.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GPU_RemoteTensor_API.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/HDDL.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/HDDL.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/HDDL.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/MYRIAD.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/MYRIAD.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/MYRIAD.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/ov_dynamic_shapes.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/config_properties.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/config_properties.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/preprocessing_details.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/preprocessing_details.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/preprocessing_details.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/preprocessing_details.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/performance_hints.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/deployment/deployment-manager-tool.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Apply suggestions from code review Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/preprocessing_details.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/performance_hints.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/preprocessing_details.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/performance_hints.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Update docs/OV_Runtime_UG/deployment/deployment-manager-tool.md Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Apply suggestions from code review Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Apply suggestions from code review Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> * Apply suggestions from code review * Apply suggestions from code review * Apply suggestions from code review * Apply suggestions from code review * Apply suggestions from code review * Apply suggestions from code review * Apply suggestions from code review * Apply suggestions from code review * Apply suggestions from code review * Apply suggestions from code review * Update ref links * Update Getting_performance_numbers.md * Update deployment_intro.md * Update preprocessing_details.md * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update tools/pot/openvino/tools/pot/algorithms/quantization/default/README.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/automatic_batching.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/deployment/deployment-manager-tool.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update tools/pot/openvino/tools/pot/algorithms/quantization/default/README.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update automatic_batching.md * Update docs/OV_Runtime_UG/automatic_batching.md * Update docs/OV_Runtime_UG/ShapeInference.md * Update deployment-manager-tool.md * Update deployment-manager-tool.md * Update docs/OV_Runtime_UG/deployment/deployment-manager-tool.md * Update automatic_batching.md * Update automatic_batching.md * Update docs/OV_Runtime_UG/ShapeInference.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/integrate_with_your_application.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/integrate_with_your_application.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/integrate_with_your_application.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/integrate_with_your_application.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/integrate_with_your_application.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update integrate_with_your_application.md * Update docs/OV_Runtime_UG/integrate_with_your_application.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/integrate_with_your_application.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/integrate_with_your_application.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/integrate_with_your_application.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/model_representation.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/model_representation.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update integrate_with_your_application.md * Update docs/OV_Runtime_UG/integrate_with_your_application.md * Update docs/OV_Runtime_UG/layout_overview.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/layout_overview.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/layout_overview.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update model_representation.md * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update integrate_with_your_application.md * Update docs/OV_Runtime_UG/layout_overview.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update Additional_Optimizations.md Removing redundant information. * Update docs/OV_Runtime_UG/layout_overview.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/layout_overview.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/layout_overview.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/layout_overview.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update Additional_Optimizations.md * Apply suggestions from code review Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update Additional_Optimizations.md * Update docs/OV_Runtime_UG/model_representation.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/layout_overview.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/OV_Runtime_UG/layout_overview.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update model_representation.md * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update tools/pot/docs/SaturationIssue.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update tools/pot/openvino/tools/pot/algorithms/quantization/accuracy_aware/README.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update tools/pot/docs/SaturationIssue.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update tools/pot/docs/SaturationIssue.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/GNA.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update docs/OV_Runtime_UG/supported_plugins/CPU.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update tools/pot/docs/SaturationIssue.md * Update tools/pot/docs/SaturationIssue.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update README.md * Update README.md * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update tools/pot/docs/Introduction.md * Update tools/pot/docs/AccuracyAwareQuantizationUsage.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Removing one-liners Removing introductory sentences from 'Supported Features' sections. * Update docs/OV_Runtime_UG/openvino_intro.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * Update docs/benchmarks/performance_benchmarks_ovms.md Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update tools/pot/docs/Introduction.md * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> * Update tools/pot/docs/DefaultQuantizationUsage.md * Update tools/pot/docs/BestPractices.md * Update tools/pot/docs/BestPractices.md * Update tools/pot/docs/AccuracyAwareQuantizationUsage.md * Update docs/optimization_guide/model_optimization_guide.md * Update docs/optimization_guide/dldt_deployment_optimization_guide.md * Update docs/OV_Runtime_UG/supported_plugins/config_properties.md * Update docs/OV_Runtime_UG/supported_plugins/GNA.md * Update docs/OV_Runtime_UG/supported_plugins/CPU.md * Update docs/OV_Runtime_UG/preprocessing_usecase_save.md * Apply suggestions from code review Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> Co-authored-by: Yuan Xu <yuan1.xu@intel.com> Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> Co-authored-by: msmykx <101244365+msmykx-intel@users.noreply.github.com> Co-authored-by: Piotr Milewski <piotr.milewski@intel.com>
84 lines
3.3 KiB
Markdown
84 lines
3.3 KiB
Markdown
# Use Case - Integrate and Save Preprocessing Steps Into IR {#openvino_docs_OV_UG_Preprocess_Usecase_save}
|
|
|
|
|
|
Previous sections covered the topic of the [preprocessing steps](@ref openvino_docs_OV_UG_Preprocessing_Details) and the overview of [Layout](@ref openvino_docs_OV_UG_Layout_Overview) API.
|
|
|
|
For many applications, it is also important to minimize read/load time of a model. Therefore, performing integration of preprocessing steps every time on application startup, after `ov::runtime::Core::read_model`, may seem inconvenient. In such cases, once pre and postprocessing steps have been added, it can be useful to store new execution model to OpenVINO Intermediate Representation (OpenVINO IR, `.xml` format).
|
|
|
|
Most available preprocessing steps can also be performed via command-line options, using Model Optimizer. For details on such command-line options, refer to the [Optimizing Preprocessing Computation](../MO_DG/prepare_model/Additional_Optimizations.md).
|
|
|
|
## Code example - Saving Model with Preprocessing to OpenVINO IR
|
|
|
|
When some preprocessing steps cannot be integrated into the execution graph using Model Optimizer command-line options (for example, `YUV`->`RGB` color space conversion, `Resize`, etc.), it is possible to write a simple code which:
|
|
- Reads the original model (OpenVINO IR, ONNX, PaddlePaddle).
|
|
- Adds the preprocessing/postprocessing steps.
|
|
- Saves resulting model as IR (`.xml` and `.bin`).
|
|
|
|
Consider the example, where an original ONNX model takes one `float32` input with the `{1, 3, 224, 224}` shape, the `RGB` channel order, and mean/scale values applied. In contrast, the application provides `BGR` image buffer with a non-fixed size and input images as batches of two. Below is the model conversion code that can be applied in the model preparation script for such a case.
|
|
|
|
- Includes / Imports
|
|
|
|
@sphinxtabset
|
|
|
|
@sphinxtab{C++}
|
|
|
|
@snippet docs/snippets/ov_preprocessing.cpp ov:preprocess:save_headers
|
|
|
|
@endsphinxtab
|
|
|
|
@sphinxtab{Python}
|
|
|
|
@snippet docs/snippets/ov_preprocessing.py ov:preprocess:save_headers
|
|
|
|
@endsphinxtab
|
|
|
|
@endsphinxtabset
|
|
|
|
- Preprocessing & Saving to the OpenVINO IR code.
|
|
|
|
@sphinxtabset
|
|
|
|
@sphinxtab{C++}
|
|
|
|
@snippet docs/snippets/ov_preprocessing.cpp ov:preprocess:save
|
|
|
|
@endsphinxtab
|
|
|
|
@sphinxtab{Python}
|
|
|
|
@snippet docs/snippets/ov_preprocessing.py ov:preprocess:save
|
|
|
|
@endsphinxtab
|
|
|
|
@endsphinxtabset
|
|
|
|
|
|
## Application Code - Load Model to Target Device
|
|
|
|
After this, the application code can load a saved file and stop preprocessing. In this case, enable [model caching](./Model_caching_overview.md) to minimize load time when the cached model is available.
|
|
|
|
@sphinxtabset
|
|
|
|
@sphinxtab{C++}
|
|
|
|
@snippet docs/snippets/ov_preprocessing.cpp ov:preprocess:save_load
|
|
|
|
@endsphinxtab
|
|
|
|
@sphinxtab{Python}
|
|
|
|
@snippet docs/snippets/ov_preprocessing.py ov:preprocess:save_load
|
|
|
|
@endsphinxtab
|
|
|
|
@endsphinxtabset
|
|
|
|
|
|
## Additional Resources
|
|
* [Preprocessing Details](@ref openvino_docs_OV_UG_Preprocessing_Details)
|
|
* [Layout API overview](@ref openvino_docs_OV_UG_Layout_Overview)
|
|
* [Model Optimizer - Optimize Preprocessing Computation](../MO_DG/prepare_model/Additional_Optimizations.md)
|
|
* [Model Caching Overview](./Model_caching_overview.md)
|
|
* The `ov::preprocess::PrePostProcessor` C++ class documentation
|
|
* The `ov::pass::Serialize` - pass to serialize model to XML/BIN
|
|
* The `ov::set_batch` - update batch dimension for a given model |