openvino/docs/get_started.md

Get Started

@sphinxdirective

.. toctree:: :maxdepth: 1 :hidden:

Installing OpenVINO <openvino_docs_install_guides_overview> Additional Configurations <openvino_docs_install_guides_configurations_header> Uninstalling <openvino_docs_install_guides_uninstalling_openvino> Troubleshooting <openvino_docs_get_started_guide_troubleshooting>

@endsphinxdirective

@sphinxdirective .. raw:: html

Welcome to OpenVINO! This guide introduces installation and learning materials for Intel® Distribution of OpenVINO™ toolkit. The guide walks through the following steps:
Quick Start Example Install OpenVINO Learn OpenVINO

@endsphinxdirective

1. Quick Start Example (No Installation Required)

Try out OpenVINO's capabilities with this quick start example that estimates depth in a scene using an OpenVINO monodepth model. Run the example in a Jupyter Notebook inside your web browser to quickly see how to load a model, prepare an image, inference the image, and display the result.

2. Install OpenVINO

See the installation overview page for options to install OpenVINO and set up a development environment on your device.

3. Learn OpenVINO

OpenVINO provides a wide array of examples and documentation showing how to work with models, run inference, and deploy applications. Step through the sections below to learn the basics of OpenVINO and explore its advanced optimization features. For further details, visit OpenVINO documentation.

OpenVINO users of all experience levels can try Intel® DevCloud, a free web-based service for developing, testing, and running OpenVINO applications on an online cluster of the latest Intel® hardware.

OpenVINO Basics

Learn the basics of working with models and inference in OpenVINO. Begin with “Hello World” Interactive Tutorials that show how to prepare models, run inference, and retrieve results using the OpenVINO API. Then, explore other examples from the Open Model Zoo and OpenVINO Code Samples that can be adapted for your own application.

Interactive Tutorials - Jupyter Notebooks

Start with interactive Python tutorials that show the basics of model inferencing, the OpenVINO API, how to convert models to OpenVINO format, and more.

• Hello Image Classification - Load an image classification model in OpenVINO and use it to apply a label to an image
• OpenVINO Runtime API Tutorial - Learn the basic Python API for working with models in OpenVINO
• Convert TensorFlow Models to OpenVINO
• Convert PyTorch Models to OpenVINO

OpenVINO Code Samples

View sample code for various C++ and Python applications that can be used as a starting point for your own application. For C++ developers, step through the Get Started with C++ Samples to learn how to build and run an image classification program that uses OpenVINO’s C++ API.

Integrate OpenVINO With Your Application

Learn how to use the OpenVINO API to implement an inference pipeline in your application.

OpenVINO Advanced Features

OpenVINO provides features to improve your model’s performance, optimize your runtime, maximize your application’s throughput on target hardware, and much more. Visit the links below to learn more about these features and how to use them.

Model Compression and Quantization

Use OpenVINO’s model compression tools to reduce your model’s latency and memory footprint while maintaining good accuracy.

• Tutorial - OpenVINO Post-Training Model Quantization
• Tutorial - Quantization-Aware Training in TensorFlow with OpenVINO NNCF
• Tutorial - Quantization-Aware Training in PyTorch with NNCF
• Model Optimization Guide

Automated Device Configuration

OpenVINO’s hardware device configuration options enable you to write an application once and deploy it anywhere with optimal performance.

• Increase application portability with Automatic Device Selection (AUTO)
• Perform parallel inference across processors with Multi-Device Execution (MULTI)
• Efficiently split inference between hardware cores with Heterogeneous Execution (HETERO)

Flexible Model and Pipeline Configuration

Pipeline and model configuration features in OpenVINO Runtime allow you to easily optimize your application’s performance on any target hardware.

• Automatic Batching performs on-the-fly grouping of inference requests to maximize utilization of the target hardware’s memory and processing cores.
• Performance Hints automatically adjust runtime parameters to prioritize for low latency or high throughput
• Dynamic Shapes reshapes models to accept arbitrarily-sized inputs, increasing flexibility for applications that encounter different data shapes
• Benchmark Tool characterizes model performance in various hardware and pipeline configurations

Additional Resources

• OpenVINO Success Stories - See how Intel partners have successfully used OpenVINO in production applications to solve real-world problems.
• OpenVINO Supported Models - Check which models OpenVINO supports on your hardware.
• Performance Benchmarks - View results from benchmarking models with OpenVINO on Intel hardware.