* Added info on DockerHub CI Framework
* Feature/azaytsev/change layout (#3295)
* Changes according to feedback comments
* Replaced @ref's with html links
* Fixed links, added a title page for installing from repos and images, fixed formatting issues
* Added links
* minor fix
* Added DL Streamer to the list of components installed by default
* Link fixes
* Link fixes
* ovms doc fix (#2988)
* added OpenVINO Model Server
* ovms doc fixes
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
* Updated openvino_docs.xml
* Updated the link to software license agreements
* Revert "Updated the link to software license agreements"
This reverts commit 706dac500e.
* Docs to Sphinx (#8151)
* docs to sphinx
* Update GPU.md
* Update CPU.md
* Update AUTO.md
* Update performance_int8_vs_fp32.md
* update
* update md
* updates
* disable doc ci
* disable ci
* fix index.rst
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
# Conflicts:
# .gitignore
# docs/CMakeLists.txt
# docs/IE_DG/Deep_Learning_Inference_Engine_DevGuide.md
# docs/IE_DG/Extensibility_DG/Custom_ONNX_Ops.md
# docs/IE_DG/Extensibility_DG/VPU_Kernel.md
# docs/IE_DG/InferenceEngine_QueryAPI.md
# docs/IE_DG/Int8Inference.md
# docs/IE_DG/Integrate_with_customer_application_new_API.md
# docs/IE_DG/Model_caching_overview.md
# docs/IE_DG/supported_plugins/GPU_RemoteBlob_API.md
# docs/IE_DG/supported_plugins/HETERO.md
# docs/IE_DG/supported_plugins/MULTI.md
# docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Caffe.md
# docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Kaldi.md
# docs/MO_DG/prepare_model/convert_model/Convert_Model_From_MxNet.md
# docs/MO_DG/prepare_model/convert_model/Convert_Model_From_ONNX.md
# docs/MO_DG/prepare_model/convert_model/Converting_Model.md
# docs/MO_DG/prepare_model/convert_model/Converting_Model_General.md
# docs/MO_DG/prepare_model/convert_model/Cutting_Model.md
# docs/MO_DG/prepare_model/convert_model/pytorch_specific/Convert_RNNT.md
# docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_EfficientDet_Models.md
# docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_WideAndDeep_Family_Models.md
# docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_YOLO_From_Tensorflow.md
# docs/doxygen/Doxyfile.config
# docs/doxygen/ie_docs.xml
# docs/doxygen/ie_plugin_api.config
# docs/doxygen/ngraph_cpp_api.config
# docs/doxygen/openvino_docs.xml
# docs/get_started/get_started_macos.md
# docs/get_started/get_started_raspbian.md
# docs/get_started/get_started_windows.md
# docs/img/cpu_int8_flow.png
# docs/index.md
# docs/install_guides/VisionAcceleratorFPGA_Configure.md
# docs/install_guides/VisionAcceleratorFPGA_Configure_Windows.md
# docs/install_guides/deployment-manager-tool.md
# docs/install_guides/installing-openvino-linux.md
# docs/install_guides/installing-openvino-macos.md
# docs/install_guides/installing-openvino-windows.md
# docs/optimization_guide/dldt_optimization_guide.md
# inference-engine/ie_bridges/c/include/c_api/ie_c_api.h
# inference-engine/ie_bridges/python/docs/api_overview.md
# inference-engine/ie_bridges/python/sample/ngraph_function_creation_sample/README.md
# inference-engine/ie_bridges/python/sample/speech_sample/README.md
# inference-engine/ie_bridges/python/src/openvino/inference_engine/ie_api.pyx
# inference-engine/include/ie_api.h
# inference-engine/include/ie_core.hpp
# inference-engine/include/ie_version.hpp
# inference-engine/samples/benchmark_app/README.md
# inference-engine/samples/speech_sample/README.md
# inference-engine/src/plugin_api/exec_graph_info.hpp
# inference-engine/src/plugin_api/file_utils.h
# inference-engine/src/transformations/include/transformations_visibility.hpp
# inference-engine/tools/benchmark_tool/README.md
# ngraph/core/include/ngraph/ngraph.hpp
# ngraph/frontend/onnx_common/include/onnx_common/parser.hpp
# ngraph/python/src/ngraph/utils/node_factory.py
# openvino/itt/include/openvino/itt.hpp
# thirdparty/ade
# tools/benchmark/README.md
* Cherry-picked remove font-family (#8211)
* Cherry-picked: Update get_started_scripts.md (#8338)
* doc updates (#8268)
* Various doc changes
* theme changes
* remove font-family (#8211)
* fix css
* Update uninstalling-openvino.md
* fix css
* fix
* Fixes for Installation Guides
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
Co-authored-by: kblaszczak-intel <karol.blaszczak@intel.com>
# Conflicts:
# docs/IE_DG/Bfloat16Inference.md
# docs/IE_DG/InferenceEngine_QueryAPI.md
# docs/IE_DG/OnnxImporterTutorial.md
# docs/IE_DG/supported_plugins/AUTO.md
# docs/IE_DG/supported_plugins/HETERO.md
# docs/IE_DG/supported_plugins/MULTI.md
# docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Kaldi.md
# docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_YOLO_From_Tensorflow.md
# docs/install_guides/installing-openvino-macos.md
# docs/install_guides/installing-openvino-windows.md
# docs/ops/opset.md
# inference-engine/samples/benchmark_app/README.md
# inference-engine/tools/benchmark_tool/README.md
# thirdparty/ade
* Cherry-picked: doc script changes (#8568)
* fix openvino-sphinx-theme
* add linkcheck target
* fix
* change version
* add doxygen-xfail.txt
* fix
* AA
* fix
* fix
* fix
* fix
* fix
# Conflicts:
# thirdparty/ade
* Cherry-pick: Feature/azaytsev/doc updates gna 2021 4 2 (#8567)
* Various doc changes
* Reformatted C++/Pythob sections. Updated with info from PR8490
* additional fix
* Gemini Lake replaced with Elkhart Lake
* Fixed links in IGs, Added 12th Gen
# Conflicts:
# docs/IE_DG/supported_plugins/GNA.md
# thirdparty/ade
* Cherry-pick: Feature/azaytsev/doc fixes (#8897)
* Various doc changes
* Removed the empty Learning path topic
* Restored the Gemini Lake CPIU list
# Conflicts:
# docs/IE_DG/supported_plugins/GNA.md
# thirdparty/ade
* Cherry-pick: sphinx copybutton doxyrest code blocks (#8992)
# Conflicts:
# thirdparty/ade
* Cherry-pick: iframe video enable fullscreen (#9041)
# Conflicts:
# thirdparty/ade
* Cherry-pick: fix untitled titles (#9213)
# Conflicts:
# thirdparty/ade
* Cherry-pick: perf bench graph animation (#9045)
* animation
* fix
# Conflicts:
# thirdparty/ade
* Cherry-pick: doc pytest (#8888)
* docs pytest
* fixes
# Conflicts:
# docs/doxygen/doxygen-ignore.txt
# docs/scripts/ie_docs.xml
# thirdparty/ade
* Cherry-pick: restore deleted files (#9215)
* Added new operations to the doc structure (from removed ie_docs.xml)
* Additional fixes
* Update docs/IE_DG/InferenceEngine_QueryAPI.md
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
* Update docs/IE_DG/Int8Inference.md
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
* Update Custom_Layers_Guide.md
* Changes according to review comments
* doc scripts fixes
* Update docs/IE_DG/Int8Inference.md
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
* Update Int8Inference.md
* update xfail
* clang format
* updated xfail
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>
Co-authored-by: kblaszczak-intel <karol.blaszczak@intel.com>
Co-authored-by: Yury Gorbachev <yury.gorbachev@intel.com>
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
194 lines
6.6 KiB
Markdown
194 lines
6.6 KiB
Markdown
# ExperimentalDetectronDetectionOutput {#openvino_docs_ops_detection_ExperimentalDetectronDetectionOutput_6}
|
|
|
|
**Versioned name**: *ExperimentalDetectronDetectionOutput-6*
|
|
|
|
**Category**: *Object detection*
|
|
|
|
**Short description**: The *ExperimentalDetectronDetectionOutput* operation performs non-maximum suppression to generate
|
|
the detection output using information on location and score predictions.
|
|
|
|
**Detailed description**: The operation performs the following steps:
|
|
|
|
1. Applies deltas to boxes sizes [x<sub>1</sub>, y<sub>1</sub>, x<sub>2</sub>, y<sub>2</sub>] and takes coordinates of
|
|
refined boxes according to the formulas:
|
|
|
|
`x1_new = ctr_x + (dx - 0.5 * exp(min(d_log_w, max_delta_log_wh))) * box_w`
|
|
|
|
`y0_new = ctr_y + (dy - 0.5 * exp(min(d_log_h, max_delta_log_wh))) * box_h`
|
|
|
|
`x1_new = ctr_x + (dx + 0.5 * exp(min(d_log_w, max_delta_log_wh))) * box_w - 1.0`
|
|
|
|
`y1_new = ctr_y + (dy + 0.5 * exp(min(d_log_h, max_delta_log_wh))) * box_h - 1.0`
|
|
|
|
* `box_w` and `box_h` are width and height of box, respectively:
|
|
|
|
`box_w = x1 - x0 + 1.0`
|
|
|
|
`box_h = y1 - y0 + 1.0`
|
|
|
|
* `ctr_x` and `ctr_y` are center location of a box:
|
|
|
|
`ctr_x = x0 + 0.5f * box_w`
|
|
|
|
`ctr_y = y0 + 0.5f * box_h`
|
|
|
|
* `dx`, `dy`, `d_log_w` and `d_log_h` are deltas calculated according to the formulas below, and `deltas_tensor` is a
|
|
second input:
|
|
|
|
`dx = deltas_tensor[roi_idx, 4 * class_idx + 0] / deltas_weights[0]`
|
|
|
|
`dy = deltas_tensor[roi_idx, 4 * class_idx + 1] / deltas_weights[1]`
|
|
|
|
`d_log_w = deltas_tensor[roi_idx, 4 * class_idx + 2] / deltas_weights[2]`
|
|
|
|
`d_log_h = deltas_tensor[roi_idx, 4 * class_idx + 3] / deltas_weights[3]`
|
|
|
|
2. If *class_agnostic_box_regression* is `true` removes predictions for background classes.
|
|
3. Clips boxes to the image.
|
|
4. Applies *score_threshold* on detection scores.
|
|
5. Applies non-maximum suppression class-wise with *nms_threshold* and returns *post_nms_count* or less detections per
|
|
class.
|
|
6. Returns *max_detections_per_image* detections if total number of detections is more than *max_detections_per_image*;
|
|
otherwise, returns total number of detections and the output tensor is filled with undefined values for rest output
|
|
tensor elements.
|
|
|
|
**Attributes**:
|
|
|
|
* *score_threshold*
|
|
|
|
* **Description**: The *score_threshold* attribute specifies a threshold to consider only detections whose score are
|
|
larger than the threshold.
|
|
* **Range of values**: non-negative floating-point number
|
|
* **Type**: float
|
|
* **Default value**: None
|
|
* **Required**: *yes*
|
|
|
|
* *nms_threshold*
|
|
|
|
* **Description**: The *nms_threshold* attribute specifies a threshold to be used in the NMS stage.
|
|
* **Range of values**: non-negative floating-point number
|
|
* **Type**: float
|
|
* **Default value**: None
|
|
* **Required**: *yes*
|
|
|
|
* *num_classes*
|
|
|
|
* **Description**: The *num_classes* attribute specifies the number of detected classes.
|
|
* **Range of values**: non-negative integer number
|
|
* **Type**: int
|
|
* **Default value**: None
|
|
* **Required**: *yes*
|
|
|
|
* *post_nms_count*
|
|
|
|
* **Description**: The *post_nms_count* attribute specifies the maximal number of detections per class.
|
|
* **Range of values**: non-negative integer number
|
|
* **Type**: int
|
|
* **Default value**: None
|
|
* **Required**: *yes*
|
|
|
|
* *max_detections_per_image*
|
|
|
|
* **Description**: The *max_detections_per_image* attribute specifies maximal number of detections per image.
|
|
* **Range of values**: non-negative integer number
|
|
* **Type**: int
|
|
* **Default value**: None
|
|
* **Required**: *yes*
|
|
|
|
* *class_agnostic_box_regression*
|
|
|
|
* **Description**: *class_agnostic_box_regression* attribute is a flag that specifies whether to delete background
|
|
classes or not.
|
|
* **Range of values**:
|
|
* `true` means background classes should be deleted
|
|
* `false` means background classes should not be deleted
|
|
* **Type**: boolean
|
|
* **Default value**: false
|
|
* **Required**: *no*
|
|
|
|
* *max_delta_log_wh*
|
|
|
|
* **Description**: The *max_delta_log_wh* attribute specifies maximal delta of logarithms for width and height.
|
|
* **Range of values**: floating-point number
|
|
* **Type**: float
|
|
* **Default value**: None
|
|
* **Required**: *yes*
|
|
|
|
* *deltas_weights*
|
|
|
|
* **Description**: The *deltas_weights* attribute specifies weights for bounding boxes sizes deltas.
|
|
* **Range of values**: a list of non-negative floating-point numbers
|
|
* **Type**: float[]
|
|
* **Default value**: None
|
|
* **Required**: *yes*
|
|
|
|
**Inputs**
|
|
|
|
* **1**: A 2D tensor of type *T* with input ROIs, with shape `[number_of_ROIs, 4]` providing the ROIs as 4-tuples:
|
|
[x<sub>1</sub>, y<sub>1</sub>, x<sub>2</sub>, y<sub>2</sub>]. The batch dimension of first, second, and third inputs
|
|
should be the same. **Required.**
|
|
|
|
* **2**: A 2D tensor of type *T* with shape `[number_of_ROIs, num_classes * 4]` providing deltas for input boxes.
|
|
**Required.**
|
|
|
|
* **3**: A 2D tensor of type *T* with shape `[number_of_ROIs, num_classes]` providing detections scores. **Required.**
|
|
|
|
* **4**: A 2D tensor of type *T* with shape `[1, 3]` contains three elements
|
|
`[image_height, image_width, scale_height_and_width]` providing input image size info. **Required.**
|
|
|
|
**Outputs**
|
|
|
|
* **1**: A 2D tensor of type *T* with shape `[max_detections_per_image, 4]` providing boxes indices.
|
|
|
|
* **2**: A 1D tensor of type *T_IND* with shape `[max_detections_per_image]` providing classes indices.
|
|
|
|
* **3**: A 1D tensor of type *T* with shape `[max_detections_per_image]` providing scores indices.
|
|
|
|
**Types**
|
|
|
|
* *T*: any supported floating-point type.
|
|
|
|
* *T_IND*: `int64` or `int32`.
|
|
|
|
|
|
**Example**
|
|
|
|
```xml
|
|
<layer ... type="ExperimentalDetectronDetectionOutput" version="opset6">
|
|
<data class_agnostic_box_regression="false" deltas_weights="10.0,10.0,5.0,5.0" max_delta_log_wh="4.135166645050049" max_detections_per_image="100" nms_threshold="0.5" num_classes="81" post_nms_count="2000" score_threshold="0.05000000074505806"/>
|
|
<input>
|
|
<port id="0">
|
|
<dim>1000</dim>
|
|
<dim>4</dim>
|
|
</port>
|
|
<port id="1">
|
|
<dim>1000</dim>
|
|
<dim>324</dim>
|
|
</port>
|
|
<port id="2">
|
|
<dim>1000</dim>
|
|
<dim>81</dim>
|
|
</port>
|
|
<port id="3">
|
|
<dim>1</dim>
|
|
<dim>3</dim>
|
|
</port>
|
|
</input>
|
|
<output>
|
|
<port id="4" precision="FP32">
|
|
<dim>100</dim>
|
|
<dim>4</dim>
|
|
</port>
|
|
<port id="5" precision="I32">
|
|
<dim>100</dim>
|
|
</port>
|
|
<port id="6" precision="FP32">
|
|
<dim>100</dim>
|
|
</port>
|
|
<port id="7" precision="I32">
|
|
<dim>100</dim>
|
|
</port>
|
|
</output>
|
|
</layer>
|
|
```
|