Files
openvino/docs/ops/convolution/GroupConvolutionBackpropData_1.md

176 lines
6.5 KiB
Markdown
Raw Normal View History

Feature/azaytsev/from 2021 4 (#9247) * Added info on DockerHub CI Framework * Feature/azaytsev/change layout (#3295) * Changes according to feedback comments * Replaced @ref's with html links * Fixed links, added a title page for installing from repos and images, fixed formatting issues * Added links * minor fix * Added DL Streamer to the list of components installed by default * Link fixes * Link fixes * ovms doc fix (#2988) * added OpenVINO Model Server * ovms doc fixes Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com> * Updated openvino_docs.xml * Updated the link to software license agreements * Revert "Updated the link to software license agreements" This reverts commit 706dac500e764bd7534f7005ac6197f827d68cb5. * Docs to Sphinx (#8151) * docs to sphinx * Update GPU.md * Update CPU.md * Update AUTO.md * Update performance_int8_vs_fp32.md * update * update md * updates * disable doc ci * disable ci * fix index.rst Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com> # Conflicts: # .gitignore # docs/CMakeLists.txt # docs/IE_DG/Deep_Learning_Inference_Engine_DevGuide.md # docs/IE_DG/Extensibility_DG/Custom_ONNX_Ops.md # docs/IE_DG/Extensibility_DG/VPU_Kernel.md # docs/IE_DG/InferenceEngine_QueryAPI.md # docs/IE_DG/Int8Inference.md # docs/IE_DG/Integrate_with_customer_application_new_API.md # docs/IE_DG/Model_caching_overview.md # docs/IE_DG/supported_plugins/GPU_RemoteBlob_API.md # docs/IE_DG/supported_plugins/HETERO.md # docs/IE_DG/supported_plugins/MULTI.md # docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Caffe.md # docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Kaldi.md # docs/MO_DG/prepare_model/convert_model/Convert_Model_From_MxNet.md # docs/MO_DG/prepare_model/convert_model/Convert_Model_From_ONNX.md # docs/MO_DG/prepare_model/convert_model/Converting_Model.md # docs/MO_DG/prepare_model/convert_model/Converting_Model_General.md # docs/MO_DG/prepare_model/convert_model/Cutting_Model.md # docs/MO_DG/prepare_model/convert_model/pytorch_specific/Convert_RNNT.md # docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_EfficientDet_Models.md # docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_WideAndDeep_Family_Models.md # docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_YOLO_From_Tensorflow.md # docs/doxygen/Doxyfile.config # docs/doxygen/ie_docs.xml # docs/doxygen/ie_plugin_api.config # docs/doxygen/ngraph_cpp_api.config # docs/doxygen/openvino_docs.xml # docs/get_started/get_started_macos.md # docs/get_started/get_started_raspbian.md # docs/get_started/get_started_windows.md # docs/img/cpu_int8_flow.png # docs/index.md # docs/install_guides/VisionAcceleratorFPGA_Configure.md # docs/install_guides/VisionAcceleratorFPGA_Configure_Windows.md # docs/install_guides/deployment-manager-tool.md # docs/install_guides/installing-openvino-linux.md # docs/install_guides/installing-openvino-macos.md # docs/install_guides/installing-openvino-windows.md # docs/optimization_guide/dldt_optimization_guide.md # inference-engine/ie_bridges/c/include/c_api/ie_c_api.h # inference-engine/ie_bridges/python/docs/api_overview.md # inference-engine/ie_bridges/python/sample/ngraph_function_creation_sample/README.md # inference-engine/ie_bridges/python/sample/speech_sample/README.md # inference-engine/ie_bridges/python/src/openvino/inference_engine/ie_api.pyx # inference-engine/include/ie_api.h # inference-engine/include/ie_core.hpp # inference-engine/include/ie_version.hpp # inference-engine/samples/benchmark_app/README.md # inference-engine/samples/speech_sample/README.md # inference-engine/src/plugin_api/exec_graph_info.hpp # inference-engine/src/plugin_api/file_utils.h # inference-engine/src/transformations/include/transformations_visibility.hpp # inference-engine/tools/benchmark_tool/README.md # ngraph/core/include/ngraph/ngraph.hpp # ngraph/frontend/onnx_common/include/onnx_common/parser.hpp # ngraph/python/src/ngraph/utils/node_factory.py # openvino/itt/include/openvino/itt.hpp # thirdparty/ade # tools/benchmark/README.md * Cherry-picked remove font-family (#8211) * Cherry-picked: Update get_started_scripts.md (#8338) * doc updates (#8268) * Various doc changes * theme changes * remove font-family (#8211) * fix css * Update uninstalling-openvino.md * fix css * fix * Fixes for Installation Guides Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com> Co-authored-by: kblaszczak-intel <karol.blaszczak@intel.com> # Conflicts: # docs/IE_DG/Bfloat16Inference.md # docs/IE_DG/InferenceEngine_QueryAPI.md # docs/IE_DG/OnnxImporterTutorial.md # docs/IE_DG/supported_plugins/AUTO.md # docs/IE_DG/supported_plugins/HETERO.md # docs/IE_DG/supported_plugins/MULTI.md # docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Kaldi.md # docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_YOLO_From_Tensorflow.md # docs/install_guides/installing-openvino-macos.md # docs/install_guides/installing-openvino-windows.md # docs/ops/opset.md # inference-engine/samples/benchmark_app/README.md # inference-engine/tools/benchmark_tool/README.md # thirdparty/ade * Cherry-picked: doc script changes (#8568) * fix openvino-sphinx-theme * add linkcheck target * fix * change version * add doxygen-xfail.txt * fix * AA * fix * fix * fix * fix * fix # Conflicts: # thirdparty/ade * Cherry-pick: Feature/azaytsev/doc updates gna 2021 4 2 (#8567) * Various doc changes * Reformatted C++/Pythob sections. Updated with info from PR8490 * additional fix * Gemini Lake replaced with Elkhart Lake * Fixed links in IGs, Added 12th Gen # Conflicts: # docs/IE_DG/supported_plugins/GNA.md # thirdparty/ade * Cherry-pick: Feature/azaytsev/doc fixes (#8897) * Various doc changes * Removed the empty Learning path topic * Restored the Gemini Lake CPIU list # Conflicts: # docs/IE_DG/supported_plugins/GNA.md # thirdparty/ade * Cherry-pick: sphinx copybutton doxyrest code blocks (#8992) # Conflicts: # thirdparty/ade * Cherry-pick: iframe video enable fullscreen (#9041) # Conflicts: # thirdparty/ade * Cherry-pick: fix untitled titles (#9213) # Conflicts: # thirdparty/ade * Cherry-pick: perf bench graph animation (#9045) * animation * fix # Conflicts: # thirdparty/ade * Cherry-pick: doc pytest (#8888) * docs pytest * fixes # Conflicts: # docs/doxygen/doxygen-ignore.txt # docs/scripts/ie_docs.xml # thirdparty/ade * Cherry-pick: restore deleted files (#9215) * Added new operations to the doc structure (from removed ie_docs.xml) * Additional fixes * Update docs/IE_DG/InferenceEngine_QueryAPI.md Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com> * Update docs/IE_DG/Int8Inference.md Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com> * Update Custom_Layers_Guide.md * Changes according to review comments * doc scripts fixes * Update docs/IE_DG/Int8Inference.md Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com> * Update Int8Inference.md * update xfail * clang format * updated xfail Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com> Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com> Co-authored-by: kblaszczak-intel <karol.blaszczak@intel.com> Co-authored-by: Yury Gorbachev <yury.gorbachev@intel.com> Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
2021-12-21 20:26:37 +03:00
# GroupConvolutionBackpropData {#openvino_docs_ops_convolution_GroupConvolutionBackpropData_1}
2020-06-19 14:39:57 +03:00
**Versioned name**: *GroupConvolutionBackpropData-1*
**Category**: *Convolution*
2020-06-19 14:39:57 +03:00
**Short description**: Computes 1D, 2D or 3D *GroupConvolutionBackpropData* of input and kernel tensors.
2020-06-19 14:39:57 +03:00
**Detailed description**: Splits input and filters into multiple groups, computes *ConvolutionBackpropData* on them and concatenates the results. It is equivalent to GroupConvolution and Convolution relationship.
2020-06-19 14:39:57 +03:00
**Attributes**: The operation has the same attributes as a *ConvolutionBackpropData*. Number of groups is derived from the kernel shape.
2020-06-19 14:39:57 +03:00
* *strides*
* **Description**: *strides* has the same definition as *strides* for a regular Convolution but applied in the backward way, for the output tensor.
* **Range of values**: positive integers
* **Type**: `int[]`
2020-06-19 14:39:57 +03:00
* **Required**: *yes*
* *pads_begin*
* **Description**: *pads_begin* has the same definition as *pads_begin* for a regular Convolution but applied in the backward way, for the output tensor. May be omitted, in which case pads are calculated automatically.
* **Range of values**: non-negative integers
* **Type**: `int[]`
2020-06-19 14:39:57 +03:00
* **Required**: *yes*
* **Note**: the attribute is ignored when *auto_pad* attribute is specified.
* *pads_end*
* **Description**: *pads_end* has the same definition as *pads_end* for a regular Convolution but applied in the backward way, for the output tensor. May be omitted, in which case pads are calculated automatically.
* **Range of values**: non-negative integers
* **Type**: `int[]`
2020-06-19 14:39:57 +03:00
* **Required**: *yes*
* **Note**: the attribute is ignored when *auto_pad* attribute is specified.
* *dilations*
* **Description**: *dilations* has the same definition as *dilations* for a regular Convolution but applied in the backward way, for the output tensor.
* **Range of values**: positive integers
* **Type**: `int[]`
2020-06-19 14:39:57 +03:00
* **Required**: *yes*
* *auto_pad*
* **Description**: *auto_pad* has the same definition as *auto_pad* for a regular Convolution but applied in the backward way, for the output tensor.
* *explicit* - use explicit padding values from *pads_begin* and *pads_end*.
* *same_upper* - the input is padded to match the output size. In case of odd padding value an extra padding is added at the end.
* *same_lower* - the input is padded to match the output size. In case of odd padding value an extra padding is added at the beginning.
2020-06-19 14:39:57 +03:00
* *valid* - do not use padding.
* **Type**: `string`
* **Default value**: explicit
2020-06-19 14:39:57 +03:00
* **Required**: *no*
* **Note**: *pads_begin* and *pads_end* attributes are ignored when *auto_pad* is specified.
* *output_padding*
* **Description**: *output_padding* adds additional amount of paddings per each spatial axis in the output tensor. It unlocks more elements in the output allowing them to be computed. Elements are added at the higher coordinate indices for the spatial dimensions. Number of elements in *output_padding* list matches the number of spatial dimensions in input and output tensors.
2020-06-19 14:39:57 +03:00
* **Range of values**: non-negative integer values
* **Type**: `int[]`
2020-06-19 14:39:57 +03:00
* **Default value**: all zeros
* **Required**: *no*
**Inputs**:
* **1**: Input tensor of type `T1` and rank 3, 4 or 5. Layout is `[N, GROUPS * C_IN, Z, Y, X]` (number of batches, number of channels, spatial axes Z, Y, X). **Required.**
2020-06-19 14:39:57 +03:00
* **2**: Kernel tensor of type `T1` and rank 4, 5 or 6. Layout is `[GROUPS, C_IN, C_OUT, X, Y, Z]` (number of groups, number of input channels, number of output channels, spatial axes X, Y, Z). **Required.**
2020-06-19 14:39:57 +03:00
* **3**: Output shape tensor of type `T2` and rank 1. It specifies spatial shape of the output. **Optional.**
* **Note** Number of groups is derived from the shape of the kernel and not specified by any attribute.
* **Note**: Type of the convolution (1D, 2D or 3D) is derived from the rank of the input tensors and not specified by any attribute:
* 1D convolution (input tensors rank 3) means that there is only one spatial axis X
* 2D convolution (input tensors rank 4) means that there are two spatial axes Y, X
* 3D convolution (input tensors rank 5) means that there are three spatial axes Z, Y, X
2020-06-19 14:39:57 +03:00
**Outputs**:
Convolution group operations alignment (#4387) * Convolution: Enhance dynamic shape inference of validate and infer types method * Convolution: Change onnx test with dynamic shapes to float element type * Convolution: Remove test instances with integer precision * Convolution: Add backticks to types in spec * Convolution: Change element type variable for output element type * GroupConvolution: Add backticks to types in spec * GroupConvolution: Enhance dynamic shape inference of validate and infer types method * GroupConvolution: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Enhance dynamic shape inference of validate and infer types method * Convolution: Add helper function to validate convolution parameters in ref impl * Convolution: Rewrite lambda to capture spatial dims of filters in validate and infer types * GroupConvolution: Refactor reference implementation * Remove call to old implementation of convolution using dilations * Added validation method to validate shapes * GroupConvolutionBackpropData: Add more type_prop unit test and refactor test names * Convolution: Extended validation of convolution parameters in reference implementation * GroupConvolution: Extended validation of group convolution parameters in reference implementation * GroupConvolutionBackpropData: Add helper function to validate convolution backprop parameters in ref impl * Clean up unnecessary lines * BinaryConvolution: Use validate helper function from convolution ref impl * Convolution: Refactor validate and infer types to improve readability * BinaryConvolution: Refactor validate and infer types to improve readability * Convolution: Add explicit tensor shape dims for inputs and outputs in spec * BinaryConvolution: Add explicit tensor shape dims for inputs and outputs in spec * GroupConvolution: Add explicit tensor shape dims for inputs and outputs in spec * Add helper function to infer convolution forward output shape * Convolution: Refactor validate and infer types to use helpers to infer output shape * BinaryConvolution: Refactor validate and infer types to use helpers to infer output shape * GroupConvolutionBackpropData: Fix formula to calculate output shape in validation functions * Remove symbol to export convolution output shape inference function * GroupConvolution: Add validation checks for input channels dim of data batch and filter shape * GroupConvolutionBackpropData: clean up type prop tests * Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes * GroupConvolutionBackpropData: Correct layout of filters input * GroupConvolution: Deduce groups from inputs shape during output shape inference * Change spec supported types of convolution operations to any numeric type * Revert "GroupConvolution: Remove serialization test instances with integer precision" This reverts commit 781c2570d6991ef8d1a0ca6d56f00d4ce2fb2a8a. * Revert "GroupConvolutionBackpropData: Remove serialization test instances with integer precision" This reverts commit 9a6ac23968befe828eaae13918dac9ce2f2f1704. * Revert "Convolution: Remove test instances with integer precision" This reverts commit 0b07052a621135d44242985614bf628ae046d7b3. * Revert "Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes" This reverts commit c9f5944b6bc956d63df28b3fd6d1b19160f57bdd. * Revert "Convolution: Change onnx test with dynamic shapes to float element type" This reverts commit 1f4202b010883fa721a3b3a80f57bf4e09f4e697. * Allow integral types in validate and infer types method for convolution group of operations * Add i32 precision in single layer tests for convolution group of operations * BinaryConvolution: Fix shape of input and output tensors in spec * Address nitpick comments
2021-04-06 13:36:12 +02:00
* **1**: Output tensor of type `T1` and rank 3, 4 or 5 (the same as input *1*). Layout is `[N, GROUPS * C_OUT, Z, Y, X]` (number of batches, number of kernel output channels, spatial axes Z, Y, X).
**Types**:
Convolution group operations alignment (#4387) * Convolution: Enhance dynamic shape inference of validate and infer types method * Convolution: Change onnx test with dynamic shapes to float element type * Convolution: Remove test instances with integer precision * Convolution: Add backticks to types in spec * Convolution: Change element type variable for output element type * GroupConvolution: Add backticks to types in spec * GroupConvolution: Enhance dynamic shape inference of validate and infer types method * GroupConvolution: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Enhance dynamic shape inference of validate and infer types method * Convolution: Add helper function to validate convolution parameters in ref impl * Convolution: Rewrite lambda to capture spatial dims of filters in validate and infer types * GroupConvolution: Refactor reference implementation * Remove call to old implementation of convolution using dilations * Added validation method to validate shapes * GroupConvolutionBackpropData: Add more type_prop unit test and refactor test names * Convolution: Extended validation of convolution parameters in reference implementation * GroupConvolution: Extended validation of group convolution parameters in reference implementation * GroupConvolutionBackpropData: Add helper function to validate convolution backprop parameters in ref impl * Clean up unnecessary lines * BinaryConvolution: Use validate helper function from convolution ref impl * Convolution: Refactor validate and infer types to improve readability * BinaryConvolution: Refactor validate and infer types to improve readability * Convolution: Add explicit tensor shape dims for inputs and outputs in spec * BinaryConvolution: Add explicit tensor shape dims for inputs and outputs in spec * GroupConvolution: Add explicit tensor shape dims for inputs and outputs in spec * Add helper function to infer convolution forward output shape * Convolution: Refactor validate and infer types to use helpers to infer output shape * BinaryConvolution: Refactor validate and infer types to use helpers to infer output shape * GroupConvolutionBackpropData: Fix formula to calculate output shape in validation functions * Remove symbol to export convolution output shape inference function * GroupConvolution: Add validation checks for input channels dim of data batch and filter shape * GroupConvolutionBackpropData: clean up type prop tests * Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes * GroupConvolutionBackpropData: Correct layout of filters input * GroupConvolution: Deduce groups from inputs shape during output shape inference * Change spec supported types of convolution operations to any numeric type * Revert "GroupConvolution: Remove serialization test instances with integer precision" This reverts commit 781c2570d6991ef8d1a0ca6d56f00d4ce2fb2a8a. * Revert "GroupConvolutionBackpropData: Remove serialization test instances with integer precision" This reverts commit 9a6ac23968befe828eaae13918dac9ce2f2f1704. * Revert "Convolution: Remove test instances with integer precision" This reverts commit 0b07052a621135d44242985614bf628ae046d7b3. * Revert "Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes" This reverts commit c9f5944b6bc956d63df28b3fd6d1b19160f57bdd. * Revert "Convolution: Change onnx test with dynamic shapes to float element type" This reverts commit 1f4202b010883fa721a3b3a80f57bf4e09f4e697. * Allow integral types in validate and infer types method for convolution group of operations * Add i32 precision in single layer tests for convolution group of operations * BinaryConvolution: Fix shape of input and output tensors in spec * Address nitpick comments
2021-04-06 13:36:12 +02:00
* *T1*: any numeric type.
* *T2*: any integer type.
2020-06-19 14:39:57 +03:00
**Example**
1D GroupConvolutionBackpropData
```xml
<layer id="5" name="upsampling_node" type="GroupConvolutionBackpropData">
<data dilations="1" pads_begin="1" pads_end="1" strides="2"/>
<input>
<port id="0">
<dim>1</dim>
<dim>20</dim>
<dim>224</dim>
</port>
<port id="1">
<dim>4</dim>
<dim>5</dim>
<dim>2</dim>
<dim>3</dim>
</port>
</input>
<output>
<port id="0" precision="FP32">
<dim>1</dim>
<dim>8</dim>
<dim>447</dim>
</port>
</output>
</layer>
```
2D GroupConvolutionBackpropData
2020-06-19 14:39:57 +03:00
```xml
<layer id="5" name="upsampling_node" type="GroupConvolutionBackpropData">
<data dilations="1,1" pads_begin="1,1" pads_end="1,1" strides="2,2"/>
<input>
<port id="0">
<dim>1</dim>
<dim>20</dim>
<dim>224</dim>
<dim>224</dim>
</port>
<port id="1">
<dim>4</dim>
<dim>5</dim>
<dim>2</dim>
<dim>3</dim>
<dim>3</dim>
</port>
</input>
<output>
<port id="0" precision="FP32">
<dim>1</dim>
<dim>8</dim>
<dim>447</dim>
<dim>447</dim>
</port>
</output>
</layer>
```
3D GroupConvolutionBackpropData
```xml
<layer id="5" name="upsampling_node" type="GroupConvolutionBackpropData">
<data dilations="1,1,1" pads_begin="1,1,1" pads_end="1,1,1" strides="2,2,2"/>
<input>
<port id="0">
<dim>1</dim>
<dim>20</dim>
<dim>224</dim>
<dim>224</dim>
<dim>224</dim>
</port>
<port id="1">
<dim>4</dim>
<dim>5</dim>
<dim>2</dim>
<dim>3</dim>
<dim>3</dim>
<dim>3</dim>
</port>
</input>
<output>
<port id="0" precision="FP32">
<dim>1</dim>
<dim>8</dim>
<dim>447</dim>
<dim>447</dim>
<dim>447</dim>
</port>
</output>
</layer>
```