Files
openvino/docs/ops/convolution/Convolution_1.md

185 lines
6.8 KiB
Markdown
Raw Normal View History

2021-02-02 09:05:39 +01:00
## Convolution <a name="Convolution"></a> {#openvino_docs_ops_convolution_Convolution_1}
2020-06-19 14:39:57 +03:00
**Versioned name**: *Convolution-1*
**Category**: Convolution
2021-02-02 09:05:39 +01:00
**Short description**: Computes 1D, 2D or 3D convolution (cross-correlation to be precise) of input and kernel tensors.
2020-06-19 14:39:57 +03:00
2021-02-02 09:05:39 +01:00
**Detailed description**: Basic building block of convolution is a dot product of input patch and kernel. Whole operation consist of multiple such computations over multiple input patches and kernels. More thorough explanation can be found in [Convolutional Neural Networks](http://cs231n.github.io/convolutional-networks/#conv) and [Convolution operation](https://medium.com/apache-mxnet/convolutions-explained-with-ms-excel-465d6649831c).
2020-06-19 14:39:57 +03:00
2021-02-02 09:05:39 +01:00
For the convolutional layer, the number of output features in each dimension is calculated using the formula:
2020-06-19 14:39:57 +03:00
\f[
n_{out} = \left ( \frac{n_{in} + 2p - k}{s} \right ) + 1
2021-02-02 09:05:39 +01:00
\f]
The receptive field in each layer is calculated using the formulas:
* Jump in the output feature map:
\f[
j_{out} = j_{in} * s
\f]
* Size of the receptive field of output feature:
\f[
r_{out} = r_{in} + ( k - 1 ) * j_{in}
\f]
* Center position of the receptive field of the first output feature:
\f[
start_{out} = start_{in} + ( \frac{k - 1}{2} - p ) * j_{in}
\f]
* Output is calculated using the following formula:
\f[
out = \sum_{i = 0}^{n}w_{i}x_{i} + b
\f]
**Attributes**:
2020-06-19 14:39:57 +03:00
* *strides*
2021-02-02 09:05:39 +01:00
* **Description**: *strides* is a distance (in pixels) to slide the filter on the feature map over the `(z, y, x)` axes for 3D convolutions and `(y, x)` axes for 2D convolutions. For example, *strides* equal `4,2,1` means sliding the filter 4 pixel at a time over depth dimension, 2 over height dimension and 1 over width dimension.
2020-06-19 14:39:57 +03:00
* **Range of values**: integer values starting from 0
Convolution group operations alignment (#4387) * Convolution: Enhance dynamic shape inference of validate and infer types method * Convolution: Change onnx test with dynamic shapes to float element type * Convolution: Remove test instances with integer precision * Convolution: Add backticks to types in spec * Convolution: Change element type variable for output element type * GroupConvolution: Add backticks to types in spec * GroupConvolution: Enhance dynamic shape inference of validate and infer types method * GroupConvolution: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Enhance dynamic shape inference of validate and infer types method * Convolution: Add helper function to validate convolution parameters in ref impl * Convolution: Rewrite lambda to capture spatial dims of filters in validate and infer types * GroupConvolution: Refactor reference implementation * Remove call to old implementation of convolution using dilations * Added validation method to validate shapes * GroupConvolutionBackpropData: Add more type_prop unit test and refactor test names * Convolution: Extended validation of convolution parameters in reference implementation * GroupConvolution: Extended validation of group convolution parameters in reference implementation * GroupConvolutionBackpropData: Add helper function to validate convolution backprop parameters in ref impl * Clean up unnecessary lines * BinaryConvolution: Use validate helper function from convolution ref impl * Convolution: Refactor validate and infer types to improve readability * BinaryConvolution: Refactor validate and infer types to improve readability * Convolution: Add explicit tensor shape dims for inputs and outputs in spec * BinaryConvolution: Add explicit tensor shape dims for inputs and outputs in spec * GroupConvolution: Add explicit tensor shape dims for inputs and outputs in spec * Add helper function to infer convolution forward output shape * Convolution: Refactor validate and infer types to use helpers to infer output shape * BinaryConvolution: Refactor validate and infer types to use helpers to infer output shape * GroupConvolutionBackpropData: Fix formula to calculate output shape in validation functions * Remove symbol to export convolution output shape inference function * GroupConvolution: Add validation checks for input channels dim of data batch and filter shape * GroupConvolutionBackpropData: clean up type prop tests * Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes * GroupConvolutionBackpropData: Correct layout of filters input * GroupConvolution: Deduce groups from inputs shape during output shape inference * Change spec supported types of convolution operations to any numeric type * Revert "GroupConvolution: Remove serialization test instances with integer precision" This reverts commit 781c2570d6991ef8d1a0ca6d56f00d4ce2fb2a8a. * Revert "GroupConvolutionBackpropData: Remove serialization test instances with integer precision" This reverts commit 9a6ac23968befe828eaae13918dac9ce2f2f1704. * Revert "Convolution: Remove test instances with integer precision" This reverts commit 0b07052a621135d44242985614bf628ae046d7b3. * Revert "Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes" This reverts commit c9f5944b6bc956d63df28b3fd6d1b19160f57bdd. * Revert "Convolution: Change onnx test with dynamic shapes to float element type" This reverts commit 1f4202b010883fa721a3b3a80f57bf4e09f4e697. * Allow integral types in validate and infer types method for convolution group of operations * Add i32 precision in single layer tests for convolution group of operations * BinaryConvolution: Fix shape of input and output tensors in spec * Address nitpick comments
2021-04-06 13:36:12 +02:00
* **Type**: `int[]`
2020-06-19 14:39:57 +03:00
* **Default value**: None
* **Required**: *yes*
* *pads_begin*
2021-02-02 09:05:39 +01:00
* **Description**: *pads_begin* is a number of pixels to add to the beginning along each axis. For example, *pads_begin* equal `1,2` means adding 1 pixel to the top of the input and 2 to the left of the input.
2020-06-19 14:39:57 +03:00
* **Range of values**: integer values starting from 0
Convolution group operations alignment (#4387) * Convolution: Enhance dynamic shape inference of validate and infer types method * Convolution: Change onnx test with dynamic shapes to float element type * Convolution: Remove test instances with integer precision * Convolution: Add backticks to types in spec * Convolution: Change element type variable for output element type * GroupConvolution: Add backticks to types in spec * GroupConvolution: Enhance dynamic shape inference of validate and infer types method * GroupConvolution: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Enhance dynamic shape inference of validate and infer types method * Convolution: Add helper function to validate convolution parameters in ref impl * Convolution: Rewrite lambda to capture spatial dims of filters in validate and infer types * GroupConvolution: Refactor reference implementation * Remove call to old implementation of convolution using dilations * Added validation method to validate shapes * GroupConvolutionBackpropData: Add more type_prop unit test and refactor test names * Convolution: Extended validation of convolution parameters in reference implementation * GroupConvolution: Extended validation of group convolution parameters in reference implementation * GroupConvolutionBackpropData: Add helper function to validate convolution backprop parameters in ref impl * Clean up unnecessary lines * BinaryConvolution: Use validate helper function from convolution ref impl * Convolution: Refactor validate and infer types to improve readability * BinaryConvolution: Refactor validate and infer types to improve readability * Convolution: Add explicit tensor shape dims for inputs and outputs in spec * BinaryConvolution: Add explicit tensor shape dims for inputs and outputs in spec * GroupConvolution: Add explicit tensor shape dims for inputs and outputs in spec * Add helper function to infer convolution forward output shape * Convolution: Refactor validate and infer types to use helpers to infer output shape * BinaryConvolution: Refactor validate and infer types to use helpers to infer output shape * GroupConvolutionBackpropData: Fix formula to calculate output shape in validation functions * Remove symbol to export convolution output shape inference function * GroupConvolution: Add validation checks for input channels dim of data batch and filter shape * GroupConvolutionBackpropData: clean up type prop tests * Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes * GroupConvolutionBackpropData: Correct layout of filters input * GroupConvolution: Deduce groups from inputs shape during output shape inference * Change spec supported types of convolution operations to any numeric type * Revert "GroupConvolution: Remove serialization test instances with integer precision" This reverts commit 781c2570d6991ef8d1a0ca6d56f00d4ce2fb2a8a. * Revert "GroupConvolutionBackpropData: Remove serialization test instances with integer precision" This reverts commit 9a6ac23968befe828eaae13918dac9ce2f2f1704. * Revert "Convolution: Remove test instances with integer precision" This reverts commit 0b07052a621135d44242985614bf628ae046d7b3. * Revert "Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes" This reverts commit c9f5944b6bc956d63df28b3fd6d1b19160f57bdd. * Revert "Convolution: Change onnx test with dynamic shapes to float element type" This reverts commit 1f4202b010883fa721a3b3a80f57bf4e09f4e697. * Allow integral types in validate and infer types method for convolution group of operations * Add i32 precision in single layer tests for convolution group of operations * BinaryConvolution: Fix shape of input and output tensors in spec * Address nitpick comments
2021-04-06 13:36:12 +02:00
* **Type**: `int[]`
2020-06-19 14:39:57 +03:00
* **Default value**: None
* **Required**: *yes*
* **Note**: the attribute is ignored when *auto_pad* attribute is specified.
* *pads_end*
2021-02-02 09:05:39 +01:00
* **Description**: *pads_end* is a number of pixels to add to the ending along each axis. For example, *pads_end* equal `1,2` means adding 1 pixel to the bottom of the input and 2 to the right of the input.
2020-06-19 14:39:57 +03:00
* **Range of values**: integer values starting from 0
Convolution group operations alignment (#4387) * Convolution: Enhance dynamic shape inference of validate and infer types method * Convolution: Change onnx test with dynamic shapes to float element type * Convolution: Remove test instances with integer precision * Convolution: Add backticks to types in spec * Convolution: Change element type variable for output element type * GroupConvolution: Add backticks to types in spec * GroupConvolution: Enhance dynamic shape inference of validate and infer types method * GroupConvolution: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Enhance dynamic shape inference of validate and infer types method * Convolution: Add helper function to validate convolution parameters in ref impl * Convolution: Rewrite lambda to capture spatial dims of filters in validate and infer types * GroupConvolution: Refactor reference implementation * Remove call to old implementation of convolution using dilations * Added validation method to validate shapes * GroupConvolutionBackpropData: Add more type_prop unit test and refactor test names * Convolution: Extended validation of convolution parameters in reference implementation * GroupConvolution: Extended validation of group convolution parameters in reference implementation * GroupConvolutionBackpropData: Add helper function to validate convolution backprop parameters in ref impl * Clean up unnecessary lines * BinaryConvolution: Use validate helper function from convolution ref impl * Convolution: Refactor validate and infer types to improve readability * BinaryConvolution: Refactor validate and infer types to improve readability * Convolution: Add explicit tensor shape dims for inputs and outputs in spec * BinaryConvolution: Add explicit tensor shape dims for inputs and outputs in spec * GroupConvolution: Add explicit tensor shape dims for inputs and outputs in spec * Add helper function to infer convolution forward output shape * Convolution: Refactor validate and infer types to use helpers to infer output shape * BinaryConvolution: Refactor validate and infer types to use helpers to infer output shape * GroupConvolutionBackpropData: Fix formula to calculate output shape in validation functions * Remove symbol to export convolution output shape inference function * GroupConvolution: Add validation checks for input channels dim of data batch and filter shape * GroupConvolutionBackpropData: clean up type prop tests * Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes * GroupConvolutionBackpropData: Correct layout of filters input * GroupConvolution: Deduce groups from inputs shape during output shape inference * Change spec supported types of convolution operations to any numeric type * Revert "GroupConvolution: Remove serialization test instances with integer precision" This reverts commit 781c2570d6991ef8d1a0ca6d56f00d4ce2fb2a8a. * Revert "GroupConvolutionBackpropData: Remove serialization test instances with integer precision" This reverts commit 9a6ac23968befe828eaae13918dac9ce2f2f1704. * Revert "Convolution: Remove test instances with integer precision" This reverts commit 0b07052a621135d44242985614bf628ae046d7b3. * Revert "Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes" This reverts commit c9f5944b6bc956d63df28b3fd6d1b19160f57bdd. * Revert "Convolution: Change onnx test with dynamic shapes to float element type" This reverts commit 1f4202b010883fa721a3b3a80f57bf4e09f4e697. * Allow integral types in validate and infer types method for convolution group of operations * Add i32 precision in single layer tests for convolution group of operations * BinaryConvolution: Fix shape of input and output tensors in spec * Address nitpick comments
2021-04-06 13:36:12 +02:00
* **Type**: `int[]`
2020-06-19 14:39:57 +03:00
* **Default value**: None
* **Required**: *yes*
* **Note**: the attribute is ignored when *auto_pad* attribute is specified.
* *dilations*
2021-02-02 09:05:39 +01:00
* **Description**: *dilations* denotes the distance in width and height between elements (weights) in the filter. For example, *dilation* equal `1,1` means that all the elements in the filter are neighbors, so it is the same as for the usual convolution. *dilation* equal `2,2` means that all the elements in the filter are matched not to adjacent elements in the input matrix, but to those that are adjacent with distance 1.
2020-06-19 14:39:57 +03:00
* **Range of values**: integer value starting from 0
Convolution group operations alignment (#4387) * Convolution: Enhance dynamic shape inference of validate and infer types method * Convolution: Change onnx test with dynamic shapes to float element type * Convolution: Remove test instances with integer precision * Convolution: Add backticks to types in spec * Convolution: Change element type variable for output element type * GroupConvolution: Add backticks to types in spec * GroupConvolution: Enhance dynamic shape inference of validate and infer types method * GroupConvolution: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Enhance dynamic shape inference of validate and infer types method * Convolution: Add helper function to validate convolution parameters in ref impl * Convolution: Rewrite lambda to capture spatial dims of filters in validate and infer types * GroupConvolution: Refactor reference implementation * Remove call to old implementation of convolution using dilations * Added validation method to validate shapes * GroupConvolutionBackpropData: Add more type_prop unit test and refactor test names * Convolution: Extended validation of convolution parameters in reference implementation * GroupConvolution: Extended validation of group convolution parameters in reference implementation * GroupConvolutionBackpropData: Add helper function to validate convolution backprop parameters in ref impl * Clean up unnecessary lines * BinaryConvolution: Use validate helper function from convolution ref impl * Convolution: Refactor validate and infer types to improve readability * BinaryConvolution: Refactor validate and infer types to improve readability * Convolution: Add explicit tensor shape dims for inputs and outputs in spec * BinaryConvolution: Add explicit tensor shape dims for inputs and outputs in spec * GroupConvolution: Add explicit tensor shape dims for inputs and outputs in spec * Add helper function to infer convolution forward output shape * Convolution: Refactor validate and infer types to use helpers to infer output shape * BinaryConvolution: Refactor validate and infer types to use helpers to infer output shape * GroupConvolutionBackpropData: Fix formula to calculate output shape in validation functions * Remove symbol to export convolution output shape inference function * GroupConvolution: Add validation checks for input channels dim of data batch and filter shape * GroupConvolutionBackpropData: clean up type prop tests * Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes * GroupConvolutionBackpropData: Correct layout of filters input * GroupConvolution: Deduce groups from inputs shape during output shape inference * Change spec supported types of convolution operations to any numeric type * Revert "GroupConvolution: Remove serialization test instances with integer precision" This reverts commit 781c2570d6991ef8d1a0ca6d56f00d4ce2fb2a8a. * Revert "GroupConvolutionBackpropData: Remove serialization test instances with integer precision" This reverts commit 9a6ac23968befe828eaae13918dac9ce2f2f1704. * Revert "Convolution: Remove test instances with integer precision" This reverts commit 0b07052a621135d44242985614bf628ae046d7b3. * Revert "Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes" This reverts commit c9f5944b6bc956d63df28b3fd6d1b19160f57bdd. * Revert "Convolution: Change onnx test with dynamic shapes to float element type" This reverts commit 1f4202b010883fa721a3b3a80f57bf4e09f4e697. * Allow integral types in validate and infer types method for convolution group of operations * Add i32 precision in single layer tests for convolution group of operations * BinaryConvolution: Fix shape of input and output tensors in spec * Address nitpick comments
2021-04-06 13:36:12 +02:00
* **Type**: `int[]`
2020-06-19 14:39:57 +03:00
* **Default value**: None
* **Required**: *yes*
* *auto_pad*
* **Description**: *auto_pad* how the padding is calculated. Possible values:
2021-02-02 09:05:39 +01:00
* *explicit* - use explicit padding values from *pads_begin* and *pads_end*.
* *same_upper* - the input is padded to match the output size. In case of odd padding value an extra padding is added at the end.
* *same_lower* - the input is padded to match the output size. In case of odd padding value an extra padding is added at the beginning.
2020-06-19 14:39:57 +03:00
* *valid* - do not use padding.
Convolution group operations alignment (#4387) * Convolution: Enhance dynamic shape inference of validate and infer types method * Convolution: Change onnx test with dynamic shapes to float element type * Convolution: Remove test instances with integer precision * Convolution: Add backticks to types in spec * Convolution: Change element type variable for output element type * GroupConvolution: Add backticks to types in spec * GroupConvolution: Enhance dynamic shape inference of validate and infer types method * GroupConvolution: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Enhance dynamic shape inference of validate and infer types method * Convolution: Add helper function to validate convolution parameters in ref impl * Convolution: Rewrite lambda to capture spatial dims of filters in validate and infer types * GroupConvolution: Refactor reference implementation * Remove call to old implementation of convolution using dilations * Added validation method to validate shapes * GroupConvolutionBackpropData: Add more type_prop unit test and refactor test names * Convolution: Extended validation of convolution parameters in reference implementation * GroupConvolution: Extended validation of group convolution parameters in reference implementation * GroupConvolutionBackpropData: Add helper function to validate convolution backprop parameters in ref impl * Clean up unnecessary lines * BinaryConvolution: Use validate helper function from convolution ref impl * Convolution: Refactor validate and infer types to improve readability * BinaryConvolution: Refactor validate and infer types to improve readability * Convolution: Add explicit tensor shape dims for inputs and outputs in spec * BinaryConvolution: Add explicit tensor shape dims for inputs and outputs in spec * GroupConvolution: Add explicit tensor shape dims for inputs and outputs in spec * Add helper function to infer convolution forward output shape * Convolution: Refactor validate and infer types to use helpers to infer output shape * BinaryConvolution: Refactor validate and infer types to use helpers to infer output shape * GroupConvolutionBackpropData: Fix formula to calculate output shape in validation functions * Remove symbol to export convolution output shape inference function * GroupConvolution: Add validation checks for input channels dim of data batch and filter shape * GroupConvolutionBackpropData: clean up type prop tests * Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes * GroupConvolutionBackpropData: Correct layout of filters input * GroupConvolution: Deduce groups from inputs shape during output shape inference * Change spec supported types of convolution operations to any numeric type * Revert "GroupConvolution: Remove serialization test instances with integer precision" This reverts commit 781c2570d6991ef8d1a0ca6d56f00d4ce2fb2a8a. * Revert "GroupConvolutionBackpropData: Remove serialization test instances with integer precision" This reverts commit 9a6ac23968befe828eaae13918dac9ce2f2f1704. * Revert "Convolution: Remove test instances with integer precision" This reverts commit 0b07052a621135d44242985614bf628ae046d7b3. * Revert "Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes" This reverts commit c9f5944b6bc956d63df28b3fd6d1b19160f57bdd. * Revert "Convolution: Change onnx test with dynamic shapes to float element type" This reverts commit 1f4202b010883fa721a3b3a80f57bf4e09f4e697. * Allow integral types in validate and infer types method for convolution group of operations * Add i32 precision in single layer tests for convolution group of operations * BinaryConvolution: Fix shape of input and output tensors in spec * Address nitpick comments
2021-04-06 13:36:12 +02:00
* **Type**: `string`
2021-02-02 09:05:39 +01:00
* **Default value**: explicit
2020-06-19 14:39:57 +03:00
* **Required**: *no*
* **Note**: *pads_begin* and *pads_end* attributes are ignored when *auto_pad* is specified.
**Inputs**:
Convolution group operations alignment (#4387) * Convolution: Enhance dynamic shape inference of validate and infer types method * Convolution: Change onnx test with dynamic shapes to float element type * Convolution: Remove test instances with integer precision * Convolution: Add backticks to types in spec * Convolution: Change element type variable for output element type * GroupConvolution: Add backticks to types in spec * GroupConvolution: Enhance dynamic shape inference of validate and infer types method * GroupConvolution: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Enhance dynamic shape inference of validate and infer types method * Convolution: Add helper function to validate convolution parameters in ref impl * Convolution: Rewrite lambda to capture spatial dims of filters in validate and infer types * GroupConvolution: Refactor reference implementation * Remove call to old implementation of convolution using dilations * Added validation method to validate shapes * GroupConvolutionBackpropData: Add more type_prop unit test and refactor test names * Convolution: Extended validation of convolution parameters in reference implementation * GroupConvolution: Extended validation of group convolution parameters in reference implementation * GroupConvolutionBackpropData: Add helper function to validate convolution backprop parameters in ref impl * Clean up unnecessary lines * BinaryConvolution: Use validate helper function from convolution ref impl * Convolution: Refactor validate and infer types to improve readability * BinaryConvolution: Refactor validate and infer types to improve readability * Convolution: Add explicit tensor shape dims for inputs and outputs in spec * BinaryConvolution: Add explicit tensor shape dims for inputs and outputs in spec * GroupConvolution: Add explicit tensor shape dims for inputs and outputs in spec * Add helper function to infer convolution forward output shape * Convolution: Refactor validate and infer types to use helpers to infer output shape * BinaryConvolution: Refactor validate and infer types to use helpers to infer output shape * GroupConvolutionBackpropData: Fix formula to calculate output shape in validation functions * Remove symbol to export convolution output shape inference function * GroupConvolution: Add validation checks for input channels dim of data batch and filter shape * GroupConvolutionBackpropData: clean up type prop tests * Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes * GroupConvolutionBackpropData: Correct layout of filters input * GroupConvolution: Deduce groups from inputs shape during output shape inference * Change spec supported types of convolution operations to any numeric type * Revert "GroupConvolution: Remove serialization test instances with integer precision" This reverts commit 781c2570d6991ef8d1a0ca6d56f00d4ce2fb2a8a. * Revert "GroupConvolutionBackpropData: Remove serialization test instances with integer precision" This reverts commit 9a6ac23968befe828eaae13918dac9ce2f2f1704. * Revert "Convolution: Remove test instances with integer precision" This reverts commit 0b07052a621135d44242985614bf628ae046d7b3. * Revert "Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes" This reverts commit c9f5944b6bc956d63df28b3fd6d1b19160f57bdd. * Revert "Convolution: Change onnx test with dynamic shapes to float element type" This reverts commit 1f4202b010883fa721a3b3a80f57bf4e09f4e697. * Allow integral types in validate and infer types method for convolution group of operations * Add i32 precision in single layer tests for convolution group of operations * BinaryConvolution: Fix shape of input and output tensors in spec * Address nitpick comments
2021-04-06 13:36:12 +02:00
* **1**: Input tensor of type *T* and rank 3, 4 or 5. Layout is `[N, C_IN, Z, Y, X]` (number of batches, number of channels, spatial axes Z, Y, X). Required.
* **2**: Kernel tensor of type *T* and rank 3, 4 or 5. Layout is `[C_OUT, C_IN, Z, Y, X]` (number of output channels, number of input channels, spatial axes Z, Y, X). Required.
2021-02-02 09:05:39 +01:00
* **Note**: Type of the convolution (1D, 2D or 3D) is derived from the rank of the input tensors and not specified by any attribute:
* 1D convolution (input tensors rank 3) means that there is only one spatial axis X
* 2D convolution (input tensors rank 4) means that there are two spatial axes Y, X
* 3D convolution (input tensors rank 5) means that there are three spatial axes Z, Y, X
**Outputs**:
Convolution group operations alignment (#4387) * Convolution: Enhance dynamic shape inference of validate and infer types method * Convolution: Change onnx test with dynamic shapes to float element type * Convolution: Remove test instances with integer precision * Convolution: Add backticks to types in spec * Convolution: Change element type variable for output element type * GroupConvolution: Add backticks to types in spec * GroupConvolution: Enhance dynamic shape inference of validate and infer types method * GroupConvolution: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Enhance dynamic shape inference of validate and infer types method * Convolution: Add helper function to validate convolution parameters in ref impl * Convolution: Rewrite lambda to capture spatial dims of filters in validate and infer types * GroupConvolution: Refactor reference implementation * Remove call to old implementation of convolution using dilations * Added validation method to validate shapes * GroupConvolutionBackpropData: Add more type_prop unit test and refactor test names * Convolution: Extended validation of convolution parameters in reference implementation * GroupConvolution: Extended validation of group convolution parameters in reference implementation * GroupConvolutionBackpropData: Add helper function to validate convolution backprop parameters in ref impl * Clean up unnecessary lines * BinaryConvolution: Use validate helper function from convolution ref impl * Convolution: Refactor validate and infer types to improve readability * BinaryConvolution: Refactor validate and infer types to improve readability * Convolution: Add explicit tensor shape dims for inputs and outputs in spec * BinaryConvolution: Add explicit tensor shape dims for inputs and outputs in spec * GroupConvolution: Add explicit tensor shape dims for inputs and outputs in spec * Add helper function to infer convolution forward output shape * Convolution: Refactor validate and infer types to use helpers to infer output shape * BinaryConvolution: Refactor validate and infer types to use helpers to infer output shape * GroupConvolutionBackpropData: Fix formula to calculate output shape in validation functions * Remove symbol to export convolution output shape inference function * GroupConvolution: Add validation checks for input channels dim of data batch and filter shape * GroupConvolutionBackpropData: clean up type prop tests * Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes * GroupConvolutionBackpropData: Correct layout of filters input * GroupConvolution: Deduce groups from inputs shape during output shape inference * Change spec supported types of convolution operations to any numeric type * Revert "GroupConvolution: Remove serialization test instances with integer precision" This reverts commit 781c2570d6991ef8d1a0ca6d56f00d4ce2fb2a8a. * Revert "GroupConvolutionBackpropData: Remove serialization test instances with integer precision" This reverts commit 9a6ac23968befe828eaae13918dac9ce2f2f1704. * Revert "Convolution: Remove test instances with integer precision" This reverts commit 0b07052a621135d44242985614bf628ae046d7b3. * Revert "Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes" This reverts commit c9f5944b6bc956d63df28b3fd6d1b19160f57bdd. * Revert "Convolution: Change onnx test with dynamic shapes to float element type" This reverts commit 1f4202b010883fa721a3b3a80f57bf4e09f4e697. * Allow integral types in validate and infer types method for convolution group of operations * Add i32 precision in single layer tests for convolution group of operations * BinaryConvolution: Fix shape of input and output tensors in spec * Address nitpick comments
2021-04-06 13:36:12 +02:00
* **1**: Output tensor of type *T* and rank 3, 4 or 5. Layout is `[N, C_OUT, Z, Y, X]` (number of batches, number of kernel output channels, spatial axes Z, Y, X).
2021-02-02 09:05:39 +01:00
**Types**:
Convolution group operations alignment (#4387) * Convolution: Enhance dynamic shape inference of validate and infer types method * Convolution: Change onnx test with dynamic shapes to float element type * Convolution: Remove test instances with integer precision * Convolution: Add backticks to types in spec * Convolution: Change element type variable for output element type * GroupConvolution: Add backticks to types in spec * GroupConvolution: Enhance dynamic shape inference of validate and infer types method * GroupConvolution: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Remove serialization test instances with integer precision * GroupConvolutionBackpropData: Enhance dynamic shape inference of validate and infer types method * Convolution: Add helper function to validate convolution parameters in ref impl * Convolution: Rewrite lambda to capture spatial dims of filters in validate and infer types * GroupConvolution: Refactor reference implementation * Remove call to old implementation of convolution using dilations * Added validation method to validate shapes * GroupConvolutionBackpropData: Add more type_prop unit test and refactor test names * Convolution: Extended validation of convolution parameters in reference implementation * GroupConvolution: Extended validation of group convolution parameters in reference implementation * GroupConvolutionBackpropData: Add helper function to validate convolution backprop parameters in ref impl * Clean up unnecessary lines * BinaryConvolution: Use validate helper function from convolution ref impl * Convolution: Refactor validate and infer types to improve readability * BinaryConvolution: Refactor validate and infer types to improve readability * Convolution: Add explicit tensor shape dims for inputs and outputs in spec * BinaryConvolution: Add explicit tensor shape dims for inputs and outputs in spec * GroupConvolution: Add explicit tensor shape dims for inputs and outputs in spec * Add helper function to infer convolution forward output shape * Convolution: Refactor validate and infer types to use helpers to infer output shape * BinaryConvolution: Refactor validate and infer types to use helpers to infer output shape * GroupConvolutionBackpropData: Fix formula to calculate output shape in validation functions * Remove symbol to export convolution output shape inference function * GroupConvolution: Add validation checks for input channels dim of data batch and filter shape * GroupConvolutionBackpropData: clean up type prop tests * Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes * GroupConvolutionBackpropData: Correct layout of filters input * GroupConvolution: Deduce groups from inputs shape during output shape inference * Change spec supported types of convolution operations to any numeric type * Revert "GroupConvolution: Remove serialization test instances with integer precision" This reverts commit 781c2570d6991ef8d1a0ca6d56f00d4ce2fb2a8a. * Revert "GroupConvolutionBackpropData: Remove serialization test instances with integer precision" This reverts commit 9a6ac23968befe828eaae13918dac9ce2f2f1704. * Revert "Convolution: Remove test instances with integer precision" This reverts commit 0b07052a621135d44242985614bf628ae046d7b3. * Revert "Convolution: Change element type in onnx unit tests with dyn shapes and convolution nodes" This reverts commit c9f5944b6bc956d63df28b3fd6d1b19160f57bdd. * Revert "Convolution: Change onnx test with dynamic shapes to float element type" This reverts commit 1f4202b010883fa721a3b3a80f57bf4e09f4e697. * Allow integral types in validate and infer types method for convolution group of operations * Add i32 precision in single layer tests for convolution group of operations * BinaryConvolution: Fix shape of input and output tensors in spec * Address nitpick comments
2021-04-06 13:36:12 +02:00
* *T*: any numeric type.
2020-06-19 14:39:57 +03:00
2021-02-02 09:05:39 +01:00
**Example**:
2020-06-19 14:39:57 +03:00
2021-02-02 09:05:39 +01:00
1D Convolution
2020-06-19 14:39:57 +03:00
```xml
<layer type="Convolution" ...>
2021-02-02 09:05:39 +01:00
<data dilations="1" pads_begin="0" pads_end="0" strides="2" auto_pad="valid"/>
<input>
<port id="0">
<dim>1</dim>
<dim>5</dim>
<dim>128</dim>
</port>
<port id="1">
<dim>16</dim>
<dim>5</dim>
<dim>4</dim>
</port>
</input>
<output>
<port id="2" precision="FP32">
<dim>1</dim>
<dim>16</dim>
<dim>63</dim>
</port>
</output>
</layer>
```
2D Convolution
```xml
<layer type="Convolution" ...>
<data dilations="1,1" pads_begin="2,2" pads_end="2,2" strides="1,1" auto_pad="explicit"/>
2020-06-19 14:39:57 +03:00
<input>
<port id="0">
<dim>1</dim>
<dim>3</dim>
<dim>224</dim>
<dim>224</dim>
</port>
<port id="1">
<dim>64</dim>
<dim>3</dim>
<dim>5</dim>
<dim>5</dim>
</port>
</input>
<output>
<port id="2" precision="FP32">
<dim>1</dim>
<dim>64</dim>
<dim>224</dim>
<dim>224</dim>
</port>
</output>
</layer>
```
2021-02-02 09:05:39 +01:00
3D Convolution
```xml
<layer type="Convolution" ...>
<data dilations="2,2,2" pads_begin="0,0,0" pads_end="0,0,0" strides="3,3,3" auto_pad="explicit"/>
<input>
<port id="0">
<dim>1</dim>
<dim>7</dim>
<dim>320</dim>
<dim>320</dim>
<dim>320</dim>
</port>
<port id="1">
<dim>32</dim>
<dim>7</dim>
<dim>3</dim>
<dim>3</dim>
<dim>3</dim>
</port>
</input>
<output>
<port id="2" precision="FP32">
<dim>1</dim>
<dim>32</dim>
<dim>106</dim>
<dim>106</dim>
<dim>106</dim>
</port>
</output>
</layer>
```