openvino/docs/ops/sparse/EmbeddingBagPackedSum_3.md

EmbeddingBagPackedSum

@sphinxdirective

.. meta:: :description: Learn about EmbeddingBagPackedSum-3 - a sparse operation, which can be performed on two required and one optional input tensor.

Versioned name: EmbeddingBagPackedSum-3

Category: Sparse

Short description: Computes sums of "bags" of embeddings, without instantiating the intermediate embeddings.

Detailed description: This is the first case of the PyTorch EmbeddingBag <https://pytorch.org/docs/stable/nn.html#embeddingbag>__ , it has indices in the tensor of format [batch, indices_per_bag]. If 3rd input is not provided, this operation is equivalent to Gather followed by ReduceSum(axis=0). However, EmbeddingBagPackedSum is much more time and memory efficient than using a chain of these operations.

Attributes: EmbeddingBagPackedSum operation has no attributes.

Inputs:

• 1: emb_table tensor containing the embedding lookup table of the module of shape [num_emb, emb_dim1, emb_dim2, ...] and of type T. Required.
• 2: indices tensor of shape [batch, indices_per_bag] and of type T_IND. Required.
• 3: per_sample_weights tensor of the same shape as indices and of type T. Each value in this tensor are multiplied with each value pooled from embedding table for each index. Optional, default is tensor of ones.

Outputs:

• 1: tensor of shape [batch, emb_dim1, emb_dim2, ...] and of type T containing embeddings for each bag.

Types

• T: any numeric type.
• T_IND: int32 or int64.

Example

.. code-block:: cpp

<layer ... type="EmbeddingBagPackedSum" ... > < !-- emb_table value is: -0.2, -0.6], [-0.1, -0.4], [-1.9, -1.8], [-1., 1.5], [ 0.8, -0.7 --> 5 2 < !-- indices value is: 0, 2], [1, 2], [3, 4 --> 3 2 < !-- per_sample_weigths value is: 0.5, 0.5], [0.5, 0.5], [0.5, 0.5 --> 3 2 < !-- output value is: -1.05, -1.2], [-1., -1.1], [-0.1, 0.4 --> 3 2

@endsphinxdirective