Forward intermediates of the output projection, required by the backward pass.
Cache
01 Syntax
Microsoft.VisualBasic.MachineLearning.Transformer.OutputLayer.Cache
02 Fields
| Name | Overloads | Summary |
|---|---|---|
| FlatInput | 2 | The flattened decoder output that was projected. |
| InputShape | 2 | The original shape of the decoder output, used to unflatten the gradient. |
| Logits | 2 | The logits produced before the softmax. |
03 Members
FlatInput
The flattened decoder output that was projected.
InputShape
The original shape of the decoder output, used to unflatten the gradient.
Logits
The logits produced before the softmax.
FlatInput
InputShape
Logits