Enum cudnnSoftmaxAlgorithm
cudnnSoftmaxAlgorithm is used to select an implementation of the softmax function used in cudnnSoftmaxForward() and cudnnSoftmaxBackward().
Namespace: ManagedCuda.CudaDNN
Assembly: CudaDNN.dll
Syntax
public enum cudnnSoftmaxAlgorithm
Fields
Name | Description |
---|---|
Accurate | This implementation scales each point of the softmax input domain by its maximum value to avoid potential floating point overflows in the softmax evaluation. |
Fast | This implementation applies the straightforward softmax operation. |
Log | This entry performs the Log softmax operation, avoiding overflows by scaling each point in the input domain as in CUDNN_SOFTMAX_ACCURATE |