Package me.damoebe.architectures

Interface Backpropagation

All Known Implementing Classes:

EDHead, Head, MultiHeadAttention

public interface Backpropagation

An interface for backpropagation implemented by each module that supports delta-gradient based weight updates.

Method Summary

Modifier and Type	Method	Description
double[][]	backPropagate(double[][] deltas)	The method in which the backpropagation process should be managed.

Method Details

backPropagate

double[][] backPropagate(double[][] deltas)

The method in which the backpropagation process should be managed.

Parameters:

deltas - The deltas from the previous backpropagation step, which are being passed into this module

Returns:

The new deltas used for the next backpropagation step.