Package me.damoebe.architectures.transformer

Klasse DecoderTransformer<N extends FFNetwork>

java.lang.Object

me.damoebe.architectures.Network

me.damoebe.architectures.transformer.DecoderTransformer<N>

Typparameter:

N - The feed-forward neural network type used for this transformer

public class DecoderTransformer<N extends FFNetwork>
extends Network

The class for a Decoder-Only Transformer, used for generative tasks

Konstruktorübersicht

Konstruktoren

Konstruktor	Beschreibung
DecoderTransformer(int decoderBlockAmount, Block<Head,N> referenceBlock)	Main constructor for a Decoder-Only Transformer with a reference Decoder-Block

Methodenübersicht

Modifizierer und Typ	Methode	Beschreibung
List<Double>	getOutput()
void	insertInput(List<Double> input)
void	train(List<Double> input, List<Double> optimalOutput)
void	updateAllActivations()	Updates All activations in the transformer as well as the currentOutput

Von Klasse geerbte Methoden me.damoebe.architectures.Network

loadNetworkFromJson, loadToJsonFile

Von Klasse geerbte Methoden java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Konstruktordetails

DecoderTransformer

public DecoderTransformer(int decoderBlockAmount,
 Block<Head,N> referenceBlock)

Main constructor for a Decoder-Only Transformer with a reference Decoder-Block

Parameter:

decoderBlockAmount - The amount of Decoder Blocks that should be used.

referenceBlock - The reference Decoder-Block that will be used to construct the blocks

Methodendetails

train

public void train(List<Double> input,
 List<Double> optimalOutput)

Angegeben von:

train in Klasse Network

getOutput

public List<Double> getOutput()

Angegeben von:

getOutput in Klasse Network

insertInput

public void insertInput(List<Double> input)

Angegeben von:

insertInput in Klasse Network

updateAllActivations

public void updateAllActivations()

Updates All activations in the transformer as well as the currentOutput

Angegeben von:

updateAllActivations in Klasse Network