Package me.damoebe.architectures.transformer

Class Normalization

java.lang.Object

me.damoebe.architectures.transformer.Normalization

public class Normalization
extends Object

A class for Sub-Layer normalisation, it stores weights and biases.

Constructor Summary

Constructors

Constructor	Description
Normalization(int embeddingAmount, int embeddingSize)	Main constructor for Normalisation class

Method Summary

Modifier and Type	Method	Description
final Sequence[]	normalize(Sequence... embeddings)	Normalize 1 or 2 embeddings

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

Normalization

public Normalization(int embeddingAmount,
 int embeddingSize)

Main constructor for Normalisation class

Parameters:

embeddingAmount - The embedding amount

embeddingSize - The embedding size (*2 if two sequences)

Method Details

normalize

public final Sequence[] normalize(Sequence... embeddings)

Normalize 1 or 2 embeddings

Parameters:

embeddings - The embedding-lists that should be normalized.

Returns:

The normalized embedding-lists