athena.models.lm

lm

Submodules

Package Contents

Classes

RNNLM

Standard implementation of a RNNLM. Model mainly consists of embeding layer,

TransformerLM

Standard implementation of a RNNLM. Model mainly consists of embeding layer,

class athena.models.lm.RNNLM(data_descriptions, config=None)

Bases: athena.models.lm.nn_lm.NNLM

Standard implementation of a RNNLM. Model mainly consists of embeding layer, rnn layers(with dropout), and the full connection layer, which are all incuded in self.model_for_rnn

default_config
forward(inputs, inputs_length=None, training: bool = None)

do NN LM forward computation, for both train and decode.

class athena.models.lm.TransformerLM(data_descriptions, config=None)

Bases: athena.models.lm.nn_lm.NNLM

Standard implementation of a RNNLM. Model mainly consists of embeding layer, rnn layers(with dropout), and the full connection layer, which are all incuded in self.model_for_rnn

default_config
forward(inputs, input_lengths, training: bool = None)

do NN LM forward computation, for both train and decode.