Language

Language model

Constructors

ConstructorDescription
new(text)
Signature: text:string -> Language
new(text, punctuation)
Signature: (text:string * punctuation:string []) -> Language
new(tokens, punctuation)
Signature: (tokens:string [] * punctuation:string []) -> Language

Instance members

Instance memberDescription
DecodeOneHot(x)
Signature: x:DM -> string []
EncodeOneHot(x)
Signature: (x:string []) -> DM
EncodeOneHot(x)
Signature: x:string -> DM
Length
Signature: int
Sample(model, start, stop, maxlen)
Signature: (model:(DM -> DM) * start:string * stop:string [] * maxlen:int) -> string
Sample(probs)
Signature: probs:DV -> string
Sample(probs)
Signature: probs:DM -> string []
Tokens
Signature: string []

Static members

Static memberDescription
TokenizeWords(text, punctuation)
Signature: (text:string * punctuation:string []) -> string []