Corpus

struct Corpus {
Dictionary dict;
int[][string] dataset;
size_t batchSize;
}

Members

Functions

batchfy
auto batchfy(string name)

returns word-id 2d slice shaped (seqlen, batchsize)

Meta