Token predictor

Predict which tokens will appear after a fragment of Shakespeare’s text. Use the available language model and data to distinguish genuine continuations from misleading candidates.