Stanford Neural Cache Model presents a new method for generating text 31 times faster.
Stanford researchers introduced Next-Concept Modeling, a text-generation method that first sketches an answer at coarse abstraction levels and then adds detail. Instead of generating each token sequen…