HyperAI超神经

Language Modelling On Wiki 40B

评估指标

Perplexity

评测结果

各个模型在此基准测试上的表现结果

比较表格
模型名称Perplexity
transformer-quality-in-linear-time14.998
combiner-full-attention-transformer-with16.49
combiner-full-attention-transformer-with16.60