ChatGPT の異常なトークン
Work done at SERI-MATS, over the past two months, with Matthew Watkins.TL;DR:Anomalous Tokens: a mysterious failure mode for GPT (which reliably insulted my colleague Matthew)We have found a set of anomalous tokens which result in a previously undocumented failure mode for GPT2 and GPT3 models. (The instruct models are particularly deranged.)It also appears to break…