Microsoft ResearchOpenHMNet (gold spans) (paper Table 3 R-1)ParamsUndisclosedContext128kSpeed—ReleaseApr 2021
Microsoft ResearchOpenCodeBERT encoder (CodeSearchNet summarization, six-language overall BLEU)ParamsUndisclosedContext128kSpeed—ReleaseFeb 2021
Microsoft ResearchOpenDeBERTa ensemble (TuringNLRv4)ParamsUndisclosedContext128kSpeed—ReleaseJan 2021