CodeT5: The Code-aware Encoder-Decoder based Pre-trained Programming Language Models

Yue Wang · #code-intelligence

TL; DR: Introducing CodeT5 --- the first code-aware, encoder-decoder-based pre-trained programming language model, which enables a wide range of code intelligence applications including code understanding and generation tasks. CodeT5 achieves state-of-the-art performance on 14 sub-tasks in the CodeXGLUE code intelligence benchmark.CodeT5 for code-related understanding and generation tasksGiven the goal