Economical, and Efficient Mixture-of-Experts Language Model DeepSeek-AI research@deepseek.com Abstract We present DeepSeek-V2, a strong Mixture-of-Experts (MoE) language model characterized by economical training Evaluations on Math and Code 33 G Evaluation Formats 34 3 1. Introduction In the past few years, Large Language Models (LLMs) (Anthropic, 2023; Google, 2023; OpenAI, 2022, 2023) have undergone rapid development to tackle this problem, we introduce DeepSeek-V2, a strong open-source Mixture-of-Experts (MoE) language model, characterized by economical training and efficient inference through an innovative Transformer

projects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 260 2.8 Language definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277 see an overview of projects and components, as well as their respective translation pro- gression. New in version 2.5. Components of projects you are watching are shown by default, and cross-referenced the main menu showing translation status for each project on the Weblate instance. • Selecting a language in the main menu Languages will show translation status of all projects, filtered by one of your

projects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 259 2.8 Language definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276 see an overview of projects and components, as well as their respective translation pro- gression. New in version 2.5. Components of projects you are watching are shown by default, and cross-referenced the main menu showing translation status for each project on the Weblate instance. • Selecting a language in the main menu Languages will show translation status of all projects, filtered by one of your

projects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 255 2.8 Language definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 273 see an overview of projects and components, as well as their respective translation pro- gression. New in version 2.5. Components of projects you are watching are shown by default, and cross-referenced the main menu showing translation status for each project on the Weblate instance. • Selecting a language in the main menu Languages will show translation status of all projects, filtered by one of your

projects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 255 2.8 Language definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 273 see an overview of projects and components, as well as their respective translation pro- gression. New in version 2.5. Components of projects you are watching are shown by default, and cross-referenced the main menu showing translation status for each project on the Weblate instance. • Selecting a language in the main menu Languages will show translation status of all projects, filtered by one of your

projects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247 2.8 Language definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264 see an overview of projects and components, as well as their respective translation pro- gression. New in version 2.5. Components of projects you are watching are shown by default, and cross-referenced the main menu showing translation status for each project on the Weblate instance. • Selecting a language in the main menu Languages will show translation status of all projects, filtered by one of your

projects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247 2.8 Language definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264 see an overview of projects and components, as well as their respective translation pro- gression. New in version 2.5. Components of projects you are watching are shown by default, and cross-referenced the main menu showing translation status for each project on the Weblate instance. • Selecting a language in the main menu Languages will show translation status of all projects, filtered by one of your

projects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247 2.8 Language definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264 see an overview of projects and components, as well as their respective translation pro- gression. New in version 2.5. Components of projects you are watching are shown by default, and cross-referenced the main menu showing translation status for each project on the Weblate instance. • Selecting a language in the main menu Languages will show translation status of all projects, filtered by one of your

Upgrading Weblate Backing up and moving Weblate Authentication Access control Translation projects Language definitions Continuous localization Licensing translations Translation process Checks and fixups see an overview of projects and components, as well as their respective translation progression. New in version 2.5. Components of projects you are watching are shown by default, and cross- referenced in the main menu showing translation status for each project on the Weblate instance. Selecting a language in the main menu Languages will show translation status of all projects, filtered by one of your

Upgrading Weblate Backing up and moving Weblate Authentication Access control Translation projects Language definitions Continuous localization Licensing translations Translation process Checks and fixups see an overview of projects and components, as well as their respective translation progression. New in version 2.5. Components of projects you are watching are shown by default, and cross- referenced in the main menu showing translation status for each project on the Weblate instance. Selecting a language in the main menu Languages will show translation status of all projects, filtered by one of your