Compare AI models

Specifications
Parameters
16B8B/43B
Context window
4k4k
These models have no shared benchmark scores.
Overview
CompanyDeepSeekNVIDIA
Release dateJan 11 2024Mar 21 2023
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

DeepSeek-MoE and NeMo GPT (8B/43B) don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. NeMo GPT (8B/43B) shipped 296 days before DeepSeek-MoE, so benchmark comparisons should account for the intervening progress.

DeepSeek-MoE has 16B parameters, while NeMo GPT (8B/43B) has 8B/43B. Context windows are 4k (DeepSeek-MoE) vs 4k (NeMo GPT (8B/43B)). DeepSeek-MoE is open weight, while NeMo GPT (8B/43B) is closed.

Direct benchmark comparisons are unavailable — DeepSeek-MoE and NeMo GPT (8B/43B) don't publish scores on any of the same benchmarks.