NeMo GPT (8B/43B)

Released

NeMo GPT (8B/43B) is an AI model released by NVIDIA on Tuesday, Mar 21 2023. It was released in 8B and 43B parameter sizesThe learned values that shape how a model responds. B means billion and T means trillion. For mixture-of-experts models, the total count is larger than the number active for each token. Parameter count alone does not measure quality., with a 4k token context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider..

Compare NeMo GPT (8B/43B) with

NeMo GPT (8B/43B)

About

At GTC on March 21, 2023, NVIDIA introduced GPT-8 and GPT-43 through its NeMo language service. Early-access customers could use the hosted models through an API and adapt them for tasks such as summarizing financial documents and answering questions about company information.

Both models supported a 4K-token context. NVIDIA trained each on 1.1 trillion tokens and used FLAN instruction data for supervised fine-tuning. The 8B model offered faster responses, while the 43B model supported 50 languages.

Frequently asked questions

NeMo GPT (8B/43B) was released by NVIDIA on Tuesday, Mar 21 2023.

All NVIDIA releases

20 tracked