Grok 1.5
xAI · March 2024
● activeClosedmixture of expertsmultimodal
Parameters314B
Context Window128K tokens
Description
An interim upgrade to Grok-1 that dramatically expanded its capabilities: the context window jumped from 8K to 128K tokens (roughly 96,000 words), and it gained the ability to understand images alongside text. Also showed significant improvements in reasoning and coding benchmarks, closing the gap with frontier models like GPT-4.
Key Innovations
Long Context
Long ContextAbility to process very long inputs (100K+ tokens), enabling analysis of entire codebases or books.
Multimodal
MultimodalProcessing multiple types of input (text, images, audio, video) in a single model.