Arctic
Snowflake · April 2024
● activeOpen Sourcemixture of expertstext
Parameters480B (17B active)
Context Window4K tokens
Why It Matters
Snowflake's entry into the AI model race, designed specifically for enterprise SQL and coding tasks.
Description
Snowflake's entry into the AI model race, featuring 480 billion total parameters with only 17 billion active per input — one of the most aggressive Mixture-of-Experts sparsity ratios of any model. Designed specifically for enterprise SQL generation and coding tasks rather than general-purpose conversation, reflecting Snowflake's focus on data warehouse and analytics customers.
Key Innovations
MoE
MoEArchitecture where only a fraction of the model's parameters are active for each input, allowing massive scale with lower compute.
Open Weight
Open WeightModel weights are publicly released but training data/code may not be. Enables fine-tuning but not full reproduction.
External Links
More from Community / Uncensored
WizardLM2023-06 · 13B
Dolphin (Eric Hartford)2023-07 · —
Hermes (Nous Research)2023-09 · —
LLaMA 4 Scout Abliterated2025-05 · 81B (17B active × 16 experts)
DeepSeek R1 Uncensored2025-03 · 671B (37B active)
Bark2023-04 · —
Mistral 7B Uncensored2024-01 · 7B
Qwen 2.5 72B Abliterated2025-01 · 72B
SOLAR 10.7B Uncensored2024-02 · 10.7B
LLaMA 3.1 405B Abliterated2024-08 · 405B