•5 min read
Understanding Model Parameters: Total Parameters vs Active Parameters
An explanation of how parameters are used during LLM inference, and the key differences between total and active parameters in Dense vs Mixture of Experts (MoE) architectures.