MoE model calculator
Plan a Mixture of Experts (MoE) model on one or more graphics cards. Add each card’s video memory separately; their capacities can differ.
Plan a Mixture of Experts (MoE) model on one or more graphics cards. Add each card’s video memory separately; their capacities can differ.