Microsoft Research & AzureOpen weightsWizardLM-2 8x22BParams141B MoE (39B active)Context66kSpeed—ReleaseApr 2024
Microsoft Research & AzureOpen weightsPhi-4-multimodalParams5.6B MultimodalContext128kSpeed—ReleaseFeb 2025