Grouped-Query Attention (GQA)

Grouped-Query Attention (GQA) lets several attention groups share some cached information about earlier tokens.

Home Calculators Model explorer Learn Glossary About the project Have a question or a bug to report?How to use Green Zone Stories