"MoE-Infinity: Activation-Aware Expert Offloading for Efficient MoE Serving."

Leyang Xue et al. (2024)

Details and statistics

DOI: 10.48550/ARXIV.2401.14361

access: open

type: Informal or Other Publication

metadata version: 2024-02-06

a service of  Schloss Dagstuhl - Leibniz Center for Informatics