This repository contains code required to reproduce the expert pruning and merging methods used in the paper: REAP the Experts: Why Pruning Prevails for One-Shot MoE compression Expert pruning and ...

MemTrace helps developers understand why an LLM memory system gives a wrong answer. A memory system may read many user messages, extract facts, update stored memories, delete outdated memories, ...