LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory

Catalog evidence and recorded chart appearances. Inclusion is not an endorsement.

Source snapshot imported 2026-10-20. This is not a live feed. Source and contributions.

Evidence and limits

Finding: Long-term memory requires information extraction, multi-session reasoning, temporal reasoning, knowledge updates, and abstention. Evaluated systems showed substantial degradation across sustained interactions.

Impact: Strengthen update, temporal, and abstention tests in the memory exam. Reject recall accuracy or context length as sufficient memory evidence.

Boundary: The histories and questions are benchmark constructs and do not test authority, provenance, or repository custody. Next: how should correction survival and source precedence be evaluated alongside these abilities?

Flags: generated histories; benchmark and model-judge dependence

Record State: Catalog review recorded; not a performance endorsement

What was reviewed: Structure and relevance screened; not a full evaluation

Inspect original source

Recorded chart appearances

  • 2026-10-13: position 32. Relevant to the recorded review topic (see source); Structure and relevance screened; not a full evaluation evidence
  • 2026-10-12: position 31. Relevant to the recorded review topic (see source); Structure and relevance screened; not a full evaluation evidence