Performance benefits - Amazon ElastiCache
Services or capabilities described in AWS documentation might vary by Region. To see the differences applicable to the AWS European Sovereign Cloud Region, see the AWS European Sovereign Cloud User Guide.

Performance benefits

The following table summarizes the performance improvements observed in testing with a memory-enabled agent versus a stateless agent:

Metric Without memory With memory Improvement
Tool calls per request 3 0 (memory retrieval) Eliminated redundant tool calls
Token usage ~70,000 ~6,300 12x reduction
Response time 9.25 seconds 2 seconds 3x+ faster
Memory lookup latency N/A Sub-millisecond Valkey in-memory performance