Datasheet
MemoryAI™ KV Cache Server NMA4801 Ethernet-based memory appliance for faster training and low-latency, enterprise-scale production inference
Overview Penguin Solutions MemoryAI KV Cache Server NMA4801 is a 4U
Key Features
rackmount server designed specifically for use as a KV cache server during AI inference. It features dual AMD EPYC CPUs and
x
enables up to 11 TB of CXL-based memory (SMART CXA-8F2W).
pooled memory for KV cache storage
The server provides 3TB main DDR5 memory and up to 8 1TB CXL Add-In-Cards (AICs) and uses dual 400Gb/s Ethernet NICs
Up to 11 TB of DDR5 to create
x
CXL Add-In-Cards to provide significantly expanded
for network connectivity.
memory capacity critical for KV cache tiering x
Up to 24 DDR5-6400 MT/s ECC memory modules to deliver speed and efficiency for dataintensive workloads
x
Dual AMD EPYC™ 9355 processors
© 2026 Penguin Solutions MemoryAI KV Cache Server - 11.2026
1
Technical Specifications Form Factor Form Factor
4U Rackmount
Processors Processor Number
2
Processor Type
AMD EPYC™ 9355
Maximum TDP
500W
Motherboard Chipset
SoC
Board Management BMC Chipset
ASpeed AST2600
Dedicated BMC Interface
RJ45
IPMI 2.0
Yes
Virtual Media Over LAN
Yes
KVM Over LAN
Yes
RedFish
Yes
Memory Memory Type
DDR5-6400 MT/s
Memory Capacity
Up to 3TB DDR5
CXL Memory Capacity
Up to 8TB (CXL based memory DIMMs)
Storage System Hard Drive Bays
SATA/U.2 NVMe (2.5”)
N/A
M.2 (2280/22110)
2 PCIe Gen3
Networking Ethernet Controller
Intel® X710 10GbE
On-Board LAN
2x 400Gb/s QSFP112
PCI Expansion Slots Number of Slots/Gen/Speed (Size)
8x PCIe Gen5 x16 FHFL, 2x PCIe Gen5 x16 LP
GPU GPU Capable
No
GPU Supported
N/A
External I/O Interfaces USB Ports
2x USB 3.2 Gen1
Video Output
1x VGA Port
Supported Operating System Supported OS
Ubuntu, RHEL, Rocky
Power System Power Supply Size
© 2026 Penguin Solutions MemoryAI KV Cache Server - 11.2026
4x 3000W 80Plus Titanium
2
Regulatory Compliance Regulations
CE, FCC
Mounting Hardware Rackmount Rails
Standard Rails included
Operating Environment Operating Temperature
10C to 35C (50F to 95F)
Non-operating Temperature
0C to 60C (32F to 140F)
Operating Relative Humidity
8% to 80% (non-condensing)
Non-operating Relative Humidity
20% to 95% (non-condensing)
System Dimensions Height
6.93 inches
Width
17.64 inches
Depth
34.65 inches
Warranty 3 Years Standard; For details see the MPSA
Warranty
Contact Us For sales queries, please contact sales@penguinsolutions.com. To learn more about MemoryAI KV Cache Server and other Penguin Solutions products, please visit: www.penguinsolutions.com © 2026 Penguin Solutions, Inc. All rights reserved. Penguin Solutions and Penguin Solutions MemoryAI are trademarks or registered trademarks of Penguin Solutions. All other product names, trademarks, and registered trademarks are the property of their respective owners. All company, product, and service names used in this document are for identification purposes only. Use of these names, trademarks, and brands does not imply endorsement.