Datasheet
MemoryAI™
KV Cache Server
Ethernet-based memory appliance for faster training and low-latency, enterprise-scale production inference
Overview
Penguin Solutions MemoryAI KV Cache Server is an Altus-based 4U rackmount server designed specifically for use as a KV cache server during AI inference. It features dual AMD EPYC CPUs and enables up to 11 TB of CXL-based memory (SMART CXA-8F2W).
The server provides 3TB main DDR5 memory and up to 8 1TB CXL Add-In-Cards (AICs) and uses dual 400Gb/s Ethernet NICs for network connectivity.
Key Features
Up to 11 TB of DDR5 to create pooled memory for KV cache storage
CXL Add-In-Cards to provide significantly expanded memory capacity critical for KV cache tiering
Up to 24 DDR5-6400 MT/s ECC memory modules to deliver speed and efficiency for data-intensive workloads
Dual AMD EPYC™ 9005 processors
Technical Specifications
Fo r m Fa cto r
Form Factor 4U Rackmount
Proces so r s
Processor N um ber 2
Processor Type AMD EPYC™ 9005 series
M a xim um TD P 500W
Moth er b oa rd
Chipset SoC
B oa rd M a nage m e nt
B M C Chipset
ASpeed AST2600
Dedicated B M C Inter face RJ45
I PM I 2 0
Vir tua l Media Over L AN Yes
K VM Over L AN Yes
M e m o r y
M emor y Type
DDR5-6400 MT/s
M emor y Ca pacit y Up to 3TB DDR5
CXL Memory Capacity Up to 8TB (CXL based memory DIMMs)
Sto rage S yste m
Ha rd D rive Bays
N et wo rk i ng
SATA/U.2 NVMe (2.5”) N/A M.2 (2280/22110) 2 PCIe Gen3
Ethernet Controller Intel® I350-AM2
O n-Boa rd L AN 2x 400 GbE/RJ45
P C I E x pa n sio n S l ots
N um ber of Slots/G en/Speed (Size) 8x PCIe Gen5 x16 FHFL, 2x PCIe Gen5 x16 LP
G PU
G PU Ca pa ble No
G PU Suppor ted N/A
E x te r na l I/O I nte r fa ces
US B Por ts 2x USB 3.2 Gen1
Video O utput 1x VGA Port
S u p p o r te d O p e rati ng S yste m
Suppor ted OS RHEL, Rocky
Powe r S yste m
Power Supply Size 4x 3000W 80Plus Titanium
Reg u l ato r y Co m p l ia n ce
Reg ulations CE, FCC
M o u nti ng H a rd wa re
Rackmount Rails Standard Rails included
O p e rati ng Env i ro n m e nt
O perating Tem perature 10C to 35C (50F to 95F)
Non-operating Tem perature 0C to 60C (32F to 140F)
O perating Relative H umidit y 8% to 80% (non-condensing)
Non-operating Relative H umidit y 20% to 95% (non-condensing)
S yste m Di m e n sio n s Height
inches
inches
Wa r ra nt y
Wa rra nt y 3 Years Standard; For details see the MPSA
Contact Us For sa l es q ue ries , pl ease conta ct sa l es@pe n g uinsol utions com. To l ea rn m ore a bo ut the MemoryAI KV Cache Server and oth e r Pe n g uin Sol utions prod ucts , please visit: ww w pe n g uinsol utions com © 2026 Penguin Solutions, Inc. All rights reserved. Penguin Solutions and Penguin Solutions MemoryAI are trademarks within the family of companies owned by Penguin Solutions, Inc. All other trademarks are the property of their respective owners, and no claims of ownership are asserted therein.