Phison Details SSD With Built-In NPU, 64GB Memory to Run AI on Drive at Chicago Conference

Storage controller manufacturer Phison demonstrated a new enterprise solid-state drive design featuring a built-in neural processing unit and 64GB of memory to run artificial intelligence models directly on the drive at the International Supercomputing Conference in Chicago this week.

AI servers spend much of their operating time pulling data from solid-state storage so a host processor or graphics card can parse it. Phison wants that processing to happen before the data leaves the drive.

The company detailed two enterprise storage architectures at SC26, Tom’s Hardware reported. One design integrates the NPU and memory to run AI frameworks directly on the hardware.

The second design merges a fast programmable single-level cell cache and large quad-level cell capacity behind a single controller, as AI JP Net noted. This layout places the cache inside each individual drive.

“scan and process data in parallel” the drives do, Phison says. It then returns only the relevant results.

Phison claims this approach cuts data transfers by 10 to 100 times for suitable workloads, according to 5iter. The host central processing unit gains breathing room as a result.

Phison Gen 6 Controller
Photo: tomshardware.com

The onboard memory delivers 130 GB/s of bandwidth. That figure stands at more than four times the 28 GB/s speed that Phison’s upcoming PCIe 6.0 controller delivers to a host, TechSpot reported. The drive reads its own data far faster than it transfers it outward.

Developers can build on the drive without specialized programming tools. The hardware supports common inference servers and runtimes including PyTorch, vLLM, OpenVINO, and llama.cpp.

Phison said that the integrated NPU delivers 36,800 DMIPS of compute performance. Analysts point out that DMIPS is an older CPU integer benchmark from the 1980s, while neural processing units are typically rated in TOPS, indicating the figure likely describes companion CPU cores rather than AI processing power.

Founded in 2000 by Datuk Pua Khein Seng and four others, Phison claims to have produced the earliest single-chip USB flash removable disk, known as a “pen drive.” The Taiwanese public company designs and sells controllers for NAND flash memory used in SSDs, USB drives, and memory cards.

In April 2022, Phison announced a long-term partnership with Seagate to develop and distribute enterprise NVMe SSDs, marking a deeper push into the data center market where its new AI-enabled drive is targeted.

The company has not disclosed a product name, sampling date, or memory type. Many of the showcased products and features remain in development.

Photo of author

Technology Desk

Technology Desk at Archyde.

Ivrea Prosecutors Close Probe Into 2.9M Euro Life Insurance Fraud

BTS Wins Five Awards, Cortis Takes Song of the Year at 2026 MAMA Awards