Communications of the ACM

Can We Understand How Large Language Models Reason?

Large language models can write essays, solve math problems, and generate computer code, but it’s not fully understood how ...
IEEE

PLAIN: Leveraging High Internal Bandwidth in PIM for Accelerating Large Language Model Inference via Mixed-Precision Quantization

Abstract: DRAM-based processing-in-memory (DRAM-PIM) has gained commercial prominence in recent years. However, its integration for deep learning acceleration, particularly for large language models ...
IEEE

5-nm High-Efficiency and High-Density Digital SRAM In-Memory-Computing Macros for AI Accelerators

Abstract: Two specialized digital SRAM In-memory computing (IMC) macros were implemented using a 5-nm process: 1) a high efficiency (HE) macro and 2) a high-density (HD) macro. The HE macro achieves ...
Tech Xplore

Ferroelectric memory enables one chip to sample randomness and compute for generative AI

For the first time, a research team has demonstrated an artificial intelligence semiconductor technology that integrates the ...