IEEE International Symposium on Information Theory (ISIT)
ProductMPT: Message-Passing Transformer for Product Codes
Jinyuan Li, Shuai Xiao, Weijun Fang
Abstract
Deep learning has shown significant promise in neural decoding, and Transformer-based decoders have achieved competitive performance across various code families. However, applying these decoders to product codes remains challenging, as they often treat the code as a generic linear block code, failing to exploit the intrinsic row-column algebraic constraints. This paper proposes the Product Message-Passing Transformer (ProductMPT), a novel architecture that transforms the inherent row-column parity-check structure of product codes into a structured neural message-passing mechanism. To facilitate this mechanism, we introduce a unified syndrome that explicitly couples row-wise and column-wise parity constraints. Extensive experiments on various product codes demonstrate that ProductMPT achieves substantial bit error rate (BER) improvements, typically by about an order of magnitude in the moderate-to-high signal-to-noise ratio (SNR) regime, while significantly reducing computational complexity, inference latency, and memory usage compared with state-of-the-art Transformer-based decoders.