Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

International Symposium on Problems of Redundancy in Information and Control Systems (REDUNDANCY)

Deep Neural Network Based Decoding of Short 5G LDPC Codes

Kirill Andreev, Alexey Frolov, German Svistunov, Kedi Wu, Jing Liang

Published Oct 25, 2021• 9 citations
Publisher

Abstract

We investigate the application of machine learning techniques (in particular, deep neural networks, DNN) to improve the decoding algorithms of short quasi-cyclic low-density paritycheck (LDPC) codes adopted to the 5G standard. We note that straightforward application of general-purpose DNNs is not possible due to the curse of dimensionality problem – the training set size grows exponentially with the number of information bits. In our opinion, the only way to deal with this problem is to combine deep learning methods with existing decoding algorithms. We start with a Tanner-based neural network decoder with Min-Sum activation functions proposed by Nachmani et al. and extend it as follows. First, the quasi-cyclic nature of 5G LDPC codes allows us to use a single weight per circular matrix (circulant). We refer to this as weight sharing. This idea significantly reduces the training time, preserving the error-correcting performance. Second, we add residual connections to our NN architecture. Residual connections improve the performance and reduce the training time. We also present the results for the rate and length adaptation techniques. Rate adaptation allows multiple DNNs corresponding to different coding rates to run with a single set of trained weights. Length adaptation allows optimally reusing weights for multiple lifting size indices.

DOI
10.1109/redundancy52534.2021.9606471

Related papers

Learning to Decode LDPC Codes with Finite-Alphabet Message Passing

Bane V. Vasic, Xin Wei Xiao, Shu Lin

In this paper, we discuss the perspectives of utilizing deep neural networks (DNN) to decode Low-Density Parity Check (LDPC) codes. The main idea is to build a neural network to learn and optimize a conventional iterative decoder of LDPC codes. A DNN is based on Tanner graph, and the activation functions emulate message update functions in variable and check nodes. We impose a symmetry on weight matrices which makes it possible to train the DNN on a single codeword and noise realizations only. Based on the trained weights and the bias, we further quantize messages in such DNN-based decoder with 3-bit precision while maintaining no loss in error performance compared to the min-sum algorithm. We use examples to present that the DNN framework can be applied to various code lengths. The simulation results show that, the trained weights and bias make the iterative DNN decoder converge faster and thus achieve higher throughput at the cost of trivial additional decoding complexity.

Information Theory and Applications Workshop (ITA)•Feb 1, 2018•34 citations

Normalized Neural Network for Belief Propagation LDPC Decoding

Yiduo Tang, Lin Zhou, Shuying Zhang +2 more

BP decoding algorithm is one of the commonly used decoding algorithms for LDPC codes. To adapt LDPC codes to different 5G scenarios and further improve the decoding performance of short LDPC codes, a scheme combining model-driven deep learning with a traditional BP decoding algorithm is proposed. With the advantages of model-driven, this solution expands the decoding iteration process between the check node and the variable node into a neural network and proposes a parameter normalization optimization solution to solve the problem of the program with many training parameters, the edge weights of the optimized Tanner graph are re-assigned and bound. Simulation results show that the proposed scheme can improve the decoding performance of LDPC codes with short lengths.

IEEE International Conference on Networking, Sensing and Control (ICNSC)•Dec 3, 2021•8 citations

Optimizing LDPC Decoding with Machine Learning Using Learnable Weights: A Hybrid Framework Integrating Neural Networks with Iterative Message-Passing for Enhanced Error-Correction in 5G Systems

Niklas Savijoki

This thesis investigates the optimization of Low-Density Parity-Check (LDPC) decoding through machine learning techniques, with a specific focus on 5G communication systems. Traditional LDPC decoding algorithms face a critical trade-off: Belief Propagation (BP) offers excellent error-correction performance but with high computational complexity, while Min-Sum (MS) reduces complexity at the cost of degraded performance. To address this limitation, a hybrid neural network architecture is proposed that incorporates learnable normalization and offset weights into the message-passing framework of LDPC decoders. This approach integrates multiplicative (normalization) and additive (offset) weights into the Tanner graph structure, allowing the decoder to adapt to specific channel conditions. A novel weighted binary cross-entropy loss function is developed that prioritizes entire block recovery by assigning different importance to information and parity bits during training. Experimental results demonstrate that ML-assisted decoder consistently outperforms conventional Min-Sum decoding, approaching the error-correction capability of Belief Propagation while maintaining comparable computational efficiency to Min-Sum. Comprehensive evaluations across different weight configurations (scalar and vector-based) reveal that increased parametrization generally improves decoding performance. Analysis of the impact of iteration counts shows that the optimal number of decoding iterations varies between different code configurations with studied Basegraph 1 case requiring 15 iterations for optimal performance while studied Basegraph 2 case benefits significantly from 20 iterations. The proposed ML-assisted LDPC decoder represents a significant advancement for 5G systems, offering improved error correction at lower signal strengths while balancing latency and computational requirements. This research contributes to the ongoing evolution of wireless technology by demonstrating how machine learning can effectively enhance traditional decoding algorithms, providing a practical pathway toward more efficient and adaptive error correction in modern communication systems.

•Jan 1, 2025•0 citations

LDPC long code decoding with neural normalized min-sum based on deep learning

Jia Di, Yan Wei, Saijie Yao +2 more

LDPC code is a widely-used high-performance error correction code. In recent years, LDPC decoding based on deep learning and neural networks becomes a research hotspot. Based on the (512,256) LDPC code of the CCSDS standard, this paper firstly studies the traditional decoding algorithms of SP, MS, NMS, and OMS, laying a foundation for the construction of neural networks. Then a data-driven (DD) decoding method is studied which adopts the information with its encoded, modulated and noise-added LDPC code as the training data within a Multi-layer Perceptron (MLP) neural network. In order to solve the problem of high bit error rate (BER) in data-driven method, the Neural Normalized Min-sum (NNMS) decoding in which the NMS algorithm is mapped to the neural network structure is proposed, achieving more excellent BER performance than that of NMS. The BER declines by 85.19% when channel SNR equals to 3.5 dB. Finally, improved training methods to enhance the SNR generalization ability of the NNMS network is studied.

•Dec 1, 2024•0 citations

A Model-Driven Quasi-ResNet Belief Propagation Neural Network Decoder for LDPC Codes

Liangsi Ma, Bei Liu, Xin Su +1 more

For the Belief Propagation (BP) algorithm of low-density parity-check (LDPC) codes, existing deep learning methods have a limited performance improvement and it is difficult to train deep-level networks. In this paper, a model-driven quasi-residual network (Quasi-ResNet) BP decoding architecture is proposed for LDPC codes to further improve the performance of standard BP decoding. This method feeds the reliable messages calculated in current iteration into the next iteration based on the shortcut connection, and adjusts the weight of shortcut connection based on the error Back Propagation algorithm of neural network to determine the optimal genetic proportion of reliable messages. The decoding architecture is composed of a model-driven deep neural network (DNN) and shortcut connection. Simulation results show that the decoder can not only unfold more layers quickly compared with the DNN-based BP decoder, but also further improve the decoding performance.

IEEE Symposium on Computers and Communications (ISCC)•Jul 9, 2023•1 citation

Neural Self-Corrected Min-Sum Decoder for NR LDPC Codes

Taehyun Kim, Joo Sung Park

In this letter, a neural self-corrected min-sum (NSCMS) decoder is proposed for 5G new radio (NR) low-density parity-check (LDPC) codes. Training in real-time on a rapidly changing channel requires low latency and minimal resource utilization. Unfortunately, typical neural decoders for LDPC codes use large and deep neural networks proportional to the code length, leading to latency and resource problems. In the network of NSCMS similar to network model pruning, certain nodes meeting the self correction condition are deleted and excluded from learning. This reduces the computational complexity of learning, compared to conventional networks. Thus, the NSCMS decoder has high practicality in real-time training using machine learning. Furthermore, self-correction allows for more reliable message-based learning and significantly improves performance. Simulation results demonstrate that NSCMS decoders exhibit lower error rates than previously proposed min-sum decoders.

IEEE Communications Letters•May 22, 2024•8 citations
We investigate the application of machine learning techniques (in particular, deep neural networks, DNN) to improve the decoding algorithms of short quasi-cyclic low-density paritycheck (LDPC) codes adopted to the 5G standard. We note that straightforward application of general-purpose DNNs is not possible due to the curse of dimensionality problem – the training set size grows exponentially with the number of information bits. In our opinion, the only way to deal with this problem is to combine deep learning methods with existing decoding algorithms. We start with a Tanner-based neural network decoder with Min-Sum activation functions proposed by Nachmani et al. and extend it as follows. First, the quasi-cyclic nature of 5G LDPC codes allows us to use a single weight per circular matrix (circulant). We refer to this as weight sharing. This idea significantly reduces the training time, preserving the error-correcting performance. Second, we add residual connections to our NN architecture. Residual connections improve the performance and reduce the training time. We also present the results for the rate and length adaptation techniques. Rate adaptation allows multiple DNNs corresponding to different coding rates to run with a single set of trained weights. Length adaptation allows optimally reusing weights for multiple lifting size indices.
In this paper, we discuss the perspectives of utilizing deep neural networks (DNN) to decode Low-Density Parity Check (LDPC) codes. The main idea is to build a neural network to learn and optimize a conventional iterative decoder of LDPC codes. A DNN is based on Tanner graph, and the activation functions emulate message update functions in variable and check nodes. We impose a symmetry on weight matrices which makes it possible to train the DNN on a single codeword and noise realizations only. Based on the trained weights and the bias, we further quantize messages in such DNN-based decoder with 3-bit precision while maintaining no loss in error performance compared to the min-sum algorithm. We use examples to present that the DNN framework can be applied to various code lengths. The simulation results show that, the trained weights and bias make the iterative DNN decoder converge faster and thus achieve higher throughput at the cost of trivial additional decoding complexity.
BP decoding algorithm is one of the commonly used decoding algorithms for LDPC codes. To adapt LDPC codes to different 5G scenarios and further improve the decoding performance of short LDPC codes, a scheme combining model-driven deep learning with a traditional BP decoding algorithm is proposed. With the advantages of model-driven, this solution expands the decoding iteration process between the check node and the variable node into a neural network and proposes a parameter normalization optimization solution to solve the problem of the program with many training parameters, the edge weights of the optimized Tanner graph are re-assigned and bound. Simulation results show that the proposed scheme can improve the decoding performance of LDPC codes with short lengths.
This thesis investigates the optimization of Low-Density Parity-Check (LDPC) decoding through machine learning techniques, with a specific focus on 5G communication systems. Traditional LDPC decoding algorithms face a critical trade-off: Belief Propagation (BP) offers excellent error-correction performance but with high computational complexity, while Min-Sum (MS) reduces complexity at the cost of degraded performance. To address this limitation, a hybrid neural network architecture is proposed that incorporates learnable normalization and offset weights into the message-passing framework of LDPC decoders. This approach integrates multiplicative (normalization) and additive (offset) weights into the Tanner graph structure, allowing the decoder to adapt to specific channel conditions. A novel weighted binary cross-entropy loss function is developed that prioritizes entire block recovery by assigning different importance to information and parity bits during training. Experimental results demonstrate that ML-assisted decoder consistently outperforms conventional Min-Sum decoding, approaching the error-correction capability of Belief Propagation while maintaining comparable computational efficiency to Min-Sum. Comprehensive evaluations across different weight configurations (scalar and vector-based) reveal that increased parametrization generally improves decoding performance. Analysis of the impact of iteration counts shows that the optimal number of decoding iterations varies between different code configurations with studied Basegraph 1 case requiring 15 iterations for optimal performance while studied Basegraph 2 case benefits significantly from 20 iterations. The proposed ML-assisted LDPC decoder represents a significant advancement for 5G systems, offering improved error correction at lower signal strengths while balancing latency and computational requirements. This research contributes to the ongoing evolution of wireless technology by demonstrating how machine learning can effectively enhance traditional decoding algorithms, providing a practical pathway toward more efficient and adaptive error correction in modern communication systems.
LDPC code is a widely-used high-performance error correction code. In recent years, LDPC decoding based on deep learning and neural networks becomes a research hotspot. Based on the (512,256) LDPC code of the CCSDS standard, this paper firstly studies the traditional decoding algorithms of SP, MS, NMS, and OMS, laying a foundation for the construction of neural networks. Then a data-driven (DD) decoding method is studied which adopts the information with its encoded, modulated and noise-added LDPC code as the training data within a Multi-layer Perceptron (MLP) neural network. In order to solve the problem of high bit error rate (BER) in data-driven method, the Neural Normalized Min-sum (NNMS) decoding in which the NMS algorithm is mapped to the neural network structure is proposed, achieving more excellent BER performance than that of NMS. The BER declines by 85.19% when channel SNR equals to 3.5 dB. Finally, improved training methods to enhance the SNR generalization ability of the NNMS network is studied.
For the Belief Propagation (BP) algorithm of low-density parity-check (LDPC) codes, existing deep learning methods have a limited performance improvement and it is difficult to train deep-level networks. In this paper, a model-driven quasi-residual network (Quasi-ResNet) BP decoding architecture is proposed for LDPC codes to further improve the performance of standard BP decoding. This method feeds the reliable messages calculated in current iteration into the next iteration based on the shortcut connection, and adjusts the weight of shortcut connection based on the error Back Propagation algorithm of neural network to determine the optimal genetic proportion of reliable messages. The decoding architecture is composed of a model-driven deep neural network (DNN) and shortcut connection. Simulation results show that the decoder can not only unfold more layers quickly compared with the DNN-based BP decoder, but also further improve the decoding performance.
In this letter, a neural self-corrected min-sum (NSCMS) decoder is proposed for 5G new radio (NR) low-density parity-check (LDPC) codes. Training in real-time on a rapidly changing channel requires low latency and minimal resource utilization. Unfortunately, typical neural decoders for LDPC codes use large and deep neural networks proportional to the code length, leading to latency and resource problems. In the network of NSCMS similar to network model pruning, certain nodes meeting the self correction condition are deleted and excluded from learning. This reduces the computational complexity of learning, compared to conventional networks. Thus, the NSCMS decoder has high practicality in real-time training using machine learning. Furthermore, self-correction allows for more reliable message-based learning and significantly improves performance. Simulation results demonstrate that NSCMS decoders exhibit lower error rates than previously proposed min-sum decoders.