Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2210.00313

CRISP: Curriculum based Sequential Neural Decoders for Polar Code Family

S. Ashwin Hebbar, Viraj Nadkarni, Ashok Vardhan Makkuva, Bhat, Suma, Sewoong Oh, Pramod Viswanath

Published Oct 1, 2022• 6 citations
arXivHTMLPDF

Abstract

Polar codes are widely used state-of-the-art codes for reliable communication that have recently been included in the 5th generation wireless standards (5G). However, there remains room for the design of polar decoders that are both efficient and reliable in the short blocklength regime. Motivated by recent successes of data-driven channel decoders, we introduce a novel $\textbf{C}$ur$\textbf{RI}$culum based $\textbf{S}$equential neural decoder for $\textbf{P}$olar codes (CRISP). We design a principled curriculum, guided by information-theoretic insights, to train CRISP and show that it outperforms the successive-cancellation (SC) decoder and attains near-optimal reliability performance on the Polar(32,16) and Polar(64,22) codes. The choice of the proposed curriculum is critical in achieving the accuracy gains of CRISP, as we show by comparing against other curricula. More notably, CRISP can be readily extended to Polarization-Adjusted-Convolutional (PAC) codes, where existing SC decoders are significantly less reliable. To the best of our knowledge, CRISP constructs the first data-driven decoder for PAC codes and attains near-optimal performance on the PAC(32,16) code.

DOI
10.48550/arxiv.2210.00313

Related papers

Curriculum learning for polar and PAC decoders

Viraj Nadkarni

Polar codes are widely used state-of-the-art codes for reliable communication that have recently been included in the 5 th generation wireless standards (5G).Polar-Adjusted Convolutional (PAC) codes are a recent modification to Polar codes that provide better reliability even at shorter block lengths.Training efficient neural decoders for both kinds of codes proves challenging at longer block lengths or smaller model sizes.We show that the technique of Curriculum learning is useful in training such models.We also show that particular kinds of curricula work better than others in training the network and also explain reasons why this is the case using the structure of the encoding procedure in Polar codes.Various neural architectures, such as transformers, recurrent neural networks and convolutional neural networks, are tried.For a few codes, anomalous behaviour is observed in terms of which curriculum works the best based on what architecture is used.The work explicated in this thesis would not have been possible without the guidance of my adviser, Prof. Pramod Viswanath and close collaborators

•Jul 19, 2022•0 citations

Neural Network Aided SC Decoder for Polar Codes

Jie Gao, Rongke Liu

Theoretically, conventional decoders for polar codes can be entirely replaced by neural network (NN) with enough size and enough training, which called NN decoder. But the exponentially increasing training complexity becomes unacceptable when information length increases, which means only decoders for short codes can be trained practically. However, a successive cancellation (SC) decoder for long polar codes can be divided into several SC decoders for short codes, which can be replaced by several short codes NN decoders, then the whole decoder becomes our NN aided SC (NNSC) decoder. Besides, we defined Universal Set of NN, which can be combined into NNSC decoders for any long polar codes. In this paper, the main purpose of constructing NNSC decoder is increasing decoding efficiency of polar codes by taking advantage of NN, and in the meantime ensuring an acceptable performance compared to conventional decoding algorithms.

IEEE International Conference on Computer and Communications (ICCC)•Dec 1, 2018•6 citations

Neural Network Based Successive Cancellation Decoding Algorithm for Polar Codes in URLLC

Ruiyi Zhang, Fangfang Liu, Zhimin Zeng +2 more

Polar codes are considered as a competitive candidate for 5G ultra-reliable and low-latency communication (URLLC) channel codes, but its strict latency and reliability requirements pose signicant challenges to the existing decoding schemes, especially in terms of decoding latency. In this paper, we propose a neural network based successive cancellation (NN-SC) decoding algorithm. In the proposed algorithm, neural networks are used to replace the local decoders for rate-R constituent codes because of their one-shot decoding capacity, which greatly reduce the decoding latency and algorithmic complexity. The simulation results indicate that the NN-SC decoding algorithm can achieve comparable reliability performance against the successive cancellation (SC) decoding for a polar code of length 128 and rate 1/6, while reducing the decoding latency by 65.2% when compared with the simplified SC decoding. In addition, for two conventional decoding algorithms: SC and belief propagation (BP) decoding, the proposed algorithm can further reduce the decoding latency by 22.8% and 13.8%, respectively.

International Symposium on Wireless Communication Systems•Aug 1, 2019•5 citations

ATRNN: Using Seq2Seq Approach for Decoding Polar Codes

Aniket Dhok, Swapnil Bhole

Polar codes have been chosen by 3GPP as the official error-correcting codes in the control plane of 5G NR enhanced Mobile Broadband (eMBB) due to their low complexity decoding and near-DMC capacity achievement. Recently, deep learning methods have produced promising results in many fields, including linear and polar code decoding. Using end-to-end DL approach provides flexibility, thus empowering us to integrate powerful DL algorithms into channel decoders. In this paper, we propose a novel one-shot decoding framework for polar codes using Attention-based Recurrent Neural Network (ATRNN). Furthermore, we evaluate the decoding performance of ATRNN using bit error rate (BER) and compare it with the state-of-the-art techniques such as successive cancellation (SC).

International Conference on Communication Systems & Networks (COMSNETS)•Jan 1, 2020•2 citations

A RNN Based Decoder for Polar Codes

Yuan Chai, Zuting Chen, Shuai Han +1 more

Polar code is the first type of constructive coding with achievable capacity, which has become the encoding scheme for 5G mobile communication systems and is a cutting-edge direction in channel coding research. However, traditional decoding algorithms for Polar codes still need to be improved in terms of errorcorrection performance and decoding delay. For Polar code short codes, due to the phenomenon of incomplete Polar, the traditional SC decoding algorithm has a problem of poor decoding performance. Algorithms that utilize deep learning for direct or auxiliary operations often yield more accurate computational results with lower computational complexity. Therefore, considering that applying deep learning to the communication field is a mainstream trend in the 6G era, a (16,8) short Polar code decoder based on recurrent neural network (RNN) is proposed. At the same time, a suitable dataset construction method was proposed, which achieved better performance than SC decoding algorithm under low signal-to-noise ratio by adjusting network parameters and training under the appropriate dataset.

International Conference on Information Processing and Network Provisioning (ICIPNP)•Oct 26, 2023•2 citations

CNN-SC Decoder for Polar Codes under Correlated Noise Channels

Wenyuan Rao, Zhibin Liu, Li Huang +2 more

In 5G mobile communication standard, polar codes have been used as coding on control channels. Although the polar code has good performance, the performance of its short code is still facing huge challenges. Moreover, the size limitation of using the deep learning model as the decoder of the polar code has always been the focus of researchers seeking a breakthrough. In this paper, the convolutional neural network (CNN) model in deep learning is cascaded with a successive cancellation (SC) decoder to achieve the decoding of polar codes under additive correlated Gaussian noise (ACGN) channels, thereby improving the decoding performance of short polar codes under ACGN and alleviating the code length limitation of a single deep learning model as a decoder. The cascaded decoding structure is represented as a CNN-SC decoder, which can effectively estimate colored noise. The simulation shows that the CNN-SC decoder improves the performance of polar codes under ACGN channels significantly.

IEEE International Conference on Electronic Information and Communication Technology (ICEICT)•Nov 13, 2020•6 citations
Polar codes are widely used state-of-the-art codes for reliable communication that have recently been included in the 5th generation wireless standards (5G). However, there remains room for the design of polar decoders that are both efficient and reliable in the short blocklength regime. Motivated by recent successes of data-driven channel decoders, we introduce a novel C\textbf{C}CurRI\textbf{RI}RIculum based S\textbf{S}Sequential neural decoder for P\textbf{P}Polar codes (CRISP). We design a principled curriculum, guided by information-theoretic insights, to train CRISP and show that it outperforms the successive-cancellation (SC) decoder and attains near-optimal reliability performance on the Polar(32,16) and Polar(64,22) codes. The choice of the proposed curriculum is critical in achieving the accuracy gains of CRISP, as we show by comparing against other curricula. More notably, CRISP can be readily extended to Polarization-Adjusted-Convolutional (PAC) codes, where existing SC decoders are significantly less reliable. To the best of our knowledge, CRISP constructs the first data-driven decoder for PAC codes and attains near-optimal performance on the PAC(32,16) code.
Polar codes are widely used state-of-the-art codes for reliable communication that have recently been included in the 5 th generation wireless standards (5G).Polar-Adjusted Convolutional (PAC) codes are a recent modification to Polar codes that provide better reliability even at shorter block lengths.Training efficient neural decoders for both kinds of codes proves challenging at longer block lengths or smaller model sizes.We show that the technique of Curriculum learning is useful in training such models.We also show that particular kinds of curricula work better than others in training the network and also explain reasons why this is the case using the structure of the encoding procedure in Polar codes.Various neural architectures, such as transformers, recurrent neural networks and convolutional neural networks, are tried.For a few codes, anomalous behaviour is observed in terms of which curriculum works the best based on what architecture is used.The work explicated in this thesis would not have been possible without the guidance of my adviser, Prof. Pramod Viswanath and close collaborators
Theoretically, conventional decoders for polar codes can be entirely replaced by neural network (NN) with enough size and enough training, which called NN decoder. But the exponentially increasing training complexity becomes unacceptable when information length increases, which means only decoders for short codes can be trained practically. However, a successive cancellation (SC) decoder for long polar codes can be divided into several SC decoders for short codes, which can be replaced by several short codes NN decoders, then the whole decoder becomes our NN aided SC (NNSC) decoder. Besides, we defined Universal Set of NN, which can be combined into NNSC decoders for any long polar codes. In this paper, the main purpose of constructing NNSC decoder is increasing decoding efficiency of polar codes by taking advantage of NN, and in the meantime ensuring an acceptable performance compared to conventional decoding algorithms.
Polar codes are considered as a competitive candidate for 5G ultra-reliable and low-latency communication (URLLC) channel codes, but its strict latency and reliability requirements pose signicant challenges to the existing decoding schemes, especially in terms of decoding latency. In this paper, we propose a neural network based successive cancellation (NN-SC) decoding algorithm. In the proposed algorithm, neural networks are used to replace the local decoders for rate-R constituent codes because of their one-shot decoding capacity, which greatly reduce the decoding latency and algorithmic complexity. The simulation results indicate that the NN-SC decoding algorithm can achieve comparable reliability performance against the successive cancellation (SC) decoding for a polar code of length 128 and rate 1/6, while reducing the decoding latency by 65.2% when compared with the simplified SC decoding. In addition, for two conventional decoding algorithms: SC and belief propagation (BP) decoding, the proposed algorithm can further reduce the decoding latency by 22.8% and 13.8%, respectively.
Polar codes have been chosen by 3GPP as the official error-correcting codes in the control plane of 5G NR enhanced Mobile Broadband (eMBB) due to their low complexity decoding and near-DMC capacity achievement. Recently, deep learning methods have produced promising results in many fields, including linear and polar code decoding. Using end-to-end DL approach provides flexibility, thus empowering us to integrate powerful DL algorithms into channel decoders. In this paper, we propose a novel one-shot decoding framework for polar codes using Attention-based Recurrent Neural Network (ATRNN). Furthermore, we evaluate the decoding performance of ATRNN using bit error rate (BER) and compare it with the state-of-the-art techniques such as successive cancellation (SC).
Polar code is the first type of constructive coding with achievable capacity, which has become the encoding scheme for 5G mobile communication systems and is a cutting-edge direction in channel coding research. However, traditional decoding algorithms for Polar codes still need to be improved in terms of errorcorrection performance and decoding delay. For Polar code short codes, due to the phenomenon of incomplete Polar, the traditional SC decoding algorithm has a problem of poor decoding performance. Algorithms that utilize deep learning for direct or auxiliary operations often yield more accurate computational results with lower computational complexity. Therefore, considering that applying deep learning to the communication field is a mainstream trend in the 6G era, a (16,8) short Polar code decoder based on recurrent neural network (RNN) is proposed. At the same time, a suitable dataset construction method was proposed, which achieved better performance than SC decoding algorithm under low signal-to-noise ratio by adjusting network parameters and training under the appropriate dataset.
In 5G mobile communication standard, polar codes have been used as coding on control channels. Although the polar code has good performance, the performance of its short code is still facing huge challenges. Moreover, the size limitation of using the deep learning model as the decoder of the polar code has always been the focus of researchers seeking a breakthrough. In this paper, the convolutional neural network (CNN) model in deep learning is cascaded with a successive cancellation (SC) decoder to achieve the decoding of polar codes under additive correlated Gaussian noise (ACGN) channels, thereby improving the decoding performance of short polar codes under ACGN and alleviating the code length limitation of a single deep learning model as a decoder. The cascaded decoding structure is represented as a CNN-SC decoder, which can effectively estimate colored noise. The simulation shows that the CNN-SC decoder improves the performance of polar codes under ACGN channels significantly.