Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2005.05788 · IEEE Transactions on Communications

Noisy Density Evolution With Asymmetric Deviation Models

Elsa Dupraz, François Leduc-Primeau

Published Nov 23, 2020• 4 citations
arXivHTMLPDF

Abstract

This paper considers low-density parity-check (LDPC) decoders affected by deviations introduced by the electronic device on which the decoder is implemented. Noisy density evolution (DE) that allows to theoretically study the performance of these LDPC decoders can only consider symmetric deviation models due to the all-zero codeword assumption. A novel DE method is proposed that admits the use of asymmetric deviation models, thus widening the range of faulty implementations that can be analyzed. DE equations are provided for three noisy decoders: belief propagation, Gallager B, and quantized min-sum (MS). Simulation results confirm that the proposed DE accurately predicts the performance of LDPC decoders with asymmetric deviations. Furthermore, asymmetric versions of the Gallager B and MS decoders are proposed to compensate the effect of asymmetric deviations. The parameters of these decoders are then optimized using the proposed DE, leading to better ensemble thresholds and improved finite-length performance in the presence of asymmetric deviations.

DOI
10.1109/tcomm.2020.3039856

Related papers

Discrete density evolution and LDPC codes designwith asymmetric channels

涛 袁, 征 马, 琦珂 庞 +1 more

To design low-density parity-check (LDPC) codes with asymmetric channels and analyze their performance, an achievable asymmetric discrete density evolution method is proposed, which is based on offset min-sum decoding. First, the iterative formula of low-complexity asymmetric channel discrete density evolution is derived by means of combinatorics, difference method and the binomial theorem. The iterative formula is applied to further optimize the design of the LDPC codes using the offset min-sum decoding, and the optimal degree distributions and performance of the LDPC codes under different quantization ranges and step sizes are obtained under the asymmetric channel. Finally, the optimal offset values under high-precision quantization are obtained. The results show that under the asymmetric channel, the complexity of the proposed asymmetric density evolution method based on the offset min-sum decoding is reduced by an order of magnitude than that using the original method. For a fixed code rate, the smaller the variable node degree of the regular codes, the better the performance and the smaller the optimal offset value. For irregular LDPC codes, the optimal degree distributions and offset values are determined according to the differential evolution algorithm. For a fixed code rate, the larger the maximum variable node degree, the better the performance of irregular codes.

Scientia Sinica Informationis•Aug 29, 2022•1 citation

Density evolution thresholds for noise-against-noise min-sum decoders

Franklin Cochachin, David Declercq, Emmanuel Boutillon +1 more

In this paper, we define Noise-against-Noise Min-Sum (NAN-MS) decoders as decoders that incorporate a certain amount of random perturbation due to deliberate noise injection. We introduce a noise model which is used to implement quantized NAN-MS decoders, using a limited number of precision bits. The behavior of NAN-MS decoders is investigated in the asymptotic limit of the code length using a noisy version of density evolution (DE). We use the noisy-DE thresholds to analyze and optimize the noise model parameters. We show that a controlled injection of noise allows NAN-MS decoders to achieve better performance than noiseless MS decoders, especially for low precision. The finite-length simulations confirm the conclusions of the DE analysis.

IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)•Oct 1, 2017•7 citations

Density Evolution for Min-Sum Decoding of LDPC Codes Under Unreliable Message Storage

Alexios Balatsoukas‐Stimming, Andreas Peter Burg

We analyze the performance of quantized min-sum decoding of low-density parity-check codes under unreliable message storage. To this end, we introduce a simple bit-level error model and show that decoder symmetry is preserved under this model. Subsequently, we formulate the corresponding density evolution equations to predict the average bit error probability in the limit of infinite block length. We present numerical threshold results and we show that using more quantization bits is not always beneficial in the context of faulty decoders.

arXiv:1404.1601•IEEE Communications Letters•Mar 17, 2014•51 citations

Optimization of Sign-Preserving Noise-Aided Min-Sum Decoders with Density Evolution

Franklin Cochachin, Emmanuel Boutillon, David Declercq

The novelty of this paper is to propose a new LDPC decoder called Sign-Preserving Noise-Aided Min-Sum (SP-NA-MS) decoder that improves the decoding performance compared to classical Offset Min-Sum (OMS) decoder when messages are quantized, with only 3 or 4 bits. The particularity of the SP-NA-MS decoder is that the variable-to-check messages are never set to 0, and always carry the sign information. Moreover, the decoder incorporates random perturbation due to deliberate noise injection. The parameters of the SP-NA-MS decoders are optimized in the asymptotic limit of the code length thanks to the Density Evolution (DE) method. The finite-length simulations confirm the conclusions of the DE analysis and gain of up to 0.3 dB in SNR can be obtained compared to regular OMS with same quantization level.

International Symposium on Turbo Codes and Iterative Information Processing•Dec 1, 2018•2 citations

Density Evolution and Functional Threshold for the Noisy Min-Sum Decoder

Christiane L. Kameni Ngassa, Valentin Savin, Elsa Dupraz +1 more

This paper investigates the behavior of the Min-Sum decoder running on noisy devices. Our aim is to evaluate the robustness of the decoder to computation noise caused by the faulty logic in the processing units. This type of noise represents a new source of errors that may occur during the decoding process. To this end, we first introduce probabilistic models for the arithmetic and logic units of the finite-precision min-sum decoder and then carry out the density evolution analysis of the noisy min-sum decoder. We show that, in some particular cases, the noise introduced by the device can help the min-sum decoder to escape from fixed points attractors and may actually result in an increased correction capacity with respect to the noiseless decoder. We also point out a specific threshold phenomenon, referred to as functional threshold, which accurately describes the convergence behavior of noisy decoders. The behavior of the noisy MS is demonstrated in the asymptotic limit of the code length through a noisy version of density evolution and is also verified in the finite-length case by Monte Carlo simulations.

arXiv:1405.6594•IEEE Transactions on Communications•Jan 6, 2015•40 citations

Performance analysis of iterative decoding algorithms with memory

Emil Janulewicz, Amir H. Banihashemi

Density evolution is often used to determine the performance of an ensemble of low-density parity-check (LDPC) codes under iterative message-passing algorithms. Conventional density evolution techniques over memoryless channels are based on the independence assumption amongst all the processed messages in variable and check nodes. This assumption is valid for many algorithms such as standard belief propagation (BP) and min-sum (MS) algorithms. However, there are other important iterative algorithms such as successive relaxation (SR) versions of BP and MS, and differential decoding with binary message passing (DD-BMP) algorithm of Mobini et. al., for which this assumption is not valid. The dependence created among messages for these algorithms is due to the introduction of memory in the iterative algorithm. In this work, we propose a model for iterative decoding algorithms with memory which covers SR and DD-BMP algorithms as special cases. Based on this model, we derive a Bayesian network for iterative algorithms with memory over memoryless channels and use this representation to analyze the algorithms using density evolution. The density evolution technique is developed based on truncating the memory of the decoding process and approximating it with a finite order Markov process, and can be implemented efficiently. As an example, we apply our technique to analyze the performance of DD-BMP on regular LDPC code ensembles, and make a number of interesting observations with regard to the performance/complexity trade off of DD-BMP in comparison with BP and MS algorithms.

IEEE Information Theory Workshop (ITW)•Jan 1, 2010•2 citations
This paper considers low-density parity-check (LDPC) decoders affected by deviations introduced by the electronic device on which the decoder is implemented. Noisy density evolution (DE) that allows to theoretically study the performance of these LDPC decoders can only consider symmetric deviation models due to the all-zero codeword assumption. A novel DE method is proposed that admits the use of asymmetric deviation models, thus widening the range of faulty implementations that can be analyzed. DE equations are provided for three noisy decoders: belief propagation, Gallager B, and quantized min-sum (MS). Simulation results confirm that the proposed DE accurately predicts the performance of LDPC decoders with asymmetric deviations. Furthermore, asymmetric versions of the Gallager B and MS decoders are proposed to compensate the effect of asymmetric deviations. The parameters of these decoders are then optimized using the proposed DE, leading to better ensemble thresholds and improved finite-length performance in the presence of asymmetric deviations.
To design low-density parity-check (LDPC) codes with asymmetric channels and analyze their performance, an achievable asymmetric discrete density evolution method is proposed, which is based on offset min-sum decoding. First, the iterative formula of low-complexity asymmetric channel discrete density evolution is derived by means of combinatorics, difference method and the binomial theorem. The iterative formula is applied to further optimize the design of the LDPC codes using the offset min-sum decoding, and the optimal degree distributions and performance of the LDPC codes under different quantization ranges and step sizes are obtained under the asymmetric channel. Finally, the optimal offset values under high-precision quantization are obtained. The results show that under the asymmetric channel, the complexity of the proposed asymmetric density evolution method based on the offset min-sum decoding is reduced by an order of magnitude than that using the original method. For a fixed code rate, the smaller the variable node degree of the regular codes, the better the performance and the smaller the optimal offset value. For irregular LDPC codes, the optimal degree distributions and offset values are determined according to the differential evolution algorithm. For a fixed code rate, the larger the maximum variable node degree, the better the performance of irregular codes.
In this paper, we define Noise-against-Noise Min-Sum (NAN-MS) decoders as decoders that incorporate a certain amount of random perturbation due to deliberate noise injection. We introduce a noise model which is used to implement quantized NAN-MS decoders, using a limited number of precision bits. The behavior of NAN-MS decoders is investigated in the asymptotic limit of the code length using a noisy version of density evolution (DE). We use the noisy-DE thresholds to analyze and optimize the noise model parameters. We show that a controlled injection of noise allows NAN-MS decoders to achieve better performance than noiseless MS decoders, especially for low precision. The finite-length simulations confirm the conclusions of the DE analysis.
We analyze the performance of quantized min-sum decoding of low-density parity-check codes under unreliable message storage. To this end, we introduce a simple bit-level error model and show that decoder symmetry is preserved under this model. Subsequently, we formulate the corresponding density evolution equations to predict the average bit error probability in the limit of infinite block length. We present numerical threshold results and we show that using more quantization bits is not always beneficial in the context of faulty decoders.
The novelty of this paper is to propose a new LDPC decoder called Sign-Preserving Noise-Aided Min-Sum (SP-NA-MS) decoder that improves the decoding performance compared to classical Offset Min-Sum (OMS) decoder when messages are quantized, with only 3 or 4 bits. The particularity of the SP-NA-MS decoder is that the variable-to-check messages are never set to 0, and always carry the sign information. Moreover, the decoder incorporates random perturbation due to deliberate noise injection. The parameters of the SP-NA-MS decoders are optimized in the asymptotic limit of the code length thanks to the Density Evolution (DE) method. The finite-length simulations confirm the conclusions of the DE analysis and gain of up to 0.3 dB in SNR can be obtained compared to regular OMS with same quantization level.
This paper investigates the behavior of the Min-Sum decoder running on noisy devices. Our aim is to evaluate the robustness of the decoder to computation noise caused by the faulty logic in the processing units. This type of noise represents a new source of errors that may occur during the decoding process. To this end, we first introduce probabilistic models for the arithmetic and logic units of the finite-precision min-sum decoder and then carry out the density evolution analysis of the noisy min-sum decoder. We show that, in some particular cases, the noise introduced by the device can help the min-sum decoder to escape from fixed points attractors and may actually result in an increased correction capacity with respect to the noiseless decoder. We also point out a specific threshold phenomenon, referred to as functional threshold, which accurately describes the convergence behavior of noisy decoders. The behavior of the noisy MS is demonstrated in the asymptotic limit of the code length through a noisy version of density evolution and is also verified in the finite-length case by Monte Carlo simulations.
Density evolution is often used to determine the performance of an ensemble of low-density parity-check (LDPC) codes under iterative message-passing algorithms. Conventional density evolution techniques over memoryless channels are based on the independence assumption amongst all the processed messages in variable and check nodes. This assumption is valid for many algorithms such as standard belief propagation (BP) and min-sum (MS) algorithms. However, there are other important iterative algorithms such as successive relaxation (SR) versions of BP and MS, and differential decoding with binary message passing (DD-BMP) algorithm of Mobini et. al., for which this assumption is not valid. The dependence created among messages for these algorithms is due to the introduction of memory in the iterative algorithm. In this work, we propose a model for iterative decoding algorithms with memory which covers SR and DD-BMP algorithms as special cases. Based on this model, we derive a Bayesian network for iterative algorithms with memory over memoryless channels and use this representation to analyze the algorithms using density evolution. The density evolution technique is developed based on truncating the memory of the decoding process and approximating it with a finite order Markov process, and can be implemented efficiently. As an example, we apply our technique to analyze the performance of DD-BMP on regular LDPC code ensembles, and make a number of interesting observations with regard to the performance/complexity trade off of DD-BMP in comparison with BP and MS algorithms.