15 September 2009 in IEEE Transactions on Information Theory
We address the connection between the multiple-description (MD) problem and delta-sigma quantization. The inherent redundancy due to oversampling in delta-sigma quantization, and the simple linear-additive noise model resulting from dithered lattice quantization, allow us to construct a symmetric and time-invariant MD coding scheme. We show that the use of a noise-shaping filter makes it possible to trade off central distortion for side distortion. Asymptotically, as the dimension of the lattice vector quantizer and order of the noise-shaping filter approach infinity, the entropy rate of the dithered delta-sigma quantization scheme approaches the symmetric two-channel MD rate-distortion function for a memoryless Gaussian source and mean square error (MSE) fidelity criterion, at any side-to-central distortion ratio and any resolution. In the optimal scheme, the infinite-order noise-shaping filter must be minimum phase and have a piecewise flat power spectrum with a single jump discontinuity. An important advantage of the proposed design is that it is symmetric in rate and distortion by construction, so the coding rates of the descriptions are identical and there is therefore no need for source splitting.
29 October 2007 in IEEE Transactions on Information Theory
We investigate the capacity loss for using uncorrelated Gaussian input over a multiple-input multiple-output (MIMO) linear additive-noise channel. We upper-bound the capacity loss by a universal constant C* which is independent of the channel matrix and the noise distribution. For a single-user MIMO channel with nt inputs and nr outputs C* = min [ 1/2, nr/nt log2 (1+nt/nr) ] bit per input dimension (or 2C* bit per transmit antenna per second per hertz), under both total and per-input power constraints. If we restrict attention to (colored) Gaussian noise, then the capacity loss is upper-bounded by a smaller constant CG = nr/2nr log2 (nt/nr) for nr ges nt/e, and CG = 0.265 otherwise, and this bound is tight for certain cases of channel matrix and noise covariance. We also derive similar bounds for the sum-capacity loss in multiuser MIMO channels. This includes in particular uncorrelated Gaussian transmission in a MIMO multiple-access channel (MAC), and "flat" Gaussian dirty-paper coding (DPC) in a MIMO broadcast channel. In the context of wireless communication, our results imply that the benefit of beamforming and spatial water-filling over simple isotropic transmission is limited. Moreover, the excess capacity of a point-to-point MIMO channel over the same MIMO channel in a multiuser configuration is bounded by a universal constant.
1 November 1998 in IEEE Transactions on Information Theory
We derive a version of the Brunn-Minkowski inequality which gives a nontrivial lower bound on the volume of the Minkowski sum of degenerate sets, namely, line sets. This inequality parallels a recently obtained matrix generalization of the entropy-power inequality.
31 October 2013 in IEEE Transactions on Information Theory
The Gaussian parallel relay network, introduced by Schein and Gallager, consists of a concatenation of a Gaussian additive broadcast channel from a single encoder to a layer of relays followed by a Gaussian multiple-access channel from the relays to the final destination (decoder), where all noises are independent. This setup exhibits an inherent conflict between digital and analog relaying; while analog relaying [known as amplify-and-forward (A&F)] suffers from noise accumulation, digital relaying (known as decode-and-forward) looses the potential coherence gain in combining the relay noises at the decoder. For a large number of relays, the coherence gain is large, and thus analog relaying has better performance; however, it is limited to white channels of equal bandwidth. In this paper, we present a generalization of the analog approach to the case of bandwidth mismatch. Our strategy, coined rematch and forward (R&F), is based upon applying joint source-channel coding techniques that belong to a certain class of maximally analog schemes. Using such techniques, R&F converts the bandwidth of the broadcast section to that of the multiple-access section, creating an equivalent matched-bandwidth network over which A&F is applied. It is shown that this strategy exploits the full bandwidth of the individual channels, without sacrificing the coherence gain offered by A&F. Specifically, for given individual-link capacities, R&F remains within a constant gap from the network capacity for any number of relays and any bandwidth ratio between the sections. Finally, the approach is extended to the case of colored channels.