Driven primarily by cloud service and data-center applications, short-reach optical communication has become a key market segment and growing research area in recent years. Short-reach systems are characterized by direct detection-based receiver configurations and other low-cost and small form factor components that induce transmission impairments unforeseen in their coherent counterparts. Innovative signaling and digital signal processing (DSP) play a pivotal role in enabling these components to realize their ultimate potentials and meet data rate requirements in cost-effective manners. This paper presents an overview of recent DSP developments for short-reach communications systems and discusses future trends.

Optical performance monitoring (OPM) is the estimation and acquisition of different physical parameters of transmitted signals and various components of an optical network. OPM functionalities are indispensable in ensuring robust network operation and plays a key role in enabling flexibility and improve overall network efficiency. We review the development of various OPM techniques for direct-detection systems and digital coherent systems and discuss future OPM challenges in flexible and elastic optical networks.

Machine learning (ML) has disrupted a wide range of science and engineering disciplines in recent years. ML applications in optical communications and networking are also gaining more attention, particularly in the areas of nonlinear transmission systems, optical performance monitoring, and cross-layer network optimizations for software-defined networks. However, the extent to which ML techniques can benefit optical communications and networking is not clear and this is partly due to an insufficient understanding of the nature of ML concepts. This paper aims to describe the mathematical foundations of basic ML techniques from communication theory and signal processing perspectives, which in turn will shed light on the types of problems in optical communications and networking that naturally warrant ML use. This will be followed by an overview of ongoing ML research in optical communications and networking with a focus on physical layer issues.

We demonstrate mode-division multiplexed WDM transmission over 50-km of few-mode fiber using the fiber’s LP₀₁ and two degenerate LP₁₁ modes. A few-mode EDFA is used to boost the power of the output signal before a few-mode coherent receiver. A 6×6 time-domain MIMO equalizer is used to recover the transmitted data. We also experimentally characterize the 50-km few-mode fiber and the few-mode EDFA.

We experimentally demonstrate the use of deep neural networks (DNNs) in combination with signals’ amplitude histograms (AHs) for simultaneous optical signal-to-noise ratio (OSNR) monitoring and modulation format identification (MFI) in digital coherent receivers. The proposed technique automatically extracts OSNR and modulation format dependent features of AHs, obtained after constant modulus algorithm (CMA) equalization, and exploits them for the joint estimation of these parameters. Experimental results for 112 Gbps polarization-multiplexed (PM) quadrature phase-shift keying (QPSK), 112 Gbps PM 16 quadrature amplitude modulation (16-QAM), and 240 Gbps PM 64-QAM signals demonstrate OSNR monitoring with mean estimation errors of 1.2 dB, 0.4 dB, and 1 dB, respectively. Similarly, the results for MFI show 100% identification accuracy for all three modulation formats. The proposed technique applies deep machine learning algorithms inside standard digital coherent receiver and does not require any additional hardware. Therefore, it is attractive for cost-effective multi-parameter estimation in next-generation elastic optical networks (EONs).

In long-haul optical communication systems, compensating nonlinear effects through digital signal processing (DSP) is difficult due to intractable interactions between Kerr nonlinearity, chromatic dispersion (CD) and amplified spontaneous emission (ASE) noise from inline amplifiers. Optimizing the standard digital back propagation (DBP) as a deep neural network (DNN) with interleaving linear and nonlinear operations for fiber nonlinearity compensation was shown to improve transmission performance in idealized simulation environments. Here, we extend such concepts to practical single-channel and polarization division multiplexed wavelength division multiplexed experiments. We show improved performance compared to state-of-the-art DSP algorithms and additionally, the optimized DNN-based DBP parameters exhibit a mathematical structure which guides us to further analyze the noise statistics of fiber nonlinearity compensation. This machine learning-inspired analysis reveals that ASE noise and incomplete CD compensation of the Kerr nonlinear term produce extra distortions that accumulates along the DBP stages. Therefore, the best DSP should balance between suppressing these distortions and inverting the fiber propagation effects, and such trade-off shifts across different DBP stages in a quantifiable manner. Instead of the common ‘black-box’ approach to intractable problems, our work shows how machine learning can be a complementary tool to human analytical thinking and help advance theoretical understandings in disciplines such as optics.