To view PDF files

You need Adobe Reader 7.0 or later in order to read PDF files on this site.
If Adobe Reader is not installed on your computer, click the button below and go to the download site.

Feature Articles: High-capacity, Low-delay Transmission Technologies Utilizing Optical, Radio, and Acoustic Waves for IOWN/6G

Vol. 22, No. 7, pp. 40–47, July 2024. https://doi.org/10.53829/ntr202407fa4

Research and Development of 1.6-Tbit/s-class Ethernet Optical Transmission Technology Supporting Large-scale Datacenter Networks

Hiroki Taniguchi, Fukutaro Hamaoka, Kohki Shibahara, Takayoshi Mori, Masashi Kikuchi, and Teruo Jyo

Abstract

To improve the scalability of large-scale datacenter networks, it is necessary to achieve a 10-km transmission of 1.6-Tbit/s optical signal per fiber, which is more than 4 times the conventional practical level. In this article, we introduce a digital-signal-processing technology developed by NTT that is excellent in resistance to waveform distortion due to transmission systems, an ultra-wideband baseband amplifier integrated circuit module, and optical signal transmission experiment in which 400-Gbit/s optical-intensity-modulation signals were transmitted in 4-parallel spatial division multiplexing using a multi-core fiber cable installed at NTT laboratories.

Keywords: optical transmission technology, datacenter network, intensity-modulated direct detection method

PDF PDF

1. Large datacenter networks and high-speed Ethernet

Due to the explosive growth in video streaming services, the expansion of cloud services, and the spread of 5th-generation mobile communication system (5G) services, communication traffic is expected to continue increasing. Therfore, traffic within and between datacenters is expected to increase due to the large number of users accessing datacenters.

In datacenter networks, the Ethernet standard is applied as a data-signal transmission method, and the standardization up to 400 Gbit/s was completed as the Institute of Electrical and Electronics Engineers (IEEE) 802.3 standard. Discussions on Ethernet standards of 800 Gbit/s and 1.6 Tbit/s have also started as the next standard [1]. Figure 1 shows the specific configuration of the standardized Ethernet standards (green) and next Ethernet standards (black). Many Ethernet standards use a multi-lane distribution system for parallel transmission to achieve higher Ethernet speeds. For 400-Gbit/s Ethernet signal transmission, for example, four lanes of 100-Gbit/s signals are transmitted in parallel. The method of parallelization is wavelength division multiplexing (WDM)*1 or using parallel single-mode fiber (PSM)*2. The 1.6-Tbit/s Ethernet standard currently under discussion is a configuration in which 200-Gbit/s signals are multiplexed with 8 lanes of PSMs.


Fig. 1. Trends in Ethernet standard standardization and positioning of results.

As datacenter network traffic increases, Ethernet switches with a huge capacity are installed, and an increase in the number of ports for Ethernet modules is inevitable. Therefore, for future large-scale datacenter networks, an economical 1.6-Tbit/s high-capacity Ethernet module is required to increase the capacity per port and reduce the number of installations. To achieve this, it is necessary to increase the speed to 400 Gbit/s per lane and transmit signals in parallel with one fiber and a small number of lanes (4 lanes). The use of the intensity-modulated direct detection (IM-DD)*3 method, which transmits Ethernet data signals in a simple transceiver configuration, is also an effective means of economizing. Ethernet has standards for transmission distances of 2, 10, and 40 km, but in future large-scale datacenter networks, a transmission distance of 10 km, which broadly supports Ethernet connections within and between datacenters, will be important. The latest Ethernet standard achieves a signal of 100 Gbit/s per lane using the IM-DD method by using the 4-level pulse amplitude modulation (PAM*4-4) method with a symbol rate*5 of approximately 53 GBaud. To speed this up to 400 Gbit/s per lane using the PAM-4 method as before, it is necessary to speed up the signal symbol rate to 200 GBaud or higher. To transmit such ultrafast signals with high quality, it is necessary to increase the bandwidth of the electrical amplifier (driver amplifier for driving optical modulators) in the optical transceiver. With the speedup of the signal, digital-signal-processing technology, which compensates for the distorted signal in the optical transmitter/receiver with extremely high precision at the receiver side, is also necessary, and it is difficult to transmit/receive the signal of 400 Gbit/s per lane with the conventional technology. In such ultrafast signals, the effect of waveform distortion generated in the optical fiber transmission line is very pronounced in proportion to the square of the symbol rate (modulation speed), and the signal quality deteriorates significantly. Therefore, when four different wavelengths are multiplexed in one optical fiber as with the conventional method (WDM method), specification of the wavelength channel far from the zero-dispersion wavelength is essential, and it is difficult to achieve 10-km transmission of the wavelength channel.

*1 WDM: A system that transmits signals in parallel using multiple wavelength channels.
*2 PSM: A system that transmits signals in parallel using multiple optical fibers.
*3 IM-DD: Information is added to the light intensity relative to the transmission wavelength. The IM-DD system can be configured with only a semiconductor laser, external optical modulator, driver amplifier, and photodetector, enabling the fabrication of a simple and low-cost optical transceiver.
*4 PAM: A modulation scheme that places information on multiple intensities of signal light. The PAM-4 scheme uses four different light-intensity levels, and the PAM-8 scheme uses eight different light-intensity levels to transmit and receive signals.
*5 Symbol rate: The number of times the optical waveform is switched per second, in baud. The 155-GBaud optical signal achieved in this experiment transmits information by switching the optical waveform 155 billion times per second.

2. Development trends in high-speed IM-DD signal transmission and reception technology

Figure 2 summarizes the research results of IM-DD signal transmission in the Ethernet standard wavelength band (O-band) [2–6]. Figure 2(a) shows the results of a demonstration of a transmission rate of 100 Gbit/s or more per lane, and Figure 2(b) shows the results of a transmission experiment with a total capacity of 0.1 Tbit/s or more per fiber. Transmission experiments with relatively high-speed bitrate per lane (up to 400 Gbit/s [3]) are conducted in a single lane due to the large effect of chromatic dispersion*6 [2, 3] (Fig. 2(a)). However, it has been demonstrated that the use of multiple lanes can provide a transmission capacity that exceeds that reported for a single lane, even if the bitrate per lane is relatively low [4, 5] (Fig. 2(b)). For transmission, where the number of lanes to be multiplexed is very large (16 or more), there is concern about the effect of chromatic dispersion even in the O band. Therefore, the space division multiplexing (SDM)*7 method has been combined with the WDM method so that the wavelength range used with the WDM method is not too wide [5].


Fig. 2. Results and conventional technology.

In an optical transceiver composed of multiple lanes, as described above, an increase in the number of lanes directly leads to an increase in the number of constituent devices and higher prices for the transceiver. Therefore, to develop economical large-capacity Ethernet modules, reducing the number of lanes required by multiplexing high-speed optical signals with low chromatic-dispersion tolerance in multiple lanes is important.

In this experiment, we achieved the transmission and reception of IM-DD optical signals exceeding 400 Gbit/s per lane by NTT’s in-house ultra-wideband baseband amplifier integrated circuit (IC) module*8 and ultra-high-precision digital-signal-processing technology (Fig. 2(a)). At the same time, we conducted a 10-km transmission experiment of ultrafast IM-DD signals of 1.6 Tbit/s per fiber with a relatively small number of lanes of 4 (Fig. 1 red and Fig. 2(b)) by implementing chromatic-dispersion management using SDM transmission technology using multi-core fiber [6].

*6 Chromatic dispersion: A phenomenon in which the speed of light propagating through an optical fiber varies with each wavelength. Regarding ultrafast signals, because the signal band to be transmitted is wide and the propagation speed of each wavelength component is different, the effect of signal distortion due to chromatic dispersion becomes significant.
*7 SDM: By using multi-core fibers with multiple cores (optical signal channels) in a single optical fiber, multi-mode fibers that propagate multiple modes, etc., it is possible to achieve a dramatically higher communication capacity by using a system that spatially transmits signals in parallel within a single optical fiber.
*8 Ultra-wideband baseband amplifier IC module: An ultra-wideband baseband amplifier IC with the widest bandwidth in the world developed by NTT is mounted in a package with a 1-mm coaxial connector for frequencies up to 110 GHz. InP HBT*9 technology has been used to fabricate amplifier ICs that apply our original high-precision circuit design technology and new circuit architecture technology that enables bandwidth expansion.

3. NTT proprietary technology details: 400-Gbit/s per-lane ultrafast IM-DD signal transmission/reception technology

An ultra-wideband baseband amplifier IC module [7, 8] corresponding to frequencies up to 110 GHz based on InP-based heterojunction bipolar transistor (InP HBT)*9 technology, which NTT has been researching and developing, was applied as a driver amplifier for driving optical modulators in the optical transmission system. By newly applying the PAM-8 system, which can reduce the symbol rate by 3/4 that with the conventional PAM-4 system, we were able to generate a stable optical signal with an ultrafast IM-DD signal (155-Gbaud PAM-8) of 400 Gbit/s per lane (Fig. 3(a)). On the receiver side, NTT’s original digital-signal-processing technology uses nonlinear maximum likelihood sequence estimation (NL-MLSE)*10 [6] to emulate distorted signals in optical transmitters and receivers and transmission lines with high accuracy. By comparing the emulated signal with the received signal, the bit error rate of the received signal is greatly reduced, enabling the high-quality reception of the ultrafast PAM-8 signal of 400 Gbit/s per lane (Fig. 3(b)).


Fig. 3. 400-Gbit/s per-lane ultrafast IMDD signal transmittion and reception technology.

*9 InP HBT: A heterojunction bipolar transistor using indium phosphide of a III-V semiconductor. It is a transistor with excellent high speed and breakdown voltage.
*10 NL-MLSE: Maximum likelihood sequence estimation is a technique that improves the accuracy of symbol decision at the receiver by comparing multiple received signals (signal sequences) with multiple candidate sequences that simulate the received signals. In NTT’s original NL-MLSE, it is possible to further improve the symbol-decision accuracy by reflecting the nonlinear distortion, which is caused by complex changes in waveform distortion depending on input strength, in the candidate signal sequence in the maximum likelihood sequence estimation.

4. NTT proprietary technology details: 10-km multi-core-fiber transmission demonstration of 1.6-Tbit/s ultrafast IM-DD signal per fiber

The ultra-wideband baseband amplifier IC module using InP HBT technology and NL-MLSE developed by NTT enabled transmission and reception of ultrafast IM-DD signals at 400 Gbit/s per lane. For this to be a 1.6-Tbit/s signal, a 400-Gbit/s ultrafast IM-DD signal must be transmitted in four parallel channels. In optical fiber transmission lines, signal waveform distortion occurs due to chromatic dispersion, etc., and the effect becomes more pronounced with higher-speed signals.

To achieve 4-parallel 10-km transmission using the WDM system used in conventional datacenter networks with an optical fiber, a 400-Gbit/s ultrafast, high-multilevel (155-GBaud PAM-8) signal per lane requires severe dispersion management, i.e., verification of specific chromatic dispersion. The specific dispersion range to be considered can be determined from the wavelength range of the wavelength channel defined in the conventional Ethernet standard, range of the zero-dispersion wavelength of the standard single-mode fiber, and dispersion slope, assuming that the system to be considered follows the conventional Ethernet standard [9]. Since the wavelength channel farthest from the zero-dispersion wavelength is more significantly affected by the chromatic dispersion, the narrower the wavelength spacing of each wavelength channel, the better. The narrowest wavelength spacing among the wavelength channels defined by the conventional Ethernet standard is local area network (LAN)-WDM with a frequency spacing of 800 GHz. The chromatic dispersion to be determined takes into account the LAN-WDM wavelength range (1294.5 to 1310.2 nm). Under the above assumptions, the chromatic dispersions for 2- and 10-km transmissions are −5.7 to 1.9 and −28.1 to 9.3 ps/nm, respectively, as shown in the red area in Fig. 4. Assuming that 200 Gbit/s (106-GBaud PAM-4), which is scheduled for the next Ethernet standardization, can be multiplexed by 4 lanes of WDM for 10-km transmission, the allowable range of chromatic dispersion for 400-Gbit/s (155-GBaud PAM-8) transmission is determined by considering the difference in baud rate and modulation format and is shown in the green area in Fig. 4 (−5.6 to 5.6 ps/nm). These results indicate that, in 2-km transmission, LAN-WDM can transmit 1.6-Tbit/s signals with 4 lanes of 400-Gbit/s per lane (Fig. 4(a)), except for the fiber with the chromatic-dispersion characteristic where the zero-dispersion wavelength is the longest. In 10-km transmission, however, the range of the chromatic-dispersion amount that must be considered is very wide, and the range of the allowable chromatic dispersion amount of 400 Gbit/s is greatly exceeded; thus, parallelization with the WDM method is not practical (Fig. 4(b)). When wavelength channels are evenly spaced near the zero-dispersion wavelength, the narrower the distance between the wavelength channels, the greater the crosstalk between lanes due to nonlinear optical effects.


Fig. 4. Chromatic-dispersion characteristics by transmission wavelength and transmission distance.

In this experiment, we solved these problems by adopting an SDM system using multi-core fibers. Specifically, by assigning one wavelength to each core, we set each of the four cores to a wavelength that is less affected by chromatic dispersion, thereby suppressing the occurrence of nonlinear optical effects (Fig. 5). By upgrading the optical signal format from the conventional 4-level (PAM-4) to the 8-level (PAM-8), the symbol rate is reduced by 3/4, and by applying NL-MLSE signal processing, signal-waveform distortion due to chromatic dispersion is greatly reduced.


Fig. 5. Experimental 10-km transmission system of 1.6-Tbit/s ultrafast IM-DD signal per fiber.

The transmitters and receivers shown in Fig. 3 were used one by one, and the 400-Gbit/s signal was parallelized by four branches of the optical signal output from the transmitter. Because all the parallelized signals were modulated by the same random symbol sequence, they were connected to fibers of different lengths before they were incident on each core of the multi-core fiber, and the symbol sequence was temporally shifted between each core and each lane, so that inter-lane crosstalk acted as a transmission-performance-degradation factor, as in an actual deployment environment.

The multi-core fiber used in this experiment simulates an actual 10-km cable installation environment by laying a 4-core fiber cable in an underground facility of 1-km round trip in an NTT laboratory and fusing it into 10 round trips [10] (Fig. 5). This 4-core fiber uses the same cladding outer diameter*11 (125 μm) as existing fiber, and each core has the same simple step-index-type refractive index structure as existing fiber. Therefore, crosstalk between cores is an issue in the 1.5-μm wavelength band (C-band), which is generally used for long-distance transmission, but the structure is suitable for mass production. The optical characteristics of each core are equivalent to those of the current international standards for optical fibers, and the dispersion of the characteristics of each core is reduced compared with the PSM system using individual fibers. Therefore, the zero-dispersion wavelength of each core is within ±0.33 nm, light-source wavelength of the transmitter can be the same, and light source can be reduced to 1 in 4-parallel configurations (Fig. 6(a)). The crosstalk (amount of light leakage from adjacent cores) between cores during 10-km transmission is about 1/1000 in the 1.3-μm wavelength band (O-band) of the Ethernet standard using the IM-DD system compared with the 1.5-μm wavelength band (C-band), which reduces the optical signal transmission to a level that does not affect it (Fig. 6(b)). Therefore, the configuration of this experiment, which involved a multi-core fiber of standard cladding outer diameter and step-index profile to transmit O-band optical signals in one lane per core, could directly solve the problems of chromatic dispersion, nonlinear optical effects, and crosstalk between cores introduced thus far, and can be achieved economically. Therefore, it is highly compatible with a datacenter network with a very large number of installations.


Fig. 6. Multi-core-fiber characterization results.

We successfully conducted a field-ambient optical-transmission experiment over 10 km of an ultrafast IM-DD signal exceeding 1.6 Tbit/s per fiber by executing 4-parallel SDM transmission at 400 Gbit/s per lane using a field-installed multi-core fiber and reducing the bit error rate by applying NL-MLSE to the PAM-8 system (Fig. 7).


Fig. 7. 10-km transmission results of an ultrafast IM-DD signal at 1.6 Tbit/s per fiber.

*11 Cladding outer diameter: The optical fiber used in current optical communications is internationally standardized at 125±0.7 μm in diameter (cladding outer diameter) and 235 to 265 μm in diameter, including the cladding layer that protects the optical fiber, to ensure superior mass production and interconnectivity.

5. Summary

The technologies presented in this article are expected to achieve a large capacity, more than 4 times the conventional practical level, and reliably transmit Ethernet signals exceeding 1.6 Tbit/s per fiber, which will be used in future large-scale datacenter networks.


Part of this research is supported by the National Institute of Information and Communications Technology, Japan under the commissioned research of No. 20301.

References

[1] IEEE P802.3df 400 Gb/s and 800 Gb/s Ethernet Task Force,
http://www.ieee802.org/3/df/
[2] O. Ozolins, T. Salgals, H. Louchet, M. Joharifar, R. Schatz, D. Che, Y. Matsui, M. Gruen, T. Dippon, F. Pittala, B. Krüger, Y. Fan, A. Udalcovs, U. Westergren, L. Zhang, X. Yu, S. Spolitis, V. Bobrovs, S. Popov, and X. Pang, “High Baudrate Short-reach Communication,” Proc. of the 27th OptoElectronics and Communications Conference (OECC 2022) and International Conference on Photonics in Switching and Computing (PSC) 2022, Toyama, Japan, July 2022.
https://doi.org/10.23919/OECC/PSC53152.2022.9850148
[3] E. Berikaa, M. S. Alam, W. Li, S. Bernal, B. Krueger, F. Pittalà, and D. V. Plant, “TFLN MZMs and Next-gen DACs: Enabling Beyond 400 Gbps IMDD O-band and C-band Transmission,” IEEE Photonics Technol. Lett., Vol. 35, No. 15, pp. 850–853, Aug. 2023.
https://doi.org/10.1109/LPT.2023.3285881
[4] N.-P. Diamantopoulos, H. Nishi, T. Fujii, K. Shikama, T. Matsui, K. Takeda, T. Kakitsuka, K. Nakajima, and S. Matsuo, “4×56-GBaud PAM-4 SDM Transmission over 5.9-km 125-µm-cladding MCF Using III-V-on-Si DMLs,” Proc. of the 43rd Optical Fiber Communication Conference (OFC 2020), San Diego, CA, USA, Mar. 2020.
https://doi.org/10.1364/ofc.2020.w1d.4
[5] R. S. Luis, B. J. Puttnam, G. Rademacher, S. Shinada, T. Hayashi, T. Nakanishi, Y. Saito, T. Morishima, and H. Furukawa, “12.8 Tb/s SDM Optical Interconnect for a Spine-leaf Datacenter Network with Spatial Channel Connectivity,” Proc. of the 48th European Conference on Optical Communication (ECOC 2022), Basel, Switzerland, Sept. 2022.
[6] H. Taniguchi, M. Nakamura, F. Hamaoka, T. Mori, K. Shibahara, T. Matsui, Y. Yamada, T. Jyo, M. Nagatani, M. Mutou, Y. Shiratori, H. Wakita, T. Kobayashi, S. Yamamoto, H. Takahashi, K. Nakajima, Y. Kisaka, and Y. Miyamoto, “1.6-Tb/s (4 SDM × 400 Gb/s/lane) O-band Transmission over 10 km of Installed Multicore Fibre,” Proc. of the 49th European Conference on Optical Communications (ECOC 2023), Glasgow, UK, Oct. 2023.
https://doi.org/10.1049/icp.2023.1852
[7] T. Jyo, M. Nagatani, M. Mutoh, Y. Shiratori, H. Wakita, and H. Takahashi, “An Over 130-GHz-bandwidth InP-DHBT Baseband Amplifier Module,” Proc. of IEEE BiCMOS and Compound Semiconductor Integrated Circuits and Technology Symposium (BCICTS) 2021, 1b.1, Monterey, CA, USA, Dec. 2021.
https://doi.org/10.1109/BCICTS50416.2021.9682479
[8] Press release issued by NTT on June 3, 2019 (in Japanese).
https://group.ntt/jp/newsrelease/2019/06/03/190603b.html
[9] IEEE, “IEEE Standard for Ethernet,” in IEEE Std 802.3-2022 (Revision of IEEE Std 802.3-2018), July 2022.
https://doi.org/10.1109/IEEESTD.2022.9844436
[10] T. Matsui, Y. Sagae, T. Sakamoto, and K. Nakajima, “Design and Applicability of Multi-core Fibers with Standard Cladding Diameter,” J. Light. Technol., Vol. 38, No. 21, pp. 6065–6070, Nov. 2020.
https://doi.org/10.1109/JLT.2020.3004824
Hiroki Taniguchi
Research Engineer, NTT Network Innovation Laboratories.
He received a B.E. and M.E. in electrical engineering from Tokyo Institute of Technology in 2014 and 2016. He joined NTT Network Innovation Laboratories in 2016. His research interests include photonic transport network systems. He is a member of the Institute of Electronics, Information and Communication Engineers (IEICE) and the Institute of Electrical and Electronics Engineers (IEEE). He was a recipient of the 2019 IEICE Communications Society Optical Communication Systems (OCS) Young Researchers Award and the IEICE Young Researcher’s Award in 2020.
Fukutaro Hamaoka
Senior Research Engineer, NTT Network Innovation Laboratories.
He received a B.E., M.E., and Ph.D. in electrical engineering from Keio University, Kanagawa, in 2005, 2006, and 2009. From 2009 to 2014, he was with NTT Network Service Systems Laboratories, where he was engaged in the R&D of high-speed optical communication systems, including digital coherent optical transmission systems. He is currently with NTT Network Innovation Laboratories. His research interests include high-capacity optical transport systems with ultra-wideband WDM and high-symbol-rate techniques. He is a member of IEICE and IEEE. He was the recipient of the Japan Society of Applied Physics Young Scientist Presentation Award in 2007 and IEICE Communications Society OCS Best Paper Award in 2022.
Kohki Shibahara
Distinguished Researcher, NTT Network Innovation Laboratories.
He received a B.S. in physics and M.S. in geophysics from Kyoto University in 2008 and 2010. He joined NTT Network Innovation Laboratories in 2010. He received a Ph.D. in informatics from Kyoto University in 2017. His current research interests include spatial-division-multiplexing transmission systems and advanced multiple-input and multiple-output signal processing. He is a member of IEICE and the IEEE/Photonics Society. He received the Tingye Li Innovation Prize from Optica in 2016, the Young Researcher’s Award from IEICE in 2017, and Maejima Hisoka Encouragement Award from the Tsushinbunka Association in 2024.
Takayoshi Mori
Senior Research Engineer, NTT Access Network Service Systems Laboratories.
He received a B.E. from the Tokyo University of Agriculture and Technology in 2007, and M.E. and Ph.D. from Tokyo Institute of Technology in 2009 and 2015. Since 2009, he has been with NTT Access Network Service Systems Laboratories, where he is engaged in research on multi-core fibers and few-mode fibers for spatial-division-multiplexing transmission. He is a member of IEICE. He was the recipient of the IEICE Communications Society OCS Young Researchers Award in 2011 and 2015 and the Young Investigators Award from IEICE in 2016.
Masashi Kikuchi
Researcher, NTT Access Network Service Systems Laboratories.
He received a B.E. from Waseda University, Tokyo, and M.E. from the University of Tokyo in 2010 and 2012. In 2012, he joined NTT Access Network Service Systems Laboratories, where he has been researching optical fiber cables. He is a member of IEICE.
Teruo Jyo
Researcher, NTT Device Technology Laboratories.
He received a B.E. and M.E. in electronic engineering from Keio University, Kanagawa, in 2012 and 2014. In 2014, he joined NTT Microsystem Integration Laboratories. He is currently with NTT Device Technology Laboratories. His research interests are high-speed analog circuits for optical fiber communications and terahertz-wave wireless communications and imaging. He received the 2013 IEEE Radio and Wireless Symposium (RWS) Best Student Poster Award and the 2019 IEEE Microwave Theory and Techniques Society (MTT-S) Japan Young Engineer Award.

↑ TOP