Technical Trends in Infrastructure Maintenance Management

1.1 Maintenance based on prediction and monitoring

It was not previously possible to predict where, how, and when a structure would deteriorate. The basic approach has been to conduct periodic inspections, decide on repairs according to how much the facility’s functionality has decreased, and select the most appropriate repair method for the facility if repair is needed. After repair, however, the cycle of inspection and repair continues, so it has not been possible to determine the deterioration mechanism or supplement parts for which the deterioration-reduction mechanism cannot be identified.

We are currently conducting research and development (R&D) on clarifying deterioration mechanisms for infrastructure facilities and have been successful regarding various types of facilities. If mechanisms can be identified, periodic inspections would not be needed to determine what parts to repair and when to repair them. Instead, it is possible to predict deterioration and carry out predictive maintenance. We will be applying this approach to standard facilities such as manholes and manhole covers.

However, predicting deterioration in nonstandard facilities, such as specialized bridges and bridge-attached conduits, is difficult, so monitoring-based maintenance will be carried out. Concerning large-scale tunnels, we will move forward with a hybrid system that combines predictive maintenance and monitoring maintenance (Fig. 1).

Fig. 1. Direction of maintenance management.

1.2 Shifting maintenance management from defense to offense

We have thus far taken measures so that facilities older than 50 years can be used for 100 years or so. We also intend to evolve maintenance management from the conventional defensive approach to an offensive approach to further extend service life so that facilities can be used without concern for 150 or more years (Fig. 2). To achieve this goal, we must take a new technical perspective in developing management methods to replace the conventional inspect-and-repair approach from a post-construction perspective. To achieve an ultimate maintenance-free world, we are moving forward with new innovative R&D regarding construction and repair methods using new materials and inspection methods and creating new databases.

Fig. 2. Transform maintenance.

As described above, preventive maintenance based on deterioration prediction and monitoring-based maintenance serve as core technologies and are supported by databases. Because there is a huge amount of data and the role of the database as the foundation for advanced management through the use of various applications, there is a need to evolve from two-dimensional (2D) management on paper towards management in three or four dimensions with a time axis. Database evolution will result in changes in related tasks. For example, 3D management through visualization of underground spaces would make it possible to understand the situation of underground facilities as if a person were on-site and touching them. Previously, it was necessary to look at drawings on paper and imagine the required assembly, but now staff can easily share the same underground space without having such special skills. We call this digital transformation (DX).

We are aiming to reduce manual work by combing artificial intelligence (AI), augmented reality (AR), and virtual reality (VR) with advanced database management. For example, the inspection of facility structures requires automation and autonomous operation with robots, etc., so we are pursuing R&D on automated inspection technology using unmanned aerial vehicles, etc.

Our R&D also includes application of AI to automatically detect deterioration using digital images taken during inspections as well as damage prediction for infrastructure facilities using a highly accurate 3D database. In engineering, AI-assisted design and assessment and automated machine construction at the worksite are also possible. AR can be used to increase efficiency in on-site inspections, and future advances will enable elimination of on-site inspections. Such 3D databases require highly accurate coordinates, so R&D on highly precise acquisition of location data from a global navigation satellite system (GNSS) is also in progress.

2.1 Infrastructure tasks (for conduits and manholes)

Correct and accurate location information is needed to increase the efficiency of conduit and manhole work, so technology for acquiring highly accurate absolute coordinates is important. Specifically, using a single-frequency GNSS to measure the location of newly constructed conduits and ground-penetrating radar for locating existing conduits are current R&D topics.

Highly accurate acquisition of absolute coordinates would enable sharing of precise facility location information with other lifeline providers in the implementation of the “i-Construction^*” measures of the Ministry of Land, Infrastructure, Transport, and Tourism. Doing so would make it possible to automate the construction-completion processing, exclusive-use management, and design and assessment work. It would also lead to more efficient outside inspection work and acceptance of transfer work. In other words, it will lead to the promotion of DX in other companies as well (Fig. 3).

Fig. 3. Effect of acquiring high-precision absolute coordinates.

We have been working on using AI for detecting deterioration to improve the efficiency of bridge inspection, and this work is presented in this article as a case study (Fig. 4). Currently, various types of inspection images are acquired by drones, special equipment, or cameras operated by workers, etc. Skilled individuals who determine the degree of deterioration examine images. Our objective is to automate this process so that individuals who do not have specialized skills can do it.

Fig. 4. Determining degree of deterioration with AI.

The first step in the process is to distinguish NTT facilities from those of other companies in the obtained images. Then, the NTT facilities are examined for corrosion, and the parts where corrosion exists are identified. It is now possible to detect corrosion with a high probability of success, and we are continuing this work with the goal of automating the determination of the degree of deterioration. Therefore, digital images can be used to determine what facilities are deteriorating, thus increasing efficiency.

2.2 Infrastructure tasks (for tunnels)

We are conducting R&D on using 3D models in managing tunnels. This technique visualizes the situation of underground spaces in a manner similar to the street-view function of satellite map services, making it possible to also reference the history of the inspection location (Fig. 5). Workers can view the facilities in 3D with a sense of themselves being in the tunnel. Also, a skeleton view of the tunnel makes it possible to know the placement of the reinforcement bars. For shield tunnels, it is possible to view the state of the primary lining, and any inspection point can be checked in cross-section. Although research is still in progress, it is possible to view from any angle, direction, or cross-section at any time. Implementing this technique will increase work efficiency.

Fig. 5. Visualization image with 3D model.

To increase the efficiency of cable-tunnel management, we are currently focusing on three points: 1) full automation of monitoring and inspection using 3D models, 2) central management of facility information using 3D models, and 3) remote support for on-site personnel. Tunnels throughout the country will be monitored at a central monitoring center, and 3D information will be used for viewing facility information (Fig. 6). Also, data on environmental changes, such as temperature and oxygen concentration, in tunnels can be acquired from sensors in real time. Cameras can be used for central monitoring of sites where work may be dangerous and the status of facilities can be checked during natural disasters. The ability to quickly dispatch monitoring capabilities to disaster sites with robots and drones is also desirable.

Fig. 6. Fully automated monitoring and inspection with 3D model.

Unified management of facility information with 3D models is another method of increasing efficiency. Facility-location data are managed as absolute coordinates, making it possible to visualize the situation in cable tunnels in a manner similar to the street-view function of mapping programs, obtain historical data on inspection points and the placement of reinforcement bars, and browse shield segment arrangements. Real-time monitoring with cameras is also possible.

Remote support for workers is important because the interior of tunnels is very complicated, especially in Tokyo. Workers who go into tunnels to inspect or repair must be kept informed of environmental conditions, such as temperature, humidity, and oxygen concentration, via real-time communication using tablet devices, etc. Workers can also access the results of past inspections and repair history and determine their current position and the route to the destination from a navigation display on the screen. Emergency evacuation guidance can also be given, the escape direction can be displayed, and communication with the monitoring center is possible, providing support for workers in real time.