Skip to main content

REVIEW article

Front. Earth Sci., 16 February 2023
Sec. Marine Geoscience
Volume 11 - 2023 | https://doi.org/10.3389/feart.2023.1090185

A review of artificial intelligence in marine science

  • 1College of Computer Science and Technology, China University of Petroleum, Qingdao, Shandong, China
  • 2Department of Artificial Intelligence, Faculty of Computer Science, Campus de Montegancedo, Polytechnical University of Madrid, Madrid, Spain

Utilization and exploitation of marine resources by humans have contributed to the growth of marine research. As technology progresses, artificial intelligence (AI) approaches are progressively being applied to maritime research, complementing traditional marine forecasting models and observation techniques to some degree. This article takes the artificial intelligence algorithmic model as its starting point, references several application trials, and methodically elaborates on the emerging research trend of mixing machine learning and physical modeling concepts. This article discusses the evolution of methodologies for the building of ocean observations, the application of artificial intelligence to remote sensing satellites, smart sensors, and intelligent underwater robots, and the construction of ocean big data. We also cover the method of identifying internal waves (IW), heatwaves, El Niño-Southern Oscillation (ENSO), and sea ice using artificial intelligence algorithms. In addition, we analyze the applications of artificial intelligence models in the prediction of ocean components, including physics-driven numerical models, model-driven statistical models, traditional machine learning models, data-driven deep learning models, and physical models combined with artificial intelligence models. This review shows the growth routes of the application of artificial intelligence in ocean observation, ocean phenomena identification, and ocean elements forecasting, with examples and forecasts of their future development trends from several angles and points of view, by categorizing the various uses of artificial intelligence in the ocean sector.

1 Introduction

The study and exploration of the oceans began centuries ago, initially for commercial and military purposes. It subsequently developed into a systematic discipline belonging to a large and important branch of Earth sciences. Over the centuries, human beings have exploited and utilized marine resources and studied marine application technologies, providing an effective means for human understanding of the marine world with multiple sources and scales in spatial information. Research in marine science is inseparable from advanced research methods. We review the development and current research of AI techniques in ocean observation, ocean element forecasting, and numerical models. The pitfalls of poor interpretability of AI techniques have led more scholars to study AI techniques combining physical information (Schneider et al., 2022).

With the advancement of technology and the advent of big data in recent years, the storage volume of Earth system data has far exceeded tens of petabytes (Agapiou, 2017). We require rapid and timely analysis and processing of the massive data of ocean observation and simulation to construct accurate and real-time forecast data in a shorter period. Emerging technologies such as AI are gradually being applied to research and development in the field of ocean, which to a certain extent, can complement and assist the traditional numerical forecasting models in the weak links of traditional ocean forecasting. For some prediction and forecasting problems, classical mathematical models and traditional ocean theories cannot be easily described accurately, especially for the regional ocean and climate mechanisms humans have not yet mastered (Yu, 2021). With the increase in the amount of information acquired by the ocean, data-driven AI technology may, in turn, be a strong point in these fields. How to use ocean data-driven AI has become a vital issue in ocean AI (Chengcheng and Ge, 2018).

Ocean observation is the foundation for the study and use of the ocean, which has a deep historical foundation, and in recent decades remote sensing technology (Boukabara et al., 2019) and sensor network technology (Lu et al., 2019) have developed rapidly. Chengcheng and Ge (2018) describe the development of ocean big data acquisition, analysis, and application. Ocean observation technology, driven by ocean big data, has gradually been combined with big data enabling technology, blockchain platform technology, and AI application technology, leading to the research and development of smart ocean technology (Zhang et al., 2020). This technology uses AI to combine satellite remote sensing data, sensor networking, and traditional robotics to make intelligent ocean observations. The ocean data generated by observations inevitably produce errors, and AI algorithms can reconstruct the data.

Many physical phenomena in the ocean have a critical impact on the Earth’s climate, marine ecology, and human activities, e.g., internal waves, heatwaves, and eddies. Traditional methods are based on physical knowledge using satellite data for identification. The development of AI has brought new ideas for the application of ocean data. Applying the new technology in ocean phenomena identification proves its sufficient accuracy and identification speed. In this paper, we mainly sort out the AI identification methods of internal waves, heatwaves, the ENSO phenomenon, and sea ice using ocean remote sensing data.

Numerical and statistical models are essential tools for forecasting traditional ocean elements. By complementing and synergizing the technology in AI with traditional ocean theory and numerical forecasting, the effect and value of data-driven prediction forecasting can effectively compensate for the uncertainty factor of statistical methods of numerical forecasting. Ocean big data AI has become a new bridge between ocean data and technology, playing an essential role in the detection and simulation of ocean currents, sea ice, and seafloor targets (Chen et al., 2022a). Although deep learning models show their great merits, they still have problems such as poor interpretability and traditional prediction methods not constrained by physical laws. Therefore, more and more researchers are now combining physical information constraints with AI techniques to form physics-driven AI methods, which can better solve scientific problems using physical laws for model modeling.

The AI techniques in the ocean domain have also been analyzed in relevant research reports. Sonnewald et al. (2021) focuses on three branches covering the field: observations, theory, and numerical modeling, discussing the historical background and the application of ML theory to oceanographic exploration advances, model error, bias correction, and an emphasis on current and potential uses in data assimilation. However, today’s machine learning techniques still encounter development bottlenecks. Their interpretability remains insufficient to allow purely data-driven models to be trusted, so hybrid models that combine machine learning with physical modeling may have better scope for future development (Reichstein et al., 2019; Schneider et al., 2022). The research on physically driven machine learning has not yet matured, so the above reviews provide relatively limited descriptions of this aspect.

In this survey, we demonstrate the development route of ocean observation, identification of ocean processes, and ocean element forecasting by merging numerous instances of AI applications in ocean field technology based on the AI algorithm model. Alongside these instances, we concentrate on the specialized application of AI technology to large data sets. In addition, the article illustrates the considerable study effort on AI models in the fields of ocean element forecasting and ocean phenomena identification, as well as the research directions that have evolved in recent years to combine AI with physical modeling concepts. We have provided proper nouns and abbreviations throughout the text in the Supplementary Materials.

2 The application of AI in ocean observation

Ocean observation is the basis for studying the ocean, developing the ocean, and using the ocean. Ocean observation technologies such as buoys, remote sensing, and drones have also promoted the development of marine science. Ocean observation capability also reflects a country’s comprehensive national power. Through the observation and investigation of the ocean, human beings can more fully understand and use the laws of the ocean so that they can better carry out their productive lives. This chapter is mainly divided into two parts to elaborate. See Figure 1. The papers covered in this section are listed in Tables 1, 2.

FIGURE 1
www.frontiersin.org

FIGURE 1. The Application of AI in Ocean Observation. First, the history of ocean observation is presented, followed by a discussion of the inadequacies of conventional ocean observation methods, the strategies for merging ocean observation with artificial intelligence, and then the reconstruction of data.

TABLE 1
www.frontiersin.org

TABLE 1. Statistics of ocean observation papers.

TABLE 2
www.frontiersin.org

TABLE 2. The ocean big data reconstruction paper.

2.1 History of ocean observation

The first global observations of the ocean date back to the Challenger expedition in 1873 AD (Sonnewald et al., 2021), which first studied the global distribution of ocean depth, temperature, and salinity and revealed the three-dimensional structure of the ocean. This expedition also significantly increased interest in the oceans. Countries worldwide have sent ocean exploration vessels to conduct regional or global ocean exploration surveys. By the 1940s, humanity introduced radar precision navigation systems for submarine detection in World War II, which also brought a revolution in ocean observation. In the second half of the 20th century, several countries launched many satellites for ocean observation, such as the first artificial satellite launched by the Soviet Union in 1957 and the Seasat satellite launched by the United States in 1978 (Stewart, 1988), which also contributed to the development of ocean observation. In 1985, the World Climate Research Program (WCRP) launched its first international cooperative project, the Tropical Ocean and Global Atmosphere (TOGA). This project focuses on sea-air interactions on seasonal to interannual time scales, mainly focusing on the equatorial eastern Pacific Ocean where ENSO occurs. In this project, observations are made by a three-dimensional network of satellite systems, aircraft, survey ships, ground-based sounding stations, moored buoys, and drifting buoys (Lin and Yang, 2020). In the 21st century, several atmospheric and oceanic scientists proposed the Argo project, which opened a new era in ocean environment observation, establishing an ocean observation network and placing many automatic detection buoys into the ocean. In 2002, China officially announced its participation in the Argo program. After nearly 20 years of effort, the Argo Ocean Observing Network, consisting of more than 3,000 Argo profiling buoys, has been built worldwide. It provides continuous information on ocean temperature, depth, salinity measurements, and current velocities up to 2,000 m. It is available for free research and application by scientists worldwide.

As early as the 17th century, studies have shown that some surveyors began to make observations of sea level. The first devices used to observe sea level were graduated rods, often called “tide rods,” fixed in a position where the observer could read the instantaneous height of the sea level at any time (Wöppelmann et al., 2006). The point tide gauge was invented in the 1970s and uses a measuring device to measure the tide height and then record the data through computer processing. This instrument has the advantages of high automation, high accuracy, and ease of use, so it has been widely used.

Since the 19th century, many atmospheric pressure sensors have been used for ocean observations. Sea level pressure data are used to calculate trends for diagnosing climate models and constructing climate indices. For example, the tropical Pacific SLP field defines multivariate ENSO indices (Wolter and Timlin, 2011). Sea level pressure data also contribute directly or indirectly to many reanalysis products used in climate assessments. Climate-related changes in mean atmospheric load or SLP correspond to sea level changes of about 1 cm for a 100 hPa difference, the so-called inverse barometer effect (Wunsch and Stammer, 1997). Sea level pressure observations can also be used to assess changes in the frequency and intensity of temperate storms and to monitor and predict monsoonal changes and trends in extreme weather.

2.2 Defects of traditional observation methods

However, traditional ocean observation methods have several limitations. Drifters used for surface observations have financial difficulties in deployment, there are still limitations in distribution, the Arctic is mainly devoid of drifting buoys, maintaining global distribution is complex, and achieving this goal requires the cooperation of multiple countries (Centurioni et al., 2019). There are also some problems with shipboard observation techniques, namely the structure of the ship itself and the placement of its sensors can make errors when measuring data (Berry et al., 2004; Popinet et al., 2004). Although moored buoys can provide a variety of realistic, high-quality ocean observations (Bourras, 2006), they cannot achieve global coverage due to maintenance costs and deployment problems.

In recent decades, AI has become popular, and more and more fields are using AI technology, and the ocean is no exception.

2.3 Technologies of ocean observation

AI was first introduced in 1956 (Spector, 2006). At first, it was only intended to use some mechanical tools to replace humans in doing some simple and tedious tasks. In the 21st century, with the accumulation of global ocean quasi-real-time 3D observation data, the growth rate of ocean data has accelerated by 40%, which has given rise to the growing trend of ocean big data (Overpeck et al., 2011). Various countries have increasingly recognized the importance of big data in social development and national core competitiveness (Chengcheng and Ge, 2018). With the rapid development of computer hardware and software, computer capacity and computing power have been much improved, and the cost has been reduced significantly. AI-related technologies such as machine learning, deep learning, and pattern recognition have advanced rapidly, bringing a boon to the marine field. The smart ocean combines AI and the ocean, the deep development of ocean information, and the nervous system to understand and plan the ocean (Jiang et al., 2018). Making full use of ocean big data can help human research to achieve better development in coping with climate change, protecting the ecological environment, and preventing natural disasters (Rasouli et al., 2012; Kim et al., 2014; Deo and Şahin, 2015; Rosso et al., 2020; Lou et al., 2021; Syeed et al., 2022).

2.3.1 Remote sensing technique

Satellite remote sensing technology is also a way of ocean observation and constitutes the essential modern ocean technology innovation (Liu et al., 2017). Figure 2 shows the acquisition process of remote sensing data. Traditional processing of satellite remote sensing data is highly dependent on personnel with specialized knowledge. It requires manual processing and interpretation by combining satellite remote sensing data characteristics, actual conditions, and ocean expertise. It is time-consuming and challenging to guarantee accuracy. Deep learning of remote sensing has flourished with the technological development of AI and the open sharing of remote sensing data sets. Various forms of AI, including machine learning, have been used successfully on many satellite remote sensing problems (Haupt et al., 2008; Hsieh, 2009; Krasnopolsky, 2013; Ball et al., 2017; Boukabara et al., 2019).

FIGURE 2
www.frontiersin.org

FIGURE 2. Remote sensing data acquisition process. Ocean data is taken as input, and the remote sensing information is finally acquired through pre-processing, geometric correction, image enhancement, image crop, image mosaicing, and color grading turn.

Remote sensing data are fundamental to ocean prediction, revealing new phenomena at critical spatial and temporal scales previously unavailable using in situ observational data alone (Liu et al., 2017). These data can provide rich data fuel for data-driven deep learning, and data-driven deep learning provides a promising avenue for making full use of ocean remote sensing big data. This win-win situation has also led several research scholars abroad to conduct exploratory research around AI-based satellite remote sensing applications, proposing new ideas, methods, and techniques. Li et al. (2020) reviewed the application of supervised classification and target detection based on deep learning networks in extracting several typical ocean phenomena from ocean remote sensing images, such as ocean internal wave detection, coastal flood detection, and sea ice detection. Ducournau and Fablet (2016) Ducournau and Fablet used a deep learning-based image super-resolution model to address the reduction of sea surface temperature data derived from ocean remote sensing. Du et al. (2019) developed the DeepEddy deep learning model to solve the problem of ocean eddy detection using synthetic aperture radar (SAR) image data. Yuan et al. (2020) presented the main results and problems of AI techniques in environmental remote sensing, detailed the traditional neural network and deep learning network structures and the applications of both methods in marine as well as other aspects, and pointed out the technical bottlenecks of AI in combining physical model simulation, incorporating geographic laws and small sample-based and migration learning. Ghaffarian et al. (2021) introduced a remote sensing image processing method based on a deep learning attention mechanism, which can improve the overall accuracy when using deep learning methods for remote sensing image classification, image segmentation, change detection, and target detection. Therefore, combining AI with satellite remote sensing for ocean observation big data is vital for the development and progress of the ocean field, remote sensing technology, and AI field.

2.3.2 Smart sensor networking

The so-called ocean intelligent sensors also apply AI technology to the sensors. These sensors also play a tremendous auxiliary role in ocean observation. With many advantages, such as small size, easy networking, and resistance to electromagnetic interference, it is also expected to become an auxiliary measurement tool in ocean observation. Howe et al. (2010) developed an intelligent sensor network that combines many of the fundamental elements of ocean observing systems, embeds a data assimilation framework, and facilitates adaptive sampling and calibration. Cater et al. (2009) define a new generation of smart ocean sensors that can be located and identified on the World Wide Web. They demonstrate “plug-and-play” interoperability in the field and provide data that can be shared, processed, and presented to end users across many disciplines and applications. Sensors are primarily deployed in networks in the ocean to facilitate ocean observation. An ocean sensor network is an underwater wireless sensor network that typically consists of a variety of ocean sensors, autonomous underwater vehicles, surface research vessels, and in some cases, coastal radars and large gliders. Different types of underwater devices in such a network can communicate through underwater communication technologies to form an underwater wireless network.

In contrast, marine sensors can form various sensing and detection tasks for marine applications. Luo et al. (2022) proposed a software-defined intelligent wireless sensor network to solve ocean monitoring problems such as sea surface and subsea monitoring. Marine sensor networks have a wide range of applications and a high potential for ocean observation and prediction.

2.3.3 Intelligent robots

Combining traditional robots with AI and using them for ocean observation has also given birth to many intelligent robots for ocean observation, such as underwater robots fish, marine robots, and oil drilling robots. Traditional robots can be called programmable machines and perform a series of operations and instructions automatically or semi-automatically. With the addition of AI technology, these robots can automate and learn independently. Wang et al. (2021) designed a gliding robot fish with multi-linked fins in a BCF-like mode to exploit marine resources and monitor oil rigs. This robotic fish can swim flexibly, glide efficiently in three dimensions, and analyze gliding motion and fish-like swimming behavior. Yoerger et al. (2021) designed a Mesobot intelligent underwater robot for observation in the ocean twilight zone with target detection, classification, and tracking of underwater animals.

2.4 The reconstruction of ocean big data

For scientific research in the ocean, two characteristics of ocean big data: accuracy and spatiotemporal continuity, are crucial. The actual process of generating ocean data from ocean observations leads to missing or unavailable data due to errors in observation equipment, satellites, weather, and other factors, which then involves the problem of data reconstruction (Sun et al., 2018). Interpolation algorithms are usually used to achieve the reconstruction of ocean data. Ma and Jing (2004) used a dynamic optimal interpolation method to assimilate sea surface temperature (SST) data from the Bohai Sea in July, combined with the shelf sea model (HAMSOM) for validation. Liu and Wang (2018) used data interpolation empirical orthogonal functions to perform the missing VIIRS ocean color dataset. Ping et al. (2016) proposed an improved data interpolation empirical orthogonal function algorithm to solve the problem of missing values of spatiotemporal sea surface temperature data.

However, the interpolation process leads to the loss of important information, resulting in large data reconstruction errors and posing a huge challenge for traditional data reconstruction methods. The emergence of AI also alleviates this problem very well. Among the methods of AI, deep learning can learn complex models from a large amount of sample data and can control the model’s efficiency. For example, Ducournau and Fablet (2016) used a super-resolution convolutional neural network (SRCNN) to solve the problem of shrinking satellite-generated sea surface temperature (SST) data. Li et al. (2021) proposed a new machine learning-based IFBN model based on Bayesian networks and information flow for interpolating multiple oceans missing time series of variables. This method has better accuracy, validity, and stability. Durán-Rosal et al. (2016) used an evolutionary product unit neural network to solve the problem of reconstructing a large amount of missing data in marine buoys (Durán-Rosal et al., 2016). Park et al. (2019) used a machine learning-based model for chlorophyll concentration data reconstruction to improve the availability of chlorophyll-a data.

3 The identification of ocean phenomena

This chapter is mainly divided into four parts to elaborate (see Figure 3). The significant papers covered in this section are listed in the Table 3.

FIGURE 3
www.frontiersin.org

FIGURE 3. The Identification of Ocean Phenomena. This section describes four ocean phenomena (internal waves, heatwaves, ENSO, and sea ice).

TABLE 3
www.frontiersin.org

TABLE 3. Identification of ocean phenomena with AI.

3.1 Internal waves

Ocean internal waves are a wave phenomenon that occurs in densely stable and stratified oceans. Due to differences in temperature and salinity, this phenomenon usually occurs in densely stratified bodies of water (Zheng et al., 2021b). Large amplitudes, long crests, and long propagation distances characterize internal waves (IW) (Zhang et al., 2022). Internal waves occur at all ocean depths and differ from other waves in that they play an essential role in transmitting the energy of mesoscale and large-scale motions (Dong et al., 2022a). In addition, internal waves cause disturbances at the ocean’s surface, which can cause problems for maritime transport. Internal waves have more energy, which can modify the atmosphere, while the critical role of internal waves is in ocean acoustics, ocean mixing, marine engineering, and submarine navigation (Li et al., 2020; Vasavi et al., 2021). As a result, internal waves have attracted extensive research interest.

Scientists have long recognized the potential of using satellite imagery to study IW. Satellite images can compensate for in situ observations to study the generation, propagation, evolution, and dissipation of IW. SAR is an active sensor that measures the roughness of the sea surface. It is unaffected by cloud cover and can image the sea surface at a spatial resolution of 1 m to tens of meters in all-weather, day, and night conditions (Li et al., 2020). In principle, the internal wave-induced flow will interact with the sea surface and modulate the distribution of small slopes of the character, so the optical sensor receives the sunlight reflected by those modulated small slopes due to the mirror reflection. As a result, internal waves will appear to be bright and dark bands on the optical remote-sensing images. Therefore, the parameters of internal waves are indirectly reflected by the stripes on visual remote-sensing images (Pan et al., 2018). In layperson’s terms, internal oceanic waves appear as irregular streaks of alternating light and dark in SAR images. This feature makes SAR graphics the primary means and means by which scientists study internal waves.

Nowadays, machine learning is developing rapidly and is also being used to solve some of the problems in the ocean. It shows powerful advantages, for example, in studying internal waves. The general flow is shown in the Figure 4. As mentioned above, internal oceanic waves appear as irregular streaks of alternating light and dark in SAR images. However, this feature can easily be confused with other similar oceanic phenomena. In addition, during the polarity transition of internal waves, the separation distance between the light and dark bands becomes wider (Zheng et al., 2021a). Segmenting the maritime internal wave fringes is necessary to determine the position of internal waves in SAR images. A considerable amount of research has been devoted to segmenting oceanic internal wave streaks in SAR images to obtain the role of internal waves in the ocean. Zheng et al. (2021a) proposed a SegNet-based oceanic internal wave streak segmentation algorithm, which can obtain the positions of internal waves. The results show that the method can identify whether the SAR image contains internal waves, get the respective roles of light and dark stripes in the SAR image, and can accurately determine the relative parts of light and dark stripes. Zheng et al. (2021b) used support vector machine (SVM) to classify SAR images to obtain images containing internal waves. Then, the Canny edge detection method was used to detect and identify the oceanic inner wave streaks in the SAR images. These streaks were filtered by three parameters, namely length, area ratio, and direction, and finally, the positions of the oceanic internal wave streaks were obtained. Zheng et al. (2022) proposed a Mask RCNN-based algorithm for the segmentation of internal waves. The results show that the proposed method can identify the presence or absence of internal waves and obtain the respective positions of light and dark stripes in the image. In addition, based on the relative positions of the identified light and dark stripes, the time of polarity transition of internal oceanic waves can be further determined. It was found that there is another category of research dedicated to the inversion of some parametric information of internal waves. For example, Vasavi et al. (2021) combine numerical and machine learning methods to perform noise removal. Then The data enhancement of SAR maps using convolutional neural network (CNN), followed by segmentation and feature extraction of wave parameters such as frequency, amplitude, longitude, and latitude using U-Net. Finally, for the modeling of internal waves, the Korteweg-de Vries (KdV) solver is used to take the internal wave parameters as input and give the velocity and density maps of the internal waves. Zhang et al. (2022) developed an AI-based wave amplitude inversion model using laboratory experiments and in situ satellite observations using a migration learning approach. The results are more accurate than the conventional KdV equation. Pan et al. (2018) introduced a deep learning model to invert the internal wave amplitudes based on many optical remote sensing images to investigate the relationship between internal wave amplitudes and the characteristic parameters of remote sensing images. The inversion results are in good agreement with the observed data. While the above studies have almost always used a single data source, Drees et al. (2020) uses a multimodal deep learning algorithm to obtain information from multiple data sources. The authors utilize a multimodal neural network approach, SONET, which is trained jointly on two modalities, radiometric full-resolution image (OLCI) and Water data product (SRAL). A joint representation of the two modalities is then obtained and compressed by the fully connected (FC) layer until the output layer returns a classification result. Good results in internal wave recognition were achieved. His multimodal approach may become a hot topic for future internal wave research.

FIGURE 4
www.frontiersin.org

FIGURE 4. Flowchart of internal wave identification.

3.2 Heatwaves

Heatwaves are a major cause of weather-related deaths (Robinson, 2001). Heatwaves become increasingly severe, long-lasting, and recurrent as global temperatures rise (Asadollah et al., 2022). In recent years, heatwaves have received widespread attention for their wide-ranging impacts on human health, ecosystems, agriculture, and the economy (Gao et al., 2018). The prediction of heatwaves is the primary task in heatwaves research. Defining a heatwave is one of the main obstacles to heatwaves prediction and analysis. Heatwaves are usually defined according to their location and timing (Perkins and Alexander, 2013; You et al., 2017). The most common definition is the accumulation of excessive sensible heat resulting in a heat load (Sanderson et al., 2017; You et al., 2017). Based on this heat load concept, Khan et al. (2019a); Perkins-Kirkpatrick and Gibson (2017) uses different temperature thresholds and periods to define heatwaves.

Heatwaves are usually predicted using temperature prediction models, mainly classified as statistical or dynamic models. Kinetic models rely on physical interactions between the ocean, atmosphere, and land to develop predictive models, which makes model development computationally intensive. As a result, statistical models are widely used in developing heatwaves prediction models (Perkins-Kirkpatrick and Gibson, 2017; Gao et al., 2018). Machine learning has a huge advantage in learning the complex non-linear interactions of heatwaves by and with large-scale atmospheric variables. Today, many studies are using machine learning to predict heatwaves, and all have achieved good results. Asadollah et al. (2022) develops a physical empirical model using two classical machine learning algorithms, decision trees (DT) and random forests. It employs a novel hybrid technique of Ada-Boost regression and decision trees (ABR-DT) to predict the annual number of heatwaves days. The annual variability of HWD is effectively modeled, and experiments show that the model can be used to forecast heatwaves years. Iglesias et al. (2015) has developed a multi-task deep, fully connected neural network for predicting heatwaves trained on historical time series data. Experimental studies have shown that the neural network is a generative method that can be applied to heatwaves or various other climate problems. Chattopadhyay et al. (2020) proposes a data-driven extreme weather prediction framework based on simulated predictions of novel deep learning pattern recognition techniques Capsule Networks (CapsNet) that can achieve 80% accuracy for heatwaves. Khan et al. (2019b) presents a statistical model called quantile regression forest (QRF) for predicting heatwaves with different time-lags in Pakistan using weather climate variables. The study demonstrates the strength of the QRF model in predicting conditional quartiles, which helps explain some of the extreme temperature behavior. Khan et al. (2021) uses machine learning (ML) algorithms such as SVM, random forests, and artificial neural networks to develop a climate change resilient heatwaves prediction mode that has been shown to provide reliable predictions under climate change scenarios. Jung et al. (2020) used convolutional long-term short-term memory (ConvLSTM) to predict SST in Korea’s South China Sea region for up to 7 days. The study also examined anomalously high SST predictions based on three ocean heatwaves categories (i.e., warning, caution, and watch out). The study shows that ConvLSTM can successfully predict ocean heatwaves up to 5 days in advance.

3.3 ENSO

ENSO is currently the world’s largest coupled sea-air model, occurring in the equatorial central and eastern Pacific Ocean, influencing climate around the world and significantly impacting ecological and agricultural development. ENSO can not only change the state of the Pacific Ocean and atmosphere but also have a significant impact on global climate (Yang et al., 2018), precipitation (Ropelewski and Halpert, 1987), and ecosystems in remote areas (Adams et al., 1999). Therefore, the analysis and prediction of ENSO are critical. However, traditional analytical models face challenges due to insufficient data, spring predictability barriers (SPB), and model uncertainty. To address these issues, researchers have begun to apply AI techniques to ENSO studies to explore the impact of ENSO on extreme global climate change.With the rapid development of AI techniques, more and more researchers are trying to apply them to the analysis and prediction of ENSO. Nooteboom et al. (2018) used a hybrid model of classical linear statistical methods with autoregressive integrated moving average (ARIMA) (Box and Pierce, 1970) and artificial neural network (ANN) methods. The hybrid model gives slightly better prediction results than the traditional numerical model, using the potential of machine learning (ML) to overcome SPB (Guckenheimer et al., 2017). Mekanik and Imteaz (2012) used multiple linear regression and non-linear ANN to explore the lag time relationship between ENSO and Indian Ocean dipole (IOD) for spring rainfall in Victoria. The results show that the ANN model using Southern Oscillation Index-Dipole Mode Index (SOI-DMI) can achieve a spring precipitation correlation coefficient of 96.96%. In comparison, the multiple regression model can only achieve 66.15%.

In recent years, with the gradual application of AI in various fields, researchers have recently started to use deep learning for ENSO analysis and prediction. Promising results have been achieved using deep learning methods to analyze and predict ENSO, overcoming the challenges of SPB and obtaining predictions of ENSO type and intensity. Ham et al. (2019) predicts ENSO index, intensity, and type for the next 18 months using a CNN model. Coulibaly et al. (2000) investigated the impact of climate indices such as ENSO on the observed energy inflow projections from 1991 to 1996 by Recurrent Neural Network (RNN) models. Broni-Bedaiko et al. (2019) combines climate complex network analysis with a neural network regression task. It uses metrics to train long short-term memory networks (LSTM) neural networks as predictors to predict the ENSO phenomenon. Huang et al. (2019) compared LSTM with linear regression (LR) models to determine the advantages of a simple DL model for ENSO event prediction. The results show that the prediction results of the two methods are comparable when the monthly inputs are the same.

ConvLSTM outperforms almost all running models for the prediction of ENSO events when considering post-spring predictions. By combining LSTM time series modeling features and multidimensional data processing properties of CNN, Gupta et al. (2020) successfully overcame SPB using the ConvLSTM model to achieve prediction of Niño3.4 index monthly averages 12 months in advance. Ye et al. (2021) proposed a parallel deep convolutional neural network, i.e., MS-CNN, which could not accurately predict the Niño3.4 index of strong ENSO, and the prediction error increased with time. However, the model was more accurate than other models in predicting ENSO in spring.

3.4 Sea ice

Polar sea ice is a sensitive indicator of global climate change. Information on sea ice types is essential for ship navigation and predicting polar climate change. However, due to the large size and harsh environment of the polar regions, most polar regions are difficult to access, and the cost of fieldwork is very high. Ice extent and thickness are decreasing throughout the Arctic, and as the ice melts, pockets of ice become more mobile, allowing hazards such as ice floes to disperse. Sea ice retreat, especially in the Arctic, is one of the essential measures to address global climate change. Therefore, sea ice cover and concentration are essential for conducting climate change studies, polar navigation, and successful offshore operations.

SAR has proven to be an ideal remote sensing technique for generating detailed sea ice information because of its inherent ability to image surfaces at a high resolution independent of daylight and weather conditions. In addition, its polarization capability allows SAR to respond differently to sea ice types and open water. Since the launch of the first civilian SAR instrument, Seasat, in 1978, polar sea ice monitoring has been the primary mission of satellite-based SAR satellite operations. In order to process a large amount of available data in real-time, automated methods are needed to detect ice floes. Applying machine learning algorithms to sea ice classification has long been a focus of interest. Features are manually selected and extracted, and then, these features are fed into traditional machine learning algorithms, such as SVM (Leigh et al., 2013; Liu et al., 2014; Zakhvatkina et al., 2017), random forest (RF) algorithms (Tan et al., 2018), or artificial neural networks (Ressel et al., 2015). Automatic sea ice segmentation (ASIS) (Soh and Tsatsoulis, 1999), developed in 1999, combines image processing, data mining, and machine learning to segment unpolarized SAR images automatically. Another sea ice classification algorithm (Scheuchl et al., 2005) uses the Wishart algorithm to classify fully polarized single- and dual-frequency SAR data from sea ice and achieves good results. Kim et al. (2015) used decision tree and random forest machine learning methods to map land-fixed sea ice in Antarctica. The performance of traditional machine learning depends heavily on selecting features. In contrast, data-driven deep learning models with the ability to extract features automatically have come to the forefront in recent years.

CNN is a classical deep learning model, but its low-layer features perform poorly in sea ice detection tasks. Therefore, Gao et al. (2019) introduced multilayer feature fusion to exploit the complementary information between low, medium, and high-level feature representations and proposed a transferred multilevel fusion network (MLFN) model to achieve stronger feature extraction. Chen et al. (2017) proposed a combination of CNN and CRF to solve the problem of poor CNN localization. In addition, Wang and Li (2021) also stacked multiple U-Net models with different specializations for the sea ice segmentation task based on a multi-feature fusion approach, which has higher accuracy than any individual classifier. Cooke and Scott (2019) used a DenseNet model to estimate sea ice concentration by training on a dataset containing SAR images. Based on this, Kruk et al. (2020) proposed a new algorithm for predicting sea ice development stages based on deep learning concepts, using a combination of SAR images and CIS ice maps to create labeled datasets, completing a comparative analysis of DenseNet and U-Net performance. Furthermore (panchi2021supplementing) extracts different features for feature fusion by PSPNet, PSPDenseNet, DeepLabV3+, and UPerNet, and the fusion results are post-processed by ConvCRF to achieve the effect of identifying rich sea ice types. The process is shown in the Figure 5. In addition, the lightweight pixel-based deep residual neural network model MSI-ResNet for sea ice classification performs better than the classical SVM classifier for sea ice identification (Zhang et al., 2021). Nagi et al. (2021) took advantage of CNN and convolutional conditional random fields (Conv-CRF), where RES-UNET computes expressive features to generate coarse segmentation maps. At the same time, Conv-CRF uses spatial co-occurrence pairwise potential as well as RES-UNET segmentation maps to generate final predictions. Comparing the experimental results with conventional segmentation networks such as UNET, DeepLabV3, and FCN-8 demonstrates the effectiveness of the proposed architecture.

FIGURE 5
www.frontiersin.org

FIGURE 5. This figure shows a flow chart of sea ice identification by feature fusion. Four models, PSPNet, PSPDenseNet, DeepLabV3+, and UPerNet, generate different feature maps and perform feature fusion. The synthesized feature maps are then passed through the ConvCRF post-processing layer to achieve the recognition of rich sea ice. Adapted from Figure 5 of (Panchi et al., 2021).

4 Ocean element forecasting

This chapter is mainly divided into four parts to elaborate (see Figure 6). The papers covered in this section are listed in the Table 4.

FIGURE 6
www.frontiersin.org

FIGURE 6. Ocean element forecasting. Four components comprise the AI approach to ocean element forecasting: physics-guided numerical models, model-guided statistical and traditional machine learning models, data-guided deep learning models, and the combination of physical models and AI. Each section describes the most prevalent model algorithms and model optimization techniques in the area of ocean element forecasting.

TABLE 4
www.frontiersin.org

TABLE 4. Statistics of ocean element forecasting literatur.

4.1 Numerical models and statistical models

Numerical ocean models have played an essential role in ocean observation and ocean forecasting since their inception in the last century. More than 40 ocean data models are now available, including numerical ocean models for different seas and different ocean sciences.

Countries generally establish such numerical ocean models. Such as the HYCOM model applied globally by the National Centers for Environmental Prediction (NCEP) of the United States; the LIM2 model of the United Kingdom Met Office; the CONCEPTS model of Canada; and the MRI.COM model of the Japan Meteorological Agency, which has developed the Global Ocean forecasting system and regional nested high-resolution ocean forecasting system. For marine disasters and early warning forecasting, the United States, Japan, and other countries have developed the GFDL model, T213L3 model, etc. Operational forecasting systems based on marine ecodynamics have been opened internationally for marine ecological environment forecasting. The European Regional Seas Ecosystem Model (ERSEM) contains several refined cyclic processes that can characterize the vital biochemical processes in the shelf sea ecosystem. This model, coupled with the hydrodynamic model, has been operationalized at the Met Office in the United Kingdom. Furthermore, it can provide ecosystem health, water quality monitoring, harmful algal bloom prediction, and other product services in the northwest European shelf sea. The model, coupled with a hydrodynamic model, is operational at the Met Office in the United Kingdom and can provide ecosystem health, water quality monitoring, harmful algal bloom prediction, and other product services in the NW European shelf sea (Yu, 2021).

Numerical models are characterized by physical law constraints and require high computational and time costs to compute large models, resulting in a lack of ease of use and convenience.

4.2 Model-driven statistical models and traditional machine learning models

4.2.1 Statistical models

Numerical prediction models have always occupied the main position of marine environmental forecasting due to the single means of observation, the short age of observation data, and the small sample size of data in the early days. Numerical models are characterized by physical constraints and require high computational and time costs to compute large models, making them less easy to use. As an adjunct to numerical models, statistical models have also been helpful in ocean data observation. Physical laws do not constrain statistical models, are more concerned with correlations among ocean data, and play more freely. Statistical models used more often today include support vector regression (SVR), Markov models, etc.

The autoregressive moving average (ARMA) model, the autoregressive (AR) model, and the autoregressive integrated moving average model (ARIMA) models are classical time series models. The effective wave height of the Portuguese coastline region is the prediction work using AR models (Soares et al., 1996; Soares and Cunha, 2000). Agrawal and Deo (2002) used ARIMA and ARMA models to predict waves at multiple intervals along the Indian coast. Although classical time series models are well adapted, they do not apply to complex ocean conditions due to their assumption of linearity and smoothness. Effective wave heights are generally non-linear and non-stationary, so classical time series cannot accurately predict non-linear and non-stationary waves.

The principle of the SVR model is to find the optimal hyperplane to minimize the distance from all data points in the sample to the hyperplane. In the prediction study of chlorophyll-a, Amorim et al. (2021) evaluated and compared SVR, MLP, RF, and ARIMA algorithms. Comparing the algorithms, SVR reached the best R2 (0.78) and RMSE (1.113 µg L1), however, these were only slightly better results (MLP = 0.76; 1.144 µg L1 and RF = 0.75; 1.189 µg L1) (Amorim et al., 2021). The advantage of the SVR model in the forecast study is that it can avoid the complexity of the high-level ocean data space and solve the corresponding high-dimensional space decision problem directly in the linearly separable case. When the kernel function is known, it can simplify the analysis difficulty of the high-dimensional space problem; the disadvantage is that it requires high parameter tuning of the model and consumes more space for storing training samples and kernel matrix.

4.2.2 Traditional machine learning models

The traditional machine learning (ML) is an effective empirical method. It is a collection of algorithms (e.g., neural networks, support vector machines, decision trees, random forests, genetic programming, etc.) that can solve multivariate, non-linear, non-parametric regression or classification problems. The traditional ML-based modeling capability makes it highly capable of solving problems in the Earth’s marine sciences.

The application of traditional ML-based approaches is divided into three domains (Lary et al., 2016):

1. The system’s deterministic models are computationally intensive, and machine learning can be used as a code accelerator tool.

2. No deterministic model exists, but an empirically based ML model can be derived using existing data.

3. Classification problems that wish to identify specific spatial processes or events.

The generalized additive model GAM is characterized by simplicity and ease of interpretation. However, at the same time, simplicity is also the most significant weakness because, in the real world, the relationship between features and results is non-linear. GAM models are particularly suitable for analyzing time series datasets in the Earth’s marine sciences. Time series signals can often be explained by multiple additional components, such as trends, seasonality, and daily fluctuations, which can be easily incorporated into GAM models. Researchers have widely used GAM models and their derivatives in modeling analysis to predict changes in SST (Miftahuddin, 2016; Humaira et al., 2019).

From statistical models such as GAM to machine learning models, random forest RF performs well in complex prediction problems characterized by non-linear dynamics. RF is a classification regression algorithm based on the aggregation of many decision trees and is widely used for sea salt and wave prediction (Liu et al., 2015; Callens et al., 2020).

RF is famous for its good performance and little hyperparameter tuning. As with all machine learning models, there are biases to consider, variance tradeoffs, the balance between models, models that do not generalize to new data, and models that have preferences or fail to learn training data features.

The extreme gradient boosting (XGBoost) belongs to the Gradient Boosting Decision Tree (GBDT) model. It shares many features and advantages with RF (interpretability, predictability, and simplicity), but the key difference is that the decision trees that facilitate performance improvement are constructed sequentially. Jin et al. (2020) has used XGBoost to estimate the intensity of tropical cyclones in the South China Sea. XGBoost and its variant AdaBoost have also been applied to wave height prediction in Malaysian waters (Anggraeni et al., 2021). However, the drawback of XGBoost is also apparent: the time-space overhead is enormous, which is very unfriendly to progressively larger training data.

The main reason for LightGBM is to solve the problems encountered by GBDT in massive data so that GBDT can be used better and faster in practice. While retaining the advantages of XGBoost, LightGBM optimizes the traditional GBDT algorithm, enabling it to speed up the training of GBDT models without compromising accuracy. Considering the effective performance of LightGBM models in regression, Gan et al. (2021) developed a LightGBM model for predicting estuarine water levels in the lower Columbia River region and outperformed the commonly used NS_TIDE model overall. Su et al. (2021) combined LightGBM with The Ocean and Land Color Instrument (OLCI) and in situ data to estimate near-coastal chlorophyll-a concentrations and map the spatial distribution of chlorophyll-a concentrations.

Some of the variables that may play a role in predicting elements of the ocean environment are atmospheric conditions (temperature, solar radiation, cloud, precipitation, wind speed, etc.), autoregressive features (past values of elements), temporal information (seasons), and variables in adjacent spaces. Feature engineering uses domain expertise and statistical analysis to extract the most appropriate set of features for a given problem from the entire dataset, improving prediction accuracy and accelerating model convergence by selecting the most relevant features for the response variable. Figure 7 shows the basic steps of feature engineering. For machine learning, raw data rarely provides the most information, so it must consider the combination and transformation of raw data.

FIGURE 7
www.frontiersin.org

FIGURE 7. Basic steps of feature engineering. From a large amount of initial feature data, the features that are not relevant to the problem are eliminated, the features that are more relevant to the problem are selected, and the subset of features that are most important to the problem is generated.

Feature engineering is an essential part of machine learning. The good or bad feature engineering will primarily affect the final result of machine learning, which is also the disadvantage of machine learning compared with deep learning.

4.3 Data-driven deep learning models

As Big Data brings new perspectives to scientific research, more and more disciplines are moving toward data-driven analysis, including research in the field of oceanography. Data-driven deep learning techniques have recently been widely used in forecasting ocean elements. By mining the correlation between ocean elements and extracting spatial and temporal features from a large amount of ocean data, mathematical models for ocean element forecasting have been established, enabling the ability to input realistic data and then obtain accurate forecast data. Commonly used AI methods include ANN, CNN, LSTM, and ConvLSTM. These methods have been widely used in forecasting ocean elements, such as sea wind, sea surface height (SSH), SST, etc. Due to the poor interpretability and lack of physical constraints of AI, such deep learning methods cannot replace the current traditional numerical modeling methods. Combining AI with numerical ocean models is a significant development direction in the future.

4.3.1 ANN

ANN has been widely used to predict ocean parameters because of their higher predictive efficiency than traditional statistical techniques. Without the interpretability of neural networks in physical mechanisms, neural networks can sometimes be used to complement or replace traditional methods for optimization problems. Their excellent performance has encouraged researchers to use neural network models in many practical applications. ANN was first applied to sea level prediction in a 1997 study (Röske, 1997). Since then, ANN has been more widely promoted in marine research. For example, ANN has been applied to ocean salinity (Chen and Hu, 2017) and wave prediction (Ducournau and Fablet, 2016) in specific sea areas. Some extreme marine meteorological phenomena, such as storm surges and extreme sea level heights, can also be estimated using ANN (Sahoo and Bhaskaran, 2019). Moreover, relatively simple neural networks can also accurately predict surface currents in most global navigable oceans (Sinha and Abernathey, 2021). Chen et al. (2022b) developed a deep neural network (DNN) model to retrieve vertical profiles of chlorophyll-a from surface ocean data, an improvement that helps improve predictive power compared to shallow ANN (Das and Roy, 2019).

4.3.2 CNN

CNN plays an essential role in developing ocean environment elements and extreme climate predictions by extracting image features to reflect spatial information Huang et al. (2022). Jiang et al. (2018) combined shallow learning (SL) and CNN to forecast atmospheric typhoon events using SST. In a comparison experiment using meteorological parameters for forecasting SST in Japanese waters, CNN can identify extreme forecasting phenomena such as typhoons with higher accuracy than LSTM and deep MLP (Patil and Iiyama, 2022a). For marine ecology, the chlorophyll-a prediction can be performed using two different scales of CNN models for overall and local training (Jin et al., 2021), and the average RMSE of CNN Model II (7 × 7) was 0.191, which is significantly lower than that of CNN Model I (48 × 27), which was 0.463. Since CNN alone extracts only spatial feature information, it does not work excellently in ocean element forecasting with mainly spatial and temporal features.

4.3.3 RNN

RNN is a neural network with a “memory” function, specifically in that the output of a time series is also correlated with the previous output. It was designed to track the temporal dependence between the sequences of ocean elements, making RNN useful in marine environmental forecasting. The correlation coefficient of RNN is higher than that of a feedforward neural network when performing wave prediction (Mandal and Prabaharan, 2006). However, RNN suffers from the gradient disappearance problem. To overcome this problem, input gates, output gates, and forgetting gates are added outside the RNN structure. It produces the long short term memory network LSTM. The powerful memory capability of LSTM has been demonstrated in the time-series data of marine environment forecasting (Song et al., 2021; 2020a). predicts SSH using LSTM (Zhang et al., 2017). conducted the first study to use time series plus FC-LSTM to predict SST, followed by comparative experiments applying RNN and LSTM for SST prediction (Aydınlı et al., 2022). The integrated model of LSTM superimposed on MLP also obtained better results in predicting SST (Jahanbakht et al., 2021). SWAN-LSTM models integrating near-coastal wave models have also emerged to achieve near-coastal wave height predictions (Fan et al., 2020). As well as a series of experiments with LSTM on currents, sea level, and even ENSO phenomenon (Broni-Bedaiko et al., 2019; Ishida et al., 2020; Zulfa et al., 2021). LSTM models were also shown to be effective in predicting chlorophyll-a concentrations (Cho and Park, 2019; Rostam et al., 2021; Cen et al., 2022). These experiments have demonstrated the robust performance of the LSTM model. In addition, the LSTM has a variant of the bidirectional propagation model, bi-directional long short-term memory (BiLSTM), and a deep learning architecture based on these two models for wind speed prediction in the Indian Ocean region proved to be the most effective BiLSTM model (Biswas and Sinha, 2021). The LSTM model introduces many parameters that make training difficult, so the LSTM is simplified to produce a gated recurrent unit (GRU), synthesizing the forget gate and the input gate into a single update gate. It also mixes cell states and hidden states with some other modifications. It has the advantages of faster training and a more straightforward structure than the LSTM, which also performs well in marine environmental forecasting. Zhang et al. (2017) predicted medium and long term SST prediction models based on the GRU model mitigating the overfitting and underfitting phenomena. Sukanda and Adytia (2022) used GRU and bidirectional GRU for wave prediction in the Indonesia region. The GRU model obtained relatively good values of MSE, RMSE, and R2, 0.0443, 0.2106, and 0.9756, respectively, while the BiGRU model performs better than the GRU model with an MSE value of 0.0477, 0.2184 for RMSE, and 0.9869 for R2. Tropical cyclones often cause intense SSH changes at sea (Meng, 2022), Meng et al. (2021a); Song et al. (2022b) use bidirectional GRU to predict tropical cyclone tracks and SSH changes caused by tropical cyclones. The model evolution of RNN is shown in Figure 8. Although RNN and its derived networks are effective in time series ocean element forecasting, they do not extract spatial information from marine spatio-temporal data. It leaves significant room for improvement of RNN with single extraction of temporal features.

FIGURE 8
www.frontiersin.org

FIGURE 8. Evolution of the RNN family of models. RNN, LSTM, and GRU model structures are shown from left to right. The LSTM adds three gates (forget gate, input gate, and output gate) to the RNN, and the GRU is a variant of the LSTM that synthesizes forget and input gate into a single update gate.

4.3.4 CNN+RNN

In order to make RNN incorporate spatial dependency features in addition to extracted temporal features, researchers combined CNN with RNN. They successfully introduced spatial dependency extraction into time series information to further improve the performance of deep learning in ocean environment elements forecasting. Braakmann-Folgmann et al. (2017) studied combining CNN and RNN to analyze SSH evolution and predict SLA from temporal and spatial dimensions. Wei and Chang (2021) predicted typhoon-induced sea winds and waves around Taiwan Island, using a model of GRU+CNN to build a typhoon-induced wind and wave height prediction model. Mahesh et al. (2019) combined CNN and RNN to predict ENSO using SST with accuracy close to the state-of-the-art seasonal dynamic prediction model. Ren et al. (2022) Constructed a C-LSTM model based on CNN network combined with LSTM to predict typhoon paths with better results than a single LSTM model. The average surface distance error predicted by a single LSTM model is 11,503 m, while the prediction error of CNN+LSTM is only 832 m.

4.3.5 ConvLSTM

In introducing spatial features into time series, the ConvLSTM model is generated. The ConvLSTM replaces matrix multiplication with convolution operations for each gate in the LSTM cell (Shi et al., 2015). The difference between ConvLSTM and CNN+LSTM model is that the former convolves the state of the hidden layer at each step, making ConvLSTM more capable of spatial feature extraction, not only for one-dimensional temporal data but also for two-dimensional spatio-temporal data. Because of its robust feature extraction capability, ConvLSTM has shown outstanding performance in high-precision 2D wave prediction and SST for short- and medium-term prediction (Xiao et al., 2019; Zhou et al., 2021). ConvLSTM is also applied to invert SST and SSS (Song et al., 2022c). Moreover, ConvLSTM predicts chlorophyll-a compared to 3D-CNN models in marine ecological studies, and the results show that the accuracy of 2D-CNN, 3D-CNN and ConvLSTM are 0.8804, 0.9397 and 0.9799, respectively. (Lee et al., 2020; Wang et al., 2022b). If ConvLSTM exists, there must exist its twin model ConvGRU (Xu et al., 2022). extracts non-linear features of typhoons by ConvGRU combined with an attention mechanism to predict typhoon trajectories.

4.3.6 Optimization of AI methods

Based on the deep learning models mentioned above, we analyze the principles and processes of these marine element prediction models. We believe that two main factors affect the prediction performance of the models: dataset optimization and parameter optimization. The construction of datasets is even more critical in AI algorithms than the algorithms themselves. Taking the prediction of single-element SST as an example (Patil and Iiyama, 2022b), target SST data with high spatial and temporal resolution are crucial for developing deep learning models. ERA5 is one of the most commonly used ocean reanalysis datasets. JCOPE data have good temporal and spatial scales and are more regionally compatible with ERA5 reanalysis data (Miyazawa et al., 2017). Considering the daily variation of SST, the target SST data has a total of 153 days, adjusted considering the sensitivity of different models to the dataset. For example, CapsNet is less sensitive to the size of the dataset, while CNN has a stronger sensitivity because the former captures richer feature information from a single image (Chattopadhyay et al., 2020). Theoretically, multi-element data prediction has higher accuracy than single-element prediction. Using complex parameters in the atmospheric ocean to simulate more realistic environmental states helps to constitute richer features for deep learning models (Pathak et al., 2022). The parameter tuning of the model mainly refers to tuning the external parameters or hyperparameters of the model, which is optimized through iterative trials or with the help of complex optimization algorithms. In the current study, the stochastic search algorithm is used to optimize the hyperparameters because the performance of the DL model is susceptible to them. The various hyperparameters include the time duration, the number of hidden layers, the number of cells in each hidden layer, the size of the convolution kernel in the convolution layer, and the setting of the loss function. We need to evaluate these hyperparameters with the validation set to determine the most suitable for this experiment.

4.4 Combination of physical models and AI

The Traditional machine learning and deep learning have proven influential in ocean atmospheres, providing new alternatives to efficiently identify complex patterns and simulate non-linear dynamics. However, its predictions do not necessarily obey the control laws of physical systems and cannot be generalized to different systems. Therefore, physics-guided machine learning has emerged, and some results have been achieved. Physics-guided machine learning uses the laws of physics modeling and machine learning with deep learning models to solve scientific problems better.

4.4.1 Physics-guided loss function

There is no way to learn the underlying physical laws when fitting data using standard deep learning models, which leads to low physical consistency and poor generalization. The simplest and most widely used method to incorporate physical constraints is to design physically guided loss functions, which can help deep learning models to learn data patterns that conform to physical laws. Jia et al. (2019); Stewart and Ermon (2017); Daw et al. (2017) are used to guide network learning using a physics-based loss function that measures the violation of physical principles in the neural network’s output. Beucler et al. (2021); Wu et al. (2020a) introduce statistical and physical constraints in the loss function to regulate the predictions of physical simulations.

4.4.2 Physics-guided design of architecture

Although the inclusion of physical bootstrapping through the loss function allows the model to learn physical patterns, deep learning models are still black-box models in most cases. Physics-guided neural network structures have tighter hard constraints than the soft constraints of the loss function. So physics-guided structural models are more interpretable and generalizable. For example, the LSTM architecture incorporates an intermediate physical variable as part of the structure that maintains monotonicity (Daw et al., 2020). The model will produce physically consistent predictions in addition to attaching an exit layer to quantify uncertainty. De Bézenac et al. (2019) proposed a warping scheme for predicting sea surface temperature but only considered the linear advection-diffusion equation. The Turbulence Network (TF-Net) is the combination of turbulence modeling and deep learning (DL) to produce a novel deep learning model that enhances the ability to predict complex turbulence using deep neural networks (Wang et al., 2020).

4.4.3 Hybrid Physics-ML models

In addition to the two designs mentioned above that incorporate the physical system into a loss function or neural network structure, there exists a combination of physical and data-driven model models into a generalized hybrid model. A straightforward approach is to provide the output of the physical-based model as input to the data-driven model, which is visualized in Figure 9, for example, the physics-based machine learning model PBML for short-term wave forecasting (Wu et al., 2020b). The inputs and outputs of the PBML model are first determined by the main variables in the physics-based wave model, and then machine learning algorithms are used to train and perform multi-step ahead forecasts. A framework based on a combination of GAN and physical numerical models for predicting SST is also used to train the neural network model using the physical-based numerical model and then calibrate the model parameters using observed data (Meng et al., 2021b).

FIGURE 9
www.frontiersin.org

FIGURE 9. This figure is a concrete example of a hybrid model for predicting sea surface temperature. A convolution-deconvolution network can generate a motion field of water. Then, the motion field and the initial input predict the state after a time step by a physical model. Adapted from Figure 1 of De Bézenac et al. (2019).

4.4.4 Application of AI in numerical models

The ocean and the atmosphere have their physical laws, which a set of controlling equations can represent (Haidvogel et al., 2017; Schultz et al., 2021). Numerical ocean models are a commonly used method for forecasting ocean elements, essentially the numerical solution of a series of physical partial differential equations using different numerical analysis methods (Blumberg and Mellor, 1978). Another way of combining AI and physics is embodied in the combination of AI and numerical modes, thus further improving the efficiency and accuracy of numerical modes. The ocean numerical forecasting process is shown in Figure 10.

FIGURE 10
www.frontiersin.org

FIGURE 10. Schematic diagram of the atmospheric and oceanic numerical model prediction process.

The combination of AI and numerical modeling is manifested in three main areas: pre-processing, the model itself, and post-processing. Pre-processing refers to the optimization of data assimilation methods. Neural networks have great advantages in terms of accuracy and efficiency of data assimilation and are powerful in approximating non-linear systems and extracting meaningful features from high-dimensional data. These properties are very useful in the process of data assimilation (O’Donncha et al., 2018). For example, Choi et al. (2022) assimilated deep learning results for spatiotemporal prediction in the ocean to a numerical forecasting system, improving the model’s accuracy. Boosting the model means replacing some physical parameterization processes with a machine-learning model. Parameterization means that the details of the process are not taken into account but that the physical process is represented by a simplified function represented by some other defined variables (Liang et al., 2022) proposes a vertical mixing effect using a deep neural network (DNN) model to parameterize OSBL turbulence and compares the DNN model with two traditional physical parameterization methods, KPP-CVMix and KPP-LF17, showing that the (DNN) model outperforms the two popular physical-based parameterization methods. There are two main ways in which machine learning can be applied to the post-processing of numerical models, one is to revise the predictions of the numerical models, and the other is to use the results of the numerical model predictions as input or training data for the deep learning models. Fei et al. (2022) proposed a sea surface temperature (SST) correction method for convolutional long and short-term memory (ConvLSTM) networks based on a multi-attentive mechanism. Zhang et al. (2013) used higher resolution data on meteorological variables from the National Centre for Environmental Protection (NCEP) - Global Forecasting System (GFS) Final Analysis (FNL) dataset to train the neural network. The study demonstrates that combining AI and numerical models not only improves the efficiency and accuracy of numerical models but also saves computational resources.

4.4.5 Signal decomposition hybrid model

The classical time series models such as AR, ARMA, and ARIMA in statistical models are adaptive models based on linear and smooth theory predictions. Furthermore, the deep learning models LSTM developed for time series problems have strong non-linear processing capability. However, the variation of ocean elements, such as sea wind and waves, is non-linearity and non-stationary. Therefore although these models have proven to be robust in ocean forecasting, it is undeniable that they are still limited when facing non-stationary problems. So the signal decomposition method has been introduced to the study of ocean forecasting, as shown in Figure 11. This technique can decompose complex time series into simple components to overcome the non-linear and non-stationary state. The signal decomposition technique can be combined with machine learning and deep learning to enhance the models’ ability to handle non-stationary signals. LI et al. (2017) enhanced SVM models to forecast SST using complementary ensemble empirical mode decomposition (CEEMD) algorithm. Duan et al. (2016) combined the empirical modal decomposition algorithm empirical mode decomposition (EMD) with statistical models model AR and deep learning model LSTM for wave prediction, respectively, and successfully enhanced the performance of both models (Hao et al., 2022). Ensemble empirical mode decomposition (EEMD) and CEEMD are two improved algorithms of EMD. Each of the two algorithms was combined with back propagation neural network (BPNN) to construct a hybrid model for predicting SST, and the results showed that CEEMD-BPNN was better for predicting SST (Wu et al., 2019). Moreover, Song et al. (2022a) combined three signal decomposition techniques (TVF-EMD, WT and CEEMD) with ENN models for a minute-scale sea level prediction study, respectively, and in the time series lengths of 1,440, 720, and 360 min, the mean R2 values of TVF-EMD-ENN were best among the four models. For the 1,440 min sequence length, the average R2 of TVF-EMD-ENN was 0.952, higher than those of WT-ENN (0.910) and CEEMD-ENN (0.929). A hybrid prediction model was developed for wind and wave power prediction, which was based on adaptive decomposition (Nelder-Mead variational mode decomposition) and a convolutional neural network with bi-directional long short-term memory (Neshat et al., 2022). Meng et al. (2022) applied an adaptive time-frequency decomposition algorithm to predict SSH caused by tropical cyclones. Hu et al. (2021) proposed a hybrid time series prediction model based on integrated empirical modal decomposition EEMD, LSTM, and Bayesian optimization (BO) for wind and wave height prediction.

FIGURE 11
www.frontiersin.org

FIGURE 11. Signal decomposition schematic, the input data is decomposed into multiple sub-signals Z SD1 to ZSDn by the signal decomposition algorithm. The sub-signal input data-driven model results are combined to obtain the prediction results.

In summary, signal decomposition algorithms enhance the model’s ability to handle non-stationary signals. However, not all signal decomposition algorithms apply to a particular problem. For example, Gan et al. (2021) discusses the application of NS_TIDE, EEMD, and VMD to river tides. EEMD and VMD are general signal decomposition algorithms, and VMD can eliminate modal mixing better than EEMD. NS_TIDE can resolve specific tidal components compared to VMD but cannot accurately reproduce sub-tidal water levels during high flow times. Specific problems should be analyzed to select the appropriate signal decomposition algorithm.

5 Discussion

5.1 Direction of the application of AI in ocean observation

In remote sensing, AI models related to ocean observation need to incorporate physics. Moreover, models lacking physics may not be very accurate, and most current models used for ocean remote sensing image information mining are from computer vision. Some models explicitly serving the ocean should also be developed in the future. Increase the generalization capability of the models so that they can be adapted to different ocean observation sensors. In terms of intelligent sensor networking, its mobility is currently limited, and its location is relatively fixed. In the future, it needs to combine more unmanned aerial vehicles and autonomous underwater vehicles to expand its observation range and make it more flexible. For underwater robots, the current robotic intelligence delays the established procedures to meet the operating environment of basic behavior patterns. However, it does not yet have the human brain’s advanced reasoning evolutionary behavior capabilities. The future must develop AI robots with higher-order intelligence and behavior capabilities.

5.2 Direction of identification of ocean phenomena

Two trends can be summarised by analyzing the evolution of methods for identifying some marine processes. Firstly, more AI methods have been used for marine process identification in recent years, and the models used by researchers are becoming more advanced. Thus more advanced deep learning models are a major trend for future development. Other marine elements related to marine process identification are gradually gaining attention from researchers, and multi-element studies are becoming mainstream.

It is clear from the current state of research that most work has focused on SAR imagery, and more needs to be done to identify it. The current state of research shows that most of the work has focused on SAR images. Very little work has been done to identify ocean phenomena in geostationary satellite images. In order to fill this gap, ocean phenomena in geostationary satellite images could be the main object of study in the future, and more advanced neural networks could be used to cope with the interference caused by complex imaging conditions. SAR images can be combined with geostationary satellite images, providing additional information for identifying ocean phenomena in geostationary satellite images. In addition, similar to the authors of (Drees et al., 2020), using a multimodal approach to fuse datasets other than SAR images with SAR images for further processing and recognition may become a major trend for future development.

5.3 Direction of ocean element forecasting

The following describes future research directions for ocean element forecasting from the perspectives of data, methods, and applications.

1. In terms of data, the performance of AI is inextricably linked to data features, and improving data validity is the basis for improving prediction accuracy. It can be combined with physical features, feature mining of data from the perspective of ocean physics, or data optimization through mathematical methods, statistics, or machine learning.

2. In terms of methods, different sea areas may be suitable for different methods. Combining AI with marine numerical models, statistical models, and big data to form a data collection forecasting system to complement each other’s shortcomings will effectively improve the forecasting effect.

3. In terms of application, real-time observation of marine environmental data often faces characteristics such as missing data, significant errors, massive data, and complex calculations. Hence, it is necessary to consider various conditions of practical applications and improve the model’s compatibility and robustness to more complex conditions.

6 Summary

With the emergence of AI and the age of “big data,” humans have the high-tech objective of using vast quantities of data. Big data on the ocean supports people in improving the ocean ecosystem and enhances the quality of life in society. We examine the evolution of ocean observation and its relevance in the development of ocean observation. Intelligent remote sensing technology, intelligent sensor networking technology, and intelligent underwater robots were created by combining the present observation technology with an AI algorithm. Among them, the data supplied by remote sensing technologies serve as the foundation for ocean forecasting and identification and are frequently used by scientists. In addition, reconstructed observation data are included in the ocean’s big data set. Numerous objective causes will unavoidably cause a considerable quantity of ocean observational data to be incomplete or unavailable, necessitating the challenge of data reconstruction. The AI system is able to effectively recreate observation data and correct any inaccuracies or missing data issues.

Oceanic physical processes, such as internal waves, heatwaves, and eddies, have vital impacts on the Earth’s climate, marine ecology, and human activities. Consequently, it is crucial that humans use ocean data for the identification of ocean phenomena. This research highlights the use of artificial intelligence algorithms for detecting and recognizing internal waves, heatwaves, the El Niño phenomena, and sea ice, as well as for forecasting ocean components. We categorize them as physics-driven numerical models, model-driven statistical models, classical machine learning models, data-driven deep learning models, and physical models mixed with AI models. Each model type focuses differently on ocean forecasting. Currently, CNN, LSTM, and ConvLSTM are frequently used data-driven deep learning models in marine element forecasting, such as sea breeze, SSH, SST, etc. Due of the poor interpretability and absence of physical restrictions of AI in general, these deep learning approaches cannot yet replace classic numerical modeling techniques. Combining physical models with AI has thus yielded some outcomes. Using the rules of physics in conjunction with data-driven models improves the ability to address scientific challenges. Finally, we address briefly how to increase the performance of AI systems, mostly through optimizing data sets and parameters.

Author contributions

TS: He is responsible for setting overall research goals and objectives, designing research ideas, supervising and planning the overall research plan, and reviewing and revising the original draft. CP: He is responsible for writing the original draft, collecting research papers, conducting research, and creating graphics. BH: He is responsible for writing the original draft, collecting research papers, conducting research, and creating graphics. GX: He is responsible for writing the original draft, collecting research papers, conducting research, and creating graphics. JX: He is responsible for compiling the findings and reviewing the results. HS: She is responsible for reviewing and revising the original draft. FM: He provides financial support and coordinates the entire research process.

Funding

This work was supported by the Natural Science Foundation of China (Grant: U1811464); National Key Research and Development Program (No. 2018YFC1406201 and No. 2018YFC1406204); Natural Science Foundation of Shandong Province (Grant No. 405 ZR2019MF012); Taishan Scholars Fund (Grant No. ZX20190157). Project Supported by Key Laboratory of Environmental Change and Natural Disaster of Ministry of Education, Beijing Normal University (Project No. 2022-KF-08), Project Supported by Key Laboratory of Marine Hazards Forecasting, Ministry of Natural Resources (No.LOMF2202), Innovation found project for graduate students of China University of Petroleum (East China) (CXJJ-2022-08).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/feart.2023.1090185/full#supplementary-material

References

Adams, R. M., Chen, C.-C., McCarl, B. A., and Weiher, R. F. (1999). The economic consequences of enso events for agriculture. Clim. Res. 13, 165–172. doi:10.3354/cr013165

CrossRef Full Text | Google Scholar

Adhikary, S., Chaturvedi, S. K., Banerjee, S., and Basu, S. (2021). “Dependence of physiochemical features on marine chlorophyll analysis with learning techniques,” in Advances in environment engineering and management (Springer), 361–373.

CrossRef Full Text | Google Scholar

Agapiou, A. (2017). Remote sensing heritage in a petabyte-scale: Satellite data and heritage Earth engineⒸ applications. Int. J. Digital Earth 10, 85–102. doi:10.1080/17538947.2016.1250829

CrossRef Full Text | Google Scholar

Agrawal, J., and Deo, M. (2002). On-line wave prediction. Mar. Struct. 15, 57–74. doi:10.1016/s0951-8339(01)00014-4

CrossRef Full Text | Google Scholar

Amorim, F. d. L. L. d., Rick, J., Lohmann, G., and Wiltshire, K. H. (2021). Evaluation of machine learning predictions of a highly resolved time series of chlorophyll-a concentration. Appl. Sci. 11, 7208. doi:10.3390/app11167208

CrossRef Full Text | Google Scholar

Anggraeni, F., Adytia, D., and Ramadhan, A. W. (2021). “Forecasting of wave height time series using adaboost and xgboost, case study in pangandaran, Indonesia”. In 2021 International Conference on Data Science and Its Applications (ICoDSA) (IEEE), 97–101.

CrossRef Full Text | Google Scholar

Aparna, S., D’souza, S., and Arjun, N. (2018). Prediction of daily sea surface temperature using artificial neural networks. Int. J. Remote Sens. 39, 4214–4231. doi:10.1080/01431161.2018.1454623

CrossRef Full Text | Google Scholar

Asadollah, S. B. H. S., Khan, N., Sharafati, A., Shahid, S., Chung, E.-S., and Wang, X.-J. (2022). Prediction of heat waves using meteorological variables in diverse regions of Iran with advanced machine learning models. Stoch. Environ. Res. risk Assess. 36, 1959–1974. doi:10.1007/s00477-021-02103-z

CrossRef Full Text | Google Scholar

Aydınlı, H. O., Ekincek, A., Aykanat-Atay, M., Sarıtaş, B., and Özenen-Kavlak, M. (2022). sea surface temperature prediction model for the black sea by employing time-series satellite data: A machine learning approach. Appl. Geomatics 14, 669–678. doi:10.1007/s12518-022-00462-y

CrossRef Full Text | Google Scholar

Ball, J. E., Anderson, D. T., and Chan Sr, C. S. (2017). Comprehensive survey of deep learning in remote sensing: Theories, tools, and challenges for the community. J. Appl. remote Sens. 11, 1. doi:10.1117/1.jrs.11.042609

CrossRef Full Text | Google Scholar

Berry, D. I., Kent, E. C., and Taylor, P. K. (2004). An analytical model of heating errors in marine air temperatures from ships. J. Atmos. Ocean. Technol. 21, 1198–1215. doi:10.1175/1520-0426(2004)021<1198:aamohe>2.0.co;2

CrossRef Full Text | Google Scholar

Beucler, T., Pritchard, M., Rasp, S., Ott, J., Baldi, P., and Gentine, P. (2021). Enforcing analytic constraints in neural networks emulating physical systems. Phys. Rev. Lett. 126, 098302. doi:10.1103/physrevlett.126.098302

PubMed Abstract | CrossRef Full Text | Google Scholar

Biswas, S., and Sinha, M. (2021). Performances of deep learning models for indian ocean wind speed prediction. Model. Earth Syst. Environ. 7, 809–831. doi:10.1007/s40808-020-00974-9

CrossRef Full Text | Google Scholar

Blumberg, A. F., and Mellor, G. L. (1978). A coastal ocean numerical model. Math. Model. Estuar. Phys. 1, 203–219.

Google Scholar

Boukabara, S.-A., Krasnopolsky, V., Stewart, J. Q., Maddy, E. S., Shahroudi, N., and Hoffman, R. N. (2019). Leveraging modern artificial intelligence for remote sensing and nwp: Benefits and challenges. Bull. Am. Meteorological Soc. 100, ES473–ES491. doi:10.1175/bams-d-18-0324.1

CrossRef Full Text | Google Scholar

Bourras, D. (2006). Comparison of five satellite-derived latent heat flux products to moored buoy data. J. Clim. 19, 6291–6313. doi:10.1175/jcli3977.1

CrossRef Full Text | Google Scholar

Box, G. E., and Pierce, D. A. (1970). Distribution of residual autocorrelations in autoregressive-integrated moving average time series models. J. Am. Stat. Assoc. 65, 1509–1526. doi:10.1080/01621459.1970.10481180

CrossRef Full Text | Google Scholar

Braakmann-Folgmann, A., Roscher, R., Wenzel, S., Uebbing, B., and Kusche, J. (2017). Sea level anomaly prediction using recurrent neural networks. arXiv preprint arXiv:1710.07099.

Google Scholar

Broni-Bedaiko, C., Katsriku, F. A., Unemi, T., Atsumi, M., Abdulai, J.-D., Shinomiya, N., et al. (2019). El niño-southern oscillation forecasting using complex networks analysis of lstm neural networks. Artif. Life Robotics 24, 445–451. doi:10.1007/s10015-019-00540-2

CrossRef Full Text | Google Scholar

Callens, A., Morichon, D., Abadie, S., Delpey, M., and Liquet, B. (2020). Using random forest and gradient boosting trees to improve wave forecast at a specific location. Appl. Ocean Res. 104, 102339. doi:10.1016/j.apor.2020.102339

CrossRef Full Text | Google Scholar

Cater, N. E., Eng, P., and O’Reilly, T. (2009). “Promoting interoperable ocean sensors the smart ocean sensors consortium,” in Oceans 2009 (IEEE), 1–6.

CrossRef Full Text | Google Scholar

Cen, H., Jiang, J., Han, G., Lin, X., Liu, Y., Jia, X., et al. (2022). Applying deep learning in the prediction of chlorophyll-a in the east China sea. Remote Sens. 14, 5461. doi:10.3390/rs14215461

CrossRef Full Text | Google Scholar

Centurioni, L. R., Turton, J., Lumpkin, R., Braasch, L., Brassington, G., Chao, Y., et al. (2019). Global in situ observations of essential climate and ocean variables at the air–sea interface. Front. Mar. Sci. 6, 419. doi:10.3389/fmars.2019.00419

CrossRef Full Text | Google Scholar

Chattopadhyay, A., Nabizadeh, E., and Hassanzadeh, P. (2020). Analog forecasting of extreme-causing weather patterns using deep learning. J. Adv. Model. Earth Syst. 12, e2019MS001958. doi:10.1029/2019ms001958

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, G., Huang, B., Chen, X., Ge, L., Radenkovic, M., and Ma, Y. (2022a). deep blue AI: A new bridge from data to knowledge for the ocean science. Deep Sea Res. Part I Oceanogr. Res. Pap. 190, 103886. doi:10.1016/j.dsr.2022.103886

CrossRef Full Text | Google Scholar

Chen, J., Gong, X., Guo, X., Xing, X., Lu, K., Gao, H., et al. (2022b). Improved perceptron of subsurface chlorophyll maxima by a deep neural network: A case study with bgc-argo float data in the northwestern Pacific ocean. Remote Sens. 14, 632. doi:10.3390/rs14030632

CrossRef Full Text | Google Scholar

Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A. L. (2017). Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans. pattern analysis Mach. Intell. 40, 834–848. doi:10.1109/tpami.2017.2699184

CrossRef Full Text | Google Scholar

Chen, S., and Hu, C. (2017). Estimating sea surface salinity in the northern gulf of Mexico from satellite ocean color measurements. Remote Sens. Environ. 201, 115–132. doi:10.1016/j.rse.2017.09.004

CrossRef Full Text | Google Scholar

Chengcheng, Q., and Ge, C. (2018). Big data science for ocean: Present and future. Bull. Chin. Acad. Sci. Chin. Version) 33, 884–891.

Google Scholar

Cho, H., and Park, H. (2019). “Merged-lstm and multistep prediction of daily chlorophyll-a concentration for algal bloom forecast,” in IOP Conference Series: Earth and Environmental Science (Bristol: IOP Publishing), 351, 012020.

CrossRef Full Text | Google Scholar

Choi, H., Park, M., Son, G., Jeong, J., Park, J., Mo, K., et al. (2020). Real-time significant wave height estimation from raw ocean images based on 2d and 3d deep neural networks. Ocean. Eng. 201, 107129. doi:10.1016/j.oceaneng.2020.107129

CrossRef Full Text | Google Scholar

Choi, Y., Park, Y., Hwang, J., Jeong, K., and Kim, E. (2022). Improving ocean forecasting using deep learning and numerical model integration. J. Mar. Sci. Eng. 10, 450. doi:10.3390/jmse10040450

CrossRef Full Text | Google Scholar

Cooke, C. L., and Scott, K. A. (2019). Estimating sea ice concentration from sar: Training convolutional neural networks with passive microwave data. IEEE Trans. Geoscience Remote Sens. 57, 4735–4747. doi:10.1109/tgrs.2019.2892723

CrossRef Full Text | Google Scholar

Coulibaly, P., Anctil, F., Rasmussen, P., and Bobée, B. (2000). A recurrent neural networks approach using indices of low-frequency climatic variability to forecast regional annual runoff. Hydrol. Process. 14, 2755–2777. doi:10.1002/1099-1085(20001030)14:15<2755::aid-hyp90>3.0.co;2-9

CrossRef Full Text | Google Scholar

Das, H. S., and Roy, P. (2019). “A deep dive into deep learning techniques for solving spoken language identification problems,” in Intelligent speech signal processing (Elsevier), 81–100.

CrossRef Full Text | Google Scholar

Daw, A., Karpatne, A., Watkins, W. D., Read, J. S., and Kumar, V. (2017). “Physics-guided neural networks (pgnn): An application in lake temperature modeling,” in Knowledge-guided machine learning (Chapman and Hall/CRC), 353–372.

Google Scholar

Daw, A., Thomas, R. Q., Carey, C. C., Read, J. S., Appling, A. P., and Karpatne, A. (2020). “Physics-guided architecture (pga) of neural networks for quantifying uncertainty in lake temperature modeling,” in Proceedings of the 2020 siam international conference on data mining (Philadelphia: SIAM), 532–540.

CrossRef Full Text | Google Scholar

De Bézenac, E., Pajot, A., and Gallinari, P. (2019). Deep learning for physical processes: Incorporating prior scientific knowledge. J. Stat. Mech. Theory Exp. 2019, 124009. doi:10.1088/1742-5468/ab3195

CrossRef Full Text | Google Scholar

Deo, R. C., and Şahin, M. (2015). Application of the extreme learning machine algorithm for the prediction of monthly effective drought index in eastern Australia. Atmos. Res. 153, 512–525. doi:10.1016/j.atmosres.2014.10.016

CrossRef Full Text | Google Scholar

Dong, C., Xu, G., Han, G., Bethel, B. J., Xie, W., and Zhou, S. (2022a). Recent developments in artificial intelligence in oceanography. Ocean-Land-Atmosphere Res. 2022. doi:10.34133/2022/9870950

CrossRef Full Text | Google Scholar

Dong, X., Zhang, C., Fang, L., and Yan, Y. (2022b). A deep learning based framework for remote sensing image ground object segmentation. Appl. Soft Comput. 130, 109695. doi:10.1016/j.asoc.2022.109695

CrossRef Full Text | Google Scholar

Drees, L., Kusche, J., and Roscher, R. (2020). Multi-modal deep learning with sentinel-3 observations for the detection of oceanic internal waves. ISPRS Ann. Photogrammetry, Remote Sens. Spatial Inf. Sci. 2, 813–820. doi:10.5194/isprs-annals-v-2-2020-813-2020

CrossRef Full Text | Google Scholar

Du, Y., Song, W., He, Q., Huang, D., Liotta, A., and Su, C. (2019). Deep learning with multi-scale feature fusion in remote sensing for automatic oceanic eddy detection. Inf. Fusion 49, 89–99. doi:10.1016/j.inffus.2018.09.006

CrossRef Full Text | Google Scholar

Duan, W.-y., Huang, L.-m., Han, Y., and Huang, D.-t. (2016). A hybrid emd-ar model for nonlinear and non-stationary wave forecasting. J. Zhejiang University-SCIENCE A 17, 115–129. doi:10.1631/jzus.a1500164

CrossRef Full Text | Google Scholar

Ducournau, A., and Fablet, R. (2016). “Deep learning for ocean remote sensing: An application of convolutional neural networks for super-resolution on satellite-derived sst data,” in 2016 9th IAPR Workshop on Pattern Recogniton in Remote Sensing (PRRS) (IEEE), 1–6.

CrossRef Full Text | Google Scholar

Durán-Rosal, A. M., Hervás-Martínez, C., Tallón-Ballesteros, A. J., Martínez-Estudillo, A., and Salcedo-Sanz, S. (2016). Massive missing data reconstruction in ocean buoys with evolutionary product unit neural networks. Ocean. Eng. 117, 292–301. doi:10.1016/j.oceaneng.2016.03.053

CrossRef Full Text | Google Scholar

Fan, S., Xiao, N., and Dong, S. (2020). A novel model to predict significant wave height based on long short-term memory network. Ocean. Eng. 205, 107298. doi:10.1016/j.oceaneng.2020.107298

CrossRef Full Text | Google Scholar

Fei, T., Huang, B., Wang, X., Zhu, J., Chen, Y., Wang, H., et al. (2022). A hybrid deep learning model for the bias correction of sst numerical forecast products using satellite data. Remote Sens. 14, 1339. doi:10.3390/rs14061339

CrossRef Full Text | Google Scholar

Gan, M., Pan, S., Chen, Y., Cheng, C., Pan, H., and Zhu, X. (2021). Application of the machine learning lightgbm model to the prediction of the water levels of the lower columbia river. J. Mar. Sci. Eng. 9, 496. doi:10.3390/jmse9050496

CrossRef Full Text | Google Scholar

Gao, M., Wang, B., Yang, J., and Dong, W. (2018). Are peak summer sultry heat wave days over the yangtze–huaihe river basin predictable? J. Clim. 31, 2185–2196. doi:10.1175/jcli-d-17-0342.1

CrossRef Full Text | Google Scholar

Gao, Y., Gao, F., Dong, J., and Wang, S. (2019). Transferred deep learning for sea ice change detection from synthetic-aperture radar images. IEEE Geoscience Remote Sens. Lett. 16, 1655–1659. doi:10.1109/lgrs.2019.2906279

CrossRef Full Text | Google Scholar

Geiger, E. F., Grossi, M. D., Trembanis, A. C., Kohut, J. T., and Oliver, M. J. (2013). Satellite-derived coastal ocean and estuarine salinity in the mid-atlantic. Cont. Shelf Res. 63, S235–S242. doi:10.1016/j.csr.2011.12.001

CrossRef Full Text | Google Scholar

Ghaffarian, S., Valente, J., Van Der Voort, M., and Tekinerdogan, B. (2021). Effect of attention mechanism in deep learning-based remote sensing image processing: A systematic literature review. Remote Sens. 13, 2965. doi:10.3390/rs13152965

CrossRef Full Text | Google Scholar

Guckenheimer, J., Timmermann, A., Dijkstra, H., and Roberts, A. (2017). (un) predictability of strong el niño events. Dyn. Statistics Clim. Syst. 2, dzx004. doi:10.1093/climsys/dzx004

CrossRef Full Text | Google Scholar

Gupta, M., Kodamana, H., and Sandeep, S. (2020). Prediction of enso beyond spring predictability barrier using deep convolutional lstm networks. IEEE Geoscience Remote Sens. Lett. 19, 1–5. doi:10.1109/lgrs.2020.3032353

CrossRef Full Text | Google Scholar

Haidvogel, D. B., Curchitser, E. N., Danilov, S., and Fox-Kemper, B. (2017). Numerical modelling in a multiscale ocean. J. Mar. Res. 75, 683–725. doi:10.1357/002224017823523964

CrossRef Full Text | Google Scholar

Ham, Y.-G., Kim, J.-H., and Luo, J.-J. (2019). Deep learning for multi-year enso forecasts. Nature 573, 568–572. doi:10.1038/s41586-019-1559-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Hao, W., Sun, X., Wang, C., Chen, H., and Huang, L. (2022). A hybrid emd-lstm model for non-stationary wave prediction in offshore China. Ocean. Eng. 246, 110566. doi:10.1016/j.oceaneng.2022.110566

CrossRef Full Text | Google Scholar

Haupt, S. E., Pasini, A., and Marzban, C. (2008). Artificial intelligence methods in the environmental sciences. Springer Science & Business Media.

Google Scholar

Howe, B. M., Chao, Y., Arabshahi, P., Roy, S., McGinnis, T., and Gray, A. (2010). A smart sensor web for ocean observation: Fixed and mobile platforms, integrated acoustics, satellites and predictive modeling. IEEE J. Sel. Top. Appl. Earth Observations Remote Sens. 3, 507–521. doi:10.1109/jstars.2010.2052022

CrossRef Full Text | Google Scholar

Hsieh, W. W. (2009). Machine learning methods in the environmental sciences: Neural networks and kernels. Cambridge University Press.

Google Scholar

Hu, W., He, Y., Liu, Z., Tan, J., Yang, M., and Chen, J. (2021). Toward a digital twin: Time series prediction based on a hybrid ensemble empirical mode decomposition and bo-lstm neural networks. J. Mech. Des. 143. doi:10.1115/1.4048414

CrossRef Full Text | Google Scholar

Huang, A., Vega-Westhoff, B., and Sriver, R. L. (2019). Analyzing el niño–southern oscillation predictability using long-short-term-memory models. Earth Space Sci. 6, 212–221. doi:10.1029/2018ea000423

CrossRef Full Text | Google Scholar

Huang, L., Jing, Y., Chen, H., Zhang, L., and Liu, Y. (2022). A regional wind wave prediction surrogate model based on cnn deep learning network. Appl. Ocean Res. 126, 103287. doi:10.1016/j.apor.2022.103287

CrossRef Full Text | Google Scholar

Humaira, R., Miftahuddin, , and Setiawan, I. (2019). “Modelling of sea surface temperature by using generalized additive mixed models in risk detection,” in IOP Conference Series: Earth and Environmental Science (Bristol: IOP Publishing), 273 012025.

CrossRef Full Text | Google Scholar

Iglesias, G., Kale, D. C., and Liu, Y. (2015). “An examination of deep learning for extreme climate pattern analysis,” in The 5th International Workshop on Climate Informatics.

Google Scholar

Ishida, K., Tsujimoto, G., Ercan, A., Tu, T., Kiyama, M., and Amagasaki, M. (2020). Hourly-scale coastal sea level modeling in a changing climate using long short-term memory neural network. Sci. Total Environ. 720, 137613. doi:10.1016/j.scitotenv.2020.137613

PubMed Abstract | CrossRef Full Text | Google Scholar

Jahanbakht, M., Xiang, W., and Azghadi, M. R. (2021). Sea surface temperature forecasting with ensemble of stacked deep neural networks. IEEE Geoscience Remote Sens. Lett. 19, 1–5. doi:10.1109/lgrs.2021.3098425

CrossRef Full Text | Google Scholar

Jang, E., Kim, Y. J., Im, J., and Park, Y.-G. (2021). Improvement of smap sea surface salinity in river-dominated oceans using machine learning approaches. GIScience Remote Sens. 58, 138–160. doi:10.1080/15481603.2021.1872228

CrossRef Full Text | Google Scholar

Jang, E., Kim, Y. J., Im, J., Park, Y.-G., and Sung, T. (2022). Global sea surface salinity via the synergistic use of smap satellite and hycom data based on machine learning. Remote Sens. Environ. 273, 112980. doi:10.1016/j.rse.2022.112980

CrossRef Full Text | Google Scholar

Jia, X., Willard, J., Karpatne, A., Read, J., Zwart, J., Steinbach, M., et al. (2019). “Physics guided rnns for modeling dynamical systems: A case study in simulating lake temperature profiles,” in Proceedings of the 2019 SIAM International Conference on Data Mining (Philadelphia: SIAM), 558–566.

CrossRef Full Text | Google Scholar

Jiang, G.-Q., Xu, J., and Wei, J. (2018). A deep learning algorithm of neural network for the parameterization of typhoon-ocean feedback in typhoon forecast models. Geophys. Res. Lett. 45, 3706–3716. doi:10.1002/2018gl077004

CrossRef Full Text | Google Scholar

Jin, D., Lee, E., Kwon, K., and Kim, T. (2021). A deep learning model using satellite ocean color and hydrodynamic model to estimate chlorophyll-a concentration. Remote Sens. 13, 2003. doi:10.3390/rs13102003

CrossRef Full Text | Google Scholar

Jin, Q., Fan, X., Liu, J., Xue, Z., and Jian, H. (2020). Estimating tropical cyclone intensity in the south China sea using the xgboost model and fengyun satellite images. Atmosphere 11, 423. doi:10.3390/atmos11040423

CrossRef Full Text | Google Scholar

Jung, S., Kim, Y. J., Park, S., and Im, J. (2020). Prediction of sea surface temperature and detection of ocean heat wave in the south sea of Korea using time-series deep-learning approaches. Korean J. Remote Sens. 36, 1077–1093.

Google Scholar

Khan, N., Shahid, S., Ismail, T., Ahmed, K., and Nawaz, N. (2019a). Trends in heat wave related indices in Pakistan. Stoch. Environ. Res. risk Assess. 33, 287–302. doi:10.1007/s00477-018-1605-2

CrossRef Full Text | Google Scholar

Khan, N., Shahid, S., Ismail, T. B., and Behlil, F. (2021). Prediction of heat waves over Pakistan using support vector machine algorithm in the context of climate change. Stoch. Environ. Res. Risk Assess. 35, 1335–1353. doi:10.1007/s00477-020-01963-1

CrossRef Full Text | Google Scholar

Khan, N., Shahid, S., Juneng, L., Ahmed, K., Ismail, T., and Nawaz, N. (2019b). Prediction of heat waves in Pakistan using quantile regression forests. Atmos. Res. 221, 1–11. doi:10.1016/j.atmosres.2019.01.024

CrossRef Full Text | Google Scholar

Kim, M., Im, J., Han, H., Kim, J., Lee, S., Shin, M., et al. (2015). Landfast sea ice monitoring using multisensor fusion in the Antarctic. GIScience remote Sens. 52, 239–256. doi:10.1080/15481603.2015.1026050

CrossRef Full Text | Google Scholar

Kim, S., Kang, J.-S., Lee, M., and Song, S.-k. (2018). Deeptc: Convlstm network for trajectory prediction of tropical cyclone using spatiotemporal atmospheric simulation data.

Google Scholar

Kim, Y. H., Im, J., Ha, H. K., Choi, J.-K., and Ha, S. (2014). Machine learning approaches to coastal water quality monitoring using goci satellite data. GIScience Remote Sens. 51, 158–174. doi:10.1080/15481603.2014.900983

CrossRef Full Text | Google Scholar

Krasnopolsky, V. M. (2013). The application of neural networks in the Earth system sciences. Neural Netw. Emulations Complex Multidimensional Mappings 46.

CrossRef Full Text | Google Scholar

Kruk, R., Fuller, M. C., Komarov, A. S., Isleifson, D., and Jeffrey, I. (2020). Proof of concept for sea ice stage of development classification using deep learning. Remote Sens. 12, 2486. doi:10.3390/rs12152486

CrossRef Full Text | Google Scholar

Lary, D. J., Alavi, A. H., Gandomi, A. H., and Walker, A. L. (2016). Machine learning in geosciences and remote sensing. Geosci. Front. 7, 3–10. doi:10.1016/j.gsf.2015.07.003

CrossRef Full Text | Google Scholar

Lee, T., Choi, J.-H., Jang, M., Won, J., and Kim, J. (2020). “Enhancing prediction of chlorophyll-a concentration with feature extraction using higher-order partial least squares,” in 2020 International Conference on Information and Communication Technology Convergence (ICTC) (IEEE), 1666–1668.

CrossRef Full Text | Google Scholar

Leigh, S., Wang, Z., and Clausi, D. A. (2013). Automated ice–water classification using dual polarization sar satellite imagery. IEEE Trans. Geoscience Remote Sens. 52, 5529–5539. doi:10.1109/tgrs.2013.2290231

CrossRef Full Text | Google Scholar

Li, M., Zhang, R., and Liu, K. (2021). Evolving a bayesian network model with information flow for time series interpolation of multiple ocean variables. Acta Oceanol. Sin. 40, 249–262. doi:10.1007/s13131-021-1734-1

CrossRef Full Text | Google Scholar

Li, Q.-J., Zhao, Y., Liao, H.-L., and Li, J.-K. (2017). Effective forecast of northeast Pacific sea surface temperature based on a complementary ensemble empirical mode decomposition–support vector machine method. Atmos. Ocean. Sci. Lett. 10, 261–267. doi:10.1080/16742834.2017.1305867

CrossRef Full Text | Google Scholar

Li, X., Liu, B., Zheng, G., Ren, Y., Zhang, S., Liu, Y., et al. (2020). Deep-learning-based information mining from ocean remote-sensing imagery. Natl. Sci. Rev. 7, 1584–1605. doi:10.1093/nsr/nwaa047

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, Y., Zhang, X., Cheng, L., Xie, M., and Cao, K. (2022). 3d wave simulation based on a deep learning model for spatiotemporal prediction. Ocean. Eng. 263, 112420. doi:10.1016/j.oceaneng.2022.112420

CrossRef Full Text | Google Scholar

Liang, J.-H., Yuan, J., Wan, X., Liu, J., Liu, B., Jang, H., et al. (2022). Exploring the use of machine learning to parameterize vertical mixing in the ocean surface boundary layer. Ocean. Model. 176, 102059. doi:10.1016/j.ocemod.2022.102059

CrossRef Full Text | Google Scholar

Lin, M., and Yang, C. (2020). Ocean observation technologies: A review. Chin. J. Mech. Eng. 33, 32–18. doi:10.1186/s10033-020-00449-z

CrossRef Full Text | Google Scholar

Liu, H., Guo, H., and Zhang, L. (2014). Svm-based sea ice classification using textural features and concentration from radarsat-2 dual-pol scansar data. IEEE J. Sel. Top. Appl. Earth Observations Remote Sens. 8, 1601–1613. doi:10.1109/jstars.2014.2365215

CrossRef Full Text | Google Scholar

Liu, M., Liu, X., Liu, D., Ding, C., and Jiang, J. (2015). Multivariable integration method for estimating sea surface salinity in coastal waters from in situ data and remotely sensed data using random forest algorithm. Comput. geosciences 75, 44–56. doi:10.1016/j.cageo.2014.10.016

CrossRef Full Text | Google Scholar

Liu, X., and Wang, M. (2018). Gap filling of missing data for viirs global ocean color products using the dineof method. IEEE Trans. Geoscience Remote Sens. 56, 4464–4476. doi:10.1109/tgrs.2018.2820423

CrossRef Full Text | Google Scholar

Liu, Y., Qiu, M., Liu, C., and Guo, Z. (2017). Big data challenges in ocean observation: A survey. Personal Ubiquitous Comput. 21, 55–65. doi:10.1007/s00779-016-0980-2

CrossRef Full Text | Google Scholar

Lou, R., Lv, Z., Dang, S., Su, T., and Li, X. (2021). Application of machine learning in ocean data. Multimed. Syst. 1–10. doi:10.1007/s00530-020-00733-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Lu, H., Wang, D., Li, Y., Li, J., Li, X., Kim, H., et al. (2019). Conet: A cognitive ocean network. IEEE Wirel. Commun. 26, 90–96. doi:10.1109/mwc.2019.1800325

CrossRef Full Text | Google Scholar

Lu, P., Xu, M., Sun, A., Wang, Z., and Zheng, Z. (2022). Typhoon tracks prediction with convlstm fused reanalysis data. Electronics 11, 3279. doi:10.3390/electronics11203279

CrossRef Full Text | Google Scholar

Luo, H., Wang, X., Xu, Z., Liu, C., and Pan, J.-S. (2022). A software-defined multi-modal wireless sensor network for ocean monitoring. Int. J. Distributed Sens. Netw. 18, 155014772110683. doi:10.1177/15501477211068389

CrossRef Full Text | Google Scholar

Ma, Z., and Jing, A. (2004). Dynamic interpolation and its application in data assimilation. J. Hebei Univ. Sci. Ed. 24, 574–580.

Google Scholar

Mahesh, A., Evans, M., Jain, G., Castillo, M., Lima, A., Lunghino, B., et al. (2019). “Forecasting el niño with convolutional and recurrent neural networks,” in 33rd Conference on Neural Information Processing Systems (NeurIPS 2019) (Vancouver: Canada), 8–14.

Google Scholar

Mandal, S., and Prabaharan, N. (2006). Ocean wave forecasting using recurrent neural networks. Ocean. Eng. 33, 1401–1410. doi:10.1016/j.oceaneng.2005.08.007

CrossRef Full Text | Google Scholar

Mekanik, F., and Imteaz, M. (2012). “Forecasting victorian spring rainfall using enso and iod: A comparison of linear multiple regression and nonlinear ann,” in 2012 2nd International Conference on Uncertainty Reasoning and Knowledge Engineering (IEEE), 86–89.

CrossRef Full Text | Google Scholar

Meng, F. (2022). Creating interpretable data-driven approaches for tropical cyclones forecasting.

CrossRef Full Text | Google Scholar

Meng, F., Song, T., Xu, D., Xie, P., and Li, Y. (2021a). Forecasting tropical cyclones wave height using bidirectional gated recurrent unit. Ocean. Eng. 234, 108795. doi:10.1016/j.oceaneng.2021.108795

CrossRef Full Text | Google Scholar

Meng, F., Xu, D., and Song, T. (2022). Atdnns: An adaptive time–frequency decomposition neural network-based system for tropical cyclone wave height real-time forecasting. Future Gener. Comput. Syst. 133, 297–306. doi:10.1016/j.future.2022.03.029

CrossRef Full Text | Google Scholar

Meng, Y., Rigall, E., Chen, X., Gao, F., Dong, J., and Chen, S. (2021b). Physics-guided generative adversarial networks for sea subsurface temperature prediction. IEEE Trans. Neural Netw. Learn. Syst., 1–14. doi:10.1109/tnnls.2021.3123968

CrossRef Full Text | Google Scholar

Miftahuddin, M. (2016). Modelling sea surface temperature using generalized additive models for location scale and shape by boosting with autocorrelation. Ph.D. thesis (Colchester: University of Essex).

Miyazawa, Y., Varlamov, S. M., Miyama, T., Guo, X., Hihara, T., Kiyomatsu, K., et al. (2017). Assimilation of high-resolution sea surface temperature data into an operational nowcast/forecast system around Japan using a multi-scale three-dimensional variational scheme. Ocean. Dyn. 67, 713–728. doi:10.1007/s10236-017-1056-1

CrossRef Full Text | Google Scholar

Na, L., Shaoyang, C., Zhenyan, C., Xing, W., Yun, X., Li, X., et al. (2022). Long-term prediction of sea surface chlorophyll-a concentration based on the combination of spatio-temporal features. Water Res. 211, 118040. doi:10.1016/j.watres.2022.118040

PubMed Abstract | CrossRef Full Text | Google Scholar

Nagi, A. S., Kumar, D., Sola, D., and Scott, K. A. (2021). Ruf: Effective sea ice floe segmentation using end-to-end res-unet-crf with dual loss. Remote Sens. 13, 2460. doi:10.3390/rs13132460

CrossRef Full Text | Google Scholar

Neshat, M., Nezhad, M. M., Sergiienko, N. Y., Mirjalili, S., Piras, G., and Garcia, D. A. (2022). Wave power forecasting using an effective decomposition-based convolutional bi-directional model with equilibrium Nelder-Mead optimiser. Energy 256, 124623. doi:10.1016/j.energy.2022.124623

CrossRef Full Text | Google Scholar

Nooteboom, P. D., Feng, Q. Y., López, C., Hernández-García, E., and Dijkstra, H. A. (2018). Using network theory and machine learning to predict el niño. Earth Syst. Dyn. 9, 969–983. doi:10.5194/esd-9-969-2018

CrossRef Full Text | Google Scholar

O’Donncha, F., Zhang, Y., Chen, B., and James, S. C. (2018). An integrated framework that combines machine learning and numerical models to improve wave-condition forecasts. J. Mar. Syst. 186, 29–36. doi:10.1016/j.jmarsys.2018.05.006

CrossRef Full Text | Google Scholar

Overpeck, J. T., Meehl, G. A., Bony, S., and Easterling, D. R. (2011). Climate data challenges in the 21st century. science 331, 700–702. doi:10.1126/science.1197869

PubMed Abstract | CrossRef Full Text | Google Scholar

Pan, X., Wang, J., Zhang, X., Mei, Y., Shi, L., and Zhong, G. (2018). A deep-learning model for the amplitude inversion of internal waves based on optical remote-sensing images. Int. J. Remote Sens. 39, 607–618. doi:10.1080/01431161.2017.1390269

CrossRef Full Text | Google Scholar

Panchi, N., Kim, E., and Bhattacharyya, A. (2021). Supplementing remote sensing of ice: Deep learning-based image segmentation system for automatic detection and localization of sea-ice formations from close-range optical images. IEEE Sensors J. 21, 18004–18019. doi:10.1109/jsen.2021.3084556

CrossRef Full Text | Google Scholar

Park, J., Kim, J.-H., Kim, H.-c., Kim, B.-K., Bae, D., Jo, Y.-H., et al. (2019). Reconstruction of ocean color data using machine learning techniques in polar regions: Focusing on off cape hallett, ross sea. Remote Sens. 11, 1366. doi:10.3390/rs11111366

CrossRef Full Text | Google Scholar

Pathak, J., Subramanian, S., Harrington, P., Raja, S., Chattopadhyay, A., Mardani, M., et al. (2022). Fourcastnet: A global data-driven high-resolution weather model using adaptive Fourier neural operators. arXiv preprint arXiv:2202.11214.

Google Scholar

Patil, K. R., and Iiyama, M. (2022a). Deep learning models to predict sea surface temperature in tohoku region. IEEE Access 10, 40410–40418. doi:10.1109/access.2022.3167176

CrossRef Full Text | Google Scholar

Patil, K. R., and Iiyama, M. (2022b). Deep learning models to predict sea surface temperature in tohoku region. IEEE Access 10, 40410–40418. doi:10.1109/ACCESS.2022.3167176

CrossRef Full Text | Google Scholar

Perkins, S. E., and Alexander, L. V. (2013). On the measurement of heat waves. J. Clim. 26, 4500–4517. doi:10.1175/jcli-d-12-00383.1

CrossRef Full Text | Google Scholar

Perkins-Kirkpatrick, S., and Gibson, P. (2017). Changes in regional heatwave characteristics as a function of increasing global temperature. Sci. Rep. 7, 1–12. doi:10.1038/s41598-017-12520-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Petrioli, C., Petroccia, R., Potter, J. R., and Spaccini, D. (2015). The sunset framework for simulation, emulation and at-sea testing of underwater wireless sensor networks. Ad Hoc Netw. 34, 224–238. doi:10.1016/j.adhoc.2014.08.012

CrossRef Full Text | Google Scholar

Ping, B., Su, F., and Meng, Y. (2016). An improved dineof algorithm for filling missing values in spatio-temporal sea surface temperature data. PLoS One 11, e0155928. doi:10.1371/journal.pone.0155928

PubMed Abstract | CrossRef Full Text | Google Scholar

Popinet, S., Smith, M., and Stevens, C. (2004). Experimental and numerical study of the turbulence characteristics of airflow around a research vessel. J. Atmos. Ocean. Technol. 21, 1575–1589. doi:10.1175/1520-0426(2004)021<1575:eansot>2.0.co;2

CrossRef Full Text | Google Scholar

Raizer, V. (2013). “Multisensor data fusion for advanced ocean remote sensing studies,” in 2013 IEEE International Geoscience and Remote Sensing Symposium-IGARSS (IEEE), 1622–1625.

CrossRef Full Text | Google Scholar

Rajabi-Kiasari, S., and Hasanlou, M. (2020). An efficient model for the prediction of smap sea surface salinity using machine learning approaches in the Persian gulf. Int. J. Remote Sens. 41, 3221–3242. doi:10.1080/01431161.2019.1701212

CrossRef Full Text | Google Scholar

Rasouli, K., Hsieh, W. W., and Cannon, A. J. (2012). Daily streamflow forecasting by machine learning methods with weather and climate inputs. J. Hydrology 414, 284–293. doi:10.1016/j.jhydrol.2011.10.039

CrossRef Full Text | Google Scholar

Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N., et al. (2019). Deep learning and process understanding for data-driven Earth system science. Nature 566, 195–204. doi:10.1038/s41586-019-0912-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Ren, J., Xu, N., and Cui, Y. (2022). Typhoon track prediction based on deep learning. Appl. Sci. 12, 8028. doi:10.3390/app12168028

CrossRef Full Text | Google Scholar

Ressel, R., Frost, A., and Lehner, S. (2015). A neural network-based classification for sea ice types on x-band sar images. IEEE J. Sel. Top. Appl. Earth Observations Remote Sens. 8, 3672–3680. doi:10.1109/jstars.2015.2436993

CrossRef Full Text | Google Scholar

Robinson, P. J. (2001). On the definition of a heat wave. J. Appl. Meteorology Climatol. 40, 762–775. doi:10.1175/1520-0450(2001)040<0762:otdoah>2.0.co;2

CrossRef Full Text | Google Scholar

Ropelewski, C. F., and Halpert, M. S. (1987). Global and regional scale precipitation patterns associated with the el niño/southern oscillation. Mon. weather Rev. 115, 1606–1626. doi:10.1175/1520-0493(1987)115<1606:garspp>2.0.co;2

CrossRef Full Text | Google Scholar

Röske, F. (1997). Sea level forecasts using neural networks. Dtsch. Hydrogr. Z. 49, 71–99. doi:10.1007/bf02765119

CrossRef Full Text | Google Scholar

Rosso, I., Mazloff, M. R., Talley, L. D., Purkey, S. G., Freeman, N. M., and Maze, G. (2020). Water mass and biogeochemical variability in the kerguelen sector of the southern ocean: A machine learning approach for a mixing hot spot. J. Geophys. Res. Oceans 125, e2019JC015877. doi:10.1029/2019jc015877

CrossRef Full Text | Google Scholar

Rostam, N. A. P., Malim, N. H. A. H., Abdullah, R., Ahmad, A. L., Ooi, B. S., and Chan, D. J. C. (2021). A complete proposed framework for coastal water quality monitoring system with algae predictive model. IEEE Access 9, 108249–108265. doi:10.1109/access.2021.3102044

CrossRef Full Text | Google Scholar

Sahoo, B., and Bhaskaran, P. K. (2019). Prediction of storm surge and coastal inundation using artificial neural network–a case study for 1999 odisha super cyclone. Weather Clim. Extrem. 23, 100196. doi:10.1016/j.wace.2019.100196

CrossRef Full Text | Google Scholar

Sanderson, M. G., Economou, T., Salmon, K. H., and Jones, S. E. (2017). Historical trends and variability in heat waves in the United Kingdom. Atmosphere 8, 191. doi:10.3390/atmos8100191

CrossRef Full Text | Google Scholar

Sari, A. P., Suzuki, H., Kitajima, T., Yasuno, T., Prasetya, D. A., and Rabi, A. (2020). “Prediction of wind speed and direction using encoding-forecasting network with convolutional long short-term memory,” in 2020 59th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE) (IEEE), 958–963.

Google Scholar

Saxena, B. K., Mishra, S., and Rao, K. V. S. (2021). Offshore wind speed forecasting at different heights by using ensemble empirical mode decomposition and deep learning models. Appl. Ocean Res. 117, 102937. doi:10.1016/j.apor.2021.102937

CrossRef Full Text | Google Scholar

Scheuchl, B., Cumming, I., and Hajnsek, I. (2005). Classification of fully polarimetric single-and dual-frequency sar data of sea ice using the wishart statistics. Can. J. Remote Sens. 31, 61–72. doi:10.5589/m04-060

CrossRef Full Text | Google Scholar

Schneider, R., Bonavita, M., Geer, A., Arcucci, R., Dueben, P., Vitolo, C., et al. (2022). Esa-ecmwf report on recent progress and research directions in machine learning for Earth system observation and prediction. npj Clim. Atmos. Sci. 5, 51–55. doi:10.1038/s41612-022-00269-z

CrossRef Full Text | Google Scholar

Schultz, M. G., Betancourt, C., Gong, B., Kleinert, F., Langguth, M., Leufen, L. H., et al. (2021). Can deep learning beat numerical weather prediction? Philosophical Trans. R. Soc. A 379, 20200097. doi:10.1098/rsta.2020.0097

CrossRef Full Text | Google Scholar

Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., and Woo, W.-c. (2015). Convolutional lstm network: A machine learning approach for precipitation nowcasting. Adv. neural Inf. Process. Syst. 28.

Google Scholar

Sinha, A., and Abernathey, R. (2021). Estimating ocean surface currents with machine learning. Front. Mar. Sci. 8, 672477. doi:10.3389/fmars.2021.672477

CrossRef Full Text | Google Scholar

Soares, C. G., and Cunha, C. (2000). Bivariate autoregressive models for the time series of significant wave height and mean period. Coast. Eng. 40, 297–311. doi:10.1016/s0378-3839(00)00015-6

CrossRef Full Text | Google Scholar

Soares, C. G., Ferreira, A., and Cunha, C. (1996). Linear models of the time series of significant wave height on the southwest coast of Portugal. Coast. Eng. 29, 149–167. doi:10.1016/s0378-3839(96)00022-1

CrossRef Full Text | Google Scholar

Soh, L.-K., and Tsatsoulis, C. (1999). Unsupervised segmentation of ers and radarsat sea ice images using multiresolution peak detection and aggregated population equalization. Int. J. Remote Sens. 20, 3087–3109. doi:10.1080/014311699211633

CrossRef Full Text | Google Scholar

Song, C., Chen, X., Xia, W., Ding, X., and Xu, C. (2022a). Application of a novel signal decomposition prediction model in minute sea level prediction. Ocean. Eng. 260, 111961. doi:10.1016/j.oceaneng.2022.111961

CrossRef Full Text | Google Scholar

Song, T., Han, N., Zhu, Y., Li, Z., Li, Y., Li, S., et al. (2021). Application of deep learning technique to the sea surface height prediction in the south China sea. Acta Oceanol. Sin. 40, 68–76. doi:10.1007/s13131-021-1735-0

CrossRef Full Text | Google Scholar

Song, T., Jiang, J., Li, W., and Xu, D. (2020a). A deep learning method with merged lstm neural networks for ssha prediction. IEEE J. Sel. Top. Appl. Earth Observations Remote Sens. 13, 2853–2860. doi:10.1109/jstars.2020.2998461

CrossRef Full Text | Google Scholar

Song, T., Li, Y., Meng, F., Xie, P., and Xu, D. (2022b). A novel deep learning model by bigru with attention mechanism for tropical cyclone track prediction in the northwest Pacific. J. Appl. Meteorology Climatol. 61, 3–12.

Google Scholar

Song, T., Wang, Z., Xie, P., Han, N., Jiang, J., and Xu, D. (2020b). A novel dual path gated recurrent unit model for sea surface salinity prediction. J. Atmos. Ocean. Technol. 37, 317–325. doi:10.1175/jtech-d-19-0168.1

CrossRef Full Text | Google Scholar

Song, T., Wei, W., Meng, F., Wang, J., Han, R., and Xu, D. (2022c). Inversion of ocean subsurface temperature and salinity fields based on spatio-temporal correlation. Remote Sens. 14, 2587. doi:10.3390/rs14112587

CrossRef Full Text | Google Scholar

Sonnewald, M., Lguensat, R., Jones, D. C., Dueben, P., Brajard, J., and Balaji, V. (2021). Bridging observations, theory and numerical simulation of the ocean using machine learning. Environ. Res. Lett. 16, 073008. doi:10.1088/1748-9326/ac0eb0

CrossRef Full Text | Google Scholar

Spector, L. (2006). Evolution of artificial intelligence. Artif. Intell. 170, 1251–1253. doi:10.1016/j.artint.2006.10.009

CrossRef Full Text | Google Scholar

Srisuksomwong, P., and Hammachukiattikul, P. (2022). “The chlorophyll-a modelling over the andaman sea using bi-directional lstm neural network,” in 2022 37th International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC) (IEEE), 955–958.

CrossRef Full Text | Google Scholar

Stewart, R., and Ermon, S. (2017). “Label-free supervision of neural networks with physics and domain knowledge,” in Thirty-First AAAI Conference on Artificial Intelligence.

CrossRef Full Text | Google Scholar

Stewart, R. H. (1988). Seasat: Results of the mission. Bull. Am. Meteorological Soc. 69, 1441–1447. doi:10.1175/1520-0477(1988)069<1441:srotm>2.0.co;2

CrossRef Full Text | Google Scholar

Su, H., Lu, X., Chen, Z., Zhang, H., Lu, W., and Wu, W. (2021). Estimating coastal chlorophyll-a concentration from time-series olci data based on machine learning. Remote Sens. 13, 576. doi:10.3390/rs13040576

CrossRef Full Text | Google Scholar

Sukanda, A. J. T., and Adytia, D. (2022). “Wave forecast using bidirectional gru and gru method case study in pangandaran, Indonesia,” in 2022 International Conference on Data Science and Its Applications (ICoDSA) (IEEE), 278–282.

Google Scholar

Sun, M., Yu, F., Chongjing, L., and Jiang, X. (2018). Deep learning application in marine big data mining. Sci. Technol. Rev. 36, 83–90.

Google Scholar

Syeed, M. M. A., Farzana, M., Namir, I., Ishrar, I., Nushra, M. H., and Rahman, T. (2022). “Flood prediction using machine learning models,” in 2022 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA) (IEEE), 1–6.

CrossRef Full Text | Google Scholar

Tan, W., Li, J., Xu, L., and Chapman, M. A. (2018). Semiautomated segmentation of sentinel-1 sar imagery for mapping sea ice in labrador coast. IEEE J. Sel. Top. Appl. Earth Observations Remote Sens. 11, 1419–1432. doi:10.1109/jstars.2018.2806640

CrossRef Full Text | Google Scholar

Vasavi, S., Divya, C., and Sarma, A. S. (2021). Detection of solitary ocean internal waves from sar images by using u-net and kdv solver technique. Glob. Transitions Proc. 2, 145–151. doi:10.1016/j.gltp.2021.08.063

CrossRef Full Text | Google Scholar

Wang, C., Lu, J., Ding, X., Jiang, C., Yang, J., and Shen, J. (2021). Design, modeling, control, and experiments for a fish-robot-based iot platform to enable smart ocean. IEEE Internet Things J. 8, 9317–9329. doi:10.1109/jiot.2021.3055953

CrossRef Full Text | Google Scholar

Wang, G., Wang, X., Wu, X., Liu, K., Qi, Y., Sun, C., et al. (2022a). A hybrid multivariate deep learning network for multistep ahead sea level anomaly forecasting. J. Atmos. Ocean. Technol. 39, 285–301. doi:10.1175/jtech-d-21-0043.1

CrossRef Full Text | Google Scholar

Wang, L., Li, W., Wang, X., Xu, J., Zhao, Z., Yu, J., et al. (2022b). Remote sensing image prediction of water environment based on 3d cnn and convlstm.

Google Scholar

Wang, R., Kashinath, K., Mustafa, M., Albert, A., and Yu, R. (2020). Towards physics-informed deep learning for turbulent flow prediction. Proc. 26th ACM SIGKDD Int. Conf. Knowl. Discov. Data Min., 1457–1466.

CrossRef Full Text | Google Scholar

Wang, W., Tang, R., Li, C., Liu, P., and Luo, L. (2018). A bp neural network model optimized by mind evolutionary algorithm for predicting the ocean wave heights. Ocean. Eng. 162, 98–107. doi:10.1016/j.oceaneng.2018.04.039

CrossRef Full Text | Google Scholar

Wang, Y.-R., and Li, X.-M. (2021). Arctic sea ice cover data from spaceborne synthetic aperture radar by deep learning. Earth Syst. Sci. Data 13, 2723–2742. doi:10.5194/essd-13-2723-2021

CrossRef Full Text | Google Scholar

Wei, C.-C., and Chang, H.-C. (2021). Forecasting of typhoon-induced wind-wave by using convolutional deep learning on fused data of remote sensing and ground measurements. Sensors 21, 5234. doi:10.3390/s21155234

PubMed Abstract | CrossRef Full Text | Google Scholar

Wolter, K., and Timlin, M. S. (2011). El niño/southern oscillation behaviour since 1871 as diagnosed in an extended multivariate enso index (mei. ext). Int. J. Climatol. 31, 1074–1087. doi:10.1002/joc.2336

CrossRef Full Text | Google Scholar

Wöppelmann, G., Zerbini, S., and Marcos, M. (2006). Tide gauges and geodesy: A secular synergy illustrated by three present-day case studies. Comptes Rendus Geosci. 338, 980–991. doi:10.1016/j.crte.2006.07.006

CrossRef Full Text | Google Scholar

Wu, J.-L., Kashinath, K., Albert, A., Chirila, D., Prabhat, , and Xiao, H. (2020a). Enforcing statistical constraints in generative adversarial networks for modeling chaotic dynamical systems. J. Comput. Phys. 406, 109209. doi:10.1016/j.jcp.2019.109209

PubMed Abstract | CrossRef Full Text | Google Scholar

Wu, M., Stefanakos, C., and Gao, Z. (2020b). Multi-step-ahead forecasting of wave conditions based on a physics-based machine learning (pbml) model for marine operations. J. Mar. Sci. Eng. 8, 992. doi:10.3390/jmse8120992

CrossRef Full Text | Google Scholar

Wu, Z., Jiang, C., Conde, M., Deng, B., and Chen, J. (2019). Hybrid improved empirical mode decomposition and bp neural network model for the prediction of sea surface temperature. Ocean Sci. 15, 349–360. doi:10.5194/os-15-349-2019

CrossRef Full Text | Google Scholar

Wunsch, C., and Stammer, D. (1997). Atmospheric loading and the oceanic “inverted barometer” effect. Rev. Geophys. 35, 79–107. doi:10.1029/96rg03037

CrossRef Full Text | Google Scholar

Xiao, C., Chen, N., Hu, C., Wang, K., Xu, Z., Cai, Y., et al. (2019). A spatiotemporal deep learning model for sea surface temperature field prediction using time-series satellite data. Environ. Model. Softw. 120, 104502. doi:10.1016/j.envsoft.2019.104502

CrossRef Full Text | Google Scholar

Xu, G., Xian, D., Fournier-Viger, P., Li, X., Ye, Y., and Hu, X. (2022). Am-Convgru: A spatio-temporal model for typhoon path prediction. Neural Comput. Appl. 34, 5905–5921. doi:10.1007/s00521-021-06724-x

CrossRef Full Text | Google Scholar

Yang, S., Li, Z., Yu, J.-Y., Hu, X., Dong, W., and He, S. (2018). El niño–southern oscillation and its impact in the changing climate. Natl. Sci. Rev. 5, 840–857. doi:10.1093/nsr/nwy046

CrossRef Full Text | Google Scholar

Yang, Y., Dong, J., Sun, X., Lima, E., Mu, Q., and Wang, X. (2017). A cfcc-lstm model for sea surface temperature prediction. IEEE Geoscience Remote Sens. Lett. 15, 207–211. doi:10.1109/lgrs.2017.2780843

CrossRef Full Text | Google Scholar

Ye, M., Nie, J., Liu, A., Wang, Z., Huang, L., Tian, H., et al. (2021). Multi-year enso forecasts using parallel convolutional neural networks with heterogeneous architecture. Front. Mar. Sci. 8, 1092. doi:10.3389/fmars.2021.717184

CrossRef Full Text | Google Scholar

Yoerger, D. R., Govindarajan, A. F., Howland, J. C., Llopiz, J. K., Wiebe, P. H., Curran, M., et al. (2021). A hybrid underwater robot for multidisciplinary investigation of the ocean twilight zone. Sci. Robotics 6, eabe1901. doi:10.1126/scirobotics.abe1901

PubMed Abstract | CrossRef Full Text | Google Scholar

You, Q., Jiang, Z., Kong, L., Wu, Z., Bao, Y., Kang, S., et al. (2017). A comparison of heat wave climatologies and trends in China based on multiple definitions. Clim. Dyn. 48, 3975–3989. doi:10.1007/s00382-016-3315-0

CrossRef Full Text | Google Scholar

Yu, X. (2021). Research on marine environment big data forecasting method based on data-driven relationship dependence. Ph.D. thesis (Shanghai: Shanghai University).

Yuan, Q., Shen, H., Li, T., Li, Z., Li, S., Jiang, Y., et al. (2020). Deep learning in environmental remote sensing: Achievements and challenges. Remote Sens. Environ. 241, 111716. doi:10.1016/j.rse.2020.111716

CrossRef Full Text | Google Scholar

Zakhvatkina, N., Korosov, A., Muckenhuber, S., Sandven, S., and Babiker, M. (2017). Operational algorithm for ice–water classification on dual-polarized radarsat-2 images. Cryosphere 11, 33–46. doi:10.5194/tc-11-33-2017

CrossRef Full Text | Google Scholar

Zhang, Q., Wang, H., Dong, J., Zhong, G., and Sun, X. (2017). Prediction of sea surface temperature using long short-term memory. IEEE geoscience remote Sens. Lett. 14, 1745–1749. doi:10.1109/lgrs.2017.2733548

CrossRef Full Text | Google Scholar

Zhang, T., Yang, Y., Shokr, M., Mi, C., Li, X.-M., Cheng, X., et al. (2021). Deep learning based sea ice classification with gaofen-3 fully polarimetric sar data. Remote Sens. 13, 1452. doi:10.3390/rs13081452

CrossRef Full Text | Google Scholar

Zhang, W., Leung, Y., and Chan, J. C. (2013). The analysis of tropical cyclone tracks in the Western north Pacific through data mining. part i: Tropical cyclone recurvature. J. Appl. meteorology Climatol. 52, 1394–1416. doi:10.1175/jamc-d-12-045.1

CrossRef Full Text | Google Scholar

Zhang, X., Han, Z., Zhou, W., and Wu, Y. (2020). Survey of smart ocean technology. Remote Sens. Inf. 35, 1–7.

Google Scholar

Zhang, X., Wang, H., Wang, S., Liu, Y., Yu, W., Wang, J., et al. (2022). Oceanic internal wave amplitude retrieval from satellite images based on a data-driven transfer learning model. Remote Sens. Environ. 272, 112940. doi:10.1016/j.rse.2022.112940

CrossRef Full Text | Google Scholar

Zheng, Y.-g., Qi, K.-t., and Zhang, H.-s. (2022). Stripe segmentation of oceanic internal waves in synthetic aperture radar images based on mask r-cnn. Geocarto Int. 1–15, 1–15. doi:10.1080/10106049.2022.2088860

PubMed Abstract | CrossRef Full Text | Google Scholar

Zheng, Y.-g., Zhang, H.-s., Qi, K.-t., and Ding, L.-y. (2021a). Stripe segmentation of oceanic internal waves in sar images based on segnet. Geocarto Int. 1–12, 1–12. doi:10.1080/10106049.2021.2002430

PubMed Abstract | CrossRef Full Text | Google Scholar

Zheng, Y.-g., Zhang, H.-s., and Wang, Y.-Q. (2021b). Stripe detection and recognition of oceanic internal waves from synthetic aperture radar based on support vector machine and feature fusion. Int. J. Remote Sens. 42, 6706–6724. doi:10.1080/01431161.2021.1943040

CrossRef Full Text | Google Scholar

Zhou, S., Xie, W., Lu, Y., Wang, Y., Zhou, Y., Hui, N., et al. (2021). Convlstm-based wave forecasts in the south and east China seas. Front. Mar. Sci. 8, 740. doi:10.3389/fmars.2021.680079

CrossRef Full Text | Google Scholar

Zulfa, I. I., Novitasari, D. C. R., Setiawan, F., Fanani, A., and Hafiyusholeh, M. (2021). Prediction of sea surface current velocity and direction using lstm. IJEIS (Indonesian J. Electron. Instrum. Syst. 11, 93–102. doi:10.22146/ijeis.63669

CrossRef Full Text | Google Scholar

Keywords: artificial intelligence, marine science, ocean observation, ocean element forecasting, ocean phenomena

Citation: Song T, Pang C, Hou B, Xu G, Xue J, Sun H and Meng F (2023) A review of artificial intelligence in marine science. Front. Earth Sci. 11:1090185. doi: 10.3389/feart.2023.1090185

Received: 05 November 2022; Accepted: 19 January 2023;
Published: 16 February 2023.

Edited by:

Huayang Cai, Sun Yat-sen University, China

Reviewed by:

Haidong Pan, Ministry of Natural Resources, China
Zhongya Cai, University of Macau, China

Copyright © 2023 Song, Pang, Hou, Xu, Xue, Sun and Meng. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Fan Meng, vanmeng@163.com

These authors have contributed equally to this work

Download