Advancing autonomy through lifelong learning: a survey of autonomous intelligent systems
Dekang Zhu1 
Zhongpan Zhu- 1College of Electronic and Information Engineering, Tongji University, Shanghai, China
- 2College of Science and Engineering, University of Glasgow, Glasgow, United Kingdom
- 3College of Mechanical Engineering, University of Shanghai for Science and Technology, Shanghai, China
The combination of lifelong learning algorithms with autonomous intelligent systems (AIS) is gaining popularity due to its ability to enhance AIS performance, but the existing summaries in related fields are insufficient. Therefore, it is necessary to systematically analyze the research on lifelong learning algorithms with autonomous intelligent systems, aiming to gain a better understanding of the current progress in this field. This paper presents a thorough review and analysis of the relevant work on the integration of lifelong learning algorithms and autonomous intelligent systems. Specifically, we investigate the diverse applications of lifelong learning algorithms in AIS’s domains such as autonomous driving, anomaly detection, robots, and emergency management, while assessing their impact on enhancing AIS performance and reliability. The challenging problems encountered in lifelong learning for AIS are summarized based on a profound understanding in literature review. The advanced and innovative development of lifelong learning algorithms for autonomous intelligent systems are discussed for offering valuable insights and guidance to researchers in this rapidly evolving field.
1 Introduction
Autonomous intelligent systems (AIS), including intelligent robots, autonomous vehicles, and similar technologies, have emerged as a frontier direction in the field of artificial intelligence. These systems possess the ability to interact with humans and the environment, enabling them to execute tasks such as perception, planning, decision-making, and control. With the advancement of artificial intelligence, the algorithms employed by AIS for different tasks have transitioned from being model-driven to data-driven approaches. End-to-end AI algorithms based on deep learning, reinforcement learning, and other techniques have gained significant research attention.
However, as the data-driven algorithms rely on the type, scale, and quality of training data, the coherence, generality, and adaptability of the algorithms across different tasks and environments are great challenges. The challenge for AIS concerned in this paper is the ability to remember previous tasks when learning new ones, known as catastrophic forgetting (Shi et al., 2021). Catastrophic forgetting refers to the phenomenon where a neural network loses previously learned information after training on subsequent tasks, resulting in a drastic performance drop on previous tasks (Serra et al., 2018). Therefore, it is crucial to improve the capability of AIS for lifelong learning, which aims to enhance knowledge retention and transfer, thereby addressing the problem of catastrophic forgetting.
Lifelong learning algorithms have made significant progress in dealing with the core problems faced by AIS and mitigating the impact of catastrophic forgetting. Lifelong learning algorithms aim to sequentially acquire proficiency in multiple tasks while pursuing two primary objectives: ensuring that the acquisition of new tasks does not lead to catastrophic forgetting of previously learned knowledge (Zhou and Cao, 2021a), and leveraging prior task knowledge to facilitate the acquisition of novel tasks. Despite numerous achievements in lifelong learning in recent years, there are still evident shortcomings. Firstly, lifelong learning still heavily relies on labeling, which can be costly, troublesome, prone to errors, and impractical for providing persistent human labeling for all future tasks (He et al., 2021). Secondly, adapting to drift in adaptation spaces poses a challenge for lifelong learning. Drift in adaptation spaces arises from uncertainties that impact the quality properties of adaptation options, potentially leading to no adaptation option satisfying the initial set of adaptation goals, thereby damaging system quality (Gheibi and Weyns, 2023). Additionally, the big data problem presents another major challenge. AIS with lifelong learning algorithms must handle the continuous influx of changing data and adapt to learning problems effectively (Yang, 2013).
In this paper, we aim to provide a comprehensive overview of lifelong learning algorithms for autonomous intelligent systems, covering the recent development, related applications, and existing challenges that need to be addressed. Furthermore, we will discuss the future outlook of lifelong learning with autonomous intelligent systems. The main contributions of this paper are as follows:
1. The thoroughly review and analysis of AIS and lifelong learning, along with the rationale for combining these two fields, are introduced.
2. Relevant applications of lifelong learning algorithms with AIS are presented to showcase their significant role in different industry applications.
3. Remaining problems are analyzed, and academic insights into the future trends of AIS Lifelong learning are expounded.
The rest of the paper is organized as follows. Section II elucidates the background information on the emergence and historical milestones of AIS and lifelong learning. Section III presents various applications of lifelong learning algorithms with AIS, highlighting the research status and latest progress. In Section IV, A comprehensive review of issues and challenges in lifelong learning for AIS and the outlook and future trends are discussed. Finally, the main conclusions are given in Section V.
2 The developing lifelong learning and autonomous intelligent systems
2.1 Autonomous intelligent systems
In recent decades, remarkable progress has been made in the development of unmanned systems, ranging from robots to unmanned aerial vehicles (UAVs), unmanned ground vehicles (UGVs), and unmanned marine vehicles (UMVs). What once were programming-based systems have now transformed into automatic unmanned systems and are further advancing toward autonomous intelligent systems (AIS). AIS represents the forefront of artificial intelligence development, characterized by exceptional levels of autonomy and intelligence. By harnessing advanced technologies such as artificial intelligence (AI), big data, and robotics, AIS enables the execution of complex tasks and adaptive decision-making. This section explores the potential applications of AIS across various domains.
2.1.1 Intelligent transportation and autonomous driving
The development of the automobile industry has driven an increased demand for safety and stability in modern transportation. As a result, autonomous driving technology has gained significant traction and is being widely deployed in the market (Xiao, 2022). This technology is revolutionizing intelligent transportation and smart city systems by enhancing the efficiency and safety of transportation networks. It’s worth noting that although autonomous driving has recently garnered more attention, the concept of autonomous vehicles dates back several decades, with various activities in this field taking place even further in the past (Khan, 2022).
The first autonomous car was introduced by Tsugawa at the Mechanical Engineering Laboratory in Tsukuba, Japan in the 1970s (OM Group of Companies, 2020). Subsequently, there have been numerous developments and initiatives worldwide. Notably, Ernst Dickmann’s vision guided Mercedes Benz in 1980 to achieve speeds of up to 39mph in a controlled environment (Delcker, 2020). With the integration of autonomous driving algorithms, vehicles possess self-navigating capabilities, real-time traffic monitoring, and adaptive route planning based on changing environmental conditions. Furthermore, autonomous driving vehicle enables the efficient management of traffic, congestion control, and the integration of advanced communication and information technologies, thereby facilitating intelligent infrastructure.
However, the utilization of autonomous driving faces significant challenges in complex traffic environments characterized by dynamic and variable scenarios. A key issue lies in perception algorithms encountering the long-tail problem, where rare or unforeseen events pose difficulties for standard algorithms to handle. This challenge becomes even more pronounced in mixed traffic scenarios involving both human-driven and autonomous vehicles. In such settings, algorithms must continually iterate and improve to adapt to the varying and unpredictable nature of the environment (Zhu et al., 2021; Zhou et al., 2022; Li et al., 2023). Therefore, lifelong learning is critical for the development of reliable and safe autonomous systems capable of operating effectively in real-world environments.
2.1.2 Medical healthcare and service robotics
Service robots are typical AIS designed to assist humans, enhancing customer experiences across various industries such as hospitality, logistics, retail, and healthcare (Rajan and Cruz, 2022). With the advancements in AI and IoT technologies, service robots are continuously evolving and becoming more intelligent (Pan et al., 2010). The integration of healthcare and service robotics holds immense promise for improving patient care and enhancing efficiency. Intelligent service robots have the capability to assist in a range of tasks, including patient monitoring, medication dispensing, and patient support, thereby relieving healthcare professionals from repetitive and time-consuming responsibilities. Additionally, intelligent service robots can analyze medical data, provide personalized treatment recommendations, and contribute to remote healthcare services, leading to improved accessibility and quality of care. By leveraging the power of AIS, service robots in healthcare settings can not only streamline processes but also contribute to better patient outcomes. They serve as valuable tools in alleviating the burden on healthcare professionals, enabling them to focus on more complex and critical aspects of patient care. Moreover, AIS-driven analysis of medical data helps generate valuable insights that can inform decision-making and improve treatment strategies (Qu et al., 2021).
However, the integration of intelligent service robots in the field of healthcare also presents certain challenges. One significant challenge is ensuring the safety and reliability of these robots in critical medical environments. As they interact closely with patients, it is essential to address concerns regarding privacy, data security, and potential errors in their operations. Additionally, there is a need for standardized regulations and guidelines to govern the use of service robots in healthcare settings.
Moreover, the complexity and diversity of healthcare scenarios pose challenges for intelligent service robots. Medical environments can be unpredictable, requiring robots to adapt to various situations, handle unexpected events, and effectively communicate with both patients and healthcare professionals. Achieving seamless human-robot interaction and maintaining an appropriate balance between automation and human intervention is crucial in providing high-quality and patient-centric care.
2.1.3 Urban security and UAV
UAV has garnered considerable attention in various military and civilian applications due to their improved stability and endurance (Mohsan et al., 2022). Over the past decade, UAVs have been employed in a wide range of fields, including target detection and tracking, public safety, traffic monitoring, military operations, hazardous area exploration, indoor and outdoor navigation, atmospheric sensing, post-disaster operations, health care, data-sharing, infrastructure management, emergency and crisis management, freight transport, wildfire monitoring and logistics (Hassija et al., 2019). For example, DARPA’s “Collaborative Operations in Denied Environment” (CODE) program seeks to enhance the mission capabilities of unmanned aerial vehicles (UAVs) by increasing autonomy and inter-platform collaboration. The United States military has integrated autonomous intelligent unmanned systems into combat through the Project Maven initiative, which employs artificial intelligence algorithms to identify relevant targets in Iraq and Syria. In the domain of urban security, UAV plays a critical role by leveraging AIS’s advanced surveillance and analytical capabilities. These intelligent drones enable efficient monitoring of public spaces, early detection of potential threats, and prompt response to emergencies. Moreover, AIS-driven drones enhance search and rescue operations, disaster management, and protection of critical infrastructure while minimizing human risk.
However, several crucial factors hinder the performance of UAVs in urban security. These factors include diverse scenes, stringent man–machine safety requirements, limited availability of training data, and small sample sizes (Carrio et al., 2017; Teixeira et al., 2023). Addressing these challenges is essential to ensure the optimal functioning of UAVs in urban security scenarios. Efforts should be made to develop robust and adaptable AI algorithms that can handle diverse environmental conditions encountered in urban settings. Additionally, ensuring the safety of UAV operations requires stringent regulations and standards for both hardware and software components. Acquiring more extensive and representative training datasets is also necessary to improve the accuracy and reliability of AI models used in UAV systems. Lastly, efforts should be made to address the limitations posed by small sample sizes by leveraging transfer learning techniques and collaborative data sharing initiatives.
2.1.4 Ocean exploration and UMV
AIS contributes significantly to ocean exploration and research through the development of UMV equipped with advanced sensing and navigation capabilities. UMVs integrated with AI algorithms can be used for tasks such as scientific exploration, hydrological surveys, emergency search and rescue, and security patrols (Kingston et al., 2008; Wang et al., 2016). The Monterey Bay Aquarium Research Institute (MBARI) has significantly reduced the human resources required for data analysis by 81% and simultaneously increased the labeling rate tenfold through its Ocean Vision AI program, which trains a vast underwater image database. The autonomous underwater robot, CUREE, developed in collaboration with WHOI, can autonomously track and monitor marine animals, facilitating effective marine management. These wide-ranging applications have contributed to the development of motion control techniques and have produced many interesting results in the literature, such as heading control (Kahveci and Ioannou, 2013), trajectory tracking control (Katayama and Aoki, 2014; Ding et al., 2017), formation control (Li et al., 2018; Liao et al., 2024), and path-following problems (Shen et al., 2019).
The ocean environment presents complex and variable challenges that demand adaptive capabilities from UMV. In the deep-sea environment, UMV encounter various challenges, including changes in underwater terrain, marine biodiversity, and ocean currents. These changes can result in variations in sensor data and diverse appearances of targets. By employing lifelong learning algorithms, unmanned systems can adapt and learn in real-time, enhancing their performance and robustness (Wibisono et al., 2023). Furthermore, deep-sea environments pose limitations in communication bandwidth, latency, and mission execution times. Traditional machine learning algorithms often struggle to adapt to new environments and tasks, as they are typically trained for specific purposes. Lifelong learning algorithms offer a solution by reducing reliance on external resources and human intervention. UMV equipped with these algorithms can autonomously learn and make decisions, increasing their independence and reliability (Wang et al., 2019).
2.1.5 Deep space exploration and spacecraft
Intelligent or autonomous control of an unmanned spacecraft is a promising technology (Soeder et al., 2014). And the ground-based mission control center will no longer be able to help the astronauts diagnose and fix spacecraft issues in real-time due to the longer connection durations associated with deep space exploration, using lifelong learning algorithms, unmanned systems can accumulate experience and knowledge during task execution and reduce reliance on frequent interactions and updates, enhancing their autonomy and adaptability (Jeremy and et.al, 2013). Also, the deep space environment is extremely complex and full of unknown and uncertain factors, such as the landform of the planet’s surface, the relationship between celestial bodies, and the atmosphere of the planet. Traditional machine learning algorithms are difficult to pre-train to adapt to all possible situations. Lifelong learning algorithms enable unmanned systems to constantly learn and adapt to new environments and tasks as they explore (Bird et al., 2020). What is more, in deep space exploration missions, unmanned systems typically need to process huge data streams from various sensors and extract useful information from them. Lifelong learning algorithms can help systems automatically discover and learn new features and patterns, thereby improving their perception and understanding (Choudhary et al., 2022). As a result, each vehicle core subsystem will contain inbuilt intelligence to allow autonomous operation for both normal and emergency operations including defect identification and remediation. This extends previous work on creating an autonomous power control (Soeder et al., 2014) which involves the development of control architectures for deep space vehicles (Dever et al., 2014; May et al., 2014) and using software agents (May and Loparo, 2014). As a result, the application of AIS in deep space exploration and spacecraft missions opens up new frontiers for scientific discovery. Intelligent spacecraft equipped with AIS can autonomously navigate, perform complex maneuvers, and adapt to dynamic space environments. Advanced AI-based algorithms enable real-time analysis of vast amounts of space data, autonomous targeting, and intelligent resource allocation, facilitating enhanced mission efficiency and enabling breakthrough discoveries.
In conclusion, the development of unmanned systems has evolved from programming-based to AIS. AIS leverages advanced technologies such as AI, big data, and robotics to enable complex tasks and adaptive decision-making. Across domains including intelligent transportation, healthcare, urban security, ocean exploration, and space missions, AIS demonstrates immense potential for revolutionizing various industries and pushing the boundaries of technological advancements. However, Autonomous intelligent systems require continuous learning to enable their applications in various domains. With the advancements in technologies such as deep learning, reinforcement learning, and large-scale AI models like AIGC (Artificial Intelligence General Cognitive), AISs are moving toward achieving general task learning and lifelong evolution. Establishing a lifelong learning paradigm is crucial for the future development of these autonomous systems. Embracing this paradigm will pave the way for remarkable advancements in the field of autonomous intelligent systems.
Besides the technical perspective, there are actually other angles people should take into consideration to enrich and improve the connotation of autonomous intelligent systems. For one thing, the ethical and social perspective cannot be ignored. Ethically and socially, the deployment of autonomous intelligence systems raises significant questions around accountability, privacy, job displacement, and fairness. The decision-making processes of AIS need to be transparent, explainable, and align with societal values to ensure trust and acceptance. Addressing these concerns involves interdisciplinary research, incorporating insights from ethics, law, and social sciences into the development and governance of AIS. For another thing, autonomous intelligent systems are also closely linked to the Sustainable Development Goals. They have the potential to help address global challenges in environmental protection, health, education and more, such as protecting the environment through intelligent monitoring and management of resources, or improving the quality and accessibility of education through personalized education systems. However, this also requires environmental impact, resource consumption and long-term sustainability to be taken into account when designing and applying autonomous intelligent systems.
2.2 Lifelong learning
Lifelong learning, alternatively known as continuous learning or incremental learning, traces its roots back to the mid-20th century. Early computer scientists and artificial intelligence researchers contemplated ways to enable computer systems to continuously learn and adapt to new knowledge. The adage “one is never too old to learn” holds true and applies equally to AIS.
In 1957, Frank Rosenblatt’s perceptron emerged as an early neural network model that introduced the idea of machines improving their ideas and performance gradually through repeated training (Block et al., 1962). The era of artificial intelligence algorithms based on neural networks was begun. But for a long time, neural networks could not handle multiple tasks, nor could they handle dynamic tasks of time series. During the 1990s, the concept and research of transfer learning started to develop, positively influencing the notion of lifelong learning. Transfer learning focused on leveraging previously acquired knowledge for new tasks (Pan et al., 2010). In the 2000s, incremental learning began to emerge in lifelong learning research, enabling AI systems to learn new tasks without sacrificing previously acquired knowledge (Zhou et al., 2022). This approach helps in continuously improving the AI system’s performance, adapting to changes in the data distribution, and avoiding catastrophic forgetting. Incremental learning is particularly useful in dynamic environments where new data arrives regularly and the model needs to be continuously updated to maintain its accuracy and relevance. In our dynamically changing world, where new classes appear frequently, fresh users in the authentication system and a machine learning model ought to identify new classes while not forgetting the memory of previous ones (Zhou et al., 2022). If the dataset of old classes is no longer available, directly fine-tuning a deployed model with new classes might bring about the so-called catastrophic forgetting problem in which information about past classes is quickly forgotten (Hinton et al., 2015; Kirkpatrick et al., 2017; Shin et al., 2017). Hence, incremental learning, a framework that enables online learning without forgetting, has been actively investigated (Kang et al., 2022). From the 2000s to 2020s, Researchers have proposed various incremental learning algorithms and techniques to address the challenges associated with learning from evolving data. These algorithms focus on updating the model efficiently (Lv et al., 2019; Tian et al., 2019; Zhao et al., 2021; Ding et al., 2024), handling concept drift (Schwarzerova and Bajger, 2021), managing memory constraints (Smith et al., 2021), and balancing stability and plasticity in the learned knowledge (Wu et al., 2021; Lin et al., 2022; Kim and Han, 2023). Additionally, incremental learning has been explored in different domains, including image classification (Meng et al., 2022; Nguyen et al., 2022; Zhao et al., 2022), natural language processing (Jan Moolman Buys University College University of Oxford, 2017; Kahardipraja et al., 2023), recommender systems (Ouyang et al., 2021; Wang et al., 2021; Ahrabian et al., 2021a), and data stream mining (Eisa et al., 2022). Researchers have investigated different strategies such as incremental decision trees (Barddal and Fabr’ıcio Enembreck., 2020; Choyon et al., 2020; Han et al., 2023), online clustering (Bansiwala et al., 2021), ensemble methods (Lovinger and Valova, 2020; Zhang J. et al., 2023), and deep learning approaches to tackle incremental learning problems (Ali et al., 2022). Incremental learning enables lifelong learning to constantly learn new data new data while leveraging prior knowledge that continues to be an active research topic (Figure 1).
Figure 1. The history of the development of lifelong learning.
Lifelong learning plays a crucial role in enhancing the performance of Artificial Intelligence Systems (AIS) due to its powerful capabilities. It enables AIS to continuously update their knowledge and skills, allowing them to effectively handle consecutive tasks in dynamic and evolving environments.
There are three main research methods used in lifelong learning:
• Regularization-based Approach: This method consolidates past knowledge by incorporating additional loss terms that reduce the rate of learning for important weights used in previously learned tasks. By doing so, it minimizes the risk of new task information significantly altering the previously acquired weights (Shaheen et al., 2022). An example of this approach is Elastic Weight Consolidation (EWC), which penalizes weight changes based on task importance, regularizing model parameters and preventing catastrophic forgetting of previous experiences (Febrinanto et al., 2022).
• Rehearsal-based Approach: This method focuses on preserving knowledge by leveraging generative models to replay tasks whenever the model is modified or by storing samples from previously learned tasks in a memory buffer (Faber et al., 2023). One notable approach is Prototype Augmentation and Self-Supervision for Incremental Learning (PASS) (Zhu et al., 2021).
• Model-based Approach: To prevent forgetting, models can be expanded to improve performance, or different models can be assigned to each task. Examples of this approach include Packnet (Mallya and Lazebnik, 2018a) and Dynamically Expandable Representation for Class Incremental Learning (DER) (Yan et al., 2021).
These research methods offer distinct strategies for addressing the challenges associated with lifelong learning in the context of handling consecutive tasks in dynamic and evolving environments. The choice of the most suitable approach depends on specific requirements and circumstances. Ongoing research in the field of lifelong learning continues to explore innovative techniques and approaches to further enhance the performance and adaptability of AIS.
However, the combination of lifelong learning and autonomous intelligent systems poses several challenges due to perceptual cognitive algorithms (Nicolas, 2018; Hadsell et al., 2020), varying tasks (Kirkpatrick et al., 2017; Aljundi et al., 2021), changing environments (Zenke et al., 2017a), and limitations in computing chips (Mallya and Lazebnik, 2018b), control systems (Kober et al., 2013; Andrei et al., 2017), and the diverse range of system types (Kemker and Kanan, 2017; Parisi et al., 2017). Currently, research on this integration is insufficient, and numerous difficulties remain to be addressed. Among these challenges, catastrophic forgetting is a prominent problem wherein previously learned tasks may be forgotten when AIS learns new ones. Consequently, solving this problem holds immense significance and remains a core objective of lifelong learning.
There are three main dimensions to handle catastrophic forgetting:
2.2.1 Knowledge retention
If there is only one model continuously learning different tasks, we naturally expect it not to forget knowledge previously learned when it learns new tasks. In addition, the model is supposed to prevent stopping learning just in order to retain what has been learned at the same time. There are several methods such as Elastic Weight Consolidation (EWC) (Aich, 2021), Synaptic Intelligence (SI) (Zenke et al., 2017b), Memory Aware Synapses (MAS) (Aljundi et al., 2018).
2.2.2 Knowledge transfer
It is expected that models are able to utilize what they have learned to help handle new problems. Related method is Gradient Episodic Memory (GEM) (Lopez-Paz and Ranzato, 2022).
2.2.3 Model expansion
Sometimes, models may be too simple to handle complicated tasks, so it is expected that these models could expand themselves to more complicated ones according to the complexity of problems. Some related methods are Progressive Neural Networks (Rusu et al., 2022), Expert Gate (Aljundi et al., 2017), Net2Net (Chen et al., 2016; Sodhani et al., 2019).
3 Representative applications of lifelong learning for AIS
Nowadays, it is an increasingly popular trend to use lifelong learning algorithms for AIS, which could better improve the performance of these systems. There have been plenty of domains making use of lifelong learning algorithms, here we highlight some representative and contemporary examples below (Figure 2).
Figure 2. The taxonomy of technologies related to applications of lifelong learning algorithms for AIS.
3.1 Autonomous driving
The development of autonomous vehicles has advanced quickly in recent years (Han et al., 2023). Modern vehicles are becoming more and more automated and intelligent due to advancements in lifelong learning algorithms, mechanical, and computing technologies (Su et al., 2012). The Institute of Electrical and Electronics Engineers (IEEE) alone produced around 43,000 conference papers and 8,000 journal (including magazine) articles on the subject of autonomous driving in the 5 years between 2016 and 2021 (Chen et al., 2022). Many IT and automotive companies have been attracted to this promising field, such as Baidu Apollo, Google Waymo. And by 2021, Waymo’s autonomous vehicles have driven more than 20 million miles on the road, demonstrating the reliability and safety of the technology of autonomous driving. As a result, in the near future, different types of AVs are expected to be fully commercialized, with a significant impact on all aspects of our lives (Su et al., 2012).
The most challenging problem autonomous driving currently faces is to adapt to novel driving scenarios, especially in complex and mixed traffic environments, and react properly and rapidly in time. As a result, autonomous driving is particularly in need of the combination of lifelong learning algorithms. So in the section below, different frames of lifelong learning in some crucial fields of autonomous driving are explained.
3.1.1 Lane changing
Lane changing is one of the largest challenges in the high-level decision-making of autonomous vehicles (AVs), especially in mixed and dynamic traffic scenarios, where lane changing has a significant impact on traffic safety and efficiency. In recent years, the application of lifelong learning to lane-changing decision-making in AVs has been widely explored with encouraging results. However, most of these studies have focused on single-vehicle environments, and lane-changing in situations where multiple AVs coexist with human-driven vehicles has received little attention (Zhou et al., 2022), which should be paid more attention. In this regard, Ref. (Zhou et al., 2022) proposes a multi-agent advantage actor-critic method which uses a novel local reward design and parameter sharing scheme to formulate the lane changing decision of multiple AVs in a mixed traffic highway environment as a multi-agent lifelong learning problem using a lifetime learning algorithm.
3.1.2 Automated valet parking
Automated valet parking (AVP) allows human drivers to park their cars in a drop-off zone (e.g., a parking garage entrance). These cars can independently perform autonomous driving tasks from the parking area to a designated parking space. AVP can greatly improve driver convenience, and is seen as an entry point for the promotion of AVs. And high-precision indoor positioning service is unavoidable in AVP. However, existing wireless indoor positioning technologies, including Wi-Fi, Bluetooth, and ultra-wideband (UWB), have a tendency to degrade significantly with the increase of working time and the change of building environments (Zhao et al., 2023). To handle this problem, a data-driven and map-assisted indoor positioning correction model has been proposed to improve the positioning accuracy for the infrastructure-enabled AVP system recently by a research team from Tongji University, Shanghai, China (for details refer to Ref. (Zhao et al., 2023)). In order to sustain the lifelong performance, the model is updated in an adversarial manner using crowdsourced data from the on-board sensors of fully instrumented autonomous vehicles (Zhao et al., 2023).
3.1.3 Trajectory prediction
Accurate trajectory prediction of vehicles is the key to reliable autonomous driving. Adapting to changing traffic environments and implementing lifelong trajectory prediction models are crucial in order to maintain consistent vehicle performance across different cities. In real applications, intelligent vehicles equipped with autonomous driving systems should travel on different roadways, cities and even countries. The system needs to properly forecast the future trajectories of the surrounding vehicles and adapt to the diverse distribution of their motion and interaction pattern in order to safely guide the vehicle. In order to achieve this, the system must constantly acquire new information about developing traffic conditions while retaining its previous understanding. Furthermore, the system cannot afford to store a significant amount of trajectory data due to its restricted storage resources (Bao et al., 2021). So, in order to perform well on all processed tasks, it is necessary to keep lifelong learning with restricted storage resource. As a consequence, in a bid to achieve lifelong trajectory prediction, a new framework based on conditional generative replay is proposed by the research team from the University of Science and Technology of China (USTC), which handles the problem of catastrophic forgetting due to different types of traffic environments and improve the precision and efficiency of vehicle trajectory prediction (Bao et al., 2021).
At the moment, autonomous vehicles are not perfect in their operation (Chen et al., 2022), as evidenced by some accidents caused by autonomous driving vehicles in recent years, in which safety drivers were unable to prevent the accidents from occurring, resulting in the loss of multiple lives, thus bringing about these mournful aftermaths which could have been prevented. Obviously, in terms of performance, autonomous vehicle systems are still far from the visual systems of humans or animals (Chen et al., 2020). It is necessary to find novel solutions, such as bio-inspired visual sensing, multi-agent collaborative perception, and control capabilities that emulate biological systems’ operational principles (Tang et al., 2021). It is predicted that after reaching increasing degrees of robotic autonomy and vehicle intelligence, autonomous driving will become sufficiently safe and dependable by 2030 to replace the majority of human driving (Litman, 2021).
3.2 Anomaly detection
Anomaly detection is the task of finding anomalous data instances, which therefore represents deviations from the normal conditions of a process (Aggarwal, 2017). In many fields and real-world applications, such as network traffic invasions (Faber et al., 2021), aberrant behavior in cyber-physical systems like smart grids (Corizzo et al., 2021), or flaws in manufacturing processes (Alfeo et al., 2020), the ability to identify abnormal behavior is crucial.
Examples of relevant techniques for detecting anomalies in one-class learning are: (i) Autoencoder, a model based on neural network reconstruction; (ii) One-Class Support Vector Machine, which provides anomaly scores by contrasting new data with the decision boundary based on hyperplanes.; (iii) Local Outlier Factor, which provides an anomaly score that is derived from the ratio of the new data samples’ local density to the average local density of its closest neighbors; (iv) Isolation Forest, which offers tree ensembles and calculates the new samples’ anomaly score by measuring the distance from the root to the leaf; (v) Copula-based anomaly detection, which draws conclusions about the level of “extremeness” of data samples by using tail probabilities (Goldstein and Uchida, 2016; Li et al., 2020; Lesouple et al., 2021).
However, although these methods have been established and perform well in many scenarios, due to the catastrophic forgetting, the performance of the anomaly detection system is affected negatively when previous circumstances reoccur. For this reason, lifelong anomaly detection is supposed to be applied to balance between knowledge transferring and knowledge retention. Since many real-world domains are characterized by both recurrent conditions and dynamic, rapidly evolving situations, lifelong anomaly detection may out to be quite advantageous in these kinds of environments. This feature necessitates model characteristics that promote concurrent learning and adaptability (Faber et al., 2023). And several recent research efforts have begun to address the problem of lifelong anomaly detection. Examples include using meta-learning to estimate parameters for numerous tasks in one-class image classification (Frikha et al., 2021), transfer learning for anomaly detection in videos (Doshi and Yilmaz, 2020), and change-point detection in conjunction with memory arrangement (Corizzo et al., 2022). Particularly, in the field of autonomous driving, an effective collaborative anomaly detection methodology known as ADS-Lead was proposed to safeguard the lane-following mechanism of ADSs. It has a unique transformer-based one-class classification algorithm to detect adversarial image examples (traffic sign and lane identification threats) as well as time series anomalies (GPS spoofing threat) (Han et al., 2023). In addition, to enhance the anomaly detection performance of models, an active lifetime anomaly detection framework was provided for class-incremental scenarios that supports any memory-based experience replay mechanism, any query strategy, and any anomaly detection model (Faber et al., 2022).
Figure 3. A scenario with four recurring tasks (Comparisons between conventional and lifelong anomaly detection).
Figure 3 illustrates a typical scenario comparing conventional anomaly detection with model updating with lifelong anomaly detection. In contrast to conventional anomaly detection, which continuously updates the model and causes detection delays, or false predictions, until the new task is incorporated into the model, lifetime anomaly detection in the second iteration does not require model updates following a recurrence of each work. Furthermore, in a 100-iteration scenario, only 4 model updates would be needed for lifetime anomaly detection, as opposed to 400 model updates for traditional anomaly detection, which results in detection delays. It could be used to map a wide range of recurring real-world scenarios, such as human activity sequences, geophysical phenomena like weather patterns, and cyber-physical system operating conditions (Faber et al., 2023; Figure 3).
The core process of lifelong anomaly detection involves several key steps, as depicted in Figure 4. These steps include data collection, initial anomaly detection, lifelong learning, model adaptation, continuous monitoring, model update, and the repetition of the process. The first step is data collection, wherein data is gathered from multiple sources, such as network traffic, smart grids, and manufacturing processes. Following data collection, initial anomaly detection techniques, such as Autoencoders, Support Vector Machines, Local Outlier Factor, and Isolation Forests, are employed to conduct preliminary anomaly detection. Subsequently, lifelong learning takes place, whereby new data is integrated into the model while existing knowledge is updated and retained. Model adaptation is then performed based on the new data, which may involve applying techniques like meta-learning, transfer learning, or change point detection with memory organization. Continuous monitoring of the data for anomalies is carried out to ensure timely detection. To maintain the model’s effectiveness, periodic model updates are performed by refreshing it with new data and employing advanced techniques. This entire process is repeated cyclically, encompassing both data collection and model updating stages.
Figure 4. The core process of lifelong anomaly detection.
3.3 Service robots
Depending on the continuous learning mechanism for a variety of various robotic tasks, lifelong machine learning has drawn intriguing academic interests in the field of robotics (Dong et al., 2022). And past research has identified lifelong learning as a critical capability for service robots. Creating an artificial “lifelong learning” agent that can construct a cultivated understanding of the world from the current scene and their prior knowledge through an autonomous lifelong system is one of the big ambitions of robotics (She et al., 2020). According to a report by Allied Market Research, the global service robot market is valued at $21.084 billion in 2020 and is expected to reach $293.087 billion by 2032, with a CAGR of 24.3% from 2023 to 2032. Moreover, the number of new startups named after service robots accounts for 29% of all U.S. robotics companies. Those data, among other similar figures, remark the development in the service robots area (Gonzalez-Aguirre et al., 2021). Service robots are mostly tasked with helping humans in the home environment, and they must handle a wide variety of objects. These objects are dependent on the particular environment (e.g., bedroom, toilet, balcony), the human being supported (e.g., kids, elderly people, disabled people). It is practically impossible to prepare all possible objects at the time of or prior to the deployment of the robot. Therefore, the robots will need to adjust to new objects and different ways of perceiving things throughout their lives (Niemueller, 2013). Despite these challenges, we want these robots to notice us and show adaptive behavior when they are on a mission. When a robot is given negative feedback when vacuuming while someone is watching TV, it should be able to recognize this as a new context and adjust its behavior accordingly in similar spatial or social contexts. For example, when people are reading books, the robot should be able to connect this scenario to the one it has previously encountered and cease vacuuming (Irfan et al., 2021). Another example is when service robots engage in language teaching, they may encounter variations in language environments and user learning needs. In such cases, it is imperative for service robots to achieve self-learning and improvement by monitoring user feedback, autonomously exploring language environments, and utilizing natural language processing techniques. Only through these means can they better provide personalized language learning support and practical opportunities for users, thus enhancing teaching proficiency and efficiency (Kanero et al., 2022).
Another aspect of lifelong learning applied to robots is the ability to function independently for lengthy periods of time in dynamic, constantly-changing surroundings. For example, in a domestic scene, where most objects are likely to be movable and interchangeable, the visual character of the same place may differ markedly over successive days. To deal with this situation, a term lifelong SLAM has been in use to address SLAM problems in environments that have been changing over time, improving the robustness and accuracy of pose estimation of robots (Shi et al., 2020). Lifelong SLAM takes into account a robot’s long-term operations, which involve repeatedly visiting previously mapped places in dynamic surroundings. In lifetime SLAM, we make the assumption that a region is constantly mapped over an extended period of time, rather than only once (Kurz et al., 2021). Compared to classical SLAM methods, however, there exist a lot of challenges (Shi et al., 2020):
• Changed viewpoints - the robot may look at the same scene or items from several angles.
• Changed things - the objects may have been changed when reentering a place that was previously observed by the robot.
• Changed illumination - there could be a significant change in illumination.
• Dynamic objects - There could be objects in the scene that are moving or changing.
• Degraded sensors - unpredictable sensor noises and calibration errors could result from a variety of factors, including mechanical strain, temperature changes, dirty or damp lenses, etc.
To address these challenges, the operational flow of the lifetime service robot is shown in Figure 5.
Figure 5. The operational flow of the lifetime service robot.
3.4 Emergency management
In recent years, machine learning algorithms have made great strides in enabling autonomous agents to learn through observation and sensor feedback how to carry out tasks in complex online environments. In particular, recent developments in deep neural network-based lifelong learning have demonstrated encouraging outcomes in the creation of autonomous agents that can interact with their surroundings in a variety of application domains (Arulkumaran et al., 2017), including learning to play games (Brown and Sandholm, 2017; Xiang et al., 2021), generating optimal control policies for robots (Jin et al., 2017; Pan et al., 2017), natural language processing and speech recognition (Bengio et al., 2015), body emotion understanding (Sun and Wu, 2023), as well as choosing the best trades in light of the shifting market conditions (Deng et al., 2017). The agent gradually learns the best course of action for the assigned task by seeing how its actions result in rewards from these encounters.
These methods are effective when it can be presumed that every event that occurs during deployment is a result of the same distribution that the agent was trained on. However, agents that must operate for extended periods of time in complex, real-world environments may be subject to unforeseen circumstances beyond the distribution for which they were designed or trained, due to changes in the environment. For instance, a construction site worker may unintentionally place a foreign object—like their hand–inside the workspace of a vision-guided robot arm, which must then react to prevent harm or damage. Similarly, an autonomous driving car may come across significantly distorted lane markings that it has never encountered before and must decide how to continue driving safely. In such unexpected and novel situations, the agent’s strategy will not apply, leading to the possibility of the agent taking unsafe actions. And that is what makes emergency management crucial.
The purpose of emergency management is to provide autonomous agents with the ability to respond to unforeseen situations that are different from what they are trained or designed to handle. Therefore, a lifelong data-driven response-generation system must be developed to tackle this problem. It enables an agent to handle new scenarios without depending on the reliability of pre-existing models, safe states, and recovery strategies created offline or from prior experiences, or on their accuracy. The main finding is that, when needed, uncertainty in environmental observations may be used to inform the creation of quick, online reactions that effectively avoid threats and allow the agent to carry on operating and learning in its surroundings (Maguire et al., 2022). As is shown in Figure 6, the core process of emergency management has a close relationship with lifelong learning algorithms, it keeps learning and adapting.
Figure 6. The emergency management process based on lifelong learning.
4 Outlook
Lifelong learning with AIS has made significant progress in recent decades. And graph lifelong learning is emerging as an important area in AI research and applications. Graph lifelong learning involves applying lifelong learning principles to graph-based data structures and algorithms. This approach aims to enable systems to continuously learn and adapt from a stream of graph data over time. There are many kinds of graph lifelong learning algorithms, and there exist several differences between these methods, which suit different situations. Each method may have its own approach and principle to cope with problems, as can be seen in Table 1.
Table 1. Graph lifelong learning method comparison.
The key challenge in graph lifelong learning is to efficiently update and refine the model as new data arrives, without forgetting previously learned information (Galke et al., 2023). In addition, dynamic nature of graphs also brings problems for the reasons that graph data is often dynamic, such as social networks or knowledge graphs. Models need to adapt to these changes while maintaining the validity of past learning (Galke et al., 2023). Graph lifelong learning is a rapidly growing field that proposes new solutions for how intelligent systems can continuously learn and adapt to changing environments. With further research, this field is expected to solve existing challenges and provide strong support for the continued development and application of intelligent systems.
Besides the development of graph lifelong learning, several trends and directions can be observed in the relationship between lifelong learning algorithms and AIS. Firstly, multi-modal learning will play a crucial role as autonomous systems learn from diverse sensors and data sources, including visual, auditory, textual, and sensor data. This integration will greatly enhance the system’s perception and understanding capabilities. Secondly, an important aspect is self-improvement learning, where the system autonomously assesses its performance, identifies weaknesses, and automatically adjusts and improves its algorithms and models to enhance efficiency and accuracy. Furthermore, cross-domain transfer of knowledge and experience becomes a possibility. The system will be able to transfer learned knowledge from one domain to another, thereby enhancing its problem-solving abilities across different domains. What is more, lifelong learning with AIS can also be developed and applied in the area of education, especially in English teaching and learning. According to Grand View Research, the AI market in education is expected to reach $13.3 billion by 2025. Its diversity is able to change the form of language education to a certain extent, making it continuously transform from the original, traditional, and monotonous form to a dimensional, dynamic, and multi-spatial form, providing a personalized learning experience based on individual needs and preferences (Hwang et al., 2020). Although there has been little research on how lifelong learning can enhance English teaching and learning through AIS so far, it can benefit this area without doubt (Gao, 2021; Pikhart, 2021; Klimova et al., 2022).
Concerning lifelong learning algorithms themselves, incremental learning should receive more attention. Improving the efficiency and stability of incremental learning becomes crucial, enabling the system to retain previous knowledge while learning new tasks. Additionally, self-supervised learning methods will gain prominence. These techniques allow systems to learn from unlabeled data, reducing reliance on extensive labeled data and opening up opportunities for continuous learning. Overall, these trends and directions highlight the importance of multi-modal learning, self-improvement learning, cross-domain transfer, efficient incremental learning, and self-supervised learning in advancing the field of lifelong learning algorithms for AIS.
5 Conclusion
In this paper, we have extensively discussed the relationship between lifelong learning algorithms and autonomous intelligent systems. We have demonstrated the specific applications of lifelong learning algorithms in various domains such as autonomous driving, anomaly detection, service robotics, and emergency management. It is found that current research has made certain progress in addressing the catastrophic forgetting problem of complex scenarios and multitasking under long time sequences. However, challenges such as activation drift, inter-task confusion, and excessive neural resources still persist. In light of this, we particularly emphasize the significance and potential of advancing lifelong learning through graphical approaches, while pointing out that multimodal learning and methods like cross-domain transfer are pivotal references for future advancements in AIS lifelong learning algorithms. Among these, the integration of robot vision and tactile perception is recognized as a key challenge to enhance robot performance and efficiency. To conclude, lifelong learning proves to be a reliable and efficient method for advancing autonomous intelligent systems. Future research efforts should focus on developing fully autonomous and secure learning frameworks that offer superior performance while reducing the need for excessive supervision, training time, and resources.
Author contributions
DZ: Conceptualization, Methodology, Resources, Writing – review & editing. QB: Investigation, Visualization, Writing – original draft. ZZ: Conceptualization, Funding acquisition, Methodology, Resources, Writing – review & editing. YZ: Investigation, Visualization, Writing – original draft. ZW: Funding acquisition, Resources, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported in part by the National Key Research and Development Program of China (t 2021YFE0193900 and 2020AAA0108901), in part by the Fundamental Research Funds for the Central Universities (22120220642).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Ahrabian, K., Xu, Y., Zhang, Y., Wu, J., Wang, Y., and Coates, M. (2021a). Structure aware experience replay for incremental learning in graph-based recommender systems. CIKM ‘21: The 30th ACM International Conference on Information and Knowledge Management.
Aich, A. (2021). Elastic weight consolidation(EWC): nuts and bolts. arXiv 2021:004093v1. doi: 10.48550/arXiv.2105.04093
Alfeo, A. L., Cimino, M. G., Manco, G., Ritacco, E., and Vaglini, G. (2020). Using an autoencoder in the design of an anomaly detector for smart manufacturing. Pattern Recogn. Lett. 136:8. doi: 10.1016/j.patrec.2020.06.008
Ali, R., Hardie, R. C., Narayanan, B. N., and Kebede, T. M. (2022). IMNets: deep learning using an incremental modular network synthesis approach for medical imaging applications. Appl. Sci. 12:5500. doi: 10.3390/app12115500
Aljundi, R., Babiloni, F., Elhoseiny, M., Rohrbach, M., and Tuytelaars, T. (2018). Memory aware synapses: learning what (not) to forget. arXiv 2018:09601v4. doi: 10.48550/arXiv.1711.09601
Aljundi, R., Babiloni, F., Elhoseiny, M., Rohrbach, M., and Tuytelaars, T. (2021). Memory aware synapses: learning what (not) to forget. Proceedings of the European Conference on Computer Vision (ECCV), pp. 144–161.
Aljundi, R., Chakravarty, P., and Tuytelaars, T. (2017). Expert gate: lifelong learning with a network of experts. arXiv 2017:06194v2. doi: 10.48550/arXiv.1611.06194
Andrei, A., Rusu, M. V., Rothörl, T., Heess, N., Pascanu, R., and Hadsell, R. (2017). Sim-to-real robot learning from pixels with progressive nets. Proceedings of the 1st Annual Conference on Robot Learning, PMLR, No. 78, pp. 262–270.
Arulkumaran, K., Deisenroth, M. P., Brundage, M., and Bharath, A. A. (2017). Deep reinforcement learning: a brief survey. IEEE Signal Process. Mag. 34, 26–38. doi: 10.1109/MSP.2017.2743240
Bansiwala, R., Gosavi, P., and Gaikwad, R. (2021). Continual learning for food recognition using class incremental extreme and online clustering method: self-organizing incremental neural network. Int. J. Innov. Eng. Sci. 6, 36–40. doi: 10.46335/IJIES.2021.6.10.7
Bao, P., Chen, Z., Wang, J., Dai, D., and Zhao, H. (2021). Lifelong vehicle trajectory prediction framework based on generative replay. arXiv 2021:0751. doi: 10.1109/TITS.2023.3300545
Barddal, J. P., and Enembreck, F. (2020). Regularized and incremental decision trees for data streams. Ann. Telecommun. 75, 493–503. doi: 10.1007/s12243-020-00782-3
Bengio, S., Vinyals, O., Jaitly, N., and Shazeer, N. (2015). Scheduled sampling for sequence prediction with recurrent neural networks. In: Proceedings of the 28th international conference on neural information processing systems. MIT Press, Cambridge, MA, pp. 1171–1179.
Bird, J., Colburn, K., Petzold, L., and Lubin, P. (2020). Model optimization for deep space exploration via simulators and deep learning. ArXiv 2020:14092. doi: 10.48550/arXiv.2012.14092
Block, H. D., Knight, B. W., and Rosenblatt, F. (1962). Analysis of a four-layer series-coupled perception. II*. Rev. Mod. Phys. 34, 135–142. doi: 10.1103/RevModPhys.34.135
Brown, N., and Sandholm, T. (2017). Libratus: the superhuman AI for no-limit poker. In Proceedings of the twenty-sixth international joint conference on artificial intelligence (IJCAI-17). IJCAI Organization, Menlo Park, Calif, pp. 5226–5228.
Carrio, A., Sampedro, C., Rodriguez-Ramos, A., and Campoy, P. (2017). A review of deep learning methods and applications for unmanned aerial vehicles. J Sens 2017:3296874. doi: 10.1155/2017/3296874
Chen, G., Cao, H., Conradt, J., Tang, H., Rohrbein, F., and Knoll, A. (2020). Event-based neuromorphic vision for autonomous driving: a paradigm shift for bioinspired visual sensing and perception. IEEE Signal Process. Mag. 37, 34–49. doi: 10.1109/MSP.2020.2985815
Chen, T., Goodfellow, I., and Shlens, J. (2016). Net2Net: accelerating learning via knowledge transfer. arXiv 2016:05641v4. doi: 10.48550/arXiv.1511.05641
Chen, J., Sun, J., and Wang, G. (2022). From unmanned systems to autonomous intelligent systems. Engineering 12, 16–19. doi: 10.1016/j.eng.2021.10.007
Choudhary, K., DeCost, B., Chen, C., Jain, A., Tavazza, F., Cohn, R., et al. (2022). Recent advances and applications of deep learning methods in materials science. NPJ Comput. Mater. 8:59. doi: 10.1038/s41524-022-00734-6
Choyon, A., Md, A. R., Hasanuzzaman, D. M. F., and Shatabda, S. (2020). Incremental decision trees for prediction of adenosine to inosine RNA editing sites. F1000Research 9:11. doi: 10.12688/f1000research.22823.1
Corizzo, R., Baron, M., and Japkowicz, N. (2022). Cpdga: change point driven growing auto-encoder for lifelong anomaly detection. Knowl. Based Syst. 2022:108756. doi: 10.1016/j.knosys.2022.108756
Corizzo, R., Ceci, M., Pio, G., Mignone, P., and Japkowicz, N. (2021). Spatially-aware autoencoders for detecting contextual anomalies in geo-distributed data. In: International Conference on Discovery Science, Springer, pp. 461–471.
Delcker, J. (2020). The man who invented the self-driving Car (in 1986). Available at: www.politico.eu/article/delf-driving-car-born-1986-ernst-dickmanns-merc%edes/.
Deng, Y., Bao, F., Kong, Y., Ren, Z., and Dai, Q. (2017). Deep direct reinforcement learning for financial signal representation and trading. IEEE Trans. Neural Netw. Learn. Syst. 28, 653–664. doi: 10.1109/TNNLS.2016.2522401
Dever, T. P., Trase, L. M., and Soeder, J. F. (2014). Application of autonomous spacecraft power control technology to terrestrial microgrids. AIAA-2014-3836, AIAA propulsion and energy forum, 12th international energy conversion engineering conference, Cleveland, OH.
Ding, S., Feng, F., He, X., Liao, Y., Shi, J., and Zhang, Y. (2024). Causal incremental graph convolution for recommender system retraining. IEEE Trans. Neural Netw. Learn. Syst., 1–11. doi: 10.1109/TNNLS.2022.3156066
Ding, L., Xiao, L., Liao, B., Lu, R., and Peng, H. (2017). An improved recurrent neural network for complex-valued Systems of Linear Equation and its Application to robotic motion tracking. Front. Neurorobot. 11:45. doi: 10.3389/fnbot.2017.00045
Dong, J., Cong, Y., Sun, G., and Zhang, T. (2022). Lifelong robotic visual-tactile perception learning. Pattern Recogn. 121:108176. doi: 10.1016/j.patcog.2021.108176
Doshi, K., and Yilmaz, Y. (2020). Continual learning for anomaly detection in surveillance videos. In: Proceedings of the IEEE/CVF CVPR workshops, pp. 254–255.
Eisa, A., EL-Rashidy, N., Alshehri, M. D., El-Bakry, H. M., and Abdelrazek, S. (2022). Incremental learning framework for mining big data stream. Comput. Mater. Contin. 2022:342. doi: 10.32604/cmc.2022.021342
Faber, K., Corizzo, R., Sniezynski, B., and Japkowicz, N.. (2022). Active lifelong anomaly detection with experience replay. 2022 IEEE 9th International Conference on Data Science and Advanced Analytics (DSAA).
Faber, K., Corizzo, R., Sniezynski, B., and Japkowicz, N. (2023). Lifelong learning for anomaly detection: new challenges, perspectives, and insights. arXiv 2023:07557v1. doi: 10.48550/arXiv.2303.07557
Faber, K., Faber, L., and Sniezynski, B. (2021). Autoencoder-based ids for cloud and mobile devices. In: 2021 IEEE/ACM 21st CCGrid, IEEE, pp. 728–736.
Febrinanto, F. G., Xia, F., Moore, K., Thapa, C., and Aggarwal, C. (2022). Graph lifelong learning: a survey. arXiv 2022:10688v2. doi: 10.48550/arXiv.2202.10688
Frikha, A., Krompaß, D., and Tresp, V. (2021). Arcade: a rapid continual anomaly detector. In: 2020 25th international conference on pattern recognition (ICPR), IEEE, pp. 10449–10456.
Galke, L., Franke, B., Zielke, T., and Scherp, A.. (2021). Lifelong learning of graph neural networks for open-world node classification. 2021 International Joint Conference on Neural Networks (IJCNN), Shenzhen, China, pp. 1–8.
Galke, L., Vagliano, I., Franke, B., Zielke, T., Hoffmann, M., and Scherp, A. (2023). Lifelong learning on evolving graphs under the constraints of imbalanced classes and new classes. Neural Netw. 164, 156–176. doi: 10.1016/j.neunet.2023.04.022
Gao, J. (2021). Exploring the feedback quality of an automated writing evaluation system pigai. Int. J. Emerg. Technol. Learn. 16, 322–330. doi: 10.3991/ijet.v16i11.19657
Gheibi, O., and Weyns, D. (2023). Dealing with drift of adaptation spaces in learning-based self-adaptive systems using lifelong self-adaptation. arXiv 2023:02658. doi: 10.48550/arXiv.2211.02658
Goldstein, M., and Uchida, S. (2016). A comparative evaluation of unsupervised anomaly detection algorithms for multivariate data. PLoS One 11:e0152173. doi: 10.1371/journal.pone.0152173
Gonzalez-Aguirre, J. A., Osorio-Oliveros, R., Rodríguez-Hernández, K. L., Lizárraga-Iturralde, J., Morales Menendez, R., Ramírez-Mendoza, R. A., et al. (2021). Service robots: trends and technology. Appl. Sci. 11:10702. doi: 10.3390/app112210702
Hadsell, R., Rao, D., Rusu, A. A., and Pascanu, R. (2020). Embracing change: continual learning in deep neural networks. Trends Cogn. Sci. 24, 1028–1040. doi: 10.1016/j.tics.2020.09.004
Han, Z., Ge, C., Member, I. E. E. E., Bingzhe, W., Liu, Z., and Senior Member, I. E. E. E. (2023). Lightweight privacy-preserving federated incremental decision trees. IEEE Trans. Serv. Comput. 16:1. doi: 10.1109/TSC.2022.3195179
Han, Y., Karunasekera, S., and Leckie, C. (2020). Graph neural networks with continual learning for fake news detection from social media. ArXiv 2020:03316. doi: 10.48550/arXiv.2007.03316
Han, X., Zhou, Y., Member, I. E. E. E., Chen, K., Qiu, H., Qiu, M., et al. (2023). ADS-Lead: lifelong anomaly detection in autonomous driving systems. IEEE Trans. Intell. Transp. Syst. 24:906. doi: 10.1109/TITS.2021.3122906
Hassija, V., Saxena, V., and Chamola, V. (2019). Scheduling drone charging for multi-drone network based on consensus time-stamp and game theory. Comput. Commun. 149, 51–61. doi: 10.1016/j.comcom.2019.09.021
He, Y., Chen, S., Wu, B., Xu, Y., and Xindong, W. (2021). Unsupervised lifelong learning with curricula. Proceedings of the Web Conference.
Hinton, G. E., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv 2015:1503. doi: 10.48550/arXiv.1503.02531
Hwang, G. J., Xie, H., Wah, B. W., and Gašević, D. (2020). Vision, challenges, roles and research issues of artificial intelligence in education. Comput. Educ. 1:100001. doi: 10.1016/j.caeai.2020.100001
Irfan, B., Ramachandran, A., Spaulding, S., Kalkan, S., Parisi, G. I., and Gunes, H. (2021). Lifelong Learning and personalization in Long-term human-robot interaction(LEAP-HRI). HRI’21 Companion, Boulder, CO, USA.
Jan Moolman Buys University College University of Oxford. (2017). Incremental generative models for syntactic and semantic natural language processing.
Jin, L., Liao, B., Liu, M., Xiao, L., Guo, D., and Yan, X. (2017). Different-level simultaneous minimization scheme for fault tolerance of redundant manipulator aided with discrete-time recurrent neural network. Front. Neurorobot. 11:50. doi: 10.3389/fnbot.2017.00050
Kahardipraja, P., Madureira, B., and Schlangen, D. (2023). TAPIR: learning adaptive revision for incremental natural language understanding with a two-Pass model. arXiv 2023:10845v1. doi: 10.48550/arXiv.2305.10845
Kahveci, N. E., and Ioannou, P. A. (2013). Adaptive steering control for uncertain ship dynamics and stability analysis. Automatica 49, 685–697. doi: 10.1016/j.automatica.2012.11.026
Kanero, J., Oranç, C., Koşkulu, S., Kumkale, G. T., Göksun, T., and Küntay, A. C. (2022). Are tutor robots for everyone? The influence of attitudes, anxiety, and personality on robot-led language learning. Int. J. Soc. Robot. 14, 297–312. doi: 10.1007/s12369-021-00789-3
Kang, M., Kang, M., and Han, B. (2022). Class-incremental learning by knowledge distillation with adaptive feature consolidation. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR.
Katayama, H., and Aoki, H. (2014). Straight-line trajectory tracking control for sampled-data underactuated ships. IEEE Trans. Control Syst. Technol. 22, 1638–1645. doi: 10.1109/TCST.2013.2280717
Kemker, R., and Kanan, C. (2017). Fearnet: brain-inspired model for incremental learning. arXiv 2017:10563. doi: 10.48550/arXiv.1711.10563
Khan, M. A. (2022). Intelligent environment enabling autonomous driving. Hindawi Comput. Intell. Neurosci. 2022:2938011. doi: 10.1109/ACCESS.2021.3059652
Kim, D., and Han, B. (2023). On the stability-plasticity dilemma of class-incremental learning. arXiv 2023:01663v1. doi: 10.48550/arXiv.2304.01663
Kingston, D., Beard, R. W., and Holt, R. S. (2008). Decentralized perimeter surveillance using a team of UAVs. IEEE Trans. Robot. 24, 1394–1404. doi: 10.1109/TRO.2008.2007935
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., et al. (2017). Overcoming catastrophic forgetting in neural networks. Proc. Natl. Acad. Sci. 114, 3521–3526. doi: 10.1073/pnas.1611835114
Klimova, B., Pikhart, M., Benites, A. D., Lehr, C., and Sanchez-Stockhammer, C. (2022). Neural machine translation in foreign language teaching and learning: a systematic review. Educ. Inf. Technol. 27, 1–20. doi: 10.1007/s10639-022-11194-2
Kober, J., Bagnell, J. A., and Peters, J. (2013). Reinforcement learning in robotics: a survey. Int. J. Rob. Res. 32, 1238–1274. doi: 10.1177/0278364913495721
Kou, X., Lin, Y., Liu, S., Li, P., Zhou, J., and Zhang, Y. (2020). Disentangle-based continual graph representation learning. In: Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), pp. 2961–2972. Association for Computational Linguistics.
Kurz, G., Holoch, M., and Biber, P. (2021). Geometry-based graph pruning for lifelong SLAM, 2021 IEEE/RSJ international conference on intelligent robots and systems (IROS), Prague: Czech Republic, pp. 3313–3320.
Lesouple, J., Baudoin, C., Spigai, M., and Tourneret, J.-Y. (2021). Generalized isolation forest for anomaly detection. Pattern Recogn. Lett. 149, 109–119. doi: 10.1016/j.patrec.2021.05.022
Li, J., Dani, H., Hu, X., Tang, J., Chang, Y., and Liu, H. (2017). Attributed network embedding for learning in a dynamic environment. In: Proceedings of the 2017 ACM on conference on information and knowledge management (CIKM '17). New York: Association for Computing Machinery, pp. 387–396.
Li, Y., Qi, T., Ma, Z., Quan, D., and Miao, Q. (2023). Seeking a hierarchical prototype for multimodal gesture recognition. IEEE Trans. Neural Netw. Learn. Syst. :5811. doi: 10.1109/TNNLS.2023.3295811
Li, Z., Zhao, Y., Botta, N., Ionescu, C., and Hu, X. (2020). Copod: copulabased outlier detection. In: 2020 IEEE international conference on data mining (ICDM), IEEE, pp. 1118–1123.
Li, T. S., Zhao, R., Philip Chen, C. L., Fang, L. Y., and Liu, C. (2018). Finite-time formation control of under-actuated ships using nonlinear sliding mode control. IEEE Trans. Cybern. 48, 3243–3253. doi: 10.1109/TCYB.2018.2794968
Li, X., et al. (2023). Graph structure-based implicit risk reasoning for Long-tail scenarios of automated driving. 4th International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE), Hangzhou, China, pp. 415–420.
Li, Z., et al. (2023). Two flexible translation-based models for knowledge graph embedding. pp. 3093–3105.
Liao, B., Hua, C., Xu, Q., Cao, X., and Li, S. (2024). Inter-robot management via neighboring robot sensing and measurement using a zeroing neural dynamics approach. Expert Syst. Appl. 244:122938. doi: 10.1016/j.eswa.2023.122938
Lin, G., Chu, H., and Lai, H. (2022). Towards better plasticity-stability trade-off in incremental learning: a simple linear connector. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
Litman, T. (2021). Autonomous vehicle implementation predictions: Implications for transport planning. Victoria: Victoria Transport Policy Institute.
Liu, Z., Huang, C., Yu, Y., and Dong, J. (2021). Motif-preserving dynamic attributed network embedding. In: Proceedings of the web conference 2021 (WWW '21). New York: Association for Computing Machinery, 1629–1638.
Liu, H., Yang, Y., and Wang, X. (2021). Overcoming catastrophic forgetting in graph neural networks. Proc. AAAI Conf. Artif. Intell. 35, 8653–8661. doi: 10.1609/aaai.v35i10.17049
Lopez-Paz, D., and Ranzato, M. A. (2022). Gradient episodic memory for continual learning. arXiv 2022:08840v6. doi: 10.48550/arXiv.1706.08840
Lovinger, J., and Valova, I. (2020). Infinite lattice learner: an ensemble for incremental learning. Soft. Comput. 24, 6957–6974. doi: 10.1007/s00500-019-04330-7
Lv, X., Xiao, L., and Tan, Z. (2019). Improved Zhang neural network with finite-time convergence for time-varying linear system of equations solving. Inf. Process. Lett. 147, 88–93. doi: 10.1016/j.ipl.2019.03.012
Maguire, G., Ketz, N., Pilly, P. K., and Mouret, J. B. (2022). A-EMS: an adaptive emergency management system for autonomous agents in unforeseen situations. TAROS 2022: Towards Autonomous Robotic Systems, pp. 266–281.
Mallya, A., and Lazebnik, S. (2018a). PackNet: adding multiple tasks to a single network by iterative pruning. arXiv 2018:05769v2. doi: 10.48550/arXiv.1711.05769
Mallya, A., and Lazebnik, S. (2018b). Packnet: adding multiple tasks to a single network by iterative pruning. 2018 IEEE/CVF conference on computer vision and pattern recognition, Salt Lake City, UT, pp. 7765–7773.
May, R. D., and Loparo, K. A. (2014). The use of software agents for autonomous control of a DC space power system. AIAA-2014-3861, AIAA propulsion and energy forum, 12th international energy conversion engineering conference, Cleveland, OH.
May, R. D., et al. (2014). An architecture to enable autonomous control of spacecraft. AIAA-2014-3834, AIAA propulsion and energy forum, 12th international energy conversion engineering conference, Cleveland, OH.
Meng, X., Zhao, Y., Liang, Y., and Ma, X. (2022). Hyperspectral image classification based on class-incremental learning with knowledge distillation. Remote Sens. 14:2556. doi: 10.3390/rs14112556
Mohsan, S. A. H., Mohsan, S. A. H., Noor, F., Ullah, I., and Alsharif, M. H. (2022). Towards the unmanned aerial vehicles (UAVs): a comprehensive review. Drones 6:147. doi: 10.3390/drones6060147
Natali, A., Coutino, M., and Leus, G.. Topology-aware joint graph filter and edge weight identification for network processes. (2020). 2020 IEEE 30th International Workshop on Machine Learning for Signal Processing (MLSP), Espoo, Finland, 2020, pp. 1–6.
Nguyen, T.-T., Pham, H. H., Le Nguyen, P., Nguyen, T. H., and Do, M. (2022). Multi-stream fusion for class incremental learning in pill image classification. arXiv 2022:02313v1. doi: 10.48550/arXiv.2210.02313
Nicolas, Y. (2018). Masse, Gregory D Grant, David J freeman. Alleviating catastrophic forgetting using context-based parameter modulation and synaptic stabilization. Proc. Natl. Acad. Sci. 115, E10467–E10475. doi: 10.1073/pnas.1803839115
Niemueller, T. (2013). Stefan Schiffer, Gerhard Lakemeyer, Safoura Rezapour Lakani. Life-long Learning Perception using Cloud Database Technology. Proceeding IROS Workshop on Cloud Robotics.
OM Group of Companies. (2020). The future of automotive: still a Long ride. Available at: www.omnicommediagroup.com/news/globalnews/the-future-of-automotive-st.
Ouyang, Y., Shi, J., Wei, H., and Gao, H. (2021). Incremental learning for personalized recommender systems. arXiv 2021:13299v1. doi: 10.48550/arXiv.2108.13299
Pan, S. J., and Yang, Q. (2010). A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22:191. doi: 10.1109/TKDE.2009.191
Pan, X., You, Y., Wang, Z., and Lu, C. (2017). Virtual to real reinforcement learning for autonomous driving. In: Proceedings of the British machine vision conference (BMVC). BMVA Press, London, UK.
Parisi, G. I., Tani, J., Weber, C., and Wermter, S. (2017). Lifelong learning of human actions with deep neural network self-organization. Neural Netw. 96, 137–149. doi: 10.1016/j.neunet.2017.09.001
Pikhart, M. (2021). Human-computer interaction in foreign language learning applications: applied linguistics viewpoint of mobile learning. Proc. Comput. Sci. 184, 92–98. doi: 10.1016/j.procs.2021.03.123
Qu, C., Zhang, L., Li, J., Deng, F., Tang, Y., Zeng, X., et al. (2021). Improving feature selection performance for classification of gene expression data using Harris hawks optimizer with variable neighborhood learning. Brief. Bioinform. 22:bbab097. doi: 10.1093/bib/bbab097
Rajan, V., and Cruz, A. D. L. (2022). Utilisation of service robots to assist human Workers in Completing Tasks Such in retail, hospitality, healthcare, and logistics businesses. Technoarete Trans. Ind. Robot. Automat. Syst. 2:2. doi: 10.36647/TTIRAS/02.01.A002
Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., et al. (2022). Progressive neural networks. arXiv 2022:04671v4. doi: 10.48550/arXiv.1606.04671
Sarlin, P. E., DeTone, D., Malisiewicz, T., and Rabinovich, A. (2020). SuperGlue: learning feature matching with graph neural networks," 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, pp. 4937–4946.
Schwarzerova, J., and Bajger, A. (2021). Iro Pierdou, Lubos Popelinsky, Karel Sedlar, Wolfram Weckwerth. An innovative perspective on metabolomics data analysis in biomedical research using concept drift detection. 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).
Serra, J., Suris, D., Miron, M., and Karatzoglou, A.. (2018). Overcoming catastrophic forgetting with hard attention to the task. 80. Proceedings of the 35th International Conference on Machine Learning, PMLR, pp. 4548–4557.
Shaheen, K., Hanif, M. A., Hasan, O., and Hasan, O. (2022). Continual learning for real-world autonomous systems: algorithms, challenges and frameworks. J. Intell. Robot. Syst. 105:9. doi: 10.48550/arXiv.2105.12374
She, Q., Feng, F., Liu, Q., Chan, R. H. M., Hao, X., Lan, C., et al. (2020). IROS 2019 lifelong robotic vision challenge lifelong object recognition report. arXiv 2020:14774v1. doi: 10.48550/arXiv.2004.14774
Shen, C., Shi, Y., and Buckham, B. (2019). Path-following control of an AUV: a multiobjective model predictive control approach. IEEE Trans. Control Syst. Technol. 27, 1334–1342. doi: 10.1109/TCST.2018.2789440
Shi, G., Chen, J., Zhang, W., Zhan, L.-M., and Xiao-Ming, W. (2021). Overcoming catastrophic forgetting in incremental few-shot learning by finding flat minima. Adv. Neural Inf. Proces. Syst. 34:21. doi: 10.48550/arXiv.2111.01549
Shi, X., Li, D., Zhao, P., Tian, Q., Tian, Y., Long, Q., et al. (2020). Are we ready for service robots? The OpenLORIS-scene datasets for lifelong SLAM. arXiv 2020:05603v2. doi: 10.48550/arXiv.1911.05603
Shin, H., Lee, J. K., Kim, J., and Kim, J. (2017). Continual learning with deep generative replay. NIPS, 2990–2999. doi: 10.48550/arXiv.1705.08690
Smith, J., Hsu, Y. C., Balloch, J., Shen, Y., Jin, H., and Kira, Z. (2021). Always be dreaming: a new approach for data-free class-incremental learning. 2021 IEEE/CVF International Conference on Computer Vison(ICCV).
Sodhani, S., Chandar, S., and Bengio, Y. (2019). Towards training recurrent neural networks for lifelong learning. arXiv 2019:07017v3. doi: 10.48550/arXiv.1811.07017
Soeder, J. F., Dever, T. P., McNelis, A. M., Beach, R. F., and Trase, L. M.. (2014). Overview of intelligent power controller development for human deep space exploration. 12th International Energy Conversion Engineering Conference, July 28–30.
Soeder, J. F., Dever, T. P., McNelis, A. M., Beach, R. F., Trase, L. M., and May, R. D. (2014). Overview of intelligent power controller development for human deep space exploration. AIAA-2014-3833, AIAA propulsion and energy forum, 12th international energy conversion engineering conference, Cleveland, OH.
Su, H., Qiu, M., and Wang, H. (2012). Secure wireless communication system for smart grid with rechargeable electric vehicles. IEEE Commun. Mag. 50, 62–68. doi: 10.1109/MCOM.2012.6257528
Su, J., Zou, D., Zhang, Z., and Wu, C. (2023). Towards robust graph incremental learning on evolving graphs. Proceedings of the 40th International Conference on Machine Learning Available at: https://proceedings.mlr.press/v202/su23a.html.
Sun, Q., and Wu, X. (2023). A deep learning-based approach for emotional analysis of sports dance. PeerJ Comput. Sci. 9:1441. doi: 10.7717/peerj-cs.1441
Tan, Z., Ding, K., Guo, R., and Liu, H. (2022). Graph few-shot class-incremental learning. In: Proceedings of the fifteenth ACM international conference on web search and data mining (WSDM '22). Association for Computing Machinery, New York, NY, USA, 987–996.
Tang, B., Zhong, Y., Neumann, U., Wang, G., Zhang, Y., and Chen, S. (2021). Collaborative uncertainty in multi-agent trajectory forecasting. In: Proceedings of 35th conference on neural information processing systems (NeurIPS 2021).
Teixeira, K., Miguel, G., Silva, H. S., and Madeiro, F. (2023). A survey on applications of unmanned aerial vehicles using machine learning. IEEE Access 11, 117582–117621. doi: 10.1109/ACCESS.2023.3326101
Tian, H., Shuai, M., Li, K., and Peng, X. (2019). An incremental learning ensemble strategy for industrial process soft sensors. Hindawi Complexity 2019:5353296. doi: 10.1155/2019/5353296
Wang, W., Ni, H., Lin, S., Tao, H., Ren, Q., Gerstoft, P., et al. (2019). Deep transfer learning for source ranging: deep-sea experiment results. J. Acoust. Soc. Am. 146:EL317:EL322. doi: 10.1121/1.5126923
Wang, N., Qian, C., Sun, J.-C., and Liu, Y.-C. (2016). Adaptive robust finite-time trajectory tracking control of fully actuated marine surface vehicles. IEEE Trans. Control Syst. Technol. 24, 1454–1462. doi: 10.1109/TCST.2015.2496585
Wang, J., Song, G., Wu, Y., and Liang, W. (2020). Streaming graph neural networks via continual learning. In: proceedings of the 29th ACM international conference on information & knowledge management (CIKM '20). Association for Computing Machinery, New York, USA, 1515–1524.
Wang, Y., Zhang, Y., and Coates, M. (2021). Graph structure aware contrastive knowledge distillation for incremental learning in recommender systems. CIKM ‘21: The 30th ACM International Conference on Information and Knowledge Management.
Wibisono, A., Piran, M. J., Song, H. K., and Lee, B. M. (2023). A survey on unmanned underwater vehicles: challenges, enabling technologies, and future research directions. Sensors (Basel). 23:7321. doi: 10.3390/s23177321
Wu, G., Gong, S., and Li, P. (2021). Striking a balance between stability and plasticity for class-incremental learning. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
Xiang, Z., Xiang, C., Li, T., and Guo, Y. (2021). A self-adapting hierarchical actions and structures joint optimization framework for automatic design of robotic and animation skeletons. Soft. Comput. 25, 263–276. doi: 10.1007/s00500-020-05139-5
Xiao, Y. (2022). Application of machine learning in ethical Design of Autonomous Driving Crash Algorithms. Hindawi Comput. Intell. Neurosci. 2022:2938011. doi: 10.1155/2022/2938011
Yan, S., Xie, J., and He, X. (2021). DER: dynamically expandable representation for class incremental learning. arXiv 2021:16788v1. doi: 10.48550/arXiv.2103.16788
Yang, Q. (2013). Big data, lifelong machine learning and transfer learning. Proceedings of the Sixth ACM International Conference on Web Search and Data Mining.
Yoon, H. G., Song, H. J., Park, S. B., and Park, S. Y. (2016). A translation-based knowledge graph embedding preserving logical property of relations. In: Proceedings of the 2016 conference of the north American chapter of the Association for Computational Linguistics: Human language technologies, pp. 907–916.
Yoon, J., Yang, E., Lee, J., and Hwang, S. J. (2017). Lifelong learning with dynamically expandable networks. ArXiv 2017:01547. doi: 10.48550/arXiv.1708.01547
Zenke, F., Poole, B., and Ganguli, S. (2017a). Continual learning through synaptic intelligence. Proceedings of the 34th International Conference on Machine Learning, No. 70, pp. 3987–3995.
Zenke, F., Poole, B., and Ganguli, S. (2017b). Continual learning through synaptic intelligence. arXiv 2017:04200v3. doi: 10.48550/arXiv.1703.04200
Zhang, X., Song, D., and Tao, D. (2023a). Hierarchical prototype networks for continual graph representation learning. IEEE Trans. Pattern Anal. Mach. Intell. 45, 4622–4636. doi: 10.1109/TPAMI.2022.3186909
Zhang, X., Song, D., and Tao, D. (2023b). Ricci curvature-based graph Sparsification for continual graph representation learning. IEEE Trans. Neural. Netw. Learn Syst. :454. doi: 10.1109/TNNLS.2023.3303454
Zhang, J., Wang, T., Ng, W. W. Y., and Pedrycz, W. (2023). KNNENS: a k-nearest neighbor ensemble-based method for incremental learning under data stream with emerging new classes. IEEE Trans. Neural Netw. Learn. Syst. 34, 9520–9527. doi: 10.1109/TNNLS.2022.3149991
Zhang, Q., et al. (2022). A dynamic Variational framework for open-world node classification in structured sequences. 2022 IEEE International Conference on Data Mining (ICDM), Orlando, FL, USA, pp. 703–712.
Zhao, Y., Lin, H., Wang, H., and Ma, X. (2022). Few-SHOT class incremental learning for HYPERSPECTRAL image classification based on constantly updated CLASSIFIER.GARSS 2022–2022 IEEE International Geoscience and Remote Sensing Symposium.
Zhao, C., Song, A., Zhu, Y., Jiang, S., Liao, F., Yuchuan, D., et al. (2023). Data-driven indoor positioning correction for infrastructure-enabled autonomous driving systems: a lifelong framework. IEEE Trans. Intell. Transp. Syst. 24:563. doi: 10.1109/TITS.2022.3233563
Zhao, H., Wang, H., Yongjian, F., Wu, F., and Li, X. (2021). Memory efficient class-incremental learning for image classification. IEEE Trans. Neural Net. Learn. Syst. 11:1. doi: 10.48550/arXiv.2008.01411
Zhou, F., and Cao, C. (2021a) Overcoming catastrophic forgetting in graph neural networks with experience replay. The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21).
Zhou, F., and Cao, C. (2021b). Overcoming catastrophic forgetting in graph neural networks with experience replay. Proc. AAAI Conf. Artif. Intell. 35, 4714–4722. doi: 10.1609/aaai.v35i5.16602
Zhou, W., Cao, Z., Xu, Y., Deng, N., Liu, X., Jiang, K., et al. (2022). Long-tail prediction uncertainty aware trajectory planning for self-driving vehicles. 2022 IEEE 25th international conference on intelligent transportation systems (ITSC), Macau, China, pp. 1275–1282.
Zhou, W., Chen, D., Yan, J., Li, Z., Yin, H., and Ge, W. (2022). Multi-agent reinforcement learning for cooperative lane changing of connected and autonomous vehicles in mixed traffic. Auton. Intell. Sys. 1, 2–5. doi: 10.48550/arXiv.2111.06318
Zhou, D.-W., Ye, H.-J., Liang, M., Xie, D., Shiliang, P., and Zhan, D.-C. (2022). Few-shot class-incremental learning by sampling multi-phase tasks. arXiv 2022:17030v2. doi: 10.48550/arXiv.2203.17030
Zhou, Y., Zhang, X., Wang, S., and Li, L.. (2022) Multi-attribute joint point cloud super-resolution with adversarial feature graph networks. 2022 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), Taipei City, Taiwan, 2022: pp. 1–6.
Zhu, X. L., Wang, H. C., You, H. M., Zhang, W. H., Zhang, Y. Y., Liu, S., et al. (2021). Survey on testing of intelligent Systems in Autonomous Vehicles. J. Softw. 32, 2056–2077. doi: 10.13328/j.cnki.jos.006266
Keywords: artificial intelligence, lifelong learning, algorithm, autonomous intelligent systems, future perspectives
Citation: Zhu D, Bu Q, Zhu Z, Zhang Y and Wang Z (2024) Advancing autonomy through lifelong learning: a survey of autonomous intelligent systems. Front. Neurorobot. 18:1385778. doi: 10.3389/fnbot.2024.1385778
Edited by:
Long Jin, Lanzhou University, ChinaCopyright © 2024 Zhu, Bu, Zhu, Zhang and Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Zhongpan Zhu, 521bergsteiger@tongji.edu.cn