Original Research ARTICLE
Path Following, Obstacle Detection and Obstacle Avoidance for Thrusted Underwater Snake Robots
- 1Department of Engineering Cybernetics, Centre for Autonomous Marine Operations and Systems, Norwegian University of Science and Technology, Trondheim, Norway
- 2Department of Seafood Technology, SINTEF Ocean, Trondheim, Norway
- 3Department of Engineering Cybernetics, Norwegian University of Science and Technology, Trondheim, Norway
- 4Department of Mathematics and Cybernetics, SINTEF Digital, Oslo, Norway
The use of unmanned underwater vehicles is steadily increasing for a variety of applications such as mapping, monitoring, inspection and intervention within several research fields and industries, e.g., oceanography, marine biology, military, and oil and gas. Particularly interesting types of unmanned underwater vehicles are bio-inspired robots such as underwater snake robots (USRs). Due to their flexible and slender body, these versatile robots are highly maneuverable and have better access capabilities than more conventional remotely operated vehicles (ROVs). Moreover, the long and slender body allows for energy-efficient transit over long distances similar to torpedo-shaped autonomous underwater vehicles (AUVs). In addition, USRs are capable of performing light intervention tasks, thereby providing intervention capabilities which exceed those of AUVs and inspection class ROVs. USRs may also propel themselves using energy-efficient motion patterns inspired by their biological counterparts. They can thereby increase the propulsion efficiency during transit and maneuvering, which is among the great challenges for autonomous underwater vehicles. In this paper, a control system for path following, and algorithms for obstacle detection and avoidance, are presented for a USR with thrusters attached at the tail module. The position of the obstacles is detected using a single camera in the head module of the USR and a developed computer vision algorithm. For the proposed control concept the robot joints are used for directional control while the thrusters are used for forward propulsion. The USR circumvents obstacles by following a circular path around them before converging back to the main straight line path when this is safe. Experimental results that validate the proposed methods are also presented.
Through millions of years of evolution, sea snakes, eels and fish have developed highly efficient motion for propulsion and locomotion. These creatures are able to rapidly change direction in a highly efficient manner (Lighthill, 1970, 1975). Many of them have superior acceleration capabilities, while simultaneously being able to access confined spaces using their flexible bodies. Over the last decades, remotely operated vehicles (ROVs) have been extensively used for subsea inspection, maintenance, and repair operations in the oil and gas industry (Christ and Wernli, 2013). These vehicles rely on being operated by a highly trained human in the loop. In order to make such operations safer and more cost-efficient, there has been an increasing interest in developing intervention AUVs (I-AUVs) (Ridao et al., 2014), underwater snake robots (USRs) (Mclsaac and Ostrowski, 1999; McIsaac and Ostrowski, 2002; Takayama and Hirose, 2002; Wilbur et al., 2002; Crespi et al., 2005; Yamada et al., 2005; Crespi and Ijspeert, 2006; Li et al., 2011; Stefanini et al., 2012; Liljebäck et al., 2014; Kelasidi et al., 2016a,b) and underwater snake robots with thrusters (Sverdrup-Thygeson et al., 2016a,b) as a step toward improved autonomy, dexterity and precision for underwater manipulation tasks. Detailed discussions on different underwater robotic systems such as ROVs, AUVs and bio-inspired robotic systems can be found in Kelasidi et al. (2016a) and Kelasidi et al. (2017b).
Inspired by biological swimming creatures, a novel concept for bio-inspired multi-articulated robotic systems has been illustrated in Figure 1, which combines properties of aquatic animals with state of the art solutions from marine technology. Unlike conventional underwater robotic solutions, the USR is a slender and highly redundant robot, which is able to propel itself forward using body undulations combined with caudal, dorsal and pectoral fins and/or with stern propellers and tunnel thrusters along the body. This provides significant flexibility and increases the maneuverability of the robot for subsea applications, as illustrated in Figure 1 (Kelasidi et al., 2015; Sverdrup-Thygeson et al., 2016b). The modular design of the robot makes it suitable for different applications by simply connecting various modules in different combinations to form various types of vehicles. As illustrated in Figure 1, the robotic system is a dexterous robotic arm which can operate tools and carry out light intervention tasks. In addition, by using either foils or thrusters, it can transit over long distances in a similar manner as a survey AUV, while its flexible and slender body provides the ability to access and operate in restricted areas of subsea structures. The modular design of the robot makes it applicable for different applications depending on the requirement of the task. For instance, a purely bio-inspired solution without using propellers can be considered for applications where limited acoustic noise is required, whereas equipping the robot with thrusters can provide improved maneuverability for inspection and intervention tasks. The use of USRs for such subsea operations introduces several interesting research challenges. Figure 2 presents the first USR equipped with thrusters at the tail module, developed at the Norwegian University of Science and Technology (NTNU) (Liljebäck et al., 2014; Kelasidi et al., 2016b). This robotic platform using thrusters only at the tail module can be considered a special case of the general concept shown in Figure 1, and is a step toward developing the next generation of USRs with additional effectors. The modular snake robot Mamba (Liljebäck et al., 2014) can be equipped with thrusters when operated underwater (Kelasidi et al., 2016b). Mamba with thrusters is a new type of snake-like robot which combines biologically inspired undulatory locomotion with the use of thrusters, and is the test platform considered for all the experimental results presented in this paper.
Figure 1. Underwater snake robots are highly flexible, capable of rapid directional changes and can access small and confined spaces. They can perform intervention tasks and efficient transportation for longer range missions. When combined with additional effectors such as thrusters or tail fins, these robots are highly versatile and may be applied for a variety of underwater operations. (A) Concept sketches bio-inspired underwater snake robots with additional effectors. (B) Next generation of inspection and intervention vehicles for underwater applications.
Obstacle avoidance is a crucial task for numerous robotic systems. For fixed base systems, the robot must avoid self-collisions as well as any objects that might be within its workspace. For floating base robots, such as a USR or a surface ship, the main task is to avoid stationary and dynamic obstacles such as islands/pipelines/other structures and other ships or floating base systems. There exist several path planning algorithms for computing a safe path to avoid obstacles, such as A⋆, RRT and HBug (Hernandez et al., 2015). However, these global path planning methods are not suitable for unknown and dynamic environments, and must be complemented by a local guidance system that is able to make the mobile robotic system avoid small, unforeseen, and dynamic obstacles while following the global path. A variety of such local approaches have been proposed, both for the general and maritime case, such as potential fields (Khatib, 1985), dynamic window (Fox et al., 1997; Loe, 2008), velocity obstacles van den Berg et al. (2011); Kuwata et al. (2014), and Tangent/WedgeBug Laubach and Burdick (1999). However, these approaches have several drawbacks. Potential fields may suffer from oscillating behavior and convergence to local minima (Koren and Borenstein, 1991), and the dynamic window approach can be computationally heavy. The velocity obstacle (VO) approach has good mathematical qualities and is computationally simple, but is not straight-forward to implement. However, the main drawback of these methods is the fact that it is not obvious how to combine these collision avoidance methods with existing, commonly used guidance methods for path following such as line-of-sight (LOS) (Fossen, 2011). The Wedgebug algorithm is applied to Mars Rovers and assumes that the rover is modeled as a point robot in a 2D binary environment (i.e., every point in the environment is either contained within an impassable obstacle, or lies in freespace) and that obstacle boundaries block sensing as well as motion. In the approach proposed in this paper, the obstacle boundaries have the possibility to be virtual, which prevents passage into identified unsafe areas without physical obstacles in the way.
In nautical navigation there exists several obstacle avoidance methods which all require some information about the obstacle itself, i.e., position, size and/or velocity. To detect underwater obstacles, one may use sensors such as sonars and cameras (Nicholson and Healey, 2008; Ridao et al., 2014; Mallios et al., 2016). Due to the properties of light propagation under water, acoustics-based navigations methods are often applied. Vision systems decrease the range, but also decrease space and cost and increase the resolution (Bonin-Font et al., 2008). Often, vision systems are based on two cameras, i.e., stereo vision. With such a setup, one can use matching and geometric triangulation to calculate the 3D-position of detected features (Goldberg et al., 2002). The USR Mamba is equipped with a single camera at the head module. However, obstacle avoidance still requires sensing of depth, i.e., the distance between the vision sensor and the obstacle. To achieve this using monocular vision, one must rely on assumptions concerning the scene geometry and vehicle motion (Bhatti, 2008; Lei et al., 2013). In this paper, we have developed a computer vision algorithm to detect potential obstacles along the path of the USR by using a single camera attached at the head module of the robot and reflective markers on the obstacles. The area of the markers is a priori knowledge and can be used to calculate the 3D distance based on the corresponding area in the image similar to Bousaid et al. (2016). Different geometric shapes (i.e., triangle, square and circle). This can be used to classify different types of obstacles. The shape is determined by analyzing the curvature of the shape and counting the number of peaks.
In this paper, we perform experiments to investigate both the path following and obstacle avoidance control problem using the USR Mamba with thrusters (Kelasidi et al., 2016b). The goal of the experiments is to detect potential obstacles along the path and design the USR motion to ensure that the robot can converge to and follow a predefined reference path while avoiding the detected obstacles.
In Kelasidi et al. (2016b), it is suggested that in order to ensure efficient transportation, a USR with thrusters at the tail module should mainly use the thrusters for locomotion, while the multi-articulated body should be used for directional control. Motivated by these results, we propose a motion control strategy for thrusted USRs with an overall goal of investigating its ability to follow a given reference path. Several previous works consider control schemes for locomotion of USRs without thrusters. A comparison of these approaches is presented in Kelasidi et al. (2017b) and Kelasidi et al. (2016a). In addition, a docking approach for thrusted USRs using the joint angles to control the direction of the robot has been presented in Sans-Muntadas et al. (2017).
This paper presents a path following control strategy that is able to make the thrusted USR follow the desired reference path. Furthermore, the developed obstacle detection scheme was successfully applied and combined with a set-based collision avoidance method (Moe and Pettersen, 2016; Kohl et al., 2017). This approach ensures obstacle avoidance when necessary and path following otherwise.
The path following control concept and obstacle avoidance for USRs without thrusters has been investigated in Kohl et al. (2017). Here, both the direction and propulsion are achieved through the undulatory motion of the joints. In this paper, these methods are adapted to USRs with thrusters. In addition, an obstacle detection strategy is presented and combined with the path following and obstacle avoidance methods. The proposed guidance and control strategy and obstacle detection and obstacle avoidance strategy are experimentally validated for USRs with thrusters. To the authors' best knowledge experimental results regarding obstacle detection and avoidance have not been presented in previous literature for thrusted USRs.
This paper is organized as follows: Section 2 presents the experimental setup as well as the guidance and control methods for path following and obstacle avoidance and the obstacle detection algorithm. In section 3, the experimental results are presented and discussed. Conclusions are given in section 4.
2. Setup and Control System
In this section, we give a brief description of the thrusted USR Mamba and the experimental setup. Furthermore, we discuss and present how the guidance and control approach proposed earlier for USRs without thrusters are adapted for the experiments with the thrusted Mamba. Finally, the obstacle detection technique adopted in this paper and the set-based obstacle avoidance approach proposed for the thrusted USRs are presented.
2.1. Experimental Setup
The underwater snake robot with thrusters at the tail module named Mamba (Figure 2) is basically a self-propelled robotic arm with a slender and flexible body able to access and carry out inspection tasks in confined spaces not accessible by conventional underwater vehicles. Mamba has a modular design and can operate at shallow water depths. For more information about the robot, see Kelasidi et al. (2016a,b). Note that for the thrusted robot it is important to know the amplitude of the applied thruster forces as a function of the particular control input. Initial experiments were performed to obtain the necessary mapping from the thruster inputs uc to thruster forces Ft for the USR, and the results prove that the relationship is quite linear (Kelasidi et al., 2016b). Another purely bio-inspired configuration of the underwater snake robot Mamba with a passive caudal fin attached at the tail module of the robot (Figure 2) can be advantageous compared to the configuration with thrusters, since it does not produce significant acoustic noise. Moreover, a fin configuration will not perturb the surroundings as much as the thrusters, which is highly relevant for applications such as archaeological investigation of shipwrecks and non-invasive monitoring of marine life. A comparative study of the robot with and without a caudal fin was presented in Kelasidi et al. (2017a). In particular, it was shown that by attaching a passive caudal fin it is possible to double the forward velocity. This significant velocity increase requires a relatively low increase in power consumption, and is achieved with a minimum increase in the complexity of the mechanical design.
The robot considered in the current study consists of 18 joints mounted with a relative orientation of 90 degrees in an alternating fashion to achieve both yaw and pitch motion (Liljebäck et al., 2014). An external skin was used during the experiments in order to achieve an additional water barrier, in addition to making the robot's outer surface more smooth. The experimental setup is illustrated in Figure 3.
Figure 3. Experimental setup to investigate path following control and obstacle detection and obstacle avoidance using the underwater snake robot Mamba.
The experiments carried out in a basin at the Marine cybernetics laboratory (MC-lab), Trondheim, Norway (MCl, 2018). The basin is 1.5 m deep with a surface area of 40 m × 6.45 m. Six underwater cameras from Qualisys (QUA, 2018) were used to track and log the position and orientation θ of the robot, using a structure with reflective markers attached at the head or tail module. The center of mass (CM) px, py is then calculated using the kinematic equations of the robot (Kelasidi et al., 2016a). As illustrated in Figure 3, the obtained measurements were used to investigate different control challenges for the thrusted underwater snake robot Mamba. During these experiments the joint angles responsible for the vertical (pitch) motion were set to zero degrees to achieve purely horizontal motion. All the algorithms were implemented in an external computer using Labview, and the necessary signals were sent/received to/from the robot through a CAN bus connection through a tether. Figure 3 illustrates three different case studies for USRs with thrusters: (1) Locomotion efficiency studies Kelasidi et al. (2016b), (2) Path following of USR with thrusters, and (3) Switching strategy between path following, and obstacle detection and obstacle avoidance modes developed and experimentally validated in this paper. In the following sections, each part of the case studies illustrated in Figure 3 will be discussed in more detail.
2.2. Guidance and Control
The guidance and control system of the USR is illustrated in Figure 3 and the definition of the mathematical symbols are described in Table 1. The guidance system provides a reference θref for the orientation of the USR, which the controller attempts to follow by controlling the USR joints. The thrusters are controlled by the input uc and each joint follows the output from the heading controller ϕ0 according to (1). The proposed control strategy assumes that the robot joints are used for directional control, while the propulsion of the robot is given only by the thrusters. It is a decoupled system where the values of the control input uc is responsible for controlling the forward velocity of the robot, while the heading controller (1) is responsible for the turning motion of the robot.
Obstacle avoidance is by its very nature a safety feature which should be activated when necessary and otherwise not affect the behavior of the system. In this paper, the default mode of operation is straight line path following, although this objective may easily be replaced by another mode of operation to be combined with the proposed obstacle avoidance method. For more details, see section 2.3 and Moe and Pettersen (2016). To achieve a guidance system with a path following and an obstacle avoidance mode, we employ a guidance law from Kohl et al. (2017) which is suitable both for straight line and circular path following. The latter is applied for obstacle avoidance to encircle obstacles on the way.
Obstacles are avoided by ensuring that the USR always maintains a certain safe distance between itself and the obstacle. Thus, in our obstacle avoidance guidance system we propose to encircle an obstacle, whose center position is defined as Po = [Pox, P oy]T, with a virtual circle of radius Rs. The circle center is anchored in the obstacle center, and the radius is chosen sufficiently large so that if the USR is outside or on Rs, a collision will not occur. Therefore, Rs is referred to as the safe radius, and the formalized control objective of the obstacle avoidance is to ensure that the USR is always outside or on Rs.
A variety of different path following control approaches for USRs without thrusters have been studied in previous literature (McIsaac and Ostrowski, 2003; Lapierre and Jouvencel, 2005; Alamir et al., 2007; Kelasidi et al., 2016a, 2017b). An introductory discussion comparing the different control approaches studied for underwater swimming robots can be found in (Kelasidi et al., 2016a, 2017b). In this paper, we present experimental results for the underwater snake robot Mamba with thrusters at the tail module, using the path following control approach described below.
The control approach consists of a path following guidance law responsible for producing the reference orientation θref, pf, the heading controller responsible for making the actual orientation θ track the reference orientation, and the control input uc to the thrusters responsible to propel the robot forward. The reference orientation θref, pf of the robot is calculated using the guidance law presented in (1), which for the straight line path following reduces to the well-known LOS guidance law. The LOS approach is based on a term guiding the vehicle in question along the desired path and another toward the path. The latter is reduced to zero when the vehicle is on the desired path and is commonly used both for marine vehicles (Børhaug and Pettersen, 2006; Breivik and Fossen, 2008) and USRs (Kelasidi et al., 2016a, 2017b).
In this paper, the reference path is aligned with the world x-axis. Therefore, the y-position of the USR py is defined as the path cross-track error for path following. The orientation of the robot was measured using the underwater camera positioning system as shown in Figure 3 by attaching reflective markers at the tail module of the robot. The heading controller (2) is used to generate the joint angle offset, ϕ0, which is sent to the robot via the CAN.
There are multiple possible definitions of the orientation of an USR (Kelasidi et al., 2016a; Kohl et al., 2016). In this paper, the orientation θ of the robot is defined as the orientation of the head angle θ: = θN. In the experimental setup, the USR position and orientation is measured using the underwater positioning system in the lab (see Figure 3). The reference orientation is defined by the following guidance law (Kohl et al., 2017):
Here, h(p) is a cost function that implicitly defines the reference path, is a vector that is normal to the level sets of h, ktran is the transversal gain, and kalong the along-path gain. This reference angle is referred to as θref, pf and is utilized as a reference for path following (see Figure 3).
Since is perpendicular to the level sets of h(·), the control law (1) can be intuitively described as follows. The reference velocity μ(p) is composed of two components: The first component is perpendicular to the level sets of h(·) and decreases the distance of the center of mass to the curve γ = h−1(0). The second component is tangent to the level sets of h(·) and regulates the velocity of the center of mass on the curve γ = h−1(0). The choice of ν enables us to choose the direction which the robot should follow around the obstacle.
Analogously, the angle θref, oa obtained from (1) by using is used as a reference for obstacle avoidance. In this case, the parameter ν controls the USR direction of motion, and is chosen such that the USR circumvents an obstacle by deviating as little as possible from the reference straight line path. Note that for this guidance scheme it is sufficient to know the position of the obstacles relative to the USR. However, in this paper we have calculated the obstacle world position because the obstacles are detected relative to the camera frame (attached to the USR head link), whereas the position of the USR is given as the CM.
When applied to a straight line, the guidance law (1) ensures that the USR converges to the reference path. However, for a circular path, the guidance law (1) ensures that the robot approaches the path and thereafter remains close to it with a constant offset outside the radius Rs.
Remark 1. Note that the offset can be made small by increasing ktran or eliminated completely by adding integral action to the guidance law. However, in this paper we deliberately choose to employ a rather small ktran and thus always keep the USR safely outside the circle, rather than ensure that it converges closer to the safe radius Rs and possibly overshoots.
The final part of the guidance system is an algorithm which determines if path following or obstacle avoidance is the active mode. This is described in more detail in section 2.3.
In Sans-Muntadas et al. (2017) it is proposed to set the reference for each joint as
i.e., to make each joint have the same value, providing an even curvature along the whole robot. This is different from Kohl et al. (2017) where undulations are used for propulsion, and the joint references include an additional sinusoidal term with a phase shift between the joints. Instead (1) ensures that the joints are used only for directional control, while the thrusters are used to propel the robot forward. In particular, Sans-Muntadas et al. (2017) has shown that by using (1) the robot managed to converge nicely toward and move along the desired path. Hence, in order to steer the thrusted USR to the reference orientation, the parameter ϕ0 is used to control the direction of the robot. To steer the orientation θ according to the guidance law (1), the following PD controller is used to define the joint angle offset (Kohl et al., 2017):
In the above equation, the control gains kp and kd are constant and positive. In addition, to ensure that the joint angle ϕi tracks the reference signal , a low level P-controller is implemented in the microcontrollers inside each module of Mamba. Similarly, to assign a rotational speed to the thrusters, a corresponding low level controller is implemented to ensure that the two tail thrusters track the reference uc.
2.3. Set-Based Obstacle Avoidance
It is clear that tasks such as path following and obstacle avoidance are not necessarily compatible. If an obstacle is somewhere along the path, the USR either has to deviate from the path or collide. We therefore propose a switched control system with a path following and an obstacle avoidance mode. The default mode of operation, which is active as long as it will not lead to a collision, is path following. When the USR is close to an obstacle and path following will further decrease that distance, the system switches to collision avoidance mode.
The switched guidance system is based on recent results in set-based control (Moe et al., 2016). Here, a widely used kinematic control framework is extended to handle set-based tasks, which have a valid interval of values rather than en exact desired state. Obstacle avoidance may be described as such a task, where the distance between the USR and an obstacle should be kept within a certain interval. In particular, the valid interval is given by all positive numbers above the lower bound Rs. However, the approach proposed in Moe et al. (2016) is applicable to redundant systems to fulfill several, compatible tasks simultaneously. Since the two control objectives, i.e., path following and obstacle avoidance, are not compatible, we therefore alter the approach according to Moe and Pettersen (2016) and Kohl et al. (2017) to switch between the two tasks, i.e., the two guidance laws θref, pf and θref, oa described in section 2.2.
For the switched system we introduce an additional circle, which is also anchored in the obstacle center po, with a radius Rm > Rs. The radius Rm is referred to as the mode change radius. Outside the mode change radius, the guidance system is always in path following mode. Inside Rm, either mode may be active. If path following mode will not lead to the distance between the USR and the obstacle decreasing further, it is active. Otherwise, obstacle avoidance is activated, and the USR should converge toward the safe radius Rs. The mode change radius must be chosen sufficiently large so that in case of a switch to obstacle avoidance mode, the USR converges to the safe radius without overshoot. This is partly achieved by tuning the obstacle avoidance guidance law such that the USR converges to an offset outside Rs rather than to the actual safe radius as described in the previous section. The desired switching behavior is captured by Algorithm 1, which is based on set-based theory described in Moe et al. (2016), Moe and Pettersen (2016), and Kohl et al. (2017).
Remark 2. Note that a similar approach is applied in Kohl et al. (2017) for obstacle avoidance of snake robots without thrusters that is able to propel forward only by using undulatory gaits. Due to the oscillatory behavior of the swimming snake robots, the set-based approach must be more conservative to ensure that no part of the robot collides with the obstacle. For thrusted USRs in this paper, we exploit the fact that the thrusters ensure forward propulsion and the joints control the direction of motion by letting the robot safely curve around the obstacle.
For the obstacle avoidance scenario described above, the obstacle avoidance task σ is defined as the distance between the USR CM and an obstacle. It has a valid interval D = [Rs, ∞), and the input parameters are illustrated in Figure 4, where θref, pf is the desired heading for path following and θo is the angular coordinate of the obstacle. Thus, as illustrated in Figure 4, path following will result in the distance between the USR and the obstacle increasing when the angle between θref, pf and θo is less than π/2. In this case, path following is active also within the radius Rm. Note that by using the CM of the USR when calculating σ, part of the USR is actually allowed within the safe radius Rs. This must be accounted for by choosing a sufficiently large Rs. Furthermore, the switching strategy in Algorithm 1 is completely general, and may be applied for any combination of guidance laws to achieve alternative desired behaviors such as target tracking, trajectory tracking or other path following schemes.
Figure 4. Obstacle avoidance parameters: the set-based task σ is defined as the distance between the obstacle center and the USR. Outside the mode change radius Rm, the system is always in path following mode. The desired straight line path lies along the x-axis. The desired heading for path following is defined as θref, pf and indicated by the black arrows for several USR positions and orientations. Inside Rm, the system is in path following mode if it will lead to an increase in σ, i.e., when the angle between θref, pf and θo is smaller than or equal to π/2. Otherwise, obstacle avoidance mode is active, in which case the desired heading is defined by θref, oa and the USR should converge the and track the safe radius Rs.
Remark 3. Note that this method is valid for multiple obstacles given that said obstacles are not overlapping or moving. In these experiments, only one stationary obstacle was used due to the limited size of the test basin. Handling overlapping and moving obstacles is a topic for future work.
2.4. Obstacle Detection
In this paper, we assume that the USR is to operate in some structured environment which we are free to influence, e.g., an underwater oil and gas structure. Hence, we presume that potential obstacles are marked with some sort of geometric shape that may be detected using a camera on the USR head and computer vision. Thus, obstacles of different sizes may be marked with different shapes. For unforeseen events such as debris another detection scheme must be applied. However, note that a set-based approach is still applicable for avoidance given estimation of obstacle position and velocity.
For these experiments, we used the pinhole camera model (Medioni and Kang, 2004) to derive the equations applied in the implemented detection algorithm. Three geometric shapes with a known area Ar have been constructed using reflective tape, and these represent the obstacles in the experiments: a circle, a triangle and a square (see Figure 5). To avoid an obstacle by circumventing it as described in sections 2.2 and 2.3, the obstacle position in the world coordinate frame po must be known. Hence, the goal of the obstacle detection algorithm is to calculate this position.
The obstacle detection algorithm is based on four main steps, which are illustrated in Figure 6: (1) Recognize and classify an obstacle marker as a triangle, square or circle, (2) find the position and area of the marker in the image xp, yp and Ap, (3) compare Ap to the actual area of the marker Ar and use the camera focal length f and the marker position in the image to calculate the 3D obstacle position relative to the camera , and (4) find the obstacle position relative to the world coordinate frame po by rotating and transltaing about the camera frame orientation and position. The detailed implementation can be found in Algorithm 2.
Figure 6. The 3D-position of a marker relative to the camera coordinate system can be calculated using the focal length f of the camera, the area of the marker in the image AP and reality Ar and the position of the marker in the image coordinate system (xp, yp). In this paper, the USR is moving in the plane, so the vertical component yr can be ignored. (A) Convert input image to black and white. (B) Find closed boundaries, smoothen them, calculate curvature and count number of peaks to classify geometric shape. (C) Find the position (xp, yp) and the area of the shape Ap in the image coordinate system. (D) Use the pinhole camera model, camera focal length f and the actual area of the shape Ar to calculate the 3D-position of the detected shape relative to the camera coordinate frame. (E) The calculated position is referred to as . (F) Use the USR camera position and orientation to calculate the detected position in the world coordinate frame po.
Remark 4. Note that the equations in Figure 6D are based on the assumption that the obstacle marker is oriented parallel to the camera coordinate system xy-plane, i.e., that all the corners of the triangle have the same z-coordinate. This assumption is not satisfied if the camera is looking at a marker at an angle. However, due to the relatively small size of the markers, the potential difference in the z-coordinate of the corners is limited and small compared to the distance at which it is necessary to observe them to successfully avoid the obstacle. Thus, this assumption is a valid approximation and will result in a limited error in the calculated position.
3. Experimental Results
In this section, we discuss the obtained experimental results for the proposed path following control strategy (section 3.1) and the obstacle detection and avoidance concept (sections 3.2–3.3) described in previous section using the thrusted USR Mamba.
3.1. Straight Line Path Following
In all experiments the joint angles of the robot were set to zero, whereas the initial orientation, θ(0), the position of the CM of the robot along the y axis, py, the proportional control gain, kp, the look-ahead distance, Δ, and the control input to the thrusters, uc, are displayed in Table 2 for each trial. The average power consumption is calculated by using the following expression
where V = 35 [V] and Iavg [A] is the average current that is measured using the high performance industrial logging multimeter FLUKE 289. In addition, the average forward velocity for each experimental trial was calculated as
where pstart and pstop represent the initial and the final points of the distance traveled in the time interval tstop − tstart. The control gain kd was set to zero for the experimental results presented for the straight line path following control approach. In addition, the joint offset ϕ0 has been saturated at ±20° to ensure that the physical limitation of the robot joint angles is not exceeded.
Table 2. The average forward velocity and power consumption for the path following case studies using the underwater snake robot mamba with thrusters.
Previous experimental results for path following of underwater snake robots using the body undulation for both propulsion and directional control, showed that the robot was able to reach and follow the path using the LOS guidance law (Kelasidi et al., 2016a, 2017b). However, the use of an oscillatory gait pattern causes steady state oscillations about zero for the cross-track error and the orientation, which is expected since it is difficult to achieve a purely non-oscillating motion for the CM and the orientation of underwater swimming snake robots (Kelasidi et al., 2016a, 2017b). These oscillations can be restrictive for several applications in subsea environment, such as for instance docking (Sans-Muntadas et al., 2017).
Experimental results for four different path following trials of Mamba with thrusters are presented in Figure 7, see also the Supplementary Videos. As Figure 7 illustrates, the robot manages to converge to and follow the desired path for all the investigated cases. Furthermore, the reference orientation is tracked without oscillations. The overshoot and the initial rapid change on the orientation shown in Figure 7 as the snake robot converges to the path is a result of the tuning, and in particular the choice of the look-ahead distance Δ. The larger the choice of Δ is, the smaller the overshoot will be, and the slower the convergence rate will be. The choice of Δ is thus a trade-off between convergence and the overshoot (Kelasidi et al., 2017b). The small steady state error in cross-track error may be a result of several factors, such as the possible misalignment of the two thrusters used at the tail module of the robot, measurement errors from the different sensors used during the experiments, and the forces on the robot due to the use of the tether. In the future, more advanced heading control approaches can be investigated to remove this small error, for instance by including integral action (Caharija et al., 2012). In addition to the convergence to the straight line path, we obtained results regarding the achieved forward velocity and the power consumption for all the investigated trials, and these are shown in Table 2. The achieved velocity is very similar in all trials, which is expected since the same control input value for the thrusters was used for all the investigated cases. However, the average power consumption varies for the different investigated path following case studies as shown in Table 2. This is reasonable since the power consumption is related not only to the trusters, but also to the joint modules. The actuation of the directional control and thereby the joint motion for each trial depends on the initial heading and distance from the path, which varies in the different trials.
Figure 7. Experimental results path following. (A) Center of mass position for uc = 60, kp = 1, kd = 0, Δ = 180cm and θ = −82.7o. (B) Center of mass position for uc = 60, kp = 1, kd = 0, Δ = 90cm and θ = −26.2o. (C) Center of mass position for uc = 60, kp = 1, kd = 0, Δ = 90cm and θ = 21.4o. (D) Center of mass position for uc = 60, kp = 1, kd = 0, Δ = 130cm and θ = 2.7o. (E) The orientation of the robot for case (A). (F) The orientation of the robot for case (B). (G) The orientation of the robot for case (C). (H) The orientation of the robot for case (D). (I) The motion of the underwater snake robot Mamba with thrusters during the path following for the experimental results presented in (C,G), where the red line indicates the reference path.
3.2. Obstacle Detection
For the experiments presented in this paper, the obstacle detection algorithm was run off-line and the detected position was added manually to the switched guidance and control system described in section 2.3. However, the algorithm also has the potential to be fully autonomous as part of the online control system; the detection algorithm is sufficiently fast that runtime will not be a concern in an online implementation. The implementation of the necessary communication and control structure required to achieve this is a topic of future work. However, in the presented results the obstacle detection algorithm was run and the detected position added to the control system in one operation without removing the robot from the pool or turning it off.
To detect the obstacle position, the detection algorithm described in Figure 6 was run three times for different camera positions and orientations, see Figures 8, 9A. Note that when testing the obstacle detection scheme, the available USR positions and orientations where the obstacle marker was in the camera frame were limited by the pool size and the Qualisys tracking system. The average of the three detected positions po was then inserted into the control system and used for the remainder of the experiments. To quantify the accuracy of the algorithm, the actual position of the obstacle was measured using the Qualisys tracking system, and the final detected position po was approximately 0.07 m from the actual obstacle position, which corresponds to 7% of the safe radius Rs = 1 m and 3.9% of the total length of the robot. This result is sufficiently accurate to safely use for the obstacle avoidance scheme, thereby confirming that the proposed detection approach is highly applicable. Note that to achieve a sufficiently good visual to detect and classify the reflective markers and to simulate a subsea environment as closely as possible, all lights were turned off during the experiments with the exception of the lights on the camera of the USR and the Qualisys tracking system.
Figure 8. The obstacle detection algorithm described in Figure 6 was run three times for different USR positions and orientation shown as magenta, blue and red, respectively. For the two latter cases, the algorithm also detects the distorted surface reflection of the markers and classifies it as a square and a triangle, respectively. For a true underwater applications this phenomena will not occur, and these fake detections are easily disregarded by observing that their y-coordinate is negative, i.e., they are above the surface. (A) The average detected position ♢ was 7 cm from the actual obstacle position ○. (B) The detected obstacle position relative to the camera corresponding to magenta in (A). (C) The detected obstacle position relative to the camera corresponding to blue in (A). (D) The detected obstacle position relative to the camera corresponding to red in (A).
Figure 9. Experimental results for path following with detected obstacle position and obstacle avoidance. (A) The obstacle detection algorithm described in Figure 6 was run three times for different USR positions and orientation. The average detected position ♢ was approximately 0.07 m from the actual obstacle position ○. (B) The path of the USR as it follows the path (blue), switches to obstacle avoidance and circumvents the detected obstacle (green) and finally switches back to path following (blue). (C) The actual and desired orientation of the robot. The control system switches from path following to obstacle avoidance at ≈ t = 13 s and back again at ≈ t = 37 s. (D) The motion of the underwater snake Mamba with thrusters during the obstacle detection and avoidance experiments. Corresponding positions are indicated in (B).
3.3. Obstacle Avoidance
The experimental setup for path following and obstacle avoidance is identical to the one described in the previous section, and experimental results are shown in Figures 9B–D. A recording of the experiment can be seen in the Supplementary Videos. The USR initial position is on the reference path, and the initial mode is path following. Once the USR enters the mode change radius Rm = 3 m, it is evident that continued path following will result in the USR getting closer to the obstacle. Hence, obstacle avoidance is activated, and the robot circumvents the obstacle by turning and attempting to stay outside the safe radius Rs = 1 m. According to the theory described in section 2.2, the USR converges to a constant offset of the safe radius, which could be made smaller by a different choice of control gains. However, for this application it is crucial to avoid overshoot into Rs, and thus a larger offset is preferable. Furthermore, the position of the USR is defined by the CM, which also requires a more conservative approach since part of the USR will in fact be allowed to enter the safe radius Rs and must be able to do so safely. Finally, the physical obstacle in the pool partly blocked the camera tracking system, making it infeasible with the available experimental setup to attempt less conservative approaches which would exploit the flexibility of the USR better. Note that the robot circumvents the obstacle by choosing the direction along the circle that ensures the shortest path as discussed in section 2.2.
As the USR circumvents the obstacle, path following will once again ensure that the robot moves away from the obstacle. Path following is then reactivated and the robot converges back to the path. This can be seen in Figure 9B. Figure 9C displays the reference orientation provided by the switched guidance system and the actual orientation of the USR. The implemented PD-controller ensures that the reference is tracked in a sufficiently accurate manner. Note that the switched guidance system described in Algorithm 1 results in abrupt changes in the reference orientation when the system switches between path following and obstacle avoidance. To provide the control system with a feasible reference signal, a hyperbolic smoothing function is implemented to ensure a continuous reference signal after a switch (Kohl et al., 2017). In addition, the commanded joint offset, ϕ0, is filtered with a first-order low-pass filter before it enters the low-level controller.
Figure 9D displays images from the experiment. The USR clearly circumvents the obstacle on a circular path before converging back to the reference path. The chosen control parameters for the implementation are as follows:
1. Path following guidance law θref, pf: ktran = 0.1, kalong = 0.15 (corresponding to a look-ahead distance Δ = 1.5 m)
2. Obstacle avoidance guidance law θref, oa: ktran = 0.02, kalong = 0.15
3. Controller ϕo: kp = 0.42, kd = 0.03
4. Smoothing function:
USRs have a multitude of essential qualities for autonomous underwater operations, such as efficient locomotion, flexible bodies and the possibility to perform intervention tasks. These highly versatile robots may be equipped with different modules such as thrusters or fins, and are applicable for a variety of tasks within several fields of research.
In this paper, we present a guidance and control system to ensure path following and obstacle avoidance of a USR with thrusters, in addition to a computer vision algorithm to detect and calculate the position of potential obstacles. Based on preliminary results to ensure energy efficient motion and high velocity, the USR motion relies on thrusters for forward propulsion, whereas directional control is achieved through the joints of the body. The proposed methods are all experimentally verified for the first time, using the thrusted USR Mamba for the first time. Future work includes extending the proposed guidance and control approach to 3D in order to be able to investigate path following and obstacle avoidance of USR with thrusters in 3D.
All authors listed have made a substantial, direct and intellectual contribution to the work, and approved it for publication.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
This work was funded by the Research Council of Norway through its Centres of Excellence funding scheme, project no. 223254-NTNU AMOS, and by VISTA - a basic research program in collaboration between The Norwegian Academy of Science and Letters, and Statoil.
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/frobt.2019.00057/full#supplementary-material
Supplementary Video 1. Obstacle avoidance.
Supplementary Video 2. Path following thrusted Mamba.
Alamir, M., El Rafei, M., Hafidi, G., Marchand, N., Porez, M., and Boyer, F. (2007). “Feedback design for 3D movement of an EEL-like robot,” in Proceedings of the IEEE International Conference on Robotics and Automation (Roma), 256–261.
Bousaid, A., Theodoridis, T., and Nefti-Meziani, S. (2016). “Introducing a novel marker-based geometry model in monocular vision,” in 2016 13th Workshop on Positioning, Navigation and Communications (WPNC) (Bremen), 1–6.
Caharija, W., Pettersen, K. Y., Gravdahl, J. T., and Børhaug, E. (2012). “Integral LOS guidance for horizontal path following of underactuated autonomous underwater vehicles in the presence of vertical ocean currents,” in Proceedings of the American Control Conference (Montreal, QC), 5427–5434.
Crespi, A., Badertscher, A., Guignard, A., and Ijspeert, A. (2005). “Swimming and crawling with an amphibious snake robot,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (Barcelona), 3024–3028.
Crespi, A., and Ijspeert, A. J. (2006). “AmphiBot II: an amphibious snake robot that crawls and swims using a central pattern generator,” in Proceedings of the 9th International Conference on Climbing and Walking Robots (CLAWAR) (Brussels), 19–27.
Goldberg, S. B., Maimone, M. W., and Matthies, L. (2002). “Stereo vision and rover navigation software for planetary exploration,” in Proceedings of the IEEE Aerospace Conference Proceedings (Big Sky, MT), 5.
Kelasidi, E., Kohl, A. M., Pettersen, K. Y., and Gravdahl, J. T. (2017a). “An experimental investigation of path following for an underwater snake robot with a caudal fin,” in Proceedings of the 20th World Congress of the International Federation of Automatic Control (Toulouse), 11182–11190.
Kelasidi, E., Liljebäck, P., Pettersen, K. Y., and Gravdahl, J. T. (2016a). Innovation in underwater robots: biologically inspired swimming snake robots. IEEE Robot. Automat. Mag. 23, 44–62. doi: 10.1109/MRA.2015.2506121
Kelasidi, E., Liljebäck, P., Pettersen, K. Y., and Gravdahl, J. T. (2017b). Integral line-of-sight guidance for path following control of underwater snake robots: theory and experiments. IEEE Trans. Robot. 33, 1–19. doi: 10.1109/TRO.2017.2651119
Kelasidi, E., Pettersen, K. Y., and Gravdahl, J. T. (2015). “Energy efficiency of underwater robots,” in Proceedings of the 10th IFAC Conference on Manoeuvring and Control of Marine Craft (Copenhagen), 152–159.
Kelasidi, E., Pettersen, K. Y., Liljebäck, P., and Gravdahl, J. T. (2016b). “Locomotion efficiency of underwater snake robots with thrusters,” in Proceedings of the IEEE International Symposium on Safety, Security, and Rescue Robotics (Lausanne), 174–181.
Kohl, A., Moe, S., Kelasidi, E., Pettersen, K. Y., and Gravdahl, J. T. (2017). “Set-based path following and obstacle avoidance for underwater snake robots,” in IEEE International Conference on Robotics and Biomimetics (Macau), 1206–1213.
Kohl, A. M., Kelasidi, E., Mohammadi, A., Maggiore, M., and Pettersen, K. Y. (2016). Planar maneuvering control of underwater snake robots using virtual holonomic constraints. Bioinspir. Biomimet. 11:065005. doi: 10.1088/1748-3190/11/6/065005
Koren, Y., and Borenstein, J. (1991). “Potential field methods and their inherent limitations for mobile robot navigation,” in Proceedings of the IEEE International Conference on Robotics and Automation (Sacramento, CA), 1398–1404.
Kuwata, Y., Wolf, M. T., Zarzhitsky, D., and Huntsberger, T. L. (2014). Safe maritime autonomous navigation with COLREGS, using velocity obstacles. IEEE J. Ocean. Eng. 39, 110–119. doi: 10.1109/JOE.2013.2254214
Laubach, S. L., and Burdick, J. W. (1999). “An autonomous sensor-based path-planner for planetary microrovers,” in Proceedings of the 1999 IEEE International Conference on Robotics and Automation (Detroit, MI), Vol. 1, 347–354.
Lei, G., Zhitao, X., Jun, W., Fang, Z., and Jinghong, M. (2013). Monocular vision distance measurement method based on dynamic error compensation. Int. J. Digit. Content Technol. Appl. 7, 230–237. doi: 10.4156/jdcta.vol7.issue5.28
Li, B., Yu, S., Ma, S., and Wang, Y. (2011). “An amphibious snake-like robot with novel gaits on ground and in water,” in Proceedings of the IASTED International Conference Intelligent Systems and Control (ISC 2011) (Calgary, AB), 100–105.
Lighthill, M. J. (1975). Mathematical Biofluiddynamics. Society for Industrial and Applied Mathematics. Available online at: https://www.cambridge.org/core/journals/journal-of-fluid-mechanics/article/mathematical-biofluiddynamics-by-m-j-lighthill-society-for-industrial-and-applied-mathematics-1975-281-pp-2150/16A1602AAA4ED4BF89C7258E9365FFDA
Liljebäck, P., Stavdahl, Ø., Pettersen, K., and Gravdahl, J. (2014). “Mamba - a waterproof snake robot with tactile sensing,” in Proceedings of the International Conference on Intelligent Robots and Systems (Chicago, IL), 294–301.
McIsaac, K., and Ostrowski, J. (2002). “Experiments in closed-loop control for an underwater eel-like robot,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (Washington, DC), 750–755.
MCl (2018). Marine Cybernetics Laboratory (MC-Lab). Available online at: https://www.ntnu.edu/imt/lab/cybernetics (accessed September 25, 2018).
Mclsaac, K., and Ostrowski, J. (1999). “A geometric approach to anguilliform locomotion: modelling of an underwater eel robot,” in Proceedings of the International Conference on Robotics and Automation (ICRA) (Detroit, MI), 2843–2848.
Moe, S., Antonelli, G., Teel, A. R., Pettersen, K. Y., and Schrimpf, J. (2016). Set-based tasks within the singularity-robust multiple task-priority inverse kinematics framework: general formulation, stability analysis, and experimental results. Front. Robot. AI 3:16. doi: 10.3389/frobt.2016.00016
Moe, S., and Pettersen, K. Y. (2016). “Set-based line-of-sight (LOS) path following with collision avoidance for underactuated unmanned surface vessel,” in Proceedings of the 24th Mediterranean Conference on Control and Automation (Athens), 402–409.
QUA (2018). Qualisys–Motion Capture Systems. Available online at: http://www.qualisys.com/ (accessed September 25, 2018).
Sans-Muntadas, A., Kelasidi, E., Pettersen, K. Y., and Brekke, E. (2017). “Spiral path planning for docking of underactuated vehicles with limited fov,” in Proceedings of the 1st IEEE Conference on Control Technology and Applications (Hawaii), 732–739.
Stefanini, C., Orofino, S., Manfredi, L., Mintchev, S., Marrazza, S., Assaf, T., et al. (2012). A novel autonomous, bioinspired swimming robot developed by neuroscientists and bioengineers. Bioinspir. Biomimet. 7:025001. doi: 10.1088/1748-3182/7/2/025001
Sverdrup-Thygeson, J., Kelasidi, E., Pettersen, K. Y., and Gravdahl, J. T. (2016a). “A control framework for biologically inspired underwater swimming manipulators equipped with thrusters,” in Proceedings of the 10th IFAC Conference on Control Applications in Marine Systems (Trondheim), 89–96.
Sverdrup-Thygeson, J., Kelasidi, E., Pettersen, K. Y., and Gravdahl, J. T. (2016b). “The underwater swimming manipulator - a bio-inspired auv,” in Proceedings of the IEEE/OES Autonomous Underwater Vehicles (Tokyo), 387–395.
Takayama, T., and Hirose, S. (2002). “Amphibious 3d active cord mechanism "helix" with helical swimming motion,” in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (Lausanne), 775–780.
van den Berg, J., Guy, S. J., Lin, M., and Manocha, D. (2011). “Reciprocal n-body collision avoidance,” in Robotics Research: The 14th International Symposium ISRR (Berlin; Heidelberg: Springer), 3–19.
Wilbur, C., Vorus, W., Cao, Y., and Currie, S. (2002). “A lamprey-based undulatory vehicle,” in Neurotechnology for Biomimetic Robots, eds J. Ayers, J. L. Davis, and A. Rudolph (Cambridge: Bradford/MIT Press), 285–296. Available online at: https://cbns.ucr.edu/faculty/currie_robolamprey2002.pdf
Yamada, H., Chigisaki, S., Mori, M., Takita, K., Ogami, K., and Hirose, S. (2005). “Development of amphibious snake-like robot ACM-R5,” in Proceedings of the 36th International Symposium on Robotics (Tokyo).
Keywords: underwater snake robots, energy efficiency, thrusted USR, path following, obstacle detection and avoidance
Citation: Kelasidi E, Moe S, Pettersen KY, Kohl AM, Liljebäck P and Gravdahl JT (2019) Path Following, Obstacle Detection and Obstacle Avoidance for Thrusted Underwater Snake Robots. Front. Robot. AI 6:57. doi: 10.3389/frobt.2019.00057
Received: 13 December 2018; Accepted: 27 June 2019;
Published: 23 July 2019.
Edited by:Yongping Pan, National University of Singapore, Singapore
Reviewed by:Matthew Jason Bays, Naval Sea Systems Command (NAVSEA), United States
Dimitris Tsakiris, Foundation for Research and Technology Hellas, Greece
Copyright © 2019 Kelasidi, Moe, Pettersen, Kohl, Liljebäck and Gravdahl. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
†These authors have contributed equally to this work and significantly in writing this paper