Abstract
This paper is a systematic review of studies that used multicriteria decision analysis (MCDA) to address plastic waste management. A literature search for scientific articles in online databases (Web of Science and Scopus) enabled us to identify 20 relevant papers from 2008 to 2021, spanning case studies in three continents. These studies focus on: plastics as a resource (material), plastics as a product (reverse logistics), and plastics as a problem (pollution). Content analysis methodology was used, with the focus being on how the authors used MCDA for managing plastic waste, which has relevance for researchers and practitioners. Alternative solutions were found for the selection of disposal methods for almost all types of plastic categorized in this review. The most popular method was AHP, followed by TOPSIS, outranking methods, MAUT/MAVT and simple weighted sums, with some studies including more than one method. The choice of criteria spanned operational (mostly), but also environmental and economic aspects to evaluate the alternatives. Less frequently, one finds criteria related to social, managerial, and political aspects. The weighting of the criteria was performed mainly by consulting experts, followed by decision makers. Representatives of the affected population or other stakeholders have been consulted only on a few occasions. The authors of the studies consider their application of MCDA was successful, highlighting mainly the importance of being able to encompass different dimensions in the evaluation of the alternatives and the transparency of the process. In most cases, a winning alternative emerged clearly, which sometimes was a combination of multiple strategies. We also report other recommendations of these authors concerning marine and terrestrial plastic waste management.
Introduction
The invention of plastic as a material dates back to 1909. It has improved the comfort, quality, and safety of our societies. As the world population increased and new technological developments gave rise to a very extensive use of commercial and industrial plastic-based materials, these resources became essential in the various different supply chains of many goods. However, the effects of these plastics have relatively recently turned out to be considered a major concern to sustainable development. More and more activities are focused on the life-cycle of plastics and on design innovation for end-of-life actions, to reduce the environmental impact of plastic pollution.
When a plastic component or plastic based good no longer works within the specified parameters which it has been designed for, it has reached its end-of-life. At this point it frequently becomes waste. Increasingly often, it turns out to be considered a valuable resource. However, there are still end-of-life options just using landfills for its disposal. Around the world, a huge number of plastic objects are abandoned or rejected without any concern about the consequences for the environment. Sources of plastic waste are multiple: sanitation and sewage, electrical components, automotive and air industries, commercial fishing activities, tourism, health care systems, construction, agriculture, and packaging, among many others. Terrestrial and marine settings are being impacted and aquatic wildlife and ecosystems (both freshwater and marine) are being radically harmed.
found that 80% of the eight billion kilograms of human generated debris reaching the oceans in 2010 (growing exponentially by 10% each year) consisted of plastic. Many activities, such as marine transportation and fishing industries, are suffering extensive damage. Plastics take a long time to decompose, and they become persistent pollution (see ; ; ).
Therefore life-cycle, particularly end-of-life plastics management actions are a growing priority and key political issue. From fundamental research to the integration of knowledge sourced from different areas, to industry, consumer behaviors and the public, regulatory, and business worlds, this must be a collective will.
The European Union defined a waste hierarchy that shall apply as a priority order in waste prevention and management legislation and policy: (a) prevention; (b) preparing for re-use; (c) recycling; (d) other recovery, e.g., energy recovery; and (e) disposal ().
Improving the development of sound solutions for responding to these sustainability challenges has to be the focus. These are quite complex problems involving many actors with conflicting perspectives, including industry, tourism, fishing activities, vessel owners, environmentalists, consumers, financial institutions, governments, etc. This is crucial because the decision-making process depends on the input of the different points of view provided by all the stakeholders. Multicriteria decision analysis (MCDA) can offer a clear, well-organized way to better inform decision-making. It can simultaneously encompass so many different facets covering all the different issues at stake and account for the priorities set by stakeholders for evaluating solutions for plastic waste management (; ).
Multicriteria decision analysis is a way to address problems in which the decision alternatives to improve a problematic situation can be evaluated according to multiple criteria. According to , MCDA can be used to solve any problem where a significant decision needs to be made: choosing the single best option, sorting options, ranking alternatives, describing options and their consequences, eliminating alternatives, and identifying or creating a new strategy. MCDA helps to find better decisions not only by using an appropriate method but also, as notes, because of the insights provided throughout the reasoning process and “value-focused glasses” perspective used. The values approach guides the decision-maker not only to find better suited alternatives but also to recognize improved decision situations. MCDA fosters the use of a value-based perspective aggregating multiple dimensions, with a recognized potential to involve the concerns and aspirations of multiple stakeholders.
This is a systematic review paper whose main purpose is answering the following questions: (a) How do studies use multicriteria decision methods to manage plastic waste in the marine and terrestrial environments? (b)What are the recommendations to address marine and terrestrial plastic management?
The study presents an overview of existing multicriteria decision methods for managing plastic waste and related approaches in an increasingly plastic-using context. A systematic literature search delivered 20 papers matching the purpose of this review. 80% of them were published in the last 5 years, showing this is an emerging area of research. Although these studies are ultimately addressing pollution by plastics they have different foci. Some studies focus on plastic as a resource, seen as a beneficial material that offers unparalleled functionality, so how to maintain and improve it through recycling and reuse is the issue. Other studies focus on plastics as a product through reverse logistics, a process that offers customers the chance to return end-of-life plastics or raw equipment to suppliers or manufacturers and, as such, can be revaluated and reintroduced into the supply chain. And another group focuses on plastics as a problem, causing great damage when they reach the environment. This is why it is essential to devise actions to address the negative impacts of this pollution on the most diverse natural terrestrial, freshwater and marine habitats. Content analysis methodology was used, and the focus was on how the authors used the multicriteria decision approaches for managing plastic waste. Figure 1 provides a graphical summary of the characteristics of the studies analyzed in this review. This can help to better understand the use of this methodology for decision making in this field. It can also provide benchmarking for carrying out subsequent studies and to create guidelines for policy and practices.
FIGURE 1
Previous systematic reviews have also addressed specific aspects or applications in environmental sciences, including waste management issues as in and . just tackled waste management problems, while energy systems, including waste energy generation appears in . More generally, reviewed five models addressing waste treatment problems: MCDA models, simulation models, forecasting models, cost-benefit analyses and optimization models. To the best of our knowledge the present work is the first review to focus on MCDA applied to marine and terrestrial plastics waste management.
This systematic review has five sections, which are structured as follows: after this introduction, the second section shows how this review was carried out; the third section looks at the alternatives to cope with plastic waste management and describes and discusses the MCDA methods used along with their criteria and weights; recommendations for plastics waste management decision making issues are set out in the fourth section, before the conclusion in the final section.
Materials and Methods
This study is based on a scientific literature review. Articles using the online databases Web of Science™ and Scopus® were searched for, with the following queries: (multicriteria OR multi-criteria OR multiattribute OR multi-attribute OR MCDA OR MCDM OR AHP) AND (Plastic). April 22nd (2021) was the last time the data bases were checked, returning 233 results from Web of Science and 360 from Scopus, although 176 documents were referenced in both databases (417 different documents in total).
The abstracts of these documents were analyzed to find studies in which a multicriteria decision approach for solving a problem with plastic waste in the environment or general marine litter including plastics was used. Sometimes the entire manuscript was examined to see if they could be added to this review. These findings comprise 20 papers in 19 sources from 2008 to 2021 (see Table 1), referring to case studies on three continents (including one in a laboratory).
TABLE 1
| Authors | Purpose (plastic subject) | Decision making focus | M/T | Country/Region | Plastic type | Type of company/place | MCDA method | Multi-actor weighting decision | Conclusions |
| To tackle barriers in the recycling value chains for the transition to a circular economy. | Bottlenecks that hinder the efficient recycling plastic packing waste | Terrestrial | European Union | Plastic packaging waste | Supply chains in the circular economy | - AHP - MAVT | Experts and residents | Highlights the importance of the role of group decision-making approaches to create joint learning and exchange of ideas among value chain actors for removing constraints on success or circular economy initiatives. | |
| To tackle packaging plastic waste management for a circular economy. | End-of-life options | Terrestrial | India | HDPE, PP, and PET Plastic | Company that is transforming plastic waste into a poly fuel | - AHP | Experts | Results indicate that deposit and refund method is the best option compared with vehicular or curbside collection, drop-off recycling or buy-back center options for plastic waste collection to support the circular economy. | |
| To examine and evaluate plastic waste disposal options. | End-of-life options | Terrestrial | India | General plastic waste | City | - Weighted sum | Experts and residents | The most sustainable option for management and disposal of plastic waste in Delhi was a blend of recycling along with incineration. | |
| To define disposal options for post-consumer plastic waste. | End-of-life options | Terrestrial | Brazil | HDPE plastic | City | - THOR | Decision makers | The results showed a preference for mechanical recycling as disposal alternative for HDPE waste. | |
| To evaluate the best option for cleaning up marine debris. | Marine debris removal systems | Marine | United States | Marine debris (It includes plastics) | Marine debris removal system (North pacific subtropical gyre, plastic, subtropical convergence zone) | - Weighted sum | Authors | Autonomous vacuum is suggested as the most viable option for litter removal in the Subtropical Convergence Zone. | |
| To evaluate and compare different polymer matrix composite material waste recycling methods. | End-of-life options | Terrestrial | Latvia | Fiber reinforced plastic (FRP) | Laboratory | - AHP - TOPSIS | Authors (Literature review) | Mechanical recycling method is the most sustainable fiber reinforced plastic waste recycling method when specific sustainability criteria are evaluated (however, lack of data about other potential sustainability criteria was signalized). | |
| To rank the end-of-life alternatives for waste plastics. | End-of-life options | Marine | Norway | Marine debris (Waste plastics from fishing gears) | Fishing sector | - MAVT | Experts | For the Circular economy strategy success, developed countries must explore systems promoting reduce, reuse, and in-house recycling of plastic waste. Among end-of-life alternatives, recycling (inland) alternative emerged as the preferred to deal with waste fishing gears in Norway. | |
| To find a suitable recycling method for managing disposal and recycling of plastic materials. | End-of-life options | Terrestrial | India | PET, HDPE, PVC, LDPE, PP, and PS Plastic | City | - HPF-ELECTRE III - HPF-TOPSIS | Decision-makers | The preferred recycling methods for six plastic types are: chemical recycling for HDPE; mechanical recycling for PET and PP; feedstock recycling for PVC and PS; and incineration with energy recovery for LDPE. | |
| To evaluate different disposal alternatives for plastic waste. | End-of-life options | Terrestrial | Brazil | HDPE plastic | Local community | - THOR | Decision makers and Experts | The results showed a preference for reuse and mechanical recycling as disposal alternatives for HDPE waste. Fully appraisal of recycling methods needs information of the logistics system in which these recycling solutions will be included. | |
| To select a suitable technological device for recycling process. | End-of-life options | Terrestrial | Slovakia | General plastic waste | Department of plastics pressroom | - AHP | Professionals | The evaluation of variants of knife mill devices, in a selected enterprise allows to define the most suitable device for plastic waste recycling process (Knife mill type C 17.31 by the company Wanner). | |
| To identify good practices and trends in the plastics industry companies. | Reverse logistics | Terrestrial | Colombia | General plastic waste | Plastic industry | - AHP | Decision-makers and experts | Leadership factor is the most important when evaluating the application of good practices in reverse logistics. | |
| To assess the overall risk associated with a range of human activities in the marine environment. | Risk associated with human activities in the marine environment | Marine | The Western North Atlantic Ocean | Marine debris (It includes plastics) | Marine environments | - AHP | Experts | Fisheries bycatch (particularly when involving suspended gill nets) was identified as the greatest risk associated with human activities across a wide range of bird species. | |
| To explore the effectiveness of plastic reduction actions. | Consumer-based actions | Marine | Europe | General plastic waste | European freshwater environments | - Weighted Sum | Authors and professionals | The top ranked consumer-based actions to reduce plastic pollution in rivers were identified as: using wooden or reusable cutlery and stirrers; reusable water bottles; plastic free cotton-buds; and refill detergent/shampoo bottles. | |
| To choose the most suitable third-party reverse logistic provider for a plastics factory. | Reverse logistics | Terrestrial | Iran | General plastic waste | Third-party reverse logistic provider (3PRLP) | - Fuzzy MOORA | Experts | Definition of an efficient and practical sustainable approach to choose the most suitable third-party reverse logistic provider for a plastics factory. | |
| To evaluate a technological device for recycling of plastic waste. | End-of-life options | Terrestrial | Slovakia | General plastic waste | Production enterprise | - AHP | Experts | The results show that the most suitable device for plastic waste recycling process is a knife mill (Variant 2 of the alternatives, among other characteristics, has the output from 25 to 50 kg/h and purchase price of 3900€). | |
| To select the best method for plastic recycling. | End-of-life options | Terrestrial | India | General plastic waste | Plastic industry | - Fuzzy AHP | Decision- makers | Thermal recycling is the best option, with the possibility of recovering embodied energy in plastics by incineration or by using it in industry as a substitute fuel. | |
| To choose the best end-of-life scenarios for polyethylene terephthalate (PET) waste. | End-of-life options | Terrestrial | Colombia | PET plastic | City | - MAUT | Professionals | Recycling scenarios are the choice of best end-of-life scenarios for polyethylene terephthalate (PET) waste in a municipality of a developing country. | |
| To analyze and prioritize the different potential risks in reverse logistics for providing useful insight to the supply chain managers and researchers for decision making. | Reverse logistics | Terrestrial | India | PET plastic | PET bottle recycling company | Hybridization of methods: - AHP - Fuzzy AHP - Fuzzy TOPSIS - PROMETHEE | Decision- makers | The major contribution of this work lies in the development of linkages among the various functions in reverse logistics. The results indicate that managing inventory is highly prioritized. | |
| To select the best plastic recycling method. | End-of-life options | Terrestrial | India | Fiber reinforced plastic (FRP) | Automotive industry | - Fuzzy AHP -TOPSIS | Decision- makers | Mechanical recycling process is identified as the best plastic recycling process for an automotive component manufacturing industry. | |
| To develop a framework for the multiperiod deployment and design of aerospace CFRP waste supply chain. | End-of-life options | Terrestrial | France | Carbon fiber reinforced polymer (CFRP) | Aerospace industry | - PROMETHEE - M-TOPSIS (Integrated with a multi-period Mixed Integer Linear Programming model) | Authors | The best compromise strategy for both economic and environmental objectives lead to centralized configurations for the deployment of recycling sites at the regions close to significant waste sources of aerospace carbon fiber reinforced polymer waste. |
List of papers.
AHP, Analytic Hierarchy Process; ELECTRE, Elimination and Choice Expressing Reality; MAUT, Multi-attribute Utility Theory; MAVT, Multi-Attribute Value Theory; MOORA, Multi-Objective Optimization on the basis of Ratio Analysis; PROMETHEE, Preference Ranking Organization Method for Enrichment Evaluations; THOR, Multicriteria Decision Aiding Hybrid Algorithm; TOPSIS, Technique for Order Preference by Similarity to Ideal Solution; HDPE, High-Density PolyEthylene; LDPE, Low-Density PolyEthylene; PET, PolyEthylene Terephthalates; PP, PolyPropylene; PS, PolyStyrene; PVC, PolyVinyl Chlo.
These 20 papers were fully analyzed and the information categorized in Table 1 and Supplementary Tables 1, 2, and commented on in the next sections of this paper.
A content analysis of these selected papers has been performed, we developed categorizations and coding using software. Considering the studies addressed different purposes and contexts, our focus was about the alternative solutions proposed, their evaluation criteria and how they used the MCDA approach. The studies were organized through two main groups such as: marine and terrestrial.
The selected articles exclude studies focused on: supply chains selection; choosing locations or routing models; design or alternative material choice; theoretical studies (reviews); specific products with plastic components (e.g., batteries and vehicles) or studies addressing general waste. For marine studies, however, we kept papers that do not involve an exclusive plastic focus, namely three studies on marine debris which include plastic pollution litter (e.g., beach litter and fishing gear).
Results and Discussion
Overview
Table 1 presents an overview of the 20 papers reviewed using different types of information and categorization. After the author’s name, the main purpose of the paper and decision focus are briefly presented. The type of settings (marine or terrestrial) addressed by each paper, geographic information (continent, region, country, or city), the type of plastic dealt with and type of company or place involved in the case study are then mentioned. The next two columns are about the MCDA methods applied to solve problem proposed and the weighting strategy used. The last column summarizes the main conclusions of each paper.
Most studies are concerned with terrestrial settings (80%). evaluated bottlenecks in the recycling value chains and waste collection methods is the subject of . A large part of terrestrial environment studies deals with end-of-life options (; ; ; ; ; ; ; ; ; ; ). Different disposal options (including recycling options) are considered in the MCDA frameworks built for each of these papers. Reverse logistics is examined by ; , and (see Table 1).
Meanwhile, the MCDA case studies in a marine setting deal with plastic litter management, namely, present cleaning options for marine debris removal systems and look at end-of-life issues. Risks associated with human activities are assessed by , and the effectiveness of plastic reduction consumer-based actions is studied by (see Table 1).
Case studies reported in the reviewed articles span three continents and more than 12 countries, with some studies covering larger regions (please see column Country/Region of Table 1, where 3 regions are mentioned). For seven of these studies, the location of the first author was used to define the place of the study (; ; ; ; ; ; ).
Europe and Asia are viewed as the continents with most studies in MCDA papers in the environmental field () and this review corroborates this (see Figure 2). By country, India leads with six studies. However, the analysis by country is debatable because some studies are focused on more extensive regions rather than a country, for example, the European Union; the Western North Atlantic Ocean; and Europe. The oldest study in this review concerns Brazil and was published in 2008 in Omega-International Journal of Management Science, and few articles appeared between then and 2015 (Figure 2). Since 2016, on average three papers have been published per year.
FIGURE 2
Alternatives
Many types of alternatives to manage plastic waste have been considered. It is important to group the alternatives so that the studies can be compared. Supplementary Table 1 depicts an organized presentation of different types of alternatives. There are three levels of categorization: Aim, Alternative type, and Alternatives (detailed for each paper).
Figure 3 shows the number of distinct alternatives (some options are repeated through the studies, such as recycling, for example) considering the choices proposed in the studies when the type of plastic (using classification assigned by the author) dealt with is the issue (combined information from Table 1 and Supplementary Table 1).
FIGURE 3
Alternatives concerning the selection of cleaning methods (e.g., waste collection systems and cleaning plastics from the seas) and disposal alternatives were found in almost all types of plastic categorized in this review. The most common purpose is to make a choice from the end-of-life disposal options, such as different forms of recycling, incineration, landfilling, etc. (Supplementary Table 1). This also involves choosing technological devices.
Actions and processes group of alternatives include the work of who proposed the assessment and prioritization of five bottlenecks in the recycling value chains to improve the co-operation between stakeholders and the circular economy. Also the work of evaluated 27 consumer-based plastic reduction actions. In fact, people’s individual behavior in consuming single-use plastics is an active focus of concern for the management of plastics pollution in rivers, since in far too many cases this plastic waste ends up in coastal areas and seas, where it impacts aquatic wildlife and ecosystems (both freshwater and marine). Alternatives about selecting methods of cleaning and disposal options are numerous (34 alternatives are mentioned in Supplementary Table 1) and are those used by the highest number of authors (15 authors are mentioned in the same table).
Regarding removing plastics from a marine environment or freshwater systems, seven cleaning alternatives have been considered for plastic cleaning by . They assessed options such as vacuum, vessel, barge (two types) and artificial floating island (three types). Although they found that an autonomous vacuum had the most favorable cost, the artificial floating island (types with motor and a sail) are too close to the first option to make a clear-cut decision possible about which is the best solution to this problem. They also added that the development (by increasing its rate of removal or capacity) of the artificial floating island (with motor) concept could alter the values of the scores achieved by the alternatives and new better positioned alternatives could emerge.
In terrestrial settings, regarding capturing and removing, assess plastic waste collection methods to support the circular economy. Their results state that the deposit and refund method is the best option compared with vehicular or curbside collection, drop-off recycling or buy-back center options.
Several disposal options are evaluated as alternatives in 12 papers. Five types of recycling were examined in the selected studies: mechanical, chemical, feedstock, thermal, and bottle-to-bottle. These options were evaluated individually or in combination with other strategies.
In some studies, the traditional (or mechanical) recycling is the leading alternative for general plastic waste, marine debris, and reinforced plastic: either individually (; ; ), or associated with incineration (). However, found thermal recycling the best option, with the possibility of recovering embodied energy in plastics by incineration or by using it in industry as a substitute fuel.
Pyrolysis alternatives did not perform well for . This was because the technique was associated with increased incidence of air pollution and long-term illness, although techniques like plasma pyrolysis technology (PPT) could be cleaner and more efficient. Microwave pyrolysis was performed in laboratory conditions on small material samples of FRP (fiber reinforced plastics) by . For them, this technique is very similar to pyrolysis where waste is subjected to very high temperatures in the absence of oxygen. The outcome is a recycled fiber with almost the same tensile strength as that of the virgin fiber.
In the case of polyethylene terephthalate (PET) waste management, have chosen bottle-to-bottle recycling as the best option. They assert that bottle-to-bottle recycling is a combination of conventional mechanical recycling and chemical recycling. Furthermore, this leads to a product that can be reused straightaway for food and drinks because the quality does not infringe any legal requirements stipulated for such use. For fiber reinforced plastics (FRP), reports that studies suggest that chemical recycling can recover high quality fibers.
and observed that there are many different kinds of plastic with specific properties (chemical and mechanical), so they studied just one type, high-density polyethylene—HDPE. These two studies were the only ones that considered a reuse alternative, and both concluded it was the best option (in mechanical recycling is also in joint first place together with reuse). , meanwhile, compared recycling methods for six plastic types: the preferred methods are chemical recycling for HDPE; mechanical recycling for PET (polyethylene terephthalates) and PP (polypropylene); feedstock recycling for PVC (polyvinyl chloride) and PS (polystyrene); and incineration with energy recovery for LDPE (low-density polyethylene).
Landfilling is addressed for general waste, marine debris, and polyethylene. That option was in general ranked as the least favored (; ; ; ). That option was also evaluated by , who noted it could be the alternative that requires less energy but it does not generate income with selling products. assert that landfilling plastics can be an economic loss since plastic is a reusable resource.
refer to landfilling as being a significant source of contamination, and they used mixing landfill alternatives along with recycling or incineration. However, this mixing was not enough to put alternatives of that kind in the top places. The study by identified with stakeholders two main factors (transport and the processing cost of fishing tackle and rope waste) that could result in landfilling being preferred over recycling or incineration.
For , landfilling was considered to have the lowest CO2 emission. However, asserted that in theory the amounts of carbon dioxide (CO2) emitted to the atmosphere over a very long time horizon should be the same for landfilling and incineration. were the only researchers that used a landfill with extract and burning gases as an alternative. Still, even that was not enough to be better than recycling, which they consider could provide employment and profits.
Referring to the choice of a location for recycling, highlight the importance of recycling operations within the region because the possible positive effects for the environment and society could lead to improved economic benefits from resource conservation and energy recovery. These situations depend on how the authors designed their studies. For example, did not consider the energy recovered, plastic resources conserved, and the revenue generated from recycling (occurring outside the system boundaries) for exported litter, and so they considered only the transport costs of exports. Two studies analyzed technological devices for recycling, both in Slovakia (; ). They evaluated variants of knife mill devices and both chose an option with similar characteristics and price.
developed a “multi-period approach for the deployment of new recycling sites (Grinding, Pyrolysis, Supercritical Water, Microwave)” in France, relating to aerospace carbon fiber reinforced polymer waste. They perform their alternative evaluation through scenarios pondering the amount of waste generated per 20 years: “business as usual,” “strong/light increase,” and “strong/light decrease.” They stated that “the compromise strategy for both economic and environmental objectives lead to centralized configurations at the regions close to significant waste sources.”
Reverse logistics is a process for moving materials and raw equipment back through the supply chain, i.e., from customers to suppliers or manufacturers. Returns are managed efficiently and economically to extract as much value as possible and they become a competitive advantage (). Reverse logistics is turning out to be a promising activity of interest for many practitioners (). Three papers were analyzed in this context: , to identify “good practices and trends” in the plastic industry companies; , to choose the most suitable third-party reverse logistic provider for a plastics factory; and , to analyze and prioritize the different potential risks in reverse logistics for providing useful insight to the supply chain managers and researchers for decision making.
A rather different type of study is a specific assessment (hierarchization) of different seabird species sensitivity to the risk associated with human activities in the marine environment (). In fact, the alternatives (i.e., the object of the evaluation) dealt with in this case study are living organisms (seabird species) as mentioned in Supplementary Table 1 and not end-of-life options or reverse logistics issues. Fisheries bycatch (particularly when involving suspended gill nets) was “identified as the greatest risk across a wide range of species.”
Multicriteria Decision Analysis Methods, Criteria, and Weights
It is challenging to find the best options when they have very different (often conflicting) impacts. Multicriteria decision analysis (MCDA) is a way to embrace different dimensions and values to inform decision making.
Many MCDA methodologies and techniques were used in the studies reviewed. Five MCDA approaches were used by the authors of the studies to address plastic waste:
In these five approaches (Table 2 and Figure 4), the most frequent are the analytic hierarchy process (AHP) followed by TOPSIS and outranking approaches (ELECTRE III, PROMETHEE, and THOR). This trend and popularity of AHP is also mentioned in the studies by and . They suggest it is because of the accessibility and user-friendliness of the AHP method. Some studies used different MCDA methods to address the same case or plastic type (Table 1).
TABLE 2
| Methods | Description |
| AHP | The analytic hierarchy process (AHP), from , is based on organizing criteria, sub-criteria and alternatives into a hierarchical structure, possibly with feedback (in the ANP variant). At each node of the hierarchy elements are compared pair by pair, estimating the priority of each element over each other element on a semantic scale and translating these judgments on a ratio scale. |
| MAVT/MAUT | Multi Attribute Utility Theory (MAUT) and Multi Attribute Value Theory (MAVT) are based on a set of axioms of rationality (). A value function needs to be defined for each criterion in MAVT, translating performance into value according to the decision makers’ preferences. Then, the value functions can be aggregated, usually considering an additive model. In MAUT, utility functions are used in the place of value functions, modeling the attitude toward risk of the decision makers, allowing its use for probabilistic uncertain outcomes. |
| Outranking | Outranking approaches used to rank alternatives are methods that typically compare alternatives one pair at a time, assessing their relative advantages and disadvantages. An alternative’s relative standing is thus a function of how well it compares against the set of the remaining alternatives. Three types of outranking approaches were found in the studies: – PROMETHEE—Preference Ranking Organization Method for Enrichment Evaluation (), – ELECTRE—Elimination and Choice Expressing Reality (), – THOR—Multicriteria Decision Aiding Hybrid Algorithm (; ). |
| TOPSIS | The TOPSIS (Technique for Order Preference by Similarity) method () defines an ideal alternative (based on the best observed performance on all criteria) and an anti-ideal alternative (based on the worst observed performance on all criteria). Then, it ranks all the alternatives based on how near they are to the ideal and how far they are from the anti-ideal alternatives. Usually a weighted Euclidean distance is used, requiring normalization of the scales. |
| Weighted sum | This method simply multiplies the alternatives performances (after normalizing the scales) by the weights of the respective criteria. Two types of Weighted Sum approaches were found in the studies: Weighted Sum () MOORA—Multi-Objective Optimization on the basis of Ratio Analysis () |
MCDA methods.
FIGURE 4
The AHP is also the method most often combined with other methods: MAVT/MAUT, TOPSIS, or Outranking (; ; ; ). used Outranking (PROMETHEE) and TOPSIS in their study, while used Outranking (ELECTRE III) to choose their alternatives and TOPSIS for a comparative analysis.
The criteria (Supplementary Table 2 and Figure 5) are grouped into a small number of dimensions (economic, environmental, operational, other managerial, political, and social). The operational dimension is the most frequent, being found in 43 studies, followed by the environmental dimension that is casted in 37 studies and still the economic dimension appearing also in a large number of studies (22). The political criteria were not present in marine environment studies, although international border issues do emerge in these cases.
FIGURE 5
Some patterns were found in the criteria used by the authors through the dimensions. These were grouped in categories and subcategories (Supplementary Table 2). Comparing the criteria from the studies showed that “Performance” is an intersectional area since diverse criteria are carrying it out in different dimensions (e.g., financial performance in the “Economic” dimension; production, resources consumption, and waste reduction performance in the “Environmental” dimension; and managerial performance in “Other managerial” dimension). “Organizational” is another intersectional category that can be found in different dimension (e.g. leadership and planning in the “Environmental” dimension; reverse logistics and service in the “Operational” dimension; feasibility, stakeholder in “Other managerial” dimension; and labor and workers safety in the “Social” dimension). It can also be noticed that “risk” is an important subcategory of criteria.
MCDA typically requires setting the value of the method’s parameters that reflect preferences, namely, the criteria weights. These parameters are elicited from the decision makers, experts, or other actors involved in the construction of the MCDA evaluation model. The actors most often consulted were identified as experts and followed those identified as decision makers (see Figure 6). It is important to mention that some authors distinguish between experts and decision makers, and that some professionals can be experts as well as decision makers. The authors of a study may be experts themselves and in some studies the criteria weights were chosen by them.
FIGURE 6
Some of these weights were assigned by panels in the context of workshops (; ; ) or inquired about through questionnaires or surveys (; ; ).
Recommendations for Marine and Terrestrial Plastic Management
The literature reviewed includes several recommendations stemming from the analysis of the alternatives that were assessed and the MCDA method’s results. Supplementary Tables 1, 2 present an extensive list of alternatives and criteria used in the studies reviewed here, which can serve either as a checklist or as a source of inspiration when using MCDA to address marine and terrestrial plastic waste management. In the following discussion we also mention the studies of and , which computed impacts on multiple criteria but did not aggregate the results using an MCDA method.
The recommendations of a study depend on the alternatives and criteria considered, and can also be contingent on specific aspects, such as the resources and culture of each company in business decisions (). In some of the studies a clear winning solution emerged. For instance, found that socio-economic and environmental benefits across the EU would be significant if their recommended alternative was implemented, e.g., reducing approximately 1.5 × 106 tons of CO2 eq emissions and saving tens of millions of euro in waste management costs. The same authors suggest these benefits might be even larger, if technological developments or faster adoption paths were considered. The study by found several of their top-ranked solutions to reduce plastic pollution in rivers were actually actions already implemented in several countries (e.g., banning plastic straws). Other results reflected the conflicting nature of different criteria, e.g., economic viability vs. other qualities (), leading those authors to conclude that much work remains to be done to develop better solutions.
The best alternative is often a combination of multiple strategies, e.g., combining recycling and incineration (), combining alternatives to benefit from different types of litter removal (), or combining technologies in a waste supply chain (). Yet, in their analysis of recycling alternatives, point out that the interest of recycling options depends on wider factors, such as collection rate or the availability of other traditional outlets for recycled plastic. Similarly, remark that solutions such as recycling methods often cannot be fully appraised without considering the logistics system in which these recycling solutions will be included. Therefore, if the best alternative is a combination of multiple elements, it must be kept in mind that the number of potential combinations when considering a broader system can be even larger.
As policy recommendations, suggest that more challenging targets could be set by the EU or its Member States, while taking into account the associated costs and the feasibility of meeting such targets, alongside the potential benefits. call for the drafting of detailed statistics on waste across the EU and technological solutions to enable the flow of materials to be tracked. This would include both quantitative and qualitative data encompassing economic, social, and environmental aspects. Improving data collection methods is also important to determine the relevant material flows (). call for more data on impacts such as water consumption and carbon emission impacts, and the use of life cycle assessment in combination with MCDA (on this topic, see also ; ). point out that MCDA results might depend on just a few criteria in cases where data is available only for those criteria, but not for other ones. Also concerning data, specifically on microplastics, call for improved monitoring and the adoption of more stringent size limits, in order to not underestimate the problem and also to allow comparing the results of different research works.
For , it is important to engage communities, and MCDA can be instrumental in this regard. Focusing on end of life alternatives, they recommend clearer regulations on recycling and more work on the assessment of environmental and economic impacts of different alternatives so that choices can be made with less uncertainty in the context of the EU’s circular economy strategy for plastics. Clear incentives for consumers to change their behavior and favor pro-environmental behaviors have also been suggested ().
Complementing these analyses, evaluated several policy-related barriers to implementing a circular economy in the plastics industry. Per their results, more active measures from governments are needed. In particular, economic incentives and tax benefits are needed for organizations to build technology and innovation. Training and awareness programs to enhance the knowledge and skills of stakeholders are also a priority.
In general, the authors of the studies reviewed recommended MCDA as a tool for choosing the best solutions for clearing marine litter or, more generally, in environmental management (e.g., ). MCDA proved to be useful in that it enabled environmental, socioeconomic, and other criteria to be considered simultaneously. The possibility of considering qualitative criteria has also been praised, along with the possibility of involving different stakeholders (; ). In participatory decision making, participants have the opportunity to learn from each other. Feedback from the stakeholders and experts involved in MCDA has been reported to be positive (). Another reported advantage of MCDA is its transparency (; ).
However, most authors point out that MCDA is limited by the availability of comprehensive, updated and sufficiently detailed data. Also, results are often based on inputs provided by experts, reflecting their interpretation of the available information, and thus being dependent on the situation and possibly varying in time (). In contexts involving value chains, they recommend involving experts in the analysis at all stages of the chain and having a clearly defined goal for MCDA. Some authors also remark that MCDA requires resources such as time and money to gather all the information required (). Finally, MCDA results can also depend on a number of modeling choices, including choice of variables and normalization operations ().
Conclusion
This review provides an account of studies that used multicriteria decision approaches to address plastic waste in terrestrial and marine environments. The content analysis methodology was chosen for this purpose. Based on this review, the solutions considered were then summarized and discussed in terms of how they were evaluated.
A first surprising conclusion is the very low number of MCDA studies addressing the issue of plastic waste in terrestrial and marine environments. MCDA is a well-known evaluation tool that has been applied in many fields, and plastics is no exception with over 400 articles found for this review. However, most of the MCDA applications found either address general waste or address alternative ways of making or transporting plastics, or products incorporating plastics, and managerial decisions concerning location, supply chain and distribution options. MCDA has only recently been used to address the issue of plastic waste in terrestrial and marine environments (first article in 2008) and authors are based mainly in Europe, followed by Asia and the Americas. The most common purpose has been to choose an end-of-life disposal option, such as different forms of recycling, incineration, landfilling, etc., which could prevent plastics from reaching marine environments. A few other studies address options for getting rid of plastics that have already reached these environments.
With regard to how the MCDA was performed, this review has analyzed the methods selected, the criteria considered, and the criteria weighting process. The reviewed studies are quite diverse in the modeling choices they make, which are specific for their purposes. Therefore, a consolidated best practice pattern does not emerge from this review.
The most popular method was AHP, followed by TOPSIS and outranking methods, and then MAUT/MAVT and simple weighted sums. Some authors have used more than one method to analyze the same problem. Overall, the choice of criteria spans operational (mostly), but also environmental and economic aspects to evaluate the alternatives. Less often, criteria are found to be related to social, managerial, and political factors. However, the studies addressing the marine environment emphasize the environmental dimension in their choice of evaluation criteria. The weighting of the criteria, required by all the MCDA methods that were used, was performed mainly by consulting experts, followed by decision makers. In a few cases the authors themselves proposed the weights. Representatives of the affected population or other stakeholders have been consulted on a few occasions. Apart from these panel-based methods, no other approaches to weighting, such as using monetization techniques or finding the weights based solely on statistical considerations, were found.
Overall, the authors of the studies consider their application of MCDA was successful. They stress the importance of being able to encompass environmental, socioeconomic, and operational factors in the evaluation of the alternatives. Other strengths identified were transparency, the possibility of using qualitative assessments, and the potential for involving stakeholders. When stakeholders were involved, the authors report their feedback was positive. However, the authors pointed out that MCDA can be limited by the availability of data and resources for its implementation, as well as the evolving nature of the perspectives of experts and stakeholders. Some authors called for improved monitoring and data collection methods to better appraise the performance of the alternatives on multiple indicators. MCDA results can also depend on the choice of indicators and other modeling choices.
When analyzing the problems that they addressed, the authors in most cases have managed to identify a clearly winning alternative, which was sometimes a combination of several strategies. But some authors pointed out that the number of possible combinations can lead to a large number of alternatives, and their analysis can be limited by the need to make assumptions about factors and choices related to parts of the overall system outside the scope of their studies.
Given the urgent need to tackle the impact of plastic waste on terrestrial and marine environments, more studies are clearly needed to identify the most adequate solutions. Such solutions involve not only developing technologies, but also creating or updating policies and regulations. The authors hope this review will help to raise awareness of the problem and the need to address it with MCDA, thereby taking into account its environmental, economic, social, and technical dimensions.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Statements
Author contributions
MS: methodology, investigation, writing—original draft, and visualization. LD: conceptualization, writing—review and editing, and visualization. MC: conceptualization, writing—review and editing, visualization, and funding acquisition. JM: writing—review and editing. All authors read and approved the submitted version and listed have made a substantial, direct, and intellectual contribution to the work.
Funding
This work was funded under the EU project CLAIM (Cleaning Litter by developing and Applying Innovative Methods in European seas) H2020 Grant agreement ID: 774586. MC and JM were acknowledged the support of national funds through FCT, under the project UID/EMS/00285/2020. MS was acknowledged a research grant awarded by the University of Coimbra.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmars.2021.747712/full#supplementary-material
References
1
AchillasC.MoussiopoulosN.KaragiannidisA.BaniasG.PerkoulidisG. (2013). The use of multi-criteria decision analysis to tackle waste management problems: a literature review.Waste Manag. Res.31115–129. 10.1177/0734242X12470203
2
AndreoniV.SaveynH. G. M.EderP. (2015). Polyethylene recycling: waste policy scenario analysis for the EU-27.J. Environ. Manage.158103–110. 10.1016/j.jenvman.2015.04.036
3
ATLAS.ti (2020). Scientific Software Development GmbH. Version 9. Available online at: http://atlasti.com(accessed July 20, 2021).
4
BachérJ.PihkolaH.KujanpääL.MrouehU.-M. (2018). Advancing the circular economy through group decision-making and stakeholder involvement.Detritus4, 22–35. 10.31025/2611-4135/2018.13741
5
BalwadaJ.SamaiyaS.MishraR. P. (2021). Packaging Plastic Waste Management for a Circular Economy and Identifying a better Waste Collection System using Analytical Hierarchy Process (AHP).Procedia CIRP98270–275. 10.1016/j.procir.2021.01.102
6
BesselingE.QuikJ. T. K.SunM.KoelmansA. A. (2017). Fate of nano- and microplastic in freshwater systems: a modeling study.Environ. Pollut.220540–548. 10.1016/j.envpol.2016.10.001
7
BhagatS.BhardawajA.MittalP.ChandakP.AkhtarM.SharmaP. (2016). Evaluating plastic waste disposal options in Delhi using multi criteria decision analysis.IIOAB J.725–35.
8
BransJ. P.VinckeP. (1985). A Preference Ranking Organisation Method (The PROMETHEE Method for Multiple Criteria Decision-Making).Manag. Sci.31647–656. 10.1287/mnsc.31.6.647
9
BrauersW. K.ZavadskasE. K. (2006). The MOORA method and its application to privatization in a transition economy.Control Cybern.35445–469.
10
CardosoR. S.XavierL. H.GomesC. F. S.AdissiP. J. (2009). Uso de SAD no apoio à decisão na destinação de resíduos plásticos e gestão de materiais.Pesqui. Oper.2967–95. 10.1590/s0101-74382009000100004
11
CeganJ. C.FilionA. M.KeislerJ. M.LinkovI. (2017). Trends and applications of multi-criteria decision analysis in environmental sciences: literature review.Environ. Syst. Decis.37123–133. 10.1007/s10669-017-9642-9
12
ChrissleyT.YangM.MaloyC.MasonA. (2017). “Design of a Marine Debris Removal System,”in 2017 Systems and Information Engineering Design Symposium (Bengaluru: SIEDS), 10–15. 10.1109/SIEDS.2017.7937696
13
CunhaM.MarquesJ.CreacoE.SavicD. A. (2019). Dynamic Adaptive Approach for Water Distribution Network Design.J. Water Resour. Plan. Manag.145:04019026. 10.1061/(ASCE)WR.1943-5452.0001085
14
DelvereI.IltinaM.ShanbayevM.AbildayevaA.KuzhamberdievaS.BlumbergaD. (2019). Evaluation of Polymer Matrix Composite Waste Recycling Methods.Environ. Clim. Technol.23168–187. 10.2478/rtuect-2019-0012
15
DeshpandeP. C.SkaarC.BrattebøH.FetA. M. (2020). Multi-criteria decision analysis (MCDA) method for assessing the sustainability of end-of-life alternatives for waste plastics: a case study of Norway.Sci. Total Environ.719:137353. 10.1016/j.scitotenv.2020.137353
16
DiasL.FreireF.GeldermannJ. (2019). “Perspectives on Multi-criteria Decision Analysis and Life-Cycle Assessment,” in New Perspectives in Multiple Criteria Decision Making, ed.DoumposM. (Cham: Springer), 315–329. 10.1007/978-3-030-11482-4_12
17
European Council (2008). Directive 2008/98/EC.Off. J. Eur. Union511–45.
18
FishburnP. C. (1967). Additive Utilities with Incomplete Product Sets: application to Priorities and Assignments.Oper. Res.15537–542. 10.1287/opre.15.3.537
19
GeethaS.NarayanamoorthyS.KureetharaJ. V.BaleanuD.KangD. (2021). The hesitant Pythagorean fuzzy ELECTRE III: an adaptable recycling method for plastic materials.J. Clean. Prod.291:125281. 10.1016/j.jclepro.2020.125281
20
GomesC. F. S.NunesK. R. A.XavierL. H.CardosoR.ValleR. (2008). Multicriteria decision making applied to waste recycling in Brazil.Omega36395–404. 10.1016/j.omega.2006.07.009
21
HuangI. B.KeislerJ.LinkovI. (2011). Multi-criteria decision analysis in environmental sciences: ten years of applications and trends.Sci. Total Environ.4093578–3594. 10.1016/j.scitotenv.2011.06.022
22
HusákováN.FedorkoG.MolnárV.HonusS. (2016). “Example of selection of suitable way for the process of recycling,” in Proceedings of the 16th International Multidisciplinary Scientific GeoConference Surveying Geology and Mining Ecology Management (SGEM), Albena, 357–364. 10.5593/SGEM2016/B52/S20.046
23
HwangC.-L.YoonK. (1981). Multiple Attribute Decision Making: Methods and Applications A State-of-the-Art Survey. In Lecture Notes in Economics and Mathematical Systems.Berlin: Springer.
24
IshizakaA.NemeryP. (2013). Multi-Criteria Decision Analysis: Methods and Software.Hoboken: john wiley & sons. 10.1002/9781118644898
25
JimenezG.SantosG.FélixM.HernándezH.RondónC. (2019). Good Practices and Trends in Reverse Logistics in the plastic products manufacturing industry.Procedia Manuf.41367–374. 10.1016/j.promfg.2019.09.021
26
JuulN.MünsterM.RavnH.SödermanM. L. (2013). Challenges when performing economic optimization of waste treatment: a review.Waste Manag.331918–1925. 10.1016/j.wasman.2013.04.015
27
KeeneyR. L. (1996). Value-focused thinking: identifying decision opportunities and creating alternatives.Eur. J. Operat. Res.92537–549. 10.1016/0377-2217(96)00004-5
28
KeeneyR. L.RaiffaH. (1976). Decisions with Multiple Objectives: Preferences and Value Tradeoffs.Hoboken: John Wiley & Sons.
29
KhandelwalC.BaruaM. K. (2020). Prioritizing circular supply chain management barriers using fuzzy AHP: case of the Indian plastic industry.Glob. Bus. Rev.1–20. 10.1177/0972150920948818
30
LebretonL. C. M.Van Der ZwetJ.DamsteegJ.-W.SlatB.AndradyA.ReisserJ. (2017). River plastic emissions to the world’s oceans.Nat. Commun.8:15611. 10.1038/ncomms15611
31
LieskeD. J.TranquillaL. M. F.RonconiR.AbbottS. (2019). Synthesizing expert opinion to assess the at-sea risks to seabirds in the western North Atlantic.Biol. Conserv.23341–50. 10.1016/j.biocon.2019.02.026
32
MarazziL.LoiselleS.AndersonL. G.RocliffeS.WintonD. J. (2020). Consumer-based actions to reduce plastic pollution in rivers: a multi-criteria decision analysis approach.PLoS One15:e0236410. 10.1371/journal.pone.0236410
33
Martín-GamboaM.IribarrenD.García-GusanoD.DufourJ. (2017). A review of life-cycle approaches coupled with data envelopment analysis within multi-criteria decision analysis for sustainability assessment of energy systems.J. Clean. Prod.150164–174. 10.1016/j.jclepro.2017.03.017
34
MaviR. K.GohM.ZarbakhshniaN. (2017). Sustainable third-party reverse logistic provider selection with fuzzy SWARA and fuzzy MOORA in plastic industry.Int. J. Adv. Manuf. Technol.912401–2418. 10.1007/s00170-016-9880-x
35
MikusováN.StopkaO.StopkovaM.MikušováN.StopkaO.StopkovaM. (2019). Application of Multi-criteria Decision-making Methods for the Area of Recycling.TEM J.8827–835. 10.18421/TEM83-19
36
NirmalaG.UthraG. (2017). Selecting best plastic recycling method using trapezoidal linguistic fuzzy preference relation.Int. J. Civ. Eng. Technol.8850–855.
37
PanigrahiS. K.KarF. W.FenT. A.HoeL. K.WongM. (2018). A Strategic Initiative for Successful Reverse Logistics Management in Retail Industry.Glob. Bus. Rev.19151–175. 10.1177/0972150918758096
38
RochatD.BinderC. R.DiazJ.JollietO. (2013). Combining Material Flow Analysis, Life Cycle Assessment, and Multiattribute Utility Theory Assessment of End-of-Life Scenarios for Polyethylene Terephthalate in Tunja, Colombia.J. Indus. Ecol.17642–655. 10.1111/jiec.12025
39
RodriguesM. O.GonçalvesA. M. M.GonçalvesF. J. M.NogueiraH.MarquesJ. C.AbrantesN. (2018). Effectiveness of a methodology of microplastics isolation for environmental monitoring in freshwater systems.Ecol. Indic.89488–495. 10.1016/j.ecolind.2018.02.038
40
RoyB. (1968). Classement et choix en présence de points de vue multiples (La methode ELECTRE).Rev. Inf. Rech. Oper.857–75.
41
SaatyT. L. (1980). The Analytical Hierarchy Process, Planning, Priority.New York: MacGraw-Hill.
42
SaatyT. L. (1996). Decision Making with Dependence and Feedback: The Analytic Network Process.Pittsburgh: RWS Publications.
43
SenthilS.MurugananthanK.RameshA. (2018). Analysis and prioritisation of risks in a reverse logistics network using hybrid multi-criteria decision making methods.J. Clean. Prod.179716–730. 10.1016/j.jclepro.2017.12.095
44
ThielM.Luna-JorqueraG.Álvarez-VarasR.GallardoC.HinojosaI. A.LunaN.et al (2018). Impacts of marine plastic pollution from continental coasts to subtropical gyres-fish, seabirds, and other vertebrates in the SE Pacific.Front. Mar. Sci.5:238. 10.3389/fmars.2018.00238
45
VinodhS.PrasannaM.Hari PrakashN. (2014). Integrated Fuzzy AHP-TOPSIS for selecting the best plastic recycling method: a case study.Appl. Math. Model.384662–4672. 10.1016/j.apm.2014.03.007
46
Vo DongA.Azzaro-PantelC.BoixM. (2019). A multi-period optimisation approach for deployment and optimal design of an aerospace CFRP waste management supply chain.Waste Manage.95201–216.
Summary
Keywords
multicriteria decision analysis, MCDA, MCDM, plastic waste, waste management, clean seas
Citation
Santos MR, Dias LC, Cunha MC and Marques JR (2022) Multicriteria Decision Analysis Addressing Marine and Terrestrial Plastic Waste Management: A Review. Front. Mar. Sci. 8:747712. doi: 10.3389/fmars.2021.747712
Received
26 July 2021
Accepted
17 December 2021
Published
07 January 2022
Volume
8 - 2021
Edited by
Roy Brouwer, University of Waterloo, Canada
Reviewed by
Periyadan K. Krishnakumar, King Fahd University of Petroleum and Minerals, Saudi Arabia; Gabriela Verónica Aguirre-Martínez, Arturo Prat University, Chile
Updates
Copyright
© 2022 Santos, Dias, Cunha and Marques.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Maria C. Cunha, mccunha@dec.uc.pt
This article was submitted to Marine Pollution, a section of the journal Frontiers in Marine Science
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.