Original Research ARTICLE
A Systems Approach to Performance Analysis in Women’s Netball: Using Work Domain Analysis to Model Elite Netball Performance
- 1Centre for Human Factors and Sociotechnical Systems, University of the Sunshine Coast, Sippy Downs, QLD, Australia
- 2Department of Movement Science, Australian Institute of Sport, Canberra, ACT, Australia
- 3School of Exercise Science, Australian Catholic University, Melbourne, VIC, Australia
- 4School of Health and Sports Sciences, University of the Sunshine Coast, Sippy Downs, QLD, Australia
Netball is a newly professional women’s sport, as such there has been little research conducted investigating performance analysis (PA) in elite netball. The aim of this study was to develop a model of the elite netball performance system to identify the complex relationships among key performance indicators. Eleven elite subject matter experts (SMEs) participated in workshops to produce a systems model of the netball match performance. The model was developed using the work domain analysis (WDA) method. A model of the netball match performance system was produced showing the interrelated objects, processes, functions, values, and purposes involved in elite level netball matches. The model identified the components of elite level netball performance and the interactions and relationships between them. The output of this research has identified novel PA measures including passing and possession measures, measures of cognitive performance, and measures related to physical activity. Netball is a complex sport, involving multiple dynamic and interrelated components. Consequently, there is an opportunity to develop holistic PA measures that focus on interacting components, as opposed to components in isolation.
Netball is one of the most popular women’s sports, and is played by more than 20 million people across more than 80 countries (Netball Australia, 2018). Since 1963 a netball World Championship tournament has been played every 4 years. In 1990 netball first featured in the Commonwealth Games as a demonstration sport, and has since been played competitively for medals since 1998 (Netball Australia, 2018). Despite substantial international popularity, netball remained an amateur sport for several decades. However, netball now has 61 countries recognized by the International Netball Federation, which includes several professional netball leagues. This recently obtained professional status of netball will no doubt generate new pressures and demands common within professional sport, one of which will be the increased demand for successful on-court match performance. To optimize match performance, it is necessary to assess performance variables in order to provide practical feedback to players and coaches, which will guide coaches decision making and subsequently the coaching process (Bishop, 2008).
Performance analysis (PA) in sport involves analysing and evaluating the technical, tactical, physical, and cognitive aspects of performance in training and competition to better understand the components of successful performance (Hughes and Franks, 2004; Bishop, 2008). There is a substantial body of PA research associated with long standing professional sports such as football (Sarmento et al., 2014, 2017), basketball (Bourbousson et al., 2010; Gómez et al., 2013; Sampaio et al., 2015), handball (Meletakos et al., 2011; Oliveira et al., 2012; Lago-Peñas et al., 2013), rugby (Vaz et al., 2010; Bishop and Barnes, 2013; Higham et al., 2014), water polo (Gómez et al., 2014; Lupo et al., 2014; Ruano et al., 2016), and Australian rules football (Robertson et al., 2015, 2016). In netball, research has focused on understanding the players’ physical (Davidson and Trewartha, 2008; Cormack et al., 2014; Bailey et al., 2017; Thomas et al., 2017), biomechanical (Fish and Greig, 2014; Sinclair et al., 2015), and anthropometric (Hopper et al., 1995) characteristics in isolation, rates of injury occurrence, and injury prevention strategies (Hume and Steele, 2000; McManus et al., 2006; Mason-Mackay et al., 2016). Although these studies have been important for understanding the physical demands of netball and have demonstrated the differences in variables between different levels of competition, they do little to describe on-court performance. As such, there is a paucity of PA research in netball that has attempted to integrate multiple components of match performance, or to understand team functioning. However, recent research has demonstrated that a complex system approach is necessary to understand sports performance, which requires a more holistic approach than isolated measurement of performance variables (McLean et al., 2017b; Salmon et al., 2017a; Hulme et al., 2018).
Previous research on the technical and tactical components of PA in netball has typically used descriptive notational analysis (frequencies and percentages) of isolated performance variables for individual players such as passing, turnovers, and shooting to determine successful netball performance (O’Donoghue et al., 2008; Pulling et al., 2016). This suggests that the current understanding of the composition of successful netball performance, and the appropriate methods to measure them is limited (Croft et al., 2017). A limitation of this approach in netball, and generally for team sports, is that components of performance are often investigated in isolation without consideration of the interactions between other components of performance (Rein and Memmert, 2016; McLean et al., 2017b). This represents a deterministic and reductionist approach to PA and does not consider interdependencies or the relational perspectives within and between teams that is required to understand and describe complex team performance (Mackenzie and Cushion, 2013; McLean et al., 2017b).
In sports PA research, it is becoming increasingly accepted that measuring isolated PA variables without considering the interactions between them, and the influence of match context, is limited and cannot appropriately explain team sports performance (McLean et al., 2017b; Sarmento et al., 2017). In addition, such analyses contribute to a research-practice gap, whereby the reductionist analyses are of limited use to coaches for the design of training practices (Bishop, 2008; McLean et al., 2017b). Invasion sports such as netball represent complex systems, where multiple human and non-human components are operating within a dynamic and constantly changing match environment (Duarte et al., 2012, 2013; McLean et al., 2017b). Investigating sporting performance as complex systems allows an understanding of the cooperative behaviors of team members in space and time, as well as emergent behaviors based on the opposition actions (Balague et al., 2013; Travassos et al., 2013). Traditional sport science research applications that measure individual performance variables cannot provide a complete understanding of the complexity of performance or the factors influencing it, nor do they allow the detection of new emergent behaviors that could improve performance, or how performance can be measured (Carling et al., 2014). Recent studies have demonstrated the benefit of analysing and understanding sporting performance using methods specifically designed for analysing complex systems (McLean et al., 2017b; Salmon et al., 2017a; Hulme et al., 2018). Systems ergonomics methods are specifically designed to understand complex system behavior, for example, one study used cognitive work analysis (CWA), a systems ergonomics method, to model the football performance system to identify the components of football performance, and the interactions between them (McLean et al., 2017b). Importantly, the use of subject matter experts (SMEs) in the development of the football performance model helped to provide practical insights for coaches that are both important to measure that are representative of the state of the system, and those that have a limited use for coaches (McLean et al., 2017b). In addition, over the past 5 years, there has been a progressive increase in team analysis measures based on positional data (Bartlett et al., 2012; Frencken et al., 2012; Moura et al., 2012), and teamwork interactions based on network analysis, in football and basketball (Clemente et al., 2015a; Gonçalves et al., 2017; McLean et al., 2017c). Moreover, at an elite level, coaches prefer emergent team PA measures compared to individual player analyses (McLean et al., 2017b). As such, the use of analysis methods to investigate group behaviors have improved our understanding of the complex and dynamic nature of team sports, and have provided usable information for coaches regarding team functioning (Sarmento et al., 2017).
The infancy of professional netball, and the subsequent lack of integrated PA research in elite level netball provides a unique opportunity to obtain a more complete understanding of the composition of performance in elite netball, to understand the interactions between components, emergent properties (Croft et al., 2017), and to develop a conceptual base for future research and PA in netball. By building on established PA research in other areas, it will be possible to optimize PA in netball, potentially skipping decades of research describing isolated and independent performance components, as has been the case in other sports (Mackenzie and Cushion, 2013). Therefore, the primary aim of the current study is to describe and model the netball performance system via the application of CWA, a systems ergonomic method that has been used to understand complex systems, and in the design and re-design of complex systems across multiple domains (see “Materials and Methods” section). This first-of-its-kind analysis will allow the identification of the different components of performance and how they interact to influence performance in netball. In turn, the model will support identification of appropriate PA measures for netball.
Materials and Methods
Ethical approval for this study was granted by the Human Research Ethics Committee at the University of the Sunshine Coast (A/17/1043). Eleven elite level SMEs participated in structured workshops to develop a systems analysis model of the netball match performance system. The SMEs were experienced elite level netball coaches (C), professional netball players (PL), netball performance analysts (PA), an exercise physiologist (EP), a sports psychologist (SP), a skill acquisition specialist (SA), a high-performance manager of a professional netball team (HPM), and a strength and conditioning coach (S&C) (Table 1).
In the current study, WDA, the first phase of a systems ergonomics method, CWA, was used to develop a model of the netball match performance system to describe in detail the composition of netball performance (Naikar et al., 1999). CWA (Vicente, 1999) is a systems analysis and design framework that has previously been used in sport to analyze the football match performance system (McLean et al., 2017b) and other complex sociotechnical systems (Read et al., 2016; Salmon et al., 2016, 2017b), and to inform system design or redesign activities (Cornelissen et al., 2014; Stanton and Bessell, 2014). The framework comprises five phases; however, the phases applied is dependent on the purpose of the analysis. This study uses the first phase of CWA (Vicente, 1999), WDA. WDA is used to provide an event and actor independent model of the system under analysis: in this case the elite netball match performance system. The aim is to understand the constraints imposed on the actions of any player performing activities within a netball match environment. This is achieved by describing systems at five conceptual levels using the abstraction hierarchy (AH) method (McLean et al., 2017b) (Table 2).
Within the WDA model the specific functional purposes, measures, functions, processes and physical objects are displayed as nodes. The nodes are linked across the AH levels via means-ends relationships (indicated by connecting lines in Figure 1). This indicates that linked nodes above a node in the hierarchy relate to why the content of the node is required, and the linked nodes below a node relate to how the node is achieved (Salmon et al., 2017b). For example, in the netball model the function ‘Attack’ might have links to values and priorities such as ‘Number of goals scored’ and ‘Scoring streak’ above, and links from object-related processes such as ‘Target for scoring’ and ‘Physical performance’ below.
The procedure for conducting a WDA requires an accepted nine step methodology (Naikar, 2013). The following section outlines the steps followed during the development of the current WDA.
Step 1: Establish Aims and Purpose
The purpose of the analysis was to develop a systems model of netball match performance, including a description of on-court performance, current measures used to assess performance, and to identify novel measures of performance.
Step 2: Anticipate Project Constraints
The main constraint considered was limited access to elite level SMEs due to the high demands placed on their time during training and competition. To manage this, we used multiple SMEs, including players, coaches, match analysts, and strength and conditioning coaches and held three separate workshops to provide as much opportunity for participation as possible.
Step 3: Define the System Boundary
To develop the WDA, it was necessary to set analysis boundaries. The boundary for the current analysis was confined to professional women’s netball match-play. Factors related to performance that occur outside of the match, such as training, nutrition, sleep, etc., were not considered in the analysis. A second aspect of the analysis boundary was a specific focus on elite level women’s netball.
Step 4: Classify System Constraints
For the purpose of this study, the WDA constraints represent the specific types of relationships that are to be modeled between the different components of netball match performance. For example, the physical context in which netball players operate imposes constraints on the actions of individual and group behaviors, whether this be via a need to adapt to the opposing team or the pressure to perform under stressful passages of play. Given that the relationships among performance-based components are largely non-deterministic (i.e., players continuously exhibit large degrees of freedom and latitude for behavior), the type of data sources and development of the analysis needed to include the firsthand experience of ‘real’ people who could reflect on why certain actions and behaviors occur during on court performances.
Step 5: Locate Data Sources
Existing scientific research in elite-level netball and wider sports performance peer-reviewed academic literature, as well as the identified SMEs were considered appropriate data sources to develop an initial WDA. In addition, the first author attended multiple training sessions of a professional netball team prior to the analysis to assist in understanding what comprises netball performance. The knowledge gained enabled recommendations of PA measures from other sports that could be modified and used in netball to assess performance.
Step 6: Construct the WDA
An initial model of the netball match system was developed by the research team based on the data collected in step five. The research team comprised four researchers experienced in applying systems ergonomics methods to sporting domains (Hulme et al., 2017; McLean et al., 2017b; Salmon et al., 2017a), two of which are human factors (HFs) practitioners with extensive experience in applying CWA in systems analysis and design across a range of safety critical domains (Read et al., 2015; Salmon et al., 2016), and two experienced netball performance analysts. Due to the scarcity of netball specific PA measures, several of the nodes within the initial WDA were derived from the PA literature on well-established professional sports. The research team applied the means-ends-links to the final model, to show the connections between the nodes across the levels of the AH using the how-what-why prompts.
Step 7: Refine the Analysis
The draft WDA model was reviewed and refined by the SMEs in three separate workshops. The SMEs were questioned on the appropriateness of the nodes in the draft model, including whether each node should be included or excluded from the model, and if the terms used were applicable to netball practitioners and coaches. Where required nodes and relationships were either removed, modified, or added.
Steps 8 and 9: Review and Validate the WDA
The completed WDA was presented to the two expert netball performance analysts for review. They were asked to review each node within the model, starting at the functional purposes level and proceeding downward to the physical objects level. The analysts agreed with the nodes at each level and provided no further modifications to the WDA model. To determine the novelty of included PA measures, the first author reviewed the existing literature on PA in netball, and items that have not previously been assessed in netball literature were considered to be novel to netball PA.
Modifications to the WDA
Based on the feedback from the SMEs during the workshops, there were modifications to the original WDA model of the netball performance system that was developed by the research team. See Appendix 1 for a summary of the SME modifications to the WDA model.
Work Domain Analysis
The ‘netball match performance model’ is presented in Figure 1.
Five functional purposes identified highlighting the importance of winning the match, continual team improvement, adherence to the game plans, the demonstration of team values, and a need to entertain audiences.
Values and Priority Measures
Nineteen values and priority measures were identified. These included measures of goal scoring and passing, defense, cognitive measures of psychological flow and scoreboard pressure, team structure measures of space creation, and the strategic use of time outs.
Purpose Related Functions
Eighteen general functions were deemed necessary for achieving the functional purposes. These included match phase measures such as such as attack, defend, and transition. Functions of cognitive and physical performance, and tactical measures including controlling momentum, maintenance of structures, and adaptability.
Object Related Processes and Physical Objects
The two lower levels of the WDA show the physical objects in the system and the processes that each object supports in order to achieve the purpose-related functions. For example, the ‘Goal post and goal’ provides a ‘Target for scoring,’ and ‘Footwear’ provides ‘Protection from injury.’
The means-end links in the WDA provide an indication of the relationships between the nodes across the five levels in terms of a how-what-why triad (Figure 2). The many-to-many means-end-links demonstrate the numerous possibilities for action available to the actors within the system (Figure 1).
Figure 2. Example means-end-links pathway. The relationship between levels of the abstraction hierarchy are indicated by the means-end-links using a how-what-why triad. Working from bottom to top, the physical object ‘Game plan,’ enables the object related process of ‘Define match tactics,’ which includes the purpose related function of ‘Adaptability’ of which can be assessed by the ‘Passing networks’ which can be measured to determine its influence on the functional purpose ‘Win the match.’ This approach is completed for all components in the developed netball performance system model.
The primary aim of this study was to develop, using WDA, a first-of-its-kind model of the netball performance system to determine the composition and interactions between the components of netball performance. Furthermore, the study aimed to identify components of performance that are not currently measured that have potential to advance PA in netball.
Issues Identified With Current PA in Netball
The discussions with SMEs in the workshops, and information from the relevant netball PA literature, indicates that PA in elite level netball primarily uses isolated notational analysis measures of individual players to describe performance. For example, commonly used measures identified included successful and unsuccessful passes, offensive and defensive rebounds, and number of penalties received. This reductionist approach is further problematic as the SMEs identified a lack of integration of these measures. It is our contention that PA in netball can be enhanced by addressing these issues by incorporating measures to analyze team behaviors. These measures can be extracted from the WDA. The following sections will discuss the results from across the levels of the WDA, with a specific focus on the functions and measures novel to PA in netball. The discussed functions and measures will highlight potential analysis methods aimed at increasing the quality of feedback to coaches, and subsequently improve coach’s decision making to improve the coaching process. The measures and functions presented in the following sections are those that are deemed to be novel to netball, based on the current literature and from the workshop discussions with the SMEs. The two lower levels; object related processes and the physical objects from the WDA are not discussed further as they do not represent specific measures and functions of performance, which is the main focus of the study. They do, however, influence the behavior of the system which is indicated by the means-end-links (Figure 2).
Five functional purposes were identified in the WDA (Figure 1). Although winning the match would logically be considered as the most important functional purpose, other functional purposes were identified, which were seen as changing in priority depending upon contextual factors. For example, the coaching staff and players may still be satisfied when losing if the team has implemented the game plan, progressively improved from previous performances, and demonstrated team values. The means-end links in the WDA demonstrate the interactions between the measures and functions, and the core functional purposes. However, it is questionable as to how appropriately the functional purposes within the system are currently measured, due to the reductionist tendencies of the notational analysis measures typically used for PA in netball. Using performance measures that cannot comprehensively measure the functional purposes identified in the WDA indicates that at present coaches may be required to subjectively assess the functional purposes of a match. This is potentially problematic as coaches use match performance statistics to reinforce their opinions of match events for decisions relating to future matches (Hughes and Bartlett, 2002). As such, basing decisions on variables that cannot fully capture the interactions of the components of performance, may lead to incorrect or misinformed decision making by coaches. In other words, “Most of us only see what we expect to see, and what we expect to see is what we are conditioned to see when we have learned the definitions and classifications of our culture” (Turner et al., 1967). Therefore, to optimize PA in netball, more sophisticated measures used in other more established professional sports (that are presented in the WDA) could be modified and used to objectively describe if the functional purposes are being achieved. In addition, the SMEs emphasized that as a relatively new professional women’s sport, it is important that netball matches provide entertainment in order to develop a strong supporter base, to gain sponsors, and to compete with other women’s sports to ensure long-term sustainability.
Values and Priority Measures
Several of the values and priority measures from the WDA, including passing and goal scoring variables, turnovers, and rebounds have previously been measured to assess netball performance (O’Donoghue et al., 2008; Pulling et al., 2016; Croft et al., 2017). Although these match actions are important for successful performance in netball, they are often measured in isolation and without context, which limits their use for coaches (McLean et al., 2017b). Therefore, the model was used to identify novel measures of performances including group behaviors, measures from other sports that could be modified and applied to netball, outcome measures related to physical performance, and measures to optimize cognitive performance.
Passing, Possession, and Shooting
Research on passing in netball has previously used descriptive notational analysis methods to determine performance (Pulling et al., 2016). Using isolated passing success or frequency to assess performance has decreased in many other sports and been replaced with more sophisticated methods (Gonçalves et al., 2017; McLean et al., 2017c, 2018b; Ribeiro et al., 2017; Mclean and Salmon, 2019). Therefore, to enhance PA in netball, the WDA included passing metrics used in other team sports to assess performance which have potential to be used for PA in netball. One of the aims of invasion team sports is to score points by overcoming the opposition through intra team coordination and passing (Eccles and Tenenbaum, 2004). Therefore, for the passing analyses to be effective, the methods applied need to explain this team connectivity and coordination. Network analysis is a commonly used method to assess passing interactions in other sports (Ribeiro et al., 2017). Network analysis is used to analyze passing networks and provides quantifiable metrics of the connectivity of the team, and identifies the influential players within the team (Clemente et al., 2015a,b; McLean et al., 2017a,c, 2018a). The advantage of measuring passing networks over traditional approaches is the consideration of interdependencies and relational perspectives relative to the entire team, compared to individual assessment of passing (Figure 3) (Wäsche et al., 2017). This provides information to coaches regarding team functioning, and potentially assesses whether match tactics are being achieved, or require changing. Therefore, the use of passing networks rather than isolated passing metrics (e.g., successful and unsuccessful passes) will provide additional information on team functioning in netball. In addition, the passing network analyses could be further enhanced when integrated with the location on the court where the passing networks commence, progress through the court, and break down (McLean et al., 2017c). This allows the identification of the areas of the court where passing networks were successful, the vectors of the passing network, or potentially where the opposition focuses their passing networks and their vectors (McLean et al., 2017c).
Figure 3. Network analysis diagram of passing in a netball match. The direction of attack is from left to right. In this conceptual example, the node (player) size is based on degree centrality (number of outward passes in the match). The larger nodes represent more passes made, and the edges (passes) are weighted by frequency of passes completed between players, e.g., thicker lines indicate a greater frequency of passes. GK (goalkeeper), GD (goal defense), WD (wing defense), C (center), WA (wing attack), GA (goal attack), GS (goal shooter).
Passing metrics that identify and describe the penetration through opposition defenses, and spatial dominance are beginning to be used in other sports as a measure to assess the quality of passes (McLean et al., 2017b; Rein et al., 2017; Tenga et al., 2017). These metrics consider the number of opposition players bypassed by a single pass, which is an effective pass compared to a sideways or backward pass that enables the defenders to still be involved in that specific moment of the game. Given the use of these measure in other team sports, penetrative passes would be a useful measure in netball, which prompted its inclusion in the WDA. Although this approach represents a somewhat isolated passing metric, it is a good example of how isolated passing analysis can be used alongside contextual details to provide a detailed analysis of the effectiveness of a pass.
The analysis indicated that isolated types of passing that are currently measured, such as center passes, and goal circle edge feeds, should be reported with a shooting outcome. For example, instead of simply counting the center passes, and goal circle edge feeds, measuring the center passes that were converted, or the goal circle edge feeds that were converted would provide a more detailed analysis, and could be incorporated into the passing network analysis.
Physical Performance Measures
Measuring physical performance in isolation, such as distance covered or the number of accelerations performed, also has limitations in relation to PA in sport, as physical outputs alone are not good indicators of overall performance (McLean et al., 2017b). Netball performance requires repeat explosive actions (Cormack et al., 2014), however, simply measuring the accelerations does not provide any information for how the accelerations benefit performance. In the model, strong takes were identified as a potential measure that has a performance outcome related to physical performance. Strong takes was defined as a received pass preceded by a rapid acceleration. Furthermore, acceleration data derived from motion tracking micro-technology could be a useful measure to determine effective defensive pressure, as it has been shown that percentage of passing occurrences is less in high compared to low defensive pressure for expert netball players (Bruce et al., 2009). Therefore, a measurement that describes the speed to apply defensive pressure, based on accelerations of the players may be a potential future measure when analysing performance in netball. Understanding physical match demands is important, especially from a load and injury prevention perspective (Bailey et al., 2017), however, more work is needed to integrate physical measures to performance outcome measures. Furthermore, the PA measures incorporating physical demands proposed here are somewhat subjective, suggesting that more sophisticated and objective methods are required.
Optimizing Cognitive Performance
The SMEs indicated that based on previous experience psychological flow was identified as a key component of performance in elite level netball. Psychological flow in sport is explained as the optimal psychological state for performance (Csikszentmihalyi, 1990). Experiencing flow for an athlete is characterized by an intense focus and absorption in an activity, at the exclusion of all other thoughts and emotions (Swann et al., 2012). As a result, players acquire a sense of ‘everything coming together’ even in the most demanding situations (Swann et al., 2012). Interestingly, psychological flow in netball is not represented in the literature and the SMEs indicated that flow is not routinely assessed in professional netball. The absence of such measures are despite the existence of flow state scales developed to measure flow (Jackson and Marsh, 1996). Understanding the mechanisms of flow, and the behaviors and actions of players and teams demonstrated during flow states could enhance performance in netball. Importantly, as players share common experiences such as the same opponent, the same coach, and the same conditions of play, flow can be experienced at a team level (Bakker et al., 2011).
Minimizing scoreboard pressure errors was included in the WDA as an area where players’ cognitive performance could be enhanced. The effect of scoreboard pressure on the players, which typically occurs toward the end of quarters, was described by the SMEs as a critical phase in the match that can have a direct influence on netball performance and match outcome. For example, toward the end of matches and in overtime of close matches, basketball players may be overstimulated (anxiety and self-doubt) and therefore vulnerable to distractions (Hill et al., 2009, 2010; Gómez et al., 2015). This results in poorer decision making and subsequently turnovers of possession, compared to an optimally stimulated state (Hill et al., 2009, 2010; Bradley et al., 2011). Although, no research exits on scoreboard pressure in netball, coaches could improve this component of performance in training using time and match status constraints to replicate these periods of a match.
Purpose Related Functions
The functions identified at this level included the high-level functions of attack, defend, gain and maintain possession, and components of these functions have been previously measured using a variety of methods (O’Donoghue et al., 2008; Pulling et al., 2016). However, several novel functions of netball performance were identified in the current model and require further investigation to optimize netball performance. These include controlling momentum, spatial awareness, unpredictability to opponents, and maintaining unit structures. Importantly, these functions consider the relational perspective of team members, and reduce the isolated type of analysis used so far in PA in netball research.
Unpredictability to Opponents
Unpredictability to opponents in attack was identified and included as a function of performance in the WDA. Commonly termed entropy in sport science, unpredictability has been measured in other sports to determine the predictability of ball movements during play (Hobbs et al., 2018). In basketball, there is a relationship between teams who display entropy in offensive phases and the probability of a shot for an undefended player (D’Amour et al., 2015). A separate study investigating entropy of ball movements in basketball showed that in matches won, the team displayed increased entropy in the front court (scoring zone) compared to matches lost (Hobbs et al., 2018). This result not only shows the importance of being unpredictable in and around the scoring areas, but also the importance of analysing unpredictability in relation to elements of match context such as the location of actions. Given the use of entropy as measure of performance in basketball, it is logical that entropy could be a useful measure in netball to assess performance due to the similarities of the sports. In addition, this could be optimized in netball to include the entropy of the players spatial movements (Sampaio and Maçãs, 2012) in combination with the ball trajectories (Hobbs et al., 2018). An interesting future direction would be to investigate entropy as a function of match status, to assess differences in entropy whilst winning and losing netball matches.
Maintenance of Unit Structures
The maintenance of team structures in sport is an integral component of successful performance (McLean et al., 2017b). As such, maintaining unit structure in netball is a critical strategy to (a) be compact defensively, and (b) destabilize the opposing teams’ defensive structures by increasing the distance between the opposition defenders when attacking (Moura et al., 2012). In football, during attacking phases of a match the players are more dispersed across the length and width of the pitch compared to defending situations where they are more compact (Moura et al., 2012). As an attacking team, an aim is to increase the dispersion of the defenders to attempt to create space for a shot at goal. For example, when the distance between defensive players in football is increased, more attempts at goal are conceded compared to when the distance between defenders is decreased (Moura et al., 2012). Although there is no research of this type in netball, research into team structures in other sports has shown the value of such information to understand the necessary components of creating attempts at goal. A difference between netball and other sports is that the match constraints in netball allow players of only certain positions to attack or defend. For example, only four players from each team can occupy the defensive zone, and only four players from each team can occupy the attacking zone of the court. For this reason, maintaining attacking or defensive units was included in the WDA rather than maintaining the entire team structure. There are various existing methods of assessing the maintenance of team structure, including stretch index, measurements of surface area, playing area, effective playing area, and centroid measures (Sarmento et al., 2017), all of which have potential to determine the maintenance of unit structures in elite netball.
The ability to control momentum in netball was supported in this analysis. The SMEs described controlling momentum in netball as the ability to slow down or speed up play as the match situation demands. Synonymous with controlling momentum is match tempo, which has not been clearly defined in sport science research (McLean et al., 2017b). There are conflicting definitions of tempo, and attempts to define it have included time in possession, speed of the ball, and speed of the players (Tenga et al., 2009; Buchheit et al., 2010; Wallace and Norton, 2014). However, a comprehensive definition of tempo, and the relationship between tempo and performance in sport is yet to be established (McLean et al., 2017b). The SMEs indicated that understanding the mechanisms of controlling momentum in netball would be beneficial to performance. Firstly, an appropriate method to determine how to measure tempo in netball is required, followed by methods to understand the player behaviors required to control it. This represents an opportunity for future research, and such results that would be informative and useable for coaches.
This first-of-its-kind WDA of the elite women’s netball performance system has demonstrated that netball is a complex system, which consists of multiple interacting and competing components of performance. The purpose of the WDA is not to determine the relative importance of individual nodes, but to capture all of the possibilities that influence performance. One of the strengths of WDA is that it does not attempt to describe or predict the behavior of the individuals within the analysis, but instead describes the constraints in the system that can influence and effect behavior (McLean et al., 2017b). This is important because coaches each have their own philosophies and preferred coaching styles. In the current study, it was important to model the existing measures of PA in netball, as well as to include novel functions of performance and potential measures that would exist in the optimal netball performance system. It is noted that the necessary resources required for measuring some of the proposed performance variables from the current study may not be readily available for many netball performance analysts at this early point in professional netball. This should represent a challenge to researchers to develop methods that are sophisticated and inexpensive, yet useable in practice. For instance, valid and reliable observational instruments for the technical and tactical analysis of rugby performance have been designed and could be extended to many of the novel netball performance measures proposed in this study (Villarejo et al., 2014). It has been shown here that by understanding the PA variables of other sports more advanced in terms of PA than netball, there are possibilities to modify variables to be appropriate for netball. By enhancing the PA methods in netball, a more detailed analysis is achieved which will subsequently improve the feedback to coaches and players, and improves coach’s knowledge of PA. By using elite level netball SMEs to develop the model ensures that the novel methods identified here will be usable in practice.
A final point of consideration relates to the lack of sports science research that has applied systems thinking approaches in women’s sports contexts. Thus, this research addresses two important needs. First, netball is an under-researched area relative to other team-based sports contexts, and the use of a systems-based PA framework has been beneficial at identifying non-traditional aspects of on-court performances that require the attention of coaches and players. Secondly, this research should encourage sports scientists to apply other systems thinking approaches to optimize performance in women’s sports contexts – whether this be netball or otherwise. For example, the next step following this research may be to explore how best to measure, test and validate the novel performance components identified and question the feasibility of doing so from a practical and coaching standpoint. This way, the growth of women’s sport can parallel scientific advancement and innovation in the sports sciences, bringing with it the formalization of systems thinking approaches in a underrepresented athletic group.
A potential limitation of the current study is the small number of SMEs used to develop the WDA model of elite level netball. However, the SMEs who participated in the current study have extensive experience in elite level netball including participation in national and international competitions as coaches, analysts, and players. Furthermore, a similar model of football performance used eight SMEs in their analysis (McLean et al., 2017b), and other research using this method has ranged from three to eleven SMEs to develop similar models (Jenkins et al., 2011; Salmon et al., 2016). In addition, the demographics of the SMEs spanned three of the top nations in world netball (Australia, New Zealand, and South Africa). A limitation of the WDA method is that is does not weight the relationships between the nodes to determine nodal importance. However, the purpose of the WDA phase of the CWA framework is to model the entire netball performance system, and in doing so identify all the components within the system that influence the functions and measures of performance. Future research could attempt to weight the relationships between nodes to determine nodal importance.
The current study provided a first-of-its-kind complex systems model of the elite women’s netball match performance system. The model depicts the key components of netball match performance along with the means-ends relationships between them. It is concluded that, whilst netball performance is complex in nature, there are various opportunities to understand this complexity through the introduction of new PA measures. Further investigation is recommended, particularly the development, testing and validation of the new measures discussed. It is hoped that researchers and practitioners use the model presented in this article to facilitate this, and that netball PA is optimized as a result.
SM, AH, GR, and PS conceived the study. SM, AH, GR, AB, and PS performed the study. SM, AH, MM, GR, AB, and PS analyzed the data, wrote and revised the manuscript.
PS’s contribution to this research was supported by his current ARC Future Fellowship (FT140100681). GR’s contribution to the research was funded through her Australian Research Council Discovery Early Career Research Award (DE DE180101449).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Bailey, J. A., Gastin, P. B., Mackey, L., and Dwyer, D. B. (2017). The player load associated with typical activities in elite netball. Int. J. Sports Physiol. Perform. 12, 1218–1223. doi: 10.1123/ijspp.2016-0378
Bakker, A. B., Oerlemans, W., Demerouti, E., Slot, B. B., and Ali, D. K. (2011). Flow and performance: a study among talented Dutch soccer players. Psychol. Sport Exer. 12, 442–450. doi: 10.1016/j.psychsport.2011.02.003
Bartlett, R., Button, C., Robins, M., Dutt-Mazumder, A., and Kennedy, G. (2012). Analysing team coordination patterns from player movement trajectories in soccer: methodological considerations. Int. J. Perform. Anal. Sport 12, 398–424. doi: 10.1080/24748668.2012.11868607
Bishop, L., and Barnes, A. (2013). Performance indicators that discriminate winning and losing in the knockout stages of the 2011 Rugby World Cup. Int. J. Perform. Anal. Sport 13, 149–159. doi: 10.1080/24748668.2013.11868638
Bourbousson, J., Sève, C., and McGarry, T. (2010). Space–time coordination dynamics in basketball: part 1. Intra-and inter-couplings among player dyads. J. Sports Sci. 28, 339–347. doi: 10.1080/02640410903503632
Bradley, P. S., Carling, C., Archer, D., Roberts, J., Dodds, A., Di Mascio, M., et al. (2011). The effect of playing formation on high-intensity running and technical profiles in English FA Premier League soccer matches. J. Sports Sci. 29, 821–830. doi: 10.1080/02640414.2011.561868
Carling, C., Wright, C., Nelson, L. J., and Bradley, P. S. (2014). Comment on ‘Performance analysis in football: a critical review and implications for future research’. J. Sports Sci. 32, 2–7. doi: 10.1080/02640414.2013.807352
Clemente, F. M., Martins, F. M. L., Kalamaras, D., Wong, D. P., and Mendes, R. S. (2015a). General network analysis of national soccer teams in FIFA World Cup 2014. Int. J. Perform. Anal. Sport 15, 80–96. doi: 10.1080/24748668.2015.11868778
Clemente, F. M., Martins, F. M. L., Wong, D. P., Kalamaras, D., and Mendes, R. S. (2015b). Midfielder as the prominent participant in the building attack: a network analysis of national teams in FIFA World Cup 2014. Int. J. Perform. Anal. Sport 15, 704–722. doi: 10.1080/24748668.2015.11868825
Cormack, S. J., Smith, R. L., Mooney, M. M., Young, W. B., and O’Brien, B. J. (2014). Accelerometer load as a measure of activity profile in different standards of netball match play. Int. J. Sports Physiol. Perform. 9, 283–291. doi: 10.1123/ijspp.2012-0216
Cornelissen, M., McClure, R., Salmon, P. M., and Stanton, N. A. (2014). Validating the strategies analysis diagram: assessing the reliability and validity of a formative method. Appl. Ergon. 45, 1484–1494. doi: 10.1016/j.apergo.2014.04.010
Croft, H., Willcox, B., and Lamb, P. (2017). Using performance data to identify styles of play in netball: an alternative to performance indicators. Int. J. Perform. Anal. Sport 17, 1034–1043. doi: 10.1080/24748668.2017.1419408
Duarte, R., Araújo, D., Folgado, H., Esteves, P., Marques, P., and Davids, K. (2013). Capturing complex, non-linear team behaviours during competitive football performance. J. Syst. Sci. Complex. 26, 62–72. doi: 10.1007/s11424-013-2290-3
Eccles, D. W., and Tenenbaum, G. (2004). Why an expert team is more than a team of experts: a social-cognitive conceptualization of team coordination and communication in sport. J. Sport Exerc. Psychol. 26, 542–560. doi: 10.1123/jsep.26.4.542
Frencken, W., Poel, H. D., Visscher, C., and Lemmink, K. (2012). Variability of inter-team distances associated with match events in elite-standard soccer. J. Sports Sci. 30, 1207–1213. doi: 10.1080/02640414.2012.703783
Gómez, M.-A., Lorenzo, A., Ibañez, S.-J., and Sampaio, J. (2013). Ball possession effectiveness in men’s and women’s elite basketball according to situational variables in different game periods. J. Sports Sci. 31, 1578–1587. doi: 10.1080/02640414.2013.792942
Gómez, M. -Á, DelaSerna, A., Lupo, C., and Sampaio, J. (2014). Effects of situational variables and starting quarter score in the outcome of elite women’s water polo game quarters. Int. J. Perform. Anal. Sport 14, 73–83. doi: 10.1097/JSC.0000000000000234
Gómez, M. Á, Lorenzo, A., Jiménez, S., Navarro, R. M., and Sampaio, J. (2015). Examining choking in basketball: effects of game outcome and situational variables during last 5 minutes and overtimes. Percept. Mot. Skills 120, 111–124. doi: 10.2466/25.29.PMS.120v11x0
Gonçalves, B., Coutinho, D., Santos, S., Lago-Penas, C., Jiménez, S., and Sampaio, J. (2017). Exploring team passing networks and player movement dynamics in youth association football. PLoS One 12:e0171156. doi: 10.1371/journal.pone.0171156
Hobbs, W., Morgan, S., Gorman, A. D., Mooney, M., and Freeston, J. (2018). Playing unpredictably: measuring the entropy of ball trajectories in international women’s basketball. Int. J. Perform. Anal. Sport 18, 1–12. doi: 10.1080/24748668.2018.1453639
Hopper, D. M., Hopper, J. L., and Elliott, B. C. (1995). Do selected kinanthropometric and performance variables predict injuries in female netball players? J. Sports Sci. 13, 213–222. doi: 10.1080/02640419508732230
Hulme, A., Salmon, P., Nielsen, R., Read, G. J., and Finch, C. (2017). Closing Pandora’s box: adapting a systems ergonomics methodology for better understanding the ecological complexity underpinning the development and prevention of running-related injury. Theor. Issues Ergon. Sci. 18, 338–359. doi: 10.1080/1463922X.2016.1274455
Hulme, A., Thompson, J., Plant, K. L., Read, G. J., Mclean, S., Clacy, A., et al. (2018). Applying systems ergonomics methods in sport: a systematic review. Appl. Ergon. doi: 10.1016/j.apergo.2018.03.019 [Epub ahead of print].
Jenkins, D. P., Stanton, N. A., Salmon, P. M., and Walker, G. H. (2011). Using work domain analysis to evaluate the impact of technological change on the performance of complex socio-technical systems. Theor. Issues Ergon. Sci. 12, 1–14. doi: 10.1080/14639220903353401
Lago-Peñas, C., Gómez, A. M., Viaño, J., González-García, I., and Fernández-Villarino, M. d. L. á (2013). Home advantage in elite handball: the impact of the quality of opposition on team performance. Int. J. Perform. Anal. Sport 13, 724–733. doi: 10.1080/24748668.2013.11868684
Lupo, C., Condello, G., Capranica, L., and Tessitore, A. (2014). Women’s water polo World Championships: technical and tactical aspects of winning and losing teams in close and unbalanced games. J. Strength Cond. Res. 28, 210–222. doi: 10.1519/JSC.0b013e3182955d90
Mason-Mackay, A. R., Whatman, C., Reid, D., and Lorimer, A. (2016). The effect of ankle bracing on landing biomechanics in female netballers. Phys. Ther. Sport 20, 13–18. doi: 10.1016/j.ptsp.2015.11.002
McLean, S., Salmon, P., Gorman, A., Dodd, K., and Solomon, C. (2018a). Integrating communication and passing networks in football using social network analysis. Sci. Med. Football. doi: 10.1080/24733938.2018.1478122
McLean, S., Salmon, P., Gorman, A., Wickham, J., Berber, E., and Solomon, C. (2018b). The effect of playing formation the passing network characteristics of a professional football team. Hum. Mov. 19. 14–22. doi: 10.5114/hm.2018.79416
McLean, S., Salmon, P. M., Gorman, A. D., Naughton, M., and Solomon, C. (2017a). Do inter-continental playing styles exist? Using social network analysis to compare goals from the 2016 EURO and COPA football tournaments knock-out stages. Theor. Issues Ergon. Sci. 18, 370–383. doi: 10.1080/1463922X.2017.1290158
McLean, S., Salmon, P. M., Gorman, A. D., Read, G. J., and Solomon, C. (2017b). What’s in a game? A systems approach to enhancing performance analysis in football. PLoS One 12:e0172565. doi: 10.1371/journal.pone.0172565
McLean, S., Salmon, P. M., Gorman, A. D., Stevens, N. J., and Solomon, C. (2017c). A social network analysis of the goal scoring passing networks of the 2016 European Football Championships. Hum. Mov. Sci. 57, 400–408. doi: 10.1016/j.humov.2017.10.001
Meletakos, P., Vagenas, G., and Bayios, I. (2011). A multivariate assessment of offensive performance indicators in men’s handball: trends and differences in the World Championships. Int. J. Perform. Anal. Sport 11, 284–294. doi: 10.1080/24748668.2011.11868548
Moura, F. A., Martins, L. E. B., Anido, R. D. O., De Barros, R. M. L., and Cunha, S. A. (2012). Quantitative analysis of Brazilian football players’ organisation on the pitch. Sports Biomech. 11, 85–96. doi: 10.1080/14763141.2011.637123
Naikar, N., Sanderson, P. M., and Lintern, G. (1999). Work domain analysis for identification of training needs and training-system design. Paper Presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Washington, DC. doi: 10.1177/154193129904302103
Netball Australia (2018). History of Netball. Available at: http://netball.com.au/about-netball-australia/history-of-netball/ [acessed October 19, 2018].
Oliveira, T., Gómez, M., and Sampaio, J. (2012). Effects of game location, period, and quality of opposition in elite handball performances. Percept. Mot. Skills 114, 783–794. doi: 10.2466/30.06.PMS.114.3.783-794
Read, G. J., Salmon, P. M., Lenné, M. G., and Stanton, N. A. (2015). Designing sociotechnical systems with cognitive work analysis: putting theory back into practice. Ergonomics 58, 822–851. doi: 10.1080/00140139.2014.980335
Read, G. J., Salmon, P. M., Lenné, M. G., and Stanton, N. A. (2016). Walking the line: understanding pedestrian behaviour and risk at rail level crossings with cognitive work analysis. Appl. Ergon. 53, 209–227. doi: 10.1016/j.apergo.2015.10.004
Ribeiro, J., Silva, P., Duarte, R., Davids, K., and Garganta, J. (2017). Team sports performance analysed through the lens of social network theory: implications for research and practice. Sports Med. 47, 1689–1696. doi: 10.1007/s40279-017-0695-1
Robertson, S., Back, N., and Bartlett, J. D. (2016). Explaining match outcome in elite Australian rules football using team performance indicators. J. Sports Sci. 34, 637–644. doi: 10.1080/02640414.2015.1066026
Robertson, S., Woods, C., and Gastin, P. (2015). Predicting higher selection in elite junior Australian rules football: the influence of physical performance and anthropometric attributes. J. Sci. Med. Sport 18, 601–606. doi: 10.1016/j.jsams.2014.07.019
Ruano, M. Á, Serna, A. D., Lupo, C., and Sampaio, J. E. (2016). Effects of game location, quality of opposition, and starting quarter score in the outcome of elite water polo quarters. J. Strength Cond. Res. 30, 1014–1020. doi: 10.1097/JSC.0000000000000234
Salmon, P. M., Lenné, M. G., Read, G. J., Mulvihill, C. M., Cornelissen, M., Walker, G., et al. (2016). More than meets the eye: using cognitive work analysis to identify design requirements for future rail level crossing systems. Appl. Ergon. 53, 312–322. doi: 10.1016/j.apergo.2015.06.021
Sampaio, J., McGarry, T., Calleja-González, J., Sáiz, S. J., del Alcázar, X. S., and Balciunas, M. (2015). Exploring game performance in the National basketball association using player tracking data. PLoS One 10:e0132894. doi: 10.1371/journal.pone.0132894
Sarmento, H., Clemente, F. M., Araújo, D., Davids, K., McRobert, A., and Figueiredo, A. (2017). What performance analysts need to know about research trends in Association football (2012–2016): a systematic review. Sports Med. 48, 799–836. doi: 10.1007/s40279-017-0836-6
Sarmento, H., Marcelino, R., Anguera, M. T., CampaniÇo, J., Matos, N., and LeitÃo, J. C. (2014). Match analysis in football: a systematic review. J. Sports Sci. 32, 1831–1843. doi: 10.1080/02640414.2014.898852
Sinclair, J., Chockalingam, N., Naemi, R., and Vincent, H. (2015). The effects of sport-specific and minimalist footwear on the kinetics and kinematics of three netball-specific movements. Footwear Sci. 7, 31–36. doi: 10.1080/19424280.2014.983445
Stanton, N. A., and Bessell, K. (2014). How a submarine returns to periscope depth: analysing complex socio-technical systems using cognitive work analysis. Appl. Ergon. 45, 110–125. doi: 10.1016/j.apergo.2013.04.022
Swann, C., Keegan, R. J., Piggott, D., and Crust, L. (2012). A systematic review of the experience, occurrence, and controllability of flow states in elite sport. Psychol. Sport Exerc. 13, 807–819. doi: 10.1016/j.psychsport.2012.05.006
Tenga, A., Kanstad, D., Ronglan, L., and Bahr, R. (2009). Developing a new method for team match performance analysis in professional soccer and testing its reliability. Int. J. Perform. Anal. Sport 9, 8–25. doi: 10.1080/24748668.2009.11868461
Tenga, A., Mortensholm, A., and O’Donoghue, P. (2017). Opposition interaction in creating penetration during match play in elite soccer: evidence from UEFA champions league matches. Int. J. Perform. Anal. Sport 17, 802–812. doi: 10.1080/24748668.2017.1399326
Thomas, C., Ismail, K. T., Simpson, R., Comfort, P., Jones, P. A., and Dos’Santos, T. (2017). Physical profiles of female academy netball players by position. J. Strength Cond. Res. doi: 10.1519/JSC.0000000000001949 [Epub ahead of print].
Travassos, B., Davids, K., Araújo, D., and Esteves, P. T. (2013). Performance analysis in team sports: advances from an ecological dynamics approach. Int. J. Perform. Anal. Sport 13, 83–95. doi: 10.1080/24748668.2013.11868633
Villarejo, D., Ortega, E., Gómez, M. -Á, and Palao, J.-M. (2014). Design, validation, and reliability of an observational instrument for ball possessions in rugby union. Int. J. Perform. Anal. Sport 14, 955–967. doi: 10.1080/24748668.2014.11868771
Wallace, J. L., and Norton, K. I. (2014). Evolution of World cup soccer final games 1966–2010: game structure, speed and play patterns. J. Sci. Med. Sport 17, 223–228. doi: 10.1016/j.jsams.2013.03.016
Appendix 1 | Sme Modifications to the Initial WDA.
Keywords: netball, performance analysis, work domain analysis, coaching, women’s sport
Citation: Mclean S, Hulme A, Mooney M, Read GJM, Bedford A and Salmon PM (2019) A Systems Approach to Performance Analysis in Women’s Netball: Using Work Domain Analysis to Model Elite Netball Performance. Front. Psychol. 10:201. doi: 10.3389/fpsyg.2019.00201
Received: 09 November 2018; Accepted: 21 January 2019;
Published: 06 February 2019.
Edited by:Guy Cheron, Free University of Brussels, Belgium
Reviewed by:Annette Raynor, Edith Cowan University, Australia
Miguel-Angel Gomez-Ruano, Polytechnic University of Madrid, Spain
Copyright © 2019 Mclean, Hulme, Mooney, Read, Bedford and Salmon. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Scott Mclean, email@example.com