An Empirical Study on Performance Comparisons of Different Types of DevOps Team Structure Formations and Performance

HALİL ERGUN KORKMAZ^*Mehmet Nafiz Aydin

• Kadir Has University, Istanbul, Türkiye

Despite all the efforts to successfully implement DevOps practices, principles, and cultural change, there is still a lack of understanding on how DevOps team structure formation and performance differences are related. The lack of a ground truth for DevOps team structure formation and performance has become a persistent and relevant problem for companies and researchers. In this study, we propose a framework for DevOps team Formation-Performance and conduct a survey to examine the relationships between team formations and performance with the five metrics we identified, two of which are novel. We conducted an empirical study using a survey to gather data. We employed targeted outreach on a social media platform along via a snowball sampling and sent 380 messages to DevOps professionals worldwide. This approach resulted in 122 positive responses and 105 completed surveys, achieving a 69.7% response rate from those who agreed to participate. The research shows that implementing the DevOps methodology enhances team efficiency across various organizational team structures, with the sole exception of "Separate Development and Operation teams with limited collaboration." Moreover, the study reveals that all teams experienced improvements in Repair/Recovery performance metric following DevOps adoption. Notably, the "Separate Development and Operation teams with high collaboration" formation emerged as the top performer in the key metrics, including Deployment Frequency, Number of Incidents, and Number of Failures/Service Interruptions. The analysis further indicates that different DevOps organizational formations do not significantly impact Lead Time, Repair/Recovery, and Number of Failures/Service Interruptions in terms of goal achievement. However, a statistically significant disparity was observed between "Separate Development and Operation teams with high collaboration" and "A single team formation" regarding the Deployment Frequency goal achievement percentage. The managerial and scientific implications of the findings are discussed by employing DevOps adoption team performance comparison.