<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Educ.</journal-id>
<journal-title>Frontiers in Education</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Educ.</abbrev-journal-title>
<issn pub-type="epub">2504-284X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/feduc.2022.948783</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Education</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Finnish teachers&#x2019; and students&#x2019; programming motivation and their role in teaching and learning computational thinking</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Fagerlund</surname> <given-names>Janne</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1655694/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Leino</surname> <given-names>Kaisa</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Kiuru</surname> <given-names>Noona</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Niilo-R&#x00E4;m&#x00E4;</surname> <given-names>Mikko</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Finnish Institute for Educational Research, University of Jyv&#x00E4;skyl&#x00E4;</institution>, <addr-line>Jyv&#x00E4;skyl&#x00E4;</addr-line>, <country>Finland</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Psychology, Faculty of Education and Psychology, University of Jyv&#x00E4;skyl&#x00E4;</institution>, <addr-line>Jyv&#x00E4;skyl&#x00E4;</addr-line>, <country>Finland</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Eileen Scanlon, The Open University, United Kingdom</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Florian Krieger, Technical University Dortmund, Germany; Gary Wong, The University of Hong Kong, Hong Kong SAR, China</p></fn>
<corresp id="c001">&#x002A;Correspondence: Janne Fagerlund, <email>janne.fagerlund@jyu.fi</email></corresp>
<fn fn-type="other" id="fn004"><p>This article was submitted to Digital Learning Innovations, a section of the journal Frontiers in Education</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>21</day>
<month>11</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>7</volume>
<elocation-id>948783</elocation-id>
<history>
<date date-type="received">
<day>20</day>
<month>05</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>31</day>
<month>10</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2022 Fagerlund, Leino, Kiuru and Niilo-R&#x00E4;m&#x00E4;.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Fagerlund, Leino, Kiuru and Niilo-R&#x00E4;m&#x00E4;</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<sec>
<title>Introduction</title>
<p>Despite the growing importance of teaching and learning computational thinking (CT) through programming in schools, research has shown major individual differences in teachers&#x2019; instruction emphasis and students&#x2019; skills in these topics.</p>
</sec>
<sec>
<title>Objective</title>
<p>This study aims to shed further light on the role that teachers&#x2019; and students&#x2019; programming motivation plays in CT.</p>
</sec>
<sec>
<title>Methods</title>
<p>The topic is approached from the viewpoint of the self-determination theory, which can help to understand teachers&#x2019; instruction and students&#x2019; learning. Our sample consisted of Finnish Grade 8 teachers (<italic>N</italic> = 1,853) and students (<italic>N</italic> = 2,546) who participated in the International Computer and Information Literacy Study (ICILS) in 2018. Focusing on teachers&#x2019; CT instruction emphasis, students&#x2019; CT test scores, and the Intrinsic Motivation Inventory, we investigate (1) distributions of teachers&#x2019; and students&#x2019; responses to intrinsic and extrinsic programming motivation questions, (2) associations between teachers&#x2019; and students&#x2019; programming motivation and their background factors, and (3) associations between programming motivation and teachers&#x2019; CT instruction emphasis and students&#x2019; CT test scores. The data was analyzed by examining descriptive statistics, computing mean differences and correlation coefficients and by performing (multiple) linear regression models.</p>
</sec>
<sec>
<title>Results</title>
<p>The results showed that teachers had high extrinsic programming motivation, but the extent of their intrinsic programming motivation varied widely based on their prior programming teaching experience, subject taught, and gender. Students, in turn, reported both high intrinsic and extrinsic motivation toward programming, but boys were generally more motivated for programming than girls. High programming motivation was moderately related to teachers&#x2019; higher CT instruction emphasis and students&#x2019; higher CT test scores.</p>
</sec>
<sec>
<title>Conclusion</title>
<p>The findings give a strong incentive to pay attention to increasing especially girls&#x2019; programming motivation and providing teachers with positive CT experiences relevant to their subject and with a particular objective to increase intrinsic motivation especially among teachers who lack prior programming teaching experience and interest in the topic.</p>
</sec>
</abstract>
<kwd-group>
<kwd>computational thinking</kwd>
<kwd>programming</kwd>
<kwd>intrinsic motivation</kwd>
<kwd>extrinsic motivation</kwd>
<kwd>teachers</kwd>
<kwd>students</kwd>
<kwd>basic education</kwd>
<kwd>ICILS</kwd>
</kwd-group>
<counts>
<fig-count count="1"/>
<table-count count="9"/>
<equation-count count="0"/>
<ref-count count="72"/>
<page-count count="18"/>
<word-count count="12750"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1" sec-type="intro">
<title>Introduction</title>
<p>Research concerning the teaching and learning of topics revolving around computing education has grown rapidly during recent years at various educational levels (<xref ref-type="bibr" rid="B52">Saqr et al., 2021</xref>). A key term placed at the center of several educational initiatives is <italic>computational thinking</italic> (CT); a competence, which encompasses skills to solve real-world problems with computational tools and methods and which all students are expected to acquire to prepare for subsequent studies and working life in the 21st century (<xref ref-type="bibr" rid="B70">Wing, 2006</xref>, <xref ref-type="bibr" rid="B71">2011</xref>). The concrete activity of computer programming has become the most widely employed practical context to teach and learn CT in schools (<xref ref-type="bibr" rid="B25">Heintz et al., 2016</xref>). Notably, in Finland, CT was introduced centrally to all teachers in basic education by incorporating programming into the national core curriculum in 2014 (see <xref ref-type="bibr" rid="B11">Finnish National Agency of Education, 2016</xref>).</p>
<p>In 2018, a prominent international large-scale assessment of CT called the International Computer and Information Literacy Study (ICILS) was employed to measure Grade 8 students&#x2019; CT skills and to examine home and school environments where their CT learning takes place. The results revealed substantial individual variation in students&#x2019; CT skills, but only small variation between schools (<xref ref-type="bibr" rid="B13">Fraillon et al., 2019a</xref>; <xref ref-type="bibr" rid="B35">Leino et al., 2019</xref>). Students&#x2019; high proficiency in CT was also related to higher home socioeconomic statuses and non-immigrant backgrounds. In turn, teachers across countries and schools varied in the extent to which they emphasized CT in their instruction. In other studies, Finnish teachers with certain profiles (namely, young male teachers) have also been noted to emphasize programming in their teaching more than other teachers (<xref ref-type="bibr" rid="B28">Kaarakainen et al., 2017</xref>). <xref ref-type="bibr" rid="B23">H&#x00E4;m&#x00E4;l&#x00E4;inen et al. (2021)</xref> also found that older teachers tend to feel less prepared to use information and communications technology (ICT) in their teaching despite perceiving it as important, while some teachers seemed to think that ICT-related skills were not relevant to their subject.</p>
<p>The current Finnish basic education core curriculum was implemented gradually as of 2016. In the curriculum, programming is a key content for Grades 7&#x2013;9 in a transversal competence called &#x201C;ICT competence&#x201D; that should penetrate all subjects (<xref ref-type="bibr" rid="B11">Finnish National Agency of Education, 2016</xref>, p. 304). It additionally has more detailed content and learning objective depictions in the subjects of mathematics (pp. 403, 408) and crafts (p. 463). However, the introduction of CT and programming through the curricular reform occurred &#x201C;top-down&#x201D; without being accompanied by centrally organized teacher trainings. Parallelly, teachers in Finland have much autonomy to decide the exact contents of their instruction as far as they do not conflict with the national core curriculum guidelines (<xref ref-type="bibr" rid="B12">Finnish National Agency of Education, 2018</xref>). It is then possible that individual teachers with higher affinity for ICT and programming became more active enactors of CT education. This conjecture can be traced to the theoretical domain of different types of motivation, which have long been recognized as fundamental factors influencing peoples&#x2019; behavior (see e.g., <xref ref-type="bibr" rid="B5">Deci and Ryan, 1985</xref>). In education, high autonomous teaching motivation has been shown to predict teachers&#x2019; more active participation in professional training and more active implementation of instructional innovations. Active participation in training and high quality of instruction, in turn, promotes students&#x2019; learning outcomes (<xref ref-type="bibr" rid="B18">Gorozidis and Papaioannou, 2014</xref>). Although teaching and learning practices in schools can naturally be regulated by such key factors as teacher&#x2019;s expectations and knowledge (<xref ref-type="bibr" rid="B33">Kong et al., 2020</xref>), available resources (<xref ref-type="bibr" rid="B69">Weintrop et al., 2019</xref>), and available time for pedagogical planning (<xref ref-type="bibr" rid="B68">Waite et al., 2020</xref>), Finnish students&#x2019; exposure to CT in basic education may have relied partly on the efforts of teachers who have been motivated for programming. It is possible that such teachers are especially those who teach &#x201C;STEAM&#x201D; (Science, Technology, Engineering, Arts, Mathematics) subjects, which have been traditionally affiliated with CT and programming education (see e.g., <xref ref-type="bibr" rid="B38">M&#x00E4;kitalo et al., 2019</xref>). Relatedly, as <xref ref-type="bibr" rid="B31">Kirschner (2015)</xref> has also pointed out, the targeted use of technology by teachers requires not only devices but also knowledge, skills, and attitude.</p>
<p>In the present study, programming motivation is conceptualized through the self-determination theory (SDT; <xref ref-type="bibr" rid="B5">Deci and Ryan, 1985</xref>; <xref ref-type="bibr" rid="B51">Ryan and Deci, 2017</xref>) where different types of motivation are described in terms of the extent to which they represent autonomous versus controlled regulations. Two forms of programming motivation are investigated: (1) interest/enjoyment, referring to intrinsic motivation, and (2) perceived value/usefulness, which can be understood as so-called identified motivation that is one form of extrinsic motivation (see <xref ref-type="bibr" rid="B51">Ryan and Deci, 2017</xref>). Intrinsically motivated behaviors are autonomous and performing out of pure interest and enjoyment. For instance, students who are intrinsically motivated for programming more likely seek further programming opportunities as they enjoy the activity. Correspondently, students have been previously found to gain a part of their digital skills in their free time (<xref ref-type="bibr" rid="B65">Vainikainen et al., 2022</xref>). In turn, regardless of personal interest or passion, extrinsic motivation refers to behaviors that are instrumental for other consequences, such as an external reward, social approval, avoidance of punishment, or the attainment of valued outcome (<xref ref-type="bibr" rid="B50">Ryan and Deci, 2000</xref>, <xref ref-type="bibr" rid="B51">2017</xref>). One form of extrinsic motivation can be seen when a person is experiencing identified motivation as the behavior yields outcomes that are personally valued or important and congruent with one&#x2019;s values and beliefs (<xref ref-type="bibr" rid="B56">Sheldon and Elliot, 1998</xref>; <xref ref-type="bibr" rid="B67">Vasalampi et al., 2012</xref>). In programming, extrinsic motivation can be understood to affiliate more closely with the perceived educational relevance of programming, for instance, next to expectations of future careers (<xref ref-type="bibr" rid="B32">Kong et al., 2018</xref>) or, from the viewpoint of teaching, for enhancing instructional methods or students&#x2019; skills instrumentally (<xref ref-type="bibr" rid="B72">Yukselturk and Altiok, 2017</xref>). It is important to note, though, that programming motivation may be shaped by understanding gained from actual prior programming experience (see e.g., <xref ref-type="bibr" rid="B9">Erol and Kurt, 2017</xref>) or more strongly by mere preconceptions if no clear understanding of what the activity entails has developed due to lack of prior experience (<xref ref-type="bibr" rid="B39">Mannila et al., 2020</xref>).</p>
<p>Although there are several studies about, for instance, teachers&#x2019; and students&#x2019; programming &#x201C;attitudes,&#x201D; &#x201C;beliefs,&#x201D; and &#x201C;opinions,&#x201D; which may include connections to the theoretical constructs in motivation, only few studies have investigated teachers&#x2019; and students&#x2019; programming motivation explicitly let alone considered the potential role of prior programming teaching/learning experience in it. Therefore, according to our knowledge, only little is known about the extents of teachers&#x2019; and students&#x2019; intrinsic and extrinsic programming motivation and related antecedents. Prior research is also lacking regarding associations between programming motivation and teachers&#x2019; CT instruction emphasis and students&#x2019; CT proficiency. Altogether, especially prior programming experience likely plays a key role in programming motivation. Shedding further light on these issues is important to better understand the role of motivation in educational practice and how it could be better taken into consideration in teacher training and pedagogical planning in the future. Therefore, in this study, nationally comprehensive data collected in Finland for ICILS 2018 concerning Grade 8 teachers&#x2019; and students&#x2019; programming motivation is utilized to answer the following research questions (RQs):</p>
<p>1. How do teachers&#x2019; and students&#x2019; responses to intrinsic and extrinsic programming teaching/learning motivation questions distribute</p>
<list list-type="simple">
<list-item><label>1.1</label><p>For teachers?</p></list-item>
<list-item><label>1.2</label><p>For students?</p></list-item>
</list>
<p>2. When considering teachers&#x2019; prior experience in teaching programming</p>
<list list-type="simple">
<list-item><label>2.1</label><p>How do teachers&#x2019; intrinsic and extrinsic programming motivation differ?</p></list-item>
<list-item><label>2.2</label><p>To what extent does intrinsic and extrinsic programming motivation relate to subject taught, gender, and age?</p></list-item>
<list-item><label>2.3</label><p>To what extent does intrinsic and extrinsic programming motivation relate to teachers&#x2019; CT instruction emphasis?</p></list-item>
</list>
<p>3. When considering students&#x2019; prior experience in learning programming</p>
<list list-type="simple">
<list-item><label>3.1</label><p>How do students&#x2019; intrinsic and extrinsic programming motivation differ?</p></list-item>
<list-item><label>3.2</label><p>To what extent does intrinsic and extrinsic programming motivation relate to students&#x2019; gender and home socioeconomic background?</p></list-item>
<list-item><label>3.3</label><p>To what extent does intrinsic and extrinsic programming motivation relate to students&#x2019; CT test scores?</p></list-item>
</list>
</sec>
<sec id="S2">
<title>Conceptual background and related work</title>
<sec id="S2.SS1">
<title>Computational thinking and programming</title>
<p>Jeannette <xref ref-type="bibr" rid="B70">Wing (2006</xref>, <xref ref-type="bibr" rid="B71">2011)</xref> opened the field of CT by inaugurating the term on a conceptual level and defining it as the &#x201C;thought processes involved in formulating problems and their solutions so that the solutions are represented in a form that can effectively be carried out by an information-processing agent.&#x201D; Since then, there have been multiple efforts attempting to encapsulate the theoretical and operational underpinnings of the ill-established term. Currently, CT is widely understood as a competence that builds on the disciplinary notions in computing and the power of modern digital computer devices while solving problems in the real world (<xref ref-type="bibr" rid="B7">Denning and Tedre, 2019</xref>). Although such conceptual ideas have been recently framed specifically in CT, they have been taught, learned, and studied in schools and in the field of computing education for decades (see e.g., <xref ref-type="bibr" rid="B45">Pea et al., 1987</xref>) and, in a broader sense, long before modern digital devices had been invented (<xref ref-type="bibr" rid="B63">Tedre and Denning, 2016</xref>).</p>
<p>In the light of this framing for CT, there have been various scholarly efforts shaping the core CT skills and areas of knowledge that teachers should teach and students should learn in basic education today. Recent studies have begun distinguishing a &#x201C;multiliteracy&#x201D; dimension in CT by expanding it with sociocultural approach (<xref ref-type="bibr" rid="B29">Kafai et al., 2019</xref>; <xref ref-type="bibr" rid="B42">Mertala, 2021</xref>) and encompassing such pedagogical notions as relating to designing with technology on a personal level and critically reflecting the societal impact of contemporary computational technologies (<xref ref-type="bibr" rid="B26">H&#x00F8;holt et al., 2021</xref>). Despite this nascent but educationally meaningful viewpoint, the &#x201C;problem-solving&#x201D; dimension in CT has been generally more prevalent, portraying how CT can provide skills to understand and solve concrete real-life problems with computational methods. This dimension has been characterized with such core concepts and practices as abstraction, decomposition, algorithms, evaluation, and generalization that students are expected to learn (<xref ref-type="bibr" rid="B2">Barr and Stephenson, 2011</xref>; <xref ref-type="bibr" rid="B19">Grover and Pea, 2013</xref>; <xref ref-type="bibr" rid="B57">Shute et al., 2017</xref>). Establishing on this dimension, the theoretical definition of CT in ICILS 2018 (<xref ref-type="bibr" rid="B14">Fraillon et al., 2019b</xref>, pp. 27&#x2013;28) involves two &#x201C;strands,&#x201D; that is, conceptual categories framing its core skills and knowledge, and five more specific &#x201C;aspects,&#x201D; that is, content categories for the two strands (see <xref ref-type="fig" rid="F1">Figure 1</xref>).</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>The CT framework in ICILS 2018 (see <xref ref-type="bibr" rid="B14">Fraillon et al., 2019b</xref>, pp. 27&#x2013;28).</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="feduc-07-948783-g001.tif"/>
</fig>
<p>The core conceptual and practical principles of CT are generally introduced to students through computer programming in teaching and learning practice in basic education (<xref ref-type="bibr" rid="B19">Grover and Pea, 2013</xref>). Nonetheless, CT and programming are not synonyms: programming is a concrete hands-on activity that can foster the more generic CT skills that go beyond mere programming knowledge and transfer across computational problem-solving domains (e.g., tools used to design computational solutions) (<xref ref-type="bibr" rid="B61">Tang et al., 2020</xref>). Cognitive underpinnings involved with CT are thus relevant beyond mere programming contexts (<xref ref-type="bibr" rid="B70">Wing, 2006</xref>) and have been portrayed in the context of various school subjects as well (see e.g., <xref ref-type="bibr" rid="B54">Settle and Perkovi&#x0107;, 2010</xref>; <xref ref-type="bibr" rid="B43">Moreno-Le&#x00F3;n et al., 2017</xref>).</p>
<p>Educational programming tasks and activities for CT typically involve a real-world computational problem that students need to understand and analyze and subsequently solve or meet by designing a computational solution, such as an algorithm implemented with computer code. Although a CT methodology focused on data-driven machine learning is currently rising (see e.g., <xref ref-type="bibr" rid="B66">Vartiainen et al., 2020</xref>), the solutions&#x2014;and thus views of CT&#x2014;have commonly followed the traditional &#x201C;step-by-step&#x201D; algorithmic computing methodology. Several educational programming environments that build upon this methodology are easy to access and use for both teachers and students: they emphasize learner-centered learning that is expected to capture the interest of students and engage them in learning, which lowers the threshold to include them in teaching and learning activities (<xref ref-type="bibr" rid="B36">Lye and Koh, 2014</xref>). Popular approaches include a variety of block-based programming or &#x201C;coding&#x201D; environments on the web, such as Scratch, purchasable programming tools and kits, such as Lego robotics and Micro:bits, and text-based programming languages, such as Python and JavaScript (<xref ref-type="bibr" rid="B16">Garneli et al., 2015</xref>). The manifold programming environments, tools, and languages are used in more drill-like exercises, such as those presented in (<xref ref-type="bibr" rid="B34">Lambi&#x0107; et al., 2021</xref>), and more learner-centered, creative craft-like projects in which students can more broadly apply their creativity and interest areas (<xref ref-type="bibr" rid="B3">Brennan and Resnick, 2012</xref>).</p>
</sec>
<sec id="S2.SS2">
<title>Teachers&#x2019; programming motivation</title>
<p>The scarce prior empirical studies on teachers&#x2019; programming motivation have focused mainly on pre-service teachers and computer science (CS) or information technology (IT) teachers likely because programming and CT are relatively new cross-curricular contents in basic education. As expected, pre-service CS teachers have had moderately positive attitudes toward programming and moderately high self-efficacy in programming, which has also correlated with their achievement in programming-themed training courses (<xref ref-type="bibr" rid="B22">Gurer et al., 2019</xref>). Otherwise, there have been preliminary findings showing that basic education teachers on average consider training programming to be difficult and may lack understanding regarding the purpose of programming education (<xref ref-type="bibr" rid="B24">Hartell et al., 2019</xref>). Concurrently, some teachers have been noted to disapprove programming curricula (<xref ref-type="bibr" rid="B44">M&#x00FC;hling et al., 2010</xref>). Teachers&#x2019; comfort levels to teach programming, create CT teaching materials, and integrate CT in their lessons have also varied widely, suggesting that some teachers may not be well prepared to integrate CT in their teaching (<xref ref-type="bibr" rid="B17">Garvin et al., 2019</xref>).</p>
<p>Several studies have investigated teachers&#x2019; motivation-related aspects in specific educational programming contexts. Notably, gaining hands-on experience of programming has been shown to increase positive attitudes and negate initial gender differences in attitudes between pre-service IT teachers (<xref ref-type="bibr" rid="B9">Erol and Kurt, 2017</xref>). Gaining programming experience has also improved pre-service teachers&#x2019; attitudes toward programming and utilizing ICT generally in teaching (<xref ref-type="bibr" rid="B10">Fesakis and Serafeim, 2009</xref>). Similarly, in <xref ref-type="bibr" rid="B72">Yukselturk and Altiok&#x2019;s (2017)</xref> study, pre-service teachers&#x2019; enjoyment of programming (an aspect of intrinsic programming motivation) and self-efficacy increased whereas their fear of programming decreased after attending a Scratch programming course. However, their attitudes toward the value and importance of learning programming (an aspect of extrinsic programming motivation) did not increase. <xref ref-type="bibr" rid="B4">Choi&#x2019;s (2013)</xref> study demonstrated a similar change: pre-service teachers&#x2019; initial thoughts on programming being, for instance, difficult, scary, and perplexing changed to a level of enjoyment, accomplishment, and confidence after gaining programming experience. However, teachers have been shown to have positive attitudes especially toward specific pedagogical solutions (e.g., lesson structure plans) in programming education (<xref ref-type="bibr" rid="B53">Sentance et al., 2019</xref>), suggesting that the nature of the manifold CT contents being adopted by teachers are important to consider. Similarly, CT has been shown to include specific substances that can be stronger causes of uncertainty for teachers (<xref ref-type="bibr" rid="B46">Rich et al., 2021</xref>).</p>
</sec>
<sec id="S2.SS3">
<title>Students&#x2019; programming motivation</title>
<p>Compared to scarce previous research on teachers&#x2019; programming motivation, several previous studies have examined motivation and attitudes toward programming-related topics among students of different ages and with different backgrounds. Notably, <xref ref-type="bibr" rid="B60">Sun et al. (2022)</xref> recently found that Chinese Grade 7 students&#x2019; high programming interest (an aspect of intrinsic motivation) was related to better CT learning outcomes. The study also found that girls had on average higher CT proficiency than boys but more negative programming attitudes, including interest. Other studies have also provided evidence that boys have more positive attitudes toward programming-related topics than girls (<xref ref-type="bibr" rid="B37">Mahoney, 2010</xref>; <xref ref-type="bibr" rid="B30">Kier et al., 2014</xref>; <xref ref-type="bibr" rid="B21">Gunbatar and Karalar, 2018</xref>; <xref ref-type="bibr" rid="B32">Kong et al., 2018</xref>), corresponding with the common view of computing-related studies and work fields being male-dominant. However, other studies (<xref ref-type="bibr" rid="B40">Mason and Rich, 2020</xref>; <xref ref-type="bibr" rid="B20">Gul et al., 2021</xref>) have not found gender differences in students&#x2019; programming attitudes, and gender differences have also been shown to disappear in some studies after gaining programming experiences (<xref ref-type="bibr" rid="B21">Gunbatar and Karalar, 2018</xref>). On another note, results regarding the role of gender in the level of students&#x2019; CT proficiency have also varied: in ICILS 2018 (<xref ref-type="bibr" rid="B13">Fraillon et al., 2019a</xref>), the average CT proficiency in all participating countries was in favor of boys. However, statistically significant differences were found only in two countries: in favor of boys in Portugal and of girls in Finland. Then again, another Finnish study (<xref ref-type="bibr" rid="B65">Vainikainen et al., 2022</xref>) found that boys had higher programming proficiency than girls.</p>
<p>Previous studies have discovered that students&#x2019; programming motivation associates with such factors as ethnicity, grade level, coding frequency, and math interest (<xref ref-type="bibr" rid="B40">Mason and Rich, 2020</xref>; <xref ref-type="bibr" rid="B20">Gul et al., 2021</xref>). Although social factors, such as home socioeconomic background, have been positively related to students&#x2019; better performance in CT tasks (<xref ref-type="bibr" rid="B13">Fraillon et al., 2019a</xref>), their role in programming attitudes has been so far inconclusive (see <xref ref-type="bibr" rid="B39">Mannila et al., 2020</xref>; <xref ref-type="bibr" rid="B40">Mason and Rich, 2020</xref>). However, as with teachers, gaining actual programming experiences has been shown to promote students&#x2019; positive programming attitudes, including their interest (<xref ref-type="bibr" rid="B60">Sun et al., 2022</xref>). The main reason is likely that programming with contemporary tools is generally designed to be motivating for students in different educational levels and in different contexts (<xref ref-type="bibr" rid="B16">Garneli et al., 2015</xref>). Several context-specific studies (e.g., <xref ref-type="bibr" rid="B48">Ruf et al., 2014</xref>; <xref ref-type="bibr" rid="B1">Asad et al., 2016</xref>; <xref ref-type="bibr" rid="B27">Jiang and Wong, 2017</xref>; <xref ref-type="bibr" rid="B34">Lambi&#x0107; et al., 2021</xref>; <xref ref-type="bibr" rid="B64">Tisza and Markopoulos, 2021</xref>) have illustrated in practice how students&#x2019; attitudes toward programming can increase after programming with a variety of tools and while participating in collaborative, engaging, and appropriately challenging and interesting coding tasks (see <xref ref-type="bibr" rid="B36">Lye and Koh, 2014</xref>; <xref ref-type="bibr" rid="B8">Dohn, 2019</xref>; <xref ref-type="bibr" rid="B55">Sharma et al., 2019</xref>). Connectedly, the number of years of programming learning has been shown to positively relate to students&#x2019; programming attitudes (<xref ref-type="bibr" rid="B60">Sun et al., 2022</xref>), demonstrating the importance of sustained exposure to programming rather than gaining singular introductions to only specific ways of programming, such as the popular &#x201C;Hour of Code&#x201D; (see also <xref ref-type="bibr" rid="B40">Mason and Rich, 2020</xref>).</p>
</sec>
</sec>
<sec id="S3" sec-type="materials|methods">
<title>Materials and methods</title>
<sec id="S3.SS1">
<title>Participants and data collection</title>
<p>International Computer and Information Literacy Study is an international study organized by International Association for the Evaluation of Educational Achievement (IEA) in partnership with Australian Council for Educational Research and national research centers of participating countries in 2013 and 2018. ICILS 2018 (<xref ref-type="bibr" rid="B13">Fraillon et al., 2019a</xref>, pp. 9&#x2013;10) gathered data of Grade 8 students&#x2019; computer and information literacy (CIL) proficiency from 12 countries and two benchmarking areas as well as their CT proficiency as an optional assessment from eight countries and one benchmarking area. In addition to assessing students&#x2019; skills and knowledge, contextual questionnaires were presented for students, teachers, school ICT coordinators, principals, and national research centers. The tests and surveys were conducted on computers.</p>
<p>In the present study, we utilize student and teacher data collected in ICILS 2018 in Finland. The sampling design (see <xref ref-type="bibr" rid="B15">Fraillon et al., 2020</xref>) involved multi-stage sampling, stratification, and cluster sampling. The sampling of students and teachers specifically was a two-stage cluster sampling (see also <xref ref-type="bibr" rid="B13">Fraillon et al., 2019a</xref>, p. 11). In Finland, first, 150 schools with the target grade students were randomly selected with a probability proportional to size and utilizing the NUTS classification (see <xref ref-type="bibr" rid="B58">Statistics Finland, 2022</xref>) for regions. Second, 20 Grade 8 students (or all students if less than 25 students were enrolled in the grade) were randomly sampled in each sampled school. Additionally, 15 teachers that taught Grade 8 students at the time of testing (or all teachers if less than 20 Grade 8 teachers worked in the school) were randomly sampled in each sampled school. The sampled teachers taught different subjects, and the sampling did not consider if a teacher had taught any of the sampled students or not. The final national data in Finland concluded 2,546 students and 1,853 teachers from 145 schools.</p>
</sec>
<sec id="S3.SS2">
<title>Teacher measures</title>
<p>Teachers in ICILS 2018 responded to a questionnaire enquiring about their perceptions and use of ICT and various background variables. In the present study, the examined background variables were gender (binary), age, subjects taught, and previous programming teaching experience (yes/no). Teachers&#x2019; CT instruction emphasis was assessed in the questionnaire with a question enquiring how much in their teaching of the reference class<sup><xref ref-type="fn" rid="footnote1">1</xref></sup> during the current school year they emphasized the given CT skills (see items in <xref ref-type="table" rid="T1">Table 1</xref>). The response options were presented on a 4-point Likert scale (1 = strong emphasis, 2 = some emphasis, 3 = little emphasis, 4 = no emphasis). Items A to I were international items and items J to M nationally added items that were more contextualized to programming.</p>
<table-wrap position="float" id="T1">
<label>TABLE 1</label>
<caption><p>Question items for teachers&#x2019; CT instruction emphasis in ICILS 2018 in Finland.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Item</td>
<td valign="top" align="left"></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>International items</bold></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">A.</td>
<td valign="top" align="left">To display information in different ways</td>
</tr>
<tr>
<td valign="top" align="left">B.</td>
<td valign="top" align="left">To break a complex process into smaller parts</td>
</tr>
<tr>
<td valign="top" align="left">C.</td>
<td valign="top" align="left">To understand diagrams that describe or show real-world problems</td>
</tr>
<tr>
<td valign="top" align="left">D.</td>
<td valign="top" align="left">To plan tasks by setting out the steps needed to complete them</td>
</tr>
<tr>
<td valign="top" align="left">E.</td>
<td valign="top" align="left">To use tools making diagrams that help solve problems</td>
</tr>
<tr>
<td valign="top" align="left">F.</td>
<td valign="top" align="left">To use simulations to help understand or solve real-world problems</td>
</tr>
<tr>
<td valign="top" align="left">G.</td>
<td valign="top" align="left">To make flow diagrams to show the different parts of a process</td>
</tr>
<tr>
<td valign="top" align="left">H.</td>
<td valign="top" align="left">To record and evaluate data to understand and solve a problem</td>
</tr>
<tr>
<td valign="top" align="left">I.</td>
<td valign="top" align="left">To use real-world data to review and revise solutions to problems</td>
</tr>
<tr>
<td valign="top" align="left"><bold>National items</bold></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">J.</td>
<td valign="top" align="left">To interpret and create algorithms, that is, detailed instructions</td>
</tr>
<tr>
<td valign="top" align="left">K.</td>
<td valign="top" align="left">To program computer programs</td>
</tr>
<tr>
<td valign="top" align="left">L.</td>
<td valign="top" align="left">To understand and apply programming language constructs (e.g., loop, conditional structure, and variable)</td>
</tr>
<tr>
<td valign="top" align="left">M.</td>
<td valign="top" align="left">To understand and apply good programming practices (e.g., planning, debugging, and evaluation)</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Teachers&#x2019; programming motivation was assessed in a separate question using two subscales utilized from the Intrinsic Motivation Inventory (IMI<sup><xref ref-type="fn" rid="footnote2">2</xref></sup>; for validity, see <xref ref-type="bibr" rid="B41">McAuley et al., 1987</xref>): (1) interest/enjoyment (items A to C in <xref ref-type="table" rid="T2">Table 2</xref>, Cronbach&#x2019;s &#x03B1; = 0.81) and (2) value/usefulness (items D to F, Cronbach&#x2019;s &#x03B1; = 0.82). The interest/enjoyment subscale measures teachers&#x2019; intrinsic motivation, whereas the value/usefulness subscale measures teachers&#x2019; identified motivation (see also <xref ref-type="bibr" rid="B41">McAuley et al., 1987</xref>; <xref ref-type="bibr" rid="B6">Deci et al., 1994</xref>), that is, one form of extrinsic motivation. Teachers were asked, &#x201C;When thinking about your relationship toward programming and [teaching/considering teaching] it, to what extent do you agree or disagree with the following statements?&#x201D; As demonstrated with the square brackets, the subscales had two slightly different but construct-wise not dissimilar formats for teachers who responded &#x201C;yes&#x201D; or &#x201C;no&#x201D; to a previous question regarding whether they had prior experience in teaching programming. The response options were presented on a 4-point Likert scale (1 = completely disagree, 2 = disagree, 3 = agree, 4 = completely agree). The two subscales correlated moderately positively both for teachers with prior experience in teaching programming (<italic>r</italic> = 0.37, SE 0.07) and those without it (<italic>r</italic> = 0.44, SE 0.02). Teachers who answered the questionnaire also selected different subjects (one or more) that they taught for at least four lessons each week in the school in the school year (see <xref ref-type="table" rid="T3">Table 3</xref>).</p>
<table-wrap position="float" id="T2">
<label>TABLE 2</label>
<caption><p>Items for the question concerning teachers&#x2019; programming motivation in ICILS 2018 in Finland.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Subscale</td>
<td valign="top" align="center" colspan="2">Item</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Intrinsic motivation</td>
<td valign="top" align="center">A.</td>
<td valign="top" align="left">Programming [is/seems] very interesting.</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">B.</td>
<td valign="top" align="left">[I teach/If given an opportunity, I would teach] programming gladly.</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">C.</td>
<td valign="top" align="left">[I do/I could imagine myself doing] computer programming in my leisure time.</td>
</tr>
<tr>
<td valign="top" align="left">Extrinsic motivation</td>
<td valign="top" align="center">D.</td>
<td valign="top" align="left">It is important to learn to understand the principles of programming in today&#x2019;s society.</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">E.</td>
<td valign="top" align="left">It is important to learn how to program computer programs in today&#x2019;s society.</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">F.</td>
<td valign="top" align="left">Studying programming benefits the students in their other studies and in working life.</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap position="float" id="T3">
<label>TABLE 3</label>
<caption><p>Subjects taught by the respondent teachers with and without prior experience in teaching programming.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Subject</td>
<td valign="top" align="center" colspan="2">Teachers with prior experience in teaching programming<hr/></td>
<td valign="top" align="center" colspan="2">Teachers without prior experience in teaching programming<hr/></td>
<td valign="top" align="center">Total</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center"><italic>N</italic></td>
<td valign="top" align="center">% of total</td>
<td valign="top" align="center"><italic>N</italic></td>
<td valign="top" align="center">% of total</td>
<td valign="top" align="center"></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Mother tongue</bold><break/>I.e., Finnish/Swedish and literature or Finnish/Swedish as second language for other language groups</td>
<td valign="top" align="center">44</td>
<td valign="top" align="center">13.3</td>
<td valign="top" align="center">286</td>
<td valign="top" align="center">86.7</td>
<td valign="top" align="center">330</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Foreign languages</bold><break/>I.e., second national language, English, and other languages</td>
<td valign="top" align="center">26</td>
<td valign="top" align="center">6.1</td>
<td valign="top" align="center">400</td>
<td valign="top" align="center">93.9</td>
<td valign="top" align="center">426</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Mathematics</bold></td>
<td valign="top" align="center">290</td>
<td valign="top" align="center">63.7</td>
<td valign="top" align="center">165</td>
<td valign="top" align="center">36.3</td>
<td valign="top" align="center">455</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Sciences</bold><break/>I.e., physics, chemistry, biology, and geology/geography</td>
<td valign="top" align="center">220</td>
<td valign="top" align="center">49.2</td>
<td valign="top" align="center">227</td>
<td valign="top" align="center">50.8</td>
<td valign="top" align="center">447</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Human sciences or social studies</bold><break/>History, social studies, law, economics, etc.</td>
<td valign="top" align="center">19</td>
<td valign="top" align="center">8.9</td>
<td valign="top" align="center">195</td>
<td valign="top" align="center">91.1</td>
<td valign="top" align="center">214</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Creative arts</bold><break/>Visual arts, music, dance, drama, etc.</td>
<td valign="top" align="center">36</td>
<td valign="top" align="center">19.9</td>
<td valign="top" align="center">145</td>
<td valign="top" align="center">80.1</td>
<td valign="top" align="center">181</td>
</tr>
<tr>
<td valign="top" align="left"><bold>IT, programming, or similar</bold></td>
<td valign="top" align="center">77</td>
<td valign="top" align="center">91.7</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">8.3</td>
<td valign="top" align="center">84</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Practical and vocational subjects</bold><break/>E.g., crafts</td>
<td valign="top" align="center">71</td>
<td valign="top" align="center">37.8</td>
<td valign="top" align="center">117</td>
<td valign="top" align="center">62.2</td>
<td valign="top" align="center">188</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Other</bold><break/>E.g., life philosophy, physical education, home economics, health education, and student counseling</td>
<td valign="top" align="center">49</td>
<td valign="top" align="center">10.6</td>
<td valign="top" align="center">415</td>
<td valign="top" align="center">89.4</td>
<td valign="top" align="center">464</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>A teacher can have chosen several subjects, and therefore the number of teachers does not correspond to the number of respondents.</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="S3.SS3">
<title>Student measures</title>
<p>In Finland, each sampled student in ICILS 2018 completed two of a total of five randomly selected 30-min CIL modules and two 25-min CT modules that were the same for all students (<xref ref-type="bibr" rid="B13">Fraillon et al., 2019a</xref>, pp. 8&#x2013;9). Both CT modules had several problem-solving tasks with a unifying theme, and they were designed to measure the aspects presented in <xref ref-type="fig" rid="F1">Figure 1</xref>. We used students&#x2019; CT task scores, which are based on five different plausible values. The analyses are performed for the each plausible value separately after which their average is used (see <xref ref-type="bibr" rid="B15">Fraillon et al., 2020</xref>, pp. 152&#x2013;153, 224). The task scores from all the CT tasks were aggregated to establish a total CT test score with a standardized international mean score of 500 and a standard deviation of 100 (<xref ref-type="bibr" rid="B13">Fraillon et al., 2019a</xref>, p. 92).</p>
<p>Between the CIL and CT modules, the students completed a questionnaire enquiring their learning about ICT, CIL, and CT and various background variables. In the present study, the examined background variables were gender (binary), prior programming experience (yes/no), and home socioeconomic background, which was combined from the parents&#x2019; highest level of education, parents&#x2019; highest occupation based on the International Standard Classification of Occupations, and the amount of books at home (see <xref ref-type="bibr" rid="B14">Fraillon et al., 2019b</xref>, p. 40).</p>
<p>Students&#x2019; programming motivation was assessed in the questionnaire using the same two subscales utilized from the IMI as with the teachers. The students were asked, &#x201C;When thinking about your relationship toward programming and [studying/considering studying] it, to what extent do you agree or disagree with the following statements?&#x201D; The subscales were similarly those of (1) interest/enjoyment (items A to C in <xref ref-type="table" rid="T4">Table 4</xref>, Cronbach&#x2019;s &#x03B1; = 0.88) and (2) value/usefulness (items D and E, Cronbach&#x2019;s &#x03B1; = 0.76). The interest/enjoyment subscale measured students&#x2019; intrinsic motivation, whereas the value/usefulness subscale measured their identified motivation (see also <xref ref-type="bibr" rid="B41">McAuley et al., 1987</xref>; <xref ref-type="bibr" rid="B6">Deci et al., 1994</xref>), that is, one form of extrinsic motivation. Both aspects of programming motivation were measured using a 4-point Likert scale (1 = completely disagree, 2 = disagree, 3 = agree, 4 = completely agree), and, as demonstrated by the square brackets, the questions had two slightly different but construct-wise not dissimilar formats for students with and without prior experience in programming. The two examined types of motivations correlated moderately positively both for students with prior experience in programming (<italic>r</italic> = 0.53, SE 0.03) and those without it (<italic>r</italic> = 0.58, SE 0.02).</p>
<table-wrap position="float" id="T4">
<label>TABLE 4</label>
<caption><p>Items for the question concerning students&#x2019; programming motivation in ICILS 2018 in Finland.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Subscale</td>
<td valign="top" align="left" colspan="2">Item</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Intrinsic motivation</td>
<td valign="top" align="center">A.</td>
<td valign="top" align="left">Programming [is/seems] very interesting.</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">B.</td>
<td valign="top" align="left">[I study/If given an opportunity, I would study] programming gladly.</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">C.</td>
<td valign="top" align="left">[I do/I could imagine myself doing] computer programming in my leisure time.</td>
</tr>
<tr>
<td valign="top" align="left">Extrinsic motivation</td>
<td valign="top" align="center">D.</td>
<td valign="top" align="left">It is important to learn to understand the principles of programming in today&#x2019;s society.</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">E.</td>
<td valign="top" align="left">Studying programming [benefits/would benefit] my learning in other studies or my working life.</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="S3.SS4">
<title>Data analysis</title>
<p>As the ICILS 2018 sample is not based on simple random sampling, the generalization of the results to the target population is not straightforward. The complex sampling design and the non-participation of schools, students, or teachers could lead to biased results if the data was treated as if it was drawn from a simple random sample. To achieve unbiased estimates of the corresponding population, sampling weights and non-response adjustments for each school were used when analyzing the data (<xref ref-type="bibr" rid="B15">Fraillon et al., 2020</xref>, p. 79). When estimating the variances and standard errors for the population statistics, jackknife repeated replication technique was used (see also <xref ref-type="bibr" rid="B15">Fraillon et al., 2020</xref>, p. 221).</p>
<p>For RQ1, descriptive statistics of the students&#x2019; and teachers&#x2019; responses to the programming motivation questions were explored. For RQs 2.1 and 2.2, teachers&#x2019; gender age, and subjects taught were set as explanatory variables, and the effect of those variables on the subscales of intrinsic and extrinsic motivation were analyzed by examining (weighted) mean differences and by linear regression. Similar analyses to explore the effects on the two motivation subscales were performed for students (RQs 3.1 and 3.2) using gender and home socioeconomic background as explanatory variables. The analyses for gender, age, and home socioeconomic background were performed separately for teachers and students with and without prior programming teaching/learning experience to examine differences between these two experience groups. This approach was chosen instead on just one regression analysis in which some connections were not visible and also because the motivation questions for the two experience groups were slightly different (see <xref ref-type="table" rid="T2">Tables 2</xref>, <xref ref-type="table" rid="T4">4</xref>). Correlation coefficients between the subscales were examined using Pearson correlation coefficient. For RQs 2.3 and 3.3, regression analyses were performed for the scales of interest, that is, CT instruction emphasis for teachers (see also <xref ref-type="bibr" rid="B15">Fraillon et al., 2020</xref>, p. 191) and CT test scores for students separately for teachers and students with and without prior programming teaching/learning experience.</p>
<p>Statistical significances of the mean differences and regression coefficients were also obtained. The significances are based on observed <italic>t</italic>-values, which were compared to the critical values of the standard normal distribution. This is a standard procedure in large scale assessments and is based on large sample size and the asymptotic normality of estimators. In the regression analyses, no multicollinearity issues were observed. All analyses were performed with the IEA IDB Analyzer data analysis software.</p>
</sec>
</sec>
<sec id="S4" sec-type="results">
<title>Results</title>
<sec id="S4.SS1">
<title>Teachers&#x2019; programming motivation</title>
<sec id="S4.SS1.SSS1">
<title>Teachers&#x2019; responses to programming motivation questions (research question 1.1)</title>
<p>Descriptive statistics of the teachers&#x2019; responses to the programming motivation question items are shown in <xref ref-type="table" rid="T5">Table 5</xref>. On average, teachers agreed with the statements in favor of their extrinsic programming motivation and especially about the importance of learning to understand the principles of programming in today&#x2019;s society and its benefits for the students&#x2019; other studies and working life. However, they disagreed more with the intrinsic motivation statements. For example, most of the teachers did not or could not imagine themselves doing programming in their leisure time, although more than half of the teachers considered programming interesting, and nearly half of the teachers taught or would have liked to have taught programming gladly.</p>
<table-wrap position="float" id="T5">
<label>TABLE 5</label>
<caption><p>Descriptive statistics of teachers&#x2019; programming motivation.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Subscale</td>
<td valign="top" align="center" colspan="2">Item</td>
<td valign="top" align="center" colspan="4">Percentage distributions of responses<hr/></td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="2"></td>
<td valign="top" align="center">1 &#x2013; completely disagree (%)</td>
<td valign="top" align="center">2 &#x2013; disagree (%)</td>
<td valign="top" align="center">3 &#x2013; agree (%)</td>
<td valign="top" align="center">4 &#x2013; completely agree (%)</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Intrinsic motivation</td>
<td valign="top" align="center">A.</td>
<td valign="top" align="left">Programming [is/seems] very interesting.</td>
<td valign="top" align="center">13.3</td>
<td valign="top" align="center">28.2</td>
<td valign="top" align="center">43.1</td>
<td valign="top" align="center">15.5</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">B.</td>
<td valign="top" align="left">[I teach/If given an opportunity, I would teach] programming gladly.</td>
<td valign="top" align="center">20.9</td>
<td valign="top" align="center">33.1</td>
<td valign="top" align="center">35.8</td>
<td valign="top" align="center">10.3</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">C.</td>
<td valign="top" align="left">[I do/I could imagine myself doing] computer programming in my leisure time.</td>
<td valign="top" align="center">50.2</td>
<td valign="top" align="center">36.6</td>
<td valign="top" align="center">10.3</td>
<td valign="top" align="center">3.0</td>
</tr>
<tr>
<td valign="top" align="left">Extrinsic motivation</td>
<td valign="top" align="center">D.</td>
<td valign="top" align="left">It is important to learn to understand the principles of programming in today&#x2019;s society.</td>
<td valign="top" align="center">4.5</td>
<td valign="top" align="center">17.8</td>
<td valign="top" align="center">63.8</td>
<td valign="top" align="center">14.1</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">E.</td>
<td valign="top" align="left">It is important to learn how to program computer programs in today&#x2019;s society.</td>
<td valign="top" align="center">8.0</td>
<td valign="top" align="center">43.9</td>
<td valign="top" align="center">42.5</td>
<td valign="top" align="center">5.7</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">F.</td>
<td valign="top" align="left">Studying programming benefits the students in their other studies and in working life.</td>
<td valign="top" align="center">3.0</td>
<td valign="top" align="center">13.5</td>
<td valign="top" align="center">71.3</td>
<td valign="top" align="center">12.3</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</sec>
<sec id="S4.SS2">
<title>Teachers&#x2019; background and programming motivation (research questions 2.1 and 2.2)</title>
<p>Our next RQs concerned how teachers&#x2019; prior programming teaching experience, gender, subject taught, and age are related to their programming motivation. These RQs were examined by exploring (weighted) mean differences and linear regression analysis.</p>
<p>Teachers with prior experience in teaching programming had substantially higher intrinsic motivation than teachers without said experience (Mean = 2.63 cf. 1.79; difference 0.83, SE 0.04, <italic>p</italic> &#x003C; 0.001, Cohen&#x2019;s <italic>d</italic> = 1.34). In turn, extrinsic programming motivation was only slightly higher among teachers with prior experience in teaching programming (Mean = 2.82 cf. 2.68; difference 0.14, SE 0.04, <italic>p</italic> &#x003C; 0.001, Cohen&#x2019;s <italic>d</italic> = 0.24). Statistically significant gender differences did not emerge in teachers&#x2019; extrinsic programming motivation in either experience group, but such differences were found in intrinsic motivation among both groups (see <xref ref-type="table" rid="T6">Table 6</xref>). Male teachers generally reporting a higher level of intrinsic motivation than female teachers. Intrinsic motivation among male teachers with prior programming teaching experience situated on the positive side of the 4-point Likert scale (2.5) whereas among female teachers the average was in the middle (difference &#x2212;0.15, SE 0.06, <italic>p</italic> &#x003C; 0.05, Cohen&#x2019;s <italic>d</italic> = 0.26). Gender differences among teachers without prior programming teaching experience followed a similar pattern (difference &#x2212;0.22, SE 0.04, <italic>p</italic> &#x003C; 0.001, Cohen&#x2019;s <italic>d</italic> = 0.35), but the average values were comparably much lower and on the negative side of the scale. In contrast, both experience groups&#x2019; average extrinsic programming motivation leaned toward the positive side of the scale.</p>
<table-wrap position="float" id="T6">
<label>TABLE 6</label>
<caption><p>Means and standard deviations, mean differences, and effect sizes (Cohen&#x2019;s <italic>d</italic>) of intrinsic and extrinsic motivation among the teacher respondents by gender and separately for teachers with and without programming experience.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="2">Teachers with prior experience in teaching programming<hr/></td>
<td valign="top" align="center" colspan="2">Teachers without prior experience in teaching programming<hr/></td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center"><italic>M</italic></td>
<td valign="top" align="center">SD</td>
<td valign="top" align="center"><italic>M</italic></td>
<td valign="top" align="center">SD</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Intrinsic motivation</bold></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Female</td>
<td valign="top" align="center">2.55</td>
<td valign="top" align="center">0.62</td>
<td valign="top" align="center">1.74</td>
<td valign="top" align="center">0.59</td>
</tr>
<tr>
<td valign="top" align="left">Male</td>
<td valign="top" align="center">2.71</td>
<td valign="top" align="center">0.65</td>
<td valign="top" align="center">1.96</td>
<td valign="top" align="center">0.65</td>
</tr>
<tr>
<td valign="top" align="left">Difference</td>
<td valign="top" align="center">&#x2013;0.15</td>
<td valign="top" align="center"></td>
<td valign="top" align="center">&#x2013;0.22</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Cohen&#x2019;s <italic>d</italic></td>
<td valign="top" align="center">0.26</td>
<td valign="top" align="center"></td>
<td valign="top" align="center">0.35</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left"><bold>Extrinsic motivation</bold></td>
<td valign="top" align="center" colspan="2"></td>
<td valign="top" align="center" colspan="2"></td>
</tr>
<tr>
<td valign="top" align="left">Female</td>
<td valign="top" align="center">2.82</td>
<td valign="top" align="center">0.52</td>
<td valign="top" align="center">2.68</td>
<td valign="top" align="center">0.58</td>
</tr>
<tr>
<td valign="top" align="left">Male</td>
<td valign="top" align="center">2.82</td>
<td valign="top" align="center">0.59</td>
<td valign="top" align="center">2.69</td>
<td valign="top" align="center">0.60</td>
</tr>
<tr>
<td valign="top" align="left">Difference</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center"></td>
<td valign="top" align="center">&#x2013;0.01</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Cohen&#x2019;s <italic>d</italic></td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center"></td>
<td valign="top" align="center">0.02</td>
<td valign="top" align="center"></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>The values are situated on a 4-point Likert scale.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>The subjects that the teachers taught were related to the teachers&#x2019; intrinsic and extrinsic motivation statistically significantly (see <xref ref-type="table" rid="T7">Table 7</xref>). Specifically, teachers&#x2019; intrinsic programming motivation was higher if the teacher taught IT-related subjects, mathematics, practical and vocational subjects, and creative arts. In turn, teachers&#x2019; intrinsic motivation was lower if they taught national or foreign languages, subjects in the aggregated category of &#x201C;other subjects,&#x201D; and human sciences or social studies. Higher extrinsic motivation related only to teaching IT-related subjects, and, for lower extrinsic motivation, teaching foreign languages.</p>
<table-wrap position="float" id="T7">
<label>TABLE 7</label>
<caption><p>Estimates (and standard errors) for regression coefficients in teachers&#x2019; intrinsic and extrinsic motivation by subjects taught, gender, and age.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="2">Intrinsic motivation<hr/></td>
<td valign="top" align="center" colspan="2">Extrinsic motivation<hr/></td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center"><italic>b</italic> (SE)</td>
<td valign="top" align="center">&#x03B2; (SE)</td>
<td valign="top" align="center"><italic>b</italic> (SE)</td>
<td valign="top" align="center">&#x03B2; (SE)</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Subject</bold></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Mother tongue</td>
<td valign="top" align="center">&#x2212;0.14 (0.05)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">&#x2212;0.07 (0.03)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">&#x2212;0.02 (0.05)</td>
<td valign="top" align="center">&#x2212;0.01 (0.03)</td>
</tr>
<tr>
<td valign="top" align="left">Foreign languages</td>
<td valign="top" align="center">&#x2212;0.22 (0.05)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">&#x2212;0.13 (0.03)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">&#x2212;0.15 (0.04)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">&#x2212;0.11 (0.03)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Mathematics</td>
<td valign="top" align="center">0.44 (0.05)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">0.27 (0.03)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">0.06 (0.04)</td>
<td valign="top" align="center">0.05 (0.03)</td>
</tr>
<tr>
<td valign="top" align="left">Sciences</td>
<td valign="top" align="center">0.02 (0.05)</td>
<td valign="top" align="center">0.01 (0.03)</td>
<td valign="top" align="center">&#x2212;0.05 (0.05)</td>
<td valign="top" align="center">&#x2212;0.04 (0.04)</td>
</tr>
<tr>
<td valign="top" align="left">Human sciences or social studies</td>
<td valign="top" align="center">&#x2212;0.12 (0.05)<xref ref-type="table-fn" rid="t7fns1">&#x002A;</xref></td>
<td valign="top" align="center">&#x2212;0.06 (0.02)<xref ref-type="table-fn" rid="t7fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.00 (0.05)</td>
<td valign="top" align="center">0.00 (0.02)</td>
</tr>
<tr>
<td valign="top" align="left">Creative arts</td>
<td valign="top" align="center">0.16 (0.06)<xref ref-type="table-fn" rid="t7fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.07 (0.03)<xref ref-type="table-fn" rid="t7fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.01 (0.06)</td>
<td valign="top" align="center">0.00 (0.03)</td>
</tr>
<tr>
<td valign="top" align="left">IT, programming, or similar</td>
<td valign="top" align="center">0.63 (0.09)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">0.18 (0.02)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">0.27 (0.05)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">0.10 (0.02)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Practical and vocational subjects</td>
<td valign="top" align="center">0.25 (0.06)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">0.10 (0.02)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">0.02 (0.06)</td>
<td valign="top" align="center">0.01 (0.03)</td>
</tr>
<tr>
<td valign="top" align="left">Other</td>
<td valign="top" align="center">&#x2212;0.13 (0.04)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">&#x2212;0.08 (0.03)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">&#x2212;0.01 (0.04)</td>
<td valign="top" align="center">&#x2212;0.01 (0.03)</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Gender(male)</bold></td>
<td valign="top" align="center">0.18 (0.03)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">0.11 (0.02)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">&#x2212;0.02 (0.03)</td>
<td valign="top" align="center">&#x2212;0.01 (0.02)</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Age</bold></td>
<td valign="top" align="center">&#x2212;0.01 (0.00)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">&#x2212;0.09 (0.02)<xref ref-type="table-fn" rid="t7fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">0.00 (0.00)</td>
<td valign="top" align="center">&#x2212;0.01 (0.02)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="t7fns1"><p>&#x002A;<italic>p</italic> &#x003C; 0.05, &#x002A;&#x002A;<italic>p</italic> &#x003C; 0.01, &#x002A;&#x002A;&#x002A;<italic>p</italic> &#x003C; 0.001. <italic>b</italic> = unstandardized &#x03B2;; &#x03B2; = standardized &#x03B2;; SE = standard error.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>Teacher&#x2019;s age was weakly but statistically significantly related only to intrinsic motivation (but not extrinsic motivation) at the <italic>p</italic> &#x003C; 0.05 level. Among teachers with prior experience in teaching programming, the regression coefficient was 0.01, denoting that intrinsic motivation was slightly higher among teachers in this experience group that were older than the average age of the respondents. Among teachers without prior experience in teaching programming, the coefficient was &#x2212;0.01, SE = 0.00, &#x03B2; = &#x2212;0.09, SE (&#x03B2;) = 0.03, <italic>p</italic> &#x003C; 0.01, showing an inverted effect.</p>
<sec id="S4.SS2.SSS1">
<title>Teachers&#x2019; computational thinking instruction and programming motivation (research questions 2.3)</title>
<p>Research questions 2.3 concerned associations between teachers&#x2019; intrinsic and extrinsic programming motivation and their CT instruction emphasis. Regression analysis showed that high intrinsic motivation related to higher instruction emphasis in the international CT-focused item scale (items A to I in <xref ref-type="table" rid="T1">Table 1</xref>) among both teachers with prior programming teaching experience [regression coefficient <italic>b</italic> = 0.14, SE (<italic>b</italic>) = 0.04, &#x03B2; = 0.14, SE (&#x03B2;) = 0.04] and those without it [<italic>b</italic> = 0.18, SE (<italic>b</italic>) = 0.03, &#x03B2; = 0.17. SE (&#x03B2;) = 0.03, <italic>p</italic> &#x003C; 0.001]. A similar effect was shown in instruction emphasis in the more programming-specific item scale (J to M), where, next to the CT items, the effect was slightly stronger among teachers with prior programming teaching experience [<italic>b</italic> = 0.30, SE (<italic>b</italic>) = 0.06, &#x03B2; = 0.27, SE (&#x03B2;) = 0.05, <italic>p</italic> &#x003C; 0.001] and approximately the same among teachers without said experience [<italic>b</italic> = 0.13, SE (<italic>b</italic>) = 0.03, &#x03B2; = 0.16, SE (&#x03B2;) = 0.03, <italic>p</italic> &#x003C; 0.001]. Although the coefficients were relatively modest, they revealed that there altogether were general positive trends.</p>
<p>Extrinsic programming motivation had no statistically significant effects on either CT or programming instruction among teachers with prior programming teaching experience. However, a very weak negative effect emerged among programming-wise inexperienced teachers&#x2019; emphasis on the programming-specific items [<italic>b</italic> = &#x2212;0.06, SE (<italic>b</italic>) = 0.02, &#x03B2; = &#x2212;0.07, SE (&#x03B2;) = 0.03, <italic>p</italic> &#x003C; 0.01].</p>
</sec>
</sec>
<sec id="S4.SS3">
<title>Students&#x2019; programming motivation</title>
<sec id="S4.SS3.SSS1">
<title>Students&#x2019; responses to programming motivation questions (research question 1.2)</title>
<p>Descriptive statistics of the students&#x2019; responses to the programming motivation questions are shown in <xref ref-type="table" rid="T8">Table 8</xref>. More than two thirds of the students agreed or completely agreed with the statements in favor of their extrinsic programming motivation. In contrast, more students disagreed more with the intrinsic motivation statements, even though more than half of the students nonetheless perceived programming as interesting and studied it or would have liked to have studied it gladly. However, most of the students did or could not imagine themselves doing programming in their leisure time.</p>
<table-wrap position="float" id="T8">
<label>TABLE 8</label>
<caption><p>Descriptive statistics of students&#x2019; programming motivation.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Subscale</td>
<td valign="top" align="center" colspan="2">Item</td>
<td valign="top" align="center" colspan="4">Percentage distributions of responses<hr/></td>
</tr>
<tr>
<td valign="top" align="center"></td>
<td valign="top" align="center" colspan="2"></td>
<td valign="top" align="center">1 &#x2013; completely disagree (%)</td>
<td valign="top" align="center">2 &#x2013; disagree (%)</td>
<td valign="top" align="center">3 &#x2013; agree<break/>(%)</td>
<td valign="top" align="center">4 &#x2013; completely agree (%)</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Intrinsic motivation</td>
<td valign="top" align="center">A.</td>
<td valign="top" align="left">Programming [is/seems] very interesting.</td>
<td valign="top" align="center">10.2</td>
<td valign="top" align="center">32.2</td>
<td valign="top" align="center">39.2</td>
<td valign="top" align="center">18.5</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">B.</td>
<td valign="top" align="left">[I study/If given an opportunity, I would study] programming gladly.</td>
<td valign="top" align="center">11.7</td>
<td valign="top" align="center">32.9</td>
<td valign="top" align="center">40.2</td>
<td valign="top" align="center">15.3</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">C.</td>
<td valign="top" align="left">[I do/I could imagine myself doing] computer programming in my leisure time.</td>
<td valign="top" align="center">27.4</td>
<td valign="top" align="center">47.2</td>
<td valign="top" align="center">19.4</td>
<td valign="top" align="center">6.1</td>
</tr>
<tr>
<td valign="top" align="left">Extrinsic motivation</td>
<td valign="top" align="center">D.</td>
<td valign="top" align="left">It is important to learn to understand the principles of programming in today&#x2019;s society.</td>
<td valign="top" align="center">4.8</td>
<td valign="top" align="center">22.8</td>
<td valign="top" align="center">59.8</td>
<td valign="top" align="center">12.7</td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center">E.</td>
<td valign="top" align="left">Studying programming [benefits/would benefit] my learning in other studies or my working life.</td>
<td valign="top" align="center">7.5</td>
<td valign="top" align="center">25.1</td>
<td valign="top" align="center">52.2</td>
<td valign="top" align="center">15.3</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="S4.SS3.SSS2">
<title>Students&#x2019; background and programming motivation (research questions 3.1 and 3.2)</title>
<p>Research questions 3.1 and 3.2 concerned how prior programming experience, gender, and home socioeconomic background are related to students&#x2019; programming motivation. These RQs were examined by exploring (weighted) mean differences and linear regression analysis.</p>
<p>Students with prior programming experience had on average slightly higher intrinsic (Mean = 2.60 cf. 2.26; difference 0.34, SE 0.04, <italic>p</italic> &#x003C; 0.001, Cohen&#x2019;s <italic>d</italic> = 0.45) and extrinsic (Mean = 2.90 cf. 2.66; difference 0.24, SE 0.03, <italic>p</italic> &#x003C; 0.001, Cohen&#x2019;s <italic>d</italic> = 0.36) programming motivation than students without said experience. In terms of gender, statistically significant differences among the students&#x2019; programming motivation levels were found in both experience groups (see <xref ref-type="table" rid="T9">Table 9</xref>). Specifically, boys had on average high intrinsic motivation, and it was much higher than girls&#x2019; intrinsic motivation among both students with prior programming experience (difference &#x2212;0.46, SE 0.06, <italic>p</italic> &#x003C; 0.001, Cohen&#x2019;s <italic>d</italic> = 0.67) and those without it (difference &#x2212;0.47, SE 0.05, <italic>p</italic> &#x003C; 0.001, Cohen&#x2019;s <italic>d</italic> = 0.65). Girls&#x2019; intrinsic motivation leaned slightly to the negative side of the scale midpoint (2.5). Gender differences in extrinsic motivation followed a similar pattern with the exception that the averages were slightly higher.</p>
<table-wrap position="float" id="T9">
<label>TABLE 9</label>
<caption><p>Mean and standard deviations, mean differences, and effect sizes (Cohen&#x2019;s <italic>d</italic>) of intrinsic and extrinsic motivation among the student respondents by gender and separately for with and without programming experience.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="2">Students with prior experience in programming<hr/></td>
<td valign="top" align="center" colspan="2">Students without prior experience in programming<hr/></td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center"><italic>M</italic></td>
<td valign="top" align="center">SD</td>
<td valign="top" align="center"><italic>M</italic></td>
<td valign="top" align="center">SD</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Intrinsic motivation</bold></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Girl</td>
<td valign="top" align="center">2.28</td>
<td valign="top" align="center">0.69</td>
<td valign="top" align="center">2.07</td>
<td valign="top" align="center">0.70</td>
</tr>
<tr>
<td valign="top" align="left">Boy</td>
<td valign="top" align="center">2.75</td>
<td valign="top" align="center">0.72</td>
<td valign="top" align="center">2.55</td>
<td valign="top" align="center">0.78</td>
</tr>
<tr>
<td valign="top" align="left">Difference</td>
<td valign="top" align="center">&#x2013;0.46</td>
<td valign="top" align="center"></td>
<td valign="top" align="center">&#x2013;0.47</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Cohen&#x2019;s <italic>d</italic></td>
<td valign="top" align="center">0.67</td>
<td valign="top" align="center"></td>
<td valign="top" align="center">0.65</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left"><bold>Extrinsic motivation</bold></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Girl</td>
<td valign="top" align="center">2.79</td>
<td valign="top" align="center">0.63</td>
<td valign="top" align="center">2.63</td>
<td valign="top" align="center">0.68</td>
</tr>
<tr>
<td valign="top" align="left">Boy</td>
<td valign="top" align="center">2.94</td>
<td valign="top" align="center">0.66</td>
<td valign="top" align="center">2.71</td>
<td valign="top" align="center">0.70</td>
</tr>
<tr>
<td valign="top" align="left">Difference</td>
<td valign="top" align="center">&#x2013;0.15</td>
<td valign="top" align="center"></td>
<td valign="top" align="center">&#x2013;0.09</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Cohen&#x2019;s <italic>d</italic></td>
<td valign="top" align="center">0.23</td>
<td valign="top" align="center"></td>
<td valign="top" align="center">0.12</td>
<td valign="top" align="center"></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>The values are situated on a 4-point Likert scale.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>Home socioeconomic background was weakly but positively related only to extrinsic motivation (but not intrinsic motivation) among both for students with prior programming experience [<italic>b</italic> = 0.07, SE 0.03, &#x03B2; = 0.11, SE (&#x03B2;) = 0.04, <italic>p</italic> &#x003C; 0.01] and those without it [<italic>b</italic> = 0.06, SE 0.01, &#x03B2; = 0.09, SE (&#x03B2;) = 0.02, <italic>p</italic> &#x003C; 0.001].</p>
</sec>
<sec id="S4.SS3.SSS3">
<title>Students&#x2019; computational thinking test scores and programming motivation (research question 3.3)</title>
<p>Research question 3.3 concerned associations between the students&#x2019; motivation and their CT test scores. According to our regression analysis, students&#x2019; high intrinsic motivation was related to higher CT test scores only for students with prior programming experience [<italic>b</italic> = 12.95, SE = 5.55, &#x03B2; = 0.11, SE (&#x03B2;) = 0.05, <italic>p</italic> &#x003C; 0.05]. In other words, a 1-point increase in the motivation item (Likert scale 1 to 4) raised the CT test score (Mean = 500, SD = 100) by 12.95 points among students in this experience group. High extrinsic motivation, in turn, was only related to higher CT test scores for students without programming experience [<italic>b</italic> = 10.88, SE = 4.55, &#x03B2; = 0.08, SE (&#x03B2;) = 0.03), <italic>p</italic> &#x003C; 0.05]. Although the coefficients were relatively modest in both regressions, they revealed that there altogether were general positive trends.</p>
</sec>
</sec>
</sec>
<sec id="S5" sec-type="discussion">
<title>Discussion</title>
<sec id="S5.SS1">
<title>Overview of the results</title>
<sec id="S5.SS1.SSS1">
<title>Main findings regarding teachers</title>
<p>Finnish teachers&#x2019; generally high extrinsic programming motivation in terms of their perceived value and importance of programming corresponds with the broadly voiced educational importance of the topic and global initiatives surrounding its integration in school curricula (<xref ref-type="bibr" rid="B25">Heintz et al., 2016</xref>). In turn, teachers experienced relatively low intrinsic programming motivation as relatively few teachers welcomed the idea of programming in their free time. These results suggest that teachers may consider programming as an educationally important topic but not necessarily be very interested in it personally (see also <xref ref-type="bibr" rid="B50">Ryan and Deci, 2000</xref>, <xref ref-type="bibr" rid="B51">2017</xref>). However, the substantial variability between teachers within both types of motivation displayed that there are teachers who are highly motivated for the topic. Similarly, as also preliminarily noted by <xref ref-type="bibr" rid="B24">Hartell et al. (2019)</xref>, some teachers are evidently not convinced of the educational value of programming despite the prevalent view. Teachers&#x2019; intrinsic and extrinsic programming motivation correlated moderately, though, suggesting that individual teachers&#x2019; both types of motivation may be uniformly lower and higher rather than inclusive of a noticeable difference.</p>
<p>The results showed further that male teachers as well as teachers with prior experience in teaching programming were more motivated toward programming (especially intrinsically) than female teachers and teachers without prior programming teaching experience. In this respect, the results seem to explain the finding by <xref ref-type="bibr" rid="B28">Kaarakainen et al. (2017)</xref> stating that Finnish male teachers teach programming more often than female teachers. However, especially the effect of prior programming teaching experience was very large when compared to the other examined variables. Regarding age, younger teachers have been previously found to use ICT more in their teaching (<xref ref-type="bibr" rid="B23">H&#x00E4;m&#x00E4;l&#x00E4;inen et al., 2021</xref>). However, our findings showed such a nuance that intrinsic programming motivation among teachers with prior experience in teaching programming was slightly higher the older the teacher was. One reason could be that teachers&#x2019; programming motivation deepens along the years if they have already adopted the topic in their instructional practice. Younger teachers may also need to spend more time for managing basic teaching activities and be less able to adopt novel pedagogical dimensions.</p>
<p>Second, the subjects that the teachers taught also played a role in their programming motivation. Programming-wise the most motivated teachers were those who taught IT-related subjects, mathematics, practical and vocational subjects, and creative arts. Alongside the results gained by <xref ref-type="bibr" rid="B22">Gurer et al. (2019)</xref>, the role of IT is unsurprising, because, in terms of the disciplinary backgrounds of CT and programming (see <xref ref-type="bibr" rid="B7">Denning and Tedre, 2019</xref>), these topics are the closest to IT among the subjects taught in Finnish basic education. Programming has also been taught at the basic education level before it has been enveloped in contemporary CT discourse (see e.g., <xref ref-type="bibr" rid="B45">Pea et al., 1987</xref>). In turn, the placement of programming in mathematics and practical and vocational subjects in the Finnish curriculum (<xref ref-type="bibr" rid="B11">Finnish National Agency of Education, 2016</xref>) could mainly explain the distinctive role of these subjects. A reason for creative arts teachers&#x2019; higher programming motivation could be the focus on creative expression in animating with the popular programming tool Scratch (see <xref ref-type="bibr" rid="B3">Brennan and Resnick, 2012</xref>). In contrast, teachers who teach linguistic subjects, human sciences, social studies, and other subjects, such as physical education and health education as listed in <xref ref-type="table" rid="T3">Table 3</xref> may be more strangers to the problem-solving aspects of CT characteristic to activities (see <xref ref-type="fig" rid="F1">Figure 1</xref>) typically present in STEAM subjects. Teachers of humanities and social sciences could, however, find the multiliteracy aspects of CT (see e.g., <xref ref-type="bibr" rid="B26">H&#x00F8;holt et al., 2021</xref>) interesting and valuable, though. This speculation is reinforced with the fact that, in the present study, teachers generally agreed more for the statement that in today&#x2019;s society it is important to learn to understand the principles of programming rather than to learn to program computer programs.</p>
<p>Examination of the associations between teachers&#x2019; programming motivation and their CT instruction emphasis suggested that especially intrinsic programming motivation may promote instructional emphasis on both the more cross-contextual CT skills and on skills more directly contextualized to programming. This suggested that motivation can play a role in teachers&#x2019; adoption of CT altogether, which is likely encouraged by the large amount of teacher autonomy in Finnish basic education (see <xref ref-type="bibr" rid="B12">Finnish National Agency of Education, 2018</xref>). Although the direction of the relationship was not revealed directly, the data showed that intrinsic motivation was positively related especially to prior experience in teaching programming. Prior studies have also shown that gaining positive programming experiences improves teachers&#x2019; attitudes toward programming (<xref ref-type="bibr" rid="B10">Fesakis and Serafeim, 2009</xref>; <xref ref-type="bibr" rid="B4">Choi, 2013</xref>; <xref ref-type="bibr" rid="B9">Erol and Kurt, 2017</xref>; <xref ref-type="bibr" rid="B72">Yukselturk and Altiok, 2017</xref>). It thus seems that positive personal programming experiences especially can spark motivation to adopt CT in instruction.</p>
</sec>
<sec id="S5.SS1.SSS2">
<title>Main findings regarding students</title>
<p>Finnish Grade 8 students&#x2019; average programming motivation on the positive side of the scales indicates that students largely consider programming as a personally interesting or enjoyable activity and generally as a valuable educational topic (see also <xref ref-type="bibr" rid="B32">Kong et al., 2018</xref>; <xref ref-type="bibr" rid="B40">Mason and Rich, 2020</xref>). It was especially interesting, however, that students had roughly the same amount of intrinsic and extrinsic programming motivation whereas teachers had relatively less intrinsic than extrinsic motivation. Students&#x2019; programming motivation has likely been promoted by the development and dissemination of assorted age-appropriate educational programming environments (see <xref ref-type="bibr" rid="B16">Garneli et al., 2015</xref>). These findings are promising in the sense that, according to the SDT (<xref ref-type="bibr" rid="B50">Ryan and Deci, 2000</xref>, <xref ref-type="bibr" rid="B51">2017</xref>), students can be expected to be resultantly engaged in learning CT. However, it is important to note that there was substantial variability in both types of programming motivations between students, and the motivation types also correlated moderately. Many students could therefore benefit from being more motivated in programming both intrinsically and extrinsically. However, as <xref ref-type="bibr" rid="B39">Mannila et al. (2020)</xref> have discussed, students without prior experience in programming may lack a clear understanding of what the activity entails and be unable to form informed attitudes toward it. Therefore, many students could most essentially benefit from broader awareness of what programming is.</p>
<p>With the above being said, the existence of prior programming experience as a background factor related positively to programming motivation, which is in line with numerous studies conducted in specific programming contexts (see e.g., <xref ref-type="bibr" rid="B48">Ruf et al., 2014</xref>; <xref ref-type="bibr" rid="B1">Asad et al., 2016</xref>; <xref ref-type="bibr" rid="B27">Jiang and Wong, 2017</xref>; <xref ref-type="bibr" rid="B55">Sharma et al., 2019</xref>; <xref ref-type="bibr" rid="B34">Lambi&#x0107; et al., 2021</xref>; <xref ref-type="bibr" rid="B64">Tisza and Markopoulos, 2021</xref>). The effect size was medium. Combined with the speculation regarding programming-wise inexperienced students&#x2019; lack of understanding regarding what programming is, gaining hands-on programming experiences seems to demonstrate the nature, interestingness, and value of programming to students in practice potentially well. However, it is important to note that hands-on learning experiences can impact motivation negatively if care is not devoted to effective pedagogical design (see <xref ref-type="bibr" rid="B8">Dohn, 2019</xref>).</p>
<p>Second in terms of students&#x2019; backgrounds, there were pronounced differences in programming motivation between girls and boys. As evinced also in prior research (<xref ref-type="bibr" rid="B37">Mahoney, 2010</xref>; <xref ref-type="bibr" rid="B30">Kier et al., 2014</xref>; <xref ref-type="bibr" rid="B21">Gunbatar and Karalar, 2018</xref>; <xref ref-type="bibr" rid="B32">Kong et al., 2018</xref>; <xref ref-type="bibr" rid="B60">Sun et al., 2022</xref>), boys are significantly more interested in programming-related topics than girls. Gender differences existed both in intrinsic and extrinsic motivation, and girls&#x2019; average of extrinsic motivation on the negative side of the scale midpoint indicates that many Finnish girls do not value programming. This corresponds with the stereotypical view of computing-themed studies and work fields as male-dominant. However, gender differences have been seen to diminish after gaining programming experiences (<xref ref-type="bibr" rid="B21">Gunbatar and Karalar, 2018</xref>), which suggests that especially girls should have more positive programming experiences in the future.</p>
<p>Third, home socioeconomic background, which has previously been found to relate positively to students&#x2019; CT learning outcomes (<xref ref-type="bibr" rid="B13">Fraillon et al., 2019a</xref>; <xref ref-type="bibr" rid="B35">Leino et al., 2019</xref>), also related positively to students&#x2019; extrinsic programming motivation (but not intrinsic motivation), although this relationship was rather weak. This showed slight support for <xref ref-type="bibr" rid="B39">Mannila et al.&#x2019;s (2020)</xref> speculation that family may play a role in a student&#x2019;s perception of the value or usefulness of programming. Parents can, for instance, have favor for studying ICT-related topics to prepare their child for societally valuable future careers. However, it seems that more essential factors reside elsewhere.</p>
<p>Our results regarding the associations between students&#x2019; programming motivation and their CT test scores showed that high intrinsic programming motivation was related to higher CT skills among students with prior programming experience. High extrinsic motivation was also related to higher CT skills among students without programming experience. The relationship between motivation and CT learning in general was consistent with previous research (see <xref ref-type="bibr" rid="B40">Mason and Rich, 2020</xref>; <xref ref-type="bibr" rid="B60">Sun et al., 2022</xref>). Specifically, intrinsically motivated students with prior programming experience may have performed better because they may have had voluntarily sought out additional learning situations (see <xref ref-type="bibr" rid="B49">Ryan and Connell, 1989</xref>). This point would also support the finding by <xref ref-type="bibr" rid="B65">Vainikainen et al. (2022)</xref> that Finnish students acquire a share of their digital skills through learning that is guided by their interest, and that digital skills are generally higher among students who volitionally engage in digital activities more often. In turn, students with high extrinsic programming motivation without prior programming experience may have put more effort in the CT test in ICILS for valuing the topic more than those with low extrinsic motivation. The regression coefficients were not overly large, though, which could be partly explained by the timing of the data collection: the students may have had only little prior exposure to CT, because programming was introduced to the population via the core curriculum the following academic year after the ICILS assessment.</p>
</sec>
</sec>
<sec id="S5.SS2">
<title>Implications for practice and future research</title>
<p>The broader adoption of CT in basic education could be aided by guiding all teachers to integrate CT in teaching through clear curricular guidelines. Effective implementation of such guidelines would naturally necessitate systematic training, which has been previously lacking in Finland. Because teachers have much autonomy, it is important to promote especially their intrinsic programming motivation, which appears meaningful for adopting CT in instruction and currently varied in the population. Teachers&#x2019; awareness of the possibilities of CT and programming could be expanded by providing them with further understanding of different computational tools and CT-related substance areas to pique their interest. It seems especially important to pay particular attention to in-service teachers especially with low programming motivation as well as to conduct further investigations among pre-service teachers to further understand the current situation in initial teacher training. It would also be interesting to examine potential changes in teachers&#x2019; and students&#x2019; motivation, for instance, due the continued presence of programming in the newest national core curriculum as well as examine how other types of motivation may relate to teachers&#x2019; CT instruction.</p>
<p>Alongside motivational incentives in spreading CT awareness among teachers, it is important to ensure that teachers are equipped with pedagogically effective ways to integrate CT that are also meaningful for the disciplinary nature of their subject. While there has been discussion about whether all teachers should be expected to include programming in their teaching, CT, the expected learning outcome of programming, has been expressed as being cross-contextual (<xref ref-type="bibr" rid="B70">Wing, 2006</xref>), and there are many concrete examples of integrating these topics across the curriculum (see e.g., <xref ref-type="bibr" rid="B54">Settle and Perkovi&#x0107;, 2010</xref>; <xref ref-type="bibr" rid="B43">Moreno-Le&#x00F3;n et al., 2017</xref>). Training should thus also consider solutions on how the manifold aspects of CT could be content-wise reflected in the lessons of different subjects. It appears crucial to spread awareness especially regarding such more cross-contextual CT activities as understanding diagrams and using real-world data to solve problems with computational methods (see e.g., <xref ref-type="bibr" rid="B2">Barr and Stephenson, 2011</xref>; <xref ref-type="bibr" rid="B19">Grover and Pea, 2013</xref>). Thus, also the extents and ways in which teachers of different subjects emphasize different aspects of CT (see <xref ref-type="fig" rid="F1">Figure 1</xref> and <xref ref-type="table" rid="T1">Table 1</xref>) could also be studied more thoroughly in the future. Additionally, expanding pedagogical possibilities in the more non-problem-solving aspects of CT, that is, the dimension of computational multiliteracy (see <xref ref-type="bibr" rid="B29">Kafai et al., 2019</xref>; <xref ref-type="bibr" rid="B26">H&#x00F8;holt et al., 2021</xref>; <xref ref-type="bibr" rid="B42">Mertala, 2021</xref>) concretely for different school subjects could be highly impactful.</p>
<p>To support teachers&#x2019; overall teaching success in CT instruction, it can be vital to also consider how comfortably teachers can adopt different kinds of CT-related pedagogical contents (<xref ref-type="bibr" rid="B53">Sentance et al., 2019</xref>; <xref ref-type="bibr" rid="B46">Rich et al., 2021</xref>) and what role teachers&#x2019; CT self-efficacy can play in professional learning in CT (see also <xref ref-type="bibr" rid="B44">M&#x00FC;hling et al., 2010</xref>; <xref ref-type="bibr" rid="B72">Yukselturk and Altiok, 2017</xref>; <xref ref-type="bibr" rid="B17">Garvin et al., 2019</xref>). Future teacher training and research should thus also critically and meticulously consider teachers&#x2019; subject and pedagogical content knowledge in CT (see <xref ref-type="bibr" rid="B38">M&#x00E4;kitalo et al., 2019</xref>; <xref ref-type="bibr" rid="B33">Kong et al., 2020</xref>). Additionally, the availability of teaching materials and assessment practices (<xref ref-type="bibr" rid="B69">Weintrop et al., 2019</xref>) and even such mundane factors as time for lesson planning (<xref ref-type="bibr" rid="B68">Waite et al., 2020</xref>), time in the syllabus, and time altogether for professional development are important, turning focus also into school resources and school leaders&#x2019; decision-making. Illustratively, in Finland, only 58% of school principals rated the educational outcome of developing students&#x2019; skills to write apps or programs as quite important or very important (<xref ref-type="bibr" rid="B59">Strietholt et al., 2021</xref>, p. 28), showing that nearly a half of school principals do not perceive students&#x2019; programming skills as important educational outcomes.</p>
<p>Teachers&#x2019; broader adoption of CT would likely also improve students&#x2019; exposure to CT while studying different school subjects. However, in terms of students&#x2019; programming motivation specifically, it is altogether vital to provide learning experiences that are interesting and enjoyable and that promote a sense of value and usefulness. The latter could be targeted by clearly highlighting the significant role of CT and programming in daily life and the world of professional work. Regarding the first, prior studies have already illustrated that programming in a variety of ways can be intrinsically motivating. Specifically, learners&#x2019; positive attitudes have been shown to increase after, to name a few, designing games and animations in the contexts of creative computing with Scratch (<xref ref-type="bibr" rid="B48">Ruf et al., 2014</xref>), maker-like activities (<xref ref-type="bibr" rid="B64">Tisza and Markopoulos, 2021</xref>), &#x201C;unplugged&#x201D; activities (<xref ref-type="bibr" rid="B27">Jiang and Wong, 2017</xref>), (<xref ref-type="bibr" rid="B34">Lambi&#x0107; et al., 2021</xref>), and text-based programming (<xref ref-type="bibr" rid="B1">Asad et al., 2016</xref>). Students&#x2019; motivational dimensions could thus be increased by providing personally interesting and enjoyable ways of programming from the variety of existing ways to do programming rather than through singular isolated introductions. Especially girls are in desperate need of such opportunities to diminish the prevalent views of programming being not for their gender. On the previous note regarding teachers&#x2019; pedagogical content knowledge in CT, it is important to note that students&#x2019; interest toward programming can wane when faced with difficult and tedious tasks (<xref ref-type="bibr" rid="B8">Dohn, 2019</xref>). Proper pedagogical planning in terms of appropriate instructional guidance (<xref ref-type="bibr" rid="B36">Lye and Koh, 2014</xref>) and collaborative, student-centered, and craft-oriented learning (<xref ref-type="bibr" rid="B62">Taub et al., 2012</xref>; <xref ref-type="bibr" rid="B8">Dohn, 2019</xref>; <xref ref-type="bibr" rid="B55">Sharma et al., 2019</xref>) can thus be crucial specifically from the viewpoint of student motivation and achievement.</p>
</sec>
<sec id="S5.SS3">
<title>Limitations</title>
<p>This study is not without limitations. The first limitation is the cross-sectional study design. Despite the large and representative sample and accounting for the effects of meaningful covariates, the present study was correlational, which inhibits assertions on causality. For instance, we were only able to hypothesize whether motivation may lead to increased instructional emphasis and learning or vice versa. Another limitation is that the sampling design in the study prevented certain potentially valuable analyses, such as cross-examining the responses of teachers and students in the same schools or classrooms. In addition, even though we measured intrinsic and extrinsic motivation for both students and teachers, the measures were not identical since the student measures focused on motivation for learning programming whereas teachers&#x2019; measures focused on motivation in teaching programming. Otherwise, the items were identical apart from that the extrinsic motivation questionnaire consisted of three items for teachers and two items for students.</p>
<p>The international questions in the large-scale international comparative study were developed and the data was collected following a common approach agreed by several partners. The student questionnaire especially was broad, and therefore only few additional questions on motivation could be added to investigate select theoretical dimensions. Moreover, the data was self-reported by the teachers and students, and this setting can involve factors related to, for instance, self-esteem and self-presentation styles that can influence responses. The data was also collected in 2018, and the results thus indicate the situation on the eve of the new curriculum rather than its impact.</p>
</sec>
</sec>
<sec id="S6" sec-type="conclusion">
<title>Conclusion</title>
<p>This study connects to the broad discussion and numerous educational initiatives surrounding CT in basic education both in Finland and globally. Our focus was on teachers&#x2019; and students&#x2019; programming motivation and its role in the instruction emphasis of CT among teachers of different subjects and Grade 8 students&#x2019; CT proficiency as demonstrated by their ICILS 2018 CT test results. As shown by previous research and the current study, the different ways of integrating CT across school subjects especially through the problem-solving aspect prevalent in CT have not comprehensively found inroads to the instruction of most teachers in basic education. Therefore, also students appear to vary in terms of their exposure to and learning outcomes in CT, posing growing needs for basic education to bridge these gaps.</p>
<p>Programming motivation appears to have a modest positive relationship with teachers&#x2019; CT instruction emphasis and students&#x2019; CT proficiency, which is why it is important to consider in teacher training and pedagogical planning. On average, programming motivation is comparably high especially among teachers with prior experience in teaching programming, STEAM teachers, as well as male teachers. In turn, it is comparably low among teachers without prior experience in teaching programming, teachers who teach national and foreign languages and other subjects, as well as female teachers. For students, programming motivation is on average comparably high among students who have programmed previously and boys whereas students who have not programmed previously and girls have comparably low programming motivation. It appears especially important to consider how to promote especially teachers&#x2019; intrinsic programming motivation and girls&#x2019; programming motivation generally, although other as or more important factors influencing teachers&#x2019; CT instruction and students&#x2019; CT learning may include teachers&#x2019; skills (<xref ref-type="bibr" rid="B38">M&#x00E4;kitalo et al., 2019</xref>; <xref ref-type="bibr" rid="B33">Kong et al., 2020</xref>), available resources (<xref ref-type="bibr" rid="B69">Weintrop et al., 2019</xref>) and time (<xref ref-type="bibr" rid="B68">Waite et al., 2020</xref>), the amount or quality of instruction and learning experiences and learning activities (<xref ref-type="bibr" rid="B36">Lye and Koh, 2014</xref>; <xref ref-type="bibr" rid="B60">Sun et al., 2022</xref>), and even students&#x2019; personality traits (<xref ref-type="bibr" rid="B47">Rom&#x00E1;n-Gonz&#x00E1;lez et al., 2017</xref>).</p>
<p>For spreading the word of CT in basic education more extensively, there is a growing need for teachers to understand CT more broadly than merely programming: CT should be regarded as cross-contextual computational problem-solving that can have benefits beyond mere code-writing contexts. It could also be presented for teachers more broadly as a type of multiliteracy, which involves teaching students to also examine the practical, political, and even ethical dimensions of the surrounding computational world critically (<xref ref-type="bibr" rid="B26">H&#x00F8;holt et al., 2021</xref>). This viewpoint emphasizes not just learning to employ computational tools and methods to solve logical problems but also understanding what computing means personally and socially, thus perhaps making more sense to teachers of different subjects (<xref ref-type="bibr" rid="B42">Mertala, 2021</xref>). Generally, in CT, there is also the need to continue adopting the more comprehensive viewpoints portraying it as one involving more data-driven machine learning notions as well, which are rendering the so-called &#x201C;CT 1.0&#x201D; (i.e., one involving the more traditional step-by-step computational methodologies) somewhat obsolete (<xref ref-type="bibr" rid="B66">Vartiainen et al., 2020</xref>).</p>
</sec>
<sec id="S7" sec-type="data-availability">
<title>Data availability statement</title>
<p>ICILS 2018 international database is available at the official IEA website (<ext-link ext-link-type="uri" xlink:href="https://www.iea.nl/data-tools/repository">https://www.iea.nl/data-tools/repository</ext-link>). The national data analyzed in this study can be enquired from JF.</p>
</sec>
<sec id="S8">
<title>Ethics statement</title>
<p>Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. Written informed consent from the participants&#x2019; legal guardian/next of kin was not required to participate in this study in accordance with the national legislation and the institutional requirements.</p>
</sec>
<sec id="S9">
<title>Author contributions</title>
<p>JF made primary contributions to the manuscript working collaboratively with all authors. JF and KL were primarily responsible for the study design, and, with NK, for the literature review, data analysis, and interpretation. MN-R was primarily responsible for data organization and completing the statistical tests. All authors contributed to the manuscript and approved its submitted version.</p>
</sec>
</body>
<back>
<sec id="S10" sec-type="funding-information">
<title>Funding</title>
<p>This article was funded by the University of Jyv&#x00E4;skyl&#x00E4;, in particular, Finnish Institute for Educational Research, which acted as national research center in ICILS 2018, and the Department of Psychology.</p>
</sec>
<ack>
<p>We thank the multiple people contributing to the ICILS 2018 study from the international study coordination team, the partner countries, and the national research centers.</p>
</ack>
<sec id="S11" sec-type="COI-statement">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="S12" sec-type="disclaimer">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<fn-group>
<fn id="footnote1"><label>1</label><p>In ICILS 2018, teachers were instructed to select their reference class that is the first Grade 8 class that they taught for a regular subject (i.e., other than home room and assembly) on or after Tuesday following the last weekend before they first accessed the questionnaire.</p></fn>
<fn id="footnote2"><label>2</label><p>Intrinsic Motivation Inventory is a psychometric tool to evaluate research participants&#x2019; subjective experience, such as interest/enjoyment, perceived competence, effort, value/usefulness, felt pressure and tension, and perceived choice related to a target activity. The inventory can be modified to include or exclude subscales without significant impact, resulting in a chosen selection of subscales relevant to the investigation. The inventory can be attained from: <ext-link ext-link-type="uri" xlink:href="https://selfdeterminationtheory.org/intrinsic-motivation-inventory/">https://selfdeterminationtheory.org/intrinsic-motivation-inventory/</ext-link>.</p></fn>
</fn-group>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Asad</surname> <given-names>K.</given-names></name> <name><surname>Tibi</surname> <given-names>M.</given-names></name> <name><surname>Raiyn</surname> <given-names>J.</given-names></name></person-group> (<year>2016</year>). <article-title>Primary school pupils&#x2019; attitudes toward learning programming through visual interactive environments.</article-title> <source><italic>World J. Educ.</italic></source> <volume>6</volume> <fpage>20</fpage>&#x2013;<lpage>26</lpage>. <pub-id pub-id-type="doi">10.5430/wje.v6n5p20</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barr</surname> <given-names>V.</given-names></name> <name><surname>Stephenson</surname> <given-names>C.</given-names></name></person-group> (<year>2011</year>). <article-title>Bringing computational thinking to K&#x2013;12: What is involved and what is the role of the computer science education community?</article-title> <source><italic>ACM Inroads</italic></source> <volume>2</volume> <fpage>48</fpage>&#x2013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1145/1929887.1929905</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brennan</surname> <given-names>K.</given-names></name> <name><surname>Resnick</surname> <given-names>M.</given-names></name></person-group> (<year>2012</year>). <article-title>New frameworks for studying and assessing the development of computational thinking.</article-title> <source><italic>Paper presented at the meeting of AERA 2012</italic></source>, <publisher-loc>Vancouver, BC</publisher-loc>.</citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Choi</surname> <given-names>H.</given-names></name></person-group> (<year>2013</year>). <article-title>Pre-service teachers&#x2019; conceptions and reflections of computer programming using scratch: Technological and pedagogical perspectives.</article-title> <source><italic>Int. J. Educ. Media Technol.</italic></source> <volume>7</volume> <fpage>15</fpage>&#x2013;<lpage>25</lpage>.</citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deci</surname> <given-names>E. L.</given-names></name> <name><surname>Ryan</surname> <given-names>R. M.</given-names></name></person-group> (<year>1985</year>). <source><italic>Intrinsic motivation and self-determination in human behavior.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Plenum</publisher-name>.</citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deci</surname> <given-names>E. L.</given-names></name> <name><surname>Eghrari</surname> <given-names>H.</given-names></name> <name><surname>Patrick</surname> <given-names>B. C.</given-names></name> <name><surname>Leone</surname> <given-names>D.</given-names></name></person-group> (<year>1994</year>). <article-title>Facilitating internalization: The self-determination theory perspective.</article-title> <source><italic>J. Pers.</italic></source> <volume>62</volume> <fpage>119</fpage>&#x2013;<lpage>142</lpage>.</citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Denning</surname> <given-names>P.</given-names></name> <name><surname>Tedre</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <source><italic>Computational thinking.</italic></source> <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>MIT Press Ltd</publisher-name>.</citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dohn</surname> <given-names>N. B.</given-names></name></person-group> (<year>2019</year>). <article-title>Students&#x2019; interest in scratch coding in lower secondary mathematics.</article-title> <source><italic>Br. J. Educ. Technol.</italic></source> <volume>51</volume> <fpage>71</fpage>&#x2013;<lpage>83</lpage>. <pub-id pub-id-type="doi">10.1111/bjet.12759</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Erol</surname> <given-names>O.</given-names></name> <name><surname>Kurt</surname> <given-names>A. A.</given-names></name></person-group> (<year>2017</year>). <article-title>The effects of teaching programming with scratch on pre-service information technology teachers&#x2019; motivation and achievement.</article-title> <source><italic>Comput. Hum. Behav.</italic></source> <volume>77</volume> <fpage>11</fpage>&#x2013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2017.08.017</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fesakis</surname> <given-names>G.</given-names></name> <name><surname>Serafeim</surname> <given-names>K.</given-names></name></person-group> (<year>2009</year>). <article-title>Influence of the familiarization with &#x201C;scratch&#x201D; on future teachers&#x2019; opinions and attitudes about programming and ICT in education.</article-title> <source><italic>ACM SIGCSE Bull.</italic></source> <volume>41</volume> <fpage>258</fpage>&#x2013;<lpage>262</lpage>. <pub-id pub-id-type="doi">10.1145/1595496.1562957</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><collab>Finnish National Agency of Education</collab> (<year>2016</year>). <source><italic>National core curriculum for basic education.</italic></source> <publisher-loc>Helsinki</publisher-loc>: <publisher-name>Finnish National Board of Education</publisher-name>.</citation></ref>
<ref id="B12"><citation citation-type="journal"><collab>Finnish National Agency of Education</collab> (<year>2018</year>). <source><italic>Finnish education in a nutshell.</italic></source> <publisher-loc>Helsinki</publisher-loc>: <publisher-name>Finnish National Board of Education</publisher-name>.</citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fraillon</surname> <given-names>J.</given-names></name> <name><surname>Ainley</surname> <given-names>J.</given-names></name> <name><surname>Schulz</surname> <given-names>W.</given-names></name> <name><surname>Friedman</surname> <given-names>T.</given-names></name> <name><surname>Duckworth</surname> <given-names>D.</given-names></name></person-group> (<year>2019a</year>). <source><italic>Preparing for life in a digital world. IEA international computer and information literacy study 2018 international report.</italic></source> <publisher-loc>Cham</publisher-loc>: <publisher-name>Springer</publisher-name>. <pub-id pub-id-type="doi">10.1007/978-3-030-38781-5</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fraillon</surname> <given-names>J.</given-names></name> <name><surname>Ainley</surname> <given-names>J.</given-names></name> <name><surname>Schulz</surname> <given-names>W.</given-names></name> <name><surname>Duckworth</surname> <given-names>D.</given-names></name> <name><surname>Friedman</surname> <given-names>T.</given-names></name></person-group> (<year>2019b</year>). <source><italic>IEA international computer and information literacy study 2018 assessment framework.</italic></source> <publisher-loc>Amsterdam</publisher-loc>: <publisher-name>IEA</publisher-name>.</citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fraillon</surname> <given-names>J.</given-names></name> <name><surname>Ainley</surname> <given-names>J.</given-names></name> <name><surname>Schulz</surname> <given-names>W.</given-names></name> <name><surname>Friedman</surname> <given-names>T.</given-names></name> <name><surname>Duckworth</surname> <given-names>D.</given-names></name></person-group> (<year>2020</year>). <source><italic>ICILS 2018 technical report.</italic></source> <publisher-loc>Amsterdam</publisher-loc>: <publisher-name>IEA</publisher-name>.</citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garneli</surname> <given-names>B.</given-names></name> <name><surname>Giannakos</surname> <given-names>M.</given-names></name> <name><surname>Chorianopoulos</surname> <given-names>K.</given-names></name></person-group> (<year>2015</year>). <article-title>Computing education in K&#x2013;12 schools. A review of the literature.</article-title> <source><italic>Paper presented at the 2015 IEEE global engineering education conference (EDUCON)</italic></source>, <publisher-loc>Tallinn</publisher-loc>. <pub-id pub-id-type="doi">10.1109/EDUCON.2015.7096023</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garvin</surname> <given-names>M.</given-names></name> <name><surname>Killen</surname> <given-names>H.</given-names></name> <name><surname>Plane</surname> <given-names>J.</given-names></name> <name><surname>Weintrop</surname> <given-names>D.</given-names></name></person-group> (<year>2019</year>). &#x201C;<article-title>Primary school teachers&#x2019; conceptions of computational thinking</article-title>,&#x201D; in <source><italic>Proceedings of the 50th ACM technical symposium on computer science education SIGCSE &#x2018;19</italic></source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>899</fpage>&#x2013;<lpage>905</lpage>. <pub-id pub-id-type="doi">10.1145/3287324.3287376</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gorozidis</surname> <given-names>G.</given-names></name> <name><surname>Papaioannou</surname> <given-names>A. G.</given-names></name></person-group> (<year>2014</year>). <article-title>Teachers&#x2019; motivation to participate in training and to implement innovations.</article-title> <source><italic>Teach. Teach. Educ.</italic></source> <volume>39</volume> <fpage>1</fpage>&#x2013;<lpage>11</lpage>. <pub-id pub-id-type="doi">10.1016/j.tate.2013.12.001</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grover</surname> <given-names>S.</given-names></name> <name><surname>Pea</surname> <given-names>R.</given-names></name></person-group> (<year>2013</year>). <article-title>Computational thinking in K&#x2013;12: A review of the state of the field.</article-title> <source><italic>Educ. Res.</italic></source> <volume>41</volume> <fpage>38</fpage>&#x2013;<lpage>43</lpage>. <pub-id pub-id-type="doi">10.3102/0013189X12463051</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gul</surname> <given-names>D.</given-names></name> <name><surname>Cetin</surname> <given-names>I.</given-names></name> <name><surname>Ozden</surname> <given-names>M. Y.</given-names></name></person-group> (<year>2021</year>). <article-title>A scale for measuring middle school students&#x2019; attitudes toward programming.</article-title> <source><italic>Comput. Appl. Eng. Educ.</italic></source> <volume>30</volume> <fpage>251</fpage>&#x2013;<lpage>258</lpage>. <pub-id pub-id-type="doi">10.1002/cae.22454</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gunbatar</surname> <given-names>M. S.</given-names></name> <name><surname>Karalar</surname> <given-names>H.</given-names></name></person-group> (<year>2018</year>). <article-title>Gender differences in middle school students&#x2019; attitudes and self-efficacy perceptions towards mBlock programming.</article-title> <source><italic>Eur. J. Educ. Res.</italic></source> <volume>7</volume> <fpage>925</fpage>&#x2013;<lpage>933</lpage>. <pub-id pub-id-type="doi">10.12973/eu-jer.7.4.923</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gurer</surname> <given-names>M. D.</given-names></name> <name><surname>Cetin</surname> <given-names>I.</given-names></name> <name><surname>Top</surname> <given-names>E.</given-names></name></person-group> (<year>2019</year>). <article-title>Factors affecting students&#x2019; attitudes toward computer programming.</article-title> <source><italic>Inform. Educ.</italic></source> <volume>18</volume> <fpage>281</fpage>&#x2013;<lpage>296</lpage>. <pub-id pub-id-type="doi">10.15388/infedu.2019.13</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>H&#x00E4;m&#x00E4;l&#x00E4;inen</surname> <given-names>R.</given-names></name> <name><surname>Nissinen</surname> <given-names>K.</given-names></name> <name><surname>Mannonen</surname> <given-names>J.</given-names></name> <name><surname>L&#x00E4;ms&#x00E4;</surname> <given-names>J.</given-names></name> <name><surname>Leino</surname> <given-names>K.</given-names></name> <name><surname>Taajamo</surname> <given-names>M.</given-names></name></person-group> (<year>2021</year>). <article-title>Understanding teaching professionals&#x2019; digital competence: What do PIAAC and TALIS reveal about technology-related skills, attitudes, and knowledge?</article-title> <source><italic>Comput. Hum. Behav.</italic></source> <volume>117</volume>:<issue>106672</issue>. <pub-id pub-id-type="doi">10.1016/j.chb.2020.106672</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hartell</surname> <given-names>E.</given-names></name> <name><surname>Doyle</surname> <given-names>A.</given-names></name> <name><surname>Gumaelius</surname> <given-names>L.</given-names></name></person-group> (<year>2019</year>). &#x201C;<article-title>Teachers&#x2019; attitudes towards teaching programming in swedish technology education</article-title>,&#x201D; in <source><italic>Proceedings of the PATT 37 developing a knowledge economy through technology and engineering education</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Pul&#x00E9;</surname> <given-names>S.</given-names></name> <name><surname>de Vries</surname> <given-names>M. J.</given-names></name></person-group> (<publisher-loc>Msida</publisher-loc>: <publisher-name>University of Malta</publisher-name>), <fpage>195</fpage>&#x2013;<lpage>202</lpage>.</citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Heintz</surname> <given-names>F.</given-names></name> <name><surname>Mannila</surname> <given-names>L.</given-names></name> <name><surname>F&#x00E4;rnqvist</surname> <given-names>T.</given-names></name></person-group> (<year>2016</year>). &#x201C;<article-title>A review of models for introducing computational thinking, computer science and computing in K&#x2013;12 education</article-title>,&#x201D; in <source><italic>Proceedings of the 2016 IEEE frontiers in education conference (IEEE)</italic></source> (<publisher-loc>Erie, PA</publisher-loc>: <publisher-name>IEEE</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1109/FIE.2016.7757410</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>H&#x00F8;holt</surname> <given-names>M.</given-names></name> <name><surname>Graungaard</surname> <given-names>D.</given-names></name> <name><surname>Bouvin</surname> <given-names>N. O.</given-names></name> <name><surname>Petersen</surname> <given-names>M. G.</given-names></name> <name><surname>Eriksson</surname> <given-names>E.</given-names></name></person-group> (<year>2021</year>). <article-title>Towards a model of progression in computational empowerment in education.</article-title> <source><italic>Int. J. Child Comput. Interact.</italic></source> <volume>29</volume>:<issue>100302</issue>. <pub-id pub-id-type="doi">10.1016/j.ijcci.2021.100302</pub-id></citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jiang</surname> <given-names>S.</given-names></name> <name><surname>Wong</surname> <given-names>G. K. W.</given-names></name></person-group> (<year>2017</year>). &#x201C;<article-title>Assessing primary school students&#x2019; intrinsic motivation of computational thinking</article-title>,&#x201D; in <source><italic>Proceedings of the 2017 IEEE 6th international conference on teaching, assessment, and learning for engineering (TALE) (IEEE)</italic></source> (<publisher-loc>Hong Kong</publisher-loc>: <publisher-name>IEEE</publisher-name>), <fpage>469</fpage>&#x2013;<lpage>474</lpage>. <pub-id pub-id-type="doi">10.1109/TALE.2017.8252381</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaarakainen</surname> <given-names>M.-T.</given-names></name> <name><surname>Kaarakainen</surname> <given-names>S.-S.</given-names></name> <name><surname>Tanhua-Piiroinen</surname> <given-names>E.</given-names></name> <name><surname>Viteli</surname> <given-names>J.</given-names></name> <name><surname>Syv&#x00E4;nen</surname> <given-names>A.</given-names></name> <name><surname>Kivinen</surname> <given-names>A.</given-names></name></person-group> (<year>2017</year>). <source><italic>Digiajan peruskoulu 2017 &#x2013; tilannearvio ja toimenpidesuositukset [Comprehensive school digitalisation: Status review and recommendations for action for 2017].</italic></source> <publisher-loc>New Delhi</publisher-loc>: <publisher-name>Prime Minister&#x2019;s Office</publisher-name>.</citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kafai</surname> <given-names>Y.</given-names></name> <name><surname>Proctor</surname> <given-names>C.</given-names></name> <name><surname>Lui</surname> <given-names>D.</given-names></name></person-group> (<year>2019</year>). &#x201C;<article-title>From theory bias to theory dialogue: Embracing cognitive, situated, and critical framings of computational thinking in K&#x2013;12 CS education</article-title>,&#x201D; in <source><italic>Proceedings of the 2019 ACM conference on international computing education research</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Malmi</surname> <given-names>L.</given-names></name> <name><surname>Korhonen</surname> <given-names>A.</given-names></name> <name><surname>McCartney</surname> <given-names>R.</given-names></name> <name><surname>Petersen</surname> <given-names>A.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>101</fpage>&#x2013;<lpage>109</lpage>. <pub-id pub-id-type="doi">10.1145/3291279.3339400</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kier</surname> <given-names>M. W.</given-names></name> <name><surname>Blanchard</surname> <given-names>M. R.</given-names></name> <name><surname>Osborne</surname> <given-names>J. W.</given-names></name> <name><surname>Albert</surname> <given-names>J. L.</given-names></name></person-group> (<year>2014</year>). <article-title>The development of the STEM career interest survey (STEM-CIS).</article-title> <source><italic>Res. Sci. Educ.</italic></source> <volume>44</volume> <fpage>461</fpage>&#x2013;<lpage>481</lpage>. <pub-id pub-id-type="doi">10.1007/s11165-013-9389-3</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kirschner</surname> <given-names>P. A.</given-names></name></person-group> (<year>2015</year>). <article-title>Do we need teachers as designers of technology enhanced learning?</article-title> <source><italic>Instr. Sci.</italic></source> <volume>43</volume> <fpage>309</fpage>&#x2013;<lpage>322</lpage>. <pub-id pub-id-type="doi">10.1007/s11251-015-9346-9</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kong</surname> <given-names>S.-C.</given-names></name> <name><surname>Chiu</surname> <given-names>M. M.</given-names></name> <name><surname>Lai</surname> <given-names>M.</given-names></name></person-group> (<year>2018</year>). <article-title>A study of primary school students&#x2019; interest, collaboration attitude, and programming empowerment in computational thinking education.</article-title> <source><italic>Comput. Educ.</italic></source> <volume>127</volume> <fpage>178</fpage>&#x2013;<lpage>189</lpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2018.08.026</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kong</surname> <given-names>S.-C.</given-names></name> <name><surname>Liu</surname> <given-names>M.</given-names></name> <name><surname>Sun</surname> <given-names>D.</given-names></name></person-group> (<year>2020</year>). <article-title>Teacher development in computational thinking: Design and learning outcomes of programming concepts, practices and pedagogy.</article-title> <source><italic>Comput. Educ.</italic></source> <volume>151</volume>:<issue>103872</issue>. <pub-id pub-id-type="doi">10.1016/j.compedu.2020.103872</pub-id></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lambi&#x0107;</surname> <given-names>D.</given-names></name> <name><surname>&#x00D0;ori&#x0107;</surname> <given-names>B.</given-names></name> <name><surname>Ivaki&#x0107;</surname> <given-names>S.</given-names></name></person-group> (<year>2021</year>). <article-title>Investigating the effect of the use of</article-title> <ext-link ext-link-type="uri" xlink:href="https://code.org">code.org</ext-link> <article-title>on younger elementary school students&#x2019; attitudes towards programming.</article-title> <source><italic>Behav. Inf. Technol.</italic></source> <volume>40</volume> <fpage>1784</fpage>&#x2013;<lpage>1795</lpage>. <pub-id pub-id-type="doi">10.1080/0144929X.2020.1781931</pub-id></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leino</surname> <given-names>K.</given-names></name> <name><surname>Rikala</surname> <given-names>J.</given-names></name> <name><surname>Puhakka</surname> <given-names>E.</given-names></name> <name><surname>Niilo-R&#x00E4;m&#x00E4;</surname> <given-names>M.</given-names></name> <name><surname>Sir&#x00E9;n</surname> <given-names>M.</given-names></name> <name><surname>Fagerlund</surname> <given-names>J.</given-names></name></person-group> (<year>2019</year>). <source><italic>Digiloikasta digitaitoihin. Kansainv&#x00E4;linen monilukutaidon ja ohjelmoinnillisen ajattelun tutkimus (ICILS 2018). [From digital leap to ICT skills: International computer and information literacy study with computational thinking assessment (ICILS 2018)].</italic></source> <publisher-loc>Jyv&#x00E4;skyl&#x00E4;</publisher-loc>: <publisher-name>Finnish Institute for Educational Research: University of Jyv&#x00E4;skyl&#x00E4;</publisher-name>.</citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lye</surname> <given-names>S. Y.</given-names></name> <name><surname>Koh</surname> <given-names>J. H. L.</given-names></name></person-group> (<year>2014</year>). <article-title>Review on teaching and learning of computational thinking through programming: What is next for K&#x2013;12?</article-title> <source><italic>Comput. Hum. Behav.</italic></source> <volume>41</volume> <fpage>51</fpage>&#x2013;<lpage>61</lpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2014.09.012</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mahoney</surname> <given-names>M. P.</given-names></name></person-group> (<year>2010</year>). <article-title>Students&#x2019; attitudes toward STEM: Development of an instrument for high school STEM-based programs.</article-title> <source><italic>J. Technol. Stud.</italic></source> <volume>36</volume> <fpage>24</fpage>&#x2013;<lpage>34</lpage>. <pub-id pub-id-type="doi">10.21061/jots.v36i1.a.4</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>M&#x00E4;kitalo</surname> <given-names>K. H.</given-names></name> <name><surname>Tedre</surname> <given-names>M.</given-names></name> <name><surname>Laru</surname> <given-names>J.</given-names></name> <name><surname>Valtonen</surname> <given-names>T.</given-names></name></person-group> (<year>2019</year>). &#x201C;<article-title>Computational thinking in finnish pre-service teacher education</article-title>,&#x201D; in <source><italic>Proceedings of the international conference on computational thinking education 2019</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Kong</surname> <given-names>S. C.</given-names></name> <name><surname>Andone</surname> <given-names>D.</given-names></name> <name><surname>Biswas</surname> <given-names>G.</given-names></name> <name><surname>Biswas</surname> <given-names>G.</given-names></name> <name><surname>Hoppe</surname> <given-names>H. U.</given-names></name> <name><surname>Hsu</surname> <given-names>T. C.</given-names></name><etal/></person-group> (<publisher-loc>Hong Kong</publisher-loc>: <publisher-name>The Education University of Hong Kong</publisher-name>), <fpage>105</fpage>&#x2013;<lpage>108</lpage>.</citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mannila</surname> <given-names>L.</given-names></name> <name><surname>Heintz</surname> <given-names>F.</given-names></name> <name><surname>Kj&#x00E4;llander</surname> <given-names>S.</given-names></name> <name><surname>&#x00C5;kerfeldt</surname> <given-names>A.</given-names></name></person-group> (<year>2020</year>). &#x201C;<article-title>Programming in primary education: Towards a reserch based assessment framework</article-title>,&#x201D; in <source><italic>Proceedings of the 15th workshop on primary and secondary computing education WiPSCE &#x2018;20</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Brinda</surname> <given-names>T.</given-names></name> <name><surname>Armoni</surname> <given-names>M.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>). <pub-id pub-id-type="doi">10.1145/3421590.3421598</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mason</surname> <given-names>S. L.</given-names></name> <name><surname>Rich</surname> <given-names>P. J.</given-names></name></person-group> (<year>2020</year>). <article-title>Development and analysis of the elementary student coding attitudes survey.</article-title> <source><italic>Comput. Educ.</italic></source> <volume>153</volume>:<issue>103898</issue>. <pub-id pub-id-type="doi">10.1016/j.compedu.2020.103898</pub-id></citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McAuley</surname> <given-names>E.</given-names></name> <name><surname>Duncan</surname> <given-names>T.</given-names></name> <name><surname>Tammen</surname> <given-names>V. V.</given-names></name></person-group> (<year>1987</year>). <article-title>Psychometric properties of the intrinsic motivation inventory in a competitive sport setting: A confirmatory factor analysis.</article-title> <source><italic>Res. Q. Exerc. Sport</italic></source> <volume>60</volume> <fpage>48</fpage>&#x2013;<lpage>58</lpage>.</citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mertala</surname> <given-names>P.</given-names></name></person-group> (<year>2021</year>). <article-title>The pedagogy of multiliteracies as a code breaker: A suggestion for a transversal approach to computing education in basic education.</article-title> <source><italic>Br. J. Educ. Technol.</italic></source> <volume>52</volume> <fpage>2227</fpage>&#x2013;<lpage>2241</lpage>. <pub-id pub-id-type="doi">10.1111/bjet.13125</pub-id></citation></ref>
<ref id="B43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moreno-Le&#x00F3;n</surname> <given-names>J.</given-names></name> <name><surname>Robles</surname> <given-names>G.</given-names></name> <name><surname>Rom&#x00E1;n-Gonz&#x00E1;lez</surname> <given-names>M.</given-names></name></person-group> (<year>2017</year>). <article-title>Towards data-driven learning paths to develop computational thinking with scratch.</article-title> <source><italic>IEEE Trans. Emerg. Top. Comput.</italic></source> <volume>8</volume> <fpage>193</fpage>&#x2013;<lpage>205</lpage>. <pub-id pub-id-type="doi">10.1109/TETC.2017.2734818</pub-id></citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>M&#x00FC;hling</surname> <given-names>A.</given-names></name> <name><surname>Hubwieser</surname> <given-names>P.</given-names></name> <name><surname>Brinda</surname> <given-names>T.</given-names></name></person-group> (<year>2010</year>). &#x201C;<article-title>Exploring teachers&#x2019; attitudes towards object oriented modelling and programming in secondary schools</article-title>,&#x201D; in <source><italic>Proceedings of the sixth international workshop on computing education research ICER&#x2019;10</italic></source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>59</fpage>&#x2013;<lpage>67</lpage>. <pub-id pub-id-type="doi">10.1145/1839594.1839606</pub-id></citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pea</surname> <given-names>R. D.</given-names></name> <name><surname>Soloway</surname> <given-names>E.</given-names></name> <name><surname>Sphorer</surname> <given-names>J. C.</given-names></name></person-group> (<year>1987</year>). <article-title>The buggy path to the development of programming expertise.</article-title> <source><italic>Focus Learn. Probl. Math.</italic></source> <volume>9</volume> <fpage>5</fpage>&#x2013;<lpage>30</lpage>.</citation></ref>
<ref id="B46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rich</surname> <given-names>P. J.</given-names></name> <name><surname>Mason</surname> <given-names>S. L.</given-names></name> <name><surname>O&#x2019;Leary</surname> <given-names>J.</given-names></name></person-group> (<year>2021</year>). <article-title>Measuring the effect of continuous professional development on elementary teachers&#x2019; self-efficacy to teach coding and computational thinking.</article-title> <source><italic>Comput. Educ.</italic></source> <volume>168</volume>:<issue>104196</issue>. <pub-id pub-id-type="doi">10.1016/j.compedu.2021.104196</pub-id></citation></ref>
<ref id="B47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rom&#x00E1;n-Gonz&#x00E1;lez</surname> <given-names>M.</given-names></name> <name><surname>P&#x00E9;rez-Gonz&#x00E1;lez</surname> <given-names>J.-C.</given-names></name> <name><surname>Jim&#x00E9;nez-Fern&#x00E1;ndez</surname> <given-names>C.</given-names></name></person-group> (<year>2017</year>). <article-title>Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test</article-title>. <source><italic>Comput. Hum. Behav.</italic></source> <volume>72</volume>, <fpage>678</fpage>&#x2013;<lpage>691</lpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2016.08.047</pub-id></citation></ref>
<ref id="B48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ruf</surname> <given-names>A.</given-names></name> <name><surname>M&#x00FC;hling</surname> <given-names>A.</given-names></name> <name><surname>Hubwieser</surname> <given-names>P.</given-names></name></person-group> (<year>2014</year>). &#x201C;<article-title>Scratch vs. karel &#x2013; impact on learning outcomes and motivation</article-title>,&#x201D; in <source><italic>Proceedings of the 9th workshop in primary and secondary computing education WiPSCE &#x2018;14</italic></source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>50</fpage>&#x2013;<lpage>59</lpage>. <pub-id pub-id-type="doi">10.1145/2670757.2670772</pub-id></citation></ref>
<ref id="B49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ryan</surname> <given-names>R. M.</given-names></name> <name><surname>Connell</surname> <given-names>J. P.</given-names></name></person-group> (<year>1989</year>). <article-title>Perceived locus of causality and internalization: Examining reasons for acting in two domains.</article-title> <source><italic>J. Pers. Soc. Psychol.</italic></source> <volume>57</volume> <fpage>749</fpage>&#x2013;<lpage>761</lpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.57.5.749</pub-id> <pub-id pub-id-type="pmid">2810024</pub-id></citation></ref>
<ref id="B50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ryan</surname> <given-names>R. M.</given-names></name> <name><surname>Deci</surname> <given-names>E. L.</given-names></name></person-group> (<year>2000</year>). <article-title>Darker and brighter sides of human existence: Basic psychological need a unifying concept.</article-title> <source><italic>Psychol. Inq.</italic></source> <volume>11</volume> <fpage>319</fpage>&#x2013;<lpage>338</lpage>.</citation></ref>
<ref id="B51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ryan</surname> <given-names>R. M.</given-names></name> <name><surname>Deci</surname> <given-names>E. L.</given-names></name></person-group> (<year>2017</year>). <source><italic>Self-determination theory: Basic psychological needs in motivation, development, and wellness.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Guilford Press</publisher-name>.</citation></ref>
<ref id="B52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saqr</surname> <given-names>M.</given-names></name> <name><surname>Ng</surname> <given-names>K.</given-names></name> <name><surname>Oyelere</surname> <given-names>S. S.</given-names></name> <name><surname>Tedre</surname> <given-names>M.</given-names></name></person-group> (<year>2021</year>). <article-title>People, ideas, milestones: A scientometric study of computational thinking.</article-title> <source><italic>ACM Trans. Comput. Educ.</italic></source> <volume>21</volume> <fpage>1</fpage>&#x2013;<lpage>17</lpage>. <pub-id pub-id-type="doi">10.1145/3445984</pub-id></citation></ref>
<ref id="B53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sentance</surname> <given-names>S.</given-names></name> <name><surname>Waite</surname> <given-names>J.</given-names></name> <name><surname>Kallia</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). &#x201C;<article-title>Teachers&#x2019; experiences of using PRIMM to teach programming in school</article-title>,&#x201D; in <source><italic>Proceedings of the 50th ACM technical symposium on computer science education SIGCSE &#x2018;19</italic></source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>476</fpage>&#x2013;<lpage>482</lpage>. <pub-id pub-id-type="doi">10.1145/3287324.3287477</pub-id></citation></ref>
<ref id="B54"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Settle</surname> <given-names>A.</given-names></name> <name><surname>Perkovi&#x0107;</surname> <given-names>L.</given-names></name></person-group> (<year>2010</year>). <source><italic>Computational thinking across the curriculum: A conceptual framework</italic>.</source> <article-title>Technical Reports, Paper 13</article-title>. <publisher-loc>Chicago, IL</publisher-loc>: <publisher-name>DePaul University</publisher-name>.</citation></ref>
<ref id="B55"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sharma</surname> <given-names>K.</given-names></name> <name><surname>Papavlasopoulou</surname> <given-names>S.</given-names></name> <name><surname>Giannakos</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <article-title>Coding games and robots to enhance computational thinking: How collaboration and engagement moderate children&#x2019;s attitudes?</article-title> <source><italic>Int. J. Child Comput. Interact.</italic></source> <volume>21</volume> <fpage>65</fpage>&#x2013;<lpage>76</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijcci.2019.04.004</pub-id></citation></ref>
<ref id="B56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sheldon</surname> <given-names>K. M.</given-names></name> <name><surname>Elliot</surname> <given-names>A. J.</given-names></name></person-group> (<year>1998</year>). <article-title>Not all personal goals are personal: Comparing autonomous and controlled reasons for goals as predictors of effort and attainment.</article-title> <source><italic>Pers. Soc. Psychol. Bull.</italic></source> <volume>24</volume>:<issue>546</issue>.</citation></ref>
<ref id="B57"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shute</surname> <given-names>V. J.</given-names></name> <name><surname>Sun</surname> <given-names>C.</given-names></name> <name><surname>Asbell-Clarke</surname> <given-names>J.</given-names></name></person-group> (<year>2017</year>). <article-title>Demystifying computational thinking.</article-title> <source><italic>Educ. Res. Rev.</italic></source> <volume>22</volume> <fpage>142</fpage>&#x2013;<lpage>158</lpage>. <pub-id pub-id-type="doi">10.1016/j.edurev.2017.09.003</pub-id></citation></ref>
<ref id="B58"><citation citation-type="journal"><collab>Statistics Finland</collab> (<year>2022</year>). <source><italic>NUTS division.</italic></source> <comment>Available online at:</comment> <ext-link ext-link-type="uri" xlink:href="https://www.stat.fi/meta/kas/nuts_aluejako_en.html">https://www.stat.fi/meta/kas/nuts_aluejako_en.html</ext-link> <comment>(accessed April 19, 2022)</comment>.</citation></ref>
<ref id="B59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Strietholt</surname> <given-names>R.</given-names></name> <name><surname>Fraillon</surname> <given-names>J.</given-names></name> <name><surname>Liaw</surname> <given-names>Y.</given-names></name> <name><surname>Meinck</surname> <given-names>S.</given-names></name> <name><surname>Wild</surname> <given-names>J.</given-names></name></person-group> (<year>2021</year>). <source><italic>Changes in digital learning during a pandemic &#x2013; findings from the ICILS teacher panel.</italic></source> <publisher-loc>Amsterdam</publisher-loc>: <publisher-name>IEA</publisher-name>.</citation></ref>
<ref id="B60"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sun</surname> <given-names>L.</given-names></name> <name><surname>Hu</surname> <given-names>L.</given-names></name> <name><surname>Zhou</surname> <given-names>D.</given-names></name></person-group> (<year>2022</year>). <article-title>Programming attitudes predict computational thinking: Analysis of differences in gender and programming experience.</article-title> <source><italic>Comput. Educ.</italic></source> <volume>181</volume>:<issue>104457</issue>. <pub-id pub-id-type="doi">10.1016/j.compedu.2022.104457</pub-id></citation></ref>
<ref id="B61"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tang</surname> <given-names>X.</given-names></name> <name><surname>Yin</surname> <given-names>Y.</given-names></name> <name><surname>Lin</surname> <given-names>Q.</given-names></name> <name><surname>Hadad</surname> <given-names>R.</given-names></name> <name><surname>Zhai</surname> <given-names>X.</given-names></name></person-group> (<year>2020</year>). <article-title>Assessing computational thinking: A systematic review of empirical studies.</article-title> <source><italic>Comput. Educ.</italic></source> <volume>148</volume>:<issue>103798</issue>. <pub-id pub-id-type="doi">10.1016/j.compedu.2019.103798</pub-id></citation></ref>
<ref id="B62"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Taub</surname> <given-names>R.</given-names></name> <name><surname>Armoni</surname> <given-names>M.</given-names></name> <name><surname>Ben-Ari</surname> <given-names>M.</given-names></name></person-group> (<year>2012</year>). <article-title>CS unplugged and middle-school students&#x2019; views, attitudes, and intentions regarding CS</article-title>. <source><italic>ACM Trans. Comput. Educ.</italic></source> <volume>12</volume>:<fpage>2</fpage>. <pub-id pub-id-type="doi">10.1145/2160547.2160551</pub-id></citation></ref>
<ref id="B63"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tedre</surname> <given-names>M.</given-names></name> <name><surname>Denning</surname> <given-names>P.</given-names></name></person-group> (<year>2016</year>). &#x201C;<article-title>The long quest for computational thinking</article-title>,&#x201D; in <source><italic>Proceedings of the 16th koli calling international conference on computing education research</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Sheard</surname> <given-names>J.</given-names></name> <name><surname>Suero Montero</surname> <given-names>C.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>120</fpage>&#x2013;<lpage>129</lpage>. <pub-id pub-id-type="doi">10.1145/2999541.2999542</pub-id></citation></ref>
<ref id="B64"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tisza</surname> <given-names>G.</given-names></name> <name><surname>Markopoulos</surname> <given-names>P.</given-names></name></person-group> (<year>2021</year>). <article-title>Understanding the role of fun in learning to code.</article-title> <source><italic>Int. J. Child Comput. Interact.</italic></source> <volume>28</volume>:<issue>100270</issue>. <pub-id pub-id-type="doi">10.1016/j.ijcci.2021.100270</pub-id></citation></ref>
<ref id="B65"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vainikainen</surname> <given-names>M.-P.</given-names></name> <name><surname>Oinas</surname> <given-names>S.</given-names></name> <name><surname>Koivuhovi</surname> <given-names>S.</given-names></name> <name><surname>Polso</surname> <given-names>K.-M.</given-names></name> <name><surname>Leinonen</surname> <given-names>J.</given-names></name> <name><surname>Nazeri</surname> <given-names>F.</given-names></name><etal/></person-group> (<year>2022</year>). <source><italic>DigiVOO-tutkimushankkeen v&#x00E4;liraportti [DigiVOO research project interim report].</italic></source> <publisher-loc>Tampere</publisher-loc>: <publisher-name>University of Tampere and University of Helsinki</publisher-name>.</citation></ref>
<ref id="B66"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vartiainen</surname> <given-names>H.</given-names></name> <name><surname>Tedre</surname> <given-names>M.</given-names></name> <name><surname>Valtonen</surname> <given-names>T.</given-names></name></person-group> (<year>2020</year>). <article-title>Learning machine learning with very young children: Who is teaching whom?</article-title> <source><italic>Int. J. Child Comput. Interact.</italic></source> <volume>25</volume>:<issue>100182</issue>. <pub-id pub-id-type="doi">10.1016/j.ijcci.2020.100182</pub-id></citation></ref>
<ref id="B67"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vasalampi</surname> <given-names>K.</given-names></name> <name><surname>Nurmi</surname> <given-names>J.-E.</given-names></name> <name><surname>Jokisaari</surname> <given-names>M.</given-names></name> <name><surname>Salmela-Aro</surname> <given-names>K.</given-names></name></person-group> (<year>2012</year>). <article-title>The role of goal-related autonomous motivation, effort and progress in the transition to university.</article-title> <source><italic>Eur. J. Psychol. Educ.</italic></source> <volume>27</volume> <fpage>591</fpage>&#x2013;<lpage>604</lpage>.</citation></ref>
<ref id="B68"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Waite</surname> <given-names>J.</given-names></name> <name><surname>Curzon</surname> <given-names>P.</given-names></name> <name><surname>Marsh</surname> <given-names>W.</given-names></name> <name><surname>Sentence</surname> <given-names>S.</given-names></name></person-group> (<year>2020</year>). <article-title>Difficulties with design: The challenges of teaching design in K-5 programming.</article-title> <source><italic>Comput. Educ.</italic></source> <volume>150</volume>:<issue>103838</issue>. <pub-id pub-id-type="doi">10.1016/j.compedu.2020.103838</pub-id></citation></ref>
<ref id="B69"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Weintrop</surname> <given-names>D.</given-names></name> <name><surname>Coenraad</surname> <given-names>M.</given-names></name> <name><surname>Palmer</surname> <given-names>J.</given-names></name> <name><surname>Franklin</surname> <given-names>D.</given-names></name></person-group> (<year>2019</year>). <article-title>The teacher accessibility, equity, and content (TEC) rubric for evaluating computing curricula.</article-title> <source><italic>ACM Trans. Comput. Educ.</italic></source> <volume>20</volume>:<issue>5</issue>. <pub-id pub-id-type="doi">10.1145/3371155</pub-id></citation></ref>
<ref id="B70"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wing</surname> <given-names>J. M.</given-names></name></person-group> (<year>2006</year>). <article-title>Computational thinking.</article-title> <source><italic>Commun. ACM</italic></source> <volume>49</volume> <fpage>33</fpage>&#x2013;<lpage>35</lpage>. <pub-id pub-id-type="doi">10.1145/1118178.1118215</pub-id></citation></ref>
<ref id="B71"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wing</surname> <given-names>J. M.</given-names></name></person-group> (<year>2011</year>). <source><italic>A definition of computational thinking from Jeannette Wing. Computing educational research blog.</italic></source> <comment>Available online at:</comment> <ext-link ext-link-type="uri" xlink:href="https://computinged.wordpress.com/2011/03/22/a-definition-of-computational-thinking-from-jeanette-wing/">https://computinged.wordpress.com/2011/03/22/a-definition-of-computational-thinking-from-jeanette-wing/</ext-link> <comment>(accessed April 28, 2022)</comment>.</citation></ref>
<ref id="B72"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yukselturk</surname> <given-names>E.</given-names></name> <name><surname>Altiok</surname> <given-names>S.</given-names></name></person-group> (<year>2017</year>). <article-title>An investigation of the effects of programming with scratch on the preservice IT teachers&#x2019; self-efficacy perceptions and attitudes towards computer programming.</article-title> <source><italic>Br. J. Educ. Technol.</italic></source> <volume>48</volume> <fpage>789</fpage>&#x2013;<lpage>801</lpage>. <pub-id pub-id-type="doi">10.1111/bjet.12453</pub-id></citation></ref>
</ref-list>
</back>
</article>