<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.3" xml:lang="en">
<front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">LRE</journal-id>
      <journal-title-group>
        <journal-title>London Review of Education</journal-title>
        <abbrev-journal-title abbrev-type="publisher">Lond. Rev. Educ.</abbrev-journal-title>
      </journal-title-group>
      <issn pub-type="epub">1474-8479</issn>
      <publisher>
        <publisher-name>UCL Press</publisher-name>
      </publisher>
      </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.14324/LRE.22.1.11</article-id>
      <article-id pub-id-type="publisher-id">LRE-22-11</article-id>
      <article-categories>
        <subj-group>
          <subject>Research article</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Developing teachers&#x2019; cultural competencies through co-design of robot-coding mathematics activities for Latinx and Black elementary school students</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid" authenticated="true">https://orcid.org/0000-0002-2143-5076</contrib-id>
          <name>
            <surname>Lyublinskaya</surname>
            <given-names>Irina</given-names>
          </name>
          <xref rid="af1-LRE-22-11" ref-type="aff">1</xref>
          <xref rid="c1-LRE-22-11" ref-type="corresp">*</xref>
        </contrib>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid" authenticated="true">https://orcid.org/0000-0002-1808-309X</contrib-id>
          <name>
            <surname>Okita</surname>
            <given-names>Sandra</given-names>
          </name>
          <xref rid="af1-LRE-22-11" ref-type="aff">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Walker</surname>
            <given-names>Erica</given-names>
          </name>
          <xref rid="af2-LRE-22-11" ref-type="aff">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid" authenticated="true">https://orcid.org/0000-0003-4860-5124</contrib-id>
          <name>
            <surname>Yan</surname>
            <given-names>Xiaoheng (Kitty)</given-names>
          </name>
          <xref rid="af2-LRE-22-11" ref-type="aff">2</xref>
        </contrib>
      </contrib-group>
      <aff id="af1-LRE-22-11"><label>1</label>Teachers College, Columbia University, New York, USA</aff>
      <aff id="af2-LRE-22-11"><label>2</label>Ontario Institute for Studies in Education, University of Toronto, Toronto, Canada</aff>
      <author-notes>
        <corresp id="c1-LRE-22-11"><label>*</label>Correspondence: <email>il2369@tc.columbia.edu</email></corresp>
      </author-notes>
	  <pub-date publication-format="electronic" date-type="pub" iso-8601-date="2024-04-10">
        <day>10</day>
        <month>04</month>
        <year>2024</year>
		</pub-date>
      <volume>22</volume>
      <issue>1</issue>
      <elocation-id>11</elocation-id>
      <history>
        <date date-type="received">
          <day>18</day>
          <month>09</month>
          <year>2023</year>
        </date>
        <date date-type="accepted">
          <day>28</day>
          <month>02</month>
          <year>2024</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>2024, Irina Lyublinskaya, Sandra Okita, Erica Walker and Xiaoheng (Kitty) Yan.</copyright-statement>
        <copyright-year>2024</copyright-year>
        <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
          <license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution Licence (CC BY) 4.0 <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</ext-link>, which permits unrestricted use, distribution and reproduction in any medium, provided the original author and source are credited &#x2022; DOI: <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.14324/LRE.22.1.11">https://doi.org/10.14324/LRE.22.1.11</ext-link>.</license-p>
        </license>
      </permissions>
      <abstract>
        <p>This year-long case study involved the professional development of teachers in New York City elementary schools, who co-designed with researchers culturally relevant robot-coding mathematics activities to advance teachers&#x2019; understanding of culturally responsive mathematics pedagogy. Study findings indicated that co-designing culturally relevant robot-coding mathematics activities led to the development of teachers&#x2019; cultural competencies, deeper understanding of culturally responsive mathematics pedagogy and their students&#x2019; cultures, stronger agency, and ability to integrate culturally responsive pedagogy into their mathematics curriculum. Teachers also began to perceive the robot as a mathematical tool rather than a motivational add-on, and started to develop their own cultural lens while focusing less on school structure constraints. The study emphasises the importance of engaging teachers as active co-designers of culturally relevant coding curriculum in professional development programmes.</p>
      </abstract>
      <kwd-group>
        <kwd>culturally responsive mathematics pedagogy</kwd>
        <kwd>cultural competency</kwd>
        <kwd>design thinking</kwd>
        <kwd>elementary school mathematics</kwd>
        <kwd>robot coding</kwd>
        <kwd>professional development</kwd>
      </kwd-group>
      <funding-group>
        <award-group>
          <funding-source>National Science Foundation</funding-source>
          <award-id>2147699</award-id>
        </award-group>
        <funding-statement>This study was funded by the National Science Foundation, award ID 2147699.</funding-statement>
      </funding-group>
      <counts>
        <page-count count="14"/>
      </counts>
      <custom-meta-group>
        <custom-meta>
          <meta-name>How to cite</meta-name>
          <meta-value>Lyublinskaya, I., Okita, S., Walker, E. and Yan, X. (2024) &#x2018;Developing teachers&#x2019; cultural competencies through co-design of robot-coding mathematics activities for Latinx and Black elementary school students&#x2019;. <italic>London Review of Education</italic>, 22 (1), 11. DOI: <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.14324/LRE.22.1.11">https://doi.org/10.14324/LRE.22.1.11</ext-link>.</meta-value>
        </custom-meta>
      </custom-meta-group>
    </article-meta>
  </front>
  <body>
    <sec sec-type="intro">
      <title>Introduction</title>
      <p>Research shows that students&#x2019; mathematics knowledge is tied to their cultural practices, and that students perform better on tasks that are linked to their everyday experiences (<xref ref-type="bibr" rid="B32-LRE-22-11">Thanheiser and Koestler, 2021</xref>). In American schools, mathematics tasks are often placed in a real-world context that White, middle-class students are familiar with, but racial and ethnic minority students may not be (<xref ref-type="bibr" rid="B33-LRE-22-11">Tilleczek and MacDonald, 2022</xref>). The lack of connection between school mathematics and student everyday lives diminishes student interest in mathematics as early as in upper elementary grades (<xref ref-type="bibr" rid="B28-LRE-22-11">Putwain et al., 2018</xref>). This has an even larger impact on students from sociocultural groups who on average lag behind their peers (<xref ref-type="bibr" rid="B8-LRE-22-11">Edwards and Parada, 2022</xref>). </p>
      <p>Schools need teachers who are aware of students&#x2019; cultural norms and experiences in order to influence their learning. However, the notion of culturally responsive teaching does not always resonate with teachers, and when it does, they do not know how to teach their subjects from that pedagogical stance (<xref ref-type="bibr" rid="B15-LRE-22-11">Ladson-Billings, 2000</xref>). Culturally relevant pedagogy could address these areas of concern. However, few tools are available to explicitly support teachers&#x2019; development of culturally relevant pedagogy competencies within their daily planning and implementing of mathematics lessons (<xref ref-type="bibr" rid="B18-LRE-22-11">Mark and Id-Deen, 2022</xref>). </p>
      <p>There is increasing recognition in relation to the K&#x2013;12 new standards in New York (<xref ref-type="bibr" rid="B25-LRE-22-11">NYSED, 2020</xref>) that introducing robot coding to children as early as kindergarten is desirable in developing students&#x2019; computational thinking and digital fluency (<xref ref-type="bibr" rid="B2-LRE-22-11">Angeli and Valanides, 2019</xref>). Integrating robot coding into mathematics instruction in elementary school can help make this subject more engaging and relevant to students (<xref ref-type="bibr" rid="B36-LRE-22-11">Zhang et al., 2021</xref>). Supporting teachers in combining coding with culturally relevant pedagogy into standards-based mathematics classrooms has potential to improve students&#x2019; content knowledge and attitudes towards mathematics. Such integrations are challenging, and they require professional development that engages teachers as co-designers to develop their knowledge, skills, confidence and sense of ownership (<xref ref-type="bibr" rid="B12-LRE-22-11">Kelter et al., 2021</xref>; <xref ref-type="bibr" rid="B27-LRE-22-11">Potvin et al., 2023</xref>). However, there are very few studies, if any, that examine how involving teachers in the co-design of culturally relevant robot-coding mathematics activities might influence their cultural competency. </p>
      <p>To address this challenge, we developed a professional development programme that engaged teachers in co-designing (with researchers) robot-coding mathematics activities, linked to everyday interests and culturally informed prior knowledge of Black and Latinx students in urban elementary classrooms. In this article, we report findings related to the influence of this professional development programme on teachers&#x2019; cultural competencies in mathematics pedagogy. </p>
    </sec>
    <sec>
      <title>Background</title>
      <p>Traditional approaches to teaching mathematics have been solely objective and culturally neutral (<xref ref-type="bibr" rid="B19-LRE-22-11">Matthews and L&#xF3;pez, 2019</xref>). The majority of mathematics teachers today continue to provide instruction that discounts students&#x2019; cultural and linguistic strengths and to exclude diverse students in their learning process (<xref ref-type="bibr" rid="B6-LRE-22-11">Celed&#xF3;n-Pattichis et al., 2018</xref>). Mathematics teachers&#x2019; cultural awareness impacts their perspectives on students&#x2019; mathematical abilities, as well as their approach to instruction (<xref ref-type="bibr" rid="B34-LRE-22-11">Walker, 2012</xref>). There is a demand for culturally competent teachers who develop sociocultural contexts for teaching and learning mathematics that can maximise student learning potential (<xref ref-type="bibr" rid="B1-LRE-22-11">Abdulrahim and Orosco, 2020</xref>).</p>
      <p>Teachers need professional development opportunities to develop their own cultural competence and to recognise that mathematics education does not occur in isolation of sociocultural context (<xref ref-type="bibr" rid="B23-LRE-22-11">Nasir et al., 2008</xref>). Culturally competent mathematics teachers can bridge the divide between home and school with culturally responsive mathematics teaching practices that provide an instructional context for students that is supportive, engaging and challenging (<xref ref-type="bibr" rid="B1-LRE-22-11">Abdulrahim and Orosco, 2020</xref>). They can capitalise on students&#x2019; cultural and linguistic knowledge and use these strengths as a platform to foster higher-level thinking skills (<xref ref-type="bibr" rid="B9-LRE-22-11">Gay, 2018</xref>). They can foster student engagement and agency by creating a learning context that responds to students&#x2019; social, emotional and cognitive needs (<xref ref-type="bibr" rid="B10-LRE-22-11">Hammond, 2015</xref>). Culturally competent mathematics teachers can also provide mathematics instruction that challenges students to think critically and prepare them to use mathematics as an analytical tool (<xref ref-type="bibr" rid="B35-LRE-22-11">Williams et al., 2016</xref>). Mathematics education researchers define culturally responsive mathematics pedagogy (CRMP) to include three components: (1) developing critical mathematics thinking; (2) building on students&#x2019; informal mathematics knowledge, and cultural and experiential knowledge; and (3) orienting to students&#x2019; culture and experience (<xref ref-type="bibr" rid="B3-LRE-22-11">Averill et al., 2009</xref>). Integrating these elements of CRMP into teaching requires appropriate disposition, knowledge and skills. </p>
    </sec>
    <sec>
      <title>Theoretical framework</title>
      <p>Our study is framed by sociocultural theories of learning that define learning as experiential, situated and contextual. Mathematics knowledge in the situated perspective is understood as being co-constituted in a community within a context. It is the community and context in which the student learns mathematics that significantly impacts how the student uses and understands mathematics (<xref ref-type="bibr" rid="B4-LRE-22-11">Boaler, 2000</xref>). In this project, teachers co-designed a supplementary mathematics curriculum titled &#x2018;Birds and Bots: B-squared&#x2019;, situated in a culturally relevant problem-based learning environment. Our project therefore provided teachers with participatory learning experiences through the lens of two frameworks: culturally relevant pedagogy and design thinking (<xref ref-type="bibr" rid="B29-LRE-22-11">Rinke et al., 2016</xref>). </p>
      <sec>
        <title>Culturally relevant pedagogy framework</title>
        <p>Incorporating culturally relevant pedagogy in mathematics classrooms can be a challenge for teachers (<xref ref-type="bibr" rid="B16-LRE-22-11">Leonard, 2018</xref>). <xref ref-type="bibr" rid="B14-LRE-22-11">Ladson-Billings</xref>&#x2019;s (<xref ref-type="bibr" rid="B14-LRE-22-11">1995: 483</xref>) seminal work with elementary teachers led to the conception of a culturally relevant pedagogy as teachers&#x2019; &#x2018;ability to develop students academically, ... willingness to nurture and support cultural competence, and ... development of a sociopolitical or critical consciousness&#x2019;. Furthermore, the culturally responsive-sustaining education framework (<xref ref-type="bibr" rid="B24-LRE-22-11">NYSED, 2018</xref>) suggests four key themes for teachers to consider when developing their instructional activities: welcoming and affirming environment; high expectations and rigorous instruction; inclusive curriculum and assessment; and ongoing professional learning and support (<xref ref-type="bibr" rid="B24-LRE-22-11">NYSED, 2018</xref>). </p>
        <p>Specific to mathematics, culturally relevant pedagogy provides a powerful nexus between students&#x2019; sociocultural experiences (found critical to learning and development) and classroom instruction, thus contributing to students&#x2019; mathematics cognition (<xref ref-type="bibr" rid="B1-LRE-22-11">Abdulrahim and Orosco, 2020</xref>; <xref ref-type="bibr" rid="B16-LRE-22-11">Leonard, 2018</xref>). Providing students with a cultural frame of reference during mathematics teaching and learning enables them to bridge academic content with their family and community experiences to enhance their mathematical development.</p>
        <p>Based on the work of Ladson-Billings and others, <xref ref-type="bibr" rid="B20-LRE-22-11">Matthews et al.</xref> (<xref ref-type="bibr" rid="B20-LRE-22-11">2022a</xref>) have developed a culturally relevant mathematics task-building framework to explore the core concepts of demand, relevance and agency (<xref ref-type="fig" rid="LRE-22-11-f001">Figure 1</xref>).</p>
		<fig id="LRE-22-11-f001" position="anchor">
        <label>Figure 1</label>
        <caption>
          <p><bold>Culturally relevant</bold>&#xA0;<bold>mathematics task-building actions (Source: <xref ref-type="bibr" rid="B21-LRE-22-11">Matthews et al., 2022b</xref>)</bold></p>
        </caption>
        <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="image001.png"/>
      </fig>
        <p>These concepts, with their attention to meaningful and rigorous mathematics, aligned with the goals of our project and informed our work building authentic tasks to enhance student learning. <italic>Demand</italic> centres on the importance of building deep conceptual knowledge, and further entreats students to do mathematics and construct mathematical knowledge. <italic>Relevance</italic> is meant to &#x2018;centre community and cultural inquiry&#x2019; (<xref ref-type="bibr" rid="B20-LRE-22-11">Matthews et al., 2022a: 41</xref>), in particular, affirming and exploring students&#x2019; cultural knowledge and identities. <italic>Agency</italic> incorporates the concepts of empathy and social action. Tasks that incorporate this dimension push students to consider needs and issues of their community, both narrowly and broadly, and to respond with &#x2018;empathy, critical consciousness, and social action&#x2019; (<xref ref-type="bibr" rid="B20-LRE-22-11">Matthews et al., 2022a: 41</xref>), all within mathematical contexts.</p>
      </sec>
      <sec>
        <title>Design thinking framework</title>
        <p>Design thinking is a dynamic problem-solving framework that can empower educators to develop engaging and effective curricula (<xref ref-type="bibr" rid="B5-LRE-22-11">Brown, 2008</xref>). In educational contexts, design thinking emerges out of social processes and involves creation of knowledge. While various schemes have been proposed for the design-thinking process, <xref ref-type="bibr" rid="B31-LRE-22-11">Summerville and Reid-Griffin</xref> (<xref ref-type="bibr" rid="B31-LRE-22-11">2008</xref>) suggest that design thinking should be treated as a process in which social exchanges move ideas back and forth until these ideas are fully accepted by the team. Furthermore, according to <xref ref-type="bibr" rid="B13-LRE-22-11">Koh et al.</xref> (<xref ref-type="bibr" rid="B13-LRE-22-11">2015</xref>), design thinking can be used for teacher development. Through teachers&#x2019; involvement in the design process, they can deepen their understanding of new and existing technologies and pedagogies, and enhance their understanding of the content they are teaching (<xref ref-type="bibr" rid="B17-LRE-22-11">Lyublinskaya and Tournaki, 2012</xref>). </p>
        <p>Acknowledging the importance of culturally relevant pedagogy and teacher involvement in curriculum design, and noting that these elements are often missing from teachers&#x2019; professional development experiences, we placed the co-design of culturally relevant robot-coding mathematics activities at the centre of our teacher professional development programme.</p>
      </sec>
    </sec>
    <sec sec-type="methods">
      <title>Methods</title>
      <p>This case study explored the influence of the professional development programme on teachers&#x2019; cultural competencies, and it was guided by the following research questions:<list list-type="order">
        <list-item>
          <p>How does co-designing culturally relevant robot-coding activities influence teachers&#x2019; perceptions of and competencies in CRMP?</p>
        </list-item>
        <list-item>
          <p>What core concepts of CRMP, that is, demand, relevance and agency, are demonstrated by teachers in the robot-coding activities they co-designed with researchers?</p>
        </list-item>
      </list></p>
      <sec>
        <title>Context of the study</title>
        <p>This study was completed in 2022/3 as part of a larger four-year project. Case study teachers and researchers each took the lead in designing 25 activities, totalling 50 B-squared robot-coding mathematics activities that included culturally relevant scenarios. A culturally relevant context was selected for each curriculum topic, and all scenarios for that topic were designed within that context (<xref ref-type="table" rid="LRE-22-11-t001">Table 1</xref>). </p>
		    <table-wrap id="LRE-22-11-t001" position="anchor">
        <object-id pub-id-type="pii">LRE-22-11-t001_Table 1</object-id>
        <label>Table 1</label>
        <caption>
          <p><bold>Curriculum</bold>&#xA0;<bold>topics and corresponding culturally relevant contexts</bold></p>
        </caption>
        <table>
          <thead>
            <tr>
              <th align="left" valign="middle" style="border-top:solid thin;border-bottom:solid thin">Curriculum instructional unit</th>
              <th align="left" valign="middle" style="border-top:solid thin;border-bottom:solid thin">Mathematics topic</th>
              <th align="left" valign="middle" style="border-top:solid thin;border-bottom:solid thin">Culturally relevant context</th>
              <th align="left" valign="middle" style="border-top:solid thin;border-bottom:solid thin">Number of activities</th>
            </tr>
          </thead>
          <tbody>
            <tr>
              <td rowspan="3" align="left" valign="top" style="border-bottom:solid thin">Place value and problem-solving with units of measure</td>
              <td align="left" valign="top">Rounding to the nearest ten and hundred</td>
              <td align="left" valign="top">All About Me!</td>
              <td align="left" valign="top">3</td>
            </tr>
            <tr>
              <td align="left" valign="top">Two- and three-digit measurement addition using the standard algorithm</td>
              <td align="left" valign="top">Fundraising</td>
              <td align="left" valign="top">3</td>
            </tr>
            <tr>
              <td align="left" valign="top" style="border-bottom:solid thin">Two- and three-digit measurement subtraction using the standard algorithm</td>
              <td align="left" valign="top" style="border-bottom:solid thin">Zoo Field Trip</td>
              <td align="left" valign="top" style="border-bottom:solid thin">4</td>
            </tr>
            <tr>
              <td rowspan="4" align="left" valign="top" style="border-bottom:solid thin">Multiplication and area</td>
              <td align="left" valign="top">Foundations for understanding area</td>
              <td align="left" valign="top">My Block</td>
              <td align="left" valign="top">4*</td>
            </tr>
            <tr>
              <td align="left" valign="top">Concepts of area measurement</td>
              <td align="left" valign="top">Playground Architects</td>
              <td align="left" valign="top">4*</td>
            </tr>
            <tr>
              <td align="left" valign="top">Arithmetic properties using area models</td>
              <td align="left" valign="top">Our Lego Apartment</td>
              <td align="left" valign="top">4*</td>
            </tr>
            <tr>
              <td align="left" valign="top" style="border-bottom:solid thin">Applications of area using side lengths of figures</td>
              <td align="left" valign="top" style="border-bottom:solid thin">Pok&#xE9;mon!</td>
              <td align="left" valign="top" style="border-bottom:solid thin">5*</td>
            </tr>
            <tr>
              <td rowspan="5" align="left" valign="top" style="border-bottom:solid thin">Geometry and measurement word problems</td>
              <td align="left" valign="top">Solving word problems</td>
              <td align="left" valign="top">The Brooklyn Public Library</td>
              <td align="left" valign="top">3</td>
            </tr>
            <tr>
              <td align="left" valign="top">Attributes of two-dimensional figures</td>
              <td align="left" valign="top">Take Out!</td>
              <td align="left" valign="top">6</td>
            </tr>
            <tr>
              <td align="left" valign="top">Problem-solving with perimeter</td>
              <td align="left" valign="top">Cultural Art Projects</td>
              <td align="left" valign="top">2*<break/>3</td>
            </tr>
            <tr>
              <td align="left" valign="top">Recording perimeter and area data on line plots</td>
              <td align="left" valign="top">Minecraft</td>
              <td align="left" valign="top">5*</td>
            </tr>
            <tr>
              <td align="left" valign="top" style="border-bottom:solid thin">Problem-solving with perimeter and area</td>
              <td align="left" valign="top" style="border-bottom:solid thin">Roblox</td>
              <td align="left" valign="top" style="border-bottom:solid thin">1*<break/>3</td>
            </tr>
          </tbody>
        </table>
       <table-wrap-foot>
          <fn>
            <p>* <italic>Activities that were led by the teacher team.</italic></p>
          </fn>
        </table-wrap-foot>
      </table-wrap>
        <p>All activities used BirdBrain Technologies&#x2019; (<uri>https://www.birdbraintechnologies.com/</uri>) small wireless Finch Robot 2.0 (<xref ref-type="bibr" rid="B11-LRE-22-11">Heiner, 2018</xref>; <xref ref-type="bibr" rid="B26-LRE-22-11">Okita, 2014</xref>). The robot is compatible with multiple devices used in today&#x2019;s classrooms. It has unique characteristics that make it age-appropriate for use in elementary mathematics classrooms: <list list-type="bullet">
          <list-item>
            <p>The FinchBlox, a native coding app, is an icon-based programming environment allowing active engagement of students who are not yet fluent readers.</p>
          </list-item>
          <list-item>
            <p>The built-in sensors enable students to measure distances and determine the robot&#x2019;s orientation.</p>
          </list-item>
          <list-item>
            <p>The built-in buzzer and LEDs enable sound and light effects as ways of self-assessment and immediate feedback on completion of particular mathematics tasks.</p>
          </list-item>
          <list-item>
            <p>The line tracking, precise movement, compass and pen mount allow the robot to draw straight and curved lines given specific measurements.</p>
          </list-item>
        </list></p>
      </sec>
      <sec>
        <title>Overview of the professional development programme</title>
        <p>The professional development programme included a three-day summer retreat and co-design workshops conducted during the school year. In total, teachers participated in 18 hours of in-person professional development during the summer, and 18 hours of in-person and 15 hours of online professional development during the school year. In the summer, teachers were introduced to robot coding (<xref ref-type="fig" rid="LRE-22-11-f002">Figure 2</xref>) and CRMP.</p>
		<fig id="LRE-22-11-f002" position="anchor">
        <label>Figure 2</label>
        <caption>
          <p><bold>Teachers learning</bold>&#xA0;<bold>robot coding to draw plane shapes</bold></p>
        </caption>
        <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="image002.png"/>
      </fig>
        <p>The summer workshops were led by faculty experts in mathematics education, educational technology, urban and minority education, and CRMP, as well as by professional staff &#x2013; experts in curriculum development and robotics. During this time, teachers selected instructional units for supplementing the standards-based mathematics curriculum with robot-coding culturally relevant activities. During the autumn professional development, teachers explored how mathematics activities might incorporate culturally relevant pedagogy principles and robot coding. During the spring professional development, teachers in collaboration with the project team co-designed activities for the selected instructional units. </p>
        <p>This work focused on: (1) following curriculum requirements; (2) developing culturally relevant context for the tasks; and (3) outlining ideas for the use of Finch for each task. Each activity went through a process of revision that included deepening cultural connections, expanding initial closed-ended problems to more open explorations, and making more explicit connections between the mathematics topic and the use of Finch. For example, for the <italic>Playground Architects</italic> theme, teachers developed four activities that focused on area measurements. In the <italic>Sandbox</italic> activity, students were asked to design a new school playground, and they had to figure out the possible widths and lengths of a rectangle of a given area. The <italic>Basketball Court</italic> activity asked students to divide the schoolyard of a given area in order to donate some space for a community basketball court. The <italic>Slides</italic> activity asked students to consider possible designs of slides for big kids and toddlers, given the areas that these slides could occupy in the park. In the <italic>Jungle Gym</italic> activity, students designed a playground that is wheelchair accessible. In all these activities, they coded Finch to draw their designs on square grid mats to check the area. The coding elements included movement and right-turn blocks, as well as the repeat blocks that enabled students to represent measurements using the concept of place value of two-digit numbers.</p>
      </sec>
      <sec sec-type="subjects">
        <title>Participants</title>
        <p>Twelve teachers who taught in Integrated Co-Teaching (ICT) classrooms in two New York City Title I public schools participated in the project. (A Title I school is a school with large concentrations of low-income students receiving supplemental federal funds to assist in meeting students&#x2019; educational goals.) In ICT classrooms a general education teacher and a special education teacher jointly provide instruction to a class that has students with and without disabilities. Due to the high turnover rate of teachers in New York City and changes in teaching assignments, only two teachers, Deja and Sharon (pseudonyms), teaching in the same ICT classroom, completed all parts of the professional development programme. For this reason, they were selected for this case study. In their school, 46 per cent of students are identified as Black and 49 per cent as Latinx, 24 per cent of students have disabilities and 93 per cent of students receive free lunch. Only 32 per cent of Black students and 18 per cent of Latinx students in this school demonstrated mathematics proficiency based on the 2022 state mathematics test.</p>
        <p>Deja is a Black female general education teacher with 15 years of teaching experience. She earned her undergraduate degree in elementary education and her master&#x2019;s degree in early childhood special education. She also holds professional teaching certificates in early childhood (birth to Grade 2) and childhood (Grades 1&#x2013;6) education. Sharon is a Black female special education teacher with 20 years of teaching experience. She earned her undergraduate degree in sociology and her master&#x2019;s degree in elementary education. She also holds professional teaching certificates in special education (all grades) and childhood education (Grades 1&#x2013;6).</p>
      </sec>
      <sec>
        <title>Data collection</title>
        <p>Teacher focus group interviews were conducted in person during the summer retreat. The two case study teachers participated in separate focus groups. The data from these interviews included ethnographic notes. Individual teacher interviews were conducted online in January, about halfway through the study. These interviews were videotaped and transcribed. Ethnographic notes and robot-coding mathematics activities co-designed by the teachers and researchers were selected from the professional development workshops held in February and June.</p>
      </sec>
      <sec>
        <title>Instruments and data analysis</title>
        <p>All interviews were semi-structured and followed a pre-made script with open-ended questions. Focus group interviews included five questions about teachers&#x2019; expectations from the project, their experiences in teaching mathematics and their students&#x2019; experiences in learning mathematics. Individual interviews included four questions that focused on teachers&#x2019; thoughts about CRMP and future implementation of the developed activities. The individual interviews also probed teachers&#x2019; early professional development experiences in co-designing culturally relevant robot-coding activities.</p>
        <p><italic>The Codebook for CRMP Competencies</italic> was adapted from the framework for culturally responsive teaching (<xref ref-type="bibr" rid="B22-LRE-22-11">Muniz, 2020</xref>). The framework defines eight competencies critical in enacting culturally responsive teaching across grade levels and subject areas. Two of these competencies were beyond the study scope and were therefore removed. An additional three competencies were developed upon initial coding of data, resulting in nine competencies for CRMP (<xref ref-type="table" rid="LRE-22-11-t002">Table 2</xref>).</p>
		    <table-wrap id="LRE-22-11-t002" position="anchor">
        <object-id pub-id-type="pii">LRE-22-11-t002_Table 2</object-id>
        <label>Table 2</label>
        <caption>
          <p><bold>CRMP</bold>&#xA0;<bold>competencies</bold></p>
        </caption>
         <table>
          <tbody>
            <tr>
              <td align="left" valign="top" style="border-top:solid thin;border-bottom:solid thin">
                <bold>Framework competencies</bold>
              </td>
              <td align="left" valign="top" style="border-top:solid thin;border-bottom:solid thin">
                <bold>Code</bold>
              </td>
            </tr>
            <tr>
              <td align="left" valign="top">Recognise and redress bias in the system</td>
              <td align="left" valign="top">RB</td>
            </tr>
            <tr>
              <td align="left" valign="top">Draw on students&#x2019; culture to shape curriculum and instruction </td>
              <td align="left" valign="top">SC</td>
            </tr>
            <tr>
              <td align="left" valign="top">Bring real-world issues into the classroom</td>
              <td align="left" valign="top">RW</td>
            </tr>
            <tr>
              <td align="left" valign="top">Model high expectations for all students</td>
              <td align="left" valign="top">ME</td>
            </tr>
            <tr>
              <td align="left" valign="top">Promote respect for student differences</td>
              <td align="left" valign="top">SD</td>
            </tr>
            <tr>
              <td align="left" valign="top" style="border-bottom:solid thin">Reflect on one&#x2019;s own cultural lens </td>
              <td align="left" valign="top" style="border-bottom:solid thin">OL</td>
            </tr>
            <tr>
              <td align="left" valign="top" style="border-bottom:solid thin">
                <bold>Additional competencies</bold>
              </td>
              <td align="left" valign="top" style="border-bottom:solid thin">
                <bold>Code</bold>
              </td>
            </tr>
            <tr>
              <td align="left" valign="top">Acknowledge school style</td>
              <td align="left" valign="top">SS</td>
            </tr>
            <tr>
              <td align="left" valign="top">Recognise parents&#x2019; background in mathematics </td>
              <td align="left" valign="top">PMC</td>
            </tr>
            <tr>
              <td align="left" valign="top" style="border-bottom:solid thin">Acknowledge student differences in mathematics</td>
              <td align="left" valign="top" style="border-bottom:solid thin">SM</td>
            </tr>
          </tbody>
        </table>
      </table-wrap>
        <p>To assess coding for consistency, one excerpt from each focus group interview was selected for independent coding by two coders. In the process of establishing intercoder agreement, some codes were refined, until agreement was reached. The remaining transcripts and ethnographic notes were coded independently.</p>
        <p>The CRMP rubric was developed based on <xref ref-type="bibr" rid="B20-LRE-22-11">Matthews et al.</xref>&#x2019;s (<xref ref-type="bibr" rid="B20-LRE-22-11">2022a</xref>) curriculum-building framework to assess the co-designed activities. The CRMP rubric (<xref ref-type="table" rid="LRE-22-11-t003">Table 3</xref>) incorporates the three core aspects of demand, relevance and agency, with adaptations aligned to the template that the project team designed for the development of B-squared activities. In particular, we wanted teachers to incorporate all three core aspects when designing tasks, ensuring that rich and meaningful mathematical content was present, while attending to students&#x2019; experiences, and providing opportunities for students to reflect on social action and equity within a mathematical context. </p>
		    <table-wrap id="LRE-22-11-t003" position="anchor">
        <object-id pub-id-type="pii">LRE-22-11-t003_Table 3</object-id>
        <label>Table 3</label>
        <caption>
          <p><bold>CRMP</bold>&#xA0;<bold>rubric</bold></p>
        </caption>
          <table>
          <thead>
            <tr>
              <th align="left" valign="top" style="border-top:solid thin;border-bottom:solid thin">CRMP components</th>
              <th align="left" valign="top" style="border-top:solid thin;border-bottom:solid thin">Criteria</th>
            </tr>
          </thead>
          <tbody>
            <tr>
              <td align="left" valign="top" style="border-bottom:solid thin">Demand</td>
              <td align="left" valign="top" style="border-bottom:solid thin">
                <list list-type="bullet">
                  <list-item>
                    <p>Opening scenario is clearly written: mathematical question is clear and correct, even if open-ended</p>
                  </list-item>
                  <list-item>
                    <p>Mathematics required is at or above grade level</p>
                  </list-item>
                  <list-item>
                    <p>Task (either in the opening scenario or in the reflection) has an element that allows for meaningful student exploration and thinking OR extends the mathematics explored in the task to a new or novel situation</p>
                  </list-item>
                </list>
              </td>
            </tr>
            <tr>
              <td align="left" valign="top" style="border-bottom:solid thin">Relevance</td>
              <td align="left" valign="top" style="border-bottom:solid thin">
                <list list-type="bullet">
                  <list-item>
                    <p>Scenario references a cultural or community or familial context, in a non-essentialist/non-stereotypical way</p>
                  </list-item>
                  <list-item>
                    <p>Scenario presents mathematics within the cultural/community/familial context in a meaningful, authentic way</p>
                  </list-item>
                  <list-item>
                    <p>Scenario affirms and/or reflects attention to students&#x2019; identities within and/or beyond school</p>
                  </list-item>
                  <list-item>
                    <p>Scenario makes use of students&#x2019; knowledge and experiences</p>
                  </list-item>
                </list>
              </td>
            </tr>
            <tr>
              <td align="left" valign="top" style="border-bottom:solid thin">Agency</td>
              <td align="left" valign="top" style="border-bottom:solid thin">
                <list list-type="bullet">
                  <list-item>
                    <p>Scenario prompts students to think about taking action to benefit or contribute to others or society, either locally or broadly</p>
                  </list-item>
                  <list-item>
                    <p>Scenario prompts students to engage in empathetic thinking or reflects empathetic behaviour</p>
                  </list-item>
                  <list-item>
                    <p>Scenario prompts students to consider issues relevant to social consciousness, equity and/or justice</p>
                  </list-item>
                </list>
              </td>
            </tr>
          </tbody>
        </table>
     </table-wrap>
        <p>Each CRMP component is defined by several criteria, and the score is assigned based on the number of criteria met in the activity, with a maximum score of 3 for each component. After the B-squared activities were completed (but before implementing them in the classrooms), a team of three coders randomly chose several activities to discuss, review and revise the rubric. Then, each coder applied the revised rubric to five randomly selected activities to ensure consistency of the ratings. Once agreement was reached, the rubric was finalised, and researchers used the rubric to score all co-designed activities. </p>
      </sec>
    </sec>
    <sec>
      <title>Findings and discussion</title>
      <p>Focus group interview revealed that Deja initially distinguished between bias at the individual level and institutional racism (RB) through her perceptions of her students&#x2019; needs: &#x2018;Because [of] our kids&#x2019; demographic. They need so much assistance.&#x2019; She also linked learning gaps to students&#x2019; low reading comprehension that had a direct influence on mathematics achievement (RB): &#x2018;Cuz we found a lot of gaps last year &#x2026; what I would say overall the issue is, comprehension. If you can comprehend in reading, then you&#x2019;re pretty OK for the most part with math.&#x2019; Deja then continued to acknowledge student difficulties in mathematics performance (SM): &#x2018;If they&#x2019;re lacking in comprehension, then when it comes time to solve word problems, they&#x2019;re trying to figure out, &#x201C;I need to add &#x2026; I don&#x2019;t know if I need to subtract. I don&#x2019;t know if this is a one-step or a two-step problem.&#x201D;&#x2019;</p>
      <p>Deja demonstrated knowledge of her students&#x2019; culture (SC) when describing how her students perceived mathematics as being &#x2018;game-like&#x2019;, and how this attraction could help students engage with mathematics: &#x2018;They definitely have an affinity toward math, more toward math than towards reading, and math becomes like a game to them.&#x2019; Deja further described how students may experience different learning engagement with game-like mathematics, demonstrating her respect for student differences (SD). Deja&#x2019;s understanding of her students&#x2019; interest in games is reflected in contexts of activities co-designed by her and Sharon, which included themes related to Lego, Pok&#xE9;mon and Minecraft.</p>
      <p>While Deja worried about integration of the robot-coding activity with the standards-based curriculum, she indicated that successful integration of these activities in mathematics was possible and promising, which reflects Deja&#x2019;s thoughtfulness about teaching and the long-term development of her students: &#x2018;I would hope that it&#x2019;d be different because it&#x2019;ll be like, you know, this is a benefit long term. This is what we are looking [for], this is where we&#x2019;re heading.&#x2019; However, Deja was concerned about how school expectations and norms (SS) may limit culturally responsive instruction with robot coding. Within such school restrictions, Deja describes what needs to be clear for her (and other teachers) to better develop their own cultural lens (OL). She mentions how teachers need to understand the materials presented to them, and what to expect to better prepare and implement these activities. </p>
      <p>Five months later, during an individual interview, Deja mentioned how professional development influenced her perceptions and attitudes toward her own mathematics learning and instruction, indicating development of her own cultural lens (OL):
      <disp-quote>
        <p>The workshops have been definitely helpful. I do feel that they are, I guess, stretching or expanding my thinking as far as like what math could look like in the classroom and just going from the traditional way of doing math to making it more hands-on, more engaging with the Finch, and just everything that we&#x2019;re learning. </p>
      </disp-quote>
      Other recognisable differences included deeper understanding of student culture (SC) and specific statements on how this had influenced and shaped her mathematics instruction: &#x2018;To me, culturally relevant teaching is just making sure that your students see themselves and everyday math &#x2026; So, I always make sure that my students see examples that reflect their own experiences.&#x2019; However, Deja continued to have concerns about integrating the robot-coding activities into a rigidly structured curriculum (SS): 
      <disp-quote>
        <p>At my school, like it&#x2019;s a very strict schedule. So, I feel that there&#x2019;s gonna be a lot of remodelling that&#x2019;s gonna have to take place, and that has to be done early on and not [at the] last minute &#x2026; it can&#x2019;t be just, we&#x2019;re gonna do this here &#x2026; it has to, the alignment has to fit in seamlessly. </p>
      </disp-quote>
    She was also concerned about the impact of robot-coding activities on students&#x2019; state test performance: &#x2018;Where I see the challenge lying is that when you&#x2019;re teaching a testing grade &#x2026; this is the state test, you know, we gotta get them ready for the state test &#x2026; but not seeing how it could be impactful.&#x2019; </p>
      <p>Similar to Deja, at the beginning of the project, Sharon demonstrated a variety of competencies in understanding student culture (SC), repeatedly stating that students &#x2018;enjoy working with manipulatives and hands-on activities&#x2019;. She also emphasised the importance of bringing real-world connections into the classroom (RW), commenting that &#x2018;it [mathematics] needs to be brought to their attention more of how it&#x2019;s used in the real world or how it applies to their life&#x2019;. At the same time, she demonstrated some deficit perspectives about her students, blaming students for their low academic performance (RB): &#x2018;Many students &#x2026; don&#x2019;t really have a focus on mathematics. &#x2026; things that you would think that they would know, even at such a small age, they don&#x2019;t have it, you know?&#x2019; Sharon&#x2019;s comments during the group interview also demonstrated her perception of a lack of attention to mathematics in the families of her students (PMC): &#x2018;you get an aunt, uncle, whoever comes over, they&#x2019;re giving you money &#x2026; math is everywhere, but they [students] don&#x2019;t recognise it or their attention is not brought to it&#x2019;. While Sharon pointed out connections between student experiences with money at home (SC) and mathematics they learn in class, she did not recognise an opportunity to help students make this connection. </p>
      <p>When discussing the challenges of integrating robot-coding activities into the standards-based curriculum, Sharon also referred to strict school policy on scheduling and time spent on specific subjects (SS): &#x2018;this programme sounds wonderful, but when you start to implement it in the requirements of the programme versus the requirements of the building, there can be a, you know, conflict&#x2019;. She also had difficulty imagining how robot-coding activities could support student learning of the required curriculum (SS), as evident from her comments: 
      <disp-quote>
        <p>I guess I&#x2019;m still trying to see how it fits into the curriculum. Cuz I mean we looked at places, OK, maybe we can do it here, but how, what does that look like? &#x2026; How do we use this to actually teach math to strengthen their skills in math?</p>
      </disp-quote>
      Sharon also indicated her personal challenges, reflecting on her lack of confidence in using classroom technology and her own ways of learning (OL): 
      <disp-quote>
        <p>I&#x2019;m visual, but I&#x2019;m also tactile &#x2026; I need step by step for me to really see it. Because if I don&#x2019;t, if I already have low confidence in technology, you know my abilities in technology, if I can get a clear picture of how it is from step A to step Z, you know, then that, that works for me. </p>
      </disp-quote>
     Five months later, Sharon&#x2019;s perceptions had changed significantly, as her comments reflect on her own learning (OL) of better understanding student culture, and how that can shape curriculum and instruction (SC):
      <disp-quote>
        <p>I feel that with proper support and instruction and training, robotics can be effective in teaching math for our underserved students. I feel a lot of the work that we do can be more culturally relevant. I&#x2019;ve never really thought about it in terms of mathematics. How can I change this curriculum so that it relates to their [students&#x2019;] experiences?</p>
      </disp-quote>
      Sharon&#x2019;s perceptions of her students&#x2019; potential also started to change. While she recognised that some underserved students may have mathematical difficulties (SM), she now demonstrated belief in their success with proper teaching: &#x2018;The kids don&#x2019;t have this skill. What can I do? What strategy can I use to help them to understand this thing?&#x2019; She no longer blamed students for low academic performance, but was looking for opportunities to support them, which represents her gaining competency in redressing bias in the system (RB). Sharon also started to see technology as part of student culture (SC) that can help them to get engaged in learning mathematics: &#x2018;I think for one, just the idea of the robot, you know, and the students being able to touch and manipulate and use the computer, the program and things like that. I think that it would build some excitement around mathematics.&#x2019; Building on that, Sharon shared her beliefs in student abilities to explore mathematics with robots, demonstrating higher expectations of her students (ME): &#x2018;Because we want them to be able to explore, maybe find out things on their own about how it [robot] works and what to do with it. &#x2026; so, I think it&#x2019;ll be a good entry point for, especially for those lower level students.&#x2019; As the academic year progressed, Sharon and Deja continued to develop activities that drew on students&#x2019; familial and community connections, in ways that extended beyond typical money and/or counting problems (PMC). </p>
      <p>To facilitate the co-design process, the researchers designed an activity-planning template. In addition to common elements of mathematical tasks, such as objective, materials and procedure, the template also included several components unique to the B-squared activities: developing a scenario, incorporating a mathematical prompt and providing reflection questions for students. Scenarios, mathematical situations to be explored using the Finch robot, were to be engaging and of interest to students. For each scenario and accompanying mathematical prompt and reflection questions, teachers were to consider demand, relevance and agency, which are characteristic of rich, culturally relevant mathematical tasks (<xref ref-type="fig" rid="LRE-22-11-f001">Figure 1</xref>). These three concepts, incorporated into the activity-planning template, and the corresponding rubric (<xref ref-type="table" rid="LRE-22-11-t003">Table 3</xref>) supported the teachers in the co-design process.</p>
      <p>Deja and Sharon completed four activities in February, five in April, eight in May and eight in June. These activities were assessed using the CRMP rubric. <xref ref-type="fig" rid="LRE-22-11-f003">Figure 3</xref> shows the average monthly scores for demand, relevance and agency for these activities.</p>
	   <fig id="LRE-22-11-f003" position="anchor">
        <label>Figure 3</label>
        <caption>
          <p><bold>Demand, relevance</bold>&#xA0;<bold>and agency average monthly scores of activities developed by the teachers</bold></p>
        </caption>
        <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="image003.png"/>
      </fig>
      <p>As seen in <xref ref-type="fig" rid="LRE-22-11-f003">Figure 3</xref>, all activities included scenarios that were relevant to the students, representing teachers&#x2019; competency in student culture. The demand scores that indicate teachers&#x2019; knowledge for teaching mathematics fluctuated, as teachers often used closed-ended problems that did not include meaningful explorations for students. These also reflect that teachers&#x2019; ability to create high-demand scenarios depended on their facility and familiarity with the topic. The agency component was the most difficult aspect of culturally relevant pedagogy for the teachers. </p>
      <p>To examine changes in teachers&#x2019; competencies in designing culturally relevant tasks for Finch explorations, we analysed two activities, <italic>Our Lego Balcony</italic> and <italic>Family Portrait</italic>, developed in February and June 2023, respectively. <italic>Our Lego Balcony</italic> is part of a themed unit, <italic>Our Lego Apartment</italic>, which uses Lego bricks to build distinct features of New York City apartments. The choice of using Lego bricks reflected Deja&#x2019;s interest in connecting mathematics to toys, games and surrounding environments familiar to students. This activity was designed to help students explore arithmetic properties using area models. Deja and Sharon crafted the following scenario: &#x2018;Yeamin measures the dimensions of his balcony (12 metres by 5 metres) and uses this to find the area of his balcony. His friend Malachi&#x2019;s balcony has the same area but different measurements. What could his measurements be?&#x2019;</p>
      <p>Apartments with balconies are familiar features to students living in New York City. The balcony sizes in the scenario &#x2013; 12 metres (approximately 39 feet) &#x2013; may seem somewhat contrived, but it represents real New York City apartment balconies that run the width of the building with partitions that fit different apartment details. The open-ended nature of the question (possible measurements of Malachi&#x2019;s balcony) and the desire to have multiple solutions to the question (that is, different dimensions that would yield the same area of 60 square metres) allow for rich discussions. Using the CRMP rubric, this task scored medium on demand, noting that the task was grade appropriate, and that the scenario and mathematical question would be understandable to students. The activity had an open-ended nature, but the posed reflection question at the end was simply &#x2018;What is the area?&#x2019;, which was a missed opportunity and kept the mathematical demand level from being scored as high. The scenario reflected students&#x2019; knowledge and experiences (that is, familiarity with New York City high-rise apartment balconies). It scored high for relevance. The attention to agency was missing from this scenario, resulting in a low score (demand: 2; relevance: 3; agency: 1). </p>
      <p>The second activity, <italic>Family Portrait</italic>, was developed in June within a <italic>Cultural Arts Project</italic> theme. It addressed the mathematical topic of problem-solving with perimeters: &#x2018;Jason and Celeste are creating a [rectangular] frame for their family portrait. Celeste lets her big brother, Jason, paint the set of 8-inch parallel lines purple, while Celeste paints the 4-inch parallel lines yellow. What is the perimeter of the frame they have created?&#x2019;</p>
      <p>In this activity, students coded the Finch robot to draw geometric shapes and examine its properties. The details reflect Sharon&#x2019;s desire to link mathematics to students&#x2019; families, draw on familial connections, and collaborate and share through creating a family portrait frame. Teachers thought carefully about the properties of geometric shapes and their dimensions, and how students might recognise mathematical shortcuts to adding up the four sides of the rectangular frame. This was evidenced in the reflection question for this task: &#x2018;If the shape was a square instead of a rectangle and one side measured 4 inches, how could you find the perimeter?&#x2019; Therefore, the demand and relevance of this task were evaluated as high. Agency was also attended to in a meaningful way, as Celeste demonstrates empathetic behaviour, engaging her sibling in creating the frame. This task received a perfect score of 9. </p>
      <p>These two activities showed Sharon and Deja developing capabilities of connecting rich mathematics and culturally relevant pedagogy in such a way that mathematics content was included and not obscured by the task itself. This is reflected in increased mathematical demand opportunities described in the two tasks. Furthermore, it should be emphasised that teachers are not unidimensional in their beliefs about their students and their potential. While teachers&#x2019; views can sometimes be limited when it comes to perspectives about students&#x2019; lives, support from their families, and communities for mathematical thinking, we also saw teachers&#x2019; understanding of students&#x2019; strengths, and how this could be leveraged for student engagement. </p>
      <p>As the year progressed, we observed deeper understanding and ability to reference students&#x2019; lives in the design of mathematical tasks, in ways that were affirmative and culturally centred, and not essentialist or stereotypical. Despite teachers&#x2019; continuing concern about the influence of school structures (controlled by administrators) on this work, their efforts to infuse technology and culturally relevant pedagogy into the school mathematics curriculum, their high engagement and continuous growth in competencies, both in understanding their students and in developing rich mathematical tasks, were evident.</p>
    </sec>
    <sec>
      <title>Conclusion</title>
      <p>The objective of this study was to develop teachers&#x2019; cultural competencies and deepen their understanding of CRMP as they co-designed culturally relevant robot-coding mathematics activities with researchers in a year-long professional development programme. In the earlier stages of professional development, teachers showed understanding of students&#x2019; cultural background and experiences, but were uncertain how to integrate culturally relevant pedagogy into their mathematics curriculum. Early co-designed activities lacked connections between culturally relevant pedagogy and mathematics content, and teachers&#x2019; dependence on researchers to make this connection was frequent. Existing literature similarly suggests teacher struggles in making connections between culturally relevant pedagogy and mathematics (<xref ref-type="bibr" rid="B16-LRE-22-11">Leonard, 2018</xref>). In addition, teachers initially saw the robot as a separate tool, and had difficulty connecting robot coding to the targeted mathematical concepts (<xref ref-type="bibr" rid="B30-LRE-22-11">Silk et al., 2010</xref>). Literature suggests that subject content knowledge in science, technology, engineering and mathematics (STEM) disciplines, in combination with higher teacher self-efficacy and confidence levels is crucial for successful implementations of educational robotics activities in classrooms (<xref ref-type="bibr" rid="B7-LRE-22-11">Dorotea et al., 2021</xref>). Similarly, our finding about difficulty in connecting robot coding to mathematical concepts suggests teachers&#x2019; needs for more time and support from professional development programmes in building content knowledge, skills and confidence to use robot coding in K&#x2013;12 mathematics classrooms. </p>
      <p>Over time, the influence of the co-designing process became evident. Teachers showed a deeper understanding of their students&#x2019; cultures and how to integrate culturally relevant pedagogy into mathematics activities. Teachers grew familiar with the key attributes of the robot, perceiving the Finch robot as a mathematical tool, and utilising its physical and coding features to design student tasks that focused on the meanings of the mathematical concepts. They also started to pay more attention to developing their own cultural lens, and focused less on constraints from school structures. </p>
      <p>This study explored a new approach to professional development by co-designing and implementing culturally relevant robot-coding activities into standards-based mathematics. Doing so has led to the development of elementary school teachers&#x2019; cultural competencies, deeper understanding of CRMP and their students&#x2019; cultures, stronger agency and ability to integrate culturally responsive pedagogy into their mathematics curriculum. Implications include knowledge of how teachers&#x2019; cultural competencies are affected by professional development experiences; the importance of co-design work to help teachers make connections across innovative pedagogies (that is, robot coding and culturally relevant teaching in elementary mathematics classrooms); and providing a framework for facilitating authentic connections between culturally relevant pedagogy and mathematics, a discipline where concrete examples for teaching are largely missing from the discourse and professional literature. Next steps will be to see how teachers&#x2019; cultural competencies and culturally relevant pedagogy in mathematics may continue to evolve over the years, and across different early elementary school grade levels, and how that can influence students&#x2019; mathematics performance and interests.</p>
    </sec>
    </body>
  <back>
   <notes notes-type="COI-statement">
     <title>Declarations and conflicts of interest</title>
      <sec>
        <title>Research ethics statement</title>
        <p>The authors declare that research ethics approval for this article was provided by the Teachers College Institutional Review Board, protocol 21-172, and by the Institutional Review Board and Ethics Committee of New York City Department of Education, protocol 4306. </p>
      </sec>
      <sec>
        <title>Consent for publication statement</title>
        <p>The authors declare that research participants&#x2019; informed consent to publication of findings &#x2013; including photos, videos and any personal or identifiable information &#x2013; was secured prior to publication.</p>
      </sec>
      <sec>
        <title>Conflicts of interest statement</title>
        <p>The authors declare no conflicts of interest with this work. All efforts to sufficiently anonymise the authors during peer review of this article have been made. The authors declare no further conflicts with this article.</p>
      </sec>
    </notes>
    <ref-list>
      <title>References</title>
      <ref id="B1-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Abdulrahim</surname>
              <given-names>N.A</given-names>
            </name>
            <name>
              <surname>Orosco</surname>
              <given-names>M.J</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Culturally responsive mathematics teaching: A research synthesis&#x2019;</article-title>
          <source>The Urban Review</source>
          <year>2020</year>
          <volume>52</volume><issue>1</issue>
          <fpage>1</fpage>
          <lpage>25</lpage>
          <pub-id pub-id-type="doi">10.1007/s11256-019-00509-2</pub-id>
        </element-citation>
      </ref>
      <ref id="B2-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Angeli</surname>
              <given-names>C</given-names>
            </name>
            <name>
              <surname>Valanides</surname>
              <given-names>N</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Developing young children&#x2019;s computational thinking with educational robotics: An interaction effect between gender and scaffolding strategy&#x2019;</article-title>
          <source>Computers in Human Behavior</source>
          <year>2019</year>
          <volume>105</volume>
          <fpage>1</fpage>
          <lpage>13</lpage>
          <pub-id pub-id-type="doi">10.1016/j.chb.2019.03.018</pub-id>
        </element-citation>
      </ref>
      <ref id="B3-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Averill</surname>
              <given-names>R</given-names>
            </name>
            <name>
              <surname>Anderson</surname>
              <given-names>D</given-names>
            </name>
            <name>
              <surname>Easton</surname>
              <given-names>H</given-names>
            </name>
            <name>
              <surname>Maro</surname>
              <given-names>P.T</given-names>
            </name>
            <name>
              <surname>Smith</surname>
              <given-names>D</given-names>
            </name>
            <name>
              <surname>Hynds</surname>
              <given-names>A</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Culturally responsive teaching of mathematics: Three models from linked studies&#x2019;</article-title>
          <source>Journal for Research in Mathematics Education</source>
          <year>2009</year>
          <volume>40</volume><issue>2</issue>
          <fpage>157</fpage>
          <lpage>186</lpage>
        </element-citation>
      </ref>
      <ref id="B4-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Boaler</surname>
              <given-names>J</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Mathematics from another world: Traditional communities and the alienation of learners&#x2019;</article-title>
          <source>Journal of Mathematical Behavior</source>
          <year>2000</year>
          <volume>18</volume><issue>4</issue>
          <fpage>379</fpage>
          <lpage>397</lpage>
          <pub-id pub-id-type="doi">10.1016/S0732-3123(00)00026-2</pub-id>
        </element-citation>
      </ref>
      <ref id="B5-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Brown</surname>
              <given-names>T</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Design thinking&#x2019;</article-title>
          <source>Harvard Business Review</source>
          <year>2008</year>
          <volume>86</volume><issue>6</issue>
          <fpage>85</fpage>
          <lpage>92</lpage>
        </element-citation>
      </ref>
      <ref id="B6-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Celed&#xF3;n-Pattichis</surname>
              <given-names>S</given-names>
            </name>
            <name>
              <surname>Peters</surname>
              <given-names>S.A</given-names>
            </name>
            <name>
              <surname>Borden</surname>
              <given-names>L.L</given-names>
            </name>
            <name>
              <surname>Males</surname>
              <given-names>J.R</given-names>
            </name>
            <name>
              <surname>Pape</surname>
              <given-names>S.J</given-names>
            </name>
            <name>
              <surname>Chapman</surname>
              <given-names>O</given-names>
            </name>
            <name>
              <surname>Leonard</surname>
              <given-names>J</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Asset-based approaches to equitable mathematics education research and practice&#x2019;</article-title>
          <source>Journal for Research in Mathematics Education</source>
          <year>2018</year>
          <volume>49</volume><issue>4</issue>
          <fpage>373</fpage>
          <lpage>389</lpage>
          <pub-id pub-id-type="doi">10.5951/jresematheduc.49.4.0373</pub-id>
        </element-citation>
      </ref>
      <ref id="B7-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Dorotea</surname>
              <given-names>N</given-names>
            </name>
            <name>
              <surname>Piedade</surname>
              <given-names>J</given-names>
            </name>
            <name>
              <surname>Pedro</surname>
              <given-names>A</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Mapping K-12 computer science teacher&#x2019;s interest, self-confidence, and knowledge about the use of educational robotics to teach&#x2019;</article-title>
          <source>Education Sciences</source>
          <year>2021</year>
          <volume>11</volume><issue>8</issue>
          <elocation-id>443</elocation-id>
          <pub-id pub-id-type="doi">10.3390/educsci11080443</pub-id>
        </element-citation>
      </ref>
      <ref id="B8-LRE-22-11">
        <element-citation publication-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Edwards</surname>
              <given-names>T</given-names>
            </name>
            <name>
              <surname>Parada</surname>
              <given-names>H</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Black youth disengaging from Ontario&#x2019;s educational system: Grounded theory of their educational experiences&#x2019;</article-title>
          <source>Youth, Education and Wellbeing in the Americas</source>
          <person-group person-group-type="editor">
            <name>
              <surname>Tilleczek</surname>
              <given-names>K</given-names>
            </name>
            <name>
              <surname>MacDonald</surname>
              <given-names>D</given-names>
            </name>
          </person-group>
          <publisher-name>Routledge</publisher-name>
          <publisher-loc>London</publisher-loc>
          <year>2022</year>
          <fpage>118</fpage>
          <lpage>137</lpage>
        </element-citation>
      </ref>
      <ref id="B9-LRE-22-11">
        <element-citation publication-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Gay</surname>
              <given-names>G</given-names>
            </name>
          </person-group>
          <source>Culturally Responsive Teaching: Theory, research, and practice</source>
          <edition>3rd ed.</edition>
          <publisher-name>Teachers College Press</publisher-name>
          <publisher-loc>New York</publisher-loc>
          <year>2018</year>
        </element-citation>
      </ref>
      <ref id="B10-LRE-22-11">
        <element-citation publication-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Hammond</surname>
              <given-names>Z</given-names>
            </name>
          </person-group>
          <source>Culturally Responsive Teaching and the Brain: Promoting authentic engagement and rigour among culturally and linguistically diverse students</source>
          <publisher-name>Corwin</publisher-name>
          <publisher-loc>Newtown</publisher-loc>
          <year>2015</year>
        </element-citation>
      </ref>
      <ref id="B11-LRE-22-11">
        <element-citation publication-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Heiner</surname>
              <given-names>C</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;A robotics experience for all the students in an elementary school&#x2019;</article-title>
          <source>SIGCSE&#x2019;18: Proceedings of the 49th ACM Technical Symposium on Computer Science Education</source>
          <publisher-name>Association for Computing Machinery</publisher-name>
          <publisher-loc>New York</publisher-loc>
          <year>2018</year>
          <fpage>729</fpage>
          <lpage>734</lpage>
        </element-citation>
      </ref>
      <ref id="B12-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Kelter</surname>
              <given-names>J</given-names>
            </name>
            <name>
              <surname>Peel</surname>
              <given-names>A</given-names>
            </name>
            <name>
              <surname>Bain</surname>
              <given-names>C</given-names>
            </name>
            <name>
              <surname>Anton</surname>
              <given-names>G</given-names>
            </name>
            <name>
              <surname>Dabholkar</surname>
              <given-names>S</given-names>
            </name>
            <name>
              <surname>Horn</surname>
              <given-names>M.S</given-names>
            </name>
            <name>
              <surname>Wilensky</surname>
              <given-names>U</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Constructionist co-design: A dual approach to curriculum and professional development&#x2019;</article-title>
          <source>British Journal of Educational Technology</source>
          <year>2021</year>
          <volume>52</volume><issue>3</issue>
          <fpage>1043</fpage>
          <lpage>1059</lpage>
          <pub-id pub-id-type="doi">10.1111/bjet.13084</pub-id>
        </element-citation>
      </ref>
      <ref id="B13-LRE-22-11">
        <element-citation publication-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Koh</surname>
              <given-names>J.H.L</given-names>
            </name>
            <name>
              <surname>Chai</surname>
              <given-names>C.S</given-names>
            </name>
            <name>
              <surname>Wong</surname>
              <given-names>B</given-names>
            </name>
            <name>
              <surname>Hong</surname>
              <given-names>H.Y</given-names>
            </name>
          </person-group>
          <source>Design Thinking for Education: Conceptions and applications in teaching and learning</source>
          <publisher-name>Springer</publisher-name>
          <publisher-loc>Singapore</publisher-loc>
          <year>2015</year>
          <pub-id pub-id-type="doi">10.1007/978-981-287-444-3</pub-id>
        </element-citation>
      </ref>
      <ref id="B14-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Ladson-Billings</surname>
              <given-names>G</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Toward a theory of culturally relevant pedagogy&#x2019;</article-title>
          <source>American Educational Research Journal</source>
          <year>1995</year>
          <volume>32</volume><issue>3</issue>
          <fpage>465</fpage>
          <lpage>491</lpage>
          <pub-id pub-id-type="doi">10.3102/00028312032003465</pub-id>
        </element-citation>
      </ref>
      <ref id="B15-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Ladson-Billings</surname>
              <given-names>G</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Fighting for our lives: Preparing teachers to teach African American students&#x2019;</article-title>
           <source>Journal of Teacher Education</source>
          <year>2000</year>
          <volume>51</volume><issue>3</issue>
          <fpage>206</fpage>
          <lpage>214</lpage>
          <pub-id pub-id-type="doi">10.1177/0022487100051003008</pub-id>
        </element-citation>
      </ref>
      <ref id="B16-LRE-22-11">
        <element-citation publication-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Leonard</surname>
              <given-names>J</given-names>
            </name>
          </person-group>
          <source>Culturally Specific Pedagogy in the Mathematics Classroom: Strategies for teachers and students</source>
          <publisher-name>Routledge</publisher-name>
          <publisher-loc>London</publisher-loc>
          <year>2018</year>
        </element-citation>
      </ref>
      <ref id="B17-LRE-22-11">
        <element-citation publication-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Lyublinskaya</surname>
              <given-names>I</given-names>
            </name>
            <name>
              <surname>Tournaki</surname>
              <given-names>E</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;The effects of teacher content authoring on TPACK and on student achievement in algebra: Research on instruction with the TI-Nspire handheld&#x2019;</article-title>
          <source>Educational Technology, Teacher Knowledge, and Classroom Impact: A research handbook on frameworks and approaches</source>
          <person-group person-group-type="editor">
            <name>
              <surname>Ronau</surname>
              <given-names>R</given-names>
            </name>
            <name>
              <surname>Rakes</surname>
              <given-names>C</given-names>
            </name>
            <name>
              <surname>Niess</surname>
              <given-names>M</given-names>
            </name>
          </person-group>
          <publisher-name>IGI Global</publisher-name>
          <publisher-loc>Hershey, PA</publisher-loc>
          <year>2012</year>
          <fpage>295</fpage>
          <lpage>322</lpage>
        </element-citation>
      </ref>
      <ref id="B18-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Mark</surname>
              <given-names>S.L</given-names>
            </name>
            <name>
              <surname>Id-Deen</surname>
              <given-names>L</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Examining pre-service mathematics and science teachers&#x2019; plans to implement culturally relevant pedagogy&#x2019;</article-title>
          <source>Educational Action Research</source>
          <year>2022</year>
          <volume>30</volume><issue>5</issue>
          <fpage>725</fpage>
          <lpage>746</lpage>
          <pub-id pub-id-type="doi">10.1080/09650792.2020.1775670</pub-id>
        </element-citation>
      </ref>
      <ref id="B19-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Matthews</surname>
              <given-names>J.S</given-names>
            </name>
            <name>
              <surname>L&#xF3;pez</surname>
              <given-names>F</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Speaking their language: The role of cultural content integration and heritage language for academic achievement among Latino children&#x2019;</article-title>
          <source>Contemporary Educational Psychology</source>
          <year>2019</year>
          <volume>57</volume>
          <fpage>72</fpage>
          <lpage>86</lpage>
          <pub-id pub-id-type="doi">10.1016/j.cedpsych.2018.01.005</pub-id>
        </element-citation>
      </ref>
      <ref id="B20-LRE-22-11">
        <element-citation publication-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Matthews</surname>
              <given-names>L.E</given-names>
            </name>
            <name>
              <surname>Jones</surname>
              <given-names>S.M</given-names>
            </name>
            <name>
              <surname>Parker</surname>
              <given-names>Y.A</given-names>
            </name>
          </person-group>
          <source>Engaging in Culturally Relevant Mathematics Tasks</source>
          <publisher-name>Corwin</publisher-name>
          <publisher-loc>Newtown</publisher-loc>
          <year>2022a</year>
        </element-citation>
      </ref>
      <ref id="B21-LRE-22-11">
        <element-citation publication-type="web">
          <person-group person-group-type="author">
            <name>
              <surname>Matthews</surname>
              <given-names>L.E</given-names>
            </name>
            <name>
              <surname>Jones</surname>
              <given-names>S.M</given-names>
            </name>
            <name>
              <surname>Parker</surname>
              <given-names>Y.A</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Culturally relevant mathematics task-building actions&#x2019;</article-title>
          <year>2022b</year>
          <comment>Accessed 16 March 2024</comment>
          <comment><ext-link xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://us.corwin.com/docs/default-source/resources-documents/us-1602332-culturally-relevant-mathematics-ta.pdf?sfvrsn=f5175da7_0" ext-link-type="uri">https://us.corwin.com/docs/default-source/resources-documents/us-1602332-culturally-relevant-mathematics-ta.pdf?sfvrsn=f5175da7_0</ext-link></comment>
        </element-citation>
      </ref>
      <ref id="B22-LRE-22-11">
        <element-citation publication-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Muniz</surname>
              <given-names>J</given-names>
            </name>
          </person-group>
          <source>Culturally Responsive Teaching: A reflection guide</source>
          <publisher-name>New America</publisher-name>
          <publisher-loc>Washington, DC</publisher-loc>
          <year>2020</year>
        </element-citation>
      </ref>
      <ref id="B23-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Nasir</surname>
              <given-names>N.S</given-names>
            </name>
            <name>
              <surname>Hand</surname>
              <given-names>V</given-names>
            </name>
            <name>
              <surname>Taylor</surname>
              <given-names>E.V</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Culture and mathematics in school: Boundaries between &#x201C;cultural&#x201D; and &#x201C;domain&#x201D; knowledge in the mathematics classroom and beyond&#x2019;</article-title>
          <source>Review of Research in Education</source>
          <year>2008</year>
          <volume>32</volume><issue>1</issue>
          <fpage>187</fpage>
          <lpage>240</lpage>
          <pub-id pub-id-type="doi">10.3102/0091732X07308962</pub-id>
        </element-citation>
      </ref>
      <ref id="B24-LRE-22-11">
        <element-citation publication-type="gov">
          <person-group person-group-type="author">
            <collab>NYSED (New York State Education Department)</collab>
          </person-group>
          <source>Culturally Responsive-Sustaining Education Framework</source>
          <year>2018</year>
          <comment>Accessed 16 March 2024</comment>
          <comment><ext-link xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.nysed.gov/crs/framework" ext-link-type="uri">https://www.nysed.gov/crs/framework</ext-link></comment>
        </element-citation>
      </ref>
      <ref id="B25-LRE-22-11">
        <element-citation publication-type="gov">
          <person-group person-group-type="author">
            <collab>NYSED (New York State Education Department)</collab>
          </person-group>
          <source>Computer Science and Digital Fluency Learning Standards</source>
          <year>2020</year>
          <comment>Accessed 16 March 2024</comment>
          <comment><ext-link xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.nysed.gov/curriculum-instruction/computer-science-and-digital-fluency-learning-standards" ext-link-type="uri">https://www.nysed.gov/curriculum-instruction/computer-science-and-digital-fluency-learning-standards</ext-link></comment>
        </element-citation>
      </ref>
      <ref id="B26-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Okita</surname>
              <given-names>S.Y</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;The relative merits of transparency: Investigating situations that support the use of robotics in developing student learning adaptability across virtual and physical computing platforms&#x2019;</article-title>
          <source>British Journal of Educational Technology</source>
          <year>2014</year>
          <volume>45</volume><issue>5</issue>
          <fpage>844</fpage>
          <lpage>862</lpage>
          <pub-id pub-id-type="doi">10.1111/bjet.12101</pub-id>
        </element-citation>
      </ref>
      <ref id="B27-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Potvin</surname>
              <given-names>A.S</given-names>
            </name>
            <name>
              <surname>Boardman</surname>
              <given-names>A.G</given-names>
            </name>
            <name>
              <surname>Scornavacco</surname>
              <given-names>K</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Professionalizing teachers through a co-design learning framework&#x2019;</article-title>
          <source>Teacher Development</source>
          <year>2023</year>
          <volume>27</volume><issue>5</issue>
          <fpage>630</fpage>
          <lpage>646</lpage>
          <pub-id pub-id-type="doi">10.1080/13664530.2023.2225485</pub-id>
        </element-citation>
      </ref>
      <ref id="B28-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Putwain</surname>
              <given-names>D.W</given-names>
            </name>
            <name>
              <surname>Pekrun</surname>
              <given-names>R</given-names>
            </name>
            <name>
              <surname>Nicholson</surname>
              <given-names>L.J</given-names>
            </name>
            <name>
              <surname>Symes</surname>
              <given-names>W</given-names>
            </name>
            <name>
              <surname>Becker</surname>
              <given-names>S</given-names>
            </name>
            <name>
              <surname>Marsh</surname>
              <given-names>H.W</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Control-value appraisals, enjoyment, and boredom in mathematics: A longitudinal latent interaction analysis&#x2019;</article-title>
          <source>American Educational Research Journal</source>
          <year>2018</year>
          <volume>55</volume><issue>6</issue>
          <fpage>1339</fpage>
          <lpage>1368</lpage>
          <pub-id pub-id-type="doi">10.3102/0002831218786689</pub-id>
        </element-citation>
      </ref>
      <ref id="B29-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Rinke</surname>
              <given-names>C.R</given-names>
            </name>
            <name>
              <surname>Gladstone-Brown</surname>
              <given-names>W</given-names>
            </name>
            <name>
              <surname>Kinlaw</surname>
              <given-names>C.R</given-names>
            </name>
            <name>
              <surname>Cappiello</surname>
              <given-names>J</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Characterizing STEM teacher education: Affordances and constraints of explicit STEM preparation for elementary teachers&#x2019;</article-title>
          <source>School Science and Mathematics</source>
          <year>2016</year>
          <volume>116</volume><issue>6</issue>
          <fpage>300</fpage>
          <lpage>309</lpage>
          <pub-id pub-id-type="doi">10.1111/ssm.12185</pub-id>
        </element-citation>
      </ref>
      <ref id="B30-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Silk</surname>
              <given-names>E.M</given-names>
            </name>
            <name>
              <surname>Higashi</surname>
              <given-names>R</given-names>
            </name>
            <name>
              <surname>Shoop</surname>
              <given-names>R</given-names>
            </name>
            <name>
              <surname>Schunn</surname>
              <given-names>C.D</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Designing technology activities that teach mathematics&#x2019;</article-title>
          <source>The Technology Teacher</source>
          <year>2010</year>
          <volume>69</volume><issue>4</issue>
          <fpage>21</fpage>
          <lpage>27</lpage>
        </element-citation>
      </ref>
      <ref id="B31-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Summerville</surname>
              <given-names>J</given-names>
            </name>
            <name>
              <surname>Reid-Griffin</surname>
              <given-names>A</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Technology integration and instructional design&#x2019;</article-title>
          <source>TechTrends</source>
          <year>2008</year>
          <volume>52</volume><issue>5</issue>
          <fpage>45</fpage>
          <lpage>51</lpage>
          <pub-id pub-id-type="doi">10.1007/s11528-008-0196-z</pub-id>
        </element-citation>
      </ref>
      <ref id="B32-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Thanheiser</surname>
              <given-names>E</given-names>
            </name>
            <name>
              <surname>Koestler</surname>
              <given-names>C</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;If the world were a village: Learning mathematics while learning about the world&#x2019;</article-title>
          <source>Mathematics Teacher Educator</source>
          <year>2021</year>
          <volume>9</volume><issue>3</issue>
          <fpage>202</fpage>
          <lpage>228</lpage>
          <pub-id pub-id-type="doi">10.5951/MTE.2020.0021</pub-id>
        </element-citation>
      </ref>
      <ref id="B33-LRE-22-11">
        <element-citation publication-type="book">
          <person-group person-group-type="editor">
            <name>
              <surname>Tilleczek</surname>
              <given-names>K</given-names>
            </name>
            <name>
              <surname>MacDonald</surname>
              <given-names>D</given-names>
            </name>
          </person-group>
          <source>Youth, Education and Wellbeing in the Americas</source>
          <publisher-name>Routledge</publisher-name>
          <publisher-loc>London</publisher-loc>
          <year>2022</year>
        </element-citation>
      </ref>
      <ref id="B34-LRE-22-11">
        <element-citation publication-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Walker</surname>
              <given-names>E.N</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Mathematics teacher preparation for diversity&#x2019;</article-title>
          <source>Encyclopaedia of Diversity in Education</source>
          <person-group person-group-type="editor">
            <name>
              <surname>Banks</surname>
              <given-names>J</given-names>
            </name>
          </person-group>
          <publisher-name>Sage</publisher-name>
          <publisher-loc>New York</publisher-loc>
          <year>2012</year>
          <fpage>1449</fpage>
          <lpage>1452</lpage>
        </element-citation>
      </ref>
      <ref id="B35-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Williams</surname>
              <given-names>D.L</given-names>
            </name>
            <name>
              <surname>Edwards</surname>
              <given-names>B</given-names>
            </name>
            <name>
              <surname>Kuhel</surname>
              <given-names>K.A</given-names>
            </name>
            <name>
              <surname>Lim</surname>
              <given-names>W</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Culturally responsive dispositions in prospective mathematics teachers&#x2019;</article-title>
          <source>Discourse and Communication for Sustainable Education</source>
          <year>2016</year>
          <volume>7</volume><issue>2</issue>
          <fpage>17</fpage>
          <lpage>33</lpage>
          <pub-id pub-id-type="doi">10.1515/dcse-2016-0013</pub-id>
        </element-citation>
      </ref>
      <ref id="B36-LRE-22-11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Zhang</surname>
              <given-names>Y</given-names>
            </name>
            <name>
              <surname>Luo</surname>
              <given-names>R</given-names>
            </name>
            <name>
              <surname>Zhu</surname>
              <given-names>Y</given-names>
            </name>
            <name>
              <surname>Yin</surname>
              <given-names>Y</given-names>
            </name>
          </person-group>
          <article-title>&#x2018;Educational robots improve K-12 students&#x2019; computational thinking and STEM attitudes: Systematic review&#x2019;</article-title>
          <source>Journal of Educational Computing Research</source>
          <year>2021</year>
          <volume>59</volume><issue>7</issue>
          <fpage>1450</fpage>
          <lpage>1481</lpage>
          <pub-id pub-id-type="doi">10.1177/0735633121994070</pub-id>
        </element-citation>
      </ref>
    </ref-list>

</back>
</article>
