2. DESCRIBE: Evidence about the effects of my changed practice and intervention on desired learner outcomes.

Link to overview blogpost​

The Tool: Cybersmart Clips

Describe the evidence you have so far about the effects of your changed practices/intervention on desired learner outcomes and how you summarised and recorded these.

What methods have you used to collect information?​

- Start of Year/ End of Year Cybersmart Assessment


(as seen in previous blog post)

- Student collaborative planning/brainstorming docs

(See example on previous blog post)

- Student movie clips

- Student voice

In the last blog post, you will see some word walls which show responses from two other questions asked.

- Regular collection of blog comments/ replies to blog comments

I am currently analysing blog comments by comparing blog comments at the beginning of the year to blog comments now. This qualitative data is difficult to analyse and I am having to think of the best way to measure progress. I am wanting to measure progress in interpersonal skills and critical thinking in blog posts. On an initial look, it is clear that many children are writing more detailed and thoughtful blog comments compared to at the beginning of the year.

How have you been systematic in that collection?​

Each week, I have been collecting and updating data in a spreadsheet which is organised in the above categories. I am working on collating this data into graphs and noticing trends and patterns mainly around interpersonal skills and critical thinking.

What does the data/information tell you?​

Through the process of making movies in learning cybersmart skills and collection of data, I have realised that the creation of the movies and collaborative script-making is just as important as the sharing of the movies to a wider audience. This is where this method of teaching children to be cybersmart is effective in integrating the teaching of the key competencies at the same time. In particular, children are developing their ability to think (about the cybersmart topic given to them), relate to others (through the creation of the script in preparation for movie-making), managing self (to work through the process of creating a movie, from storyboarding to sharing of the movie) and participating and contributing (in creating the script but also in being confident to present/act in the movie or to direct and be responsible for the filming). Overarching the development of these key competencies (NZ Curriculum) is the final key competency of understanding symbols, languages and texts. This overarches the others in this process as the children are learning skills in being able to make sense of the online world and respond responsibly and appropriately.

Data from student voice tells me really clearly that the children are really enjoying using movie-making as the medium to learn how to be cybersmart. I showed this in an answer garden. A higher frequency of the same response is represented by a larger word.

WHAT DO YOU LIKE ABOUT CYBERSMART LEARNING?

I have also been collecting comments that children in my class are writing on other children's blogs. A continuing step in my inquiry is to collate these in a way that will show any development in the quality of the blog comments over time.

I also need to begin collating and making sense of the data which shows development of interpersonal skills and critical thinking through the children's collaborative scripts and movie clips.

What are you going to do with the data/information in terms of ‘tweaking’ your intervention?​

Currently, I am really satisfied with how the intervention/ tool is working. On the whole, the children are engaged, they are learning valuable skills in film making, being given opportunities to develop their critical thinking and interpersonal skills, and being able to share their learning with the wider world through the school news and their public blogs! How cool is that!?

As with anything in teaching though, there is always 'tweaking' that can be done to make it better! At the moment, my focus needs to be on continuing doing what we are doing and now beginning to make sense of what the data shows.

So...what am I going to do with the data to make sense of it?

- I have already analysed the start-of-year cybersmart assessment data (see blog post). This will be followed up later in the year (early in term 4) by children completing the same cybersmart assessment and seeing how the data changed over time.

- Student collaborative brainstorms/planning docs: I need to analyse these for evidence of interpersonal skills and critical thinking. As a result of a range of research (seen in previous blog posts) I plan to make a tally of the following when reading through the docs and watching the cybersmart clips:

• Collaborative plannning (all team members given a role and contributing to ideas; efficient planning in group)
• Communication between group members to produce a coherent and connected script (i.e. not different ideas per child but rather, a script that flows from one child to the next)
• Creativity (have they thought outside the box or just used class brainstorm ideas and copied it?)
• Critical thinking (thought deeply about how to portray the message in an effective way)
• Positive role play
• Perspective taking (each 'character' shares their own ideas)
• Empathy/interpersonal skills (evident through role play - rather than just saying lines without connection to others in the group; thinking about how others feel and how actions can affect others)
• Listening to each others ideas
• Questions asked
• Challenging each others ideas
• Reflecting/ making changes
• Summarising the main ideas

Final week of term 3 - What's the plan going forward?

As we go into our final week of term 3, I wanted to reassess where I am at in my inquiry. 

What have I achieved so far?

• A lot of research into what it looks like to be cybersmart.
• Narrowing all of the research down into a focus on the connection between interpersonal skills and critical thinking.
• Planing for a tool which can be implemented into the classroom.
• Creating a website on which the cybersmart clips created by the children can be shared.
• Altering my pedagogy when it comes to teaching year 5 children to be cybersmart.
• Supporting children in the filming, editing and sharing of their cybersmart clips.
• Collecting and documenting the data in a spreadsheet. 

What do I want to achieve in this final week of term 3?

• Sharing of "The words we use" Cybersmart Clips (that have been filmed)
• Time for children to comment on blog posts (to add to the data collection)
• Work with those children who have not yet completed any cybersmart clips.

What is there still to do in term 4? What are my ongoing challenges?

This term, my focus has very much been on altering my pedagogy and implementing the cybersmart movie clips tasks. In general, the children are loving learning how to be cybersmart in this way! This is a real positive. I have had to change the groups slightly to ensure when learning groups are out, others are not disadvantaged in their learning. The children have dealt with this really well.

A challenge I have is that there are a group of children who are having difficulty with the collaborative planning stage of the process, which is causing a challenge with getting their movies filmed, let alone edited. I really need to work with these children to ensure they have success in their learning and to ensure they are learning the important skills when it comes to being cybersmart and making thoughtful decisions online. These children need to become my priority learners for next term.

I will begin term 4 by introducing a new cybersmart topic: Reflecting on our own or others work and giving and receiving feedback.