Faculty Focus Live

Assessing Online Student Learning: How You Can Gauge Activities and Writing Through Online Assessment

May 28, 2021 Tierney King
Faculty Focus Live
Assessing Online Student Learning: How You Can Gauge Activities and Writing Through Online Assessment
Show Notes Transcript

In the past year, many instructors worried that their online teaching presence might miss the in-person cues they picked up on with students in the classroom. In turn questions arose: How do you assess your students online? How do you make sure they’re learning the content? How do you gauge student learning through online activities? 

In this episode, we'll provide ideas on how you can implement check points into your online teaching, and how you can use student-created videos to assess students in your online class. Additionally, we'll touch on how you can create writing assignments that can be used as an effective means of assessment, and how focusing on the process of writing can help foster student learning.

Resources mentioned:

This week's episode is sponsored by the Teaching Professor Virtual Conference. Join the conference anytime and anywhere from June 7 through September 30, where you'll have on-demand access to plenaries, sessions, downloadable handouts, and networking opportunities. 

Tierney King:

This is the Faculty Focus Live podcast. I'm your host Tierney King, and I'm here to bring you inspiration, energy, and creative strategies that you can utilize in your everyday teaching. This week's episode is sponsored by the Teaching Professor Virtual Conference. Join us on-demand from June 7 through September 30, where you can enjoy sessions, plenaries, and networking at anytime, anywhere. The past year a lot of instructors worried that their online teaching presence might miss the in-person cues they picked up on with students in the classroom. From this

questions emerged like:

How do you assess your students online? How do you make sure they're learning the content? How do you gauge student learning through online activities? You're already busy planning and executing each online activity, but how do you know if your activities and assignments are working? Well, that's what we're here to discuss today. To start, Jeremy Caplan will provide ideas on how you can implement checkpoints into your online teaching to assess students in his 20-Minute Mentor, How Can I Gauge Online Learning Through Engaging Activities and Assignments?

Jeremy Caplan:

When we're teaching online, we don't have the same opportunity to get nonverbal signals from students or to have those informal in-the-hallway conversations with students to check how they're doing and see how much they're understanding in our class. And that's all the more reason why we have to incorporate periodic and consistent checks for understanding in our online teaching. Checks for understanding and gauging online understanding is particularly helpful in two ways. One, it actually helps students improve their retention and their learning. A lot of research shows that retrieval practice and practice questions often help students retain information and ideas in online courses. And it also helps us get information about what we need to do to adjust our explanations, or our assessments. Our assignments are exercises to make sure students are understanding - we want to do this kind of assessment on a regular basis. In each class there should be some moment at which we stop and check for understanding in one of multiple ways, which I'll talk about. And then periodically as the course progresses, we need to check before we move on to new material that the material we've covered thus far is understood by the students so that they have the foundational understanding to move on to more advanced concepts. First, you can have students work in their own Google Doc or Microsoft Word doc, and independently jot down some ideas, jot down their own summary, before then pasting in a key section of that into your online meeting software tool into the chat section. And you can ask everyone to wait until you set a particular moment and then submit all together. And that has the advantage of no one being influenced by what everyone else has been typing, but everyone having the benefit in the online class session of seeing the summaries that other people have created. And you can then comment on some differences you notice or ask students to observe differences that they notice. This is a great way to get students thinking about what they've learned to assess whether they've summarized the material in a way that shows their understanding, and to get them to look at each other's work and learn from one another. So it has multiple benefits, you can ask students to summarize material in other ways as well. For example, you could have students create a collective Google slide deck, and each student could be responsible for creating one of the slides focused on a particular topic. You could also have students use another kind of online collaborative tool like Notion or Coda to build a document together online, each responsible for a section of the document. In addition to having students summarize material, you can ask them to answer a question that reveals whether or not they really understand what it is that you've been talking about. So let's say for example, you're teaching a music history course. And you've been discussing the influence of Beethoven on Brahms. And you may ask a question, something along the lines of simply, What are some examples of ways in which Beethoven influenced Brahms? Or to what extent do you think Brahms was influenced by composers before him? And inviting students to volunteer to participate in that discussion or asking them to work in breakout rooms online, in your online meeting software, to discuss that and then come back together and provide their summary answer. Give students a chance to convey that they have, in fact, grasped some of the concepts that you've been talking about, or to come back and say, you know, we're really not sure. Can you explain that again, or we really don't know, at which point you can decide that you can go over some of that material again, or maybe present it in a slightly different way.

Tierney King:

In addition to these checkpoints, you could also use student-created videos to assess your students. In Ollie Dreon's 20-Minute Mentor, How Can I Assess Students in My Online Class Through Student-created Videos? he walks us through how you can implement student videos in your own classes to construct meaning and confirm student learning.

Ollie Dreon:

For most ins ructors, they focus on the tea hing presence. This is the des gn, the facilitation, and the organization of the content in heir classes. They focus on how we can provide the content for students so they can access it nd learn. But the other two ele ents are really important to how do we provide that cognitive pre ence? How do we make sure tha they're able to construct mea ing and confirm their und rstanding with the social pre ence?With the social pre ence this is the interaction bet een students and other stu ents, and between us and stu ents. So, student-created vid os gives us some really gre t opportunities for that. Willmot, Bramhall, and Radley found that student-created videos can increase student motivation. They can foster a more learner autonomy. And they can enhance the classroom community. Talbert found that videos can help to make students learning visible. And that's really powerful for us in online classes. Because with text-based assignments, it's really hard for us to read something and to see what the students are really thinking - the reader makes meaning in the text. And I think that by hearing students voices and seeing their faces, we have a better idea of of hearing those nuances and those tones and their voices. So I think student-created video recreates some opportunities for us. So you may be wondering, where do I even start with assigning student-created videos? Well, I would think that you can almost convert any written paper to a student-created video. Instead of assigning a paper at the end of the semester, think about converting that to a video where students, instead of writing their comments, they focus on sharing those comments in video form. If you offer presentations, or assign presentations in your face-to-face class, that's easily something that you can do in your online class and have your students record those by talking to their laptop using the cameras that are built in. Demonstrations. Any demonstration that you do, any demonstration that you would have a student do, whether it's like a problem solving set, or you know, demonstrating some process, those are all things that students can very easily record with their laptop or their mobile phone. Student reflections. Student reflections are another really great way to incorporate student-created videos, the students reflect on some content or some concepts as you've discussed, they can share those reflections in video form, and you get to see naturally how students make sense of that content. And lastly, reading responses. With reading responses, if you've assigned a chapter or you signed some very difficult readings, you can have students talk about that and say, these are some concepts that I have. And these are some areas that I'm still struggling with.

Tierney King:

Many of the assessments instructors implement includes some format of writing, whether students are writing online responses, papers, or crafting a script to record through video. So how can you make these writing assignments more effective for your students and for you, as an instructor? How can you give them the tools they need so their writing can be used as an effective means of assessment? In Deidre Price's Magna Online Seminar, Effective Writing Assessment in the Online Classroom, she explains how to give feedback to online students to help accelerate their progress, and how this will help give better insight when assessing students online.

Deidre Price:

My goal, really, for members of any discipline is to share some ideas about how to focus on writing within your courses as more of a matter of process as opposed to product. Because at the end of the day, our students aren't really going to take those products from our courses and necessarily use them time and time again. But they certainly will use the skills that they use when they develop that product as they go out and do other work in their respective fields and in additional academic programs. And what we're going to talk about today would be things that have kind of this twofold benefit. Ways of teaching and assessing writing and an online class that benefits students because it allows them to slow down the process and really focus on the individual steps so that they can get to a better product. But we also want to talk about how writing instruction and writing assessment can be more effective for the instructor as well. What can they do to manage their workload? And what can they do to manage their online classrooms effectively when they do have heightened work that's coming in, or increased work that's coming in at various points of the writing process? So what I found when I'm working with instructors who are teaching online is that a lot of them de-emphasize the process when they're teaching a course online, they tend to assign a major project or a final paper, and they're focused on where the student needs to ultimately get. But they don't oftentimes spend a whole lot of time breaking that process down in the same way that they would in a face-to-face class. All right, so online classroom tools that emphasize process, this is a big question that I get. What concrete tools can we use to try to emphasize process? And these again, are used with the tools that I'm using in D2L, so you may have different tools at your disposal. But chat is something that I allow to be live and active in my classes, but I tend to use Google Hangouts more often with my students. I also have access to WebEx, I use Skype, sometimes Blackboard Collaborate. So depending on what your institution provides, you may find something a little more effective than just a plain chat with just text conversations. But I will often schedule time for students to work together to try, especially during the invention process, they're coming up with ideas and trying to brainstorm thesis statements, and so even at the very beginning of the writing process, they may be working alongside one another. And that's very helpful. So for the Dropbox, a lot of us think about the Dropbox as being the place for final drafts only. But if you have something like release conditions within your online classroom where a student can complete one part of the assignment and by submitting something, even if its not graded with 100, if they submitted something, it gives them access to the next step of the writing process. If you wanted to have more control over whether or not the students are actually going through and completing each step of the writing process, then you can use the Dropbox as one of those checkpoints. You can have them turn in a thesis statement or turn in an outline or turn in three quotations or something. And then you can have it set where it will allow them to see the next part of the writing process. OK, the News feature, this is what I used to nudge along the students, to encourage them to stay on track and to stay with the pacing of the class. Perhaps youre not quite in the same situation. Maybe you have a completely self-paced course. But I do pace my students on a week to week basis. And so for one of my classes, they start and end on Mondays. Another class starts and ends on Wednesdays and another on Fridays. So it helps me to stay on track as well. But that consistency is helpful to them. Then were all doing the same thing at the same time. And we can kind of make that collaborative work a little more valuable since were all the ame point in the writing rocess. And then for quizzes, I se self-assessments through uizzes. The example I gave you n the supplemental material, t ats really more of like one t at you would fill out in class b hand. But you could certainly p t that into a quiz item. And y u dont want to have it like a t pical quiz where a yes would be 100% and no would be 0%. What I o for that is I allow full cr dit for any response. So the qu stion is, did you meet the mi imum word count requirement fo this assignment? If it said, y s, the feedback would be 100%, a d it would say, great job, I m glad you did it or wha Also in the quizzes, you can provide feedback that is video ever you want to say after tha. And then if they said, no, be or audio base for us, at least with D2L. The same with other ause theyre doing this self-as essment right before they tu n in the final draft of their pa erif they said, no, it would st LMS is that what you can do is actually have a video of yourself as the feedback telling them what they can do to fix the ll get them 100% for that qui item. So Im not deducting problem or congratulating them and saying, "Great glad you met anything at that point, but %100 for the quiz item. And then the your minimum word count requirements." And then you feedback might say, as a reminder, the assignment could use that same clip or that same feedback in multiple required a thousand words. If yo have not met that word requir shelves. So again, a little more work on the front-end, and it ment, remember that you ha e the ability to add more wo creates a more personalized, individualized dynamic ds to your assignment pr or to submitting your final interaction with students for feedback on these writing raft later today or this week. Here are some ideas for how to assessments. And I think that if we put some more effort in on the front end, to thoughtfully develop our assessments in such beat writers block or go ahea and give them a link to some resources.That way that elf assessment is a way for the a way that they focus on process, not product. It does to go through and see things hat they could potentiall encourage the students to have this more thoughtful pace and be deducted for. And to re edy those problems prio more thoughtful mode of participation when they're to submitting the final draf. I have found this to be an imm producing their final work. nse time saver. And I know tha it takes time to create the

Tierney King:

Whether you're driving to work, or you just elf assessment that by allowing the students to see those guidel need a 15-minute think session, we hope the Faculty Focus Live nes one last time it actually c ick that button of Yes, I've podcast will inspire your teaching, and offer ideas that one this or no I have not. And giving them some last mi you can integrate into your own course. For more information on ute just in time support, it re lly does improve the final prod the resources included in this episode, please check out the cts that they turn in and has een really helpful for me. links provided in the episode description.