Showing posts with label Grading. Show all posts
Showing posts with label Grading. Show all posts

Tuesday, July 7, 2020

What We Know About Grading (Reflections)

I just finished reading What We Know About Grading: What Works, What Doesn't, and What's Next by Thomas R. Guskey and Susan M. Brookhart. The book was mostly about the research that has been done considering grading practices and it culminates in a discussion about standards-based grading. There is a great deal of useful information in the book that is all backed by copious amounts of research, but this reflection is mainly for my reference and therefore only includes information that is new to me or especially resonates with me. Any sentences or phrases in quotations come directly from What We Know About Grading. Here are my thoughts and reflections:

Using a 4-Point Scale:

I will be using a 4-point scale when grading formative and summative assessments in my classes. I will not grade everything, but the things that are will be based on 4-point rubrics (Minimal, Approaching, Proficient, and Mastery).

Apparently, using a 4-point scale instead of a 0-100 scale will allow me to be more accurate in assigning grades and giving feedback. "Teachers were much more consistent when using grading scales with fewer categories, especially those with five categories or fewer." (18)

"The three most important [suggestions concerning grading] relate to criteria, consistency, and categories in grading." (26)

"(1) clearly define the criteria, (2) clearly specify the weight or relative emphasis each criterion should contribute to the grade for the piece of student work, and (3) apply the criteria and weights consistently." (27) To apply criteria and weights consistently, "use scales that don't require finer distinctions than you can reliably make." (30)

I will be using 4-point rubrics that will be readily available for students so the criteria and the points that can be earned are clear, and points will be awarded consistently. 

"When well constructed, grading scales with fewer categories that describe clearly distinct levels of student mastery or proficiency are not only more reliable, but also offer students better information to guide improvements." (220)

Grading for Mastery, not Behavior

"Teachers must also make sure these criteria describe students' learning and not simply how well they followed directions." (27) "...grades should be readily interpretable indicators of knowledge and skills in a content area." (63) "SBG practices are not easily standardized. Teachers may continue 'hodgepodge grading...' teachers clearly struggle with separating academic achievement from behaviors that support learning." (127)

It's very important that behavior and achievement are not reflected in the grade book together, as the grade should reflect student mastery of the standards. For example, taking late points off would be punishing a behavior, which has nothing to do with what the students have learned.

"One critique of using grades to assess conative factors [e.g. interest, volition, and self-regulation (p. 39)] is that teachers may award grades based on students appearing engaged but just going through the motions (procedural engagement) rather than on legitimate effort and participation that leads to increase learning (substantive engagement)." (41)

I have a real issue with giving "participation" grades. I will award points according to a 4-point rubric during a discussion, but I will not give participation points anymore. The rubric (in progress) will require students to show mastery of a skill, such as argumentation or use of evidence.

Objectivity

Grading can never truly be objective as a human being will be assigning points, but teachers can strive to be as objective as possible by making grading as anonymous as possible. "For constructed-response assessments, grade all students' responses to one question before moving onto the next question." (28) I tend to do this a lot, mostly because it is quicker, but I realize how this can also help protect the anonymity of my students. This is important because no matter how much I try to not be biased, bias is always there. Google forms allows teachers to grade quizzes one question at a time. Doing this digitally can also stop teachers from recognizing handwriting as well.

SBG Practices to Consider

"Using the same achievement-level indicators that appear on state or provincial assessments"
"Organizing gradebooks by standard instead of by content area"
"Involving students in grading" (125)

The three practices listed above are repeated here to help remind me to implement them. I want to look into our state assessments as well as the ACT and look at the reading standards (Social Studies standards are rarely assessed on their own) so I can see how well they match up to our standards by grade level. I also plan to set up my gradebook according to my power standards (such as use of evidence). Once my rubrics are created, I can also require students to self-assess.

Report Cards

"...teachers might reflect on the following questions before finalizing report cards: (1) What evidence have I collected with respect to this specific standard? (2) What are the strengths and limitations of the evidence? and (3) Based on the evidence I have, does this grade accurately reflect this student's performance?" (127)

"Teachers implementing SBG said that [SBG report cards] took longer to complete than traditional report cards, but that the additional time was worthwhile due to the improved quality of information." (129)

Educating All Stakeholders

We need to make sure that all people involved understand SBG, otherwise, the confusion can breed contempt. Once students and parents understand the process, they will be more likely to stand behind it.

"...successful implementation [of an SBG system] requires a multipronged approach, including (1) efforts to ensure that both parents and teachers understand the curriculum so they can accurately interpret report cards; (2) substantial district support for SBGs, including workshops and trainings for both parents and teachers; and (3) clear communication and marketing to parents." (130)

Concerning State Tests

"The evidence base that does exist reveals that while SBG and assessment results are related, they reflect different aspects of a skill and therefore should not be expected to perfectly match. This is because SBG reports at a different level of granularity than a state test. SBG also reflects the results of multiple assessments administered at different times and uses a variety of methods to gauge performance. Therefore, while some policymakers may hope that SBG implementation will increase the consistency of report card grades and assessment results, perfect consistency is not a realistic goal." (136)

State testing is continually problematic. Just because SBG doesn't correlate completely doesn't mean that it is bad practice.

The Bell Curve Isn't a Law

"With a standards-based grading approach, grades are not based on a student's relative standing among classmates, which positions students to compete with one another. Standards-based grading is success- rather than punishment-oriented." (171)

I have gotten some feedback from stakeholders asking why so many students in my classes receive A's. Many people think that if many students are getting A's, that means that the class is too easy, the teacher is grading too easily, etc. In fact, if students are mastering the content, A's will be earned! The bell curve is no longer accepted as a "law" in education.

Content and Process

"To separate 'content goals' from 'process goals' is not only a fool's errand-it's inaccurate and erroneous. Students must be able to do something with the content." (216)

The old WI State Social Studies standards were mostly focused on content instead of skills. They were written in the 1990s and were better suited for an education system that focused on memorization. I'm happy that changes have been made to reflect changes in pedagogy. The new WI State Social Studies standards focus more on skills than on content, but it would be impossible to teach content without including the skills and vice versa. Teachers are required to cover specific periods of time, but the content covered is mostly up to the discretion of the teacher. This is perfect for classes that allow a great deal of student choice, as possibilities are endless.

The Purpose of Grading

The purpose of grades is to serve as feedback for students. However, a score of 2 out of 4 means nothing on its own. Feedback must be specific and meaningful, so students know what they need to do in order to improve.

"...grades can serve to enhance both teaching and learning if we focus on their use as feedback (formative) rather than as evaluative judgments (summative)..." (217)

"When paired with individualized guidance and direction for improvement, [grades] also help direct learning progress." (217)

"...grades do not reflect who you are as a learner, but where you are in your learning journey--and where is always temporary. Knowing where you are is essential to improvement." (217)

"When combined with guidance to students and parents on how improvements can be made, grades can become a valuable tool in facilitating students' learning success." (218)

Standard Error of Measurement

"...over multiple administrations of the assessment, the same student might get one or two more items right or wrong, simply due to imprecision in the measurement instrument (i.e., the assessment)." (219)

Sometimes it is necessary to assess students' understanding of content-related vocabulary. I have created a 4-point rubric to assign a grade to a student's level of mastery of the vocabulary. In cases such as these, students often get angry that a score of 8-10 are both recorded as a 4. Students wonder why, if they earned a 10, they get the same score as someone who got a question wrong. The reason for this is the standard error of measurement. A student can take the same test multiple times and get questions wrong that they got right before, and vice versa. I've seen it when students retake assessments!

Here is the rubric on the test, though the questions/terms are not included:

Standard Addressed:


SS.Hist1.a.h.G

I can evaluate how different groups and individuals contribute to an event or cause

4 - Mastery

3 - Proficient

2 - Approaching

1 - Minimal

0 - Insufficient

Student can accurately describe how at least 8 of the following terms contributed to the Age of Exploration.

Student can accurately describe how at least 6 of the following terms contributed to the Age of Exploration.

Student can accurately describe how at least 4 of the following terms contributed to the Age of Exploration.

Student can accurately describe how at least 2 of the following terms contributed to the Age of Exploration.

Student cannot accurately describe how the following terms contributed to the Age of Exploration.


Reporting Multiple Grades in the Grade Book

"Combining disparate measures into a single, overall score or grade rarely yields anything useful or meaningful." (220)

"A more useful and meaningful description of students' performance includes multiple grades. At a minimum, it provides grades that distinguish product, process, and progress learning criteria." (221)

Right now I can make different categories in my grade book and decide how much (percentage-wise) they are weighted. I will choose 4 power standards and make them equal (25% each) and categorize my assessments within these categories.

Main Takeaway/Conclusion

"Starting with clear learning goals, focusing on the important feedback function of grades, limiting the number of grade categories, and providing multiple grades that reflect product, process, and progress criteria will greatly enhance the meaning and accuracy of that communication." (223)

Monday, July 6, 2020

Standards-Based Grading Update - July 2020

Since beginning my work on standards-based grading (SBG) practices, I have come a long way.

This reflection covers my first experiences with SBG, my efforts over the years, as well as my future plans.

I hope to have SBG fully implemented within the next couple of years. The process of implementation is one that cannot be rushed into, a lesson that took me a while to learn.

My Early Experiences with SBG

First of all, I have been interested in standards-based grading since I began teaching in 2014. As I was one of three middle-high school Social Studies teachers in a very small district, I had many different classes to prep for. This was my workload during my very first year of teaching: US History, World History, Government, AP US History, and AP Government. Talk about overwhelming. I made it through and I am a stronger teacher for it; the one regret that I have is that I wasn't able to dig deeply into standards-based grading right away.

I tend to be someone who dives in head first, gets overwhelmed, and then slowly backs away from my new initiatives a few months after they start. Standards-based grading is not one of those initiatives. I began to read about SBG in 2014 and I have reached out to my PLN on Twitter and within my school community to discuss grading practices.

I really got serious about SBG when I moved to a new district, as I was less involved in meetings and teams and had more opportunity to focus on grading practices, which really should have been my priority in the past. I also had a great PLN at my new school that was dedicated to SBG. I had a wonderful PLN at my last district whom I miss a ton, but they weren't as far on their SBG journey as my new colleagues are. The expertise of my new colleagues has greatly advanced my understanding of SBG and I am very glad to have them!

In addition, I began to reach out to my virtual PLN on Twitter more often asking for advice on SBG and my process. In 2018, the state of Wisconsin released the new Social Studies standards and my work could really begin. The 2018-2019 school year (my first in my new district) was dedicated to unpacking the new standards and really understanding what was required of my students. I also redesigned many units to fit the new curriculum, though I did not have the opportunity or time to complete them all. I have to remind myself that this is ok, as change takes time!

Since the 2019-2020 School Year

The 2019-2020 school year was focused on writing new assessments to match the standards and working to align learning activities to the standards. This is where I fell behind a bit. The assessments certainly assessed the standards, but daily learning activities were not always meaningful and many ended up being busywork. I greatly regret this, but again, change takes time.

During the last quarter of the 2019-2020 school year I worked with my student teacher on creating a full SBG unit, backward-designed and all. I discuss that unit in my post titled "Inquiry Mindset: Types of Student Inquiry (Including my "Global Interactions" unit)." Before creating the unit, we chose power standards. Then we decided which unit to create (Global Interactions) and walked through the standards that related to this unit, choosing which ones we could feasibly address within the time frame of the unit. We broke down the standards and created 4-point rubrics for them. (This is another development - the 2019-2020 school year was the first in which I switched my grading scale to a 4-point scale, though I still had to convert it to a 100-point scale. Formative assessments were graded this way, but summative assessments were graded based on the number of questions. In the most basic example, a 30-question test would be worth 30 points. This is not representative of SBG and is something that I am working on.)

I will be using the Global Interactions unit as a model for future units that I create. It will take a great deal of time to create brand-new units, so I am trying not to bite off more than I can chew. I will focus on World History first and create new units and assessments. Then I will find or modify learning activities that help students practice the skills that they need to master. After World History is completed, then I can move on to US History, then Economics, then Psychology, and finally, Sociology. This process will take a great deal of time, so I need to remember to be patient.

Along my SBG journey, I have done a lot of reading and collaborating to better understand the process and implement SBG in my classes. (It is something our district is thinking about, but we are nowhere near being able to have all classes take part.) In the summer of 2019 I took part in a Book Club. Here are my updates from the book club:

I have included my key takeaways and my reflections on the takeaways:
  • Unpack the new Social Studies standards that Wisconsin has recently approved
  • Write student-friendly learning targets using the standards
  • Organize my grade book categories into learning targets
    • I'm planning on determining how to do this before next school year. Depending on how school resumes, I might not put this into practice yet. If we are continuing remote learning, it could just get very confusing for students and parents with all of the other new things we'll probably be implementing for virtual learning.
  • Focus on skills (easy with the new standards) and find ways to provide student choice in the content they study
    • Working on it! New learning targets focus on the skills, but I have to be intentional in making sure that my everyday learning activities sync up to the standards as well. Student choice will be easier to allow once my inquiry units are set up. I have one completed, but others in progress. Each inquiry unit focuses on one compelling question. Students will choose which topics they want to research in order to answer the compelling question. More on this later as this process develops. This Civil Rights lesson plan is one example of how an inquiry could be set up.
Inquiry

To better prepare for SBG, I have also been delving into inquiry. The new WI State Social Studies standards include the following strands: Behavioral Sciences, Economics, Geography, History, and Political Science. The standards also include a strand titled Inquiry.

I have begun research into how I can incorporate more inquiry by taking part in MOOCs and by reading Inquiry Mindset by Trevor Mackenzie and Rebecca Bathurst-Hunt. To see my reflections on inquiry, please view the posts labeled with "Inquiry."

So Far This Summer and Next Steps

So far this summer (besides reading Inquiry Mindset) I have read What We Know About Grading: What Works, What Doesn't, and What's Next by Thomas R. Guskey and Susan M. Brookhart. I will be writing a blog post including my reflections from that book soon.

My next endeavor is to read Grading from the Inside Out: Bringing Accuracy to Student Assessment Through a Standards-Based Mindset by Tom Schimmer.

I have a lot planned for this summer, but I believe it is important to do as much reading as possible before trying to write more curriculum. I want to make sure that I am doing it correctly, as I often just forge ahead and then realize that I have to revise. Revision is a natural part of the process, but research should come first.

Monday, July 22, 2019

#SBGBOOKCLUB 2019: Rethinking Grading Part 2

Rethinking Grading: Meaningful Assessment for Standards-Based Grading


Alternative Ways to Give Feedback

I can use starter questions at the beginning of class. In my gamified class students can earn XP for answering the starter questions. Review games (Kahoot, Quizizz, Gimkit) are another excellent way for students to practice multiple-choice knowledge. Go Formative also offers many different types of questions that a teacher can ask and students answer the questions online. Sprinkling in challenges and competition can be very engaging for many students, and they are more exciting than quizzes. Classcraft also offers a formative assessment in the form of a "boss battle," where correct answers equal an attack on the boss.

Don't Grade Everything

We should not penalize practice. If a student tries an assignment and does most of it incorrectly, we should offer feedback and a chance to try again instead of assigning a low grade and moving on. If every task is assigned a point value, then tasks without points are considered worthless. The goal also just becomes a hunt for as many points as possible, not to learn the concepts and skills.

My Future Plans

  • Introduce students to the learning target and have them self-assess. This serves as a pretest before teaching.
  • Only summative scores should count in the final grade
  • “Find it and fix it” - teacher tells students how many questions are incorrect, but not which ones they are; students have a chance to fix their answers
  • Mastery checks
    • Green - Basic skill problems
    • Yellow - Require multiple steps/ideas to solve
    • Red - new types of questions; go beyond and apply knowledge to a new situation
  • Analogy
    • Feedback = rehearsal
    • Formative = dress rehearsal
    • Summative = performance

First Steps to Grade Reform

My first goal is to focus my grade book on the standards instead of on individual tasks. I have already stopped grading for behaviors, as gamification in my classes has taken on this role. Instead of deducting points for late work or cheating, students lose health points in our game. Hopefully, cheating will not be a problem once I completely stop grading classwork.

Changing the Schedule

We currently have collaboration time for teachers once a week, but I spend my collaboration time alone. There are 2.5 Social Studies teachers in our district. One is teaching a reading intervention during collaboration time, and the other leaves school for the day before collaboration time. As such a small school, we have not been able to find a financially feasible way to make time for collaboration for all teachers.

Takeaways

I think the most important step in switching to standards-based grading is making sure that all stakeholders understand the process, as well as why the teacher is implementing the system. It’s difficult to get parents to listen or read newsletters, so getting the word out might be difficult. There is also the potential for misunderstanding. As long as students understand the system, they can help their families understand as well. I also like the idea of making information about my grading policy available on my teacher website, which is linked through the district website. I can also link my policy on Google Classroom for student access. Administrators can also back up the standards-based grading philosophy. My administration supports the idea of standards-based grading, so I am fortunate in that regard.

#SBGBOOKCLUB 2019: Rethinking Grading Part 1

This summer I am taking part in a book club about Standards-Based Grading, hosted by Kathryn Byars. (Blog) (Twitter)

The book club focuses on three books:
  1. Rethinking Grading: Meaningful Assessment for Standards-Based Grading by Cathy Vatterott
  2. What We Know About Grading: What Works, What Doesn't, and What's Next by Thomas R. Guskey and Susan M. Brookhart 
  3. Grading from the Inside Out: Bringing Accuracy to Student Assessment Through a Standards-Based Mindset by Tom Schimmer
I am going to keep track of my reflections from the book study here. I am not going to post the questions that Byars posed to us, as those are her words. My reflections will explain my thoughts as I was reading through each book and determining my philosophy as well as what I have been doing and what I will be changing in the future.

This is the first part, focusing on the first book:

Rethinking Grading: Meaningful Assessment for Standards-Based Grading


Student Ability and Student Grades

I have seen a disconnect between student ability and student grades in my own classroom, even this school year. There are always those students who refuse to do daily work or projects but ace every test. In my classes, normally this student could still have a good grade due to the fact that summative scores are 80% of the final grade and 20% are formative scores, but students that don’t do summative projects lose out on major summative points there. I’ve always struggled with that. Projects are summative, as they showcase a student’s learning, but should I put projects and tests in the same weighted category? If I do that, students who do not complete projects still fail, even when they can easily pass tests and show mastery that way.

On the other hand, there are those students who ace every daily work assignment, but fail test after test. I know that cheating has been an issue this school year, and I aim to focus on changing that. Many students cheat due to the pressure to get a good grade on the assignment, or they aren’t engaged, or they don’t see a purpose in the assignment. I want to focus on making the work more purposeful and engaging.

Empowering Students to Own Their Learning

I try to allow choices for students, but often students go with what they consider to be the safest choice. For example, I do a year-end project that is a short research project. Students are given choices as to how to present their project (Adobe Spark video, Google Site, children’s storybook, slideshow, etc.). 90% of students choose to do a slideshow. I’ve thought about getting rid of that option, but I want to allow students choice. We have also completed projects in various mediums throughout the school year, so students have exposure to all of the choices.
We also do the National History Day project, where students get to choose their own topic. This empowers students to create a project on a topic that they are interested in.
I certainly need to empower my students more, but I think I need a structure in place first. Telling students that they are in charge of their own learning can be daunting for students who are unaccustomed to that. They often don’t know where to start, so I need to have some sort of structure to get students going. The structure will also make sure that students are focusing on the skills and content that they need to master.

Teaching Behaviors vs. Teaching Social Studies

Students that play the game of school well (speak nicely, behave, sit still, turn in your work) get good grades, though they might not have mastered the skills. Also, often students are more focused on the number of points than on the learning itself. For example, I had a student tell me that he wasn’t going to do any daily work assignments because they only affected 10% of his grade. I plan to stop grading daily work in the future, which won’t necessarily make more students complete the work, but it will help us all focus on the purpose behind the daily work (practice!) rather than the points attributed to the assignment.

Does Rigor = Few High Achievers?

Rigor does not mean that only a few students receive high grades. Some teachers might believe that assigning difficult work is rigorous, but it isn’t helping students learn if it is too difficult for them to complete by using their current skill set and possibly some help from the teacher. A class can challenge students, help them learn, and help them succeed (therefore the students earn high grades) all at the same time. The point is to help students learn, not punish the students that aren’t quite at the same level as the highest achievers who can complete the work all on their own. All students should be able to earn high grades if they show mastery.

"Deserving" an A

A student who works to achieve mastery and, even if they need help, they master the skills, they deserve an A. If a student does not show mastery, they will not receive an A, but it doesn’t mean that they don’t deserve it. Given fair opportunities and ample time to learn, every student should be able to master the necessary skills.

Quantity v. Quality

The new Social Studies standards in Wisconsin help provide an outline for how to do include more higher-level thinking skills instead of focusing on covering a great deal of specific content. The standards focus on inquiry and analyzing sources rather than on the content, which used to be the focus. We are required to cover all essential time periods for US History and World History as outlined in the introduction to the standards, but each individual standard focuses on skills instead of content. This really helps, as I can pick out important topics from a specific time period (say, the Progressive Era), and students can choose which topic they would like to focus on. As a class we would work on thinking skills such as identifying the author’s point of view and determining how their point of view affects the information that they include in their source. I would model one to the class, work through one with the class, and students could practice on their own after choosing the topic that interests them (work safety, women’s rights, social welfare, conservation, etc.). Students can have plenty of practice with the skills, but they won’t have to remember each and every Progressive Era reformer that is mentioned; just the significance of the era and how to analyze sources.

Benefits of SBL

The benefits of a standards-based learning classroom include students learning at their own pace, a focus on mastery instead of speed, opportunities for students to take risks and challenge themselves without being punished, and students better understanding the importance of the work that they are completing. Challenges include being able to help and reach every student in a system like this. As a high school teacher with 150-200 students per day and some classes with 30 students, it can be very difficult to tailor instruction in a way that helps every student learn, not to mention keep track of that learning. My issue would be setting up a system, but once in place, I know that management is attainable.

Changing the Way We Grade

I agree with Vatterott for the most part that we should only grade learning and there is no one-shot grading. There are some instances in which deadlines cannot be avoided, such as our National History Day projects. The projects must be completed in time for judging at our local contest, but this does not mean that learning stops. I allow revisions to be made on the projects even after the contests are over, and even if students do not make it to the next level. The initial project must be done to be judged, but revisions can be made later. Another project that I do is a Shark Tank project in which members of the community come in to be the sharks. The projects must be done to present them when the sharks are present. Understandably, revisions to both projects can be made after the initial deadline, but there must be a project to present. This is where I struggle; do students lose points for not having their project done on time to be judged? It is not fair to ask the judges to return simply to judge one project, and it is not authentic to have a random teacher or administrator be the judge.
Last year I graded almost everything and, naturally, was drowning in grading all of the time. Most of it was meaningless, and I knew it, but I didn’t know how else to get students to do the work. I’m working on changing that next year as I substitute worksheets with more meaningful and authentic work and make sure that students know why we are doing something and what the value of the work is. I never stuck to “one-shot grading” and always offered chances for retakes or revisions, but I feel like I have to incorporate a deadline, otherwise, I get piles and piles of retest requests or revised projects at the end of the semester and there is no time for me to grade it before grades are due for report cards.

Shifting the Grade Book to Learning Targets

I want to do shift my grade book from tasks to learning targets so badly, but I’m not sure where to start! I’ve done tons of research but have been unable to whittle down to something that is manageable for me to put together. My thoughts are that I would like to make each standard into a category, and then have tasks within each standard. As a beginner, it would be too difficult for me to only have the standard in there once, as I won’t know how many times we will be addressing a particular skill throughout the year.

Key Takeaways

My key takeaways this week are as follows… I plan to...
  • Unpack the new Social Studies standards that Wisconsin has recently approved
  • Write student-friendly learning targets using the standards
  • Organize my grade book categories into learning targets
  • Focus on skills (easy with the new standards) and find ways to provide student choice in the content they study
Read my July 2020 update here.

Wednesday, August 8, 2018

Hive Summit - Rick Wormeli - Reflection on Grading Practices