Just by looking at the second picture, it seems to me that taking these fate-determining tests on the computer would be a welcome change because there is more privacy, depending on the testing site of course. When I took the GRE on the computer, I was at a testing site that looked very similar to the one in the picture above. I thought this was awesome because I had my own little cubby with dividing walls, so I couldn't see anyone else and they couldn't see me. I was even provided with silencing headphones. Sitting down to take this test, I was optimistic that this was going to be easy to take since I wouldn't have to flip between pages and make sure my answers were bubbled in dark enough. Halfway through the test though, my eyes were watering and I had a headache (why did I choose to wear my contacts for a five hour test that consisted of starting at a computer screen?). My experience with digital-based testing illustrates to me that maybe we need to rethink making the switch from paper to computer.
In Educ 504, I attempted (and failed) to answer some questions from the 12th grade math portion of the Smarter Balance assessment. On the first question, the calculator tool froze on top of the question and I couldn't get it to go away, so I tried to just move on to the next question. This seemed like a logical idea, especially since students are often told to skip something if it's too difficult and then come back to it at the end. Unfortunately, this assessment forces students to put some answer before moving on to the next. I do not think that this is a good tactic because students might try to spend more time writing something in the answer space, which is very time inefficient. Not all digital-based tests force this upon students, but there are other cons to taking a test on the computer:
- Navigating the pages might be difficult
- Students might not be familiar with the icons
- Split screens make things very busy
- Students can't really "talk to the text" unless they write on the screen (I think this is discouraged?)
- Inefficient scrolling techniques cause a loss of valuable test time
- The mouse might be hiding
- Students might not be skilled typers
- There might not be any scratch paper
- Puts extra stress on students (especially their eyes...)
You get the idea, right? On the other hand, there are some pros to switching to taking a test on the computer:
- The test is cheaper to produce
- Scores are received much quicker, if not instantaneously (it can feel like 7.5 months before you get the paper scores back...)
- There is no hassle of labeling the tests and sorting through them
- Students can tag specific questions to easily find at the end to review
Even though switching to digital-based testing might seem like a really good idea at first, I don't think it is necessarily better than paper-based testing. "Reading linear texts on paper versus computer screen: Effects on reading comprehension" was a Norwegian study that discovered that students who read texts in print scored significantly better on a reading comprehension test. This research demonstrates that students do better on paper-based tests, so it is very confusing to me as to why so many people are advocating for digital-based tests. Have these people never taken a test on the computer before? Do they care more about costs than student growth and learning? If money is the driving force behind this decision, then we need to elect new people to make these decisions.
I believe that the most important aspect of standardized testing should be to try to assess what level students' are at in their learning in order to evaluate teachers and help these said teachers to revise their lessons to better equip their students for future courses and life in general. The cons of digital-based testing outweighs the pros for me, so I think that it is important that we do not let paper-based testing become obsolete. At the very least, we should give students a choice of how they want to take the test, such as how the MTTC test gives students a choice between paper and computer.
Do you advocate for paper-based or digital-based testing? Both? What factor weighs the most in your decision?
Hey April,
ReplyDeleteI think it would be a good idea to give paper and computer-based tests, especially for students who would like the more traditional way of taking them. I wonder if students ever get a chance to practice withe Smarter Balance assessment, because there were a gazillion icons on the top and it took me a bit to find the "next question" button.
When I was in high school, we had to take the Prairie State Exam, which is the equivalent to the MEAP here in Michigan. At that time, the PSE had a full-length ACT in it, and everyone took it, whether or not they were going to a four-year college. Our English teacher spent a good chunk of time giving us practice English/Reading ACT sections and we would have to practice in class. At least then we would know what to expect. It was the same deal with AP Spanish; I had no intention of taking the AP test, but I still had to participate in the practice test, which we took on the computer. So in case I did feel like taking it, I would have an idea of where different icons were located and how to navigate my way around the test.
You bring up a good point with your technical difficulties; nobody ever mentioned what would happen if your computer froze while taking the GRE or MTTC, or if your calculator wasn't working. I also don't know why we can't bring our own calculators. I could bring mine for the GRE, but the MTTC supplied a 4-function calculator... on the computer. It was rather irritating to use.
I really do like computer-based testing, but there are some improvements that need to be made. I liked how I got my scores instantaneously (for the GRE, but not the MTTC) and I liked how the questions were computer-adaptive. I didn't like how I couldn't skip ahead. Let's hope they change things in the near future!
April, you bring up great questions. I agree with you, I miss the good ol' days where we could feel the test and fill in our own bubbles. I personally prefer paper testing as opposed to computer based testing. My eyes are not made to stare at a screen for 5 hours. I feel that it is definitely harder to concentrate when I'm looking at a screen. I also agree with you that students should have a choice on what kind of testing they want to take. The MTTC is a great example! I had an easier time getting through the test as opposed to when I took the GRE. I do think it has a lot to do with cost of the test and the amount of time it takes to get the scores. It is also easier to grade.
ReplyDeleteApril, you bring up great points for this discussion. I think it was very useful that you brought up the positives of taking standardized tests, as opposed to only the negatives of it. I also really like that you used your own experience on a computer based standardized test. I agree with you one hundred percent that having my own cubby space and noise-blocking ear phones helped me when I took the GRE, but I also agree that it was tiring reading on a screen for hours at a time. Maybe a solution for that would be to have more tests but for shorter periods of time.
ReplyDeleteI also really appreciated the option of taking the MTTC on paper. It was absolutely worth getting up ridiculously early and driving to downtown Detroit in order to be able to read the questions off the paper. On that topic, one would think that the computer test would be cheaper to proctor but the paper version of the MTTC is way cheaper. I wonder why? Anyway, to answer your question, I advocate for students being able to choose their preferred interface.
ReplyDeleteApril, I have posted similar responses to other posts, but your blog once again causes me to think, somewhat negatively I may add, about the intention of policy makers and educational administrators that are voting for and allowing for digital testing to take over the realm of standardized tests. I hope and pray that somehow they know the future and see that it'll benefit students' learning in the long run, but the more obvious choice is that they are doing it with money and politics in mind. That's tough to digest, but I guess as teachers we just need to work on what we can control. To respond to your question, offering the choice of paper or computer testing i think is great! How to implement it with students rather than independent adults is something to consider.
ReplyDeleteApril, really like your creative way of expressing the pros and cons on digital and paper based. Looking at those pictures I was wondering, how nice it would be if we could write paper based exams in the private cubby. I used to hate the big exam halls, and but I am also not a fan of computer based tests.. my eyes water as much too.. and I remember I just collapsed on my couch after finishing GRE.. it was physically strenuous.
ReplyDelete