September 2017 Scoring

  • If you want to know something about the GRE subject test in physics then chances are you will find it in here.
  • If something about the physics GRE it isn't already discussed in here then please put it in here.

Post Reply
perpetualtoms
Posts: 2
Joined: Sun Sep 17, 2017 11:20 pm

September 2017 Scoring

Post by perpetualtoms » Sun Sep 17, 2017 11:24 pm

I just took the physics GRE two days ago, and the instructor / booklet both said incorrect answers would not be penalized. I asked the instructor to clarify, because I am used to the -1/4 of a point for every incorrect answer, and 0 points for every question left unanswered. Has this been other's experiences? I am still a bit paranoid about it.

tamdm6
Posts: 1
Joined: Mon Sep 18, 2017 4:15 pm

Re: September 2017 Scoring

Post by tamdm6 » Mon Sep 18, 2017 4:18 pm

I took it the 15th as well, and was told the same thing. If you look at the instructions on the GR1777 practice exam ETS released, it says the same--that incorrect answers are not counted against you, and it still shows a 15 point curve. I'm curious to see how this will change scoring.

perpetualtoms
Posts: 2
Joined: Sun Sep 17, 2017 11:20 pm

Re: September 2017 Scoring

Post by perpetualtoms » Tue Sep 19, 2017 10:28 am

Yeah, I wonder if it will have any effect on percentile rating. Thanks for the reassurance.

TakeruK
Posts: 941
Joined: Mon Jan 02, 2012 3:05 pm

Re: September 2017 Scoring

Post by TakeruK » Sun Sep 24, 2017 8:57 pm

It will not change the percentile rankings any more than any other new GRE test changes the percentile ranking (i.e. each year, the population of score used to calculate percentiles is updated because they add the most recent year's tests and removed the oldest year).

Remember that the scoring goes like:

Raw Score (out of 100) --> Scaled Score (out of 990) --> Percentile Ranking

The point of converting Raw Score to Scaled Score is to normalize between difficulty between test years or test versions within the same year. So in theory, everyone's raw scores after September 2017 will be a little higher than the raw scores of test takers prior to Sept 2017. However, the distribution of scaled scores should not be affected by this offset. That is, if everyone gets X percent more points than they did previously since they no longer lose 1/4 points for wrong guesses, this is similar to applying a constant in the raw score and that would be scaled out.

However, I can think of one reason why the scoring might be messed up. What if a large fraction of people didn't know about the new scoring changes. In the worst case scenario, 50% of test takers don't know the change and 50% of test takers do. Then, only half of the test takers will get a raw score "boost", resulting in them getting disproportionately higher Scaled Scores.

But I don't think this is a major concern. This change provides a slight advantage for September 2017 test takers that listened closely to the instructions but I would imagine the small change in scaled score is far less than the ETS published "uncertainty" in subject scores (close to 70-90 points in the 990 scale).

This change will also not affect the percentile ranks of anyone else who took this test prior to this change, for now. The Scaled Score-->Percentile Ranking table only gets updated once per year (July 1). All your scores reported in this application season compares your Scaled Score using test results from July 1, 2012 to June 30, 2017. The scaled scores of the new scoring change will only enter the Scaled Score-->Percentile Rank table for the 2019 application season. This means you might be most disadvantaged if you took the test in April 2017 but do not start applying until the Fall of 2018 (for 2019 start). However, this would only be 1 out of 5 years.

Note also that this "advantage" or "disadvantage" could only really occur if the distribution of scores for the Sept and Oct 2017 tests are skewed because half of the people did not know about the change. This might not even be the case. And the number of people who might gain such an advantage would be very small.

All in all, I do not expect even the worst case scenario to change someone's scaled score (and thus percentile rank) by very much, certainly not more than the large variance in the test scores.

animephysics33
Posts: 6
Joined: Thu Nov 09, 2017 9:36 pm

Re: September 2017 Scoring

Post by animephysics33 » Sun Nov 19, 2017 11:14 pm

TakeruK wrote: However, I can think of one reason why the scoring might be messed up. What if a large fraction of people didn't know about the new scoring changes. In the worst case scenario, 50% of test takers don't know the change and 50% of test takers do. Then, only half of the test takers will get a raw score "boost", resulting in them getting disproportionately higher Scaled Scores.
I will admit I hoped that some people did not know about the change, because I kind of discovered it at the last moment in an unexpected way myself. That said, it was announced at the start of the test about the change. So I think ETS wanted everyone to know and it was mandatory for the proctor to read out this new change so this unfair scenario does not arise.

Darrinallen
Posts: 5
Joined: Wed Jul 18, 2018 12:09 am

Re: September 2017 Scoring

Post by Darrinallen » Wed Jul 18, 2018 12:14 am

So we are no longer penalized for incorrect answers?



Post Reply