S&P+ rankings: Overperformance or overcorrection?

[satyanash 14276]

S&P+'s spread picks are out this week. They have Texas Tech winning 35-31.

[El Hornarino 367]

Good thing the game was played this week.

[satyanash 14276]

S&P+ win probability for the rest of the year. They have the Iowa State game as a literal tossup.

[El Hornarino 367]

Literally literally, or figuratively literally?

[satyanash 14276]

Updated S&P+ rankings: we're now at #41, up one spot from last week. Other quick notes:

- Only two Big 12 schools are featured in the top 15: Oklahoma at #5 and WVU at #12. We're the 6th-best team in the Big 12, behind the aforementioned two plus Iowa State, Tech, and Okie lite.

- USC is now ranked at #36, 5 spots ahead of us O_o They jumped 7 spots after losing to Cal. Tech also jumped 7 spots after losing to us.

- Among in-state schools, we're behind A&M (#21), North Texas (#24), and Texas Tech (#26). We're ahead of Houston (#43) and TCU (#67).

- Our expected win total is now 8.4. The Iowa State game is a tossup thanks in part to our home-field advantage, while we're heavily favoured to beat Kansas.

Edited November 12, 2018 by satyanash

[Ricky Butler 2657]

5 hours ago, satyanash said:

- USC is now ranked at #36, 5 spots ahead of us O_o They jumped 7 spots after losing to Cal. Tech also jumped 7 spots after losing to us.

I like what Bill is trying to do, but I've never followed his rankings this closely week-to-week. How is this possible? Is our ability to give up big leads late short circuiting his system?

[DanRydell 799]

I think looking at week to week movement is silly in computer rankings. One of their major benefits relative to human polls is they don’t simply move teams up and down based on the prior week’s games.

For example, a human poll gives LSU a major boost for beating #8 Miami and #7 Auburn over the first three weeks of the season and then just moves LSU up or down based on their performance week to week, without ever really looking back and reconsidering the value of those wins over what turned out to be fairly mediocre teams.

[Ricky Butler 2657]

24 minutes ago, DanRydell said:

I think looking at week to week movement is silly in computer rankings. One of their major benefits relative to human polls is they don’t simply move teams up and down based on the prior week’s games.

For example, a human poll gives LSU a major boost for beating #8 Miami and #7 Auburn over the first three weeks of the season and then just moves LSU up or down based on their performance week to week, without ever really looking back and reconsidering the value of those wins over what turned out to be fairly mediocre teams.

I guess I'm saying, I don't understand what data you could get from the Tech game that moves them up 7 spots (and still ahead of us). We entered the 4th quarter, on the road, with a lead against a team that is better than us (according to his rankings). 

[GabrielsHorn 2142]

He really undervalues turnovers and we gave up a shit ton of yards to Tech. 

Again, I’ll repeat that this system is given way too much credence on the internet. FPI, FEI, and Saragin are all much higher on us, and when you average the systems, S&P is towards our lowest ranks. 

[dcar00 14023]

5 hours ago, GabrielsHorn said:

He really undervalues turnovers and we gave up a shit ton of yards to Tech. 

Again, I’ll repeat that this system is given way too much credence on the internet. FPI, FEI, and Saragin are all much higher on us, and when you average the systems, S&P is towards our lowest ranks. 

turnovers are luck in his model. if you win close games due to turnover advantage his model basically assumes you lost.

[gmr548 16463]

18 minutes ago, dcar00 said:

turnovers are luck in his model. if you win close games due to turnover advantage his model basically assumes you lost.

Texas loses to TCU, OU, and Tech without unforced errors leading to turnovers so this isn't necessarialy a bad way to look at things. I would be curious to know whether or not the model views a team that consistently finishes games with no turnovers differently than one that has a string of 2-3 turnover games from opponents. Texas has lucked into a fair bit of turnovers this year but taking care of the ball like they have is a virtue. Turning the ball over only twice in seven conference games is not luck.

[dcar00 14023]

25 minutes ago, gmr548 said:

Texas loses to TCU, OU, and Tech without unforced errors leading to turnovers so this isn't necessarialy a bad way to look at things. I would be curious to know whether or not the model views a team that consistently finishes games with no turnovers differently than one that has a string of 2-3 turnover games from opponents. Texas has lucked into a fair bit of turnovers this year but taking care of the ball like they have is a virtue. Turning the ball over only twice in seven conference games is not luck.

Ok but what unforced errors?  this is the problem with his "I'm accounting for luck" model.  all our turnovers against tech were forced.  does he consider a 4th down stop a turnover?  

an unforced turnover might be a snap over a QB/Punter that is immediately recovered but there are very few unforced turnovers.

[satyanash 14276]

13 minutes ago, dcar00 said:

Ok but what unforced errors?  this is the problem with his "I'm accounting for luck" model.  all our turnovers against tech were forced.  does he consider a 4th down stop a turnover?  

an unforced turnover might be a snap over a QB/Punter that is immediately recovered but there are very few unforced turnovers.

1. Not all of them were forced. The interception from Duffey doesn't happen without the terrible snap that caused him to scramble.

2. Bill calculates an 'expected turnover margin' for each game based on the number of forced fumbles and pass breakups. He doesn't use actual turnover margin because that figure can rarely be predicted (turnovers are highly dependent on luck). So essentially it's considered an anomaly when your actual turnover margin is out of line with what's expected based on the above two factors.

[dcar00 14023]

Just now, satyanash said:

1. Not all of them were forced. The interception from Duffey doesn't happen without the terrible snap that caused him to scramble.

2. Bill calculates an 'expected turnover margin' for each game based on the number of forced fumbles and pass breakups. He doesn't use actual turnover margin because that figure can rarely be predicted (turnovers are highly dependent on luck). So essentially it's considered an anomaly when your actual turnover margin is out of line with what's expected based on the above two factors.

I knew someone would come back with that.  Duffey could have thrown it away earlier but we kept on him and he threw it up late.  if we don't stay on on him or don't get a rush he might actually complete a pass.

I realize its a predictive model but it pretty much sucks as it relates to turnovers.  turnovers are rarely "unforced" regardless of what you hear the talking head idiot announcers say.

[USNALonghorn 5024]

3 minutes ago, satyanash said:

1. Not all of them were forced. The interception from Duffey doesn't happen without the terrible snap that caused him to scramble.

2. Bill calculates an 'expected turnover margin' for each game based on the number of forced fumbles and pass breakups. He doesn't use actual turnover margin because that figure can rarely be predicted (turnovers are highly dependent on luck). So essentially it's considered an anomaly when your actual turnover margin is out of line with what's expected based on the above two factors.

Disagree. Duffey still had plenty of time after catching the snap to decide to throw it away, run it, or try to salvage the play.

[USNALonghorn 5024]

8 minutes ago, dcar00 said:

I knew someone would come back with that.  Duffey could have thrown it away earlier but we kept on him and he threw it up late.  if we don't stay on on him or don't get a rush he might actually complete a pass.

I realize its a predictive model but it pretty much sucks as it relates to turnovers.  turnovers are rarely "unforced" regardless of what you hear the talking head idiot announcers say.

Spot on. All except one of the turnovers in the TCU game were not flukes and a result of good defensive play. We won that game by two touchdowns and were in complete control of it in Q4. We don't lose that game without the "fluke" turnover.

The only potentially "fluke" turnover was when Murray tried to use the ball to prop himself up while under duress and lost it. I still don't completely consider that a fluke, since the defensive pressure contributed to that mental error.

Bottom line: turnovers are a part of the game. Defenses take pride and celebrate forcing turnovers. Announcers and analysts make note of a teams turnover margin  when discussing match-ups. It's much more often skill than luck that results in a plus turnover margin.

TL/DR: Stats are for losers. Take the win, pussies.

Edited November 13, 2018 by USNALonghorn

[Valmy77 13092]

Ok so the S&P gives us a chance to beat Iowa State? Good. 44.6% chance to finish 9-3? I will take it.

Edited November 13, 2018 by Valmy77

[gmr548 16463]

32 minutes ago, dcar00 said:

Ok but what unforced errors?  this is the problem with his "I'm accounting for luck" model.  all our turnovers against tech were forced.  does he consider a 4th down stop a turnover?  

an unforced turnover might be a snap over a QB/Punter that is immediately recovered but there are very few unforced turnovers.

Shawn Robinson derp-fumbling in Texas territory or missing a TD pass to instead check down to a wide open Brandon Jones. Kyler Murray's ground fumble thing. Duffey INT as mentioned. I am not ragging on Texas but rather pointing out they have gotten some breaks. As I also pointed out, they have consistently taken good care of the football which is definitely not a product of luck. That is why I am curious on how exactly the model incorporates turnovers.

Edited November 13, 2018 by gmr548

[Valmy77 13092]

4 minutes ago, gmr548 said:

Shawn Robinson derp-fumbling in Texas territory or missing a TD pass to instead check down to a wide open Brandon Jones. Kyler Murray's ground fumble thing. Duffey INT as mentioned. I am not ragging on Texas but rather pointing out they have gotten some breaks. As I also pointed out, they have consistently taken good care of the football which is definitely not a product of luck. That is why I am curious on how exactly the model incorporates turnovers.

If our opponents making shitty plays is a break, well we have given them plenty of breaks as well.

[USNALonghorn 5024]

3 minutes ago, gmr548 said:

 As I also pointed out, they have consistently taken good care of the football which is definitely not a product of luck.

That's a good point to bring up, because many people see turnover margin as a solely defensive statistic. Turnover margin is TEAM statistic. It's a product of forcing turnovers with good defensive play (stripping the ball, jumping routes, reading the QB), taking advantage of opposing offense's mental errors, and taking care of the football on offense. 

[satyanash 14276]

4 minutes ago, Valmy77 said:

If our opponents making shitty plays is a break, well we have given them plenty of breaks as well.

We've actually done a great job of not committing turnovers. For the season we're +7 in turnover margin, good for 15th in the nation. But like I said, part of that is luck as well.

Edited November 13, 2018 by satyanash

[Valmy77 13092]

13 minutes ago, satyanash said:

We've actually done a great job of not committing turnovers. For the season we're +7 in turnover margin, good for 15th in the nation. But like I said, part of that is luck as well.

Yeah but we have done plenty of horribad non-turnover things. Like Brandon Jones fielding that punt on the one yard line...

[HOOK'EMHOOAH 1606]

Claiming that a team executing on the defensive side by creating turnovers is luck is absurd. Luck is a human construct that does not have any basis in fact. Literally what the people who make the S&P rankings are saying when they call turnovers "luck" is "this is a variable that we don't know how to or dont want to calculate." Either way, its fucking bush league.

[dcar00 14023]

8 hours ago, satyanash said:

We've actually done a great job of not committing turnovers. For the season we're +7 in turnover margin, good for 15th in the nation. But like I said, part of that is luck as well.

so is catching a pass.

[dcar00 14023]

8 hours ago, gmr548 said:

Shawn Robinson derp-fumbling in Texas territory or missing a TD pass to instead check down to a wide open Brandon Jones. Kyler Murray's ground fumble thing. Duffey INT as mentioned. I am not ragging on Texas but rather pointing out they have gotten some breaks. As I also pointed out, they have consistently taken good care of the football which is definitely not a product of luck. That is why I am curious on how exactly the model incorporates turnovers.

kyler murray was under serious duress .  if he doesn't fall we could have just as easily stripped the ball from him.

Actually the way you are making the point, taking care of the football is a product of chance.  a guy fumbling while running wide open is chance as is jumping a route to get an INT.

The dudes model sucks as it relates to turnovers. its fine, it doesn't mean shit, but make no mistake it sucks.

[Fozzz 152]

17 hours ago, Ricky Butler said:

I guess I'm saying, I don't understand what data you could get from the Tech game that moves them up 7 spots (and still ahead of us). We entered the 4th quarter, on the road, with a lead against a team that is better than us (according to his rankings). 

You can't predict how well a team performed week-to-week in his metrics based on score.  The bulk of S&P+ is success rate/play, which may be masked in the final score by other factors (turnovers, field position, points/opportunity, etc.).  

[Fozzz 152]

5 hours ago, HOOK'EMHOOAH said:

Claiming that a team executing on the defensive side by creating turnovers is luck is absurd. Luck is a human construct that does not have any basis in fact. Literally what the people who make the S&P rankings are saying when they call turnovers "luck" is "this is a variable that we don't know how to or dont want to calculate." Either way, its fucking bush league.

Does he actually claim that turnovers are created by "luck"?  S&P+ is designed as a predictive metric, so it makes sense to discount stats that have little reliability, like turnovers, as factoring them in will decrease S&P+'s own reliability.  

[Huckleberry 32685]

Defensive interceptions and forced fumbles show clear correlations from season to season, so calling them just luck is highly questionable.

Fumble recovery rates, on the other hand, are random and will eventually average out to 50%.

[Fozzz 152]

That's correct, and I believe how he calculates his adjusted turnover margins.  

Edited November 13, 2018 by Fozzz

[Huckleberry 32685]

Others have said he uses pass breakups which seems like it may have an issue as a proxy for interceptions. Lots of interceptions aren't caused by tight coverage but by confusing the quarterback (think about Brandon Jones's INT against OU). Then there are those caused by quarterback pressure (but not sacks), etc.

[Fozzz 152]

Although Bill's not entirely clear in the formula behind S&P+, I believe he includes turnover margin in the S&P+, but gives it little weight relative to success rate due to turnover margin's limited reliability relative to success rate.  I believe he also uses adjusted turnover margin as well to account for variance in fumble recovery rate and the fact that the ratio of interceptions/passes defended has extremely little year-to-year reliability.  

[DanRydell 799]

His system doesn't say that turnovers are luck. His system says that creating turnover opportunities is skill (as measured by fumbles forced and passes defensed) but whether you actually turn those opportunities into turnovers is largely luck. According to his numbers, teams will generally revert to the mean of recovering 50% of fumbles forced and 22% of passes defensed.

So a team who has 4 forced fumbles and 18 passes defensed is treated the same (as an expected 6 turnovers), whether those opportunities actually resulted in zero turnovers or 22 turnovers.

[DanRydell 799]

So for the Texas Tech game for example, Texas had an expected turnover margin of 1.5, with the other 1.5 attributed to luck.

[Walden Ponderer 12639]

1 hour ago, Huckleberry said:

Fumble recovery rates, on the other hand, are random and will eventually average out to 50%.

...except that this is not necessarily true. There are elements of luck involved, of course, because which direction the ball bounces is completely out of anyone's control, but there are other aspects of fumble recovery that are very much determined by factors which are more easily predicted. Bigger, stronger, faster players who practice turnover recovery on a regular basis will consistently outperform smaller, weaker, slower players who do not have turnover drills regularly.

Hell, scramble drills in basketball are life or death matters for a lot of coaches. I see no reason why that wouldn't apply to football, as well.

[Ricky Butler 2657]

1 hour ago, Fozzz said:

You can't predict how well a team performed week-to-week in his metrics based on score.  The bulk of S&P+ is success rate/play, which may be masked in the final score by other factors (turnovers, field position, points/opportunity, etc.).  

So if we ran a more aggressive passing attack that led to Sam throwing more INTs but resulted in more explosive plays, would S&P+ like us more?

[DanRydell 799]

11 minutes ago, Ricky Butler said:

So if we ran a more aggressive passing attack that led to Sam throwing more INTs but resulted in more explosive plays, would S&P+ like us more?

Success rate isn't a measure of explosiveness. It's actually the opposite.

It's a measure of the percentage of time a team gained at least 50% of yards to go on 1st down, at least 70% of yards to go on 2nd down, and at least 100% of yards to go on 3rd and 4th downs.

So a team that gains 5 yards on 1st, 4 yards on 2nd, and 1 yard on 3rd will have a higher success rate than a team who throws incomplete on 1st and 2nd and then for 20 yards on 3rd.

[Ricky Butler 2657]

5 minutes ago, DanRydell said:

Success rate isn't a measure of explosiveness. It's actually the opposite.

It's a measure of the percentage of time a team gained at least 50% of yards to go on 1st down, at least 70% of yards to go on 2nd down, and at least 100% of yards to go on 3rd and 4th downs.

So a team that gains 5 yards on 1st, 4 yards on 2nd, and 1 yard on 3rd will have a higher success rate than a team who throws incomplete on 1st and 2nd and then for 20 yards on 3rd.

Interesting. I think I saw a tweet that our offensive ranking has moved up into the 20s over the past few weeks which would align with what I've seen watching the games.

[Fozzz 152]

Big plays, although they may be the most important factor for winning a particular game, are more subject to noise than success rate, which is why he weights explosiveness less than success rate.  He goes into this here:

https://www.footballstudyhall.com/2017/8/22/16075050/college-football-big-plays-efficiency-five-factors

 

[JBJ 3647]

He's said a couple different places that sacks are his most important statistical predictor for turnovers.  We highly buck that trend.

[satyanash 14276]

New S&P+ rankings. We're up eight spots to #33. We're also 26th in Bill's adjusted metric Resume S&P+.

- We're now the 5th-highest team in the Big 12, behind Oklahoma, West Virginia, Okie Lite, and TTU.

- We're the fourth-highest team in the state behind A&M, North Texas, and Tech.

- Our expected regular season win total is now 8.9 wins, with an 87.1% chance of beating Kansas this week.

[Pato del Muerto 52322]

So it can predict that an 8 win team with one game left against a bad team will finish with 9 wins. 

[Drew 2331]

Just crazy we will most likely have at least 9 wins.  And if they play well in the Big 12 title game and the Bowl game they have a shot at winning 11 games.  11 fucking games?!?  After the last decade?  Just crazy.

[Wishbone 4731]

3 minutes ago, Drew said:

Just crazy we will most likely have at least 9 wins.  And if they play well in the Big 12 title game and the Bowl game they have a shot at winning 11 games.  11 fucking games?!?  After the last decade?  Just crazy.

I agree with the “crazy” part of this. It was crazy ever getting this program to a point where anyone could think it was crazy for us to win a lot of games.

[totallynotabuttpirate 5341]

What's crazy is us being the 4th best team in Texas. No one honestly believes we wouldn't beat the other 3 teams at least 80% of the time. 

Edited November 19, 2018 by totallynotabuttpirate

[satyanash 14276]

S&P+ spread picks are in. We're projected to beat the spread (-14.5) and defeat Kansas 39-20.

[sushihorn 3233]

On 11/13/2018 at 4:37 AM, HOOK'EMHOOAH said:

Claiming that a team executing on the defensive side by creating turnovers is luck is absurd. Luck is a human construct that does not have any basis in fact. Literally what the people who make the S&P rankings are saying when they call turnovers "luck" is "this is a variable that we don't know how to or dont want to calculate." Either way, its fucking bush league.

Luck is what happens when opportunity meets preparation.

[sushihorn 3233]

The formula for offensive success under Herman is to take care of the ball and minimize penalties.  We know that S&P doesn't value the former very much and I suspect the later isn't really accounted for either.  Texas had ZERO penalties on offense against ISU (1 defensive, 2 ST).  There were 2 offensive penalties against TTU and neither one killed the drive.  That's especially impressive when one was a PF that resulted in 1st and 25.  Not sure how a stat based system could measure that.

[Katfid54 8591]

1 hour ago, satyanash said:

S&P+ spread picks are in. We're projected to beat the spread (-14.5) and defeat Kansas 39-20.

[ztejas 43244]

On 11/19/2018 at 2:19 PM, Drew said:

Just crazy we will most likely have at least 9 wins.  And if they play well in the Big 12 title game and the Bowl game they have a shot at winning 11 games.  11 fucking games?!?  After the last decade?  Just crazy.

It isn't crazy when you read the fucking name on the jersey, hombre. 

[DanRydell 799]

What's crazy is us being the 4th best team in Texas. No one honestly believes we wouldn't beat the other 3 teams at least 80% of the time. 

I absolutely don’t believe Texas would beat A&M, Tech, and UNT 80% of the time. Hell, I’m not sure I’d take anyone other than maybe Bama and Clemson to beat them 80% of the time.