Bleed Cubbie Blue: An SB Nation Community

Navigation: Jump to content areas:


Sports blogs for fans, by fans.
Around SBN: Tobias Harris signs with Tennessee

On Baseball, The Scientific Method, And Adam Dunn

First, I want to say that I should be and plan to be around here more often than I have been since my original post. (For those that weren't around for it, I'm the new "stats guy" here at BCB. The first post was an introduction to me. This one is more of an introduction to the way i think about things.) I had an insane couple of weeks of work and some epic struggles with a code I’m developing for my research projects, including an episode where my computer was essentially telling me that 11 > 202. My goal is to post articles once a week, on Mondays. I’ll try to do some catching up going forward, but can’t make any promises. (I’m working on some really cool stuff at work right now, and haven’t felt stressed despite putting in lots of hours. That’s a situation that leads to me not having much time to spend on baseball.) Anyway, onto "this week’s" topic… My intention here is to give you some insight into how scientists analyze things as varied as baseball, supernovae, and fossilized bug bites. My hope is that by giving everyone a brief introduction to how scientists ask and answer questions, it will provide a better understanding of the source of the confidence sabermetricians (and scientists) have in their projections.

The scientific method is often summarized this way: research a topic, form a hypothesis, predict something based on that hypothesis, and then test that prediction. If the test results do not conform to the hypothesis, accordingly discard or refine the hypothesis. Either way, devise new tests for the (perhaps new) hypothesis and continue to improve upon it with repeated tests and refinements of hypotheses. Things that cannot be stated in the form of a testable hypothesis are not considered science, and do not factor into the scientific method. Examples of things that do not fall under the purview of science are statements such as: "there is a God," or "the Cubs are cursed." However, one can test the veracity of statements (hypotheses) such as "carbon dioxide can absorb infrared radiation emitted by the Earth," and "there is a better correlation between a pitcher’s FIP (fielding independent pitching) one year and his ERA (earned run average) the following year than there is between his ERA in one year and his ERA in the following year." Such questions and statements fall under the purview of the scientific method, and they’re very useful things to consider because we can make – or in the case of fans, recommend – decisions based on extrapolations from these hypotheses.

Star-divide

However, the power of the method is not that it can help make decisions, but that it should always improve the foundations upon which those decisions are made. Adam Dunn, a player at the center of much debate here over the years, is a great example of this. A few years ago many sabermetric Cubs fans – including yours truly – wanted the Cubs to pursue Adam Dunn. We saw the eye-popping OBA (on-base average) and SLG (slugging average) numbers he posted year after year, and thought he would be a great fit for the Cubs’ lineup. Today, most statistically inclined Cubs fans no longer want Dunn in Chicago. Why? Our understanding of baseball has improved. It was once thought that defense contributes relatively little to the value of a player. Furthermore, the ability to determine how value defense had for individual players was poor, and thus relatively inaccessible to the scientific method. A tool was eventually developed (UZR, or ultimate zone rating) that allowed quantitative defensive analysis of players and opened the analysis of defense up to the scientific method. The tool invalidated the hypothesis that defense did not contribute much to a player's value, particularly for extreme cases such as Dunn’s. Now that we have a reliable method of measuring defense, and can ascribe value to players based on that method, we can include it in our evaluation of the player. In short: we're better at this evaluation thing than we were a few years ago, thanks to those that developed UZR and other defensive metrics.

The degree to which Dunn was overvalued also serves as an example of something else: scientists and sabermetricians are going to be wrong, but yet seem to be persistent in their claims that "they know best." This isn’t necessarily ego (but it admittedly can be). We have a high degree of confidence in recommendations and projections because they are the result of a mountain of past work, very little of which is our own. That’s not to say we expect these recommendations and projections to always be right. On the contrary, we expect them to be inaccurate and treasure our mistakes as opportunities to refine hypotheses and devise new tests for them. Additionally, the best science will present uncertainties alongside measurements and projections, thereby admitting the likelihood that they will be "wrong." Those uncertainties give us an idea of just how wrong we are likely to be, and that gives us some semblance of confidence. (In fact, we call the degree of uncertainty a "confidence level.") What's more, because those uncertainties are known (more or less), there's a limit to how wrong they are likely to be. That's not true when it comes to predictions, opinions, and judgements based on one person's subjective analysis of a situation.

Ultimately, our confidence and arrogance isn’t about being right about everything… but instead comes from the knowledge that when averaged over time, projections and recommendations that follow from application of the scientific method will be better than those based primarily on one person’s conjecture. That’s where I (and others, I think) are coming from, and why I hope you understand we can come off as "know it all's" from time to time. It’s not that we know it all or think we do… It's that the products and tools that arise from a community that applies the scientific method is something to trust over any one person’s opinion, including our own.

2 recs  |  Comment 113 comments |

Story-email Email Printer Print

Comments

Display:

My next post will be a little more numerical...

where I plan to take a look at Carlos Marmol and his control issues in 2009.

by shawndgoldman on Oct 28, 2009 4:16 AM CDT reply actions   0 recs

That was my first thought also

I'm Buck Melanoma. Moley Russell's wart. Not her wart. Not her wart! I'm... I'm the wart. She's my tumor. My... my growth. My... uh, my pimple. I'm Uncle Wart. Just old Buck "Wart" Russell. That's what they call me, or Melanoma Head. - Uncle Buck

by Andiamo Cuccioli on Oct 28, 2009 6:24 AM CDT up reply actions   0 recs

I fixed it.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 7:27 AM CDT up reply actions   0 recs

I copy/pasted from MS Word...

and that seemed to break things. I was too tired to catch it last night when I first posted it.

by shawndgoldman on Oct 28, 2009 9:41 AM CDT up reply actions   0 recs

Wow

Did this post tell me anything other than AD is better offensively than defensively? I coulda told you that 6 years ago.

I'm Buck Melanoma. Moley Russell's wart. Not her wart. Not her wart! I'm... I'm the wart. She's my tumor. My... my growth. My... uh, my pimple. I'm Uncle Wart. Just old Buck "Wart" Russell. That's what they call me, or Melanoma Head. - Uncle Buck

by Andiamo Cuccioli on Oct 28, 2009 6:36 AM CDT reply actions   0 recs

It seems to me this is a continuation of his first post and sets up why he loves looking at stats and how they are useful.

I saw you in that coffee shop, breaking the fifth commandment. Congress passes these things for a reason, Lois.

by hansman1982 on Oct 28, 2009 7:02 AM CDT up reply actions   0 recs

That's how I read it, too.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 7:28 AM CDT up reply actions   0 recs

I think it's a helpful introduction for those of us that know nothing about these things at all.

OK-maybe I’m the only one. But my thinking is that he is writing this for a pretty wide audience-some who know a lot and some like me who didn’t know what UZR was(gasp). I think because of that he has to start at the beginning. It’s been awhile since my college chem class so I found it a nice review and there are others out there that may not know what scientific method is.

"Fasten those seatbelts"-Pat Hughes

by katie casey on Oct 28, 2009 8:13 AM CDT up reply actions   0 recs

But

I didnt read his first post so I didnt know it was a continuation of anything. Unless you are a daily reader of all the posts you might not know that.

Katie, do you now know what UZR is? Nothing about it is explained other than it is an analysis of defense (whatever that means). My contention is still that no one who read this knows anymore about defensive analysis than they did before (other than AD is better offensively than defensively). It was a very longwinded explanation of the scientific method.

I look forward to the next post and hope it is better. I like numbers more than words anyway.

I'm Buck Melanoma. Moley Russell's wart. Not her wart. Not her wart! I'm... I'm the wart. She's my tumor. My... my growth. My... uh, my pimple. I'm Uncle Wart. Just old Buck "Wart" Russell. That's what they call me, or Melanoma Head. - Uncle Buck

by Andiamo Cuccioli on Oct 28, 2009 8:24 AM CDT up reply actions   0 recs

I did see the original post

but since he does mention it in the first sentence it would seem like an obvious continuation to me.

As for UZR, from what I gather here it is a way to measure a player’s defense. But you are right-it’s not really explained.

I’ll take words any day. I see numbers and shy away, especially if they have letters with them.

"Fasten those seatbelts"-Pat Hughes

by katie casey on Oct 28, 2009 8:51 AM CDT up reply actions   0 recs

That's a good point.

I expanded the reason for this at the front, in line with your criticism of this needing a little more context. As far as the more general criticism that this is a very long-winded explanation of the scientific method, I agree. The problem there is twofold:

1.) I’m trying to introduce the concept to everyone before I get started on more detailed posts

and

2.) I’m a long-winded writer. It’s something I’m working on fixing, but it’s definitely a process…

by shawndgoldman on Oct 28, 2009 9:44 AM CDT up reply actions   0 recs

That's the idea...

I’ll put up a more “traditional” post next time. Should be fun.

by shawndgoldman on Oct 28, 2009 9:41 AM CDT up reply actions   0 recs

I look forward to it

I hope I didnt sound too critical, but I have a real short attention span. This is one of the longer posts that I took the time to read because it does sound like a truly interesting discussion.

I'm Buck Melanoma. Moley Russell's wart. Not her wart. Not her wart! I'm... I'm the wart. She's my tumor. My... my growth. My... uh, my pimple. I'm Uncle Wart. Just old Buck "Wart" Russell. That's what they call me, or Melanoma Head. - Uncle Buck

by Andiamo Cuccioli on Oct 28, 2009 1:01 PM CDT up reply actions   0 recs

That's also why...

i didn’t have many numbers in it, or actual analysis. I wanted to get across an introduction to the scientific method before I dove into other things here.

And don’t apologize for the criticism. One of the reasons I am doing this is to improve my ability to communicate science and quantitative studies to non-scientists.

by shawndgoldman on Oct 28, 2009 3:54 PM CDT up reply actions   0 recs

I noticed that as well

but I’m not well versed in these methods like most here.

"Repetition is only good when you've been winning." - Valet

by propheteer on Oct 28, 2009 9:45 PM CDT up reply actions   0 recs

The question about AD isn't that his offense is better than his defense

‘cause, yes, anyone could see that. But people would pooh-pooh that with the notion that the bad defense didn’t really matter much. UZR and other metrics show that the shortcoming at defense do matter enough to make the offensive contribution not compelling.

by ChipSet on Oct 28, 2009 12:34 PM CDT up reply actions   0 recs

Hey, Shawn...

… I think 11 is greater than 202.

At least that’s probably what Aaron Miles would tell you.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 7:31 AM CDT reply actions   0 recs

You sound like Dr. Frankenstein at work.

Good luck with that…unless it involves robbing gravesites. But that just goes without saying. Doesn’t it?

"Fasten those seatbelts"-Pat Hughes

by katie casey on Oct 28, 2009 7:53 AM CDT reply actions   0 recs

It felt kind of weird reading this Shawn...

For the 1st 2 paragraphs, it was like reading something over on ScienceBlogs rather than Bleedcubbieblue. I look forward to more of your posts.

by madmf on Oct 28, 2009 8:10 AM CDT reply actions   0 recs

Good!

I know this is a baseball blog, but that was sort of the point. Hopefully by the end the relevance of this to baseball was more apparent. Maybe I should have flipped this around, and started with the baseball? I’m honestly interested in getting your criticisms on this.

by shawndgoldman on Oct 28, 2009 9:45 AM CDT up reply actions   0 recs

I guess my question is:

Wouldn’t the offensive production more than make up for the mistakes in the outfield? How many times is Dunn actually going to cost someone the game out there? How many times is he going to win a game with his bat? I would think it more than evens out. Not saying its a perfect representation but I don’t see where just Dunn’s defensive numbers would make a team stay away.

I think there are so many stats out there these days that its impossible to find a player (unless your name is Albert) that passes the test on all statistical categories.

Its funny, you spend most of your life gripping a baseball. And in the end, its almost always the other way around.

by TCobb1911 on Oct 28, 2009 8:24 AM CDT reply actions   0 recs

That's kind of how I viewed Dunn, too.

I think one thing people had forgotten, in terms of signing Dunn — the Cubs had potentially two or three good defensive replacements for Dunn (Johnson, Fuld, and early on, Gathright). You’d presumably take Dunn out after his final AB in the 7th inning (home) or 8th inning (road) and have good defense for at least two of the nine innings, thus reducing any damage he could do defensively.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 8:31 AM CDT up reply actions   0 recs

Yeah, but

wouldn’t you already be needing those defensive replacements for Soriano?

"Fasten those seatbelts"-Pat Hughes

by katie casey on Oct 28, 2009 8:54 AM CDT up reply actions   0 recs

Maybe.

But the Cubs did have a couple of good defensive replacements, as I noted above.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 8:57 AM CDT up reply actions   0 recs

Well, if the Cubs would keep only 11 pitchers, you could do that.

You don’t really need 12 pitchers anyway.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 9:11 AM CDT up reply actions   0 recs

You do when

You’re Lou Pinella and you stash away a rule 5 pick for the whole year without using him.

"Hey! If the moon were made of ribs, wouldja eat it? I know I would!"

by cubs0505 on Oct 28, 2009 2:34 PM CDT up reply actions   0 recs

Man, was that ridiculous.

Prediction: David Patton will NOT be on the 2010 pitching staff.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 4:30 PM CDT up reply actions   0 recs

true

I guess with all the injuries we’ve had this year that I’m assuming they’d be used already or injured themselves and we’d have only one replacement left.

"Fasten those seatbelts"-Pat Hughes

by katie casey on Oct 28, 2009 9:07 AM CDT up reply actions   0 recs

Dunn's intangibles

The solution to the left-handed big bat and the ‘protection’ that brings; positive clubhouse guy; someone who said they wanted to be in Chicago; 145-150 games in the lineup.

I’ll take all of those over the previous “investment” and Dunn’s defensive downside.

"I got a PBS mind in an MTV world"...Jimmy Buffett

by The Ryno and I Know on Oct 28, 2009 3:53 PM CDT up reply actions   0 recs

"Not saying its a perfect representation but I don’t see where just Dunn’s defensive numbers would make a team stay away."

Shawn will get to this soon – the issue of how to properly valuate a player is the hardest (and oldest) problem in sabermetrics. He was just making a more general post here. Suffice it to say though that Dunn’s defense is so awful that it DOES cancel out a good portion of his offensive production

People should remember that while they have the right to their opinion, they are not entitled to be taken seriously. -- Bruce Bartlett

by berselius on Oct 28, 2009 8:44 AM CDT up reply actions   0 recs

Would it matter in my scenario?

Would it make a difference if you took his defense out of the game for two innings — every game?

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 8:45 AM CDT up reply actions   0 recs

it will help a little, but that would only shave off ~10-15% of his defensive non-value. You'd also lose the value of any possible ABs in the 8th/9th inning

People should remember that while they have the right to their opinion, they are not entitled to be taken seriously. -- Bruce Bartlett

by berselius on Oct 28, 2009 9:09 AM CDT up reply actions   0 recs

True enough.

But how many AB would you really lose that way, compared to the 10-15% defensive improvement?

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 9:12 AM CDT up reply actions   0 recs

there

would be a way to test Al’s idea. If someone had the time to go and look at how often Dunn was taken out this year and the previous year for defense in late innings we could see if it affected his value. If teams are already doing what Al suggests then we already have the data and subbing him out isn’t helping.

If teams have been leaving him in then that would be worth knowing as well.

by CalCalender on Oct 28, 2009 9:22 AM CDT up reply actions   0 recs

There's some sense to what Al suggests

If Dunn (or the batter after him) ends a late inning (say, the 7th inning or later) and you don’t expect him to come up again then you could regain some value by substituting a good defensive player in for him. You’d essentially have him be a DH for about a third of a third of the games in that manner, and he would be more valuable with such usage. He’d actually recover a little bit more than that due to the leverage of those innings.

10-15% sounds about right for a guesstimation, which is where berselius put it.

by shawndgoldman on Oct 28, 2009 9:51 AM CDT up reply actions   0 recs

I'd agree with that...

… so, given that, would Dunn’s increased offense (over the guys he replaces) be worth it? I’d argue that it would.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 9:57 AM CDT up reply actions   0 recs

This is a good point...

he would probably be an upgrade (assuming Bradley is off the roster already). And absent any other options, and assuming we’re in a world where all players were making the same money, he’d be a good person to put on the roster. But there are other options, and players have salaries set on the market. Given those things, he’s probably overpaid and IMO there are options that are better values.

by shawndgoldman on Oct 28, 2009 9:59 AM CDT up reply actions   0 recs

Agreed, as I posted elsewhere in this thread...

… the time for Dunn was a year ago. Now, not so much.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 10:02 AM CDT up reply actions   0 recs

This many

Assume losing him for 2 innings. If he missed one AB in those two innings (assuming he makes 5 PAs in a game) you would lose 1/5th of his production (20%). Now assume that only happens half the time. We are down to 10%. Now you have lost the 10% production you are looking for.

4 PAs = 25%/2 = 12.5% production lost

I'm Buck Melanoma. Moley Russell's wart. Not her wart. Not her wart! I'm... I'm the wart. She's my tumor. My... my growth. My... uh, my pimple. I'm Uncle Wart. Just old Buck "Wart" Russell. That's what they call me, or Melanoma Head. - Uncle Buck

by Andiamo Cuccioli on Oct 28, 2009 1:11 PM CDT up reply actions   0 recs

Al

Dunn is kind of an unique thing. His defense is so awful that he is kind of in his own world. 7-8 innings of Dunn in the OF is going to hurt your team even with his bat. Take at look at his fangraphs page and scroll down to the “Value” portion. http://www.fangraphs.com/statss.aspx?playerid=319&position=OF

His bat is exactly what people remember- great, but look at his fielding. It practically neutralizes all his value. Whats amazing to me is that no AL team could have found the guy a spot at DH. Dunn isn’t simply a good hitter he is a great one who is historically terrible in the field no matter where you try and hide him.

by CalCalender on Oct 28, 2009 9:20 AM CDT up reply actions   0 recs

At the same time....

… wasn’t his WAR higher than Bradley’s this year? And doesn’t that take defense into account, too?

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 9:31 AM CDT up reply actions   0 recs

Bradley's

WAR was a result of posting his worst hitting values since 2002. Bradley’s defense was – 3.1

Dunn’s was -29

by CalCalender on Oct 28, 2009 9:35 AM CDT up reply actions   0 recs

also fwiw

they both posted a 1.1 WAR

by CalCalender on Oct 28, 2009 9:36 AM CDT up reply actions   0 recs

Same, actually (1.1 WAR)

As if beating Bradley’s 2009 campaign is something you’d put on your resume.

Hopefully whatever OF we put out there to replace Bradley gives us more than 1.1 WAR next season . . .

by madcow256 on Oct 28, 2009 9:36 AM CDT up reply actions   0 recs

keeping Bradley

out there would give you a great shot at getting more than a 1.1 WAR.

Just sayin’

by CalCalender on Oct 28, 2009 9:37 AM CDT up reply actions   0 recs

You're right...

Dunn was more valuable than Bradley this year. But that doesn’t mean Dunn would be a good fit in RF for the Cubs. IMO the Cubs need to replace Bradley with someone that is more productive than either Dunn or Bradley were in 2008. Dunn will probably be better in the field in 2009, but probably not enough to make him a good acquisition.

by shawndgoldman on Oct 28, 2009 9:54 AM CDT up reply actions   0 recs

oops, they were the same...

as madcow points out. I’d stand by the conclusion, though: you need to get better production out of RF in 2009. Bradley isn’t the answer due for team management reasons. Dunn isn’t the answer for baseball reasons.

by shawndgoldman on Oct 28, 2009 9:55 AM CDT up reply actions   0 recs

Well, or CF

Given positional adjustments and defense, it’s a wash value-wise whether Fukudome plays RF or CF

People should remember that while they have the right to their opinion, they are not entitled to be taken seriously. -- Bruce Bartlett

by berselius on Oct 28, 2009 9:55 AM CDT up reply actions   0 recs

Keep in mind Dunn's WAR would likely have been lower with the Cubs

…because the Cubs wouldn’t have been able to hide him at first base for 67 games last season like the Nats did.

by Wreckard on Oct 28, 2009 10:07 AM CDT up reply actions   0 recs

kind of funny

that “hiding” is – 18.7 UZR

by CalCalender on Oct 28, 2009 10:09 AM CDT up reply actions   0 recs

True enough, although...

… that might have allowed them to give D-Lee a few more days off.

As it was, Lee missed 21 games; undoubtedly Dunn would have started most or all of those.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 10:16 AM CDT up reply actions   0 recs

It would matter, because of the relative importance of those innings...

but what if those innings were unimportant because of some error Dunn committed earlier in the game?

I really like Dunn as a hitter. The Mariners are becoming my “A.L. team” and I think he would be a great acquisition for them. But I’d stay away if I were an N.L. team. The guy is a disaster in the OF. He just doesn’t have the range to play the position. That he’s also really bad at 1st makes me think he needs to end up in the A.L.

by shawndgoldman on Oct 28, 2009 9:48 AM CDT up reply actions   0 recs

I'm not necessarily arguing that the Cubs should get Dunn NOW.

I think the window for that was a year ago; it’s passed now, and Dunn surely isn’t going to get any BETTER in the outfield.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 9:58 AM CDT up reply actions   0 recs

Yes, especially since he'd have to be traded for...

I wasn’t criticizing you personally, for the record. (I know you’ve been a Dunn proponent.) I just think Dunn serves as a great example of how a community of analysts will change their opinion on a player even if that player hasn’t changed much, because the tools they have on hand change.

by shawndgoldman on Oct 28, 2009 10:04 AM CDT up reply actions   0 recs

I understand that and appreciate your analysis.

But it also shows that someone like me, who doesn’t necessarily use all the advanced metric tools that you do, can also change my opinion on Dunn’s usefulness to a team (the Cubs).

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 10:17 AM CDT up reply actions   0 recs

No doubt....

this was more about the why and how of “people like me” changing their minds. At least in an ideal sense.

by shawndgoldman on Oct 28, 2009 10:19 AM CDT up reply actions   0 recs

The anwser

to your question was posted over at fangraphs last summer. Look for something titled “Dunn = Morgan”

by CalCalender on Oct 28, 2009 9:16 AM CDT up reply actions   0 recs

I'm not sure that will answer it.

Does that take into count how many errors he makes in games that are already decided? Back to my original point. I don’t see how make catastrophic errors to lose the Cubs games more times than he will win games with his bat. The Red Sox won with Manny.

Its funny, you spend most of your life gripping a baseball. And in the end, its almost always the other way around.

by TCobb1911 on Oct 28, 2009 9:27 AM CDT up reply actions   0 recs

I agree with Sabermetrics most of the time...

however are these numbers going to reflect what kind of pitchers where on his teams? Were they more fly ball or ground ball pitchers? Would he get as many chances behind the Cubs starters?

Its funny, you spend most of your life gripping a baseball. And in the end, its almost always the other way around.

by TCobb1911 on Oct 28, 2009 9:30 AM CDT up reply actions   0 recs

Dunn

is almost twice as bad as Manny in the field.

Scary stuff.

by CalCalender on Oct 28, 2009 9:40 AM CDT up reply actions   0 recs

Does that take into count how many errors he makes in games that are already decided?

By that logic should we not be counting home runs he hit when the game was decided either? Should stats only matter in close games?

by Wreckard on Oct 28, 2009 10:10 AM CDT up reply actions   0 recs

What I'm trying to say

is that the number of times we would sit and say “If Dunn wouldn’t have made that error, the Cubs would have won” is far less than the times he’s going to come through with a 3 run bomb that helps decide the game.

Its funny, you spend most of your life gripping a baseball. And in the end, its almost always the other way around.

by TCobb1911 on Oct 28, 2009 12:43 PM CDT up reply actions   0 recs

You're still doing it

You’re still trying to cherry pick the stats based on situation, which is a slippery slope. Are you going to throw out the home runs hit in meaningless blowouts as well?

I think you’re also not realizing that defensive metrics go well beyond just errors. It’s not just the ball he dropped, it’s the ball he didn’t get within 10 feet of that turned into a double because he has the range of a statue.

by Wreckard on Oct 28, 2009 12:53 PM CDT up reply actions   0 recs

What about the effect that he has on other OF'ers?

For example, if you have only one “shaky” fielder out there and two above average ones, the CF’er can “cheat” towards the worse fielder. But with Soriano on one side and Dunn on the other, Fukudome/Johnson would have no legs left after the ASG.

Probably hard to measure, but also a detrimental effect that he’d have.

I'm singing, "GO CUBS GO! GO CUBS GO!" -- DrCrawdad on Jun 12, 2009 7:23 AM CDT

Facts are meaningless. You could use facts to prove anything that's even remotely true! -- Homer J. Simpson

by Shanghai Badger on Oct 28, 2009 3:12 PM CDT up reply actions   0 recs

There's another issue there, as well...

if you’ve got a great fielder playing next to you, you could look worse yourself according to fielding metrics. Why? Because Johnny McSpeedypants is catching balls in “your zone” thus affecting your range. I think UZR takes this into account, but I’m not sure that it does.

by shawndgoldman on Oct 28, 2009 3:56 PM CDT up reply actions   0 recs

The zones in UZR rarely overlap

And the effect is minimal if they do. Besides, UZR doesn’t punish a player because some guy catches a lot of balls in his zone. It’s like an IBB, it just doesn’t get factored into the equation.

by vivaelpujols on Oct 28, 2009 6:21 PM CDT up reply actions   0 recs

I'm pretty sure it used to punish a player

if a ball was caught by someone in an area believed to be his zone. Was there a change?

by ol Pete on Oct 28, 2009 9:16 PM CDT up reply actions   0 recs

UZR isn't a counting stat

It’s a rate stat. For “chances” it won’t count balls that are caught by somebody else.

by vivaelpujols on Oct 28, 2009 9:39 PM CDT up reply actions   0 recs

As I just said

I don’t believe that’s the case. Is it easy to check?

by ol Pete on Oct 28, 2009 9:47 PM CDT up reply actions   0 recs

No, I'm not.

I understand range pal. I just don’t think the degree in which he plays defense would overshadow his offensive production. Look at any graph you want. Look at any stat. You can get a stat that says Ryan Dunn has turds for fingers these days.

Its funny, you spend most of your life gripping a baseball. And in the end, its almost always the other way around.

by TCobb1911 on Oct 28, 2009 4:49 PM CDT up reply actions   0 recs

Adam*

Its funny, you spend most of your life gripping a baseball. And in the end, its almost always the other way around.

by TCobb1911 on Oct 28, 2009 4:50 PM CDT up reply actions   0 recs

Yes, you are.

You’re saying bad defense in a meaningless game situation doesn’t count. But you’re not doing the opposite, and worrying if good offense in a meaningless situation counts. You’re cherry-picking.

You can get a stat that says Ryan Dunn has turds for fingers these days.

Then show us the stats that say Dunn’s offense production completely outweighs his defensive ineptness.

That you’re resorting to lazy cliché arguments against stats would indicate that you missed the point of Shawn’s article here.

by Wreckard on Oct 28, 2009 6:21 PM CDT up reply actions   0 recs

Ryan Dunn?

Would that be a combination of Ryan Theriot and Adam Dunn?

He’d be a scrappy left fielder who couldn’t hit OR field.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 29, 2009 8:00 AM CDT up reply actions   0 recs

I see what you Dunn there

I'm singing, "GO CUBS GO! GO CUBS GO!" -- DrCrawdad on Jun 12, 2009 7:23 AM CDT

Facts are meaningless. You could use facts to prove anything that's even remotely true! -- Homer J. Simpson

by Shanghai Badger on Oct 29, 2009 4:03 PM CDT up reply actions   0 recs

Dun dun dun DUUUUUUNNNNNNN....

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 29, 2009 4:16 PM CDT up reply actions   0 recs

cobb

i would say that you cannot calculate the number of runs you would prevent and outs you can make with a better defender that has more range, can throw, and can be quicker to the ball than Dunn. He may drive in 100 runs for you but he will also allow more than a good defender would because of errors, and other bad fielding practices.

Still waiting for any of my favorite Professional teams to win a championship in my lifetime.

Last year won

Cubs- 1908
Dolphins- 1974
Suns- Never

by Long John 77 on Oct 28, 2009 1:35 PM CDT up reply actions   0 recs

Ok

But what about pitching? The Cubs have a good staff. Nationals, not good. Can’t that play into it?

Its funny, you spend most of your life gripping a baseball. And in the end, its almost always the other way around.

by TCobb1911 on Oct 28, 2009 4:50 PM CDT up reply actions   0 recs

UZR can also be normalized to a rate stat

as UZR/150. This way you can compare it to other players with different numbers of innings played/balls fielded.

People should remember that while they have the right to their opinion, they are not entitled to be taken seriously. -- Bruce Bartlett

by berselius on Oct 28, 2009 5:09 PM CDT up reply actions   0 recs

A nice but simple desription of what science is

and even if there was little new for me, I enjoyed it.

You might want to talk more about the tools you use, thier mathematical background and how they have been verified.

Btw: 11>202 ? Sounds like a fun bug to find and fix.

Well, I never heard it before, but it sounds uncommon nonsense.
- The Mock Turtle, Alice in Wonderland by Lewis Carroll -

by eths on Oct 28, 2009 8:45 AM CDT via mobile reply actions   0 recs

Dunn vs Soriano

Yeah, Dunn is awful in LF and with DLee in place would have nowhere to play except LF for the next few years if he were a Cub.

Over the last 3 years Soriano has been worth 7.8 WAR with decent offense and defense, while over the same period Dunn was worth 5.3 WAR with awful defense and tremendous offense. A difference of 2.5 WAR over a 3 year span.

Now when you look at the ages of those two players and if those 2.5 wins would have made much of a difference, it makes tons of sense for the Cubs to have Dunn in their hands if they had the chance. The Cubs have paid Soriano $38 million for $33 worth of value, while over the same period of time Dunn has made $31 million for $23 million worth of value, neither player has lived up to what they are being paid,

But Dunn is 3 years younger and has about the same projection as Soriano. I know this post wasnt a comparison of the two, but the issue is that the team would be in the exact same place they have been in the standings the past 3 years, but with more money in their pockets.

by backtocali on Oct 28, 2009 9:00 AM CDT reply actions   0 recs

or ...

that money could have been used to get another player of value …

by elgato on Oct 28, 2009 9:08 AM CDT up reply actions   0 recs

But who?

Would Cub fans have liked Aaron Rowand or Mike Cameron to have been signed instead? Both players have been more productive over the 3 year stretch than both Dunn and Soriano have been, and again, cheaper. Of course Rowand is a litte more expensive, and Cameron older Orlando Hudson would have also provided more, but again injuries are the issue.

The big difference is the money being paid going forward. Cubs really havent needed a lot of pitching the last few years, Theyve had specific holes that needed filling Would the list of players in the previous paragraph suit Cubs fans needs and the organizations?

by backtocali on Oct 28, 2009 9:26 AM CDT up reply actions   0 recs

Soriano's Defense

Okay, statistically, how good or bad is a healthy Soriano defensively? Throw the numbers out from 2009 because he was hurt so much. I know this has been a source of great debate on this site since Sori got to the Cubs. How much value is there in an outfield assist, which would work in Sori’s favor? Is Sori’s perceived lack of ability to get jumps on balls in the outfield real or imagined? What is Sori’s statistical range? According to my admittedly very fallible, very unscientific, eye test, it doesn’t seem Sori’s range is that great. Then, again, left fielders don’t tend to have that much range in the first place. If they did have a lot of range, then they wouldn’t be playing left field.

"The big possums walk late." - Harry Caray

by memphiscub on Oct 28, 2009 11:04 AM CDT up reply actions   0 recs

Soriano was the most valuable defensive left fielder from 2006-2008

According to Dewan’s +/- system. That +/- score is propped up largely by his arm, though, and his assists have declined steadily since his first season in left field, so that’s not a sustainable number.

This short answer is: he’s better than Cubs fans give him credit for, but he’s no Carl Crawford.

by Wreckard on Oct 28, 2009 12:48 PM CDT up reply actions   0 recs

The make the most important point in any discussion of the Cubs acquiring Dunn - where would he play?

The consensus seems to be that Dunn would play RF, leaving Soriano in LF. But if you put either player in RF, it magnifies their defensive shortcomings as that position is more difficult. For example, if the LF misplays a ball down the line, that becomes a double but a similar mistake by a RF leads to a triple, at least some of the time. Perhaps that example oversimplifies the problem, but the fact is that your taking a guy whose defense is costing his team runs in LF and moving him to a more difficult position, essentially exacerbating the problem.

This also raises another question, which might be better directed at Shawn, of what effect the CF has on the defense of the corner outfielders. Call it the Maddox/Luzinski problem … does having an elite CF with outstanding range, such as Garry Maddox, have much effect on an atrocious LF like Greg Luzinski, who was actually a very similar player to Adam Dunn? Certainly it doesn’t matter on balls down the line or over the LF’s head, but what about balls that are hit into the gap? Having a great CF to cover-up some of the LF’s mistakes would matter at least occasionally, but would those instances be frequent enough to show up in the LF’s statistics? While both Kosuke and Reed Johnson are competent but not outstanding in center, would the value of playing a better defensive player, such as Sam Fuld or Mike Cameron, be magnified even further because he’s helping to cover for a crappy LF?

In terms of their value the past three seasons, keep in mind that Soriano’s total of 7.8 WAR was entirely from 2007 and 2008. Soriano actually had a negative WAR this season (-0.8), whereas Dunn’s was 1.1. For both players, the best season of three was 2007, when Soriano posted a 5.5 WAR and Dunn a 2.9. Would that difference of 2.6 wins have affected the final standings? It’s impossible to say, but the 2007 Cubs finished 2.0 games ahead of the Brewers. While the NLDS sweep that followed might make it a moot point, many fans would regard the 2007 season very differently had the Cubs not won the division.

"I'd rather play baseball than eat." - Andy Pafko

by LaddieRenfroe on Oct 28, 2009 11:18 AM CDT up reply actions   1 recs

I guess I should have read this first before posting above

I'm singing, "GO CUBS GO! GO CUBS GO!" -- DrCrawdad on Jun 12, 2009 7:23 AM CDT

Facts are meaningless. You could use facts to prove anything that's even remotely true! -- Homer J. Simpson

by Shanghai Badger on Oct 28, 2009 3:13 PM CDT up reply actions   0 recs

Gary Matthews, Sr.

I don’t know what Sarge’s defensive statistics were. I thought of him as a much better left fielder defensively than Greg Luzinski for the Phillies. The Phils made the right move letting Luzinski go to the White Sox, where he could DH. Sarge was a good player for the Phils and had a good first season with the Cubs before his defensive skills eroded.

"The big possums walk late." - Harry Caray

by memphiscub on Oct 28, 2009 4:32 PM CDT up reply actions   0 recs

Not much time to post

But I just want to say that my philosophy of science is apparently different from Shawn’s. In particular, the distinction between what questions can be the subject of the scientific method and what ones can’t is not that clear-cut. This probably reflects my training as a social scientist, which of course many hard scientists would say is an oxymoron. But if the world of theoretical physics isn’t dealing with gods and curses, or the equivalent, these days, I’ll eat my hat. (Not my Cubs hat. This is BCB, after all.)

Now, having bordered on a religious discussion, I’ll back away slowly. However, my different philosophy may come out in my participation in the “Goldman threads.”

Fontenot (fon-te-no): Cajun for "scrappy"

by zambranofan on Oct 28, 2009 9:29 AM CDT reply actions   0 recs

I would contend our philosophy is not that different.

The physics and psychology studies you refer to may be related to God or a curse, but they are not addressing the question directly. I agree that there you could test for psychological effects of playing for a team that has a well-known championship drought. But that wouldn’t be addressing the question of whether or not there is a curse. One could argue the presence of such psychological effects would be a valid explanation for events that do not need to invoke goats, curses, or other voodoo. But it would not be valid to conclude there was or was not a curse based on such studies.

I’d say something similar about physics. Many scientists are devout, spiritual people that view their work as studying the work of God. But not one of them has come up with a valid test for the presence of God in the universe now or in it’s past. That’s where the difference lies.

by shawndgoldman on Oct 28, 2009 10:08 AM CDT up reply actions   0 recs

I almost didn't mention...
In particular, the distinction between what questions can be the subject of the scientific method and what ones can’t is not that clear-cut.

That is absolutely correct. I didn’t want to “muddy the waters” in the main post, but there the scientific method is a messier thing than I lay out above. I saw an excellent talk by Steve Benner last week (one of the best public lecturers I’ve seen – you should go see him talk if you have the chance). His talk was all about the scientific method, and how in reality it operates in a much more haphazard manner than we’re taught in science class. (And on baseball blogs… HA!) He uses the example of the search for life on Mars as an example of this. The scientific method was applied in the search for life, but in so doing there was a need to make an operations definition of what “life” means. Their operational definition for life was poor, and that led to a series of experiments that did an awful job of testing the hypothesis, which was that “Mars has life.” So there’s many problems in reality. Not only are there questions that straddle the line between science and non-science, but there are also questions that require us to define things. Such as “who should the Cubs acquire this offseason?” That’s a tough one to answer, in part because it has components both open and closed to rigorous analysis.

by shawndgoldman on Oct 28, 2009 10:14 AM CDT up reply actions   0 recs

If you can't see Benner talk,

he also has a book out. I haven’t read it, but I’d guess that it’s a good one… it comes with cartoons and Benner has a great sense of humor, so it should be a decent one to read. The book is called “Life, the Universe, and the Scientific Method.”

by shawndgoldman on Oct 28, 2009 10:16 AM CDT up reply actions   0 recs

Cool.

I’ll look for it when I have time to read again…this is the semester of rain, and it seems like it will never end.

Fontenot (fon-te-no): Cajun for "scrappy"

by zambranofan on Oct 28, 2009 8:40 PM CDT up reply actions   0 recs

Seeing the words Adam Dunn and Scientific Method in the same sentence

make me think of of study of cro magnon man or the missing link.

"I am not ashamed to say I love Greg Maddux" - Jim Hendry
Me either Jim

by Doggie Stalker on Oct 28, 2009 9:57 AM CDT reply actions   0 recs

That's what I think of when I see...

Adam Dunn and “defense” in the same sentence.

by shawndgoldman on Oct 28, 2009 10:19 AM CDT up reply actions   0 recs

Needs more numbers!

Oh, and I just realized we have a “Statistical Analysis” category on BCB…things I thought I’d never see…

"The riches of the game are in the thrills, not the money." --Ernie Banks

by dtpollitt on Oct 28, 2009 10:53 AM CDT reply actions   0 recs

It's rolled into ZORP 2.0, Wreckard

People should remember that while they have the right to their opinion, they are not entitled to be taken seriously. -- Bruce Bartlett

by berselius on Oct 28, 2009 12:55 PM CDT up reply actions   0 recs

Harmon Killebrew and Darrell Evans

Those seem to be two players from the past that had low batting averages but high home run, slugging and on-base percentages. Of course, Darrell Evans was primarily an infielder and DH. Killebrew played a lot in the infield, but he was an outfielder for part of his career. I believe Dunn has played a lot more outfield than first base. I wouldn’t think that Evans’ or Killebrew’s defensive abilities were the liabilities that Dunn’s defense is. I’ve thought of Dunn as being a little better than Evans and a little worse than Killebrew offensively. That has to take into consideration that Killebrew played in a lower offensive production era than Dunn.

"The big possums walk late." - Harry Caray

by memphiscub on Oct 28, 2009 1:12 PM CDT reply actions   0 recs

Killebrew played almost 800 games at third base...

… and he wasn’t terrible there, though he wasn’t great, either. He played a full year at 3B as late as age 34.

"You can observe a lot just by watching." ~ Yogi Berra

by Al on Oct 28, 2009 2:24 PM CDT up reply actions   0 recs

It was once thought that defense contributes relatively little to the value of a player.

Who and when are you talking about?

I think its a stretch to say that the existence of UZR allows baseball defense to be evaluated by the scientific method. Its someone’s observations of unknown reliability or validity which are then heavily interpreted. It might make for an interesting hypothesis to claim as you do that it correlates to real world performance, but how would you test it? No testing of the hypothesis, no scientific method.

Who is the “we” you refer to with the high level of confidence in your miscellaneous claims? How much is a mountain of evidence and how much of it was done by professional statisticians and consequently reviewed by professional statisticians?

That last paragraph – all I can say is that’s some bold stuff. I’ve yet to read a sabermetrics fan who “treasures” their mistakes. If your “arrogance” is the result of supposedly applying the scientific method like you used UZR, I think it might be misplaced.

by ol Pete on Oct 28, 2009 9:46 PM CDT reply actions   0 recs

Jeez....

That’s some cynicism.

We will at some point I’m sure discuss the limitations and criticisms of UZR (I hope anyway), so without getting into the weeds, I assume you’d grant that taking a systematic approach to aspects of baseball allows one to at least claim to be “more scientific” than eyeballing something without an overarching strategy? Or do you feel that because there are less scientific aspects to UZR’s analysis (and other saber stats), that it can’t claim any degree of legitimate method/science? (I would remind you that all science, including hard sciences like physics, to varying degrees include elements that rely on “observations of unknown reliability.” Hell, fundamental “laws” related to causality are only true in so far as we’ve never found counter-examples. It seems to me that there are many good criticisms you can make about the usefulness of UZR. But I think that your definition of methodological or “scientific” basis is overly narrow.

  • Anyway, as for your points…Given the fact that people still make the claim that defense has little effect on the valuation of a player (see the discussion of Dunn above), it doesn’t seem a large leap to claim that in the past “it was once thought that defense contributes little to the value [plus or minus] of a player,” would it?
  • I believe that his usage of “confidence” was in the mathematical sense, whether in the individual case-study or the aggregation of multiple studies. Though Shawn will hopefully correct me if I’m wrong.
  • “Treasuring” mistakes is implicit in method based inquiry, which sabermetrics aims to be (which was Shawns whole point, as I read it); without them you can’t better calibrate your study and understanding. Unless you expect every study to actually include the words “I treasure my mistakes!”, then your last paragraph strikes me as pretty uncharitable.

by CubsWin!Oregon on Oct 29, 2009 12:31 AM CDT up reply actions   0 recs

No, taking a systematic approach doesn’t make something “more scientific.”

I’m not sure how to answer your question about “degree of legitimacy.” It doesn’t sound like a real question.

The “observations of unknown reliability” are made by unknown parties. That’s critical. Claiming that going to Fangraphs is employing the scientific method is false.

I don’t agree with your characterization that the posters above are saying that Dunn’s defense has little effect on his value. It’s a huge leap to go from those comments to the bold statement that was made.

I don’t think many scientific researchers would adopt as free and easy of a path to confidence as you. Legitimate questions like study construction, data quality and logic of conclusions are critical to determining whether any value whatsoever can be ascribed to those conclusions.

No, treasuring mistakes isn’t implicit in inquiry that uses methods. The methods may even suggest whether something is a legitimate inquiry. There is a vast middle ground between your extreme threshold of expectation and there being some evidence.

by ol Pete on Oct 29, 2009 7:29 AM CDT up reply actions   0 recs

Baseball metrics dummy

Very well-thought out post; it’s something I know very little of.

"Repetition is only good when you've been winning." - Valet

by propheteer on Oct 28, 2009 9:47 PM CDT reply actions   0 recs

Comments For This Post Are Closed


User Tools

Welcome to Bleed Cubbie Blue, the Chicago Cubs blog for the SB Nation, created on February 9, 2005 by Al Yellon
Start posting about the Cubs »

Join SB Nation and dive into communities focused on all your favorite teams.

FanPosts

Community blog posts and discussion.

Recommended FanPosts

Small
Reversal of opinion...Bradley will not be moved
P272649reg_small
VERY OT: The BT Football, "Congrats to ballhawk" & "Sorry, sue369" Thread
Yelloncard_small
Baseball Picture Puzzles Overflow 1
Derrick_rose_poster_by_rokasm_small
You know you want him, Get it done Jim!
Yelloncard_small
Baseball Player Picture Puzzles

Recent FanPosts

Self-portrait-4_small
Crazy Idea: Rob Quinlan
10424_528302137858_173702948_31567344_967269_n_small
OT: Big Ten Football Thread, Nov. 21
Small
Grabow to sign
Small
SI archive story on Sandberg and Salaries
Small
OT -- Head to Evanston to Root on Northwestern -- 11/21 v. Wisconsin
Dscn2381_small
On Harden and the Players Jim Hendry Lets Go
P1_cub_fan_all_small
Annual Mark Prior Comeback Thread V. 5.0
Chc_small
Options I'd like to see the Cubs explore.

+ New FanPost All FanPosts >

FanShots

Quick hits of video, photos, quotes, chats, links and lists that you find around the web.

Recommended FanShots

FanGraphs calls Grabow a "waste of cash."
Fangraphs hasn't given up on Geo, should you?
Baseball America's Top 10 Cubs Prospects
An animated tribute to the no-hitter that Pirates pitcher Dock Ellis threw on June 12, 1970. Simply...

Recent FanShots

Minor League Ball Interview With Billy Beane
Castillo Rumor Won't Go Away
Minor League FA's
The Cubs Debut of Turk Wendell: A Cautionary Tale Of Classic Cubs History
Slightly OT re: Cards
Lincecum wins NL Cy Young
Kansas City Royals new alt cap, to be worn during home day games. My verdict: ugly. Details here.
Aaron Heilman traded to Diamondbacks
Bradley and Rays, Swisher

+ New FanShot All FanShots >

It Is Only...

Cubs By The Numbers

Cubs By The Numbers is a history of the ballclub by uniform number, but the biographies help trace the history of our beloved team in a new way. For everyone who's a Cubs fan, anyone who ever wore the uniform is like family. Cubs By The Numbers reintroduces readers to some of their long-lost ancestors, even ones they think they already know.

Click here to order your copy, available now!

SPONSORS

Recent Stories in Ticket Exchanges

Yelloncard_small
Ticket Exchanges: Cubs Convention 2010
Yelloncard_small
Ticket Exchanges: General 2009 Ticket Exchange
Yelloncard_small
Ticket Exchanges: September 29-October 4 Homestand

Managing Editor

Yelloncard_small Al

Editorial Cartoonist

Toonmike_small toonmike

Contributors

Dsc_0139_small holy mackerel

100px-boisehawkscaplogo_small Josh77

Small shawndgoldman