A graphic misrepresentation . . .
It was one of those emails that come out of the blue. Somebody who had seen that this blog cited the term “bad science” once before, was sending me an infographic, wanting to know what I thought.
What I didn’t know was that I was just one of many bloggers to whom Tony Shin had sent his artwork. But I could have predicted what would happen in a lot of cases: Free artwork and a controversial topic . . . several bloggers quickly snapped the image up without, it seems, much review.
The thumbnail to the right shows the entire image. A larger, more readable version can be found here. Regardless, at first blush, it’s very appealing, colorful and suggestive of substantial content regarding the graphic’s claim: That science is riddled with corruption and that the public should universally beware!
At the very beginning, Shin claims that “shady science is rampant,” arguing that “one in three scientists admits to using questionable research practices,” and that “one in 50 scientists admit to falsifying or fabricating data outright.” But fourth-grade mathematicians know that “one in 50” is only 2 percent, hardly qualifying such behavior as “rampant.”
Nor does he provide linked references to that — or any other — claim in his artwork.
Yes, at the tail end of the graphic, he lists “references,” but only two of those link to actual scholarly studies. The rest point to news stories from the mainstream media, opinion columns from magazines, a blog or two and even a commentary from a Minnesota “alternative newspaper.”
Hardly the stuff of serious scholarship.
When he turns to the definition of scientific misconduct, he gets that wrong too, pointing to three categories: Fabrication, falsification and questionable research practices. The federal Office of Research Integrity oversees scientific misconduct among researchers supported by federal funds. ORI categorizes misconduct as fabrication, falsification or plagiarism, adding that “research misconduct does not include honest error or differences of opinion.”
In essence, he starts with a premise that misbehavior among researchers is “rampant,” then segues to an inaccurate definition of “scientific misconduct” and uses that to frame behaviors that aren’t actually misconduct by definition, things like “questionable methods” and “statistical errors.” Granted these last two claims are worrisome to science but they in no way represent “misconduct.”
Shin’s graphic then shifts to claims that one-third of clinical psychology (papers, I presume) claim a finding was “expected when it actually wasn’t” — I’m at a loss to figure out how he would know that!
He says half of psychology papers “contain a statistical error” which would change the papers’ conclusions in 15 percent of the cases, suggesting that this was misconduct as well, regardless of the ORI’s rules saying errors are not misconduct.
Lastly, he suggests “3 ways to make research more honest,” advising first that scientists should make all raw data available to other researchers, saying that less than half of scholarly journals require authors to share their data. He says nothing about exemptions for intellectual property or proprietary information, nor does he apparently know that most researchers willingly share their data with other scholars.
That’s simply the way that science works.
His second suggestion is that the news media could do a better job of reporting on science. While most folks, including journalists, would agree that improvement would be welcome, that would hardly change the way researchers do their work.
But his last suggestion — that scientists should be allowed to publish their work anonymously — really defies all rational thought. Anonymity removes accountability and responsibility from researchers whose work is integral to improving society and the human condition. That, simply is a non-starter.
Some readers may think, “What’s the big deal? It’s just a graphic floating around the internet, obviously produced by someone who, at best, misunderstands science and research.” But that reaction misses the current state of affairs where the public rarely invests ample time to understand complex subjects.
“Infographics,” first popularized by the coming of the USAToday newspaper, are a quick and easy way of conveying information. Sadly, however, they’re equally useful in simplifying data to the point of misrepresentation. Science as a subject is all too often seen by the public as too complicated to understand. It’s a normal tendency for people to reach out for, and maintain, simpler notions that require less work.
That’s what viewers risk with this graphic, and that’s sad since the topic is too important to get wrong. What’s more worrisome is that Shin’s graphics on other topics appear frequently on the web. If he got this one so wrong, what about all the others?__Earle Holland
[Note: A more detailed PDF of my responding email to Shin can be found here.]
[A follow-up note: To his credit, Tony Shin responded with the following . . .]
Earle,
I feel privileged you’d take time out to put together an in-depth analysis for me. Truly humbled you’d pick this apart for me. It’s exactly what I needed. It’s hard making infographics for the general masses to understand without going too detailed into one area – especially in the science realm when there are several factors to decide/include. Regardless, truly appreciate this.
![[del.icio.us]](http://researchnews.osu.edu/blog/wp-content/plugins/bookmarkify/delicious.png)
![[Digg]](http://researchnews.osu.edu/blog/wp-content/plugins/bookmarkify/digg.png)
![[Google]](http://researchnews.osu.edu/blog/wp-content/plugins/bookmarkify/google.png)
![[LinkedIn]](http://researchnews.osu.edu/blog/wp-content/plugins/bookmarkify/linkedin.png)
![[StumbleUpon]](http://researchnews.osu.edu/blog/wp-content/plugins/bookmarkify/stumbleupon.png)
![[Windows Live]](http://researchnews.osu.edu/blog/wp-content/plugins/bookmarkify/windowslive.png)
![[Yahoo!]](http://researchnews.osu.edu/blog/wp-content/plugins/bookmarkify/yahoo.png)
![[Email]](http://researchnews.osu.edu/blog/wp-content/plugins/bookmarkify/email.png)

Those in the camp defending the value of “studying”
Their logic: It doesn’t save lives and, in many cases, leads to unneeded treatments that can harm patients.
Schwitzer cited the report as actually saying, “The decision to start regular, biennial screening mammography before the age of 50 years should be an individual one and take into account patient context, including the patient’s values regarding specific benefits and harms.”
We see this tug-of-war occurring most often in science stories involving public policy and perhaps in no area more often than in coverage of the global climate change issue. And a case last week provides a perfect example.
The climate change skeptic community quickly embraced that report, alleging that it was a smoking gun showing that concern over climate change was a hoax. Before it died down, more than 140,000 people had looked at our report.
Sadly though, the humor seems to have faded over time, leaving us with the frustrating conclusion that all too many members of the public run their lives based on the “truthiness” of what they hear, instead of facts.
The danger in all of this is that beliefs are self-perpetuating. Humans inherently drift to others who share their thinking, and that behavior has been shown to be increasing in recent years. And with two-thirds of the American people lacking any reasonable measure of scientific literacy, it bodes ill for scientists and researchers locked into a system requiring facts.
Led by activist
Polls continue to show an ever-decreasing acceptance among the public that the climate is changing and that humans are playing a big role in that change, in spite of the fact that the evidence grows stronger and stronger by the week.
And yet this report also floundered in news coverage compared to reporting on the latest fad or celebrity.
The writhing, snakelike twister that initially terrified Dorothy, and us, in the movie
A twister was moving northeast through a Birmingham suburb and I raced along streets several blocks over but parallel to its path. Approaching a small shopping center covered with debris, in the parking lot was Joe’s news car, him standing beside it, shaken but unhurt. He’d won our contest that day but we both wondered about the wisdom of our “game.”
After moving north to Ohio, but still in what’s called “Tornado Alley,” when skies would darken and green, I’d stand outside as the weather approached, searching the skies to the southwest for the telltale spikes in the clouds that sometimes are the first signs of twisters.
The note had come from Andrew Kauffman, associate director of the
What’s sad about this whole episode is that science organizations have for years been trying to work with Hollywood writers and directors to not only bring more science into movies and television, but to make that science more accurate and believable. Organizations such as the
In recent years, activists have picketed researchers’ homes, vandalized and burned their cars, threatened spouses and children and even resorted to using bombs against these scientists. And as seriously criminal these acts are, there always seemed to be a line that wasn’t crossed even in their zealousness.
But consider a comment the student wrote (provided by Camille’s post) that suggests something different: “Please stop saying such horrible, untrue things about me. It’s hurtful.”