Paul A. Kirschner & Mirjam Neelen
The seed of this blog was sown in a podcast trilogy by Freakonomics on what is or could potentially go wrong in the medical world and the history of those mistakes (Bad Medicine). Paul ‘binge listened’ the three podcasts because the number of ‘ignored’ podcasts on his smartphone reached epic proportions. He hadn’t touched the podcasts since 9 November 2016, the day that the world woke up in instead of from a nightmare named Donald Trump. Paul made the decision to go cold turkey on anything that had to do with the United States, though others might say he chose to exist in a bubble of denial. Anyway, Paul somehow found the courage to start listening to his podcasts again and the ‘bad medicine’ ones were his first venture back into reality.
Back to business. The Bad Medicine podcast was a triptych on failures in medicine and their causes. Think here about once accepted treatments such as blood-letting, trepanation (drilling or scraping a hole in someone’s skull), treating diseases such as syphilis with mercury, etcetera. One of the leitmotivs of the podcasts was something called ‘eminence-based medicine’.
Detail from The Extraction of the Stone of Madness (Hieronymus Bosch 1488–1516) – Public Domain
From eminence-based to evidence-based medicine
Most of those reading this blog probably know what evidence-based medicine is: medical decision-making based on evidence as provided by randomised controlled trials, also known as RCT. In other words making medical decisions based on proven positive effects. In such a RCT experiment, one group of random patients gets an intervention (e.g., medication, therapy, surgery, of some other kind of treatment) while another group (the control group) doesn’t get any intervention, is given a placebo, or receives a different type of intervention (often in addition to the former two). Also, if this is carried out in a double blind way, neither the researchers nor the participants know who is in which group. In this way, it’s possible to determine if the experimental intervention is more or less effective than no intervention or than a different type of intervention.
Now you might start yelling, “well it’s not so that all RCTs are of high quality as sometimes: researchers cherry-pick their participants to get better results (i.e., they choose patients with a condition who are not really representative for the whole population of those with a condition by choosing patients who are younger, healthier, etc. than the real population), pharmaceutical investors try to influence the research so as to profit from positive results, and/or by results that are disappointing, researchers might not be able to or be willing to publish this (e.g., publication bias), and so forth.” However, despite all its challenges, RCT is the golden standard for this type of intervention research.
Because we hear the term evidence-based medicine all the time, we might think that this has always been the way that medicine has been practiced; that is, that it has a relatively long history. Spoiler alert!! This is not the case. Starting with Hippocrates – ‘father’ of western medicine – until approximately the last decade or two , the field of medicine based its decisions on three main pillars: (1) ‘experience’, in other words trial and error practices, (2) the ‘we’ve always done it this way’ approach, and (3) eminence-based practice. This blog focuses on the last one.
Eminence-based medicine refers to clinical medical decision-making based on the opinion of a medical specialist or ‘prominent’ healthcare specialist (more often than not, these are grey male eminences, or old cronies). Now, that’s quite different from making a decision based on a critical judgment of available scientific evidence. People in general have a tendency to believe that such eminent notables have tons of knowledge and wisdom and that, hence, their opinion on a certain matter is sufficient to justify a clinical decision. Often times, we think that such an ‘authority’ or ‘expert’ knows more than anyone else and is therefore credible. However, it’s critical to remember that without solid empirical evidence their opinion is as good – or as bad – as anyone else’s. In other words, their opinion ‘ain’t worth a damn’ when it’s about making critical decisions.
The good news is that medicine has mostly shaken off this eminence-based approach. The field now even collects, reviews, and evaluates all available information on scientific approaches in medicine. The Cochrane Collaboration started this process in 1993. It was an initiative of medical researchers and in particular Iain Chalmers. The Collaboration has over 37,000 medical research volunteers in over 130 countries whose goal is to answer important questions in medicine through creating meta-analyses of RCTs in a specific area. Their reviews – all part of a central register called the Cochrane Library – are the gold standard of evidence in medicine and often times have the final say in debates on all kinds of medical subjects.
What does all of this have to do with learning and education? Well, the point is that education unfortunately doesn’t really take an evidence-based approach to the profession and perhaps it’s not even close to being ready for such an approach (also see our blog Will the Educational Sciences Ever Grow Up?). In learning and education sciences we don’t only have a range of individual, often small-scale studies of a problem or intervention for which clearly no recognised database of review studies exists, we are also blessed with a range of ‘quacksperts’, ‘eduquacks’, and ‘eduquackademics’ who propagate a certain type of eminence-based educational approach. Let’s take a close look at some of those ‘eminences’ (and pseudo-eminences; in other words eminences who suffer from the expertise generalisation syndrome) and their proposed educational or learning interventions.
Let’s meet our educational eminences, aka eduquacks
Let’s start with Sugata Mitra, Professor of Educational Technology at the School of Education, Communication, and Language Sciences of Newcastle University (United Kingdom). However, a minor detail is that he doesn’t have any credentials or expertise in the area of education. He actually has a PhD in Solid State Physics (Indian Institute of Technology in Delhi) for which he studied Organic Semiconductors (sounds impressive and probably is, but neither of us suffers from the expertise generalisation syndrome and thus can’t say anything about it), but has precious little to do with education and learning. Unfortunately, the fact that he doesn’t have the educational expertise doesn’t prevent him from preaching nonsense such as “Knowledge is an out-of-date thing that came from a time when it wasn’t possible to have access to knowledge at the point-of-need (read: Internet).”
Mitra, apparently, doesn’t seem to know that there’s a difference between data, information, and knowledge. Of course there’s a wealth of information (some reliable, some totally unreliable) from a ton of different resources (we repeat, some reliable, some unreliable) available on the Internet. However, this shouldn’t be considered knowledge (also see our blog Why Google® Can’t Replace Individual Human Knowledge). Based on this type of nonsense, Mitra blabbers all kinds of things. For example, that he has discovered that if people, and especially children mingle (his word, not ours) with the Internet, they no longer need to know anything. In other words, groups of children can learn almost anything all alone and without the help of teachers through their exposure to the World Wide Web. Or one of our favourites, “Knowing is an obsolete idea from a time when it was not possible to access or acquire knowledge at a moment of need. The idea of knowing assumes that the brain must be “primed” in advance for circumstances that may require knowledge. Just in case.” Actually it does!
There’s plenty of evidence that this claim is simply not true while Mitra himself has never presented any evidence in reputable publications to prove that his claims are correct. However, and now we get to the elephant in the room, followers of eminence-based education love to swallow this snake oil.
Excellent articles on Mitra and his nonsense have been written by:
- Tom Bennett: https://www.tes.com/news/blog/sole-snake-oil-learning-experience
- Pedro de Bruyckere: https://theeconomyofmeaning.com/2013/03/18/sugata-mitra-faces-quite-a-backlash/
- Janelle Ward: http://www.thebrokeronline.eu/Blogs/Janelle-Ward/A-critique-of-Hole-in-the-Wall-HiWEL
- Donald Clark: https://donaldclarkplanb.blogspot.fi/2013/03/sugata-mitra-slum-chic-7-reasons-for.html
Let’s move on to Sir Ken Robinson, who has a PhD in drama and theatre in education (which, by the way might explain his excellent rhetorical techniques, his charm, and his convincing presentation skills!). He propagates the claim that schools “kill creativity” (yep, nothing less!). However, there’s a monster truck (with at least a double trailer) of research which shows that creativity heavily depends on knowledge and that useful creativity is virtually impossible without knowledge. This doesn’t, however, stop Sir Ken from shouting that “Schools kill creativity” from every rooftop whether or not anyone wants to hear it (and a sad detail is that a lot of people DO want to hear it for some strange reason). Keith Sawyer said:
I believe that schools are essential to creativity. We’ve learned that creativity requires a high degree of domain knowledge… Formal schooling is quite good at delivering this domain knowledge to students. Creativity research certainly doesn’t suggest that everyone would be more creative if only we got rid of all of the schools! However, schools could better foster creativity if they were transformed to better align with creativity research (p. 390).
Some excellent pieces on why Sir Ken’s arguments are problematic can be found here:
- Crispin Weston: https://edtechnow.net/guest-posts/ken-robinson-rebuttal/
- Joe Kirby: https://pragmaticreform.wordpress.com/2013/10/12/what-sir-ken-got-wrong/
- Carl Hendrick: https://www.tes.com/news/school-news/breaking-views/ken-robinson-a-teacher-basher-schools-must-stop-listening-his
Next in line is the father of the digital native, Marc Prensky who holds a degree in French, an MAT, and an MBA from Harvard Business School (beginning to recognise a trend with our quacksperts who (second spoiler alert) actually don’t have much, if any, expertise in the domain they quack about?). Prensky observed something; namely that children apparently were multitasking on their devices. Based on this observation, he concluded several things, such as that children can actually multitask (which is actually not possible) and that they have developed unique characteristics that distinguish them from previous generations. He also said that today’s children have sophisticated technical skills and certain learning preferences and that traditional education ignores both of them.
Next, without conducting any proper research on what he observed and concluded, he published two articles (part 1 & part 2) on the matter (followed by some well-selling books) which suited the spirit of times quite well. Despite all the evidence proving that the contrary is true (children are unable to multitask and learning preferences are not always; actually usually NOT effective), the words of this eminence form the foundation of a lot of misconceptions in and on education. Paul’s article that he wrote with Jeroen van Merriënboer (includes scientific evidence!) makes mincemeat of the digital native in no time.
- Donald Clark: http://donaldclarkplanb.blogspot.fi/2013/02/prensky-game-on-digital-natives.html
- Henry Jenkens: http://henryjenkins.org/2007/12/reconsidering_digital_immigran.html
- Ellen Helsper and Rebecca Enyon: http://tinyurl.com/lrh4jxn
The list is virtually endless. A short list could include the following names as well:
- Carol Black (Writer and TV-maker of Ellen and The Wonder Years) – What the modern world has forgotten about children and learning,
- Amy Chua (Lawyer) – Battle Hymne of the Tiger Mother,
- George Lucas (Filmmaker; e.g., StarWars and Indiana Jones) – The George Lucas Educational Foundation (Edutopia), and
- Bill Gates (Microsoft co-founder) – K-12 Education program, and…
- Add as many as you like!
Dear readers: Don’t you think it’s time to get rid of our belief in such eminences and move toward evidence-informed practices? Isn’t it time to see that these emperors have no clothes? We’d say “YES” and that that we, human beings, and especially our children deserve it!
Illustration of The Emperor’s New Clothes (Hans Christian Andersen by Vilhelm Pedersen, Andersen’s first illustrator
 There are five types of Cochrane Reviews:
- Intervention reviews assess the benefits and harms of interventions used in healthcare and health policy.
- Diagnostic test accuracy reviews assess how well a diagnostic test performs in diagnosing and detecting a particular disease.
- Methodology reviews address issues relevant to how systematic reviews and clinical trials are conducted and reported.
- Qualitative reviews synthesize qualitative evidence to address questions on aspects other than effectiveness.
- Prognosis reviews address the probable course or future outcome(s) of people with a health problem.
 Summaries are available for free at http://www.cochrane.org/evidence
 Sawyer, R. K. (2012). Explaining creativity: The science of human innovation. Oxford: Oxford University Press.
20 thoughts on “Eminence-Based Education or the Terror of Famous & Shameless Eduquacks”
I think I agree on this like John Hattie agrees on this subject. In this article and video he discusses the term ‘evidence’ and how we all have evidence to prove we are all doing the right thing. https://visible-learning.org/2017/08/john-hattie-how-you-teach-video/
I am curious about how you look at the research of John Hattie (Professor of Education) and his evidence-based opinion about teaching. He is not saying that school is killing creativity like Ken Robinson does. He points out that according to his research Creativity Programs (and other programs) have a significant, positive impact on student performance.
I really appreciate John’s work. I know there has been recent commentary on his statistics (not my field of expertise) but on the whole solid and important insights!
Reblogged this on kadir kozan.
Of course educators should collectively follow, access, understand and correctly implement research based, best practices, that advance student success performance improvement outcomes for all students. The problem is that educators most likely are the worst offenders in not doing this and most likely suffer most from the dunning kruger effect.
When the incumbent teaching approach is a 20th century, factory based, one size fits all teaching methodology, that at best, provides superficial initial understanding that is soon forgotten, for the ‘lucky’ middle, you need to look in the mirror and quit blaming everyone else for something you are doing and quit defending by transference, something that does not work to advance sustained, relevant, performance improvement outcomes FOR ALL STUDENTS.
Maybe educators are so delusional that they actually think that what they are doing works to measurably, effectively, consistently, and affordably advance relevant student success outcomes for all students, when the data says it does not.
There are a number of absolutes with traditional educators: (1) They are willing to dish out criticism, but they are painfully unable to take it, (2) They think they are (and only educators are) experts in everything, especially in learning, transfer, performance improvement and education reform, when their expertise is actually simply limited to their subject (see Dunning Kruger effect), (3) They are expert naysayers, but offer no viable solutions (look at distribution of false information), (4) They cannot see the forest from the trees, (5) They don’t follow the research, (6) Ignorance is bliss (7) It’s everybody else’s and everything else’s fault. Fix these items and things will be great (8) Student success mediocrity is okay, change is painful, it takes effort, is bad and it’s something to avoid (9) They operate within a ‘secretive’, cult like cancerous environment, where the mandate is to fit in, which means gravitating to the lowest common denominator (all I have to be is better than Bob to keep my job), (10) They live in a world of entitlement (You owe me) and (11) Student success outcomes, accountability measure,s are: don’t rock the boat, everybody needs to get along and show up for work
Quite simply folks in glass houses shouldn’t throw stones.
You are habitually and routinely performing bad medicine on a daily basis and choose NOT to improve it. Funny stuff, Huh? I for one am not laughing, nor should you
Hi Tom, thanks for taking the time to reply. I guess you have enough thoughts on the topic to write a blog yourself. We’d say that the idea that education is a 19th century factory model is in itself a fable: http://hackeducation.com/2015/04/25/factory-model.
I have a blog and a website ( http://mcdonaldsalesandmarketing.biz/research/) with 1,100 + pages of research driven credible, third party content and 1,000’s of links. I’d call your fable article interesting, but intentional avoidance of the core problem, which is routinely done in traditional education, to maintain the flawed status quo. Rather than discussing the forest I’m deferred to discussing the trees.
Poor pedagogy, focus on the employees and the grounds vs focusing on advancing student success for all students and the resistance to change maintain mediocrity in relevant performance improvement outcomes for the public and the students.
Semantics are fun, but unproductive when they add nothing to improving a defined problem
Hello Tom! Having read your website, I can see why you are so keen to try to shoot-down what Paul is saying. You certainly are very active at selling and marketing your own product, and his perspective must feel like quite a threat – I can see that. And no doubt you have plenty of research evidence for how the service you have provided for people has led them to lead a much more successful life than they would otherwise have had should they not have paid for your consultancy…
I am totally with you regarding the need to rip-up the flawed educational system that we have inherited from the 20th Century, for one that advances student success for all students. I’m simply holding back a little until we have managed to properly roll-out the genome map for each student and combined that with our complete map of the lives to come for all students, so that we can then expertly intervene to exclusively interfere with their minds in a way which they will agree on their death-beds really was the best possible education that they could have had.
Until then it’s a deluded, Ted-Talk enfused pipe-dream… in my humble opinion 😉
I guess my take on things can be summarised in this post, and in the supporting ones building-up to it: https://steppingbackalittle.wordpress.com/2017/09/28/science-and-education-limits-possibilities-part-5-perfect-education-in-an-imperfect-world/
Left-right brain. Learning styles. Grit.
Reblogged this on The Echo Chamber.
You forgot about Jo Boaler
100% correct! As I said, the list goes on and on.