ads

,
Showing posts with label ross koppel. Show all posts
Showing posts with label ross koppel. Show all posts
The academic health IT community has spent the past decade (at least) burying their collective ostrich heads in the sand about the crappy software that is called health IT.

A few, though, have taken on the health IT industry at the heart of bad health IT design (including yours truly, which sadly was not enough to save my own mother from health IT design defects).

Probably the bravest soul on these issues, however, is Penn sociologist Ross Koppel.  In a critique of the latest from the medical informatics academic community on reigning in the hazards of this technology, an article by Sittig and Singh at U. Texas, he wrote the following piece in the BMJ:

The health information technology safety framework: building great structures on vast voids
http://m.qualitysafety.bmj.com/content/early/2015/11/19/bmjqs-2015-004746.full.pdf

Download it and read it in its entirety.  It makes the point that the solutions to these problems (which I increasingly believe just might be an insoluble, wicked problem without major scope and ambition reductions regarding the use of health IT) must be based on reality.

The reality must start from a firm response not to end users being flummoxed by bad rollouts or by carelessness (user error), but to the issue of products poorly designed from the get-go by their sellers whose primary interest is to make money come hell or high water.

Koppel makes the point that one will not get good results driving a car if that car is designed poorly, with hidden and confusing controls, defective brakes and an engine that overheats and explodes without warning, no matter what post-design interventions take place.

The issues of design flaws and fundamental fitness for purpose need to be blown open in a manner similar to the manner in which drugs and other medical devices are evaluated and regulated.  Academia needs to lead the charge, not suggest band aids, however well intentioned those band aids might be.

Koppel writes:

 ... In essence, I suggest that these two eminent colleagues tell us to look under the lamppost even though, as the old saying goes, the keys were dropped 70 feet away from the lamppost in the dark. Both Singh and Sittig, of course, are fully aware of the errors listed above,3 4 but (1) they expect that we can detect and understand these problems with error reporting, although many potentially serious errors go undetected (thus, unreported), and when detected, the poor design features that contributed to the error may not be readily apparent. (2) Singh and Sittig tend to attribute those sorts of problems to poor implementation, user errors or lack of access to the technology. They do not seriously question if the software is fit for its purpose.

And this:

 ... In fact, their assumption that HIT software is well designed runs throughout their work. They write about: misused software, unavailable software, poorly
implemented software and malfunctioning software (emphasis added), but what of badly designed software—neither user friendly nor interoperable with systems holding needed patient data? That failure is
not in their purview. They don’t challenge HIT vendors who design the software, or the regulators, who so often serve primarily as HIT industry promoters. Here’s what they write we need to address (my
italics): ‘1) concerns that are unique and specific to technology (e.g., to address unsafe health IT related to unavailable or malfunctioning hardware or software);
2) concerns created by the failure to use health IT appropriately or by misuse of health IT.

I add that such articles tend to confuse policy makers about what truly is needed to solve problems with HIT.

I've had the guts to take on these issues via the legal route after the death of my mother, something that led a number of academic zealots to intone that the incident, in 2010, a decade after my writings on bad health IT began, caused me to lose my objectivity.  That puerile, perverse reasoning passes for wisdom in certain academic informatics circles.  Yet it appears their objectivity about health IT never existed.

I lack respect for paper writers who in effect become apologists for products birthed as dangerous right out of the gate by opportunistic health IT companies.  Perhaps the health IT-mediated death of one of their loved ones would wake them up, but I sometimes doubt even that.

This is no mere academic spat. In this case, patient risk and harm worldwide is at issue.

The root of any software problem in healthcare, as I've written before, is at the design level.  Trying to work around bad design without facing reality leads to and perpetuates risk, patient harm, clinician disillusionment (e.g., the Medical Societies letter to ONC) and impairment of clinicians trying to take care of patients.

Kudos to Koppel. I hope the repercussions of his challenge to the usual academic fecklessness and special accommodations afforded this unregulated industry are not too severe.

Academics can be feckless towards possible sources of funding, but quite mean to internecine challenges, as Sittig, one of the authors of the challenged piece, was with me in an incident I found out about only because he did not know one of the people to whom he badmouthed me had been a former student I'd mentored.

-- SS

7:43 AM
I have not blogged on EHR issues in some time, despite some interesting source material such as:


These can be read at the links above, and are self-explanatory.

A new Politico investigation and article, however, is worth writing about:
  
Politico
Doctors barred from discussing safety glitches in U.S.-funded software
Darius Tahir
09/11/15
http://www.politico.com/story/2015/09/doctors-barred-from-discussing-safety-glitches-in-us-funded-software-213553

President Barack Obama’s stimulus put taxpayers on the hook for $30 billion in electronic medical records, many of which have turned out to be technological disasters.

But don’t expect to hear about the problems from doctors or hospitals. Most of them are under gag orders not to discuss the specific failings of their systems — even though poor technology in hospitals can have lethal consequences. 

[Change the "can" to "does", e.g., ECRI Deep Dive, http://hcrenewal.blogspot.com/2013/02/peering-underneath-icebergs-water-level.html - ed.]

A POLITICO investigation found that some of the biggest firms marketing electronic record systems inserted “gag clauses” in their taxpayer-subsidized contracts, effectively forbidding health care providers from talking about glitches that slow their work and potentially jeopardize patients.


[E.g., see http://hcrenewal.blogspot.com/search/label/glitch - ed.]

POLITICO obtained 11 contracts through public record requests from hospitals and health systems in New York City, California, and Florida that use six of the biggest vendors of digital record systems. With one exception, each of the contracts contains a clause protecting potentially large swaths of information from public exposure. This is the first time the existence of the gag clauses has been conclusively documented.

I note this Politico article appears six years after the seminal JAMA article on hold harmless and defects nondisclosure clauses:

as well as:


In that 2009 JAMA Letter to the Editor I observed:

... In their Commentary, Dr Koppel and Mr Kreda made clear the problems associated with applying the customs and traditions of business software contracting and sales (where “hold harmless” and “keep defects secret” clauses are commonplace) to health care information technology (HIT) as if they are the same. I believe that ignoring their differences has likely created an epidemic of violations of hospital governing body responsibilities and Joint Commission standards for health care organization leadership.

In 2015 I stand by these assertions.  Computer and business personnel - through arrogance, selfishness, narrow-mindedness and other issues - have made a mess assuming that business software practices apply to clinical medicine and healthcare IT.  In the latter domain, however, increased clinical stress and hypervigilance due to bugs clinicians have to work around (that might have been fixed sooner), lessening their performance and increasing risk, and patient injury and death has been the result of a belief that clinical computing is just a niche area of business computing.  (I've been making this point for at least 15 years, I might add.)

Such contractual practices endanger patients, and in 2015 are reckless, negligent and inexcusable.

http://injury.findlaw.com/accident-injury-law/recklessness.html
Recklessness means the person knew (or should have known) that his or her action were likely to cause harm. Negligence means that the person acted in violation of a duty to someone else, with the breach of that duty causing harm to someone else.

More from the Politico article:

Vendors say such restrictions target only breaches of intellectual property and are invoked rarely.

IP breaches?  While I understand the business issues at hand, in reality this is farcical.  There is little unique and valuable IP in these systems...as if one EHR vendor would really copy off another EHR vendor's screens.  I've seen many EHRs and their instruction manuals and in my opinion there's little worth stealing from any of these look-alike systems.

But doctors, researchers and members of Congress contend they stifle important discussions, including disclosures that problems exist. In some cases, they say, the software’s faults can have lethal results, misleading doctors and nurses who rely upon it for critical information in life-or-death situations.

Change the "can" to "do."  See ECRI link above, posts such as at http://hcrenewal.blogspot.com/2011/09/sweet-death-that-wasnt-very-sweet-how_24.html, and as readers here know, I have one less living relative thanks to EHR faults.  (I know of others that I cannot discuss.)

Critics say the clauses – which POLITICO documented in contracts with Epic Systems, Cerner, Siemens (now part of Cerner), Allscripts, eClinicalWorks and Meditech – have kept researchers from understanding the scope of the failures.

I actually refute that.  I believe many researchers (in the field of Medical Informatics, at least) were blinded by their own wishful thinking about health IT and their own misplaced overconfidence in computing.  My writings for a decade and that of many other "iconoclasts", based on experience and insight from other fields in which we worked, clearly raising huge red flags, were derided or summarily ignored.  For instance, see my post "The Dangers of Critical Thinking in A Politicized, Irrational Culture" from almost exactly five years ago at http://hcrenewal.blogspot.com/2010/09/dangers-of-critical-thinking-in.html.  There was enough data to ascertain that major problems were extant.

Even the ECRI Deep Dive EHR safety study referenced above, now at least three years old, finding 171 IT mishaps in 9 weeks in just 36 hospitals voluntarily reported, causing 8 significant harms and 3 possible deaths, is rarely cited by the "researchers."  See http://hcrenewal.blogspot.com/2013/02/peering-underneath-icebergs-water-level.html.

... Sheldon Whitehouse (D-RI) asked a panel of witnesses [during a HELP committee hearing earlier this summer], including Allscripts CEO Paul Black: “Can anyone on this panel see a single reason why these contracts should have gag clauses in them?”  No one ventured a reason.

Perhaps, I ask, because it would be hard to say something like "Senator, our computers have more rights than patients, and we don't give a damn about patient harm as long as the $$$ keep rolling in, and payouts for screw-ups that do make it to court are manageable", Ford Pinto-style, in such a setting?

After POLITICO disclosed its findings, an aide to HELP Chairman Lamar Alexander (R-Tenn.) said the committee would look at the issue, “exploring potentially harmful effects of these clauses – including how they could inhibit interoperability.”

The interoperability issue is a diversion if not a non-sequitur.  Dreamers still believe billions will be magically saved, and lives saved, via "interoperability", ironically at a time when basic operability is poorly achieved.

Let me state this clearly:  health IT will always be a major cost center and will never result in the mass cost savings attributed by the pundits to it.  From experience, I state that is a pipe dream, a fantasy, a risible statement consistent with a mania over the technology.  The issues in medicine that cost dear money are complex, and are not amenable to solution via cybernetic miracles.

See http://hcrenewal.blogspot.com/2012/09/wsj-koppel-and-soumerai-major-glitch.html for more on this issue:

... a comprehensive evaluation of the scientific literature has confirmed what many researchers suspected: The savings claimed by government agencies and vendors of health IT are little more than hype.

To conduct the study, faculty at McMaster University in Hamilton, Ontario, and its programs for assessment of technology in health—and other research centers, including in the U.S.—sifted through almost 36,000 studies of health IT. The studies included information about highly valued computerized alerts—when drugs are prescribed, for instance—to prevent drug interactions and dosage errors. From among those studies the researchers identified 31 that specifically examined the outcomes in light of the technology's cost-savings claims.

With a few isolated exceptions, the preponderance of evidence shows that the systems had not improved health or saved money.


Rather than saving money, the industry is sucking in some of that $17 or so trillion the United States just doesn't have (http://www.usdebtclock.org/).  See for instance "The Machinery Behind Health-Care Reform: How an Industry Lobby Scored a Swift, Unexpected Victory by Channeling Billions to Electronic Records", Washington Post, by Robert O'Harrow Jr., May 16, 2009.

Back to Politico:

... Take Cerner’s agreement with LA County’s Department of Health Services, signed in November 2012 and worth up to $370 million. It defines the vendor’s confidential information as “source code, prices, trade secrets, mask works, databases, designs and techniques, models, displays and manuals.” Such information can only be revealed with “prior written consent.” The protections cover the provider company, and its employees.

Such agreements, which are typical of the contracts examined by POLITICO, “contain broad protections for intellectual property and related confidentiality and non-disclosure language which can inhibit or discourage reporting of EHR adverse events,” said Elisabeth Belmont, corporate counsel at MaineHealth.

Belmont said she had also seen non-disparagement wordings that prohibit providers from disseminating negative information about the vendor or its software. POLITICO found no direct evidence of such clauses.

"Non-disparagement wording?"

How about good old-fashioned Orwellian thought control?  See my Oct,. 2013 post 'Words that Work: Singing Only Positive - And Often Unsubstantiated - EHR Praise As "Advised" At The University Of Arizona Health Network' at http://hcrenewal.blogspot.com/2013/10/words-that-work-singing-only-positive.html.


... The executive branch—the Office of the National Coordinator for Health IT (ONC) and the Centers for Medicare and Medicaid Services are responsible for the subsidy program— has done little about the clauses, though providers and researchers have been grumbling about them since the 2011 Institute of Medicine report warning that “[t]hese types of contractual restrictions limit transparency, which significantly contributes to the gaps in knowledge of health IT–related patient safety risks.”

...Agency officials say they deplore the clauses but lack the capacity to directly address the problem. “We strongly oppose ‘gag clauses’ and other practices that prevent providers and other health IT customers and users from freely discussing problems and other aspects of their health IT,” an ONC spokesman said.

But, he continued, ONC cannot police them. The clauses take a variety of forms, and the extent to which vendors invoke them varies, making enforcement difficult – particularly for a small agency that doesn’t have investigative or police powers.

A small agency that doesn’t have investigative or police powers?  Really?  Yet - ONC is a promoter of the non-regulatory "Safety Center" concept as a solution to health IT safety risks.  See for instance http://hcrenewal.blogspot.com/2014/04/fda-on-health-it-risk-reckless-or.html.  Their response above to Politico seems disingenuous.

What follows in the Politico article is vendor excuses and soothing reassurances, like this one:

... Epic executives said they encourage open discussion. “With permission, we very frequently allow folks to share information around the software,” said Epic’s vice president for client success, Eric Helsher.

I'll surmise I would not be able to easily get detailed information on the ten thousand EPIC "issues" I highlighted at my Nov. 2013 post "We’ve resolved 6,036 issues and have 3,517 open issues": extolling EPIC EHR Virtues at University of Arizona Health System", http://hcrenewal.blogspot.com/2013/11/weve-resolved-6036-issues-and-have-3517.html, for publication on this blog.

... a lot of problems may go under-reported. That offends [Dr. Bob] Wachter, who says the patient safety world “takes it as religion” that information be shared as widely as possible.

“These are worlds colliding. You can understand why a technology business would put restrictions on screenshots. But we’re not making widgets here, we’re taking care of sick people,” he said.

“At some level, I’d say, ‘How dare they?’”

"At some level?"  What level, exactly?

How about the life-and-death level?

Worlds colliding, indeed; the aforementioned business-IT world and the clinical world.  I would drop the "at some level" phrase, though, and also go back to my 2009 JAMA letter observation that I repeat once again: 

... In their Commentary, Dr Koppel and Mr Kreda made clear the problems associated with applying the customs and traditions of business software contracting and sales (where “hold harmless” and “keep defects secret” clauses are commonplace) to health care information technology (HIT) as if they are the same. I believe that ignoring their differences has likely created an epidemic of violations of hospital governing body responsibilities and Joint Commission standards for health care organization leadership.

Health IT companies are simply not team players in medicine.  Their heavy-handedness and narrow thinking has harmed and killed patients.   How many in total? 

Last year I spoke to a half dozen US House members and a dozen or so aides of House members who could not attend.   I was accompanied by two Plaintiff's lawyers (yes, Plaintiff's lawyers) who told their own tales of EHR-mediated catastrophes whose survivors they had represented.  They were there for that purpose, to inform the US Reps that health IT was killing people.

Extrapolating the ECRI Deep Dive study figures and adding in other known cases, the true level of harms is anything but pretty.

It would be a very useful exercise to measure it explicitly rather than using the Ostrich approach (see for instance my post "FDA on health IT risk:  "We don't know the magnitude of the risk, and what we do know is the tip of the iceberg, but health IT is of 'sufficiently low risk' that we don't need to regulate it" (http://hcrenewal.blogspot.com/2014/04/fda-on-health-it-risk-reckless-or.html). 

However, obtaining the data in a robust matter could result in those reporting the data violating EHR gag and non-disparagement clauses.

We must respect the rights of the computers...

-- SS

Addendum:  the Politico article, unfortunately, while a major piece, did not cite Koppel/Kreda or their pioneering 2009 JAMA article.  I surmise this was an oversight.


11:04 AM
Two EHR experts from Ivy-league institutions (which are typically hyperenthusiast-oriented) doubt cost savings from EHR technology.

Wall Street Journal
Opinion
September 17, 2012

A Major Glitch for Digitized Health-Care Records


Savings promised by the government and vendors of information technology are little more than hype.

By STEPHEN SOUMERAI And ROSS KOPPEL

In two years, hundreds of thousands of American physicians and thousands of hospitals that fail to buy and install costly health-care information technologies—such as digital records for prescriptions and patient histories—will face penalties through reduced Medicare and Medicaid payments. At the same time, the government expects to pay out tens of billions of dollars in subsidies and incentives to providers who install these technology programs.

Which, of course, means printing more money for luxuries we cannot afford in the midst of the worst economic downturn since 1929...

The mandate, part of the 2009 stimulus legislation [I think it would be more accurate to say "sneaked into the 2009 stimulus legislation for IT industry benefit" - ed.], was a major goal of health-care information technology lobbyists and their allies in Congress and the White House. The lobbyists promised that these technologies would make medical administration more efficient and lower medical costs by up to $100 billion annually. 

By up to $100 billion annually?   (Perhaps these lobbyists need lie detector tests - and/or drug tests to see what they may have been smoking?)  I note the lobbying was covered in the Washington Post in "The Machinery Behind Health-Care Reform: How an Industry Lobby Scored a Swift, Unexpected Victory by Channeling Billions to Electronic Records" by Robert O'Harrow Jr., May 16, 2009.

Many doctors and health-care administrators are wary of such claims—a wariness based on their own experience. An extensive new study indicates that the caution is justified: The savings turn out to be chimerical.

Some still have empirical observational skills and common sense, fortunately.  In my early days of health IT involvement two decades ago as an NIH-sponsored Medical Informatics post doctoral fellow, I believed there was some cost savings possible, but certainly not in the tens or hundreds of billions per year.  The technology was not solving problems that could lead to such savings (see for instance my Dec. 2010 post "Is Healthcare IT a Solution to the Wrong Problem?").  My experiences since my fellowship have only confirmed my own early opinions.

Since 2009, almost a third of health providers, a group that ranges from small private practices to huge hospitals—have installed at least some "health IT" technology. It wasn't cheap. For a major hospital, a full suite of technology products can cost $150 million to $200 million. Implementation—linking and integrating systems, training, data entry and the like—can raise the total bill to $1 billion.

That's countless billions that could have been spent on actual healthcare delivery itself, especially for underserved populations and the poor.  Instead, that money was funnelled to the IT industry for an experimental, unregulated, unvetted technology to be applied on live patients (and without patient consent, I add).

But the software—sold by hundreds of health IT firms—is generally clunky, frustrating, user-unfriendly and inefficient. For instance, a doctor looking for a patient's current medications might have to click and scroll through many different screens to find that essential information. Depending on where and when information on a patient's prescriptions were entered, the complete list of medications may only be found across five different screens.

Examples of that from actual systems (sketched to avoid IP problems) is at my ten part series on mission-hostile health IT at this blog, shortened link http://www.tinyurl.com/hostileuserexper.

Now, a comprehensive evaluation of the scientific literature has confirmed what many researchers suspected: The savings claimed by government agencies and vendors of health IT are little more than hype.

To conduct the study, faculty at McMaster University in Hamilton, Ontario, and its programs for assessment of technology in health—and other research centers, including in the U.S.—sifted through almost 36,000 studies of health IT. The studies included information about highly valued computerized alerts—when drugs are prescribed, for instance—to prevent drug interactions and dosage errors. From among those studies the researchers identified 31 that specifically examined the outcomes in light of the technology's cost-savings claims.

With a few isolated exceptions, the preponderance of evidence shows that the systems had not improved health or saved money.

One must understand this in the context of what these systems really are, what they do, and the problems they can actually address as in my post on 'solution to the wrong problem' mentioned supra.

The authors of "The Economics of Health Information Technology in Medication Management: A Systematic Review of Economic Evaluations" found no evidence from four to five decades of studies that health IT reduces overall health costs. Three studies examined in that McMaster review incorporated the gold standard of evidence: large randomized, controlled trials. They provide the best measure of the effects of health IT systems on total medical costs.

I point out that randomized controlled trials (RCT's) are notably rare in health IT studies.  Most "confirmatory" studies on health IT benefits are less powerful retrospective/observational studies in specialized settings, with many biases, poor science, etc.  In that sense, such studies can be considered non-generalizable and anecdotal at best (more on the "anecdotes" issue is below).

Of course, the pundits and Ddulites ("Luddite" with first four letters reversed; meaning ardent hyperenthusiasts) will likely say "it will all be fixed in version 2.0" despite decades of opportunity to get health IT "right" and demonstrate generalized improved outcomes and cost savings:

... At "Health IT: Ddulites and Irrational Exuberance" and related posts (query link) I've described the phenomenon of the: 'Hyper-enthusiastic technophile who either deliberately ignores or is blinded to technology's downsides, ethical issues, and repeated local and mass failures.'

From Regenstrief Institute, one of the premier and pioneering centers for Medical Informatics research and teaching:

A study from Regenstrief, a leading health IT research center associated with the Indiana University School of Medicine, found that there were no savings, and another from the same center found a significant increase in costs of $2,200 per doctor per year. The third study measured a small and statistically questionable savings of $22 per patient each year.

That's probably not taking into account increased medical malpractice costs as exemplified here and here and by other settlements I know of but cannot mention due to my consulting role in those cases.

A primer on health IT risks, containing a number of key articles and links, is downloadable at http://www.ischool.drexel.edu/faculty/ssilverstein/HIT_issues_Primer.zip

In short, the most rigorous studies to date contradict the widely broadcast claims that the national investment in health IT—some $1 trillion will be spent, by our estimate—will pay off in reducing medical costs. Those studies that do claim savings rarely include the full cost of installation, training and maintenance—a large chunk of that trillion dollars—for the nation's nearly 6,000 hospitals and more than 600,000 physicians.

$1 trillion would pay for a tremendous amount of actual healthcare delivery, I note.

These system lifecycle costs, known as "total cost of ownership", are due to upgrades and necessary changes as medicine itself, including the science, business and legal components change over time.   The costs are generally underestimated ahead of time.  A good source on these issues is the article "Pessimism, Computer Failure, and Information Systems Development in the Public Sector"  (Public Administration Review 67;5:917-929, Sept/Oct. 2007).  This is a cautionary article on IT that recommends much more critical attitudes towards major IT initiatives in all sectors. 

But by the time these health-care providers find out that the promised cost savings are an illusion, it will be too late. Having spent hundreds of millions on the technology, they won't be able to afford to throw it out like a defective toaster.

There, I disagree.  We may have to "throw it out" as the disruptions to good medical care by bad health IT (BHIT) increase, unless the industry reforms itself very rapidly.  As I state in the introduction to my teaching website "Contemporary Issues in Medical Informatics: Good IT, Bad IT, and Common Examples of Healthcare Information Technology Difficulties" (started in late 1998 due, in fact, to my observations of inappropriate leadership and poor quality of health IT):

The site takes a view consistent with medicine’s core values and with patients’ rights that health IT, as a medical apparatus that increasingly forms an enterprise clinical resource management and clinician workflow control mechanism, remains experimental and should be subject to the same ethical considerations, validation processes and regulatory oversight to which almost all other medical technologies and pharmaceuticals are subjected. The site is pro-health IT, but only when the health IT is “good IT” - as opposed to “bad IT."

Good Health IT ("GHIT")
is defined as IT that provides a good user experience, enhances cognitive function, puts essential information as effortlessly as possible into the physician’s hands, keeps eHealth information secure, protects patient privacy and facilitates better practice of medicine and better outcomes.

Bad Health IT ("BHIT")
is defined as IT that is ill-suited to purpose, hard to use, unreliable, loses data or provides incorrect data, causes cognitive overload, slows rather than facilitates users, lacks appropriate alerts, creates the need for hypervigilance (i.e., towards avoiding IT-related mishaps) that increases stress, is lacking in security,
compromises patient privacy or otherwise demonstrates suboptimal design and/or implementation.

This site challenges medically and ethically controversial views that health IT merits special accommodations in terms of freedom from scientific rigor and evidence-based practices, freedom from regulation, and freedom from accountability. 

I  hold little hope of these issues being seriously addressed - let alone solved - any time in the near future due to:

1)  the irrational exuberance about this technology, cf: Twitter feeds on hashtags #EHR, #EMR, #HCIT and similar;
2)  the industry-promoted myths and fabrications over decades;
3)  the FDA-admitted impediments to information diffusion about defects and harms (link);
4)  IOM-admitted impediments to same (link);and
5)  the latter's industry-favoring, Milquetoast 2012 recommendations on monitoring, remediation and regulation.

These are indicative of an industry that has neatly avoided any meaningful regulation and is, in plain terms, out of control.

Why are we pushing ahead to digitize even more of the health-care system, when the technology record so far is so disappointing? So strong is the belief in health IT that skeptics and their science are not always welcome. Studies published several years ago in the Journal of the American Medical Association and the Annals of Internal Medicine reported that health IT systems evaluated by their own developers were far more likely to be judged "successful" than those assessed by independent evaluators.

"Not welcome" is an understatement. 

ONC itself is guilty of bad science, as in its grossly deficient March 2011 Health Affairs paper on health IT benefits. (See my Oct. 2011 post "ONC: The Benefits Of Health Information Technology: A Review Of The Recent Literature Shows Predominantly Positive Results".  Also see my Aug. 2012 post "ONC and Misdirection Regarding Mass Healthcare IT Failure".)

So bad is the "Health IT critique not welcome" phenomemon that, for example, Medical Informatics leaders such as Bill Hersh of Oregon Health Sciences University (OHSU) openly attack those who are candid on health IT risks (and make fools of themselves via the open attacks), such as the attack I wrote of at my Sept. 2010 post "The Dangers of Critical Thinking in A Politicized, Irrational Culture".

Also common in the "Health IT Critique Not Welcome Here" club, and probably deliberately so, is mistaking risk management activities for research observations and calling the former, even when reported by credible witnesses, "anecdotal" while calling at-best weak HIT-positive studies "definitive science."  See "From a Senior Clinician Down Under: Anecdotes and Medicine, We are Actually Talking About Two Different Things" for the definitive rebuttal of that type of patient-endangering intellectual blindness or dishonesty.

Government agencies like the Office of the National Coordinator of Healthcare Information Technology (an agency of the Department of Health and Human Services) serve as health IT industry boosters. ONC routinely touts stories of the technology's alleged benefits.

But almost never the opposite, which is equally if not more important.  Further, they tout "certification" as a means of HIT safety evaluation and assurance, or do not deny that misconception, despite statements by the very certification bodies or ATCB's they appoint to the contrary.  Yet they need to come clean on this. (I've seen the claim of 'certification equals safety' in actual legal briefs in defense of health IT.)  See my Feb. 2012 post "Hospitals and Doctors Use Health IT at Their Own Risk - Even if Certified."

ONC also seems to turn a blind eye to industry-ghostwriting abuses in the public comments period of Notices of Proposed Rulemaking for "meaningful use" (itself an Orwellian term) rules.  See for instance my Sept. 2012 posts "Health IT Vendor EPIC Caught Red-Handed: Ghostwriting And Using Customers as Stealth Lobbyists - Did ONC Ignore This?" and "Was EPIC successful in watering down the Meaningful Use Stage 2 Final Rule?"

We fully share the hope that health IT will achieve the promised cost and quality benefits. As applied researchers and evaluators, we actively work to realize both goals. But this will require an accurate appraisal of the technology's successes and failures, not a mixture of cheerleading and financial pressure by government agencies based on unsubstantiated promises.

I share the same sentiments.  As I've often written, the Achilles heel of the health IT sector is its ignoring the very science and evidence-based approaches of the field - medicine - that health IT is supposed to somehow "revolutionize" and "transform."

It is, quite frankly, the utmost in hypocrisy for an industry that demands evidence-based medicine - and touts its expensive products as leading to that change - to itself not practice what I've called "evidence-based computing."

Mr (sic) Soumerai is professor of population medicine at Harvard Medical School and Harvard Pilgrim Health Care Institute. Mr. Koppel is a professor of sociology and medicine at the University of Pennsylvania and principal investigator of its Study of Hospital Workplace Culture.

Dr. Soumerai also co-authored "Don't Repeat the UK's Electronic Health Records Failure" with Anthony Avery, Professor of Primary Care at the University of Nottingham Medical School, UK, Huffington Post, Dec. 5, 2010.

I also expect to hear an "Ivy tower academics - what do they know?" refrain from the industry.  However, this will not hold water, as the Ivory tower inhabitants, as I previously stated, are almost uniformly of the Ddulite-hyperenthusist persuasion and touted when they speak or write in uncritical favor of health IT.

-- SS

Addendum:

Penn Wharton professors had a similar opinion on cost-savings in 2009:

Information Technology: Not a Cure for the High Cost of Health Care: Knowledge@Wharton, Wharton School of Business, University of Pennsylvania, June 10, 2009. (PDF version available at this link)

As I observed in my June 20, 2009 post "Improving Patient Safety In The EU: HIT Should Be Classified As Medical Devices. And, Can We Drop the "Massive Cost Savings" Fable?", in a WSJ article that same day entitled "The Myth of Prevention", Abraham Verghese, Professor and Senior Associate Chair for the Theory and Practice of Medicine at Stanford echoed the Wharton professors' doubts about the cost savings and ultimate value of electronic medical records:

... I have similar problems with the way President Obama hopes to pay for the huge and costly health reform package he has in mind that will cover all Americans; he is counting on the “savings” that will come as a result of investing in preventive care and investing in the electronic medical record among other things. It’s a dangerous and probably an incorrect projection.

I also had related observations published in a Letter to the Editor in the WSJ in February of that year:

Digitizing Medical Records May Help, but It's Complex, Feb. 18, 2009

You observe that the true political goal is socialized medicine facilitated by health care information technology. You note that the public is being deceived, as the rules behind this takeover were stealthily inserted in the stimulus bill.

I have a different view on who is deceiving whom. In fact, it is the government that has been deceived by the HIT industry and its pundits. Stated directly, the administration is deluded about the true difficulty of making large-scale health IT work. The beneficiaries will largely be the IT industry and IT management consultants.

For £12.7 billion the U.K., which already has socialized medicine, still does not have a working national HIT system, but instead has a major IT quagmire, some of it caused by U.S. HIT vendors.

HIT (with a few exceptions) is largely a disaster. I'm far more concerned about a mega-expensive IT misadventure than an IT-empowered takeover of medicine.

The stimulus bill, to its credit, recognizes the need for research on improving HIT. However this is a tool to facilitate clinical care, not a cybernetic miracle to revolutionize medicine. The government has bought the IT magic bullet exuberance hook, line and sinker.

I can only hope patients get something worthwhile for the $20 billion.

Scot Silverstein, M.D.
Faculty
Biomedical Informatics
Drexel University Institute for Healthcare Informatics
Philadelphia

Next time you hear from some pundit about enormous "cost savings" from clinical IT, remember this post.

Let's implement health IT - and do it well, i.e., good health IT (GHIT) instead of bad health IT (BHIT)- to facilitate clinicians, not to work financial miracles or "revolutionize" anything.


A slide from my Aug. 1, 2012 presentation to the Health Informatics Society of Australia at HIC2012.  Click to enlarge.


-- SS
3:24 AM