Posted by on June 8, 2020 8:31 am
Tags: , , , , ,
Categories: Top Page Links

“The Flawed COVID-19 Model That Locked Down Canada”


By Peter St. Onge and Gaël Campan, courtesy of IEDM

 

Before mid-March, most Canadians saw COVID-19 as an overseas problem. The emphasis was on returning Canadians stuck in China, and there had been a single COVID-19 death in Canada, a BC man in his 80s with underlying health issues.

 

Then, suddenly, the world changed. Within two weeks, practically the entire Canadian economy was locked down. Gatherings were banned, schools and daycares closed, and nearly every business deemed “non-essential” shut down in a bid to slow the virus. Historic job losses followed, 500,000 in the first week alone. By April 13, nearly 6 million Canadians had applied for emergency benefits.(1)

 

What happened? On March 16, Professor Neil Ferguson of Imperial College London released an epidemiological model that took the world by storm.(2) The report warned that tens of millions would die in a pandemic that was compared to the Spanish flu, the deadliest epidemic in modern times.

 

The only option, warned the report, would be radical physical distancing of the entire population, potentially for 18 months, until a vaccine was available. The paper advised that less restrictive methods such as isolation of suspected cases and physical distancing of the elderly and at-risk would merely reduce deaths by half. Instead, what was needed was total isolation. Two days later, the US-Canada border closed to non-essential travel, and one week after that, Prime Minister Trudeau announced an $82‑billion aid bill to address the massive job losses expected from the lockdowns.

 

Now, two months later, experts have uncovered serious flaws in the original Imperial College paper. Furthermore, evidence has emerged that Professor Ferguson himself has a long history of overpredicting deaths by a wide margin—a concern confirmed by data from countries that never locked down in the present crisis. It follows that Canada and other countries may have vastly overreacted to a single bad projection.​

 

The Predictions Behind the Lockdown

 

In his March 16 paper, Professor Ferguson predicted that COVID-19 would kill 510,000 in the UK and 2.2 million in the US in 2020. Ten days later, his team gave revised estimates for many countries, including Canada, and they were grim. Ferguson projected that, unmitigated, COVID-19 would kill 326,000 in Canada this year (see Table 1). With a “75% reduction in interpersonal contact rates,” however, he predicted deaths would fall to under 46,000 in Canada. Worldwide, he predicted that in the “unmitigated” absence of interventions, COVID-19 could infect 7 billion, resulting in 40 million deaths.(3)

 

 

The World Health Organization (WHO), which had just months earlier stated that mass quarantines are not effective for infectious diseases, quickly changed its tune, promoting the package of coercive measures China had enacted, including mandatory quarantine, contact tracing by authorities, and ultimately, lockdowns.(4)

 

Professor Ferguson’s paper had an enormous impact on lockdown debates. He himself was quickly dubbed “Professor Lockdown” in the media.(5) Johan Giesecke, former chief scientist for the European Center for Disease Control and Prevention, has called his model “the most influential scientific paper” in memory, and also “one of the most wrong.”(6)

 

Why was Professor Ferguson so influential? Mark Landler and Stephen Castle wrote in The New York Times, “It wasn’t so much the numbers themselves, frightening though they were, as who reported them: Imperial College London.” With the professor’s ties to the WHO, the authors noted, Imperial was “treated as a sort of gold standard, its mathematical models feeding directly into government policies.” The title of the Times article said that Ferguson’s report had “jarred the U.S. and the U.K. to action,” as Britain shelved its original strategy of allowing herd immunity to spread in favour of a strict lockdown.(7)

 

The panic quickly spread to Canada. The medical director of critical care at a Toronto hospital warned that Ontario’s health system could face “total collapse,” writing, “It’s World War Three. This could be an unmitigated disaster. This is the time to overreact.”(8)

 

Predictions vs. Reality

 

Today, the world looks very different. Far from “World War Three,” hospitals are actually turning off the lights in some formerly busy corridors. In Ontario, “almost 78 per cent of the province’s expanded ventilator capacity remained free” in early April as “patient volume was well under the ‘best case’ scenario depicted in Ontario-government epidemic modeling.” At the end of April, Ontario’s chief medical officer announced dozens of deaths from cardiac patients avoiding hospitals for fear of COVID-19.(9)

 

Moreover, the pandemic has had far worse effects in Quebec, especially Montreal, despite one of the most aggressive lockdowns in Canada. Given over 82% of Canadian COVID-19 deaths have been in long-term care facilities, it is possible that senior centre policies may have been far more important than lockdowns.(10)

 

Meanwhile, epidemiological models have been revised dramatically downward from Professor Ferguson’s extremes. On April 9, Canada revised estimated deaths to between 11,000 and 22,000, compared with his range of 8,000 to 326,000 deaths. On April 14, the UK revised their estimate down to 23,000, compared to his range of 22,000 to 602,000 deaths. The US, partly open throughout COVID-19, on May 4 revised estimates to 134,000 (double the 2017 US flu season), compared to his range of 84,000 to 2,654,000 deaths.(11)

 

Few countries locked down precisely on Professor Ferguson’s recommended triggers, making comparisons difficult. In fact, Canada shut down after just four deaths, far earlier than even his earliest trigger of 750 deaths.(12)

 

A cleaner comparison, then, comes from countries that never shut down at all, including, famously, Sweden, and also Japan, Korea, and Taiwan. These countries were essentially Professor Ferguson’s “unmitigated” scenario; restaurants and bars remained open, governments merely requested people social distance, a recommendation that was widely ignored even in Japan, where neighbourhood bars and diners remain packed into the night.(13)

 

While the epidemic isn’t over, the difference is already staggering. Ferguson predicted 1.4 million deaths in Japan, when the actual number as of May 12 was 657. In Korea, he predicted 381,000 deaths, compared to 258 on May 12. In Taiwan, he predicted 212,000 deaths, when the actual number of dead was seven. Even in hard-hit Sweden, he predicted 85,000 deaths, compared to the actual number on May 12 of 3,313.(14)

 

Here in Canada, so far COVID-19 is tracking slightly above a bad seasonal flu, with 5,169 COVID-19 deaths as of May 12 compared to 3,500 the Ontario Ministry of Health estimates across Canada in a typical flu season.(15) The situation is not resolved, to be sure, and if the typical bell-curve pattern of influenza is a guide, we could see deaths double or more. But we would never dream of throwing 6 million Canadians onto public assistance to head off even a very bad flu season.

 

What went wrong? Shockingly, the code that generated Professor Ferguson’s doomsday prediction was neither public nor peer reviewed. He himself admitted the computer code has thousands of lines of “undocumented” code, which makes it impossible to verify. A senior software engineer from Google found the code has amateurish errors, including giving different answers depending on the number of CPUs in the specific computer running the model. This makes the results unverifiable, and therefore meaningless.(16)

 

Professor Ferguson’s track-record is poor, to say the least (see Table 2). In 2002, he predicted up to 150,000 deaths from CJD (“Mad cow disease”)—55 times the actual death toll of 2,704. In 2005, he predicted that bird flu could kill up to 200 million people. The actual death toll was 455.(17)

 

 

Picking Up the Pieces

 

First of all, the challenge is how to get out of this economic catastrophe. This involves weighing not only the health threat, but the well-established reality that mass unemployment and poverty kill, from suicide to substance abuse to malnutrition among the vulnerable.(18)

 

This trade-off requires involving economic experts as well as epidemiologists, lest narrow groupthink dominate our response. Countries like Germany and the Netherlands have already implemented measured re-openings,(19) and now certain Canadian provinces are starting to as well. If other Canadian policymakers don’t move quickly, we run the very real risk of making the cure far worse than even the disease.

 

Second, COVID-19 has shown us how little margin of error we have in health care capacity. After years of deep concern about overburdened hospitals and waiting lists,(20) it is time to dramatically expand Canada’s health capacity so that we are not perpetually sitting on a knife’s edge.

 

Liberalization would include private-sector options that relieve the burden from the public sector even in normal times, but especially in a crisis. And it would include regulatory modernizations for both health care providers and manufacturers, including easing the long path to the development and introduction of new medicines and, indeed, new vaccines.

 

Third, we need proper scrutiny of the scientific models policy-makers rely on. Academics do not even regularly audit code in models, which would be unacceptably amateurish in, for example, car insurance. This issue is already intensely debated in the US, as skeptics accuse the Environmental Protection Agency of using “secret science” relying on hidden data or opaque modeling assumptions to enact green activists’ wish-lists.(21)

 

Anonymized data and computer code should be open to public scrutiny as the minimum requirement for any study that is used to justify public policy, from lockdowns to carbon taxes. Furthermore, these studies must be based on verified facts and use code that actually does what it says it does, and the ensuing decision-making process must be transparent and open to the public.

 

One former Indian bureaucrat put it well: “Emergency situations like this pandemic should require a far higher—and not lower—level of scrutiny” since policy choices have such tremendous impact. “This suggests a need for democracies to strengthen their critical thinking capacity by creating an independent ‘Black Hat’ institution whose purpose would be to question any technical foundations of government decisions.”(22)

 

As for the present crisis, any continuing or future lockdowns and restrictions must be based on transparent and verifiable science. We emphatically have a right to expect that any policy that threatens millions of Canadians’ livelihoods and civil liberties is based on the very highest level of scientific rigour.

References

 

  1. Andy Riga, “COVID-19 updates March 12: Quebec starts shutting down to slow spread of coronavirus,” Montreal Gazette, March 12, 2020; Shelly Hagan and Kait Bolongaro, “500,000 Jobless Claims Send Canada’s Labor Market Into Freefall,” Bloomberg, March 20, 2020; Kathleen Harris, “Nearly 6 million people have applied for COVID-19 emergency benefits,” CBC News, April 13, 2020.
  2. Neil M. Ferguson et al., “Impact of Non-Pharmaceutical Interventions (NPIs) to Reduce COVID-19 Mortality and Healthcare Demand,” Imperial College London, March 16, 2020.
  3. Patrick G.T. Walker et al., “The Global Impact of COVID-19 and Strategies for Mitigation and Suppression,” Imperial College London, March 26, 2020; MRC Centre for Global Infectious Disease Analysis, “COVID-19,” Imperial College London, 2020.
  4. World Health Organization, Non-Pharmaceutical Public Health Measures for Mitigating the Risk and Impact of Epidemic and Pandemic Influenza, October 2019; World Health Organization, “Considerations for Quarantine of Individuals in the Context of Containment for Coronavirus Disease (COVID-19),” March 19, 2020.
  5. Bill Bostock “How ‘Professor Lockdown’ Helped Save Tens of Thousands of Lives Worldwide—and Carried COVID-19 into Downing Street,” Business Insider, April 25, 2020.
  6. John Fund, “‘Professor Lockdown’ Modeler Resigns in Disgrace,” National Review, May 6, 2020.
  7. Mark Lander and Stephen Castle, “Behind the Virus Report That Jarred the U.S. and the U.K. to Action,” The New York Times, April 2, 2020.
  8. Mike Crawley, “‘The impact on the health care system could be total collapse,’ warns ICU doctor,” CBC News, March 21, 2020.
  9. Avery Haines and Alexandra Mae Jones, “‘All of our rooms are empty’: Hospital ERs vacant during pandemic,” CTV News, April 29, 2020; Tom Blackwell, “‘That is a surprise’: Doctors still waiting for feared surge of COVID-19 patients in Canadian ICUs,” National Post, April 11, 2020; Allison Jones, “Delayed cardiac surgeries due to coronavirus may have caused 35 deaths in Ontario: minister,” Global News, April 28, 2020.
  10. Tonda MacCharles, “82% of Canada’s COVID-19 deaths have been in long-term care, new data reveals,” Toronto Star, May 7, 2020.
  11. Amanda Connolly, “With strong controls, Canada could see 11,000 to 22,000 coronavirus deaths: officials,” Global News, April 9, 2020; Samuel Osborne, “Coronavirus: Experts lower projection of UK death toll, but still predict 23,000 to die from Covid-19 by August,” Independent, April 14, 2020; Eric Levenson and Madeline Holcombe, “Coronavirus model projects 134,000 deaths in US, nearly double its last estimate,” CNN, May 4, 2020.
  12. Shelly Hagan and Kait Bolongaro, “500,000 Jobless Claims Send Canada’s Labor Market Into Freefall,” Bloomberg, March 20, 2020; Matt Burgess, “When will lockdown end? The UK’s lockdown rules, explained,” Wired, May 26, 2020; Sarah Mervosh et al., “See How All 50 States Are Reopening,” The New York Times, May 26, 2020; Worldometers.info, Coronavirus Update, May 27 2020; Neil M. Ferguson et al., op. cit., endnote 2.
  13. Motoko Rich, “Tokyo, in a State of Emergency, Yet Still Having Drinks at a Bar,” The New York Times, April 19, 2020.
  14. Patrick G.T. Walker, et al., op. cit., endnote 3; Worldometers.info, Coronavirus Update, May 12, 2020.
  15. Worldometers.info, Coronavirus Canada, May 12, 2020; Ministry of Health of Ontario, “The Flu,” Ontario Government, November 20, 2019.
  16. Terence Corcoran, “We are at the mercy of two data problems with COVID-19 response,” Financial Post, April 3, 2020; Sue Denim, “Code Review of Ferguson’s Model,” Lockdown Sceptics, May 10, 2020.
  17. Lee Elliot Major, “BSE-infected sheep a ‘greater risk’ to humans,” The Guardian, January 9, 2002; National CJD Research & Surveillance Unit, “Disease in the UK (By Calendar Year),” University of Edinburgh, May 4, 2020; Phillip W. Magness, “How Wrong Were the Models and Why?” American Institute for Economic Research, April 23, 2020; James Sturcke, “Bird flu pandemic ‘could kill 150m,’” The Guardian, September 30, 2005; World Health Organization, “Cumulative Number of Confirmed Human Cases for Avian Influenza A(H5N1) reported to WHO, 2003-2020,” January 20, 2020.
  18. Kevin Milligan, “Are Opioid Deaths Affected by Macroeconomic Conditions,” National Bureau of Economic Research, Bulletin on Aging and Health, No. 3, 2017.
  19. Sabine Siebold and Andreas Rinke, “Germany to reopen all shops, allow soccer matches: sources,” Reuters, May 4, 2020.
  20. Peter St. Onge and Patrick Déry, “Canada’s Health Care Woes: Waiting Lists, Outdated Equipment, Staff Shortages,” Montreal Economic Institute, Economic Note, December 18, 2019.
  21. Sue Denim, op. cit., endnote 16; Kelsey Brugger, “Trump administration expands reach of EPA secret science proposal,” Science, March 4, 2020.
  22. Sanjeev Sabhlock, “A critique of Neil Ferguson’s (the Imperial College) pandemic model,” Times of India, April 29, 2020.