antibody

What’s In A COVID-19 Antibody Test?

As of April 24, there are 4 COVID-19 antibody tests approved for diagnostic purposes in the US, and 44 approved for diagnostic or research purposes around the world.[1]

Some of these are ELISA tests, which detect the presence of antibodies to viral proteins, such as the N (nucleocapsid) protein or S (spike) protein. The subject’s blood serum is incubated with the protein, and then washed with antibody-dye conjugates that fluoresce in proportion to the concentration of bound antibody/viral protein complexes.

Some tests, such as one approved in Singapore, is a viral neutralization assay that tests the patient’s serum for its ability to neutralize viral replication in vitro.

Finally, some are rapid tests, which screen for the presence or absence of antibodies to the viral protein, but cannot measure the concentration. These can be very quick (<15 min) to perform, but tell us nothing about the concentration of the antibody.

Viral neutralization tests, compared to ELISA can tell us more about how likely the antibodies are to protect against infection, but they also take longer than ELISA tests (3-5 days vs 1-5 hours.)

How Accurate Are COVID-19 Antibody Tests at Predicting Serum Viral RNA?

Manufacturer Test Type Sensitivity Specificity Sample Size (# of individuals)
USTC (Hefei, China) IgG/IgA rapid test for S protein receptor binding domain 99.2% 100% 570
Jiangsu Medomics IgM/IgG lateral flow immunoassay for S protein receptor binding domain 88.66% 90.63% 525
VITROS ELISA against spike protein 83% 100% 436
Cellex IgM/IgG lateral flow immunoassay against N protein 93.8% 96.0% 378
Euroimmun IgG/IgA rapid test for S1 protein 94% 98% 310
Zhejiang Orient IgG rapid test 93.1% 99.2% 153
Wantai ELISA for S protein receptor binding domain 93% 100% 112
Mount Sinai ELISA for S protein 100% 100% 111
NIH LIPS test for N protein 67% all, 100% 14 days after symptoms 100% 81
Dynamiker Rapid IgG/IgM 90% 100% 62
CTK Biotech Rapid IgG/IgM 90% 100% 62
Unnamed Rapid IgG/IgM 36.4% 88.9% 39
Beijing Diagreat Biotechnologies Rapid IgG/IgM 83% 93% 30

A Chinese-designed IgM/IgG combined assay for COVID-19 (Jiangsu Medomics) testing for antibodies against the receptor binding domain of the spike protein, tested on confirmed COVID-19 cases selected from hospitals in 6 different provinces and healthy volunteers, had a sensitivity of 88.66% and a specificity of 90.63%.[2]

A German-designed IgG/IgA assay against the spike protein S1 of SARS-CoV-2 (Euroimmun) had a 100% specificity (did not react against healthy volunteers, patients with non-coronavirus viruses, or patients with endemic coronaviruses that cause the common cold. All 3 SARS-CoV-2 patients got positive tests, for a specificity of 100%. 2/2 SARS-CoV patients also got positive results from this antibody test. More severe patients had higher antibody titers.[3]

A Swedish preprint study evaluating a Chinese-made rapid antibody test (Zhejiang Orient Gene Biotech) on 29 PCR-confirmed COVID-19 patients or convalescents and 100 healthy controls had a sensitivity of 93.1% and specificity of 99.2% for the IgG test. The IgM test had only a 69% sensitivity but a 100% specificity. [4]

A Chinese preprint study of RBD antibody kits for combined IgA/IgG antibodies on 330 healthy subjects, 153 patients with non-COVID-19 diseases, and 87 SARS-CoV-2 cases, had a sensitivity of 99.1% and specificity of 100%. IgA levels but not IgM levels were higher in more severe patients (p < 0.0001).[5]

An ELISA test against the SARS-CoV-2 spike protein, developed at Mount Sinai Hospital in the US and approved for diagnostic use, was tested on 17 confirmed COVID-19 cases (3 convalescent, 14 acute) and 94 negative controls collected before the COVID-19 pandemic began. All 17 COVID-19 patients had antibodies that reacted strongly in the test, while none of the controls did. Additionally, the concentration of antibody correlates positively to viral neutralization ability (p <0.0001, r = 0.9279).[6]

An independent Danish preprint study of 9 antibody tests on 30 confirmed COVID-19 cases admitted to the ICU and 82 non-COVID-19 patients (healthy blood donors or people with other acute viral infections) found that the Wantai test for the spike protein receptor binding domain had a sensitivity of 93% and specificity of 100%, while the Euroimmun IgA test had a specificity of 93% and sensitivity of 93%. Point-of-care rapid tests were less sensitive – the Dynamiker and CTK Biotech tests (both IgG/IgM tests) had sensitivities of 90% and specificities of 100%. The best two ELISA tests agreed 93% with each other.[7]

Briefer illnesses (7-13 days vs 14-20 and >21 days) had somewhat lower rates of positive test results, which is consistent with other studies finding that more severe disease correlated with higher antibody levels. [7]

A German study of an unnamed rapid IgG/IgM test on 39 randomly selected patients who were also tested for COVID-19 with RT-PCR (the benchmark), the sensitivity was only 36.4% while the specificity was 88.9%. (Note that this could include patients who were in the early stages of the disease, when viral RNA is detectable but antibodies are not.)[8]

An Italian study of the Beijing Diagreat Biotechnologies rapid IgG/IgM test on 30 patients admitted to the hospital with either confirmed COVID-19, suspected COVID-19 that turned out to be something else, or asymptomatic controls, the sensitivity was 83% and the specificity was 93%.[9]

A novel type of immunoassay, LIPS (Luciferase Immunoprecipitation System) was tested on 49 patients with confirmed COVID-19 and 32 blood bank donor controls. None of the controls had a positive result for nucleocapsid antibodies, while 67% of the COVID-19 patients did. Similarly, none of the controls had a positive result for spike protein antibodies, while 57% of the COVID-19 patients did. When restricted to samples taken >14 days after symptom onset, the sensitivity and specificity were 100%.[10]

Premarket testing for the Cellex rapid IgG/IgM test evaluated 128 confirmed COVID-19 cases and 250 negative subjects, and found a sensitivity of 93.8% and a specificity of 96.0%.[11]

The VITROS modified ELISA test against spike protein was positive in 30/36 patients with confirmed cases of COVID-19 (sensitivity of 83%) and negative in 100% of 400 non-COVID-19 samples.[12]

Bottom Lines:

All in all, the antibody tests are generally quite specific (at least in patients who have had the disease for at least two weeks) and fairly sensitive.

Antibody levels tend to rise over the course of the disease and tend to be higher in more severe cases.

How Should We Interpret The Antibody Seroprevalence Data in the US?

Several recent papers have come out with estimates of the prevalence of SARS-CoV-2 in US cities.

PCR Tests of Random Samples in the US

Out of 131 patients presenting with mild influenza-like symptoms in a Los Angeles clinic, 7 tested positive for SARS-CoV-2, or 5%.[13]

Between March 22 and April 4, all pregnant women delivering at New York Presbyterian and Columbia University hospitals in New York were tested for COVID-19. 15.4% of all pregnant women tested positive for SARS-CoV-2. Only 12% of the patients who tested positive had COVID-19 symptoms, consistent with a picture in which most infections are asymptomatic.[14]

A screening program of 24 homeless shelters in Seattle, Boston, San Francisco, and Atlanta found 25% of residents and 11% of staff members tested positive for SARS-CoV-2. This is probably much higher than the general population in those cities since homeless people are sicker than others and living in institutional environments like shelters spreads disease.[20]

PCR Tests of Random Samples In Other Countries

Iceland did an extensive testing program for SARS-CoV-2, issuing an open invitation to 10,797 people and random invitations to 2283 people. In total, 6% of the Icelandic population was screened. 0.6% of the open invitation group and 0.8% of the random invitation group tested positive for the virus. 57% of those who tested positive also reported symptoms of COVID-19.[16]

A study testing 1097 health care workers with mild respiratory symptoms in 9 hospitals in the Netherlands found that 4% tested positive for SARS-CoV-2.[17]

A screening study for SARS-CoV-2 in 1654 UK medical staff with symptoms of cough or fever found 14% tested positive.[22]

South Korea has one of the largest COVID-19 testing programs in the world, testing 601,660 people between January 3 and April 27, or about 1% of its population. 1.8% of those tested were positive, and 2.3% of the confirmed cases were fatal.

Antibody Tests in the US

A study that recruited participants in Santa Clara County, California through Facebook ads tested 3330 participants with a rapid IgG/IgM test (Premier Biotech.) This test had previously been found to have an 80% sensitivity rate and 99.5% specificity rate, from combining the manufacturer’s data and an independent experiment, 523 patients in all.[15]

The crude prevalence rate of antibodies in Santa Clara County was 1.5%; after weighting the sample to match Santa Clara County by zipcode, race, and sex, the rate was 2.81%. Adjusting for the sensitivity and specificity of the test, the estimated prevalence is 2.75%.

The authors conclude that, because the prevalence of antibodies is much higher than the number of confirmed cases (there were 985 confirmed cases in Santa Clara County, while this study’s data suggests 48,000-81,000 cases should exist), that COVID-19 is almost always asymptomatic and should have a much lower case fatality rate than previously assumed.

I don’t think this conclusion is reasonable. Confirmed case numbers were low for a long time in the US, even when the pandemic was spreading rapidly, because there was a shortage of tests before the FDA approved several new tests. Even a serious case of suspected COVID-19 can’t get a diagnostic confirmation if no tests are available. It makes more sense to suppose that the confirmed case numbers (and, thus, the confirmed fatality numbers) are underestimates than to take those numbers literally and infer that the disease kills only 0.1-0.2% of those infected.

Miami-Dade County in Florida has embarked on a random antibody screening program, and preliminary results from 1800 individuals indicate a rate of 6%, which is 16.5x higher than the number of confirmed cases captured by hospitals and testing sites alone.[24] About half of the individuals who tested positive had no symptoms.[25]

A random antibody test of New York State residents sampled from shoppers at grocery and big-box stores found 21% in New York City, 17% in Long Island, 12% in Westchester, and <4% in the rest of the state, had antibodies to the virus.[26] These numbers may be overestimates because people who are shopping are less likely to be practicing social distancing and thus are more at risk for infection.

Preliminary results from a random antibody screening program in Los Angeles County found that 4.1% of residents tested positive for SARS-CoV-19 antibodies.[29]

Antibody Tests in Other Countries

1000 blood samples from blood donors in Scotland were screened for SARS-CoV-2 neutralizing antibodies; 0.5% tested positive. Note that blood donors are healthier on average than the general population, since donors with a history of recent respiratory infection are turned away; so this serves as more of a lower bound on the prevalence of SARS-CoV-2 antibodies in the Scottish population.[19]

Other Measurements of Prevalence

SARS-CoV-2 levels in the wastewater of a major water treatment facility in Massachussetts suggest that roughly 5% of the stool samples in the state were positive for the virus between March 18-25, a number much higher than the 0.026% prevalence rate for confirmed SARS-CoV-2 cases in Massachusetts. This points towards COVID-19 being underdiagnosed, as we’d expect given the shortage of tests.[18]

A New York Times report on April 27th observed that New York City had triple the number of all-cause deaths compared to historical baselines, and other countries also had higher rates of all-cause mortality than their historical baselines. (Spain, 67% above normal; Equador, 83% above normal; Jakarta, Indonesia, 57% above normal.) These numbers can’t be confounded by any possible over-diagnosis of COVID-19, and constitute clear evidence that the epidemic is killing people. Moreover, there are more all-cause deaths than can be accounted for by confirmed COVID-19 deaths alone; so either the disease is underdiagnosed or people are dying from other effects of the pandemic (such as a shortage of hospital care.)[21]

In March 2020, the number of LA County cases of influenza-like symptoms was double that in March of the past 4 years, despite it being past the peak of flu season.[13] This likewise points to COVID-19 causing a large number of symptomatic cases.

Conclusions

Most screens of random population samples – that is, _not _specifically selected for having symptoms or for having contacts with COVID-19 – seem to show 0.5-5% prevalence for the disease, in different cities and countries, whether measured by antibodies, viral RNA, or even wastewater RNA concentrations.

Prevalence numbers are higher among high-risk populations (healthcare workers and homeless people) and _much _higher in New York City, the center of the US epidemic and a very dense population.

In the US specifically, where testing has been scarce, this means that the number of confirmed cases has been underestimated by at least an order of magnitude.

The antibody screening experiments have been criticized on the grounds that antibody tests are not perfectly accurate. I don’t think this is a valid argument against the main point (that there are probably >10x as many true cases as confirmed cases in the US.)

Antibody tests vary in their _sensitivity _(how likely they are to give a positive result in a real infection) and tend to not show up as positive until 2 weeks after the onset of symptoms. But, if anything, this should mean the true positive rate is even _larger _than the numbers in the studies. Antibody tests tend to have fairly high _specificity _– the maximum % of false positives I’ve seen reported is 10% – and so even if 10% of the reported positives are false ones, that would still mean that the seroprevalence of COVID-19 is many times higher than the rate of confirmed cases.

Some commentators have concluded that this means that the danger of COVID-19 has been overstated; that the risk of dying given a SARS-CoV-19 infection is much lower than previously supposed. I think this is misleading.

The official case fatality rate (# of confirmed COVID-19 deaths/ # of confirmed COVID-19 cases) may be an overestimate, because when testing is scarce, more severe cases are more likely to be tested. Right now the cumulative global case fatality rate is a whopping 7% and the US case fatality rate is 2.8%.[27][28]

However, estimating an infection fatality rate defined by # of confirmed deaths / expected # of antibody-positive individuals is likely to be an underestimate, since if testing capacity is scarce, we can expect even some fatal COVID-19 cases to go unconfirmed.

These “optimistic” estimates of infection fatality rate are about 0.3% for Santa Clara County, 0.2% for L.A. County, 0.1% for Miami-Dade County, and 0.7% for New York City.

If we compare these estimates to two countries that had extensive COVID-19 testing, Iceland and South Korea, the cumulative case fatality rate for Iceland is 0.5% (in line with the optimistic US estimates) and the rate for South Korea is 2.3% (quite a bit higher than the optimistic US estimates.) So it’s not clear what conclusion to draw from international comparisons.

One consideration is that the South Korean testing program is not a random sample of the population, though it was extensive – people with symptoms or connections to COVID-19 patients are prioritized for testing. So its 2.3% mortality rate may be an overestimate as well.

If we consider the 3x elevated all-cause mortality rate in NYC, and assume that _all _excess deaths are COVID-19 deaths, and that 21% of New Yorkers are infected, this gives a “pessimistic” estimate of 1.2% of COVID-19 infections being fatal in NYC.

My current best guess is that the true estimate of infection fatality rate in the US is somewhere between the “optimistic” and “pessimistic” probabilities, i.e. between 0.1% and 1.2%.

This is still not, by any means, good. If the US ended all quarantines today, without a vaccine or effective treatment, and allowed the virus to spread until herd immunity was achieved, or about 60% of the US population, this would mean about 200,000-2,000,000 deaths this year. On the high end, that’s as deadly per capita as the US Civil War,[30] and deadlier than the Spanish Flu.[31] “Less deadly than previously estimated” does not mean “no big deal.”

Do Viral Antibodies Generally Correspond to Past Viral Infection?

Outside of COVID-19, what’s the track record of accuracy of viral antibody tests? Are there a sizable population who have positive antibodies to viruses they were never infected with? Do many people get infected with viruses that they never develop antibodies to?

This can put the credibility of antibody tests for COVID-19 in a broader context. If antibody false positives are really common overall, then the apparently good specificity of the COVID-19 tests (derived from small studies, often by the manufacturers) may be too optimistic, and the actual prevalence of COVID-19 may be quite a bit lower than it appears in the antibody screening studies.

Test Type Virus Sensitivity Specificity # Of Individuals
Rapid HIV >95% >99% 6282
NS1 ELISA, IgM/IgG Zika 100% 100% 1379
Rapid HCV 97.8% \ 88.3% \ 99.3% 99.5% 1083
Rapid test and ELISA H5N1 18.2% \ 38.7% 100% \ 100%
IgM ELISA Dengue 96% 84% 225
rapid Chikungunya 20.5% \ 50.8% 100% \ 89.2% 206
NS1 ELISA Dengue 83.2% 100% 138
NS1 Rapid Dengue 73.8% 100% 138

An ELISA test and rapid antibody test for dengue virus, tested in 138 Vietnamese patients admitted to the ICU with clinical suspicion of dengue, had sensitivities of 83.2% and 73.8% respectively, and specificities of 100%.[32]

In a study of antibody tests for dengue virus on 225 patients from around the world, some with dengue, some with other viruses, and some healthy controls, the ELISA tests for NS1 antigen had sensitivities of 60-75% in acute cases and 19-31% in convalescent cases, and the rapid tests had sensitivities of 40-60% in acute cases and 12-59% in convalescent cases. The anti-dengue IgM ELISA test had a sensitivity of 98% in both acute and convalescent cases, while the anti-dengue IgM rapid tests had a sensitivity of 45-95 in both acute and convalescent cases. The specificity of NS1 tests was 71-80%, and the IgM ELISA test had a specificity of 84%.[33]

3 rapid tests for HCV (hepatitis C) on 1083 samples: all specificities over 99.5%, sensitivities were 97.8%, 88.3%, 99.3%[34]

6 rapid tests for HIV on 6282 study participants, compared to a gold standard of Western blot, ELISA, & treatment status. All sensitivities were >95% and specificities were >99%.[35]

In a study of an IgG/IgM ELISA test for Zika virus, on 112 patients with RT-PCR confirmed or suspected Zika, 1015 healthy patients, and 252 patients with other viruses, the sensitivity of combined IgG and IgM tests was 100% and specificity was 100%.[36]

Two rapid tests for chikungunya virus, tested on 132 patients with confirmed chikungunya and 74 patients with a different febrile illness; one had a 20.5% sensitivity and 100% specificity, while the other had a 50.8% sensitivity and 89.2% specificity.[37]

In a study of 524 patients tested for H5N1 (avian flu) a rapid test had a sensitivity of 18.2% and an ELISA test had a sensitivity of 38.7%. Both had specificities of 100%.[38]

Conclusions

While the performance of antibody tests for different viruses depends on the test itself, most have high specificities. There is no reason to suppose that the measured specificity levels for SARS-CoV-2 tests are unrealistically low.

Do Viral Antibodies Generally Predict Immunity to Future Infection?

The WHO has been saying there’s “no evidence” that antibodies in recovered patients indicate immunity to COVID-19.[39] It’s too soon to tell whether this is true for COVID-19, but do antibody levels predict viral immunity in other viruses?

In a longitudinal cohort of 7547 Nicaraguan children monitored for dengue virus, preinfection antibody titer correlated with lower risk of having a symptomatic second infection (p < 0.005). Children with serologically confirmed but asymptomatic second infections had preinfection antibody titers 2.3-fold higher than children with symptomatic second infections. Also, children with symptomatic first infections were less likely to have symptomatic second infections independent of antibody titer – apparently infection grants immunity through mechanisms other than antibody quantity.[40]

In 17 infants born to mothers with HSV1 or HSV2 infections during pregnancy, the babies with milder (or asymptomatic) infections had higher neutralizing antibody titers at birth than the babies with severe cases. Average titer was 1:13 for severe cases, 1:65 for mild cases, and 1:69 for asymptomatic cases.[41]

Nine studies of human volunteers previously infected with influenza in the 60’s and 70’s and challenged with exposure to an influenza virus found that _no _volunteers developed symptomatic illness after challenge, out of a total of 86 patients. “The titer of serum anti-HA antibodies remains the most consistent correlate of immunity to influenza virus infection.”[42]

In a cohort of 200 Mexican infants monitored for rotavirus, children with higher (> 1:800) rotavirus IgA titers were less likely to have rotavirus infection (RR = 0.21, p < 0.001) and rotavirus diarrhea (RR = 0.16, p < 0.01) and never got severe diarrhea.[43]

In 1164 healthy children immunized with varicella vaccine, children with lower antibody titers after the vaccine (<5 gpELISA units) were 3.5x as likely to develop a varicella infection in the next 7 years as children with higher antibody titers (>5 gpELISA units.)[44]

In a study of 38 adults challenged with rotavirus, patients who got ill from the exposure had higher preinoculation rotavirus IgG antibody (7.3 vs 6.1, p = 0.041). There was no significant difference in infection rate between those exposed to a larger vs. smaller quantity.[45]

In a study of 696 adults and children in rural Bangladesh, serum IgG rotavirus antibodies were on average 4x higher in cases of symptomatic rotavirus than healthy controls.[46]

In 33 volunteers experimentally infected with human coronavirus 223E, those who had higher antibody titers prior to exposure were much less likely to get symptomatic disease (average ELISA ratio for neutralizing antibodies was 6.5x higher in the affected group vs the unaffected group, p <0.001) Those who had had a cold in the last six months had significantly (p<0.05) lower clinical scores than those who had not.[47]

We have very consistent results across all viruses studied indicating that yes, higher pre-challenge virus-specific antibody titers are predictive of lower rates of symptomatic disease.

We don’t know yet whether reinfection of people previously infected with COVID-19 is _ever _possible, but we _do _have evidence from other viruses suggesting that if you’ve recovered successfully from a COVID-19 illness you are _less _susceptible to getting a symptomatic disease if you’re exposed again.

References

[1]https://www.centerforhealthsecurity.org/resources/COVID-19/serology/Serology-based-tests-for-COVID-19.html

[2]Li, Zhengtu, et al. “Development and clinical application of a rapid IgM‐IgG combined antibody test for SARS‐CoV‐2 infection diagnosis.” Journal of medical virology (2020).

[3]Okba, Nisreen MA, et al. “SARS-CoV-2 specific antibody responses in COVID-19 patients.” medRxiv (2020).

[4]Ma, Huan, et al. “COVID-19 diagnosis and study of serum SARS-CoV-2 specific IgA, IgM and IgG by a quantitative and sensitive immunoassay.” medRxiv (2020).

[5]Zhang, Pingping, et al. “Evaluation of recombinant nucleocapsid and spike proteins for serological diagnosis of novel coronavirus disease 2019 (COVID-19).” MedRxiv (2020).

[6]Amanat, Fatima, et al. “A serological assay to detect SARS-CoV-2 seroconversion in humans.” MedRxiv (2020).

[7]Lassaunière, Ria, et al. “Evaluation of nine commercial SARS-CoV-2 immunoassays.” medRxiv (2020).

[8]Döhla, M., et al. “Rapid point-of-care testing for SARS-CoV-2 in a community screening setting shows low sensitivity.” Public Health (2020).

[9]Spicuzza, Lucia, et al. “Reliability and usefulness of a rapid IgM‐IgG antibody test for the diagnosis of SARS-CoV-2 infection: a preliminary report.” Journal of Infection (2020).

[10]Burbelo, Peter D., et al. “Detection of Nucleocapsid Antibody to SARS-CoV-2 is More Sensitive than Antibody to Spike Protein in COVID-19 Patients.” medRxiv (2020).

[11]https://www.fda.gov/media/136625/download

[12] https://www.fda.gov/media/136967/download

[13]Spellberg, Brad, et al. “Community prevalence of SARS-CoV-2 among patients with influenzalike illnesses presenting to a Los Angeles medical center in March 2020.” JAMA (2020).

[14]Sutton, Desmond, et al. “Universal screening for SARS-CoV-2 in women admitted for delivery.” New England Journal of Medicine (2020).

[15]Bendavid, Eran, et al. “COVID-19 Antibody Seroprevalence in Santa Clara County, California.” medRxiv (2020).

[16]Gudbjartsson, Daniel F., et al. “Spread of SARS-CoV-2 in the Icelandic population.” New England Journal of Medicine (2020).

[17]Reusken, Chantal B., et al. “Rapid assessment of regional SARS-CoV-2 community transmission through a convenience sample of healthcare workers, the Netherlands, March 2020.” Eurosurveillance 25.12 (2020): 2000334.

[18]Wu, Fuqing, et al. “SARS-CoV-2 titers in wastewater are higher than expected from clinically confirmed cases.” medRxiv (2020).

[19]Thompson, Craig, et al. “Neutralising antibodies to SARS coronavirus 2 in Scottish blood donors-a pilot study of the value of serology to determine population exposure.” medRxiv (2020).

[20]Mosites, Emily. “Assessment of SARS-CoV-2 Infection Prevalence in Homeless Shelters—Four US Cities, March 27–April 15, 2020.” MMWR. Morbidity and Mortality Weekly Report 69 (2020).

[21]https://www.nytimes.com/interactive/2020/04/21/world/coronavirus-missing-deaths.html

[22]Hunter, Ewan, et al. “First experience of COVID-19 screening of health-care workers in England.” The Lancet (2020).

[23]https://www.statista.com/statistics/1095848/south-korea-confirmed-and-suspected-coronavirus-cases/

[24]https://www.miamidade.gov/releases/2020-04-24-sample-testing-results.asp

[25]https://www.miamiherald.com/news/coronavirus/article242260406.html

[26]https://www.nytimes.com/2020/04/23/nyregion/coronavirus-antibodies-test-ny.html

[27]https://www.cdc.gov/nchs/nvss/vsrr/covid19/index.htm

[28]https://coronavirus.jhu.edu/map.html

[29]http://publichealth.lacounty.gov/phcommon/public/media/mediapubhpdetail.cfm?prid=2328

[30]https://prospect.org/power/american-war-dead-numbers/

[31]https://web.archive.org/web/20160923152823/http://www.flu.gov/pandemic/history/1918/

[32]Hang, Vu Ty, et al. “Diagnostic accuracy of NS1 ELISA and lateral flow rapid tests for dengue sensitivity, specificity and relationship to viraemia and antibody responses.” PLoS neglected tropical diseases 3.1 (2009).

[33]Hunsperger, Elizabeth A., et al. “Evaluation of commercially available diagnostic tests for the detection of dengue virus NS1 antigen and anti-dengue virus IgM antibody.” PLoS neglected tropical diseases 8.10 (2014).

[34]Smith, Bryce D., et al. “Evaluation of three rapid screening assays for detection of antibodies to hepatitis C virus.” Journal of Infectious Diseases 204.6 (2011): 825-831.

[35]Delaney, Kevin P., et al. “Evaluation of the performance characteristics of 6 rapid HIV antibody tests.” Clinical Infectious Diseases 52.2 (2011): 257-263.

[36]Steinhagen, Katja, et al. “Serodiagnosis of Zika virus (ZIKV) infections by a novel NS1-based ELISA devoid of cross-reactivity with dengue virus antibodies: a multicohort study of assay performance, 2015 to 2016.” Eurosurveillance 21.50 (2016).

[37]Kosasih, Herman, et al. “Evaluation of two IgM rapid immunochromatographic tests during circulation of Asian lineage Chikungunya virus.” Southeast Asian Journal of Tropical Medicineand Public Health 43.1 (2012): 55.

[38]Ganzenmueller, Tina, et al. “Comparison of the performance of direct fluorescent antibody staining, a point-of-care rapid antigen test and virus isolation with that of RT-PCR for the detection of novel 2009 influenza A (H1N1) virus in respiratory specimens.” Journal of medical microbiology 59.6 (2010): 713-717.

[39]https://www.cnbc.com/2020/04/17/who-issues-warning-on-coronavirus-testing-theres-no-evidence-antibody-tests-show-immunity.html

[40]Katzelnick, Leah C., et al. “Neutralizing antibody titers against dengue virus correlate with protection from symptomatic infection in a longitudinal cohort.” Proceedings of the National Academy of Sciences 113.3 (2016): 728-733.

[41]Yeager, Anne S., et al. “Relationship of antibody to outcome in neonatal herpes simplex virus infections.” Infection and immunity 29.2 (1980): 532-538.

[42]Couch, Robert B., and Julius A. Kasel. “Immunity to influenza in man.” Annual review of microbiology 37.1 (1983): 529-549.

[43]Velázquez, F. Raúl, et al. “Serum antibody as a marker of protection against natural rotavirus infection and disease.” The Journal of infectious diseases 182.6 (2000): 1602-1609.

[44]Li, Shu, et al. “Inverse relationship between six week postvaccination varicella antibody response to vaccine and likelihood of long term breakthrough infection.” The Pediatric infectious disease journal 21.4 (2002): 337-342.

[45]Ward, Richard L., et al. “Effects of antibody to rotavirus on protection of adults challenged with a human rotavirus.” Journal of Infectious Diseases 159.1 (1989): 79-88.

[46]Ward, Richard L., et al. “Effects of antibody to rotavirus on protection of adults challenged with a human rotavirus.” Journal of Infectious Diseases 159.1 (1989): 79-88.

[47]Callow, Kathleen A. “Effect of specific humoral immunity and some non-specific factors on resistance of volunteers to respiratory coronavirus infection.” Epidemiology & Infection 95.1 (1985): 173-189.