Abstract Body

Live virus micro-neutralization (MN) is the gold standard for quantifying the neutralizing titer (NT) of antibodies to SARS-CoV-2. However, performing MN is labor intensive and requires a biosafety level 3 laboratory. We assessed the performance of 8 immunoassays which measure SARS-CoV-2 NT and compared them to gold standard MN results.

Samples from 269 individuals known to previously be SARS-CoV-2 PCR+ (i.e., convalescent individuals, <10% hospitalized) and 200 pre-pandemic individuals were evaluated on 3 lateral flow immunoassays (LFAs; Wondfo Colloidal Gold, Wondfo Colored Microsphere, Wondfo Finecare) and 5 enzyme-linked immunoassays (ELISAs; ImmunoRank, GenScript, Cusabio, Euroimmun NeutraLISA, Euroimmun QuantiVac). MN was performed on all samples from convalescent individuals; results were classified as undetectable vs any detection of MN NT (NT<20 vs. NT>20), as well as high and low MN NT (NT>80 vs. NT<80). Receiver operating curve analysis was used to assess accuracy for detecting levels of NT. The area under the curve (AUC) was calculated for the manufacturer's cut off and empirically to identify the best discriminatory cut off value. Cohen's kappa statistics were calculated to assess categorical agreement and Spearman's rank statistics were calculated to assess correlations.

Of the 269 convalescent plasma samples, 89 (33%) had MN NT values <20 (undetectable) and 117 (43%) >80 (high NT). Using the manufacturer’s cutoffs, sensitivity for detection of samples with any NT ranged from 79% to 100%, and the false-positive rate (ie, classifying samples with undetectable NT as positive) was highest for LFAs (72% to 84%) and ranged from 14% to 69% for the ELISAs. For all assays except the ImmunoRank and NeutraLISA ELISAs, discrimination to identify samples with any NT was improved by raising the cut off values (Table). AUCs of ~0.94 to discriminate high NT samples could be achieved for all quantifiable assays using an adjusted cut off value. Cohen’s kappa statistic ranged from 0.20 to 0.69. Spearman’s rank correlation between each assay and NT value ranged from 0.73 to 0.86. Using the manufacturer’s cutoffs, specificity on pre-pandemic samples was ?98% for all assays except for Cusabio which was 86%.

The performance of immunoassays using manufacturer’s cutoff to discriminate samples with any NT was accurate (AUC>0.83 for all assays), but could be improved by changing the cutoff. Identifying samples with high NT could be achieved using an alternative cutoff.