Skip to main content

Table 1 Correlation of the four strategies employed for gating raw flow cytometry data

From: A flow cytometry-based workflow for detection and quantification of anti-plasmodial antibodies in vaccinated and naturally exposed individuals

 

Manual gating

Gabonese adults (n = 37)a

MFI day 0

MFI day 84

PPFC day 0

PPFC day 84

k-means

r = 0.95

r = 0.89

ρ = 0.04§

ρ = 0.14§

 

r2 = 0.91

r2 = 0.79

  

EM*

r = 0.92

r = 0.89

ρ = 0.89

ρ = 0.94

 

r2 = 0.85

r2 = 0.80

  

Overlap subtraction

r = 0.99

r = 0.98

ρ = 0.99

ρ = 0.99

 

r2 = 0.99

r2 = 0.96

  

Gabonese children (n = 28) b

MFI day 0

MFI day 84

PPFC day 0

PPFC day 84

k-means

r = 0.71

r = 0.76

ρ = −0.93

ρ = −0.88

 

r2 = 0.51

r2 = 0.59

  

EM*

r = 0.61

r = 0.64

ρ = 0.78

ρ = 0.81

 

r2 = 0.38

r2 = 0.41

  

Overlap subtraction

r = 0.79

r = 0.83

ρ = 0.94

ρ = 0.96

 

r2 = 0.62

r2 = 0.69

  
  1. *Expectation Maximization. r = Pearson’s correlation coefficient. r2 = Coefficient of determination. ρ = Spearman correlation coefficient. Ab (IgG) responses are expressed as mean fluorescence intensity (MFI) and percentage of positive fluorescent cell (PPFC). Correlations for MFI were calculated using log10 transformed data. aData excluded for 3 participants due to problems with data acquisition and inability of some algorithms to set an appropriate gate. bTwo participants have been excluded from analysis for the same reasons as above. All p-values are significant (p < 0.001) except for those marked with §.