Objective To assess the overall pooled correlation coefficient estimate between cerebrospinal fluid (CSF) and blood neurofilament light (NfL) protein.
Methods We searched Medline, Embase and Web of Science for published articles, from their inception to 9 July 2019, according to Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines. Studies reporting the correlation between CSF and blood NfL in humans were included. We conducted a random-effects meta-analysis to calculate the overall pooled correlation coefficient estimate, accounting for correlation technique and assay used. Heterogeneity was assessed using the I2 statistic test. In sensitivity analyses, we calculated the pooled correlation coefficient estimate according to blood NfL assay: single-molecule array digital immunoassay (Simoa), electrochemiluminescence (ECL) assay or ELISA.
Results Data were extracted from 36 articles, including 3961 paired CSF and blood NfL samples. Overall, 26/36 studies measured blood NfL using Simoa, 8/36 ECL, 1/36 ELISA and 1 study reported all three assay results. The overall meta-analysis demonstrated that the pooled correlation coefficient estimate for CSF and blood NfL was r=0.72. Heterogeneity was significant: I2=83%, p<0.01. In sensitivity analyses, the pooled correlation coefficient was similar for studies measuring blood NfL using Simoa and ECL (r=0.69 and r=0.68, respectively) but weaker for ELISA (r=0.35).
Conclusion Moderate correlations are demonstrated between CSF and blood NfL, especially when blood NfL was measured using Simoa and ECL. Given its high analytical sensitivity, Simoa is the preferred assay for measuring NfL, especially at low or physiological concentrations, and this meta-analysis supports its use as the current most advanced surrogate measure of CSF NfL.
PROSPERO registration number CRD42019140469
- clinical neurology
- CSF dynamics
- systematic reviews
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Cerebrospinal fluid (CSF) neurofilament light (NfL) chain protein is well recognised as a sensitive and dynamic biomarker of active central nervous system (CNS) neuro-axonal injury.1–3 The neurofilament complex is predominantly located in the neuronal cytoplasm and they provide structural stability to neurons and enable radial growth of axons.2 3 Concentrations of CSF NfL rise proportionally to the degree of neuroaxonal injury in a variety of neurological conditions including neurodegenerative, inflammatory, vascular and traumatic diseases.2–7
However, the invasive nature of CSF collection via lumbar punctures limits the widespread use of CSF NfL. The ELISA routinely used to measure that CSF NfL is not recommended for blood NfL measurement (usually 50–100 times lower than CSF NfL concentrations), due to its limited sensitivity. Electrochemiluminescence (ECL)-based NfL assays have improved analytical sensitivity,8 9 but the novel ultrasensitive single-molecule array (Simoa) digital immunoassay is 126-fold and 25-fold more sensitive than ELISA and ECL assays, respectively, for quantification of NfL.10 The manifold higher analytical sensitivity with the Simoa assay for NfL measurement enables reliable blood NfL measurement in disease and physiological conditions,11 12 while avoiding the need for CSF collection and allowing more frequent measurement given that blood is easier to obtain.
Individual studies have reported the correlation coefficients between CSF NfL and blood NfL in several, discrete neurological conditions, but the pooled overall correlation coefficient estimate has not been established. If blood NfL is to be used as a reliable surrogate marker of CSF NfL, then the overall estimated correlation between CSF and blood NfL needs to be determined.
The aim of this systematic review and meta-analysis was to determine the overall pooled correlation coefficient estimate between CSF and blood NfL in human studies. Given the lower analytical sensitivity of ELISA compared with ECL and Simoa NfL assays, which is of particular relevance when measuring blood NfL concentrations, we also assessed the pooled correlation coefficient estimate between CSF and blood NfL, in studies that measured blood NfL using the Simoa or ECL assays only. In subanalyses, we stratified the pooled correlation coefficient estimates by blood NfL assay, and according to whether both CSF and blood NFL concentrations were measured using the Simoa assay or whether CSF NfL was measured using ELISA or ECL assays while blood NFL was measured using Simoa. Additionally, we stratified the pooled correlation coefficient estimates by plasma versus serum NfL, conditions which purely affect the CNS versus conditions that affect both the CNS and peripheral nervous system (PNS) versus control participants and statistical correlation technique used.
Standard protocol approvals, registrations and patient consents
This systematic review and meta-analysis was conducted in accordance with Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines13–15 and is reported in compliance with the Meta-Analysis of Observational Studies in Epidemiology proposal. A protocol was registered and approved in the International Prospective Register of Systematic Reviews (PROSPERO).15 16 We searched publicly available published studies, and institutional research ethics board approval and patient consent were not required for this systematic review.
Data sources and search strategy
We systematically searched Ovid MEDLINE, Ovid Embase and Web of Science electronic databases for eligible published articles from their inception to 9 July 2019. The following search terms were used: [(cerebrospinal fluid or spinal fluid or CSF) and (neurofilament* light or neuro filament* light or NFL or NFLs)] and [(plasma or blood or peripheral or serum) and (neurofilament* light or neuro filament* light or NFL or NFLs)]. Grey literature sources were not accessed.
Inclusion and exclusion criteria
Studies published in English were included if the correlation coefficient between paired CSF and blood (plasma or serum) NfL in human participants was reported. Studies were excluded for the following reasons: (1) duplicate articles (where the same article was retrieved more than once during the electronic database searches), (2) CSF and blood samples retrieved at autopsy, (3) nonoriginal research (review articles, letters in response to previous articles) and (4) abstracts and conference proceedings.
Retrieved articles were imported into Covidence, an online primary screening and data extraction tool. Two authors (JA and SvW) independently screened the titles and abstracts of all studies retrieved from the database search to identify potentially eligible studies; the two authors (JA and SvW) then independently appraised the potentially eligible full-text articles against the eligibility criteria to determine final inclusion into the systematic review and meta-analysis. Discrepancies about decisions on study inclusion were resolved by the senior author (SF). Where additional clarification was required such as correlation technique used and sample size, the corresponding author of the study was contacted and details about the specific missing information were requested.
Data from the full-text articles were independently extracted and checked for accuracy by two authors (JA and SvW) and imported into a database on Microsoft Excel. The following information was extracted: first author’s surname, year of publication, article title, location where study took place, study design, disease process(es) being investigated, study population, number of paired CSF and blood samples measured for NfL, CSF and blood NfL assays used, plasma or serum samples analysed for NfL, statistical correlation technique used and correlation coefficient value. Data extraction is summarised in online supplemental Table 1. Any disagreements during data extraction were resolved by the senior author (SF).
Assessment of quality
Quality assessment was performed at the study level by two authors (JA and SvW) using the National Institutes of Health: National Heart Lung and Blood Institute’s study quality assessment tools.17 Each item was scored as (✓=1 point, ✗ or ?=0 points). Any study that scored above 6 points of the 14-point criteria was considered ‘good’ quality or ‘low risk of bias’. Studies scoring between 5 and 6 points were considered ‘fair’ quality or ‘moderate risk of bias’ and studies scoring below 5 points were considered ‘poor’ quality or ‘high risk of bias’.
Meta-analyses were performed using the statistical software R V.3.6 and the meta package. The pooled correlation coefficient estimate and 95% CI in the overall analysis were calculated using a random-effects meta-analysis of correlations based on Fisher’s Z-transformation, incorporating the heterogeneity between studies due to the different correlation techniques and blood NfL assays used. Heterogeneity and between-study variance were assessed using the I2 statistics and τ2 (Sidik-Jonkman estimator). The rank correlation test of funnel plot asymmetry was used to assess for publication bias. A p value <0.05 was considered statistically significant throughout.
In prespecified sensitivity analyses, pooled correlation coefficient estimates were stratified according to: (1) studies measuring blood NfL using ECL and Simoa assays only, (2) blood NfL assay (Simoa, ECL or ELISA), (3) whether both CSF and blood NfL concentrations were measured using Simoa or CSF NfL was measured using ELISA or ECL and blood NfL was measured using the Simoa assay, (4) whether plasma or serum NfL was measured, (5) whether the neurological condition being investigated only affected the CNS or affected both the CNS and PNS and (6) correlation coefficient technique used (Spearman’s rank or Pearson’s correlation coefficient, where unspecified, Pearson’s correlation was imputed). Pooled correlation coefficient estimates and 95% CI in these subgroup analyses were calculated using a fixed-effects model.
The data sets used and analysed in this study including those not published within the article can be shared with other qualified investigators on reasonable request made to the corresponding author, in accordance with International Committee of Medical Journal Editors requirements.
The database searches identified 1058 unique articles (figure 1). Titles and abstracts were screened against the eligibility criteria and 826 articles were excluded (figure 1). The remaining 232 articles underwent full-text review and 36 articles8 10–12 18–49 were deemed eligible for inclusion into the meta-analysis (figure 1).
Data were extracted from the 36 articles (online supplemental table 1) and included 3961 unique paired CSF and blood NfL measurements. Studies were from Europe (n=26), North America (n=5), China (n=1) and four studies recruited in multiple sites internationally. online supplemental table 1 summarises the characteristics of the individual studies included.
Blood NfL was measured using the Simoa assay in 26/36 studies, ECL assay in 8/36 studies, ELISA in 1/36 study; one study reported results using all three assays (Simoa, ECL and ELISA) for each blood NfL measurement. Most studies measured CSF NfL using ELISA (23/36), while 6/36 studies measured CSF NfL using Simoa, 6/36 studies using ECL and 1 study reported CSF NfL measurements using all three assays (Simoa, ECL and ELISA). In total, 23/36 studies used serum NfL when calculating the correlation coefficient between CSF and blood NfL, 12/36 studies used plasma NfL and 1 study combined the results from serum and plasma NfL measurements. In total, 21 unique correlation coefficients between CSF and blood NfL were reported in conditions affecting the CNS only, 17 unique correlation coefficients were reported in conditions affecting the CNS and PNS and 7 correlation coefficients were reported in cohorts of control participants. Overall, 22/36 studies reported Spearman’s rank correlation, 13/36 studies reported Pearson’s correlation coefficient; correlation technique was unspecified in one study.
Using a random-effects model, the overall pooled correlation coefficient estimate for CSF and blood NfL across all 36 eligible studies was r=0.723 (95% CI 0.540 to 0.840) (figure 2A). Heterogeneity was significant with an I2 result of 83% and τ2 (Sidik-Jonkman estimator) of 0.072, p<0.01, thus stratified analyses were performed. The rank correlation test of funnel plot asymmetry showed no asymmetry (p=0.53), and, thus, no obvious publication bias (figure 2B).
In sensitivity analyses, the pooled correlation coefficient estimates for CSF and blood NfL for studies which measured blood NfL using Simoa or ECL assays only (n=3848), excluding the two studies which measured blood NfL using ELISA, was r=0.688 (95% CI: 0.671, 0.705) (figure 3A). The pooled correlation coefficient was similar when blood NfL was measured using Simoa (n=3117) and ECL (n=731) assays (r=0.689 (95% CI 0.670 to 0.708) and r=0.684 (95% CI 0.642 to 0.722), respectively) (figure 3B,C), but weaker with ELISA (n=113) (r=0.354 (95% CI 0.176 to 0.510)) (figure 3D). The pooled correlation estimate was similar when stratified according to studies which measured both CSF and blood NfL using Simoa (n=437) and studies where blood NfL was measured using Simoa and CSF NfL was measured using ELISA or ECL (n=2600), r=0.712 (95% CI 0.661 to 0.756) (figure 3E) and r=0.674 (95% CI 0.652 to 0.695) (figure 3F), respectively.
With regards to studies measuring blood NfL in serum versus plasma, studies using serum NfL (n=2335) had a pooled correlation coefficient estimate of r=0.658 (95% CI 0.634 to 0.681) (figure 3G), and studies which used plasma NfL (n=1531) had a pooled estimate of r=0.706 (95% CI 0.680 to 0.731) (figure 3H).
Studies including participants with clinical disorders that affected the CNS only (n=2045) had a pooled correlation coefficient estimate of r=0.642 (95% CI 0.615 to 0.667) (figure 4A). Studies including participants with clinical disorders that affected both the CNS and PNS (n=1577) had a higher overall pooled correlation coefficient estimate of r=0.745 (95% CI 0.721, 0.766) (figure 4B) and the control participants (n=308) had the lowest pooled correlation coefficient estimate at r=0.552 (95% CI 0.466 to 0.627) (figure 4C).
When stratified according to correlation technique used, studies quoting Spearman’s rank correlation coefficient (n=3085) had a pooled correlation coefficient estimate of r=0.642 (95% CI 0.620 to 0.663) (figure 4D), while the pooled estimate was higher for studies quoting Pearson’s correlation (n=876), with r=0.794 (95% CI 0.768 to 0.818) (figure 4E).
Quality assessment of included studies
The results of the quality assessment of the included studies are summarised in online supplemental table 2. Overall, 31 studies were classified as ‘good’ quality and five as ‘fair’ quality.
Our systematic review and meta-analysis demonstrates that the overall pooled correlation coefficient estimate between CSF and blood NfL across pathologies is moderately strong, according to the Chan definition.50 While this is reassuring, it is important to note that blood NfL does not correlate perfectly with CSF NfL and additional factors may need to be taken into consideration when interpreting blood NfL results.
Only two studies measured blood NfL using ELISA, which has a low analytical sensitivity for measuring NfL concentration. When these two studies were excluded, the pooled correlation coefficient estimate between CSF and blood NfL across pathologies remained moderately strong, which may reflect the small number of unique paired CSF and blood NfL measurements contributed by these two studies to the overall pooled correlation coefficient estimate in this meta-analysis. When stratified according to blood NfL assay used, moderately strong correlations were demonstrated between CSF and blood NfL in studies using Simoa and ECL blood NfL assays, but the correlations in studies using ELISA to measure blood NfL were much lower. The pooled correlation estimate was higher in studies that measured both CSF and blood NfL using Simoa compared with studies that measured blood NfL using Simoa and CSF NfL using ELISA or ECL, suggesting that in the setting of these studies, measuring CSF and blood NfL using Simoa improved the association in NfL between the two compartments. Simoa is the current preferred blood NfL assay, especially at low or physiological concentrations due to its high analytical sensitivity (low detection limit),10 12 and this meta-analysis supports the use of blood NfL measured using Simoa as the current most advanced surrogate measure of CSF NfL.
The correlation coefficients were similarly moderately strong when stratified according to studies which measured plasma versus serum NfL, in keeping with published literature suggesting the lack of difference in NfL concentration when measured in these two matrices.51
When stratified according to underlying condition being studied (purely CNS conditions, conditions with CNS and PNS components and control participants), the pooled correlation coefficient estimates were highest in participants with CNS and PNS disease and lowest in the control participants. The NfL concentration range was lower in control participants and closer to the analytical sensitivity of the NfL assays employed, thus, more variable, resulting in a lower correlation between CSF and blood NfL. This suggests that blood NfL is a better surrogate marker of CSF NfL at higher CSF NfL concentration ranges. Additionally, participants with disorders affecting the CNS may have a more disrupted blood–brain barrier, and, thus, leak more NfL from the CSF into the blood, compared with control participants, who are more likely to have intact blood–brain barriers, and, thus, leak less CSF NfL into the bloodstream. The pooled correlation coefficient between CSF and blood NfL is higher in studies reporting Pearson’s correlation compared with those reporting Spearman’s rank correlation, possibly due to the presence of outliers or to non-normality of NfL concentrations.
Strengths of our review are the high methodological standards used to conduct the systematic review, and the inclusion of potential confounders in sensitivity analyses. Limitations include publication bias, which may cause an overestimation of the pooled correlation coefficient estimates. Most studies enrolled participants in Western Europe and North America, and it is unknown whether our results can be extrapolated to individuals globally. We included publications in English language only as part of our search strategy and may have excluded studies reporting the correlation coefficient between CSF and plasma NfL that were not in English language, which may affect the pooled correlation coefficient estimates. The number of blood samples measured for NfL using ELISA was much smaller (n=113) compared with Simoa (n=3117) and ECL (n=731), which may contribute to the much wider 95% CI for the pooled correlation coefficient estimate between CSF and blood NfL in samples using ELISA technique. However, the most likely explanation for the variable results is that blood NfL concentration measured by ELISA simply reflects noise, as the analytical sensitivity of the assay is insufficient to quantify NfL in blood reliably.
The impact of heterogeneous factors that may influence NfL measurement and interpretation such as unicentric versus multicentric studies, cross-sectional versus longitudinal samples and the duration between CSF and blood sampling were not explored in this review, due to the data not being readily available from the publications. Data on preanalytical factors that may affect NfL measurements were also not consistently available, thus, it could not be systematically assessed between the studies. Preanalytical factors to consider include different sampling methods,52 duration of NfL stability at room temperature8 53–55 and number of freeze-thaw cycles prior to NfL measurement.8 53 55 56
Data were not routinely accessible for the following factors that may increase plasma NfL independently of CSF NfL and affect the correlation between CSF and blood NfL. There is evidence to suggest an association between increased blood–brain barrier permeability and increased blood NfL concentration,11 57 but other studies have not demonstrated this relationship.24 58 Other factors that may be associated with increased blood NfL include lower body mass index (possibly due to decreased blood volume),59 pregnancy (possibly due to the developing fetal brain),60 61 peripheral nerve injury,27 concomitant use of neurotoxic drugs62 and lower estimated glomerular filtration rate.63
Using rigorous systematic review and meta-analysis, we report an overall moderately strong correlation between CSF and blood NfL. Until now, the strength of the correlation between CSF and blood NfL has been questionable due to the uncertainty of agreement between the studies. Our findings support the use of blood NfL measurement as a promising surrogate marker of CSF NfL. Additional studies are warranted to validate the blood NfL assay and to assess how blood NfL performs in clinical and research settings.
Contributors JA, AW and SF conceptualised the idea for the study, JA, SvW, AW, HZ and SF designed the study, JA, SvW, JU, PE, AW, HZ and DDF formulated the data analysis plan; JA and SvW performed the data collection, SF resolved conflicts during data collection, DDF performed the statistical analysis, JA, SvW and DDF interpreted the results, JA drafted the first version of the manuscript, all authors reviewed and edited the manuscript for intellectual content.
Funding Imperial College National Institute of Health Research (NIHR) Biomedical Research Centre (BRC) provided infrastructural support
Competing interests JA has received financial support to attend scientific conferences from MSD and Gilead Sciences. JU has received honoraria for preparation of educational materials and has served on an advisory board for Gilead Sciences. PE has received grants from the Medical Research Council, Alzheimer’s Research UK, Alzheimer’s Drug Discovery Foundation, Alzheimer’s Association, Alzheimer’s Society, Novo Nordisk®, Life Molecular Imaging, GE Healthcare, Eli Lilly and Company, Novartis International AG and NIHR Imperial Biomedical Research Centre (BRC). PE was also a consultant to Pfizer, is now a consultant to Novo Nordisk, and serves on the advisory board for Novo Nordisk. PE has received consultancy and speaker fees from Piramal Life Sciences, Pfizer and Novo Nordisk. AW has received honoraria or research grants on behalf of Imperial College London or been a consultant or investigator in clinical trials sponsored by Bristol-Myers Squibb, Gilead Sciences, GlaxoSmithKline, Janssen-Cilag, Roche and ViiV Healthcare. HZ has served at scientific advisory boards for Denali, Roche Diagnostics, Wave, Samumed and CogRx, has given lectures in symposia sponsored by Fujirebio, Alzecure and Biogen, and is a co-founder of Brain Biomarker Solutions in Gothenburg AB, a GU Ventures-based platform company at the University of Gothenburg (outside submitted work). SF received funding and research grants from the National Institutes of Health (NIH), Bill & Melinda Gates Foundation (BMGF) and Medical Research Council (MRC).
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.