Abstract
Introduction
Real-time three-dimensional echocardiography (RT3DE) is currently being developed to overcome the challenges of two-dimensional echocardiography, as it is a much cheaper alternative to the gold standard imaging method, cardiac magnetic resonance (CMR). The aim of this meta-analysis is to validate RT3DE by comparing it to CMR, to ascertain whether it is a practical imaging method for routine clinical use.
Methods
A systematic review and meta-analysis method was used to synthesise the evidence and studies published between 2000 and 2021 were searched using a PRISMA approach. Study outcomes included left ventricular end-systolic volume (LVESV), left ventricular end-diastolic volume (LVEDV), left ventricular ejection fraction (LVEF), left ventricular mass (LVM), right ventricular end-systolic volume (RVESV), right ventricular end-diastolic volume (RVEDV) and right ventricular ejection fraction (RVEF). Subgroup analysis included study quality (high, moderate), disease outcomes (disease, healthy and disease), age group (50 years old and under, over 50 years), imaging plane (biplane, multiplane) and publication year (2010 and earlier, after 2010) to determine whether they explained the heterogeneity and significant difference results generated on RT3DE compared to CMR.
Results
The pooled mean differences for were − 5.064 (95% CI − 10.132, 0.004, p > 0.05), 4.654 (95% CI − 4.947, 14.255, p > 0.05), − 0.783 (95% CI − 5.630, 4.065, p > 0.05, − 0.200 (95% CI − 1.215, 0.815, p > 0.05) for LVEF, LVM, RVESV and RVEF, respectively. We found no significant difference between RT3DE and CMR for these variables. Although, there was a significant difference between RT3DE and CMR for LVESV, LVEDV and RVEDV where RT3DE reports a lower value. Subgroup analysis indicated a significant difference between RT3DE and CMR for studies with participants with an average age of over 50 years but no significant difference for those under 50. In addition, a significant difference between RT3DE and CMR was found in studies using only participants with cardiovascular diseases but not in those using a combination of diseased and healthy participants. Furthermore, for the variables LVESV and LVEDV, the multiplane method shows no significant difference between RT3DE and CMR, as opposed to the biplane showing a significant difference. This potentially indicates that increased age, the presence of cardiovascular disease and the biplane analysis method decrease its concordance with CMR.
Conclusion
This meta-analysis indicates promising results for the use of RT3DE, with limited difference to CMR. Although in some cases, RT3DE appears to underestimate volume, ejection fraction and mass when compared to CMR. Further research is required in terms of imaging method and technology to validate RT3DE for routine clinical use.
Graphical abstract
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Cardiovascular diseases are the leading cause of death worldwide and as such, sensitive diagnostic methods are vital in early diagnosis and, therefore, prevention [1]. The evaluation of ventricular mass, volume and ejection fraction are important parameters in diagnosis [2]. For the last few decades, two-dimensional echocardiography (2DE) has been the routinely used method, with the ability to provide information on each of these parameters [3]. However, two-dimensional echocardiography is limited with regards to the need for geometrical assumptions, foreshortened views and suboptimal endocardial border detection [4]. Two-dimensional echocardiography is operator-dependent, relying on the visual interpretation of moving images, and prone to inter-observer and intra-observer variability and poor test–retest reliability. Moreover, to calculate a volume from 2DE, geometric modelling of chamber shape must be performed and consequently, LVEF estimation from 2DE is subject to bias and error in the presence of pathology. This produces less accurate and less consistent geometric modelling [5].
It has been suggested that 3D echocardiography does not show variability in geometric modelling and has higher inter-observer and intra-observer reliability [6]. RT3DE shows great promise in being included in routine CVD diagnosis in the future, not only because it provides more reliable volume quantification, but also has the ability to crop and visualise specific structures in greater detail. Currently, CMR is considered as the gold standard for three-dimensional imaging that produces the most reliable and accurate imaging of the heart. However, it is both costly and time-consuming in acquisition and processing of images [7].
Previous studies have shown high concordance between RT3DE and CMR in the assessment of ventricular mass volume and ejection fraction [8,9,10,11,12]. This can be attributed to the ability to simultaneously view an image in multiple planes in RT3DE. Chosen long-axis planes can then be analysed using either a biplane or multiplane method for ventricular volumetric analysis and determination of mass. A simpler approach is the biplane method which takes 2-chamber and 4-chamber long-axis views of the image, traces the epicardial and endocardial surfaces of these two planes and uses these to calculate mass and volume. The more complex multiplane approach traces the surfaces of the epicardial and endocardial surfaces of the heart in multiple long-axis planes. This is followed by a correction of the tracings in short-axis views [13].
However, despite the significant advances made in three-dimensional echocardiography, there are still some areas which current studies aim to address, before it is integrated into routine clinical use. The spatial and temporal resolution still do not match that of 2DE, the analysis can be time consuming and the breath-hold time to acquire these images is very long as multiple beats are needed. These beats are stitched together to form a full image which is manually done, potentially causing artefacts in the image. A stitch artefact appears as a fault line in an image, compromising interpretation [14]. Advances are now being made allowing full-volume acquisition to be conducted using only a single beat, instead of multiple to avoid stitch artefacts and shorten breath-hold time [15].
Additionally, to analyse 3DE using either the fully automated or semi-automated algorithms, very high image quality is required. This requires highly trained professionals for image acquisition. Image quality is suggested to be affected not only by the expertise of the professional, but also patient factors. Therefore, current studies aim to programme more sensitive artificial intelligence to analyse images of different quality. They further aim to fully automate the analysis process to speed up the process of RT3DE, to make it a more practical too to be utilised in a clinical setting [7].
This study aims to fill in the research gap by synthesising data from numerous studies which compare RT3DE to the current gold standard, CMR, so a more reliable conclusion can be made surrounding the efficacy of RT3DE, a cheaper and faster tool for CVD diagnosis [7].
Method
A protocol containing the method and study design is published in Prospero (registration number: CRD42021262783). Studies published from 2000 to present are filtered due to its recent development in RT3DE method, and a broad search is conducted on the databases PubMed, Embase and Scopus with terms (3D echocardiography OR RT3DE OR real-time 3D echocardiography) AND (cardiac magnetic resonance OR CMR). Total articles are noted and then abstract and title screening is conducted to ensure studies fit within inclusion and exclusion criteria based on PICO approach. P: Live human adults (18+ years) of all ethnicities and both genders are the target population of the study, excluding children. I: The studies must mention terms RT3DE. Imaging conducted at rest is taken, as results during stress echocardiography can be significantly different. Post-mortem analyses and computer simulation which can produce significantly different results are excluded. C: CMR to be included. O: outcomes including at least one of the following primary outcomes: LVESV, LVEDV, LVEF, LVM, RVESV, RVEDV and RVEF.
All records are collected onto an Endnote library and then full-text articles for each included study are found. After screening the full-text articles, studies are eliminated if data are not present on the primary outcomes of the meta-analysis and those with duplicated or overlapping data. The Endnote library is then compressed and sent to a peer, along with the search terms, search databases and eligibility criteria, to mitigate reviewer bias. The final screening is conducted by a third reviewer and a final decision is made on the articles to be used for data extraction.
Data extraction is conducted on a Microsoft Excel document with each primary outcome on a different sheet. Data are extracted for primary outcomes (LVESV, LVEDV, LVEF, LVM, RVESV, RVEDV and RVEF) and subgroups. Subgroups of continuous variables from studies are converted to categorical variables to prepare for subgroup analysis. The categories used in this study include age (1 = 50 and less, 2 = more than 50 years old), disease condition (1 = disease, 2 = disease and healthy, 3 = healthy), quality of study (1 = high and 2 = medium), publication year (1 = 2010 and earlier, 2 = after 2010) and RT3DE analysis planes (1 = biplane, 2 = multiplane).
Study characteristics including study location, gender ratio, average age, study design, imaging method and brand, analysis method, statistics, disease conditions and outcome measures are all collected. The data collected for analysis include RT3DE and CMR mean values, standard deviations and sample size for calculation of effect size and mean difference. Additionally, regression values and Bland–Altman test values are also collected. Where mean and standard deviation are not reported, median values are taken to equal the mean and standard deviation is taken to be range/4. All data are checked by two independent reviewers to reduce human error and bias.
The quality assessment check is conducted using the The Grading of Recommendations Assessment, Development and Evaluation (GRADE) tool where only high- or medium-quality studies are used [16]. Two authors independently reviewed studies using this approach to ensure study quality is reliably noted.
All data analysis is conducted on STATA SE version 17. Egger regression analysis was used to assess publication bias and if the p value is less than 0.05, this indicates publication bias. If publication bias is identified, further sensitivity analysis was used to assess the publication bias is due to a single study and further removal of the study was conducted to validate the final results.
A random model using effect size measures including standardised mean difference and effect size (using Cohen’s d method) between RT3DE and CMR will be used for all continuous variables including primary outcomes in ventricular volumes, mass, ejection fraction. Mean difference is used to indicate whether there is any significant difference between RT3DE and CMR. Effect size is used to indicate the size of the difference between CMR and RT3DE. Additionally, concordance results and Bland–Altman analysis results are pooled using mean and recorded. Many studies report standard deviation instead of upper and low limits of agreement (LOA), which is required for this study. In this case, the standard deviation is converted to LOAs using the formulas [17]:
Heterogeneity analysis using I2 will be used to identify the level of variability across studies. An I2 value of more than 50% indicates a high level of heterogeneity. Subgroup analysis was conducted to identify sources of heterogeneity if I2 is more than 50%.
All data and selected studies were checked by two researchers to ensure no errors in data collection were made which can lead to erroneous conclusions. Inclusion and exclusion criteria are predetermined and applied uniformly to all studies to ensure objective selection of studies. Statistical analyses were conducted to consider the possibility of publication bias. As this is a meta-analysis, any human ethical considerations were not required for this study.
Results
The search process can be seen on Fig. 1 and included studies and study characteristics on Table 1. A total of 2073 potential studies from the databases Pubmed, Embase and Scopus were identified. After the removal of 28 duplicates, 40 articles remained. Full text screening was conducted on the remaining articles and 12 were excluded due to irrelevance or data insufficiency. Overall, 28 articles are used for quantitative synthesis in this meta-analysis.
The majority of mean effect estimates of individual studies for LVESV, LVEDV, LVEF, RVESV, RVEDV and RVEF, as reflected by the overall effect estimate, lie to the left of the central line, favouring RT3DE over CMR. Although for LVM, the majority of mean effect estimates, as reflected by the overall effect estimate, lie to the right of the central line, favouring CMR over RT3DE.
The 28 studies included were published between the years 2004 and 2017 and were all case–control studies. The total 1215 (800 males, 415 females) patients received RT3DE followed by CMR across all studies and all participants received both RT3DE (case) and CMR (control) imaging. Exceptions include Caiani et al. [21] where two patients received only CMR as they had dilated cardiomyopathy preventing their heart from being able to fit into the pyramidal scan volume for RT3DE and Zhang et al. [35] where two patients did not have adequate image quality for RT3DE analysis. Participants were recruited from 17 different countries including Argentina [18], Sweden [19], Brazil [20], USA [21,22,23,24,25,26,27], South Korea [28], Netherlands [13, 29, 30], UK [31, 32], Australia [33,34,35], Germany [26, 27, 36], Switzerland [37], China [35, 38], France [39, 40], Japan [41, 42], Taiwan [43], Italy [44], Austria [26, 27] and Hong Kong [35].
All studies include had at least one of the required outcome variables including LVESV, LVEDV, LVEF, LVM, RVESV, RVEDV and RVEF. It should be mentioned here that insufficient studies were available on the right ventricular mass (RVM) outcome variable and, therefore, this variable was not included in the meta-analysis. Information on the RT3DE and CMR imaging technologies, analysis method (automatic or semi-automatic), beat number used for RT3DE imaging, disease conditions of patients, age group, male to female ratio and RT3DE analysis plane (biplane or multiplane) were collected as these varied among the 28 studies, summarised in Table 1. In addition key results from the GRADE quality assessment as well as statistical analysis tests used in each study are also summarised in Table 1 (Fig. 2).
The studies used in this meta-analysis were either moderate or high quality based on the GRADE assessment conducted. Only moderate or high-quality studies were used in an attempt to prevent bias. The results from the Egger regression test for publication bias displayed in STable 5 indicated no significant bias for LVESV, LVEDV, LVEF, LVM, RVEDV and RVEF (p > 0.05). However, the Egger regression test indicates statistically significant bias for RVESV (p < 0.05). These results can be observed in the funnel plots in Fig. 3.
According to Table 2, the pooled mean differences for were − 5.064 (95% CI − 10.132, 0.004, p > 0.05), 4.654 (95% CI − 4.947, 14.255, p > 0.05), − 0.783 (95% CI − 5.630, 4.065, p > 0.05, − 0.200 (95% CI − 1.215, 0.815, p > 0.05) for LVEF, LVM, RVESV and RVEF, respectively. This indicates no significant difference between RT3DE and CMR for these variables, meaning that results of RT3DE are similar to CMR.
Subgroup analyses were conducted for variables with significant heterogeneity, including LVESV, LVEDV, LVEF and RVESV. The subgroup analyses which were conducted indicate some differences which may have contributed to differences in results for each variable as well as significant heterogeneity. For LVESV, there is a significant difference between RT3DE and CMR for those aged over 50 years [MD = − 13.896 (95% CI − 20.480, − 7.311, p < 0.001)], but no significant differences for those under 50 [− 21.627 (− 48.932, 5.678)]. Furthermore, studies including only participants with cardiovascular disease indicated a significant mean difference [MD = − 19.286 (95% CI − 33.345, − 5.227), p < 0.01] as well as those including both healthy and diseases participants [MD = − 13.657 (95% CI − 23.492, − 3.823), p < 0.01]. Additionally, there is a significant difference between RT3DE and CMR for high-quality studies [MD = − 14.784 (95% CI − 21.377, − 8.192), p < 0.001], compared to moderate-quality studies indicating no significant difference. Further, studies published in 2010 and earlier also indicated a significant difference between the two diagnostic methods [MD = − 12.301 (95% CI − 20.995, − 3.608), p < 0.01] compared to those published after 2010 [MD = − 21.590 (95% CI − 38.495, − 4.685), p < 0.05]. Finally, studies using the biplane method indicated a significant difference between RT3DE and CMR [MD = − 14.335 (95% CI − 21.132, − 7.537, p < 0.001)] compared to the multiplane method indicating no significant difference [MD = − 7.918 (− 21.416, 5.580), p > 0.05)].
For the LVEDV variables, there is a significant difference between RT3DE and CMR for those aged over 50 years [MD = 13.896 (95% CI − 20.480, − 7.311, p < 0.001)], but no significant differences for those under 50 [MD = − 52.758 (− 110.466, 4.950), p > 0.05]. Furthermore, studies including only participants with cardiovascular disease indicated a significant mean difference [MD = − 19.286 (95% CI − 33.345, − 5.227), p < 0.01] as well as those including both healthy and diseases participants [MD = − 13.657 (95% CI − 23.492, − 3.823), p < 0.01]. Additionally, there is a significant difference between RT3DE and CMR for high-quality studies [MD = − 14.784 (95% CI − 21.377, − 8.192), p < 0.001], compared to moderate-quality studies indicating no significant difference. Further, studies published in 2010 and earlier also indicated a significant difference between the two diagnostic methods [MD = − 12.301 (95% CI − 20.995, − 3.608), p < 0.01] as well as those published after 2010 [MD = − 37.027 (95% CI − 66.971, − 7.082), p < 0.05]. However the mean difference in studies published before 2010 is more significant. Finally, studies using the biplane method indicated a significant difference between RT3DE and CMR [MD = − 14.335 (95% CI − 21.132, − 7.537, p < 0.001)] compared to the multiplane method indicating no significant difference [MD = − 12.958 (− 27.566, 1.649), p > 0.05].
For the LVEF variable, for those aged over 50 years, there is a significant mean difference between RT3DE and CMR of − 7.403 (95% CI − 13.852, − 0.954, p < 0.05) where RT3DE reports lower left ventricular end-systolic volume compared to those aged 50 years old and under indicating no significant difference [MD = 0.981 (− 7.051, 9.013), p > 0.05]. Furthermore, there is no significant mean difference for neither the disease [MD = − 3.002 (− 6.769, 0.764), p > 0.05], nor the disease and healthy subgroup [MD = − 8.522 (− 21.784, 4.739), p > 0.05]. There is significantly high heterogeneity for mean difference in both studies with diseased participants (I2 = 91.963, p < 0.001) and studies with both diseased and healthy participants (I2 = 77.387, p < 0.001). Additionally, for studies of high quality, RT3DE reports significantly lower LVEDV compared to CMR [MD = − 4.180 (95% CI − 6.882, − 1.478), p < 0.01], compared to moderate-quality studies showing no significant difference [− 7.193 (− 26.802, 12.417), p > 0.05]. Further, the pooled mean difference for studies published in 2010 and earlier [MD = − 4.159 (95% CI − 6.807, − 1.511), p < 0.01], compared to studies published after 2010 indicating no significant difference [MD = − 7.107 (− 21.622, 7.408), p > 0.05]. Finally, there is no significant mean difference for neither the biplane [MD = − 9.998 (− 21.211, 1.214), p > 0.05] nor the multiplane [MD = 0.944 (− 2.008, 3.896), p > 0.05) methods.
For the RVESV variable, there is no significant difference between RT3DE and CMR for mean difference for any subgroups.
Pooled correlation and Bland–Altman analysis results:
According to STable 6, there is high correlation between RT3DE and CMR for all variables, and each individual correlation coefficient which was pooled was statistically significant. The statistical analysis method for concordance differed among studies, as specified in Table 1. All variables except for left ventricular end-systolic volume and left ventricular end-diastolic volume have low bias. Although, the limits of agreement for all variables are very wide.
Discussion
Summary of overall results
Overall, this meta-analysis indicated no significant mean difference and effect size between RT3DE and CMR for LVEF, LVM, RVESV and RVEF. Additionally, the pooled concordance values and Bland–Altman agreement generated in this meta-analysis for all variables was also very high. This is promising as RT3DE is a cheaper and faster alternative to CMR. Additionally, it provides better quality images to the routinely used two-dimensional echocardiography by removing the need for geometrical assumptions used for the calculation of ventricular mass and volume.
Similarity between RT3DE and CMR and reason/mechanisms
These similarities can be attributed to the three-dimensional nature of RT3DE which removes spatial and geometric assumption, similar to CMR and therefore produces more accurate ventricular mass and volume calculation. This is different to the standard practice of using two-dimensional echocardiography, subject to inter-observer bias and reduced accuracy due to geometric modelling.
These findings are supported by previous meta-analyses, indicating a low mean difference between RT3DE and CMR with high concordance and low bias within narrow limits of agreement [8,9,10,11,12, 46, 47]. Although according to this meta-analysis, for the variables LVESV, LVEDV and RVEDV, RT3DE reports significantly lower results compared to CMR. In addition, there was significant heterogeneity between studies for the variables LVESV, LVEDV, LVEF and RVESV.
These differences can be attributed to a multitude of reasons related to patient characteristics, study quality and image acquisition and processing method. Therefore in relation to these factors, subgroup analyses, summarised below, were used to identify the sources of heterogeneity and explain any differences between the two methods.
Overall, there is no difference between RT3DE and CMR for the multiplane method, but a significant difference for the biplane method for LVESV and LVEDV. This difference may be because the RT3DE technology was used, rendering the LV volume much smaller than the measured results by CMR. This is consistent with the review result published by Wood et al. [46], suggesting that this negative impact of values in RT3DE relative to the CMR method may have been due to ‘bubble destruction, resulting from the high density of scanlines required for full volumetric acquisition’ [17].
For LVEF, there is no significant difference between RT3DE and CMR for neither the multiplane nor the biplane method. This is consistent with the findings of Yap, van Geuns [12], indicating there is no significant difference between biplane and multiplane methods in LVM determination.
Shimada and Shiota [10] found that the LVM measurement by RT3DE in healthy patients was very accurate in comparison to CMR whereas there was a greater degree of underestimation in patients with cardiovascular diseases. This is similar to the effect size findings of this meta-analysis for LVESV, LVEDV and LVEF variables. We found a moderate (LVESV) or large (LVEDV, LVEF) difference between RT3DE and CMR for the disease subgroup, compared to the diseased and healthy subgroup where there is only a small difference between RT3DE and CMR.
The goal of this subgroup analysis was to determine whether healthy versus diseases heart impacted the difference in results between RT3DE and CMR. Unfortunately, there were insufficient studies on only healthy patients, and therefore studies using a combination of healthy and diseases patients were compared to studies with only patients with cardiovascular disease. However, the small difference between the methodologies for studies with healthy participants, compared to the large differences in studies with only diseases participants, does indicate that diseased hearts may negatively impact RT3DE image quality.
Shimada and Shiota [48] suggest this trend may be due to the lower spatial resolution of RT3DE compared to CMR. In pathologies, dilatation and hypertrophy leads to a great distance between the ultrasound beam and the ventricles, further decreasing image quality. Irregular borders as a result of pathologies, impairing accuracy of RT3DE border tracing and analysis, is suggested to further contribute to greater variation between RT3DE and CMR. This can explain the greater difference between RT3DE and CMR in studies with diseased patients. Based on this, it’s recommended that in future, studies separate participants with cardiovascular disease and healthy participants when analysing data. This can also potentially mitigate the significant heterogeneity for this subgroup statistically indicated in this meta-analysis for the LVESV and LVEDV variables.
Interestingly, this meta-analysis reports no significant mean difference between RT3DE and CMR for moderate-quality studies, however a significant mean difference for high-quality studies for variables LVESV, LVEDV and LVEF. A significant effect size could also be seen in the high-quality study subgroup for each of these variables. However, there is significant heterogeneity in the moderate study quality subgroup. Additionally, since the studies declared to be of high quality by the GRADE assessment tool indicate a significant difference between RT3DE and CMR, then perhaps this significant difference should be considered over the moderate-quality studies. Testing diagnostic methods, particularly imaging, can be difficult due to the expensive and time-consuming nature. Therefore, it is difficult for studies to have a large sample size. If possible, conducting studies with larger sample sizes can increase study quality, which can further validate whether or not there is any significant difference between RT3DE and CMR.
Subgroup analysis was conducted by publication year to determine whether current advancements have made any significant contribution to increasing concordance between RT3DE and CMR. For LVESV and LVEDV, there was a significant difference between CMR and RT3DE for both studies published in 2010 and earlier and those published after 2010. However, for variables LVEDV, studies published in 2010 and earlier had a large effect size, whereas those published after 2010 had only a moderate effect size. This means that more recently published studies indicated a smaller difference between RT3DE and CMR for LVEDV. This is a promising result indicating that recent developments in developments have improved RT3DE imaging analysis and acquisition to increase its concordance with CMR.
Furthermore, for the variables LVEF, where there is a significant effect size and mean difference for studies published in 2010 and earlier, but no significant effect size and mean difference in studies published after 2010. This indicates that RT3DE technology has significantly improved in over the recent years (after 2010), supporting the integration of RT3DE into routine clinical use in the near future.
This meta-analysis reports a significant mean difference and effect size between RT3DE and CMR for LVESV, LVEDV and LVEF for those over the age of 50. However there is no significant difference or effect size between RT3DE and CMR for these variables in those aged 50 years old and under. This may suggest a potential reduced image quality generated by RT3DE in older individuals. Kitzman [49] suggests that due to the normal changes in the heat as a result of age, including increased ventricular wall and valve leaflet thickness, can result in poor-quality images through echocardiography. These findings suggest that potentially, future studies need to differentiate results based on age group as they show different imaging results. This may also help mitigate heterogeneity between studies, which was statistically indicated in this meta-analysis.
Furthermore, aside from age, other biological factors worth further considering, which may potentially impact RT3DE image quality include sex and BMI. However, currently, limited studies can be found focusing or subgrouping by age, sex or BMI [49,50,51]. Therefore, future studies should also group results based on sex and BMI, in addition to age. The goal, then, is to develop RT3DE to a point where biological differences will not impact image quality.
Therefore, integrating the findings of the subgroup analyses, older patients and the use of the multiplane instead of biplane analysis method may potentially reduce the quality of RT3DE. Additionally, more recent studies indicate no significant difference between RT3DE and CMR, as opposed to older studies, indicating promising development in RT3DE over the past decade [8, 11, 12]. Although considering the significant differences between CMR and RT3DE in terms of heart pathology, older aged patients biplane image analysis methods, further improvement is required in the RT3DE imaging modality prior to integration into routine clinical practice.
Strengths and limitations
This is the first meta-analysis study which has validated RT3DE against gold standard method, CMR approach including a large number of recently published case–control clinical studies. The meta-analysis has comprehensively assessed the value of RT3DE in clinical application. However, there are a number of limitations in the study. First, the studies used in the meta-analysis themselves had low sample size due to the nature of clinical study. This may explain the significant heterogeneity observed in both variable and subgroup analysis. It is difficult to perform studies in diagnostic methods with large sample sizes and this may have contributed to the lower power and larger margin of error.
Second, there was low agreement between RT3DE and CMR in LV volume assessment, no final judgment can be made about the comparison between RT3DE and CMR in LV volume measurement. A further study encompassing a comparison between RT3DE, CMR and 2D ECHO is needed to confirm the results in our study. Additionally, with improvements to the methodology to increase the agreement between RT3DE and CMR, future studies and meta-analyses are then required to assess similarity.
Furthermore, many studies used a combination of healthy and diseased participants, but did not separate these results. This could have created further variation in results. There were further variations such as difference in equipment, analysis method and participant factors such as ethnicity which subgroup analyses could not be conducted on due to low study number and some studies not reporting on these parameters. Additionally, the number of studies included in the subgroup analyses were also small and therefore may have lacked power to stratify for any methodological differences between the selected studies. Therefore, in future, we aim to reconduct a meta-analysis once more studies have been published in the field, to produce a meta-analyses with a higher power. In addition, we hope to potentially find more studies which include a larger sample size.
Conclusion
This meta-analysis included a very detailed analysis in terms of difference between RT3DE and CMR. Further steps have been taken in subgroup analyses which previous studies have not conducted. Through the collation of data from a range of different countries and RT3DE methods, the generalisability of study findings are high.
Overall, this meta-analysis indicated promising results for the use of RT3DE, with no significant difference to CMR (for LVEF, RVESV and RVEF). Although in some cases, RT3DE appears to underestimate volumes when compared to CMR (LVESV, LVEDV and RVEDV).
Currently, the most commonly used analysis method is semi-automatic where the borders are manually traced by the observer. Although, improvements are still being made to fully automate the process, to reduce processing time. In addition, currently analysis is conducted via a biplane a multiplane method. This meta-analysis indicates that there is no difference between RT3DE and CMR for the multiplane method, but a significant difference for the biplane method for LVESV and LVEDV. This indicates that the multiplane method is potentially a superior method. This is supported by previous research suggesting the benefit of the multiplane method in more in-depth analysis of heart structures, the results surrounding this is inconclusive and further research and development is required here.
Further advancements are required to compensate for biological changes including age, sex and BMI. This is of particular importance considering that the demographics most in need of these imaging methods are patients over the age of 50 with heart pathologies. This meta-analysis indicates lower concordance between RT3DE and CMR for older individuals. There is also greater underestimation by RT3DE compared to CMR in individuals with diseased heart, as indicated in this study. Previous research has suggested that RT3DE had provide more detail into heart structures when compared with the routinely used 2DE method. However, the above developments are being made to improve temporal and spatial resolution, which is lower in RT3DE compared to 2DE.
With technological advancement, RT3DE can be integrated into routine clinical practice. Further development should improve efficiency, workflow, image quality, speed, accuracy and simplicity of the RT3DE method. This will make RT3DE more accessible, and likely to be chosen over the current, more expensive and time-consuming method of CMR.
Data availability
Data will be available upon request.
References
Sanz JA, Galar M, Jurio A, Brugos A, Pagola M, Bustince H (2014) Medical diagnosis of cardiovascular diseases using an interval-valued fuzzy rule-based classification system. Appl Soft Comput 20:103–111
Tsao CW, Gona PN, Salton CJ, Chuang ML, Levy D, Manning WJ et al (2015) Left ventricular structure and risk of cardiovascular events: a framingham heart study cardiac magnetic resonance study. J Am Heart Assoc 4(9):e002188
Mangion JR (2010) Right ventricular imaging by two-dimensional and three-dimensional echocardiography. Curr Opin Cardiol 25(5):423–429
Grune J, Blumrich A, Brix S, Jeuthe S, Drescher C, Grune T et al (2018) Evaluation of a commercial multi-dimensional echocardiography technique for ventricular volumetry in small animals. Cardiovasc Ultrasound 16(1):10
Wu VC, Takeuchi M (2017) Three-dimensional echocardiography: current status and real-life applications. Acta Cardiol Sin 33(2):107–118
Cheng K, Monaghan MJ, Kenny A, Rana B, Steeds R, Mackay C, van der Westhuizen D (2018) 3D echocardiography: benefits and steps to wider implementation. J Cardiol 25:63–68. https://doi.org/10.5837/bjc.2018.014
Lang RM, Mor-Avi V, Sugeng L, Nieman PS, Sahn DJ (2006) Three-dimensional echocardiography: the benefits of the additional dimension. J Am Coll Cardiol 48(10):2053–2069
Dorosz JL, Lezotte DC, Weitzenkamp DA, Allen LA, Salcedo EE (2012) Performance of 3-dimensional echocardiography in measuring left ventricular volumes and ejection fraction: a systematic review and meta-analysis. J Am Coll Cardiol 59(20):1799–1808
Kitano T, Nabeshima Y, Otsuji Y, Negishi K, Takeuchi M (2019) Accuracy of left ventricular volumes and ejection fraction measurements by contemporary three-dimensional echocardiography with semi- and fully automated software: systematic review and meta-analysis of 1,881 subjects. J Am Soc Echocardiogr 32(9):1105–15 e5
Pickett CA, Cheezum MK, Kassop D, Villines TC, Hulten EA (2015) Accuracy of cardiac CT, radionucleotide and invasive ventriculography, two- and three-dimensional echocardiography, and SPECT for left and right ventricular ejection fraction compared with cardiac MRI: a meta-analysis. Eur Heart J Cardiovasc Imaging 16(8):848–852
Shimada YJ, Shiota T (2012) Meta-analysis of accuracy of left ventricular mass measurement by three-dimensional echocardiography. Am J Cardiol 110(3):445–452
Shimada YJ, Shiota T (2011) A meta-analysis and investigation for the source of bias of left ventricular volumes and function by three-dimensional echocardiography in comparison with magnetic resonance imaging. Am J Cardiol 107(1):126–138
Yap SC, van Geuns RJ, Nemes A, Meijboom FJ, McGhie JS, Geleijnse ML et al (2008) Rapid and accurate measurement of LV mass by biplane real-time 3D echocardiography in patients with concentric LV hypertrophy: comparison to CMR. Eur J Echocardiogr 9(2):255–260
Le HT, Hangiandreou N, Timmerman R, Rice MJ, Smith WB, Deitte L, Janelle GM (2016) Imaging Artifacts in Echocardiography. Anesth Analg 122(3):633–646. https://doi.org/10.1213/ANE.0000000000001085
Mohamed AA, Arifi AA, Omran A (2010) The basics of echocardiography. J Saudi Heart Assoc 22(2):71–76. https://doi.org/10.1016/j.jsha.2010.02.011
Adab P, Pallan MJ, Lancashire ER, Hemming K, Frew E, Griffin T et al (2015) A cluster-randomised controlled trial to assess the effectiveness and cost-effectiveness of a childhood obesity prevention programme delivered through schools, targeting 6–7 year old children: the WAVES study protocol. BMC Public Health 15:488
Bland JM, Altman DG (1999) Measuring agreement in method comparison studies. Stat Methods Med Res 8(2):135-160. https://doi.org/10.1177/096228029900800204
Avegliano GP, Costabel JP, Asch FM, Sciancalepore A, Kuschnir P, Huguet M et al (2016) Utility of real time 3D echocardiography for the assessment of left ventricular mass in patients with hypertrophic cardiomyopathy: comparison with cardiac magnetic resonance. Echocardiography 33(3):431–436
Bech-Hanssen O, Polte CL, Lagerstrand KM, Johnsson AA, Fadel BM, Gao SA (2016) Left ventricular volumes by echocardiography in chronic aortic and mitral regurgitations. Scand Cardiovasc J 50(3):154–161
Bicudo LS, Tsutsui JM, Shiozaki A, Rochitte CE, Arteaga E, Mady C et al (2008) Value of real time three-dimensional echocardiography in patients with hypertrophic cardiomyopathy: comparison with two-dimensional echocardiography and magnetic resonance imaging. Echocardiography 25(7):717–726
Caiani EG, Corsi C, Sugeng L, MacEneaney P, Weinert L, Mor-Avi V et al (2006) Improved quantification of left ventricular mass based on endocardial and epicardial surface detection with real time three dimensional echocardiography. Heart 92(2):213–219
Gopal AS, Chukwu EO, Iwuchukwu CJ, Katz AS, Toole RS, Schapiro W et al (2007) Normal values of right ventricular size and function by real-time 3-dimensional echocardiography: comparison with cardiac magnetic resonance imaging. J Am Soc Echocardiogr 20(5):445–455
Jaochim Nesser H, Sugeng L, Corsi C, Weinert L, Niel J, Ebner C et al (2007) Volumetric analysis of regional left ventricular function with real-time three-dimensional echocardiography: validation by magnetic resonance and clinical utility testing. Heart 93(5):572–578
Kim J, Cohen SB, Atalay MK, Maslow AD, Poppas A (2015) Quantitative assessment of right ventricular volumes and ejection fraction in patients with left ventricular systolic dysfunction by real time three-dimensional echocardiography versus cardiac magnetic resonance imaging. Echocardiography 32(5):805–812
Mor-Avi V, Sugeng L, Weinert L, MacEneaney P, Caiani EG, Koch R et al (2004) Fast measurement of left ventricular mass with real-time three-dimensional echocardiography: comparison with magnetic resonance imaging. Circulation 110(13):1814–1818
Sugeng L, Mor-Avi V, Weinert L, Niel J, Ebner C, Steringer-Mascherbauer R et al (2010) Multimodality comparison of quantitative volumetric analysis of the right ventricle. JACC Cardiovasc Imaging 3(1):10–18
Sugeng L, Mor-Avi V, Weinert L, Niel J, Ebner C, Steringer-Mascherbauer R et al (2006) Quantitative assessment of left ventricular size and function: side-by-side comparison of real-time three-dimensional echocardiography and computed tomography with magnetic resonance reference. Circulation 114(7):654–661
Chang SA, Kim HK, Lee SC, Kim EY, Hahm SH, Kwon OM et al (2013) Assessment of left ventricular mass in hypertrophic cardiomyopathy by real-time three-dimensional echocardiography using single-beat capture image. J Am Soc Echocardiogr 26(4):436–442
Driessen MM, Kort E, Cramer MJ, Doevendans PA, Angevaare MJ, Leiner T et al (2014) Assessment of LV ejection fraction using real-time 3D echocardiography in daily practice: direct comparison of the volumetric and speckle tracking methodologies to CMR. Neth Heart J 22(9):383–390
Marsan NA, Westenberg JJ, Roes SD, van Bommel RJ, Delgado V, van der Geest RJ et al (2011) Three-dimensional echocardiography for the preoperative assessment of patients with left ventricular aneurysm. Ann Thorac Surg 91(1):113–121
Grapsa J, O’Regan DP, Pavlopoulos H, Durighel G, Dawson D, Nihoyannopoulos P (2010) Right ventricular remodelling in pulmonary arterial hypertension with three-dimensional echocardiography: comparison with cardiac magnetic resonance imaging. Eur J Echocardiogr 11(1):64–73
Miller CA, Pearce K, Jordan P, Argyle R, Clark D, Stout M et al (2012) Comparison of real-time three-dimensional echocardiography with cardiovascular magnetic resonance for left ventricular volumetric assessment in unselected patients. Eur Heart J Cardiovasc Imaging 13(2):187–195
Jenkins C, Moir S, Chan J, Rakhit D, Haluska B, Marwick TH (2009) Left ventricular volume measurement with echocardiography: a comparison of left ventricular opacification, three-dimensional echocardiography, or both with magnetic resonance imaging. Eur Heart J 30(1):98–106
Lu KJ, Chen JX, Profitis K, Kearney LG, DeSilva D, Smith G et al (2015) Right ventricular global longitudinal strain is an independent predictor of right ventricular function: a multimodality study of cardiac magnetic resonance imaging, real time three-dimensional echocardiography and speckle tracking echocardiography. Echocardiography 32(6):966–974
Zhang QB, Sun JP, Gao RF, Lee AP, Feng YL, Liu XR et al (2013) Feasibility of single-beat full-volume capture real-time three-dimensional echocardiography for quantification of right ventricular volume: validation by cardiac magnetic resonance imaging. Int J Cardiol 168(4):3991–3995
Kuhl HP, Schreckenberg M, Rulands D, Katoh M, Schafer W, Schummers G et al (2004) High-resolution transthoracic real-time three-dimensional echocardiography: quantitation of cardiac volumes and function using semi-automatic border detection and comparison with cardiac magnetic resonance imaging. J Am Coll Cardiol 43(11):2083–2090
Leibundgut G, Rohner A, Grize L, Bernheim A, Kessel-Schaefer A, Bremerich J et al (2010) Dynamic assessment of right ventricular volumes and function by real-time three-dimensional echocardiography: a comparison study with magnetic resonance imaging in 100 adult patients. J Am Soc Echocardiogr 23(2):116–126
Li Y, Wang Y, Zhai Z, Guo X, Yang Y, Lu X (2015) Real-time three-dimensional echocardiography to assess right ventricle function in patients with pulmonary hypertension. PLoS ONE 10(6):e0129557
Macron L, Lim P, Bensaid A, Nahum J, Dussault C, Mitchell-Heggs L et al (2010) Single-beat versus multibeat real-time 3D echocardiography for assessing left ventricular volumes and ejection fraction: a comparison study with cardiac magnetic resonance. Circ Cardiovasc Imaging 3(4):450–455
Moceri P, Doyen D, Bertora D, Cerboni P, Ferrari E, Gibelin P (2012) Real time three-dimensional echocardiographic assessment of left ventricular function in heart failure patients: underestimation of left ventricular volume increases with the degree of dilatation. Echocardiography 29(8):970–977
Oe H, Hozumi T, Arai K, Matsumura Y, Negishi K, Sugioka K et al (2005) Comparison of accurate measurement of left ventricular mass in patients with hypertrophied hearts by real-time three-dimensional echocardiography versus magnetic resonance imaging. Am J Cardiol 95(10):1263–1267
Shibayama K, Watanabe H, Iguchi N, Sasaki S, Mahara K, Umemura J et al (2013) Evaluation of automated measurement of left ventricular volume by novel real-time 3-dimensional echocardiographic system: Validation with cardiac magnetic resonance imaging and 2-dimensional echocardiography. J Cardiol 61(4):281–288
Qi X, Cogar B, Hsiung MC, Nanda NC, Miller AP, Yelamanchili P et al (2007) Live/real time three-dimensional transthoracic echocardiographic assessment of left ventricular volumes, ejection fraction, and mass compared with magnetic resonance imaging. Echocardiography 24(2):166–173
Squeri A, Censi S, Reverberi C, Gaibazzi N, Baldelli M, Binno SM et al (2017) Three-dimensional echocardiography in various types of heart disease: a comparison study of magnetic resonance imaging and 64-slice computed tomography in a real-world population. J Echocardiogr 15(1):18–26
Jenkins C, Bricknell K, Hanekom L, Marwick TH (2004) Reproducibility and accuracy of echocardiographic measurements of left ventricular parameters using real-time three-dimensional echocardiography. J Am Coll Cardiol 44(4):878–886
Wood PW, Choy JB, Nanda NC, Becher H (2014) Left ventricular ejection fraction and volumes: it depends on the imaging method. Echocardiography 31(1):87–100
Rigolli M, Anandabaskaran S, Christiansen JP, Whalley GA (2016) Bias associated with left ventricular quantification by multimodality imaging: a systematic review and meta-analysis. Open Heart 3(1):e000388
Shimada YJ, Shiota T (2012) Underestimation of left atrial volume by three-dimensional echocardiography validated by magnetic resonance imaging: a meta-analysis and investigation of the source of bias. Echocardiography 29(4):385-390. https://doi.org/10.1111/j.1540-8175.2011.01593.x
Kitzman DW (2000) Normal age-related changes in the heart: relevance to echocardiography in the elderly. Am J Geriatr Cardiol 9(6):311–320
Kou S, Caballero L, Dulgheru R, Voilliot D, De Sousa C, Kacharava G et al (2014) Echocardiographic reference ranges for normal cardiac chamber size: results from the NORRE study. Eur Heart J Cardiovasc Imaging 15(6):680–690
Siadecki S, Frasure S, Saul T, Lewiss R (2015) 2089557 High body mass index is strongly correlated with decreased image quality in focused bedside echocardiography. Ultrasound Med Biol 41:S34
Funding
Open Access funding enabled and organized by CAUL and its Member Institutions.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
There is no conflict of interests for this study.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Dissabandara, T., Lin, K., Forwood, M. et al. Validating real-time three-dimensional echocardiography against cardiac magnetic resonance, for the determination of ventricular mass, volume and ejection fraction: a meta-analysis. Clin Res Cardiol 113, 367–392 (2024). https://doi.org/10.1007/s00392-023-02204-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00392-023-02204-5
Keywords
- Cardiac magnetic resonance (CMR)
- Echocardiography
- Left ventricular ejection fraction
- Right ventricular ejection fraction
- Left ventricular end-systolic volume (LVESV)
- Left ventricular end-diastolic volume (LVEDV)
- Left ventricular mass (LVM)
- Right ventricular end-systolic volume (RVESV)
- Right ventricular end-diastolic volume (RVEDV)