Abstract
Background
Anti-radial ultrasound scanning is one of the main scanning approaches used in ultrasound breast screening. It can be used for cross-sectional imaging of mammary ductal/lobular tissue and provide information about suspicious tissue. It has certain advantages compared to linear scanning, but automatic anti-radial scanning is not yet available. Our goal is to propose an ultrasound scanning system for whole breast anti-radial scanning.
Methods
We previously developed an automatic ultrasound scanning system for whole breast screening involving linear scanning. The present study builds on our previous work by incorporating (1) surface-reconstruction algorithms, (2) a rotatable holder design, and (3) a scan-path-smoothing algorithm to achieve conformal anti-radial scanning.
Results
An improvement of approximately 40% in the normal-vector estimation is obtained with our new method, and the scan stability is improved by the scan-path-smoothing algorithm. 3D volume data of each scan are available.
Conclusions
We have successfully developed an automatic ultrasound scanning system for anti-radial breast scanning. This type of system, which has not been reported previously in the literature, can be an effective tool for fully automatic ultrasound breast screening.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Ultrasound is an important imaging modality for breast screening due to several advantages. For example, it is noninvasive, free of ionizing radiation, and can be performed in real time. In addition, it has good contrast compared to mammograms in dense breast [1,2,3,4,5,6]. Clinically, three hand-held scanning approaches are commonly used: linear (also called raster), radial, and anti-radial scanning [7]. The linear scan is the most common way to obtain the sagittal and transverse planes of the breast. Nonetheless, the cross-sectional plane of the mammary duct, which is clinically important, is also important and should be obtained by using anti-radial scanning [7,8,9,10].
Since whole breast ultrasound screening is performed manually by radiologists and sonographers, the obtained results are highly dependent on the experience of the operators. To reduce the influence of human factors in ultrasound examinations, robot-assisted systems have been designed [11,12,13,14]. Automated breast ultrasound screening (ABUS) and automated whole breast ultrasound (AWBU) [15] are robotic medical systems that are specified designed for breast screening. Based on the system designs, breast ultrasound can be performed either semiautomatically or guided by a moving structure. On contrast to ABUS and AWBU, the iVu system [16] was developed for breast screening using radial scanning. Despite the importance of fitting the body shape, none of the existing systems focus on an adaptive scan path: a predetermined curved scan pattern is chosen by ABUS and iVu, and the orientation of the transducer in AWBU is handled and guided by the operator. The functionality of the available commercialized systems for breast screening is limited by these predetermined scan trajectories.
1.1 Goals of This Study
To the best of our knowledge, only linear and radial scanning products are available commercially. Here we propose an ultrasound scanning system to achieve anti-radial scanning for whole breast screening. Previously we have developed a conformal ultrasound scanning system for linear scanning only. The system setup is shown in Fig. 1, and details about the operation of the developed system are available elsewhere [17]. In brief, the system enables the generation of a scanning path for each individual examinee based on the spatial information sensed by a 3D camera, and a robotic arm with six degrees of freedom is used to perform conformal whole breast scanning. A customized transducer holder was designed for connecting the robotic arm and the ultrasound transducer of a portable ultrasound scanning system. The present study focused on achieving anti-radial breast scanning by (1) modifying the existing algorithms and (2) improving the design of the transducer holder. In addition, we generated the corresponding 3D volume data for each individual scan.
2 Materials and Methods
A newly designed transducer holder was introduced, and the surface reconstruction and scan-path-smoothing algorithms were proposed for better approximating the target surface and to improve the scan stability, respectively. The new system allows the 3D volume of the scanned ultrasound images to be generated. The system performance was evaluated both using simulations and by scanning a breast phantom.
2.1 Rotatable Transducer Holder for Anti-radial Scanning
The transducer holder designed in the previous study could only perform linear scanning, and using the existing setup for other types of scan would damage the instruments, such as bending the wires of the transducer. Here we propose a modified rotatable transducer holder design consisting of a stepping motor (Faulhaber, Schönaich, Germany), aluminum supports, a rotating structure, and connector made by a 3D printer, as shown in Fig. 2. The operating orientation of the transducer is maintained by the rotating structure and the stepping motor. The resolution of the stepping motor is 1.8°, which is sufficient to match the system’s design criteria. Movement of the rotating structure is handled by a bearing (THK, Tokyo, Japan) with an inner radius of 80 mm. Cooperation between the stepping motor and rotating structure allows the scanning transducer to rotate ± 90°.
2.2 Breast Phantom
A breast phantom (CIRS Model 052A, Norfolk, VA, US) designed to mimic the shape of the breast and the properties of amorphous lesions was used to evaluate the performance of the proposed system both using simulations and by scanning a breast phantom.
2.3 Algorithms
In our previous work we employed temporal median/mean filters to reduce the noise level of the 3D camera. The corresponding normal vector (estimated by principal-components analysis) and linear scan path (based on the desired conditions) were generated based on the detected surface. However, the effects of noise could not be effectively reduced, and the estimated normal vector exhibited a standard deviation of ~ 1.8° to 6.4°, which resulted in unnecessary movement of the robotic arm during scanning.
Algorithm development in the present study focused on (1) improving the scanning stability by using a better surface smoothing/approximation method, (2) generating the anti-radial scan path adapted to the target surface, and (3) visualizing the scan result with 3D volume data.
3 Spatial Data Smoothing for Target Surface Reconstruction
This study employed a combination of two smoothing methods (a bilateral filter and 2D B-spline) for mitigating the spatial error of the 3D camera [18]. Generally, a bilateral filter is a modified Gaussian filter that uses the difference in distance and pixel intensity as weights. In our approach, the pixel intensity represents the distance measured by the 3D camera, and the bilateral filter can be expressed by
where w is the window size, I and Is represent the distances of the measured and processed values, respectively, and Gs and Gi are Gaussian weightings, which can be calculated by the Gaussian distribution with standard deviations σs and σi, respectively. A B-spline is a curve-smoothing algorithm that can be modeled by the Knot vector (V), controls (P), and kth-order basis functions. The Knot vector is a sequential set of values from 0 to the number of outputs:
The kth order basis function, Ni,k, can be defined recursively:
The B-spline curve and kth-order basis function can be defined as follows:
The 2D B-spline (B-spline surface) can be defined with parameters (u, v) with n + 1 and m + 1 control points as follows:
In this study we used a bilateral filter to address the noise issue, and a 2D B-spline was used to estimate the pixel values that could not be precisely detected.
4 Principal Component Analysis for Normal-Vector Estimation
The ultrasound transducer should remain perpendicular to the target surface during automatic scanning. This study used principle-components analysis to estimate the normal vectors of the surface. With the target coordinate (Ptarget = [xtarget, ytarget, ztarget]) on the surface, the corresponding normal vector can be derived based on the surrounding coordinates (Pi = [xi, yi, zi]). The n × 3 matrix, PCA, can be obtained by subtracting Ptarget from Pi- as shown below:
Then, square matrix M can be derived as
After computing the eigenvalues and eigenvectors of M, the first two eigenvectors can be used to span the target surface, and the corresponding normal vector can be generated by the cross product of the two eigenvectors. Figure 3 illustrates the relationships between the target coordinate, the surrounding coordinates, and the eigenvalues and eigenvectors.
5 Generation of the Anti-radial Scan Path
The desired scanning region was selected manually before processing, and then the center of the selected scanning region could be obtained. The anti-radial scan begins in the horizontal direction. The orientation of each following scan is increased by an angle offset, θ. The contact angles, based on the reconstructed surface, were obtained by principle-components analysis. The development of the anti-radial scan path is shown in Fig. 4. In an anti-radial scan, moving across the cross-center can minimize the total scan time and the overall required movement.
6 Model-Based Scan-Path Smoothing
To further improve the smoothness of the variance of the normal vectors on the scan path, we propose evaluating the normal vectors using the component ratio defined as
where nv denotes the normal vector [vx, vy, vz], nvi represents the x, y, and z components of nv, and the norm operation is \(\sqrt {v_{x}^{2} + v_{x}^{2} + v_{x}^{2} }\). A spherical surface was used to simulate the breast geometry. In addition, a straight path and the corresponding normal vectors represent the scan trajectory and the contact angle (Fig. 5a). The x, y, and z component ratios on the straight line are plotted in Fig. 5b, which indicates that both the x and y component ratios can be approximated by linear equations, and the z component can be approximated by a quadratic equation.
We used the least-squares error (LSE) to approximate both the linear and quadratic equations. As shown in Fig. 5b, the ratio components of x and y can be approximated by linear equations:
The error of each measured coordinate and error summation can be denoted as
To minimize the total error, partial differentiation is performed with respect to m and c:
and m and c can be solved through a matrix operation:
where the components of A and B can be obtained by
Then the values of m and c in Eq. 12 can be obtained using the following equation; in other words, the two curves (x and y) in Fig. 5b can be approximated:
As shown in Fig. 5b, the ratio component of z can be approximated by a quadratic equation:
The error of each measured coordinate and error summation can be denoted as follows:
To minimize the total error, partial differentiation is performed with respect to a, b, and c:
and a, b, and c can be solved using a matrix operation:
where the components of A and B can be obtained by
Then the values of a, b, and c in Eq. 20 can be obtained using the following equation; in other words, the z curve in Fig. 5b can be approximated:
With these approximations, the normal vector described in Eq. 11 can be expressed as follows:
7 3D Volume Data Reconstruction
The spatial information of each scanned ultrasound image is recorded during the conformal scan, which can be used to align the scan results. A mesh-grid volume data set is created for the reconstruction of volume data. Each pixel of the ultrasound image can be mapped onto the data expression grid, as shown in Fig. 6.
The coordinate expression of each pixel can be represented as
The intensity of each pixel is determined based on its eight surrounding nodes, and the intensity of each node can be obtained using the distance weighting sum:
8 Performance Evaluation Results
8.1 Surface Reconstruction
Two ideal surfaces (flat and spherical) with added random noise were used to simulate the surfaces captured by the 3D camera. The bilateral filter was modeled by w = 3, σs = 2, and σi = 1 (as defined in Eqs. 1 to 3). The 2D B-spline had an order of 3. The processed results were compared with the ideal surfaces. The mean squared error (MSE) and standard deviation were used to evaluate the coordinate differences between the reference and filtered surfaces. There was little improvement in the MSE (up to 4%), but the standard deviations of both surfaces were reduced substanti-ally (50–80%), and so fewer adjustments were needed to the position of the transducer while scanning. The comparisons are presented in more detail in Table 1 and Fig. 7.
8.2 Improvement in Normal-Vector Estimation
The normal vector was estimated using principle-components analysis and the cross product with the same surface conditions as mentioned above. The error in normal-vector estimation is defined by the angle difference between the reference and estimated normal vectors. Using principle-components analysis resulted in a higher accuracy and lower standard deviation than when using the cross product, with typically 35–40% improvement being achieved by processing with principle-components analysis. More details are presented in Table 2 and Fig. 7.
8.3 Model-Based Scan-Path-Smoothing Algorithm
The spatial-data-smoothing algorithm can successfully reduce the noise level of the reconstructed surface and the corresponding normal vector (as mentioned in Sect. 8.1), but the proposed model-based scan-path-smoothing algorithm aimed to further reduce unnecessary vibration caused associated with the standard deviation or angle error. The improvement obtained by using this algorithm was verified using both the simulated surface and actual data from the breast phantom. Figure 8a and c show the original normal vectors, while Fig. 8b and d display the smoothed normal vectors; these visualizations demonstrate that the estimated normal vector can be successfully smoothed.
8.4 Anti-radial Scanning and 3D Volume Data Reconstruction
Anti-radial scanning with 30 angle increments and a total of 6 scan paths was performed on the breast phantom. The scanning stability was improved when scanning a circular region with a radius of 50 mm at a scan speed of 5 mm/s. A total scan time of around 3.5 min was required in the current system setup. 3D volume data were generated based on the recorded spatial data. Figure 9a shows one of the six reconstructed 3D data volumes. To further verify the reconstructed results, one section of each reconstruction was chosen and compared with the actual ultrasound image of the breast phantom in Fig. 9b–m.
9 Discussion
We have successfully performed anti-radial scanning, improved the scan stability, and visualized the scan results in 3D volume representations using our modified system. However, there are some limitations that cannot be overcome using with the current prototype.
9.1 Limitations of the Current System Setup for Anti-radial Scanning
An additional rotation, as allowed by the modified transducer holder, minimized the requirement for a posture change in the anti-radial scan. Nonetheless, additional 100-mm and 250-mm extensions along the x- and z-axes were unavoidable because of the complexity of the holder design. Also, the effective scan region is restricted to within a circular region with a radius of less than 50 mm.
Choosing the appropriate scanning speed is important to obtain the optimal trade-off between the spatial resolution and the posture changes of the robot arm. By scanning at 5 mm/s, a spatial resolution of 0.67 mm can be obtained, but results in a processing time of around 3.5 min. Increasing the scan speed will reduce the scan accuracy (spatial resolution) and scan stability (due to larger changes in the posture of the robot arm). For processing at a higher scan speed, an ultrasound system with a higher frame acquisition rate (e.g., 100 fps) is suggested. On the other hand, processing with a smaller transducer holder can reduce the required posture changes of the robot arm while scanning. In addition, the algorithm for determining the scan region in anti-radial scanning was not addressed in this study due to the large variation between examinees. To avoid any improper determinations, manually selecting the scan region is suggested.
9.2 Performance of the Proposed Algorithms
The accuracy of our proposed method was tested using ideal flat and spherical surfaces. The results show that the proposed algorithm can reduce the standard deviation of the estimated error and improve the smoothness of the estimated normal vector. The proposed filter configuration (bilateral filter + 2D B-spline) reduced the estimated errors by 50%, which is the key point for smoothing the reconstructed surface. Based on the smoothed reconstructed surface, the principle-components analysis method can provide the estimated normal vector with a lower angle standard deviation (reduced from 2.51° to 1.51°, as indicated in Table 2). The reconstruction results also show that the proposed system can smoothly move across the breast phantom surface without unnecessary disturbances.
9.3 Deformation of the Breast Phantom
Due to deformation of the breast phantom, differences in the geometry between the reconstructed surface and the actual images are unavoidable. This deformation issue was alleviated in our study in two ways. First, our general setup includes a contact force sensor to make sure that the ultrasound transducer establishes good contact with the skin while avoiding applying an excessive force as often seen during manual scanning. In other words, our use of a force sensor minimized the deformation. Second, the image object (i.e., breast) can be easily confined and fixed during the scanning by using a large membrane covering the entire breast. This is already used in ABUS by applying a large transducer holder and a scanning frame on the breast. A similar scanning frame can also be used in our setup to avoid the deformation problem. The data presented in Tables 1 and 2 indicate the good accuracy (submillimeter) that can be achieved with our proposed approach.
10 Conclusions
This study developed a prototype of an automatic breast ultrasound screening system for anti-radial scanning. Such an automatic system is clinically important, and this is the first report of such a system in the literature. A modified transducer holder consisting of a stepping motor and rotating structure was designed to adjust the orientation of the transducer. The surface-model spatial-data-smoothing algorithm provided a better approximation of the target surface. The standard deviation of the surface reconstruction was effectively reduced (by 50–80%) in the simulations of flat and spherical surfaces, while an improvement of 35–40% in angle accuracy was also achieved. Our model-based scan-path-smoothing algorithm further optimized the suggested contact angle based on the shape of the breast, and this was verified in breast phantom scans. Six-direction anti-radial scanning was performed within a circular region (with a radius of 50 mm) of the breast phantom, and the overall processing time was approximately 3.5 min. The 3D volume reconstruction of each scan path was obtained, and the quality of the reconstruction was verified in comparisons of actual ultrasound images obtained from the breast phantom.
References
Kolb, T. M., Lichy, J., & Newhouse, J. H. (2002). Comparison of the performance of screening mammography, physical examination, and breast US and evaluation of factors that influence them: An analysis of 27,825 patient evaluations. Radiology, 225(1), 165–175. https://doi.org/10.1148/radiol.2251011667.
Benson, S. R. C., Blue, J., Judd, K., & Harman, J. E. (2004). Ultrasound is now better than mammography for the detection of invasive breast cancer. The American Journal of Surgery, 188(4), 381–385. https://doi.org/10.1016/j.amjsurg.2004.06.032.
Kaplan, S. S. (2001). Clinical utility of bilateral whole-breast US in the evaluation of women with dense breast tissue. Radiology, 221(3), 641–649. https://doi.org/10.1148/radiol.2213010364.
Kolb, T. M., Lichy, J., & Newhouse, J. H. (1998). Occult cancer in women with dense breasts: Detection with screening US—diagnostic yield and tumor characteristics. Radiology, 207(1), 191–199. https://doi.org/10.1148/radiology.207.1.9530316.
Leconte, I., Feger, C., Galant, C., Berlière, M., Berg, B. V., D’Hoore, W., et al. (2003). Mammography and subsequent whole-breast sonography of nonpalpable breast cancers: The importance of radiologic breast density. American Journal of Roentgenology, 180(6), 1675–1679. https://doi.org/10.2214/ajr.180.6.1801675.
Okello, J., Kisembo, H., Bugeza, S., & Galukande, M. (2014). Breast cancer detection using sonography in women with mammographically dense breasts. BMC Medical Imaging, 14, 41. https://doi.org/10.1186/s12880-014-0041-0.
Stavros, A. T., Rapp, C. L., & Parker, S. H. (2004). Breast ultrasound. Philadelphia: Lippincott Williams & Wilkins.
Dixon, A. M. (2008). Breast ultrasound HOW, WHY and WHEN (1st ed.). Amsterdam: Elsevier.
Henningsen, C., Kuntz, K., & Youngs, D. (2013). Clinical guide to sonography (2nd ed.). Amsterdam: Elsevier.
Madjar, H., Rickard, M., Jellins, J., & Otto, R. (1999). IBUS guidelines for the ultrasonic examination of the breast. European Journal of Ultrasound, 9(1), 99–102. https://doi.org/10.1016/S0929-8266(99)00016-6.
Abolmaesumi, P., Salcudean, S. E., Zhu, W.-H., Sirouspour, M. R., & DiMaio, S. P. (2002). Image-guided control of a robot for medical ultrasound. IEEE Transactions on Robotics and Automation, 18(1), 11–23. https://doi.org/10.1109/70.988970.
Janvier, M. A., Durand, L.-G., Cardinal, M.-H. R., Renaud, I., Chayer, B., Bigras, P., et al. (2008). Performance evaluation of a medical robotic 3D-ultrasound imaging system. Medical Image Analysis, 12(3), 275–290. https://doi.org/10.1016/j.media.2007.10.006.
Pierrot, F., Dombre, E., Dégoulange, E., Urbainb, L., Caron, P., Boudet, S., et al. (1999). Hippocrate: A safe robot arm for medical applications with force feedback. Medical Image Analysis, 3(3), 285–300. https://doi.org/10.1016/S1361-8415(99)80025-5.
Gonzales, A. V., Cinquin, P., Troccaz, J., Guerraz, A., Hennion, B., Pellissier, F., et al. (2001). TER: A system for robotic tele-echography. Medical image computing and computer-assisted intervention—MICCAI 2001: 4th International Conference Utrecht, The Netherlands, October 14–17, 2001 Proceedings (pp. 326–334). https://doi.org/10.1007/3-540-45468-3_39.
Kelly, K. M., Dean, J., Comulada, W. S., & Lee, S.-J. (2010). Breast cancer detection using automated whole breast ultrasound and mammography in radiographically dense breasts. European Radiology, 20(3), 734–742. https://doi.org/10.1007/s00330-009-1588-y.
Chang, R.-F., & Shen, Y.-W. (2013). 3D whole-breast ultrasonography (Citeseer).
Lee, C. Y., Truong, T. L., & Li, P. C. (2017). Automated conformal ultrasound scanning for breast screening. Journal of Medical and Biological Engineering, 38(1), 116–128. https://doi.org/10.1007/s40846-017-0292-7.
Nguyen, C. V., Izadi, S., & Lovell, D. modeling kinect sensor noise for improved 3D reconstruction and tracking. In Proceedings of the 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission, 2012 (pp. 524–530). 2415802: IEEE Computer Society. https://doi.org/10.1109/3dimpvt.2012.84.
Funding
This study was funded by Ministry of Science and Technology, Taiwan (MOST 103-2221-E-002-016-MY3).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed in the human scanning study were in accordance with the ethical standards of the institution.
Informed Consent
Informed consent was obtained from each participant included in the study.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Lee, CY., Li, PC. Automatic Conformal Anti-radial Ultrasound Scanning for Whole Breast Screening. J. Med. Biol. Eng. 39, 845–854 (2019). https://doi.org/10.1007/s40846-019-00483-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40846-019-00483-w