Skip to main content
Download PDF

The concordance in lesion detection and characteristics between the Anatomical Intelligence and conventional breast ultrasound Scan method

BMC Medical Imaging volume 21, Article number: 102 (2021) Cite this article

Abstract

Background

The aim of this study was to investigate the concordance in lesion detection, between conventional Handhold Ultrasound (HHUS) and The Anatomical Intelligence for Breast ultrasound scan method.

Result

The AI-breast showed the absolute agreement between the resident and an experienced breast radiologist. The ICC for the scan time, number, clockface location, distance to the nipple, largest diameter and mean diameter of the lesion obtained by a resident and an experienced breast radiologist were 0.7642, 0.7692, 0.8651, 0.8436, 0.7502, 0.8885, respectively. The ICC of the both practitioners of AI-breast were 0.7971, 0.7843, 0.9283, 0.8748, 0.7248, 0.8163, respectively. The k value of Anatomical Intelligence breast between experienced breast radiologist and resident in these image characteristics of boundary, morphology, aspect ratio, internal echo, and BI-RADS assessment were 0.7424, 0.7217, 0.6741, 0.6419, 0.6241, respectively. The k value of the two readers of AI-breast were 0.6531, 0.6762, 0.6439, 0.6137, 0.5981, respectively.

Conclusion

The anatomical intelligent breast US scanning method has excellent reproducibility in recording the lesion location and the distance from the nipple, which may be utilized in the lesions surveillance in the future.

Peer Review reports

Introduction

Breast cancer is one of the most common malignant tumors for women, accounting for 30% of all newly diagnosed cancers in women [1]. Various methods are routinely used for breast cancer screening, such as Mammography, Magnetic Resonance Imaging (MRI), Digital Breast Tomosynthesis (DBT), and Ultrasound (US) [2,3,4,5]. Multiple studies have determined that the mammography is the most commonly used method for breast cancer. Nonetheless, the mammography sensitivity decreases in dense breasts due to tissue overlapping. However, mammography is likely to detect multifocal or multicentric cancers [6, 7]. DBT as a complementary technique, may increase the mammography sensitivity, especially in dense breasts. Moreover, DBT is extraordinary susceptible to architectural distortion and speculation. Handheld Ultrasound (HHUS) has always been an attractive supplement to other imaging modalities among breast cancer patients. Distinct advantages of HHUS include wide availability and accessibility, it is a noninvasive, quick, highly sensitive procedure. Furthermore, it is suitable for women with dense breasts [8]. The obvious ultrasound disadvantage is that image quality and interpretation depends dramatically on the scanning experience [9, 10].

Automated breast volume scanner (ABVS) was initially designed to remove the operator dependency [11, 12]. After image acquisition and reconstruction, a physician is in position to make a diagnosis from the stored images in the workstation any time after the ABUS examination [13], which is also able to automatically annotate detected lesions. However, ABVS is more expensive compared to HHUS [14]. Furthermore, it takes longer than HHUS, which requires a trained medical technologist to scan the whole breast for 20 min [15]. Therefore, HHUS is more suitable for clinical practice in the Chinese general population.

Anatomical Intelligence for Breast (AI breast) is a new procedure using Philips EPIQ 7 Evolution 4.0 ultrasound system. It consists of eL18-4 with embedded sensors, tabletop Field Generator, and mattress, information of position and orientation can be translated and displayed through live on-screen for visual mapping during the examination. While performing a regular breast ultrasound examination, it is not necessary to use a body marker or to manually apply annotations for each image capture. Images are stored while performing sweeps, and critical images can be bookmarked for review. Clinical findings can be auto-annotated, and quick orthogonal views of anatomy can be easily retrieved.

The purpose of this study was to explore the consistency between this scanning technique and the conventional ultrasound scan technique considering the detection and diagnosis of breast lesions.

Materials and methods

Patient population

From December 2018 to June 2019, a total of 73 patients with breast lesions were enrolled in this study (Fig. 1), considering that all patients have at least three US-depicted breast lesions at prior breast imaging within a week. All patients underwent HHUS examination by an experienced radiologist (ML). Then all patients underwent AI breast ultrasound examination by a resident physician (JL) and another physician with 5-year experience (BT), respectively. All patients were women between the ages of 20 and 67 (mean 42.6 ± 12.3y). This study was approved by the Institutional Review Board and Ethics Committee of XXX. All patients provided signed informed consent before the examination.

Fig. 1
figure 1

Flowchart of the study

Full size image

Equipment

The conventional scan technique and the AI breast scan technique for ultrasound examination was performed using a Philips EPIQ 7 ultrasound system (Philips Medical Systems, Bothell, WA, USA). A 4–18 MHz transducer probe was used for the conventional US, and a 4–18 MHz linear array ultra-broadband transducer with EM tracking was used for the AI breast scan procedure. Tabletop Field Generator and mattress were used for EM tracking.

Procedure

Conventional HHUS scan procedure

First, all patients underwent the conventional gray-scale US examination of the breast by an experienced radiologist, who was equipped with over 25 years of experience in breast ultrasound. Patients maintained a supine position and kept arms upward and outward. Investigators were instructed to begin scanning the right breast in a clockwise manner using the lateral and sagittal directions. The characteristics of the lesions were then recorded in line with the demand. In this study, these results assessed by the HHUS were defined as the gold standard (reference standard) as reference with the proposed experimental method. All patients were subsequently examined by wielding AI-breast after obtaining written informed consent.

AI breast US scan procedure

Each patient underwent AI breast ultrasound examination on the same day by a resident physician and another radiologist with 5 years’ experience, respectively.

Patients maintained a supine position and kept arms upward and outward. Before scanning, the doctor started from the nipple to ensure that the transducer mark on the breast graphic on the screen was displayed correctly. Before acquiring an image, a quick check was performed to verify that the transducer marker display corresponded to the physical location of the transducer on the breast. When scanning the breast, the transducer on the screen display moves with the scanning hand, keeping the focus on the patient during the scanning process and displaying the image on the screen. When a cine loop is acquired, AI Breast automatically displays and records the transducer position and orientation for each acquisition, and dynamically indicates areas of the breast scanned during the exam, as indicated by the Sweep Graphic. The breast tissue on-screen was assigned a color to demonstrate that it has been scanned in one direction, then assigned a different color once scanned in the opposite plane. (Fig. 2). The characteristics of the lesions were then recorded according to the demand.

Fig. 2
figure 2

AI breast ultrasound scan method. A -patient maintained a supine position; B- and C- transducer marker verification on the on-screen breast graphic; D- image acquisition

Full size image

During the convention and AI-breast examinations, when lesions are found, the number, the location (clockwise location and distance from the nipple), size (largest diameter and mean diameter), and image characteristics (boundary, morphology, aspect ratio and internal echo) of the lesions are recorded. Ultimately, the diagnosis is made according to the American college of radiology breast imaging reporting and data system, ACR BI-RADS. If the lesions were complex and different, classification diagnosis were considered. The participant recorded the entire scanning time of each patient.

All lesions of BI-RADS 3 were removed by mammotomy biopsy system. Simultaneously, biopsies were performed on all lesions of BI-RADS 4–5.

Statistical analysis

All data were collected and processed with SPSS 13.0 software (SPSS Inc., Chicago, IL, USA). The enumeration data were statistically analyzed using Chi-square test. Intraclass correlation coefficients (ICCs) have been used to measure agreement on lesion size and location. For the interpretation of κ-values, we made use of the magnitude guidelines published by Landis and Koch, who characterized the values of κ < 0 as indicating no agreement, κ 0–0.20 slight, κ 0.21–0.40 fair, κ 0.41–0.60 moderate, κ 0.61–0.80 substantial, and κ 0.81–1 as almost perfect agreement [13]. The statistical analysis on the extent of agreement between the two raters was based on Cohen's Kappa test. ICCs were calculated for continuous variables. κ statistics were used for measuring agreement on lesion features and final assessments compared with the consensus.

Results

Baseline characteristics of the patients

A total of 73 patients were enrolled in this study. 326 lesions were detected by conventional HHUS with a maximum diameter between 4 and 25 mm (mean 8.4 ± 0.78 mm). 299 lesions were detected by a resident physician using AI breast scanning. While 309 lesions were examined by a physician with 5 years experiences using AI breast scanning. A total of 295 lesions (Fig. 3) with a maximum diameter of 2-27 mm and an average diameter (average value of 7.2 ± 0.98 mm). There were 36 lesions classified into BI-RADs 4–5, all of which obtained pathological results by biopsy. All lesions of BI-RADS 3 were excised by mammotomy biopsy system. The remaining lesions classified into BI-RADs 2 were all continuously followed up.

Fig. 3
figure 3

A 45-year-old women presents with eight lesions in the left breast. The number of the breast markers in the left breast and the eight lesions of the left breast

Full size image

In this study, the ICC between conventional US scan procedure and AI breast US scan procedure in scan time, number, location (clock face location; distance to the nipple), and size (largest diameter; mean diameter) was 0.7642, 0.7692, 0.8651, 0.8436, 0.7502, 0.8885, respectively. The ICC values between reader 1 and reader 2 for scan time, number, location (clock face location; distance to the nipple), and size (largest diameter; mean diameter) in AI breast US scan procedure were 0.7971, 0.7843, 0.9283, 0.8748, 0.8248, 0.8163, respectively. A more detailed breakdown of the concordance between both applications is showed in Table 1.

Table 1 Tabulated values for both scanning methods for the scan time, number, location, and size
Full size table

In this study, the image characteristics of the two scanning methods between the two readers with AI breast scan procedure including boundary, morphology, aspect ratio, and internal echo, are described in Table 2. The Kappa value for image characteristics between conventional US scan method and AI breast US scan method was also shown in Table 2. The ICC between conventional US scan procedure and AI breast US scan procedure in the distinct BI-RADS category in the ABVS examination is also given in Table 2.

Table 2 Tabulated values for the image characteristics for both investigated scanning methods
Full size table

Discussion

Early diagnosis of breast cancer possesses a profound clinical significance in improving the survival rate while reducing the rate of mortality [9, 16]. Ultrasound is one of the commonly used methods for imaging breast lesions [17]. It is convenient, radiation-free and effectively identifies benign and malignant breast lesions [18]. Yet, it is generally necessary to adjust the scanning pressure, focus area and gain in real time to properly analyze the characteristics of the lesion. Meanwhile, the examination of ultrasonography relies on the physician experience and is prone to lead to a missed diagnosis. Furthermore, diagnosing a mass less than 1 cm3 is laborious. AI breast is the innovative function of the new generation eL18-4 probe, which can mark the scanning range, automatically identifying the lesion location, improving the ability to locate nodules.

In this study, a substantial agreement for the scan time in two methods (ICC = 0.7642) was found. The average time to complete a bilateral whole-breast US examination between the three readers was 6.663, 7.686 and 6.083, which cannot generate a clinical report immediately. Scan time correlates with the number of lesions. Simultaneously, there was a substantial agreement for the scan time description between the two readers using AI-breast scan method (ICC = 0.7971). The scan time agreement for the two readers using AI breast US is higher than conventional US method, meaning that the AI breast US helps save time, improving departmental efficiency and integrating into the workflow in a busy breast imaging center using virtual mapping.

The substantial agreement for the number of nodules (ICC = 0.7692) between HHUS and AI-breast is valid. Meanwhile, substantial agreement for the number of nodules description between the two readers of AI-breast (ICC = 0.7843) was observed. In this study, we found a substantial moderate consistency was observed between HHUS and AI breast for more than 6 nodules and a substantial consistency between the two readers for AI breast. In the group with more than 10 nodules, AI breast US procedure identified more nodules. This is because, when the number of nodules higher than 6 it is difficult, even for experienced radiologist, to label each nodule using conventional ultrasound. Moreover, AI breast US can mark a lesion in real time in the energetic body to avoid this complication. Radiologists may also miss some breast tissue. While the AI breast US procedure is assigned a color to demonstrate it has been scanned in one direction on-screen, then assigned a different color once scanned in the opposite plane. This helps reduce the operational dependency and subjectivity during exams.

In this study, we also summarized an perfect conclusion for the location of nodules, including clock face location, and distance to the nipple between a resident physician and an experienced radiologist. There was a uniformly perfect agreement for the clock face location, and distance to the nipple between the two readers using the AI breast procedure. This difference between the AI breast two readers is consistent with the coherence between HHUS and AI-breast, where the latter can auto-annotate the lesion with the position and distance from the nipple for the resident physician, allowing for the elimination of labeling errors and enhance reproducibility. This is particularly valuable for the current diagnostic and follow-up examinations when multiple lesions are present.

Breast cancer diagnosis using ultrasound is based on the image features. In this study, a substantial agreement was observed for the lesion features such as boundary, morphology, aspect ratio, and internal echo (k of 0.7424, 0.7217, 0.6741, 0.6419) between both methods. Moreover, substantial agreement between the two readers of AI breast was observed for the same lesion features (k of 0.6531, 0.6762, 0.6439, 0.6137) were similarly moderated. The k value for both methods conveyed consistent results probably due to simple identification in view of a standard acquisition of lesion in AI breast US by resident physicians. AI Breast is capable of not only recording the transducer position and orientation for each acquired lesion, but it can dynamically indicate areas of the breast scanned after the examination.

Based on the comprehensive description of the images above, the consistency evaluation (Kappa) of BI-RADS classification group for lesions by the radiologist and resident physicians connecting AI breast US scan with conventional US scan method was performed. We found a moderate agreement on lesion management, with a k of 0.6241 for BI-RADS final assessments between the two methods and the two readers of AI breast. Previous studies have also reported a moderate agreement in breast US with mammography. This may be because the AI breast US cannot automatically assess the final BI-RADS category. At same time, it was confirmed that the method has excellent repeatability and could reduce the operational dependency and subjectivity during examinations to avoid missed diagnosis.

There were several limitations in our study, such as the long-term follow-up data on the prognoses of these patients, which are still required. Ample and multicenter studies stemming from this study may provide further information for a larger number of patients. Furthermore, the images may be affected by uncertainties and inaccuracies for requiring specific fuzzy image pre-processing steps [19,20,21,22].

In summary, AI breast US is less operator-dependent due to the precise documentation of lesion location and distance from the nipple and annotation. In the future, the scanning method can be used to monitor benign lesions since the operator can perform AI breast US examination without identifying the lesion.

Availability of data and materials

The datasets used and analysed during the current study available from the corresponding author on reasonable request.

References

  1. DeSantis CE, Ma J, Gaudet MM, et al. Breast cancer statistics, 2019. CA Cancer J Clin. 2019;69(6):438–51.

    Article  Google Scholar 

  2. Goto M, Le Bihan D, Yoshida M, et al. Adding a model-free diffusion MRI marker to BI-RADS assessment improves specificity for diagnosing breast lesions. Radiology. 2019;292(1):84–93.

    Article  Google Scholar 

  3. Ha SM, Cha JH, Shin HJ, et al. Mammography, US, and MRI to assess outcomes of invasive breast cancer with extensive intraductal component: a matched cohort study. Radiology. 2019;292(2):299–308.

    Article  Google Scholar 

  4. Lee JM, Arao RF, Sprague BL, et al. Performance of screening ultrasonography as an adjunct to screening mammography in women across the spectrum of breast cancer risk. JAMA Intern Med. 2019;179(5):658–67.

    Article  Google Scholar 

  5. Mann RM, Cho N, Moy L. Breast MRI: state of the art. Radiology. 2019;292(3):520–36.

    Article  Google Scholar 

  6. Philpotts LE. Density variation among mammographic modalities will likely impact imaging management and risk stratification. Radiology. 2019;291(2):328–9.

    Article  Google Scholar 

  7. Yala A, Lehman C, Schuster T, Portnoi T, Barzilay R. A deep learning mammography-based model for improved breast cancer risk prediction. Radiology. 2019;292(1):60–6.

    Article  Google Scholar 

  8. O’Flynn EAM, Fromageau J, Ledger AE, et al. Ultrasound tomography evaluation of breast density: a comparison with noncontrast magnetic resonance imaging. Invest Radiol. 2017;52(6):343–8.

    Article  Google Scholar 

  9. Berg WA, Bandos AI, Mendelson EB, et al. Ultrasound as the primary screening test for breast cancer: analysis from ACRIN 6666. J Natl Cancer Inst. 2016;108(4), djv367.

  10. Sadeghi-Naini A, Papanicolau N, Falou O, et al. Quantitative ultrasound evaluation of tumor cell death response in locally advanced breast cancer patients receiving chemotherapy. Clin Cancer Res. 2013;19(8):2163–74.

    CAS  Article  Google Scholar 

  11. Shin HJ, Kim HH, Cha JH, et al. Automated ultrasound of the breast for diagnosis: interobserver agreement on lesion detection and characterization. AJR Am J Roentgenol. 2011;197(3):747–54.

    Article  Google Scholar 

  12. Xu C, Wei S, Xie Y, et al. Combined use of the automated breast volume scanner and the US elastography for the differentiation of benign from malignant lesions of the breast. BMC Cancer. 2014;14(1):798.

    Article  Google Scholar 

  13. Nakano S, Yoshida M, Fujii K, et al. Real-time virtual sonography, a coordinated sonography and MRI system that uses magnetic navigation, improves the sonographic identification of enhancing lesions on breast MRI. Ultrasound Med Biol. 2012;38(1):42–9.

    Article  Google Scholar 

  14. Isabelle LCF, Christine G, Martine B, et al. Mammography and subsequent whole-breast sonography of nonpalpable breast cancers: the importance of radiologic breast density. AJR. 2003;2003(180):1675–1679.

  15. Huang CS, Yang YW, Chen RT, et al. Whole-breast ultrasound for breast screening and archiving. Ultrasound Med Biol. 2017;43(5):926–33.

    Article  Google Scholar 

  16. Killelea BK, Long JB, Chagpar AB, et al. Evolution of breast cancer screening in the Medicare population: clinical and economic implications. J Natl Cancer Inst. 2014;106(8).

  17. Jefferson TC. Ultrasound may markedly improve cancer detection in dense breasts. JAMA. 1999;281(4):311–2.

    CAS  Article  Google Scholar 

  18. Sickles EA, Filly RA, Callen PW. Benign breast lesions: ultrasound detection and diagnosis. Radiology. 1984;151(2):467–70.

    CAS  Article  Google Scholar 

  19. Versaci M, Morabito F C, Angiulli G. Adaptive image contrast enhancement by computing distances into a 4-dimensional fuzzy unit hypercube. IEEE Access, 2017, PP(99):1.

  20. Togacar M, Ergen B, Cmert Z. COVID-19 detection using deep learning models to exploit social mimic optimization and structured chest X-ray images using fuzzy color and stacking approaches. Comput Biol Med, 2020:103805.

  21. Versaci M, Morabito FC. Image edge detection: a new approach based on fuzzy entropy and fuzzy divergence. Int J Fuzzy Syst, 2021:1–19.

  22. Orujov F, Maskeliunas R, Damasevicius R, et al. Fuzzy based image edge detection algorithm for blood vessel detection in retinal images. Appl Soft Comput, 2020.

Download references

Acknowledgements

The authors would like to express their gratitude to EditSprings (https://www.editsprings.com/) for the expert linguistic services provided.

Funding

This study is funding by Sichuan Provincial Health Commission (17ZD039).

Author information

Author notes

  1. Juan Li and Hao Wang have contributed equally to this work

Authors and Affiliations

  1. Ultrasound Medical Center, Sichuan Cancer Hospital Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No. 55, Section 4, South Renmin Road, Chengdu, China

    Juan Li, Lu Wang, Ting Wei, Minggang Wu, Tingting Li, Jifen Liao, Bo Tan & Man Lu

  2. Breast Surgeons Center, Sichuan Cancer Hospital Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No. 55, Section 4, South Renmin Road, Chengdu, China

    Hao Wang

Authors
  1. Juan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lu Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ting Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Minggang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tingting Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jifen Liao
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Bo Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Man Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

ML designed and organized this study; JL, HW and LW, TW summarized and analyzed the multicenter data and wrote the manuscript; MW and JL prepared Figs. 1–3 and recorded the data. All authors reviewed the manuscript.

Corresponding author

Correspondence to Man Lu.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Institutional Review Board and Ethics Committee of Sichuan Cancer Hospital. All patients provided signed informed consent before the examination. All methods were performed in accordance with the relevant guidelines and regulations.

Consent for publication

All authors consent for the publication of this article.

Competing interests

The authors declare that there is no conflict of interest regarding the publication of this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Li, J., Wang, H., Wang, L. et al. The concordance in lesion detection and characteristics between the Anatomical Intelligence and conventional breast ultrasound Scan method. BMC Med Imaging 21, 102 (2021). https://doi.org/10.1186/s12880-021-00628-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12880-021-00628-x

Keywords

  • Breast
  • Ultrasound
  • Breast imaging reporting and data system
  • Anatomical intelligence breast

BMC Medical Imaging

ISSN: 1471-2342

Contact us