The purpose of this study was to investigate whether the lesion risk score provided by an AI system is influenced by the selection of exposure parameters. A breast phantom which contains a lesion, was imaged with digital mammography with different imaging conditions. The tube voltage, the dose level and the anode-filter combination were varied based on an exposure obtained with automatic exposure control. The organ dose for each image was extracted from the DICOM header. The images were analyzed with an AI system, which provided a lesion risk score (suspicion for malignancy) for each exposure condition. Correlations between the lesion risk score and the exposure conditions were investigated. The results of the study showed that the organ dose had a strong impact on the lesion risk score. Reducing the organ dose to a low level resulted in that the AI system no longer detected the lesion. Images of suboptimal quality may result in inaccurate AI system performance. In our preliminary analysis, the breast phantom and the lesion were proven to be realistic enough for being analyzed by the AI system.
Fernando Cossío, Haiko Schurz, Mathias Engström, Carl Barck-Holst, Apostolia Tsirikoglou, Claes Lundström, Håkan Gustafsson, Kevin Smith, Sophia Zackrisson, Fredrik Strand
PurposeMultiple vendors are currently offering artificial intelligence (AI) computer-aided systems for triage detection, diagnosis, and risk prediction of breast cancer based on screening mammography. There is an imminent need to establish validation platforms that enable fair and transparent testing of these systems against external data.ApproachWe developed validation of artificial intelligence for breast imaging (VAI-B), a platform for independent validation of AI algorithms in breast imaging. The platform is a hybrid solution, with one part implemented in the cloud and another in an on-premises environment at Karolinska Institute. Cloud services provide the flexibility of scaling the computing power during inference time, while secure on-premises clinical data storage preserves their privacy. A MongoDB database and a python package were developed to store and manage the data on-premises. VAI-B requires four data components: radiological images, AI inferences, radiologist assessments, and cancer outcomes.ResultsTo pilot test VAI-B, we defined a case-control population based on 8080 patients diagnosed with breast cancer and 36,339 healthy women based on the Swedish national quality registry for breast cancer. Images and radiological assessments from more than 100,000 mammography examinations were extracted from hospitals in three regions of Sweden. The images were processed by AI systems from three vendors in a virtual private cloud to produce abnormality scores related to signs of cancer in the images. A total of 105,706 examinations have been processed and stored in the database.ConclusionsWe have created a platform that will allow downstream evaluation of AI systems for breast cancer detection, which enables faster development cycles for participating vendors and safer AI adoption for participating hospitals. The platform was designed to be scalable and ready to be expanded should a new vendor want to evaluate their system or should a new hospital wish to obtain an evaluation of different AI systems on their images.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.