For Radiologists

Radiologists from all practice sizes, locations, and settings are involved in every aspect of ACR DSI’s work. They guide artificial intelligence (AI) development through participation on Data Science Subspecialty Panels, and they create annotated image data sets to help developers train and test algorithms for clinical integration. Radiologists also lead educational efforts and provide valuable perspectives through the institute’s dedicated blog and share information about AI in medical imaging with other physicians, patients, and associated stakeholders.

For Industry Partners

ACR DSI values its industry partners and works with them to inform development of clinically relevant AI algorithms around its use cases. In doing so, ACR DSI connects developers with radiology practices that have data sets for algorithm training and testing and provides opportunities for developers to validate their algorithms through the ACR Certify-AI program. ACR DSI maintains directories of the AI models built around its use cases and market availability of these models. ACR DSI also monitors algorithm effectiveness in clinical practice and uses ACR Assess-AI to provide developers with longitudinal algorithm performance data. This data can form the basis for meeting FDA post-market surveillance requirements and for adaptive learning of the algorithm.

For Developers

DSI operations are led by Senior Scientists and Data Science Subspecialty Panels composed of radiologists and experts with backgrounds in data science. Each panel prioritizes use cases according to those that yield the greatest clinical and operational value with attention to the degree to which problems are most amenable to AI solutions. A TOUCH-AI use case includes both an overview and the technical specifications of the clinically-relevant algorithm. TOUCH-AI assists developers by detailing critical content pertinent to an algorithm’s life cycle such as value proposition, common data elements, logical flow charts that inform decision support, and guidelines for annotations.

TOUCH-AI (Technically Oriented Use Cases for Healthcare AI)

Value Proposition: details the algorithm’s value and justification for an expedited review process to regulatory agencies

Common Data Elements: details the input and output variables of the algorithm in the clinical environment and the variables necessary for effective algorithm training

Care Pathways & Flow Charts: offer clinical guidance based on ACR, or other radiological society, criteria for condition classification, characterization, or management. These help developers understand the specific questions an algorithm should reliably address.

Annotation Guidance: guides annotating radiologists to create precise datasets for algorithm training