MONAI-based imaging pipelines Imaging
Building reproducible inference pipelines on Project MONAI for chest X-ray, CT, and MRI cohorts — segmentation, classification, and anomaly detection as upstream signals for downstream report generation.
An early-stage initiative exploring how Project MONAI, open-source large language models, and cloud-native infrastructure can deliver structured second-opinion radiology reports to assist clinicians.
Six intersecting questions at the boundary of medical imaging AI, large language models, and clinical decision support.
Building reproducible inference pipelines on Project MONAI for chest X-ray, CT, and MRI cohorts — segmentation, classification, and anomaly detection as upstream signals for downstream report generation.
Using open-source LLMs to convert structured imaging findings into clinician-readable second-opinion reports, with explicit grounding and uncertainty quantification.
Linking each generated finding back to the source slice, region of interest, and supporting literature — making AI-generated radiology reports auditable rather than opaque.
Architecture patterns for running MONAI plus LLM workloads cost-effectively on major hyperscaler platforms — balancing GPU spend, latency, and storage for DICOM-scale data.
Benchmarking generated second-opinion reports against board-certified radiologist readings — measuring agreement, false-negative rate, and clinically actionable disagreement.
Favouring open weights, open datasets, and reproducible inference recipes wherever possible — so findings can be independently verified rather than trusted on faith.
Three layers, each chosen because the medical imaging community has already validated it.
The PyTorch-based, NVIDIA-backed open framework for medical imaging AI. Domain-specific transforms, network architectures, and training loops purpose-built for DICOM and NIfTI data.
Llama, Mistral, and medical-domain fine-tunes. Used for report drafting, finding summarization, and clinical-language alignment with explicit grounding.
GPU-backed inference on hyperscaler infrastructure, object storage for DICOM cohorts, and event-driven workflows for batch and on-demand second-opinion generation.
A four-step pipeline, designed for auditability at every stage.
DICOM or NIfTI study uploaded to object storage. Metadata extraction, anonymization, and integrity check.
MONAI inference pipeline runs segmentation and classification. Findings emit as structured JSON with confidence scores.
Open-source LLM converts structured findings into a draft second-opinion report, grounded with citations to source slices.
Output presented for clinician review — never as autonomous diagnosis. All decisions remain with the licensed physician.
For collaboration, dataset access discussions, or to share related work.
info@2nd-opinion.click