Cinematic rendering

In medical diagnostics, cinematic rendering is an image processing technique applied to create three-dimensional, photorealistic images of cross-sectional data, such as computed-tomography, or magnetic resonance imaging (MRI). In 2017, Klaus Engel, Franz Fellner and Robert Schneider were nominated for the German Future Prize for their interdisciplinary collaboration on Cinematic Rendering.

Technology

Based on the volumetric Monte-Carlo Path Tracing algorithm, cinematic rendering traces hundreds to thousands of light path per pixel through the data generated by a virtual camera. The light input is averaged along these path and transported from high-dynamic-range images back to the virtual camera sensor. The scattering, absorption and emission is then simulated along the optical paths by means of the interaction between the light and the volumetric data, resulting in vivid, realistic anatomical images of similar image quality similar to CGI sequences used in the film industry.

Medical applications

Approved for use in the medical field, cinematic rendering is being applied to a range of different areas that include radiology (to supplement available cross-sectional images), surgery (to plan preoperative procedures, such as oral and maxillofacial surgery, trauma surgery and orthopedics), as well as cardiovascular surgery and interventional radiology. The system can also be used across disciplines to, for example, train post-graduate medical personnel, as well as support patient education and interdisciplinary clinical meetings (such as tumor boards).

Applications in medical education

Cinematic rendering technology is currently applied as a virtual educational method at specialized facilities, institutions, and centers to teach the subject of anatomy to both medical students and other healthcare professions, for example, at the JKU Faculty of Medicine at the Johannes Kepler University Linz, and for post-graduate programs in clinical areas as well as medical assistant professions.

Journal articles

1. Eid, M. et al.:, Titel:Cinematic Rendering in CT: A Novel, Lifelike 3D Visualization Technique. American Journal of Roentgenology, 2017, 209, doi:10.2214/AJR.17.17850, Citation: "The purpose of this article is to present an overview of cinematic rendering, illustrating its potential advantages and applications. Conclusion: Volume-rendered reconstruction, obtaining 3D visualization from original CT datasets, is increasingly used by physicians and medical educators in various clinical and educational scenarios. Cinematic rendering is a novel 3D rendering algorithm that simulates the propagation and interaction of light rays as they pass through the volumetric data, showing a more photorealistic representation of 3D images than achieved with standard volume rendering. ..."
2. Li, K., et al.: Value of the Cinematic Rendering From Volumetric Computed Tomography Data in Evaluating the Relationship Between Deep Soft Tissue Sarcomas of the Extremities and Adjacent Major Vessels: A Preliminary Study. Journal of Computer Assisted Tomography, 2019, 43, doi:10.1097/RCT.0000000000000852, Citation: "Abstract: Objective:The aim of the study was to assess the value of cinematic rendering (CR) from volumetric computed tomography data in evaluating the relationship between deep soft tissue sarcomas (STSs) of the extremities and the adjacent major vessels..."
3. Moser, S.E.: Cinematic Rendering: Körperkino für das Tumorboard. Deutsches Ärzteblatt, 2017, 114, 35–36, Citation in German Language: "...Cinematic Rendering: technologischer Hintergrund. Cinematic Rendering – deutsch etwa: filmische Bildsynthese – beschreibt ein 3-D-Visualisierungsverfahren. Die Technologie stammt aus der Filmbranche, wo sie unter anderem digital animierte Figuren realitätsnah in von Menschen dargestellte Filmszenen integriert – beispielsweise „Gollum“ in „Herr der Ringe“. Aus konventionellen 2-D-CT- oder MRT-DICOM-Daten errechnet die Cinematic-Rendering-Software dreidimensionale Strukturen. ..."
4. Binder J., et al.: Cinematic Rendering in Anatomy: A Crossover Study Comparing a Novel 3D Reconstruction Technique to Conventional Computed Tomography. Anatomical Sciences Education, 2021, 14, doi:10.1002/ase.1989, Citation: "Abstract: Integration of medical imaging into preclinical anatomy courses is already underway in many medical schools. However, interpretation of two-dimensional grayscale images is dif-ficult and conventional volume rendering techniques provide only images of limited quality. In this regard, a more photorealistic visualization provided by Cinematic Rendering (CR) may be more suitable for anatomical education. ...
5. Niedermair, J., et al.: On the added benefit of virtual anatomy for dissection-based skills. Anatomical Sciences Education, 2023, 16, doi:10.1002/ase.2234, Citation: "Technological approaches deploying three-dimensional visualization to integrate virtual anatomy are increasingly used to provide medical students with state-of-the-art teaching. It is unclear to date to which extent virtual anatomy may help replace the dissection course. Medical students of Johannes Kepler University attend both a dissection and a virtual anatomy course. This virtual anatomy course is based on Cinematic Rendering and radiological imaging and teaches anatomy and pathology. ...

External links

• German Future Prize 2017 – Team 1
• Ars Electronica Futurelab: Cinematic Anatomy x Deep Space