06/11/2017

Instrumentasi Biomedika
(TEE219)
Biomedical Instrumentation
(2nd part)

Intelligent Medical Imaging Modalities

Hanung Adi Nugroho

adinugroho@ugm.ac.id

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Outline
1 Intelligent Medical Imaging Research

2 Intelligent Medical Imaging Research in Breast Cancer

3 Intelligent Medical Imaging Research in Diabetic Retinopathy

adinugroho@ugm.ac.id

1
 06/11/2017

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Outline
1 Intelligent Medical Imaging Research

2 Intelligent Medical Imaging Research in Breast Cancer

3 Intelligent Medical Imaging Research in Diabetic Retinopathy

adinugroho@ugm.ac.id

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Medical imaging - Overview

Currently medical imaging is limited to the
acquisition of images of the human organs/ body

Medical imaging refers to the techniques and

processes used to create images of the human
body for clinical purposes (medical procedures
seeking to reveal, diagnose or examine disease).

Medical imaging can be seen as the solution of

mathematical inverse problems. This means that
cause (the properties of living tissue) is inferred from Analysis of the images obtained
effect (the observed signal) is performed clinically by experts

adinugroho@ugm.ac.id

2
 06/11/2017

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Medical imaging - Technology

Gamma ray : positron emission tomography (PET) a short-lived isotope, such
as 18F, is incorporated into
a substance used by the
body such as glucose which
is absorbed by the tumour of
interest

X ray : computed tomography (CT) Expose to x-ray radiation, repeated scans must be
limited to avoid health effects

adinugroho@ugm.ac.id

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Magnetic resonance imaging (MRI)

uses powerful magnets to polarise and excite
hydrogen nuclei (single proton) in water molecules
in human tissue, producing a detectable signal
which is spatially encoded resulting in images of the
body

excellent soft-tissue contrast

no known long term effects of exposure to strong

static fields

health risks associated with tissue heating from

exposure to the RF field and the presence of
implanted devices in the body, such as pace makers

adinugroho@ugm.ac.id

3
 06/11/2017

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Medical imaging - Technology

Ultrasound : ultrasonography
H-F sound, 2-10MHz,
safe, 2D moving images

Fundus camera
Retinal image

adinugroho@ugm.ac.id

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Issues, challenge and approach

Issues Approach
Harmful (radiation, contrast agent) From medical imaging (image
Specialized device difficult to use - acquisition with enhancement) to
highly trained operator needed medical image analysis (feature
Expensive (Initial cost, Maintenance) extraction, classification, pattern
Image Acquisition only, little or no recognition, measurements) resulting
analysis for diagnostic purposes, in intelligent imaging (decision
subjective support systems)

Challenge

To develop intelligent medical imaging system which is objective in analysis that is

safe to the patients.

adinugroho@ugm.ac.id

4
 06/11/2017

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Intelligence
Input Equipment Output
Systems

Acquisition Processing and analysis

adinugroho@ugm.ac.id

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Outline
1 Intelligent Medical Imaging Research

2 Intelligent Medical Imaging Research in Breast Cancer

3 Intelligent Medical Imaging Research in Diabetic Retinopathy

adinugroho@ugm.ac.id

5
 06/11/2017

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Ultrasonography
Transduser/ komponen USG yang
ditempelkan pada bagian tubuh yang akan
diperiksa. Di dalam transduser terdapat
kristal yang digunakan untuk menangkap
pantulan gelombang yang disalurkan oleh
transduser. Gelombang yang diterima masih
dalam bentuk gelombang akusitik
(gelombang pantulan) sehingga fungsi kristal
disini adalah untuk mengubah gelombang
tersebut menjadi gelombang elektronik yang
dapat dibaca oleh komputer sehingga dapat
diterjemahkan dalam bentuk gambar.

adinugroho@ugm.ac.id

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Diagnosis of Breast Cancer using Ultrasound

A breast ultrasound is a scan that uses penetrating sound waves that
do not affect or damage the tissue and cannot be heard by humans.

Normal Abnormal
adinugroho@ugm.ac.id

6
 06/11/2017

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

i-Brids Prototype.1

Image Segmentation and

ROI and Filtering Diagnosis
Capturing Feature Extraction

adinugroho@ugm.ac.id

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

i-Brids Prototype 2

Image Segmentation and

ROI and Filtering Diagnosis
Capturing Feature Extraction

adinugroho@ugm.ac.id

7
 06/11/2017

Scheme of CAD System Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Computer Aided System

USG Image Image Processing Image

Image Acquisitions Analysis Display

Radiologists Diagnosis

adinugroho@ugm.ac.id

System Diagram Block Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Preprocessing

Noise and
USG GrayScale
RoI (1) Marker Segmentation (4)
Images Conversion (2) Reduction(3)

Feature Extraction
(5)

Moment based
Malignant / Birads based Feature features
Benign Diagnosis (8)
Classification (7) Selection(6) Geometry Feature
Texture Feature

adinugroho@ugm.ac.id

8
 06/11/2017

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Outline
1 Intelligent Medical Imaging Research

2 Intelligent Medical Imaging Research in Breast Cancer

3 Intelligent Medical Imaging Research in Diabetic Retinopathy

adinugroho@ugm.ac.id

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Fundus Camera
Fundus photography documents the retina, the
neurosensory tissue in our eyes which translates the
optical images we see into the electrical impulses our
brain understands. The retina can be photographed
directly as the pupil is used as both an entrance and exit
for the fundus camera's illuminating and imaging light
rays.
The patient sits at the fundus camera with their chin in
a chin rest and their forehead against the bar. An
ophthalmic photographer focuses and aligns the
fundus camera. A flash fires as the photographer presses
the shutter release, creating a fundus photograph like the
picture above. Ophthalmologists use these retinal
photographs to follow, diagnose, and treat eye diseases.
Fundus photography can be performed with colored filters,
or with specialized dyes including fluorescein and
indocyanine green.

adinugroho@ugm.ac.id

9
 06/11/2017

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Prinsip Kerja Fundus Camera

adinugroho@ugm.ac.id

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Prinsip Kerja Fundus Camera

adinugroho@ugm.ac.id

10
 06/11/2017

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Prinsip Kerja Fundus Camera

adinugroho@ugm.ac.id

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Prinsip Kerja Fundus Camera

adinugroho@ugm.ac.id

11
 06/11/2017

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Prinsip Kerja Fundus Camera

adinugroho@ugm.ac.id

Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

adinugroho@ugm.ac.id

12
 06/11/2017

Microaneurysms detection Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Isolated MAs
STEP MAs
2a candidate
STEP 3a
MAs candidate
extraction and Vessels removal
Original Green MAs isolation border
image
INPUT STEPband
1 elimination STEP&final
4 detected MAs
OUTPUT
Original Green band Blood vessels Segmented
image extraction removal MAs
STEP 2b STEP 3b
Blood vessels Blood vessels
isolation detection

Sensitivity Specificity Accuracy

91.06 % 99.98 % 99.98 %

Isolated blood Detected
vessels blood vessels
adinugroho@ugm.ac.id

Optic disc detection Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Original Red Optic disc localisation Region of

INPUTimage STEP 1channel STEP 2 & point candidate
STEP 3 STEP
Interest4(RoI)

Original Red channel Optic disc OD point candidate RoI

image extraction localisation determination generation

OUTPUT STEP 7 STEP 6 STEP 5

Segmented Optic disc Average filtering Vessels
optic disc segmentation removal

Sensitivity Specificity Accuracy

96.12 % 94.36 % 94.71 %
Segmented Optic disc final Vessels removal
optic disc localisation & filtered image

adinugroho@ugm.ac.id

13
 06/11/2017

FAZ detection Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Pre-processed Top-Hat Stretched

image result image
Multiscale Top-Hat
Hat Histogram fitting
Pre-processing
transformation Stretching
Original
image

FAZ
Length filter Matched filter
Sensitivity Specificity Accuracy segmentation
80.86 % 99.17 % 97.49 %
Segmented
FAZ

Establishment Length Match

of polygon filter result filter result

adinugroho@ugm.ac.id

Haemorrhages detection Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Enhanced Haemorrhages Detected

image candidates haemorrhages

Green and V Histogram Vessels Vessels

Original band extraction matching detection elimination
image Fundus Two-dimensional
image Contrast Opening matched filtering
Double length Masking
enhancement operation filtering operation
Pre-processing Post-processing

Accuracy Sensitivity Specificity

98% 91% 98%

adinugroho@ugm.ac.id

14
 06/11/2017

Hard exudates detection Instrumentasi Biomedika (TEE219) Biomedical Instrumentation

Filtered Segmented Candidates

image Optic disk hard exudates

Green channel Complement Removal OD

extraction operation Optic disc and
detection (*) Morphological
Matched operation
Pre-processing filter
Original Detected hard
image exudates

Accuracy Sensitivity Specificity

99.99% 90.38% 99.99%

adinugroho@ugm.ac.id

THANK YOU

adinugroho@ugm.ac.id

15