Feng: Difference between revisions
imported>Student221 |
imported>Student221 |
||
Line 43: | Line 43: | ||
However, the images also exposed a couple of design issues within the OralEye camera. Consider the subject images in Figure 5 and 6, there are much less visible fluorescence features comparing to Figure 4. Meanwhile, the blue light image is very much like the white light image with a global tint (because of the low color rendering index of the blue LED). This indicates there is light signal seen by all three channels of the camera sensor, which isn't supposed to occur from the initial design point of view. Moreover, in Figure 6, the chin rest shows strong saturated blue light reflection, which is also not supposed to occur because of the presence of an LPF in front of the camera lens. | However, the images also exposed a couple of design issues within the OralEye camera. Consider the subject images in Figure 5 and 6, there are much less visible fluorescence features comparing to Figure 4. Meanwhile, the blue light image is very much like the white light image with a global tint (because of the low color rendering index of the blue LED). This indicates there is light signal seen by all three channels of the camera sensor, which isn't supposed to occur from the initial design point of view. Moreover, in Figure 6, the chin rest shows strong saturated blue light reflection, which is also not supposed to occur because of the presence of an LPF in front of the camera lens. | ||
In order to find out the underlying issue with the camera design, a measured OralEye blue LED spectrum along with a sketched long pass filter transmissivity are shown in Figure 7. It can be seen that the blue LED actually emits a significant amount of infrared radiation above 700 nm, which could potentially result from deep level recombination depending on the specific type of LED material [8]. Because the camera only has a long pass filter with no IR filtering capability, this portion of light is fully visible by all three channels of common CMOS sensors, whose color filters typically don't cover the IR band [9]. Moreover, the LPF has a gradual transition band, and the transmissivity in the stop band doesn't really goes to zero. This behavior allows some amount of incident blue light to make it through the LPF and reach the camera sensor. Moreover, | In order to find out the underlying issue with the camera design, a measured OralEye blue LED spectrum along with a sketched long pass filter transmissivity are shown in Figure 7. It can be seen that the blue LED actually emits a significant amount of infrared radiation above 700 nm, which could potentially result from deep level recombination depending on the specific type of LED material [8]. Because the camera only has a long pass filter with no IR filtering capability, this portion of light is fully visible by all three channels of common CMOS sensors, whose color filters typically don't cover the IR band [9]. Moreover, the LPF has a gradual transition band, and the transmissivity in the stop band doesn't really goes to zero. This behavior allows some amount of incident blue light to make it through the LPF and reach the camera sensor. Moreover, comparing Figure 5 and 6, it is clear that there's mismatch between the working distance of the camera lens and the LED illuminator. In Figure 5, the central part of the tongue is at the sharpest focus, however, the illumination shows a dark, under illuminated region. On the other hand, in Figure 6, the overall illumination is uniform and bright, but the subject is strongly out of focus. | ||
== Conclusions == | == Conclusions == |
Revision as of 06:03, 14 December 2019
Introduction
Cancer screening is a procedure that aims to detect cancer before any signs or symptoms of cancer arise; it is potentially useful for medical diagnosis because early detection of cancer significantly increases the chances for successful treatment [1]. For the case of oral cancer, screening is particularly important as survival does correlate with stage, making early diagnosis and treatment optimal for this disease [2]. Unfortunately, the diagnosis constantly rely on physical examination followed by biopsy confirmation, which could result in delay in diagnosis [3]. As such, more and more research are being conducted to develop easy-to-use, cost effective oral cancer screening devices to encourage and improve the screening process.
Currently, there is a number of devices available on the market for oral cancer screening purpose. Some examples are Velscope®, ViziLite® and Identafi®. This project is based on the newly developed "OralEye" system from Fengyun Vision Technology, and aims to improve the overall usability, accuracy and efficiency of the system for oral screening.
Background
This section provides an overview of existing oral cancer screening devices as well as areas of improvements proposed by researchers, which will be serving as guidance for development of the new screening system based on OralEye camera.
ViziLite is a disposable capsule like device that relies on chemiluminescence in 430-580 nm. Although researchers found its potential utility in identifying occult epithelial abnormalities, ViziLite suffers from high false positive and negative levels, and thus limiting its clinical application [4].
VELscope® is a hand held device that emits 400–460 nm wavelength light to excite auto-fluorescence from fluorophores in the mouth. Some researchers suggest that 405 nm wavelength light was able to discriminate neoplastic and non-neoplastic tissue with high sensitivity and specificity [5]. However, there has also been a number of criticisms on VELscope® for the limited capacity to extend its use in general dentistry. Researchers are still trying to improve its specificity to allow wider clinical use [4].
Identafi® is a probe like device designed for multi-spectral screening of oral disease. It emits three types of light: white, violet (405 nm) and green-amber (545 nm) light. The white light provides classical visual inspection and the violet light is for similar purpose as in VELscope®. The green-amber light, through reflection spectroscopy, is used to excites haemoglobin molecules in the blood, in order to visualise the vasculature [6]. Researchers found that the use of Itentafi provides more data that conventional oral exam. However, it requires high level of clinical training in oral pathology to interpret the results, and thus limiting its usage in general practice [7].
According to ref [4], a main limiting factor for universal usage of these devices is no demonstrated superiority compared to conventional oral exam. However, the authors acknowledge the possibility that these devices can be enhanced with "new approaches used to analyze optical imaging data". As such, this project aims to explore new methods towards easy-to-use oral florescence imaging as well as accurate data interpretation to address the needs in oral cancer screening.
Methods
The OralEye camera has a form factor similar to that of a torch or flashlight, and is mounted on an optical post to take images of subjects or calibration targets. The camera is connected to a PC using a USB cable. The communication between the camera and PC is based on the Ethernet-over-USB protocol RNDIS. A software development kit (SDK) provided by Fengyun Vision is used to develop custom camera interfacing software. A basic illustration of the communication is shown in Figure 3.
The command line camera control software OralEyeCamera.exe is developed in Visual C++ with Visual Studio 2017. Most of the communication between the camera and PC is based on the TCP protocol. As such, the Winsock library is heavily used. The executable can take four types of input parameters to carry out different tasks. The syntax for using the command line tool is shown below:
OralEyeCamera.exe printParam
OralEyeCamera.exe lightBlue|lightWhite|lightOff
OralEyeCamera.exe blueShoot|whiteShoot|singleShoot [expTime]
OralEyeCamera.exe task.json
The JSON file is used to specify a sequence of captures with different light/exposure settings. Its format is defined in the separate MATLAB software "oraleye".
Results
With the OralEyeCamera.exe command line tool, we were able to capture sequences of frames with different lighting/exposure at a frame rate of about 2 fps. The frame rate is mainly limited by the overhead of file I/O, establishing socket communication and parameter setting for each frame. However, for a consecutive capture of 6 frames, the subject only needs to keep the mouth open for ~3 seconds, which is still feasible in practice.
A pair of images of subject 003 are shown in Figure 4. In these images we can clearly see a number of fluorescence signatures, such as the red stripes and turquoise colored background on the tongue, which could potentially be the fluorescence of different bacteria. There are also strong fluorescence spots of the lip of the subject, which could be related to the hair follicles according to their shape and spacing. These signatures indicate that using color CMOS camera is an effective way to detect different types of fluorescence. With the spectral response curves of the camera sensor, it is also possible to locate the wavelength range of the relevant fluorescence.
However, the images also exposed a couple of design issues within the OralEye camera. Consider the subject images in Figure 5 and 6, there are much less visible fluorescence features comparing to Figure 4. Meanwhile, the blue light image is very much like the white light image with a global tint (because of the low color rendering index of the blue LED). This indicates there is light signal seen by all three channels of the camera sensor, which isn't supposed to occur from the initial design point of view. Moreover, in Figure 6, the chin rest shows strong saturated blue light reflection, which is also not supposed to occur because of the presence of an LPF in front of the camera lens.
In order to find out the underlying issue with the camera design, a measured OralEye blue LED spectrum along with a sketched long pass filter transmissivity are shown in Figure 7. It can be seen that the blue LED actually emits a significant amount of infrared radiation above 700 nm, which could potentially result from deep level recombination depending on the specific type of LED material [8]. Because the camera only has a long pass filter with no IR filtering capability, this portion of light is fully visible by all three channels of common CMOS sensors, whose color filters typically don't cover the IR band [9]. Moreover, the LPF has a gradual transition band, and the transmissivity in the stop band doesn't really goes to zero. This behavior allows some amount of incident blue light to make it through the LPF and reach the camera sensor. Moreover, comparing Figure 5 and 6, it is clear that there's mismatch between the working distance of the camera lens and the LED illuminator. In Figure 5, the central part of the tongue is at the sharpest focus, however, the illumination shows a dark, under illuminated region. On the other hand, in Figure 6, the overall illumination is uniform and bright, but the subject is strongly out of focus.
Conclusions
Appendix
You can write math equations as follows:
You can include images as follows (you will need to upload the image first using the toolbox on the left bar, using the "Upload file" link).
References
[1] https://www.who.int/cancer/detection/en/
[2] Ries LAG, Kosary CL, Hankey BF, et al. SEER Cancer Statistics Review, 1973-1995. Bethesda, MD, NCI.2. American Cancer Society, Facts and Figures, 2000.
[3] https://oralcancerfoundation.org/discovery-diagnosis/cancer-screening-protocols/
[4] Mascitti, M., et al. "An Overview on Current Non-invasive Diagnostic Devices in Oral Oncology" Front. Physiol. 9, 1510 (2018)
[5] Roblyer, D., et al. "Objective detection and delineation of oral neoplasia using autofluorescence imaging", Cancer Prev. Res. 2, 423–431 (2009)
[6] Messadi, D. V., et al. "The clinical effectiveness of reflectance optical spectroscopy for the in vivo diagnosis of oral lesions", Int. J. Oral Sci. 6, 162–167 (2014)
[7] Lalla, Y., et al. "Assessment of oral mucosal lesions with autofluorescence imaging and reflectance spectroscopy", J. Am. Dent. Assoc. 147, 650–660.
[8] Lim, et al. "UV Electroluminescence Emission from ZnO Light-Emitting Diodes Grown by High-Temperature Radiofrequency Sputtering" Adv. Mater. 18, 2720 (2006)
[9] Dworak, V., et al. "Strategy for the Development of a Smart NDVI Camera System for Outdoor Plant Detection and Agricultural Embedded Systems", Sensors, 13, 1523 (2013)