Imaging and intelligence
1. Imaging and surgical navigation with artificial intelligence
Our primary focus is on the development and application of multimodal optical medical imaging technology and surgical navigation technology. These cutting-edge technologies are revolutionizing the way we approach diagnostics and surgical interventions, ultimately improving patient care and outcomes.
- Multimodal Optical Medical Imaging: We specialize in characterizing both the structural and functional information of biological tissues using a range of optical imaging methods, including fluorescence imaging, optical coherence tomography (OCT), hyperspectral imaging, laser speckle imaging, thermography, and infrared imaging. By combining these modalities, we aim to provide healthcare professionals with a comprehensive understanding of the intricacies of biological tissues, allowing for more accurate diagnoses and treatment planning.
- Surgical Navigation Technology: Our lab is dedicated to advancing computational tools that seamlessly integrate with multimodal optical medical imaging. We utilize the Coaxial Projection Imaging (CPI) technique and augmented reality (AR) technology to enable surgeons to visualize a patient's anatomy in real-time during surgical procedures. With unique intraoperative visualization techniques, we empower surgeons to navigate instruments with unparalleled precision, reducing surgical risks and enhancing success rates.
Projects:
National Science Foundation of China (Nos. 81271527 and 81327803), Fundamental Research Funds for the Central Universities (No. WK2090090013), Anhui Provincial Technology Development Contract (No. 2016340022004031), Anhui Province Science and Technology Major Project (No. 17030801004), Science and Technology Project of Anhui Province (No. 150-11d04037) and National Key R&D Program of China (No. 2022YFA1104800)
Participating researchers:
Representative Publications:
- Wang, Zhaojun#, Tianao Chen#, Xin Li, Buyun Guo, Peng Liu, Zhiqiang Zhu, and Ronald X Xu, Oxygen-releasing Biomaterials for Regenerative Medicine. Journal of Materials Chemistry B, 2023.
- Chen, Wei#, Ru Zhang#, Ruijie Yang, Jie Hu, John E Phay, Peng Liu, Xiaopeng Ma, and Ronald X Xu, Converting a probe-based fluorescence system into an easy-to-use adjunct for the detection of parathyroid glands accidentally resected intraoperatively. Langenbeck's Archives of Surgery, 2023. 408(1): p. 262.
- 杨睿婕, 刘鹏, 饶晓旭, 吴柄萱, 郭步云, 张帆, 邵鹏飞, 陈传俊, and 徐晓嵘, 用于远程手术指导的同轴视觉光致变色标记系统. 中国激光, 2022. 49(20): p. 2007102-2007102-10.
- 李晨梦, 邵鹏飞, 吴柄萱, 孙明斋, 姚鹏, 申书伟, 刘鹏, and 徐晓嵘, 用于成像性能测试的荧光发光模拟系统. 中国激光, 2022. 49(24): p. 2407204-2407204-11.
- Zhang, Fan, Carlo M Contreras, Pengfei Shao, Liping Zhao, Bingxuan Wu, Chenmeng Li, Feng Lin, Xiaohong Zhong, Zhongliang Lang, Peng Liu and Ronald X Xu, Co-axial projective imaging for augmented reality telementoring in skin cancer surgery. Annals of Biomedical Engineering, 2022. 50(12): p. 1846-1856.
- Wu, Bingxuan, Peng Liu, Chi Xiong, Chenmeng Li, Fan Zhang, Shuwei Shen, Pengfei Shao, Peng Yao, Chaoshi Niu*, and Ronald Xu, Stereotactic co-axial projection imaging for augmented reality neuronavigation: a proof-of-concept study. Quantitative Imaging in Medicine and Surgery, 2022. 12(7): p. 3792.
- W. Ren, Y. Qu, S. Chang, S. Zhang, and R. X. Xu, ”Development of a multimodal colposcopy for early screening of cervical intraepithelial neoplasia”, Journal of Medical Devices
- Hu, Chuanzhen#, Ziling Jiang#, Peng Liu, Yajun Yu, Kaiqin Chu, and Zachary J Smith*, Super-resolved Raman imaging via galvo-painted structured line illumination. Optics Letters, 2022. 47(22): p. 5949-5952.
- Chen, Wei, Xiaopeng Ma, Pengfei Shao, Peng Liu, and Ronald X Xu, Autofluorescence detection and co-axial projection for intraoperative localization of parathyroid gland. BioMedical Engineering OnLine, 2022. 21(1): p. 37.
- Zhang, Ru, Ruijie Yang, Zhongliang Lang, Bingxuan Wu, Pengfei Shao, Peng Liu, Xiaohong Zhong, Carlo M Contreras, and Ronald X Xu, Coaxial projective imaging for sentinel lymph node mapping in melanoma. JAAD Case Reports, 2021. 15: p. 46-50.
- Wang, Zhaorui, Xiaowei Yang, Jingjing Wang, Peng Liu, Yubo Pan, Chunguang Han, and Jing Pei, Real-time in situ navigation system with indocyanine green fluorescence for sentinel lymph node biopsy in patients with breast cancer. Frontiers in Oncology, 2021. 11: p. 621914.
- Liu, Peng, Chenmeng Li, Changlin Xiao, Zeshu Zhang, Junqi Ma, Jian Gao, Pengfei Shao, Ian Valerio, Timothy M Pawlik, Chengbiao Ding, Alper Yilmaz, and Ronald X Xu, A wearable augmented reality navigation system for surgical telementoring based on Microsoft HoloLens. Annals of biomedical engineering, 2021. 49: p. 287-298.
- Zhang, Fan, Xiang Zhu, Jian Gao, Bingxuan Wu, Peng Liu, Pengfei Shao, Min Xu, Timothy M Pawlik, Edward W Martin Jr, and Ronald X Xu, Coaxial projective imaging system for surgical navigation and telementoring. Journal of Biomedical Optics, 2019. 24(10): p. 105002-105002.
- Li, Chenmeng, Peng Liu, Pengfei Shao, Jing Pei, Yingrui Li, Timothy M Pawlik, Edward W Martin, and Ronald X Xu, Handheld projective imaging device for near-infrared fluorescence imaging and intraoperative guidance of sentinel lymph node resection. Journal of Biomedical Optics, 2019. 24(8): p. 080503-080503.
- Ye, Jian, Guanghui Liu, Peng Liu, Shiwu Zhang, Pengfei Shao, Zachary J Smith, Chenhai Liu, and Ronald X Xu, Benchtop and animal validation of a portable fluorescence microscopic imaging system for potential use in cholecystectomy. Journal of Biomedical Optics, 2018. 23(2): p. 020504-020504.
- Z. Zhang, J. Pei, D. Wang, Q. Gan, J. Ye, J. Yue, B. Wang, S. P. Povoski, E. W. Martin Jr, and C. L. Hitchcock, A Wearable Goggle Navigation System for Dual-Mode Optical and Ultrasound Localization of Suspicious Lesions: Validation Studies Using Tissue-Simulating Phantoms and an Ex Vivo Human Breast Tissue Model, PloS one 11(7), e0157854 (2016).
- C. Wang, W. Zheng, Y. Bu, S. Chang, S. Zhang, and R. X. Xu, Multi-scale hyperspectral imaging of cervical neoplasia, Archives of gynecology and obstetrics 293(6), 1309-1317 (2016).
- P. Liu, J. Huang, S. Zhang, and R. X. Xu, Multiview hyperspectral topography of tissue structural and functional characteristics, Journal of biomedical optics 21(1), 016012-016012 (2016).
- Q. Gan, D. Wang, J. Ye, Z. Zhang, X. Wang, C. Hu, P. Shao, and R. X. Xu, Benchtop and Animal Validation of a Projective Imaging System for Potential Use in Intraoperative Surgical Guidance, PloS one 11(7), e0157794 (2016).
- W. Zheng, C. Wang, S. Chang, S. Zhang, and R. X. Xu, Hyperspectral wide gap second derivative analysis for in vivo detection of cervical intraepithelial neoplasia, Journal of biomedical optics 20(12), 121303-121303 (2015).
- S. Zhang, S. Gnyawali, J. Huang, W. Ren, G. Gordillo, C. K. Sen, and R. Xu, Multimodal imaging of cutaneous wound tissue, Journal of biomedical optics 20(1), 016016-016016 (2015).
- W. Ren, Q. Gan, Q. Wu, S. Zhang, and R. Xu, Quasi-simultaneous multimodal imaging of cutaneous tissue oxygenation and perfusion, Journal of Biomedical Optics 20(12), 121307-121307 (2015).
- J. Huang, S. Zhang, S. Gnyawali, C. K. Sen, and R. X. Xu, Second derivative multispectral algorithm for quantitative assessment of cutaneous tissue oxygenation, Journal of biomedical optics 20(3), 036001-036001 (2015).
- P. Shao, H. Ding, J. Wang, P. Liu, Q. Ling, J. Chen, J. Xu, S. Zhang, and R. Xu, Designing a wearable navigation system for image-guided cancer resection surgery, Annals of biomedical engineering 42(11), 2228-2237 (2014).
- R. X. Xu, D. W. Allen, J. Huang, S. Gnyawali, J. Melvin, H. Elgharably, G. Gordillo, K. Huang, V. Bergdall, and M. Litorja, Developing digital tissue phantoms for hyperspectral imaging of ischemic wounds, Biomedical optics express 3(6), 1433-1445 (2012).
2. Intelligent diagnosis and treatment for diseases
The “Healthy China 2030” plan points out that health is a necessary requirement for promoting the comprehensive development of people, an important symbol of national prosperity and national rejuvenation, and a common aspiration of people of all ethnic groups in the country. Although China’s medical diagnostic resources have been greatly improved, the lack of expert-level medical resources (especially in hospitals at the grassroots and remote areas) has led to a high incidence of related malignant diseases. Artificial intelligence (AI) based on deep neural networks has the potential to interpret clinical data more stably and quickly than doctors. How to apply them to clinical diagnosis and treatment, including skin diseases, cervical cancer, and tumors, has become a hot frontier direction of international research. However, experienced doctors are still needed to participate, and personalized treatment for different lesions cannot be achieved. On the other hand, a micro-needle with a scale of one hundred microns was proposed in the 1990s. It painlessly pierces the stratum corneum of the skin to produce a penetration channel, which can easily increase the diffusion efficiency of drugs by several orders of magnitude. In view of this, we integrate the diagnosis and treatment of the diagnosis and treatment integration research, hoping to provide new ideas for early screening and remote diagnosis and treatment of related malignant diseases.
Projects:
Chinese Academy of Sciences, CAS Strategic Pilot Project, Industrial sponsored project: Automatic Drug Delivery and Electrophysiological Simulation System. 2021-12 to 2022-12, XDA16021303
Participating researchers:
Representative Publications:
- Shuwei Shen; Mengjuan Xu; Fan Zhang; Pengfei Shao; Honghong Liu; Liang Xu; Chi Zhang; Peng Liu; Zhihong Zhang; Peng Yao; Ronald X. Xu ; A Low-Cost High-Performance Data Augmentation for Deep Learning-Based Skin Lesion Classification, BME frontiers, 2022, 2022: 1-12
- Peng Yao#; Shuwei Shen#; Mengjuan Xu; Peng Liu; Fan Zhang; Jinyu Xing; Pengfei Shao; Benjamin H. Kaffenberger; Ronald X. Xu ; Single Model Deep Learning on Imbalanced Small Datasets for Skin Lesion Classification, IEEE Transactions on Medical Imaging, 2022, 41(5): 1242-1254
- Fan Zhang, Bo Pan, Pengfei Shao, Peng Liu, Shuwei Shen *, Peng Yao *, Ronald X. Xu * & Alzheimer's Disease Neuroimaging Initiative. (2022). A single model deep learning approach for Alzheimer’s disease diagnosis. Neuroscience, 491, 200-214.
- Xue, Yue; Zheng, Zhiyuan; Shen, Shuwei; Liu, Guangli; Xu, Ronald X; Combinatory electrospray and electrospinning to produce multi-layered membrane with enhanced mechanical property, Environmental Engineering Research,2022, 220023
- Guo, Buyun; Fan, Rong; Shen, Shuwei; Xue, Yue; Zhu, Zhiqiang; Xu, Ronald X; A photo-responsive membrane for tailored drug delivery with spatially and temporally controlled release,Journal of Materials Chemistry B, 2021, 8615-8625
Patents:
- 姚鹏; 徐亮; 程逸; 申书伟; 徐晓嵘; 任维 ; 一种基于重采样策略的网络训练方法, 2021-12-24, 中国, CN202111600865.8 (发明专利)
- 申书伟; 陈梁; 刘鹏; 徐晓嵘 ; 一种用于校准多生理参数检测仪器的装置和方法, 2022-12-15, 中国, CN2022116175674 (发明专利)
- 发明专利,徐梦娟,姚鹏,申书伟,邵鹏飞. 一种基于深度学习多权重损失函数的数据均衡方法 授予日期2023.06,专利号: ZL202110078808.1
- 发明专利,姚鹏,徐亮,邵鹏飞,任维. 基于微流控和图像识别的循环肿瘤检测与分选方法及系统 授予日期2023.06,专利公开号:CN113588522A
- 申书伟,徐梦娟,姚鹏,邵鹏飞,张帆,李晨梦. 一种用于皮肤疾病自动诊断分类的便携式设备装置及方法,中国发明专利,专利公布号:CN112790737A