Robotic palpation system - reproduction method of dermatologists' skin palpation judgment using a deep neural network

Authors

  • Fumihiro Kato Waseda University
  • Takeya Adachi Keio University
  • Kaito Kamishima
  • Takumi Handa
  • Hiroyasu Iwata

DOI:

https://doi.org/10.21014/actaimeko.v13i4.1571

Keywords:

palpation, dermatology, medical robotics, telemedicine, haptic primary colours, machine learning, telexistence

Abstract

The recent surge in infectious diseases, such as COVID-19, has amplified the need for medical examinations that minimize contact between doctors and patients. This is particularly relevant for medical treatments requiring palpation, especially in dermatology. In this study, we aimed to replicate the assessment of softness and surface textures of affected areas, a critical aspect for dermatologists in diagnosing conditions, using a simple robotic device. We derived five levels of softness and three types of surface textures from 14 types of materials based on interviews with dermatologists. To elicit a haptic response from the materials during the pushing procedure, we developed 1) a single-rod probe equipped with a haptic sensor (measuring force and acceleration) using a linear actuator, and 2) a dual-rod configuration supplemented with a nearby vibrator to capture vibration propagation through the material. Frequency-analyzed images were generated from the waveforms of force and acceleration obtained. A total of 500 images from 13 different materials were evaluated for discrimination using AlexNet-based transfer learning. The discrimination accuracy for the 13 materials was 97.4 % (average across trials) when combining the force and acceleration data from the single-rod probe with the acceleration image from the dual-rod probe. The discrimination accuracy was 96.4 % using only the force and acceleration data from the single-rod probe, suggesting that adding acceleration data during vibration propagation enhances discrimination accuracy. A similar comparison was conducted for the five levels of softness and surface features, indicating that acceleration during vibration propagation may provide essential information for palpation.

Downloads

Published

2024-12-04

Issue

Vol. 13 No. 4 (2024)

Section

Research Papers

License

Copyright (c) 2024 Fumihiro Kato, Takeya Adachi, Kaito Kamishima, Takumi Handa, Hiroyasu Iwata

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under the CC BY 4.0, Creative Commons Attribution 4.0 International License.

Users are free to

  • share, i.e. copy and redistribute the material in any medium or format for any purpose, even commercially;
  • adapt, i.e. remix, transform, and build upon the material for any purpose, even commercially.

At the same time, the user must give appropriate credit, provide a link to the license, and indicate if changes were made.
Additional information about the license can be found at: https://creativecommons.org/licenses/by/4.0/.

Authors are

  • able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  • permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).