Skip to main content
  • Research Article
  • Open access
  • Published:

One-touch calibration of hum-noise-based touch sensor for unknown users utilizing models trained by different users

Abstract

Hum-noise-based touch sensors (HumTouch) are capable of recognizing human touch on semiconductive materials using the current leaking from the finger to the surface. Thus far, calibration for these hum-noise-based touch sensors has been performed for individual users because of the individual differences in hum-driven electric currents in human bodies. However, for applications designed for unknown users, time-consuming calibration for individual users is not preferred, and a new user should be able to use the sensor immediately. For this purpose, we propose a new calibration method for HumTouch. In this method, learning datasets collected from multiple people and a few extra samples from a new user are collectively used to establish a touch localization estimator. The estimator is computed using the kernel regression method with weighted samples from the new user. For a 20 \(\times \) 18 cm\(^2\) paper, the mean localization error is reduced from 1.24 cm to 0.90 cm with only one sample from the new user. Hence, a new user can establish a semipersonalized localization estimator by touching only one point on the surface. This method improves the localization performance of HumTouch sensors in an easy-to-access manner.

Introduction

Capacitive sensing has been adopted in most commonly-used and commercially successful touch-sensitive methods. This sensing method detects the changes in the electric charges within a uniform electrostatic field [1,2,3], and is extensively used in touch panels and buttons. Recently, touch localization technology that can be applied to nonspecialized surfaces or objects has attracted the attention of researchers. Most of these techniques are aimed at furniture and cloth, rather than touch panels for electronic appliances. An example is the electrical tomography method [4,5,6,7], which uses several pairs of electrodes to apply voltages to a resistive surface. The touched location can be computed by recording the changes in the electrical impedance between the electrodes. Optical methods such as cameras, which detect and trace human fingertips, can be applied to any surface as long as the occlusion problem is not severe [8,9,10,11,12]. In addition, soft or thin pressure-sensitive sheets have been used for constructing touch-sensitive areas on free-form surfaces [13,14,15,16,17]. Other approaches include radio-frequency identification tags for sensing touch events and localization [18], inertial measurement unit sensors for tracking fingertips and recognizing gestures [19], and methods utilizing the propagation of acoustic waves in solid materials [20]. Multi-axial force sensors can also turn objects such as furniture into touch sensitive interfaces [21,22,23]. Furthermore, a method based on spray coating conductive substances can be easily applied to objects with complex shapes for forming a touch-sensitive surface [6, 7, 24]. Moreover, wearable sensors, such as [25, 26], are a potential approach to detect a touch on objects without sensory instruments.

We focus on a sensing method that utilizes environmental AC-hum-noise [27,28,29,30,31,32,33]. For example, Cohn et al. demonstrated that the touch positions on a wall could be discriminated by monitoring the voltage at an electrode on human skin [27]. In their experiment, the hum-noise in the wall was detected through human skin when a person touched the wall. The hum-noise-based sensing method employed in this study is called HumTouch [34,35,36,37], which uses the environmental noise leaking from human fingers onto the surfaces of conductive or semiconductive objects. Touch or finger localization is achieved based on the voltages recorded at multiple electrodes attached to the surface [35,36,37]. In previous studies on hum-noise-based touch sensors, calibration for localization was performed for individual users, using machine learning or statistical approaches comprising support vector machines and regression analysis [27,28,29,30, 35,36,37]. Because of the individual differences in human bodies, the voltages recorded on material surfaces differ among users, leading to inaccurate localization of touch. For certain applications, calibration for individual users before using the sensors is acceptable or suitable; however, other applications require easy access to hum-noise-based touch sensors by unknown users with less effort for sensor calibration.

Fig. 1
figure 1

Principle of HumTouch. HumTouch utilizes the current leaking from a human body when conductive substances in the body react with the electromagnetic waves generated by AC power lines in buildings

Herein, we propose a calibration method in which only one or a few samples from a new unknown user and many samples collected from various people are combined to build a semipersonalized calibration model. The extra samples from the new user are weighted to tailor the calibration model to the user. We examine a method that uses \(20 \times 18~\text {cm}^2\) paper coated with conductive ink. We investigate the suitable weighting values and the extra samples required for improving the localization accuracy. To the best of our knowledge, a method similar to our semipersonalized method for touch sensors has not yet been developed. This is mainly because, in principle, most of the previous touch sensors do not require calibration for individuals because their measurement accuracy does not depend on individual users. For example, electrical tomography methods utilize the changes in the electrical impedance caused by the deformation of the surface touched by the user. Hence, calibration models are required for individual surfaces, but not for individual users.

Touch-sensing methods utilizing hum-noise have distinctive features from other sensing methods. First, this method does not require any sensing structures on the surface to be measured. It does not require any resistive or capacitive materials and layers installed on the surface as long as the surface material is semiconductive. Hence, HumTouch may allow us to turn wooden products [36], such as furniture, and those covered with paper [35, 37] or cloth into touch-sensitive interfaces. Furthermore, HumTouch can localize a human body in water [38]. The second prominent feature is the passivity. Methods based on hum-noise do not excite object surfaces by applying voltage or vibration, for example; hence, they may be suitable for sensing large-area surfaces such as a wall and floor. Camera-based touch-sensing methods [8,9,10,11,12] and acoustic methods [20] also share these two features whereas the former suffers from occlusions and the latter is not applied for soft materials. Our calibration method for HumTouch is expected to realize touch-detection functions for a variety of objects described above in public and domestic spaces.

Methods

General principle of the HumTouch sensor

Electrical grids are an essential infrastructure in modern cities. AC power lines constantly generate electromagnetic waves known as hum-noise during the transmission of electricity, which react with conductive or semiconductive objects nearby. The human body includes conductive substances such as minerals, which react with these hum-noise-producing currents in the body, as shown in Fig. 1. Therefore, when a human touches a conductive object, current leaks from the finger onto the object. These currents can be detected using voltage acquisition devices attached to the surface of the object. HumTouch sensing technology uses these currents for touch localization on papers [35, 37], woods [36], and in water [38] and gesture recognition [34].

Fig. 2
figure 2

a Semiconductive paper marked with 49 points at intervals of 2.5 and 2.25 cm. An electrode is attached to the center of each side of the paper (total of four electrodes). b Dry and flexible paper

Material and setting

We used a \(20 \times 18~\text {cm}^2\) wiping paper (Kimtowel, Nippon Paper Crecia Co. Ltd., Japan) as the experimental material. The paper was painted with a semiconductive ink [34], which contained 15 g of polyvinyl alcohol, 300 mL of ultrapure water, 75 mL of polyethylene glycol 400, and 37.5 mL of glutaraldehyde. After painting, the paper was dried at room temperature for a week. After these processes, the paper remained dry and flexible, as shown in Fig. 2.

Further, \(7 \times 7\) points were marked on the paper at intervals of 2.5 cm and 2.25 cm. The ratio of these intervals follows the dimensions of the paper. An electrode was attached to the center of each side of the paper (total of four electrodes), following [37], as depicted in Fig. 2a. These electrodes were then connected to an oscilloscope (HS6DIFF, TiePie Engineering, Netherlands; sampling frequency: 500 kHz) to record the voltages on the surface.

Experimental procedure

Experiments were conducted in an office room. Six participants (male university students above 20 years), who provided written informed consent, were involved in the experiments. Each participant was asked to touch each of the 49 marked points on the paper with their right index finger for approximately 1 s. This procedure was repeated five times to collect five sample sets from the individual participants. The contact force was not restricted because the voltage rarely changed with the contact force [37]. In addition, to confirm that the participants were well grounded, they sat still with their two feet firmly on the ground. At least, one foot needed to be on the ground to record the voltages driven by hum noise. Further, they removed their shoes and remained in socks because some shoes deterred the data collection.

Data analysis

Localization methods are described in Section 3 that includes three methods based on kernel regression analysis. The first method, i.e., personalized model, establishes estimation models by using only the samples of a certain person for localizing his/her touch. The second method, i.e., general model, establishes the model by using the samples of several people for localizing the touch of another individual. The third method, i.e., semipersonalized model, uses a few samples from a certain participant and many samples from other participants to prepare a model for that participant. Three methods are based on the kernel regression analysis method, and comparison with other potential methods is not considered.

Localization methods

Voltage-data preprocessing

The hum-noise in our experimental setting was a 50 Hz voltage signal. To reduce the influence of noise, we applied a moving average filter of length 0.2 ms with cut-off frequency of 2.2 kHz. After the noise-removal process, we recorded the maximum value detected in each electrode during 1 s as \(v_{i,j,e}\), where \(i \in \{1, ... , 245\}\), \(j \in \{1, ..., 6\}\), and \(e \in \{1, ..., 4\}\) indicate the trial, participant, and electrode, respectively. The normalized maximum voltage \({z_{i,j,e}}\) is then computed as follows:

$$\begin{aligned} {z_{i,j,e}} = \frac{v_{i,j,e}-{\bar{v}}_{i,j}}{\sigma _{i,j}}, \end{aligned}$$
(1)

where \({\bar{v}}_{i,j}\) and \(\sigma _{i,j}\) are the mean and standard deviation for \( v _{i, j,1}\)-\( v _{i, j,4}\).

Kernel regression model for fully-personalized localization (Personalized model)

We applied kernel regression analysis, known as nonlinear multiple regression analysis, to find the relationship between the touched locations and the recorded voltages because the relationship between the two variables is nonlinear. As a personalized localization model [35, 37], a regression model was constructed using data recorded from a single participant as the learning data. Note that the learning and test data were separated in a leave-one-out cross-validation manner, where four of the five sample sets were used to build the model and the remaining set was used as the test set.

The location of each marked point was defined using a two-dimensional Cartesian coordinate system. The estimated location \(({\hat{x}}, {\hat{y}})\) for the vector of normalized voltages \(\varvec{z} \in (z_1, ..., z_4)^\text{T}\) is computed as follows:

$$\begin{aligned} \begin{bmatrix} \hat{x(\varvec{z})}\\ \\ \hat{y(\varvec{z})} \end{bmatrix} = \begin{bmatrix} \sum _{i = 1}^{n}\alpha _{x,i}\text {exp}(-\Vert \varvec{ z _i}-\varvec{ z }\Vert ^2)\\ \\ \sum _{i = 1}^{n}\alpha _{y,i}\text {exp}(-\Vert \varvec{ z _i}-\varvec{ z }\Vert ^2) \end{bmatrix}, \end{aligned}$$
(2)

where n is the number of samples (four trials \(\times \) 49 points = 196), and \({\varvec{z}}_i = (z_{i,j,1},...,z_{i,j,4})^\text {T}\) are the normalized voltages for the learning samples of a single participant’s i-th trial, and \(\Vert .\Vert \) is the L2 norm. Coefficients \(\alpha _{x,i}\) and \(\alpha _{y,i}\) are the i-th elements of coefficient vectors \(\varvec{\alpha _{x}} \in \mathbf {{\mathbb {R}}}^{n \times 1}\) and \(\varvec{\alpha _{y}} \in \mathbf {{\mathbb {R}}}^{n \times 1}\), respectively. The least squares solution of the coefficients are computed as follows:

$$\begin{aligned} \varvec{\alpha _{x}} = ({\varvec{K}} + \lambda {{\varvec{I}}})^{-1}\varvec{ x } \end{aligned}$$
(3)
$$\begin{aligned} \varvec{\alpha _{y}} = ({\varvec{K}} + \lambda {{\varvec{I}}})^{-1}\varvec{ y }, \end{aligned}$$
(4)

where \(\varvec{ x }= (x_{1}, ...,x_{n})^{\text {T}}\) and \(\varvec{ y }=(y_{1}, ..., y_{n})^{\text {T}}\) are the actual x and y locations for the learning samples, respectively, and matrix \({\varvec{K}} \in \mathbf {{\mathbb {R}}}^{n \times n}\) is given by

$$\begin{aligned} {\varvec{K}} = \begin{bmatrix} \text {exp}(-\Vert \varvec{ z }_1-\varvec{ z }_1\Vert ^2) &{} \dots &{} \text {exp}(-\Vert \varvec{ z }_1-\varvec{ z }_n\Vert ^2) \\ \vdots &{} \ddots &{} \vdots \\ \text {exp}(-\Vert \varvec{ z }_n-\varvec{ z }_1\Vert ^2) &{} \dots &{} \text {exp}(-\Vert \varvec{ z }_n-\varvec{ z }_n\Vert ^2) \end{bmatrix}. \end{aligned}$$
(5)

With reference to our previous study [37], the regularization value \(\lambda \) = 0.001. \({\varvec{I}}\) is an \(n \times n\) unit matrix.

Kernel regression model built using data from various participants (General model)

As a general model for a certain participant, a regression model was constructed using the data recorded from the other five participants. Hence, the general model is the opposite of the personalized model, which only uses the data of a single target participant. The general model was computed for each of the six participants. The estimated location is computed as follows:

$$\begin{aligned} \begin{bmatrix} {\hat{x}}\\ \\ {\hat{y}} \end{bmatrix} = \begin{bmatrix} \sum _{s= 1}^{m}\alpha _{x,s}\text {exp}(-\Vert \varvec{ z_s }-\varvec{ z }\Vert ^2) \\ \\ \sum _{s= 1}^{m}\alpha _{y,s}\text {exp}(-\Vert \varvec{ z_s }-\varvec{ z }\Vert ^2) \end{bmatrix}, \end{aligned}$$
(6)

where m is the number of samples (five participants \(\times \) five trials \(\times \) 49 points = 1470) and \({\varvec{z}}_s=(z_{i,j,1},...,z_{i,j,4})^\text {T}\) are the normalized voltages of learning sample \(s \in \{1,...,m\}\). Coefficients \(\alpha _{x,s}\) and \(\alpha _{y,s}\) are the s-th elements of coefficient vectors \(\varvec{\alpha _{x}}\) and \(\varvec{\alpha _{y}}\), respectively. These coefficients are computed using (3) and (4), with \({\varvec{K}} \in \mathbf {{\mathbb {R}}}^{m \times m}\), \({\varvec{x}} \in \mathbf {{\mathbb {R}}}^{m \times 1}\), and \({\varvec{y}} \in \mathbf {{\mathbb {R}}}^{m \times 1}\).

Weighted kernel regression model for semipersonalized localization (Semipersonalized model)

Addition of extra samples from the target user

To build a semipersonalized model for a certain participant, we added one or more samples recorded by the participant to the learning data set collected from the other participants. This expanded learning dataset for kernel regression analysis includes \(1470 + l\) samples, where l is the number of extra samples from the target participant. l ranges from one–five (\(l \in \{1, ..., 5\}\)).

We investigated the effect of the number and location of the extra l samples. Figure 3 shows their locations. To add one sample from the target participant (\(l = 1\)), we tested the nine locations indicated in Fig. 3a (points near the corner (point 11), center (point 44), and seven other points). To add two samples (\(l = 2\)), we tested the three pairs of points indicated in Fig. 3b ((point 11, 44), (point 14, point 44), and (point 11, point 14)). For adding three samples (\(l = 3\)), combinations of (points 11, 17, 44) and (points 14, 41, 44) were tested, as shown in Fig. 3c. For adding four samples (\(l = 4\)), combinations of (points 11, 17, 44, 71) and (points 14, 41, 44, 74) were tested, as shown in Fig. 3d. To add five samples (\(l = 5\)), combinations of (points 11, 17, 44, 71, 77) and (points 14, 41, 44, 47, 74) were tested, as shown in Fig. 3e.

Fig. 3
figure 3

ae Location of the extra samples when a one, b two, c three, d four, and e five extra samples are added from the target participant to the learning data-set for building a semipersonalized model

Weighting of the extra samples from the target user

We expected that including extra samples from the target participant reduces the localization error. Weighted kernel regression analysis was performed by adjusting coefficients \(\varvec{\alpha _{x}}\) and \(\varvec{\alpha _{y}}\) as follows:

$$\begin{aligned} \varvec{\alpha _{x}} = ({\varvec{K}}^\text {T}{{\varvec{W}}}{{\varvec{K}}} + \lambda {{\varvec{I}}})^{-1}{\varvec{K}}^\text {T}\varvec{ Wx } \end{aligned}$$
(7)
$$\begin{aligned} \varvec{\alpha _{y}} = ({\varvec{K}}^\text {T}{{\varvec{W}}}{{\varvec{K}}} + \lambda {{\varvec{I}}})^{-1}{\varvec{K}}^\text {T}\varvec{ Wy }. \end{aligned}$$
(8)

Matrix \({\varvec{W}} \in \mathbf {{\mathbb {R}}}^{(m+l) \times (m+l)}\) is given by

$$\begin{aligned} {\varvec{W}} = \begin{bmatrix} {\varvec{I}} &{} {\varvec{0}}\\ {\varvec{0}} &{} {\varvec{U}} \end{bmatrix}, \end{aligned}$$
(9)

where I is an \(n \times n\) unit matrix and \(U = \text {diag}(w, w, ...) \in \mathbf {{\mathbb {R}}}^{l \times l}\) is the weight matrix, where w is the weight value. Weight value \(w=\) 1, 10, 100, or 1000.

Fig. 4
figure 4

Results of the personalized model constructed using samples from an individual target participant: a Actual locations of the 49 points. (P1–P6) Mean estimated location and standard deviation of each of the six participants, respectively

Results

Personalized model: touch localization with the model constructed using samples from one participant

We established localization models for the individuals. For each participant, four sample sets were used as the training dataset and one was used as the test set, applying leave-one-out cross-validation. Figure 4 shows the mean and standard deviation of the localization for each participant. Further, we computed the arithmetic mean of the absolute errors for each marked point and participant. The mean estimation error among the six participants was 0.60 cm. Participant P4 exhibits the least mean localization error of 0.44 cm, whereas P6 exhibits the highest mean error of 0.83 cm. These estimation errors are generally considered small because they are lesser than the mean width of index fingertips of Japanese males: 13.9 cm [39]. Note that the error values of the fully personalized models can be used as the benchmark scores for evaluating the other methods in this study. The estimation errors of the semipersonalized model are expected to be close to these errors.

General model: localization with the model constructed using samples from other participants

Figure 5 shows the results of the regression models constructed using the data of participants other than the tested participant. The mean estimation error among the six participants is 1.24 cm. For all the participants, the estimation errors are greater than those of the personalized model. Participant P4 exhibits a mean error below 1 cm; however, the mean errors for the other participants are equal to or greater than 1 cm. The errors of the semipersonalized model are expected to be lesser than those of the nonpersonalized general model.

The aforementioned results suggest the extent of difference among individuals. P5 and P6 may be distinctive from the others in terms of the mean estimation errors. Their mean estimation errors were 1.69 cm and 1.58 cm, respectively, whereas those for the other participants were less than 1.30 cm. Further, as shown in Fig. 5, P6 exhibited large standard deviations. For this participant, reproducibility was relatively low whereas the standard deviations were minor for the other participants. The root cause of such variability within participants is unclear. The number of the participants is small and we cannot estimate the properties of population.

Fig. 5
figure 5

Results of the general model constructed using samples from participants other than the target participant: a Actual locations of the 49 points. (P1–P6) Mean estimated location and standard deviation of each of the six participants, respectively

Fig. 6
figure 6

Results of the semipersonalized model using point 44 with \(w = 1000\). a Actual locations of the 49 marked points. (P1–P6) Mean estimated location and standard deviation of each of the six participants, respectively

Table 1 Mean localization errors (cm) of the personalized, general, and semipersonalized models for participants P1 to P6. For the semipersonalized model, weight \(w = 1\) unless otherwise specified

Semipersonalized model: localization with the model constructed using a few target-user samples and the sample sets of other participants

Table 1 lists the mean localization errors for all the participants.

When single extra samples from the target participants are used for calibration, the total mean error ranges from 0.91–0.90 cm, irrespective of the location of the extra sample. When point 44 is used, the mean errors for P5 and P6 are 1.33 and 1.25 cm, respectively, which are lesser than the errors when the other points are used. Hence, point 44, which is near the center, exhibits the best localization accuracy among all the tested points, although the differences in the accuracy are negligible.

As shown in Table 1, when the extra sample (i.e., point 44) is weighted with \(w = 10\), 100, and 1000, the mean errors are 0.90 cm for all w values. Figure 6 displays the mean and standard deviation of the localization when \(w = 1000\). The mean localization errors for the individual participants are lesser than those of the general model, as depicted in Fig. 5.

When two extra samples from the tested target participants are used for calibration, the total mean localization error is approximately 0.90 cm, irrespective of the combination of points. When three, four, or five extra samples are used, the total mean errors range 0.89–0.90 cm.

Fig. 7
figure 7

Comparison of the total mean errors. The general model obviously exhibits greater error than the semipersonalized one. The personalized model with smaller error than those of the general and semipersonalized models is also shown for reference. *** indicates \(p < 0.001\) as per the two-tailed t-test with one sample with no p-value adjustment for multiple comparisons

Figure 7 depicts the localization errors among the general, several semipersonalized, and personalized models. The mean error of the semipersonalized model using point 44 with no weight value (\(w = 1\)) is lesser than that of the general model (two-tailed t-test with one sample, \(t = 15.77\), \(p = 1.86 \times 10^{-5}\) with no p-value adjustment for multiple comparisons). The mean error of the semipersonalized model using point 44 weighted by 1000 is lesser than that of the general model (two-tailed t-test with one sample, \(t = 15.50\), \(p = 2.03 \times 10^{-5}\) with no p-value adjustment for multiple comparisons). There are significant differences between the other semipersonalized models using more than one extra point and the general model, as shown in Fig. 7.

Discussion

As listed in Table 1, the localization error of the personalized model is 0.60 cm on an average and substantially lesser than that of the general (nonpersonalized) model (1.24 cm). For the individual participants, the errors of the general model are nearly equal to or more than twice that of the personalized model. The average errors of the semipersonalized models range from 0.89–0.92 cm, indicating that the localization accuracy of the semipersonalized model developed in this study is between those of the personalized and general models. As the size of the contact-area of the fingertip is approximately a 1.0 cm-diameter circle, localization errors of 0.90 cm may be acceptable for most touch-sensor applications, although our study does not assume specific applications.

When the HumTouch technique is applied to square paper, the points near the corner and center involve relatively large localization errors. This is because the localization accuracy is relatively poor at points far from the electrodes [37]. The points near the corner and center of the paper are far from all the electrodes placed at the center of each side of the paper. The semipersonalized model can reduce the localization errors near an area by incorporating an extra sample of the target participant near the area. Thus, the calibration ability with different points has been investigated in this study. As listed in Table 1, when single extra points are used for the semipersonalized model, the estimation error obtained by adding a point in the center (i.e., point 44) has the least total mean error of 0.90 cm. In addition, by weighting the sample for point 44, the mean estimation error is further reduced, although this reduction is practically null. However, adding the extra sample is effective only for the surrounding area. The localization errors for the points in the other areas remain large. For example, as illustrated in Fig. 6, for the points near point 44 (the center point in each subfigure), the localization errors are corrected compared to those with the general model; however, the points near point 77 (right-down in each sub-figure) include localization error. Nonetheless, this study establishes that by including only a single sample, the nonpersonalized general model can be converted into a semipersonalized model with small localization errors.

Figure 7 shows that the localization errors of the nonpersonalized general model are reduced by 27.8% by adding only one sample of the target participant. However, the addition of more than one sample is not markedly effective in reducing the error. For example, adding five extra samples improves the localization accuracy by merely 0.007 cm, compared to the case where only one extra sample is used. Furthermore, weighting the extra samples is ineffective in reducing the error. As aforementioned, adding extra samples reduces the localization errors in the area nearby those points; however, it does not greatly influence other area. Hence, weighting extra samples may not effectively reduce the mean localization errors. Collectively, based on the results, a new unknown user can complete his/her calibration to improve the localization accuracy by simply touching one designated point on the material surface.

An interesting question is how only one extra sample could improve the estimation accuracy. The number of samples used to establish generalized models is an important factor. The extra samples can be more effective when the sample size for the generalized model is small. In such a case, the generalized model does not perform well and can be substantially improved by incorporating extra samples. In contrast, the effects of extra samples may be relatively minor when the generalized model is established on the basis of a large sample. Hence, there should be an appropriate sample size for establishing the generalized model, which minimizes the estimation errors of semipersonalized model.

This study has certain limitations. Only six participants were involved in the experiment. It is unclear whether semipersonalized models should be based on a large number of participants. The number of participants and samples may influence the additional number of samples necessary for constructing semipersonalized models. Potentially, the more the participants and samples, the more are the extra samples necessary to establish semipersonalized models because the effect of extra samples of the target user are obscured by the large number of samples from others. In contrast, semipersonalized models based on a few people may not be highly adaptive to unknown users. Hence, the number of people incorporated in the semipersonalized model is speculated to be a crucial design parameter. This study did not aim at optimizing the localization method. The methods based on kernel regression analysis were not compared with others. Kernel regression analysis is a suitable method for the problems discussed here; however, more effective methods must be explored. Furthermore, in hum-noise-based sensors, the causes for individual differences are unclear and have not been thoroughly discussed. If the individual differences are determined by certain parameters, such as the body weight, then another approach completely different from the one adopted in this study can be employed to build semipersonalized models. In addition, it is to be noted that localization errors are generally greater for larger surfaces [37]. If the method proposed in this study is applied to a larger surface, the localization errors may not be as small as the fingertip size.

Conclusion

We proposed an easy-to-use calibration method for unknown users of HumTouch, a hum-noise-based touch sensing method. Because of the individual differences in hum-noise-driven currents in human bodies, HumTouch sensors need to be calibrated for individual users, limiting their range of application. The proposed method incorporates numerous samples collected from other people and a few weighted new samples from a new target user to establish a semipersonalized model for the new user. When a square paper was used as a touch-sensitive surface, the mean localization error was reduced from 1.24 to 0.90 cm by adding a new point from the target user to the sample set obtained from other people. This localization error is smaller than the size of a human fingertip. Therefore, the semipersonalized localization model using a weighted or nonweighted sample from the target user is practical for hum-noise-based touch sensors.

Availability of data and materials

The data used for analysis can be accessed by contacting the corresponding author.

References

  1. An J, Hong S, Kwon O (2016) A highly linear and accurate touch data extraction algorithm based on polar coordinates for large-sized capacitive touch screen panels. IEEE Trans Consum Electron 62(4):341–348

    Article  Google Scholar 

  2. Grosse-Puppendahl T, Holz C, Cohn G, Wimmer R, Bechtold O, Hodges S, Reynolds MS, Smith JR (2017) Finding common ground: a survey of capacitive sensing in human-computer interaction Association for Computing Machinery, pp 3293–3315

  3. Ozioko O, Navaraj W, Hersh M, Dahiya R (2020) Tacsac: a wearable haptic device with capacitive touch-sensing capability for tactile display. Sensors 20(17):4780

    Article  Google Scholar 

  4. Fulton WS, Lipczynski RT (1993) Body-support pressure measurement using electrical impedance tomography. In: Proceedings of 15th annual international conference of the IEEE engineering in medicine and biology Societ, IEEE, pp 98–99.

  5. Booth MJ, Basarab-Horwath I (1996) Comparing electrode configurations for electrical impedance tomography. Electron Lett 32(7):648–649

    Article  Google Scholar 

  6. Silvera-Tawil D, Rye D, Soleimani M, Velonaki M (2015) Electrical impedance tomography for artificial sensitive robotic skin: a review. IEEE Sens J 15(4):2001–2016

    Article  Google Scholar 

  7. Yang Z, Gierad L, Chris H (2017) Electrick: Low-cost touch sensing using electric field tomography. In: Proceedings of 2017 CHI conference on human factors in computing systems, pp 1–14

  8. Akaoka E, Ginn T, Vertegaal R (2010) Displayobjects: Prototyping functional physical interfaces on 3d styrofoam, paper or cardboard models. In: Proceedings of the fourth international conference on tangible, embedded, and embodied interaction, pp 49–56

  9. Chen YL, Liang WY, Chiang CY, Hsieh TJ, Lee DC, Yuan SM, Chang YL (2011) Vision-based finger detection, tracking, and event identification techniques for multi-touch sensing and display systems. Sensors 11(7):6868–6892

    Article  Google Scholar 

  10. Liang J, Lin K, Chen H, Wang W (2018) Turn any display into a touch screen using infrared optical technique. IEEE Access 6:13033–13040

    Article  Google Scholar 

  11. Suto S, Watanabe T, Shibusawa S, Kamada M (2018) Multi-touch tabletop system using infrared image recognition for user position identification. Sensors 18(5):1559

    Article  Google Scholar 

  12. Sferrazza C, D’Andrea R (2019) Design, motivation and evaluation of a full-resolution optical tactile sensor. Sensors 19(4):928

    Article  Google Scholar 

  13. Shimojo M, Namiki A, Ishikawa M, Makino R, Mabuchi K (2004) A tactile sensor sheet using pressure conductive rubber with electrical-wires stitched method. IEEE Sens J 4(5):589–596

    Article  Google Scholar 

  14. Mazzeo AD, Kalb WB, Chan L, Killian MG, Bloch J, Mazzeo BA, Whitesides GM (2012) Paper-based, capacitive touch pads. Adv Mater 24(21):2850–2856

    Article  Google Scholar 

  15. Hua Q, Sun J, Liu H, Bao R, Yu R, Zhai J, Pan C, Wang ZL (2018) Skin-inspired highly stretchable and conformable matrix networks for multifunctional sensing. Nat Commun 9(1):1–11

    Article  Google Scholar 

  16. Matsuno T, Wang Z, Althoefer K, Hirai S (2019) Adaptive update of reference capacitances in conductive fabric based robotic skin. IEEE Robot Autom Lett 4(2):2212–2219

    Article  Google Scholar 

  17. Valasma R, Bozo E, Pitkänen O, Jarvinen T, Dombovari A, Mohl M, Lorite GS, Kiss J, Konya Z, Kordas K (2020) Grid-type transparent conductive thin films of carbon nanotubes as capacitive touch sensors. Nanotechnology 31(30):305303

    Article  Google Scholar 

  18. Shahid L, Shahid H, Riaz MA, Naqvi S, Khan MS, Amin Y, Loo J (2019) Chipless rfid tag for touch event sensing and localization. IEEE Access 8:502–513

    Article  Google Scholar 

  19. Oh JY, Park J-H, Park J-M (2020) Fingertouch: Touch interaction using a fingernail-mounted sensor on a head-mounted display for augmented reality. IEEE Access 8:101192–101208

    Article  Google Scholar 

  20. Chang CS, Lee YC (2020) Ultrasonic touch sensing system based on lamb waves and convolutional neural network. Sensors 20(9):2619

    Article  Google Scholar 

  21. Tsuji T, Kaneko Y, Abe S (2009) Whole-body force sensation by force sensor with shell-shaped end-effector. IEEE Trans Industr Electron 56(5):1375–1382

    Article  Google Scholar 

  22. Tsuji T, Kurita N, Sakaino S (2014) Development of a desk-type tactile interface using force sensors. In: Proceedings of the 40th international conference on industrial electronics, control and instrumentation, pp 5248–5253

  23. Tsuji T, Kurita N, Sakaino S (2014) Whole-body tactile sensing through a force sensor using soft materials in contact areas. Robomech J 1:11

    Article  Google Scholar 

  24. Sato K, Canete L, Takahashi T (2019) Development of a spray-coated tactile sensor—prototype and modeling of 2d sensor on cylindrical surface. J Robot Mechatron 31(6):882–893

    Article  Google Scholar 

  25. Ando M, Takei T, Mochiyama H (2020) Rubber artificial skin layer with flexible structure for shape estimation of micro-undulation surfaces. Robomech J 7:11

    Article  Google Scholar 

  26. Sato S, Okamoto S, Matsuura Y, Yamada Y (2017) Wearable finger pad deformation sensor for tactile textures in frequency domain by using accelerometer on finger side. Robomech J 4:19

    Article  Google Scholar 

  27. Cohn G, Morris D, Patel S, Tan D (2011) Your noise is my command: Sensing gestures using the body as an antenna. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 791–800

  28. Cohn G, Morris D, Patel S, Tan D (2012) Humantenna: Using the body as an antenna for real-time whole-body interaction. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 1901–1910

  29. Tobias G-P, Xavier D, Christian H, Biying F, Mario K, Arjan K, Matthias RH, James S, Marco G (2016) Platypus - indoor localization and identification through sensing electric potential changes in human bodies. In: Proceedings of 14th annual international conference on mobile systems, applications, and services, pp 17–30

  30. Laput G, Yang C, Xiao R, Sample A, Harrison C (2015) Em-sense: touch recognition of uninstrumented, electrical and electromechanical objects. In: Proceedings of the 28th annual ACM symposium on user interface software & technology, pp 157–166 . https://doi.org/10.1145/2807442.2807481

  31. Elfekey H, Okamoto S (2016) Turning surfaces into touch panels: a granite-touch pad. In: Hasegawa S, Konyo M, Kyung K-U, Nojima T, Kajimoto H (eds) Haptic interaction: science, engineering and design. Lecture nNotes in electrical engineering, vol 432. Springer, pp 301–304

    Chapter  Google Scholar 

  32. Elfekey H, Bastawrous HA, Okamoto S (2016) A touch sensing technique using the effects of extremely low frequency fields on the human body. Sensors 16(12):2049

    Article  Google Scholar 

  33. Elfekey H, Okamoto S, Yamada Y (2017) Localization of touch on granite based on AC hum noise. In: Proceeding of IEEE global conference on consumer electronics, pp 163–164

  34. Tachi K, Okamoto S, Akiyama Y, Yamada Y (2019) HumTouch: finger Gesture Recognition on Hydrogel-painted Paper Using Hum-driven Signals. In: Proceedings of IEEE global conference on consumer electronic, pp 157–159

  35. Hsia TH, Okamoto S, Akiyama Y, Yamada Y (2020) Humtouch: Kernel regression-based localization of touch on a paper. In: Proceedings of IEEE global conference on life sciences and technologies, pp 28–30

  36. Hsia TH, Okamoto S, Akiyama Y, Yamada Y (2020) HumTouch: localization of touch on a cylindrical object. In: Proceedings of IEEE global conference on consumer electronics, pp 386–388

  37. Hsia TH, Okamoto S, Akiyama Y, Yamada Y (2021) HumTouch: localization of touch on semi-conductive surfaces by sensing human body antenna signal. Sensors 21(3):859

    Article  Google Scholar 

  38. Hsia T-H, Okamoto S, Akiyama Y, Yamada Y (2022) Humtouch: Localization of a finger in purified water using humming-noise-driven human-body electric currents. In: Proceedings of IEEE 4th global conference on life sciences and technologies, pp 69–71

  39. National Institute of Advanced Industrial Science and Technology: Human Hands’ Data of Japanese People. https://www.airc.aist.go.jp/dhrt/hand/data/list.html

Download references

Acknowledgements

We thank all the participants of the experiment.

Funding

This study was supported in part by MEXT Kakenhi Grant nos. #21H05819 and #20H04263.

Author information

Authors and Affiliations

Authors

Contributions

Design, experiment, data curation, analysis: T-HH and SO. Funding: SO. Theory, writing: T-HH, SO, YA, YY. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Shogo Okamoto.

Ethics declarations

Ethics approval and consent to participate

The experimental procedure was approved by the institutional review board of the School of Engineering, Nagoya University (#20-8).

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hsia, TH., Okamoto, S., Akiyama, Y. et al. One-touch calibration of hum-noise-based touch sensor for unknown users utilizing models trained by different users. Robomech J 9, 24 (2022). https://doi.org/10.1186/s40648-022-00238-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40648-022-00238-4

Keywords