Abstract
Brain-inspired Hyperdimensional Computing (HDC), a machine learning (ML) model featuring high energy efficiency and fast adaptability, provides a promising solution to many real-world tasks on resource-limited devices. This paper introduces an HDC-based user adaptation framework, which requires efficient fine-tuning of HDC models to boost accuracy. Specifically, we propose two techniques for HDC, including the learnable projection and the fusion mechanism for the Associative Memory (AM). Compared with the user adaptation framework based on the original HDC, our proposed framework shows 4.8% and 3.5% of accuracy improvements on two benchmark datasets, including the ISOLET dataset and the UCIHAR dataset, respectively.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsChange history
22 June 2021
A correction has been published.
References
Gubbi, J., Buyya, R., Marusic, S., Palaniswami, M.: Internet of Things (IoT): a vision, architectural elements, and future directions. Future Gener. Comput. Syst. 29(7), 1645–1660 (2013)
Song, M., et al.: In-Situ AI: towards autonomous and incremental deep learning for iot systems. In: IEEE International Symposium on High Performance Computer Architecture (HPCA), Vienna, Austria, pp. 92–103. IEEE (2018)
Rahimi, A., Kanerva, P., Benini, L., Rabaey, J.M.: Efficient biosignal processing using hyperdimensional computing: Network templates for combined learning and classification of ExG signals. Proc. IEEE 107(1), 123–143 (2019)
He, J., Zhang, D., Jiang, N., Sheng, X., Farina, D., Zhu, X.: User adaptation in long-term, open-loop myoelectric training: implications for EMG pattern recognition in prosthesis control. J. Neural Eng. 12(4), (2015)
Choi, S., Sim, J., Kang, M., Choi, Y., Kim, H., Kim, L.S.: An energy-efficient deep convolutional neural network training accelerator for in situ personalization on smart devices. IEEE J. Solid-State Circuits 55(10), 2691–2702 (2020)
Lange, M.D., Jia, X., Parisot, S., Leonardis, A., Slabaugh, G., Tuytelaars, T.: Unsupervised model personalization while preserving privacy and scalability: an open problem. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 14463–14472 (2020)
Matsui, S., Inoue, N., Akagi, Y., Nagino, G., Shinoda, K.: User adaptation of convolutional neural network for human activity recognition. In: 25th European Signal Processing Conference (EUSIPCO), Kos, pp. 753–757. IEEE (2017)
Satyanarayanan, M.: The emergence of edge computing. Computer 50(1), 30–39 (2017)
Huang, S.A., Chang, K.C., Liou, H.H., Yang, C.H.: A 1.9-MW SVM processor with on-chip active learning for epileptic seizure control. IEEE J. Solid-State Circuits 55(2), 452–464 (2019)
Choi, S., Shin, J., Choi, Y., Kim, L.S.: An optimized design technique of low-bit neural network training for personalization on IoT devices. In: Proceedings of the 56th Annual Design Automation Conference, pp. 1–6 (2019)
Kanerva, P.: Hyperdimensional computing: an introduction to computing in distributed representation with high-dimensional random vectors. Cognit. Comput. 1(2), 139–159 (2009)
Chang, C.-Y., Chuang, Y.-C., Wu, A.-Y.A.: Task-projected hyperdimensional computing for multi-task learning. In: Maglogiannis, I., Iliadis, L., Pimenidis, E. (eds.) AIAI 2020. IAICT, vol. 583, pp. 241–251. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49161-1_21
Chuang, Y.-C., Chang, C.-Y., Wu, A.-Y.A.: Dynamic hyperdimensional computing for improving accuracy-energy efficiency trade-offs. In: IEEE Workshop on Signal Processing Systems (SiPS), Coimbra, Portugal, pp. 1–5. IEEE (2020)
Chang, C.-Y., Chuang, Y.-C., Wu, A.-Y.A.: IP-HDC: information-preserved hyperdimensional computing for multi-task learning. In: IEEE Workshop on Signal Processing Systems (SiPS), Coimbra, Portugal, pp. 1–6. IEEE (2020)
Chang, E.J., Rahimi, A., Benini, L., Wu, A.Y.: Hyperdimensional computing-based multimodality emotion recognition with physiological signals. In: IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS), Hsinchu, Taiwan, pp. 137–141. IEEE (2019)
Uci machine learning repository. http://archive.ics.uci.edu/ml/datasets/ISOLET. Accessed 01 Mar 2021
Anguita, D., Ghio, A., Oneto, L., Parra, X., Reyes-Ortiz, J.L.: A public domain dataset for human activity recognition using smartphones. In: European Symposium on Artificial Neural Networks, pp. 1–3 (2013)
Plate, T.A.: Holographic reduced representations. IEEE Trans. Neural Netw. 6(3), 623–641 (1995)
Courbariaux, M., Hubara, I., Soudry, D., El-Yaniv, R., Bengio, Y.: Binarized neural networks: training deep neural networks with weights and activations constrained to +1 or −1. arXiv preprint arXiv:1602.02830 (2016)
Acknowledgments.
This work was supported by the Ministry of Science and Technology of Taiwan under Grants MOST 109-2221-E-002-175 and MOST 110-2218-E-002-034 -MBK.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Hsiao, YR., Chuang, YC., Chang, CY., Wu, AY.(. (2021). Hyperdimensional Computing with Learnable Projection for User Adaptation Framework. In: Maglogiannis, I., Macintyre, J., Iliadis, L. (eds) Artificial Intelligence Applications and Innovations. AIAI 2021. IFIP Advances in Information and Communication Technology, vol 627. Springer, Cham. https://doi.org/10.1007/978-3-030-79150-6_35
Download citation
DOI: https://doi.org/10.1007/978-3-030-79150-6_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-79149-0
Online ISBN: 978-3-030-79150-6
eBook Packages: Computer ScienceComputer Science (R0)
