Hostname: page-component-8448b6f56d-42gr6 Total loading time: 0 Render date: 2024-04-23T07:57:55.427Z Has data issue: false hasContentIssue false
  • English
  • Français

Neuroprosthetic Speech: The Ethical Significance of Accuracy, Control and Pragmatics

Published online by Cambridge University Press:  02 September 2019

STEPHEN RAINEY ,
HANNAH MASLEN ,
PIERRE MÉGEVAND ,
LUC H. ARNAL ,
ERIC FOURNERET  and
BLAISE YVERT
Get access Rights & Permissions [Opens in a new window]

Abstract:

Neuroprosthetic speech devices are an emerging technology that can offer the possibility of communication to those who are unable to speak. Patients with ‘locked in syndrome,’ aphasia, or other such pathologies can use covert speech—vividly imagining saying something without actual vocalization—to trigger neural controlled systems capable of synthesizing the speech they would have spoken, but for their impairment.

We provide an analysis of the mechanisms and outputs involved in speech mediated by neuroprosthetic devices. This analysis provides a framework for accounting for the ethical significance of accuracy, control, and pragmatic dimensions of prosthesis-mediated speech. We first examine what it means for the output of the device to be accurate, drawing a distinction between technical accuracy on the one hand and semantic accuracy on the other. These are conceptual notions of accuracy.

Both technical and semantic accuracy of the device will be necessary (but not yet sufficient) for the user to have sufficient control over the device. Sufficient control is an ethical consideration: we place high value on being able to express ourselves when we want and how we want. Sufficient control of a neural speech prosthesis requires that a speaker can reliably use their speech apparatus as they want to, and can expect their speech to authentically represent them. We draw a distinction between two relevant features which bear on the question of whether the user has sufficient control: voluntariness of the speech and the authenticity of the speech. These can come apart: the user might involuntarily produce an authentic output (perhaps revealing private thoughts) or might voluntarily produce an inauthentic output (e.g., when the output is not semantically accurate). Finally, we consider the role of the interlocutor in interpreting the content and purpose of the communication.

These three ethical dimensions raise philosophical questions about the nature of speech, the level of control required for communicative accuracy, and the nature of ‘accuracy’ with respect to both natural and prosthesis-mediated speech.

Keywords

covert speechethicsneuroprosthetic speechdecodingcommunicationaccuracycontrolpragmatics
Type
Article
Information
Cambridge Quarterly of Healthcare Ethics , Volume 28 , Special Issue 4: Clinical Neuroethics , October 2019 , pp. 657 - 670
Copyright
Copyright © Cambridge University Press 2019 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

The authors gratefully acknowledge funding from the BrainCom Project, Horizon 2020 Framework Programme (732032). Additionally, Dr Pierre Mégevand, from Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (167836).

References

Notes

1. Bocquelet, F, Hueber, T, Girin, L, Chabardès, S, Yvert, B. Key considerations in designing a speech brain-computer interface. Journal of Physiology-Paris 2016;110:392–401. https://doi.org/10.1016/j.jphysparis.2017.07.002.CrossRefGoogle ScholarPubMed

2. Bocquelet, F, Hueber, T, Girin, L, Savariaux, C, Yvert, B. Real-time control of an articulatory-based speech synthesizer for brain computer interfaces. PLOS Computational Biology 2016;12:e1005119. https://doi.org/10.1371/journal.pcbi.1005119.CrossRefGoogle ScholarPubMed

3. Chakrabarti, S, Sandberg, HM, Brumberg, JS, Krusienski, DJ. Progress in speech decoding from the electrocorticogram. Biomedical Engineering Letters 2015;5:10–21. https://doi.org/10.1007/s13534-015-0175-1.CrossRefGoogle Scholar

4. Mugler, EM, Patton, JL, Flint, RD, Wright, ZA, Schuele, SU, Rosenow, J, Shih, JJ, Krusienski, DJ, Slutzky, MW. Direct classification of all american english phonemes using signals from functional speech motor cortex. Journal of Neural Engineering 2014;11:035015. https://doi.org/10.1088/1741–2560/11/3/035015.CrossRefGoogle ScholarPubMed

5. Schmitt, BM, Münte, TF, Kutas, M. Electrophysiological estimates of the time course of semantic and phonological encoding during implicit picture naming. Psychophysiology 2000;37:473–84. https://doi.org/10.1111/1469-8986.3740473.CrossRefGoogle ScholarPubMed

6. Morin, A. Self-talk and self-awareness: On the nature of the relation. Journal of Mind & Behavior 1993;14:223–34.Google Scholar

7. Price, CJ. A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading. NeuroImage 2012;62:816–47. https://doi.org/10.1016/j.neuroimage.2012.04.062.CrossRefGoogle ScholarPubMed

8. Seeck, M, Schomer, D, Niedermeyer, E. Intracranial monitoring: depth, subdural, and foramen ovale electrodes. Neupsy Key; available at https://neupsykey.com/intracranial-monitoring-depth-subdural-and-foramen-ovale-electrodes/ (last accessed 12 Sept 2017).CrossRefGoogle Scholar

9. Leuthardt, E, Pei, X, Breshears, J, Gaona, C, Sharma, M, Freudenburg, Z, Barbour, D, Schalk, G. Temporal evolution of gamma activity in human cortex during an overt and covert word repetition task. Frontiers in Human Neuroscience 2012;99:1–6. https://doi.org/10.3389/fnhum.2012.00099.Google Scholar

10. Mesgarani, N, Cheung, C, Johnson, K, Chang, EF. Phonetic feature encoding in human superior temporal gyrus. Science 2014;343:1006–10. https://doi.org/10.1126/science.1245994.CrossRefGoogle ScholarPubMed

11. Bouchard, KE, Mesgarani, N, Johnson, K, Chang, EF. Functional organization of human sensorimotor cortex for speech articulation. Nature 2013;495:327–32. https://doi.org/10.1038/nature11911.CrossRefGoogle ScholarPubMed

12. Pasley, BN, David, SV, Mesgarani, N, Flinker, A, Shamma, SA, Crone, NE, Knight, RT, Chang, EF. Reconstructing speech from human auditory cortex. PLOS Biology 2012;10:e1001251. https://doi.org/10.1371/journal.pbio.1001251.CrossRefGoogle ScholarPubMed

13. See note 7, Price 2012, at 816–47.

14. Martin, S, Millán, J del R, Knight, RT, Pasley, BN. The use of intracranial recordings to decode human language: Challenges and opportunities. Brain and Language 2016 (in press). https://doi.org/10.1016/j.bandl.2016.06.003.Google ScholarPubMed

15. Ikeda, S, Shibata, T, Nakano, N, Okada, R, Tsuyuguchi, N, Ikeda, K, Kato, A. Neural decoding of single vowels during covert articulation using electrocorticography. Frontiers in Human Neuroscience 2014;125:1–8. https://doi.org/10.3389/fnhum.2014.00125.Google Scholar

16. Pei, X, Barbour, D, Leuthardt, EC, Schalk, G. Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans. Journal of Neural Engineering. 2011;8:046028. https://doi.org/10.1088/1741-2560/8/4/046028.CrossRefGoogle ScholarPubMed

17. Martin, S, Brunner, P, Iturrate, I, Millán, J del R, Schalk, G, Knight, RT, Pasley, BN. Word pair classification during imagined speech using direct brain recordings. Scientific Reports 2016;6:srep25803. https://doi.org/10.1038/srep25803.CrossRefGoogle ScholarPubMed

18. Wolpaw, JR, Birbaumer, N, McFarland, DJ, Pfurtscheller, G, Vaughan, TM. Brain–computer interfaces for communication and control. Clinical Neurophysiology 2002;113:767–91. https://doi.org/10.1016/S1388-2457(02)00057-3.CrossRefGoogle ScholarPubMed

19. Chaudhary, U, Birbaumer, N, Ramos-Murguialday, A. Brain–computer interfaces for communication and rehabilitation. Nature Reviews Neurology 2016;12:513–25. https://doi.org/10.1038/nrneurol.2016.113.CrossRefGoogle ScholarPubMed

20. Geva, S, Jones, PS, Crinion, JT, Price, CJ, Baron, J-C, Warburton, EA. The neural correlates of inner speech defined by voxel-based lesion–symptom mapping. Brain 2011;134:3071–82.CrossRefGoogle ScholarPubMed

21. Jarosiewicz, B, Sarma, AA, Bacher, D, Masse, NY, Simeral, JD, Sorice, B, et al. Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface. Science Translational Medicine 2015;7:313ra179. https://doi.org/10.1126/scitranslmed.aac7328.CrossRefGoogle ScholarPubMed

22. See note 1, Bocquelet et al. 2016, at 392–401.

23. Guenther, FH, Brumberg, JS, Wright, EJ, Nieto-Castanon, A, Tourville, JA, Panko, M, Law, R, Siebert, SA, Bartels, JL, Andreasen, DS, Ehirim, P, Mao, H, Kennedy, PR. A wireless brain-machine interface for real-time speech synthesis. PLOS ONE 2009;4:e8218. https://doi.org/10.1371/journal.pone.0008218.CrossRefGoogle ScholarPubMed

24. Birbaumer, N, Cohen, LG. Brain–computer interfaces: Communication and restoration of movement in paralysis. The Journal of Physiology 2007;579:621–36. https://doi.org/10.1113/jphysiol.2006.125633.CrossRefGoogle ScholarPubMed

25. Singer, P. Famine, Affluence, and Morality. Philosophy & Public Affairs 1972:229–43.Google Scholar

26. Poldrack, RA, Farah, MJ. Progress and challenges in probing the human brain. Nature 2015;526:371–9. https://doi.org/10.1038/nature15692.CrossRefGoogle ScholarPubMed

27. Winner, L. Technologies as forms of life. In: Kaplan, DM, ed. Readings in the Philosophy of Technology. Oxford: Rowman & Littlefield; 2004, at 103–13.Google Scholar

28. See note 10, Mesgarani et al. 2014, at 1006–10.

29. Garud, R, Rappa, MA. A socio-cognitive model of technology evolution: The case of cochlear implants. Organization Science 1994;5:344–62.CrossRefGoogle Scholar

30. Pulvermüller, F, Huss, M, Kherif, F, Martin, FM del P, Hauk, O, Shtyrov, Y. Motor cortex maps articulatory features of speech sounds. Proceedings of the National Academy of Sciences 2006;103:7865–70. https://doi.org/10.1073/pnas.0509989103.CrossRefGoogle ScholarPubMed

31. Zheng, ZZ, Munhall, KG, Johnsrude, IS. Functional overlap between regions involved in speech perception and in monitoring one’s own voice during speech production. Journal of Cognitive Neuroscience 2010;22:1770–1781. https://doi.org/10.1162/jocn.2009.21324.CrossRefGoogle ScholarPubMed

32. Carruthers, P. On knowing your own beliefs: A representationalist account. In: New Essays on Belief. London: Palgrave Macmillan; 2013, at 145–65.CrossRefGoogle Scholar

33. Clark, A. Language, embodiment, and the cognitive niche. Trends in Cognitive Sciences 2006;10:370–374. https://doi.org/10.1016/j.tics.2006.06.012.CrossRefGoogle ScholarPubMed

34. Farahany, NA. A neurological foundation for freedom. The Stanford Technology Law Review 2012;4:11–25.Google Scholar

35. See note 17, Martin et al. 2016; 6:srep25803.

36. See note 21, Jarosiewicz et al. 2015;7:313ra179.

37. Ryan, RM, Deci, EL. Self-regulation and the problem of human autonomy: Does psychology need choice, self-determination, and will? Journal of Personality 2006;74:1557–86, at 1573–4.CrossRefGoogle ScholarPubMed

38. DeGrazia, D. Enhancement technologies and human identity. The Journal of Medicine and Philosophy 2005;30:261–283.CrossRefGoogle ScholarPubMed

39. Erler, A, Hope, T. Mental disorder and the concept of authenticity. Philosophy, Psychiatry, & Psychology 2014;21:219–32.CrossRefGoogle Scholar

40. Pugh, J, Maslen, H, Savulescu, J. Deep brain stimulation, authenticity and value. Cambridge Quarterly of Healthcare Ethics 2017;26(4):640–57.CrossRefGoogle ScholarPubMed

41. Fischer, JM, Ravizza, M. Responsibility and Control: A Theory of Moral Responsibility. Cambridge: Cambridge University Press; 1998, at 221.CrossRefGoogle Scholar

42. Olechowski, A, Eppinger, SD, Joglekar, N. Technology readiness levels at 40: A study of state-of-the-art use, challenges, and opportunities. In 2015 Portland International Conference on Management of Engineering and Technology (PICMET). 2015:2084–2094.CrossRefGoogle Scholar

43. Schooler, JW, Engstler-Schooler, TY. Verbal overshadowing of visual memories: Some things are better left unsaid. Cognitive Psychology 1990;22:36–71.CrossRefGoogle ScholarPubMed

44. Alderson-Day, B, Fernyhough, C. Inner speech: Development, cognitive functions, phenomenology, and neurobiology. Psychological Bulletin 2015;141:931–65, at 939. https://doi.org/10.1037/bul0000021.CrossRefGoogle ScholarPubMed

45. Perfect, TJ, Hunt, LJ, Harris, CM. Verbal overshadowing in voice recognition. Applied Cognitive Psychology 2002;16:973–980. <https://doi.org/10.1002/acp.920>.CrossRefGoogle Scholar

46. See note 10, Mesgarani et al. 2014, at 1006–10.

47. See note 44, Alderson-Day, Fernyhough 2015, at 931–65

48. Grice, P. Studies in the Way of Words. Cambridge, MA: Harvard University Press; 1993, at 26.Google Scholar

49. Davidson, D. Inquiries into Truth and Interpretation. Oxford: Oxford University Press; 2001, at 197.CrossRefGoogle Scholar

50. Sharp, D, Wasserman, D. Deep brain stimulation, historicism, and moral responsibility. Neuroethics 2016;9:173–85, at 175. https://doi.org/10.1007/s12152-016-9260-0.CrossRefGoogle Scholar