Revista CEFAC
https://revistacefac.org.br/article/doi/10.1590/1982-0216/20232556523
Revista CEFAC
Artigos Originais

Semantic analysis of words for the Virtual Tool for Speech Assessment

Análise semântica de palavras do Instrumento Virtual de Avaliação  da Fala

Letícia Bitencourt Uberti; Marcia Keske-Soares; Karina Carlesso Pagliarin

Downloads: 0
Views: 86

Abstract

Purpose: to carry out the semantic analysis of a list of words that will compose a virtual tool for speech assessment for children and adolescents.

Methods: twenty-three participants, aged between 2 years old and 17 years and 11 months old, from the central region of Rio Grande do Sul, Brazil, assigned the concept of 91 words. Data analysis was performed quantitatively, considering the concept of each word as correct or incorrect. Content Validity Ratio (RVC) and Gwet’s first-order agreement coefficient (AC1) statistical calculation were calculated.

Results: from the word list analyzed, 42 stimuli presented CVR = 1; 30 words obtained CVR = 0.9; 11 with CVR = 0.8; six with CVR = 0.7; two had CVR = 0.4. Gwet's AC1 statistical calculation resulted in AC1 = 0.92 [CI = 0.90 - 0.94] for semantic analysis.

Conclusion: the list consisted of 91 semantically validated words that can be used to assess the speech production of children and adolescents.

Keywords

Psychometrics; Speech; Online Systems; Child; Adolescent

Resumo

Objetivo: realizar a análise semântica da lista de palavras que comporá um Instrumento Virtual de Avaliação da Fala para crianças e adolescentes. 

Métodos: vinte e três participantes, com idades entre 2 e 17 anos e 11 meses, atribuíram o conceito de 91 palavras. A análise dos dados foi realizada de forma quantitativa, considerando a conceituação de cada palavra como correta ou incorreta. Foi realizado cálculo da Razão de Validade de Conteúdo (RVC) e o cálculo estatístico first-order agreement coefficient (AC1) de Gwet. 

Resultados: da lista de palavras analisada, 42 estímulos apresentaram RVC=1; 30 palavras obtiveram RVC=0,9; 11 com RVC=0,8; seis com RVC=0,7; duas apresentaram RVC=0,4. O cálculo estatístico AC1 de Gwet resultou em AC1=0,92 [IC=0,90 - 0,94] para a análise semântica

Conclusão: a lista ficou constituída de 91 palavras validadas semanticamente e que podem servir para avaliação da produção de fala de crianças e adolescentes.

Palavras-chave

Psicometria; Fala; Sistemas On-Line; Criança; Adolescente

Referências

1. Rouse MH. Neuroanatomy for Speech-Language Pathology and Audiology. 2. ed. Burlington, Massachusetts, 2020.

2. Flinker A, Korzeniewska A, Shestyuk AY, Franaszczuk PJ, Dronkers NF, Knight RT et al. Redefining the role of broca's area in speech. Proc Natl Acad Sci U S A. 2015;112(9):2871-5. https://doi.org/10.1073/pnas.1414491112. PMID: 25730850.

3. Mezzomo CL, Luiz SW. Interference of the linguistic variant in the repair strategies used during the phonological acquisition process. J Soc Bras Fonoaudiol. 2012;24(3):239-47. https://doi.org/10.1590/S2179-64912012000300009. PMID: 23128172.

4. van Haaften L, Diepeveen S, van den Engel-Hoek L, de Swart B, Maassen B. Speech sound development in typically developing 2-7-year-old Dutch-speaking children: a normative cross-sectional study. Int J Lang Commun Disord. 2020;55(6):971-87. https://doi.org/10.1111/1460-6984.12575. PMID: 33111376.

5. American Speech-Language-Hearing Association (n.d.) Speech Sound Disorders: Articulation and Phonology. (Practice Portal). Retrieved november, 17, 2022, from http://www.asha.org/Practice-Portal/Clinical-Topics/Articulation-and-Phonology/

6. Ceron MI, Gubiani MB, Oliveira CR de, Gubiani MB, Keske-Soares M. Prevalence of phonological disorders and phonological processes in typical and atypical phonological development. CoDAS. 2017;29(3):e20150306. https://doi.org/10.1590/2317-1782/20172015306. PMID: 28492716.

7. Wren Y, Miller LL, Peters TJ, Emond A, Roulstone S. Prevalence and predictors of persistent speech sound disorder at eight years old: findings from a population cohort study. J Speech Lang Hear Res. 2016;59(4):647-73. https://doi.org/10.1044/2015_JSLHR-S-14-0282. PMID: 27367606.

8. Bernthal J, Bankson N, Flipsen Jr P. Articulation and phonological disorders: speech sound disorders in children [Internet]. 8th ed. The Japan Journal of Logopedics and Phoniatrics. Boston: Pearson Education; 2017. ISBN-10: 0134170717; ISBN-13: 978-0134170718.

9. Savoldi A, Ceron MI, Keske-Soares M. What are the best words to compose an evaluation phonological instrument? Audiol., Commun. Res. 2013;18(3):194-202. https://doi.org/10.1590/S2317-64312013000300009.

10. Uberti LB, Portalete CR, Pagliarin KC, Keske-Soares M. Validity and reliability of speech articulation assessment tools for children and adolescents: a systematic review. Journal of Speech Sciences. 2019;8(1000):1-35. https://doi.org/10.20396/joss.v8i1.14992.

11. Pasquali L. Validade dos testes. Revista Examen [journal on the internet]. 1º de setembro de 2017 [accessed 2023 jun 29];1(1):36. Available at: https://examen.emnuvens.com.br/rev/article/view/19.

12. Pasquali L. Instrumentação psicológica fundamentos e práticas. Vol. 1. Porto Alegre: Artmed; 2010.

13. Demo P. Metodologia Científica em Ciências Sociais. 3. ed. São Paulo: Atlas, 1995.

14. Haaften L van, Diepeveen S, Engel-Hoek L van den, Jonker M, Swart B de, Maassen B. The psychometric evaluation of a speech production test battery for children: the reliability and validity of the computer articulation instrument. J Speech Lang Hear Res. 2019;62(7):2141-70. https://doi.org/10.1044/2018_JSLHR-S-18-0274. PMID: 31246524.

15. Ceron MI. Instrumento de Avaliação Fonológica (INFONO): desenvolvimento e estudos psicométricos [thesis]. Santa Maria (RS): Universidade Federal de Santa Maria; 2015.

16. Gubiani MB, Pagliarin KC, McCauley RJ, Keske-Soares M. Dynamic evaluation of motor speech skill: adaptation for Brazilian portuguese. J Commun Disord. 2021;93:106114. https://doi.org/10.1016/j.jcomdis.2021.106114. PMID: 34237603.

17. Pasquali L. Psicometria. Teoria dos testes na psicologia e na educação (2ª ed), Petrópolis, Rio de janeiro: Editora Vozes, 2003.

18. Ning X, Li C, Yang J. Word familiarity modulated the effects of category familiarity on memory performance. Front Psychol. 2018;9:1429. https://doi.org/10.3389/fpsyg.2018.01429. PMID: 30135675.

19. Peter MS, Durrant S, Jessop A, Bidgood A, Pine JM, Rowland CF. Does speed of processing or vocabulary size predict later language growth in toddlers? Cogn Psychol. 2019;115:101238. https://doi.org/10.1016/j.cogpsych.2019.101238. PMID: 31539813.

20. Caselli MC, Rinaldi P, Stefanini S, Volterra V. Early action and gesture "Vocabulary" and its relation with word comprehension and production. Child Dev. 2012;83(2):526-42. http://doi.wiley.com/10.1111/j.1467-8624.2011.01727.x. PMID: 22304431.

21. Kraljevic JK, Cepanec M, Šimleša S. Gestural development and its relation to a child's early vocabulary. Infant Behav Dev. 2014;37(2):192-202. https://doi.org/10.1016/j.infbeh.2014.01.004. PMID: 24583922.

22. Caselli C, Casadio P, Bates E. A comparison of the transition from first words to grammar in English and Italian. J Child Lang. 1999;26(1):69-111. https://doi.org/10.1017/S0305000998003687. PMID: 10217890.

23. Hage SR de V, Pereira MB. Performance by children with typical language development in expressive vocabulary test. Rev. CEFAC. 2006;8(4):419-28. https://doi.org/10.1590/S1516-18462006000400003.

24. Pasquali L. Testes referentes ao construto: teoria e modelo de construção. In: Pasquali L. organizer. Instrumentos Psicológicos: manual prático de elaboração. Brasília, DF: Laboratório de Pesquisa em Avaliação e Medida - LabPAM, 1999. p.37-71.

25. Brancalioni AR, Marini C, Cavalheiro LG, Keske-Soares M. Performance in vocabulary test of children with phonological disorder and with typical phonological developmental. Rev. CEFAC. 2011;13(3):428-36. https://doi.org/10.1590/S1516-18462010005000011.
 


Submetido em:
29/06/2023

Aceito em:
03/08/2023

65bb9ca2a95395247c79ed63 cefac Articles
Links & Downloads

Revista CEFAC

Share this page
Page Sections