This methodological synthesis surveys study and instrument quality in L2 pronunciation research by scrutinizing methodological practices in designing and employing scales and rubrics that measure accentedness, comprehensibility, and intelligibility. A comprehensive coding scheme was developed, and searches were conducted in several databases. A total of 380 articles (409 samples) that employed 576 target instruments and appeared in peer-reviewed journals from 1977 to 2023 were synthesized. Results demonstrated, among other findings, strengths in reporting several listener and speaker characteristics. Areas in need of improvement include (a) more thorough evaluation and reporting of interrater reliability and instrument validity and (b) greater adherence to methodological transparency and open science practices. We conclude by discussing the implications of these findings for researchers and researcher trainers; by raising awareness of methodological and ethical challenges in psychometric research on L2 speech perception; and by providing recommendations for advancing the quality of instruments in this domain.

中文翻译：

---

基于感知的 L2 发音研究中的学习和工具质量


该方法综合通过仔细审查设计和使用测量口音、可理解性和可理解性的量表和评分标准的方法论实践，调查了 L2 发音研究中的研究和工具质量。开发了一个全面的编码方案，并在多个数据库中进行了检索。共合成了 380 篇文章（409 个样本），使用了 576 种目标工具，并于 1977 年至 2023 年出现在同行评审期刊上。除其他发现外，结果还表明了在报告几个听众和说话者特征方面的优势。需要改进的领域包括 （a） 更彻底地评估和报告评分者间可靠性和工具有效性，以及 （b） 更加遵守方法透明度和开放科学实践。最后，我们讨论了这些发现对研究人员和研究人员培训师的影响;通过提高对 L2 语音感知心理测量研究的方法论和伦理挑战的认识;以及为提高该领域仪器的质量提供建议。