Analysis of the subtest “Grammar. Vocabulary” on TORFL-2 and TOR-8 from the point of view of content and quality of linguodidactic tests
Yuting Wang, Postgraduate Student
St. Petersburg State University, St. Petersburg, Russia, wangyuting123@yandex.ru, https://orcid.org/0009-0009-6168-1683
Abstract
The views and opinions of various scientists on the quality indicators of linguodidactic testing, which includes three elements — reliability, validity and practicality, are presented in the article. A comparative analysis of the subtests “Grammar. Vocabulary” TORFL-2 of Russia and “Integrated knowledge” of TOR-8 of China was carried out. The author analyzed the number and volume of tasks studied in recent years in TORFL-2 (Russia) and TOR-8 (China), as well as the content of their changes for the subsequent development of the tests.
Wang Yuting Analysis of the subtest “Grammar. Vocabulary” on TORFL-2 and TOR-8 from the point of view of content and quality of linguodidactic tests. Vestnik of Orenburg State Pedagogical University. Electronic Scientific Journal, 2024, no. 1 (49), pp. 312—322. DOI: https://doi.org/10.32516/2303-9922.2024.49.19.
1. Aver’yanova G. N., Belikova L. G., Erofeeva I. N., Ivanova T. A., Nesterova T. E., Popova T. I., Rogova K. A., Seliverstova E. I., Khimik V. V., Khorokhordina O. V., Shutova T. A., Yurkov E. E. Tipovye testy po russkomu yazyku kak inostrannomu. Vtoroi sertifikatsionnyi uroven’. Obshchee vladenie [Model tests in Russian as a foreign language. Second certification level. Pre-Intermediate]. Moscow, St. Petersburg, Zlatoust Publ., 1999. 112 p. (In Russian)
2. Andryushina N. P., Afanas’eva I. N., Bitekhtina G. A., Klobukova L. P., Yatsenko I. I. Leksicheskii minimum po russkomu yazyku kak inostrannomu. Vtoroi sertifikatsionnyi uroven’. Obshchee vladenie. 5-e izd. [Lexical minimum for Russian as a foreign language. Second certification level. Pre-intermediate. 5th ed.]. St. Petersburg, Zlatoust Publ., 2015. 164 p. (In Russian)
3. 王秀文. 外语交际测试理论与实践. 广州：世界图书出版公司. 2014: 179. [Van Syuven’. Teoriya i praktika lingvodidakticheskikh testov po inostrannym yazykam = Theory and practice of linguodidactic tests in foreign languages. Guangzhou, Vsemirnoe knizhnoe izdatel’stvo Publ., 2014. 179 p.] (In Chinese)
4. Kokkota V. A. Lingvodidakticheskoe testirovanie: nauch.-teor. posobie [Linguodidactic testing. Scientific and theoretical manual]. Moscow, Vysshaya shkola Publ., 1989. 127 p. (In Russian)
5. Kolesnikova I. L., Dolgina O. A. Anglo-russkii terminologicheskii spravochnik po metodike prepodavaniya inostrannykh yazykov [English-Russian terminological reference book on methods of teaching foreign languages]. Moscow, Drofa, Cambridge University Press, 2008. 431 p. (In Russian)
6. 李筱菊. 语言测试科学与艺术, 长沙：湖南教育出版社. 2001 (27): 537. [Li Syaotszyui. Nauka i iskusstvo yazykovogo testirovaniya = The Science and Art of Language Testing. Chansha, Khunan’skoe izd-vo obrazovaniya Publ., 2001, no. 27. 537 p.]. (In Chinese)
7. Maslennikova E. P., Feklicheva I. V., Esipenko E. A., Sharafieva K. R., Ismatullina V. I., Golovin G. V., Miklashevskii A. A., Chipeeva N. A., Soldatova E. L. Slovarnyi zapas kak pokazatel’ verbal’nogo intellekta: primenenie ekspress-metodiki otsenki slovarnogo zapasa [Vocabulary size as a verbal intelligence index: application of the express methods of an estimating vocabulary size]. Vestnik Yuzhno-Ural’skogo gosudarstvennogo universiteta. Ser. Psikhologiya — Bulletin of the South Ural State University. Series “Psychology”, 2017, vol. 10, no. 3, pp. 63—69. (In Russian)
8. Oleshkov M. Yu., Uvarov V. M. Sovremennyi obrazovatel’nyi protsess: osnovnye ponyatiya i terminy : (kratkii terminologicheskii slovar’) [Modern educational process: basic concepts and terms: (brief terminological dictionary)]. Moscow, Sputnik+ Publ., 2006. 189 p. (In Russian)
9. Pavlovskaya I. Yu., Bashmakova N. I. Osnovy metodologii obucheniya inostrannym yazykam. Testologiya: uchebnik. 2-e izd., ispr. i dop. [Fundamentals of methodology for teaching foreign languages. Testology. Textbook. 2nd ed., rev. and add.]. St. Petersburg, Filol. fakul’tet SPbGU Publ., 2007. 225 p. (In Russian)
10. 全国高等学校外语专业教学指导委员会俄语教学指导分委员会，髙等学校俄语专业教学大纲 [Z].-2版.北京: 外语教学与研究出版社, 2012. 380. [Podkomitet po obucheniyu russkomu yazyku Rukovodyashchego komiteta vuzov po prepodavaniyu inostrannykh yazykov. Programma obucheniya russkomu yazyku v vuzakh po spetsial’nosti “Russkii yazyk”. 2-e izd. = Subcommittee on teaching the Russian language of the Steering Committee of universities on the teaching of foreign languages. Program for teaching the Russian language at universities with a specialty in “Russian language”. 2nd ed. Beijing, Izd-vo po prepodavaniyu i issledovaniyu inostrannykh yazykov Publ., 2012. 380 p.]. (In Chinese)
11. Pushkin V. N. O zakone edinstva nadezhnosti i narusheniya [On the law of unity of reliability and violation]. XIX Gertsenovskie chteniya. Sotsial’no-ekonomicheskie i istoricheskie nauki: tez. dokl. [XIX Herzen Readings. Socio-economic and historical sciences. Abstr.]. Leningrad, LGPI im. A. I. Gertsena Publ., 1966, pp. 122—125. (In Russian)
12. Rapoport I. A., Sel’g R., Sotter I. Testy v obuchenii inostrannym yazykam v srednei shkole [Tests in teaching foreign languages in high school]. Tallin, Valgus Publ., 1987. 352 p. (In Russian)
13. 黄玫. “新国标”背景下俄语专业四、八级考试改革探索 [J].中国俄语教学. 北京外国语大学, 2020: 7—13. [Khuan Mei. Issledovanie reformy professional’nykh testov po russkomu yazyku chetvertogo urovnya i vos’mogo urovnya na fone “novykh gosudarstvennykh standartov” = Study of the reform of professional tests in the Russian language of the fourth level and eighth level against the backdrop of “new state standards”. Prepodavanie russkogo yazyka v Kitae = Teaching the Russian language in China, 2020, no. 4, pp. 7—13]. (In Chinese)
14. 何红梅, 高欣. 我国大学俄语教学改革的新思路 — 评《全国大学俄语四级统考测试改革方案》. 清华大学教育研究, 2003 (2): 87—91. [Khe Khunmei, Gao Sin’. Novye mneniya o reforme prepodavaniya russkogo yazyka v kitaiskikh vuzakh — otsenka “Plana reformy national’nogo neprofessional’nogo testa po russkomu yazyku chetvertogo urovnya” = New opinions on the reform of Russian language teaching in Chinese universities — an assessment of the “Reform Plan for the National Non-Professional Test in the Russian Language of the Fourth Level”. Issledovaniya v oblasti obrazovaniya universiteta Tsinkhua = Research in Education of Tsinghua University, 2003, no. 2, pp. 87—91]. (In Chinese)
15. 曹文. 英语文化教学的两个层次[J]. 外语教学与研究, 1998: 10—14. [Tsao Ven’. Dva urovnya prepodavaniya angliiskoi kul’tury = Two levels of teaching English culture. Prepodavanie i issledovanie inostrannykh yazykov = Teaching and research of foreign languages, 1998, pp. 10—14]. (In Chinese)
16. 赵为, 田旭. 国际竞赛评价标准对中国俄语考试评价的启示 [J]. 中国俄语教学, 2008年: 57—58+26. [Chzhao Vei, Tyan’ Syui. Kriterii otsenki mezhdunarodnykh konkursov na otsenku testov po russkomu yazyku v Kitae = Criteria for evaluating international competitions for assessing tests in the Russian language in China. Prepodavanie russkogo yazyka v Kitae = Teaching the Russian language in China, 2008, no. 4, pp. 57—58, 26]. (In Chinese)
17. 陈颖杰. 关于在俄语测试中增加多技能综合考查的思考 [J]. 课程.教材.教法, 2009 (11): 61—63. [Chen’ Intsze. Vzglyady na dobavlenie kompleksnoi proverki razlichnykh navykov v teste po russkomu yazyku = Views on adding a comprehensive test of various skills in the Russian language test. Uchebnyi plan. Uchebnik. Metod obucheniya = Curriculum. Textbook. Teaching method, 2009, no. 11, pp. 61—63]. (In Chinese)
18. 史铁强. 语言测试对语言教学的导向作用[A], 北京论坛. 文明的和谐与共同繁荣——人类文明的多元发展模式:“多元文明冲突与融合中语言的认同与流变”. 北京. 北京大学北京论坛办公室. 2007: 481—492. [Shi Tetsyan. Rukovodyashchaya rol’ yazykovogo testirovaniya v obuchenii yazyku = The leadership role of language testing in language teaching. Pekinskii forum. Garmoniya i obshchee protsvetanie tsivilizatsii na Pekinskom forume — Mnozhestvennye modeli razvitiya chelovecheskoi tsivilizatsii: “Yazykovaya identichnost’ i evolyutsiya v konflikte i integratsii mnozhestvennykh Tsivilizatsii” = Beijing Forum. Harmony and common prosperity of civilizations at the Beijing Forum — Multiple models of development of human civilization: “Linguistic identity and evolution in conflict and integration of multiple Civilizations”. Beijing, Ofis Pekinskogo foruma Pekinskogo un-ta Publ., 2007, pp. 481—492]. (In Chinese)
19. Shchelokova A. A. Realizatsiya etnopsikhologicheskogo printsipa obucheniya russkomu yazyku kak inostrannomu [Realization of the ethnopsychological principle of teaching Russian as a foreign language]. Nauchno-metodicheskii elektronnyi zhurnal “Kontsept” — The scientific and methodological electronic journal “Koncept”, 2017, no. V9, pp. 88—94. Available at: http://e-koncept.ru/2017/171025.htm. (In Russian)
20. Shcherba L. V. Yazykovaya sistema i rechevaya deyatel’nost’ [Language system and speech activity]. Leningrad, Nauka Publ., 1976. 427 p. (In Russian)
21. AERA, APA & NCME. Standards for Educational and Psychological Testing. Washington, D. C., American Psychological Association, 2014.
22. Alderson J. Ch., Clapham C., Wall D. Language Test Construction and Evaluation. Shanghai, Shanghai Foreign Language Education Press, 2000.
23. Bachman L. E., Palmer A. S. Language Testing in Practice: Designing and Developing Useful Language Tests. Oxford, Oxford University Press, 1996.
24. Brown H. D., Abeywickrama P. Language Assessment: Principles and Classroom Practices. Beijing, Tsinghua University Press, 2013.
25. Heaton J. В. Writing English Language Tests. Beijing, Foreign Language Teaching and Research Press, 2000. 192 p.
26. Hughes A. Testing for Language Teachers. 2nd ed. Cambridge, Cambridge University Press, 2003.
27. Shohamy E. The power of tests: The impact of language tests on teaching and learning. Washington, D. C., The National Foreign Language Center at John Hopkins University, 1993.