Relationship between grammatical and pragmatic competence in EFL of Spanish learners through a computer adaptive test

Authors

  • Beatriz Martín Marchante Universitat Politècnica de València

DOI:

https://doi.org/10.7203/realia.26.17694

Keywords:

higher education, pragmatics, second language adquisition

Abstract

The work at hand is part of a wider study by Martín-Marchante (2015), the objective of which was to study the way pragmatics assessment is approached in the Oxford Online Placement Test (OOPT) which is, currently, one of the most profusely administered computer adaptive tests (CAT). This paper aims, now, to find out the degree of difficulty of the pragmatic items in the OOPT and how much importance is given to pragmatic competence in this test. Furthermore, we analyze the relationship between grammatical and pragmatic competence in EFL of a group of Spanish un- dergraduate students, who took this test. To this end, a descriptive analysis and a multiple linear regression analysis was carried out. The results showed that the quality of the pragmatic items in the OOPT could be improved. Also, we have found that the pragmatic items were somehow related to the student’s final score but not so much as other items of the test, such as those related to gram- mar and reading comprehension. Additionally, the results indicated that there was no correlation between the grammatical and the pragmatic competence of this group of students.

Downloads

Download data is not yet available.

Author Biography

Beatriz Martín Marchante, Universitat Politècnica de València

Profesora Ayudante Doctor en Filología Inglesa Departamento de lingüística Aplicada

References

Adams, C. (2002). Practitioner review: The assessment of language pragmatics. Journal of child psychology and psychiatry, 43(8), 973–987. https://doi.org/10.1111/1469-7610.00226

Alderson, J. C. (2007). The Challenge of (Diagnostic) Testing. In J. Fox, M. Wesche, D. Bayliss, L. Cheng, C. E. Turner, & C. Doe (Eds.), Language Testing Reconsidered. Ottawa: University of Ottawa Press.

Allami, H., & Naeimi, A. (2011). A cross-linguistic study of refusals: An analysis of pragmatic competence development in Iranian EFL learners. Journal of Pragmatics, 43(1), 385– 406. https://doi.org/10.1016/j.pragma.2010.07.010

Ameriks, Y. S. (2011). Investigating validity across two test forms of the Examination for the Certificate of Proficiency in English (ECPE): A multi-group structural equation modeling approach (Unpublished doctoral dissertation). Teachers College, Columbia University.

Austin, J. L. (1962). How to do Things with Words (J. O. Urmston, Ed.). London: Oxford University Press.

Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.

Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford: Oxford University Press.

Bardovi-Harlig, K., & Hartford, B. S. (1991). Saying “no” in English: Native and nonnative rejections. Pragmatics and language learning, 2, 41–57.

Bardovi-Harlig, K., & Hartford, B. S. (1993). Learning the rules of academic talk: A longitudinal study of pragmatic change. Studies in Second Language Acquisition, 15(3), 279–304.

Blutner, R. (1998). Lexical pragmatics. Journal of Semantics, 15(2), 115–162. https://doi.org/ 10.1093/jos/15.2.115

Carrió-Pastor, M. L. (2016). Introduction. In M. L. Carrió-Pastor (Ed.), New Challenges for Language Testing: Towards Mutual Recognition of Qualifications (pp. 7–11). London: Cambridge Scholars Publishing.

Carrió-Pastor, M. L., & Casas-Gómez, M. (2015). The Use of Corpora to Identify the Pragmatic Knowledge Associated with Different Levels of Language Proficiency. In S. Gesuato,

F. Bianchi, & W. Cheng (Eds.), Teaching, Learning and Investigating Pragmatics (pp. 207–230). Cambridge: Cambridge Scholars.

Carrió-Pastor, M. L., & Martín-Marchante, B. (2018). Analysis of pragmatic items in an ESL online adaptive placement test. International Journal of English Studies, 18(2), 97–117. https://doi.org/10.6018/ijes/2018/2/322581

Carroll, B. J. (1980a). Testing Communicative Performance. An Interim Study. London: Pergamon Press.

Carroll, B. J. (1980b). Testing Communicative Performance. An Interim Study. Oxford: Pergamon Press.

Carston, R. (1997). Enrichment and loosening: complementary processes in deriving the proposition expressed? In E. Rolf (Ed.), Pragmatik. Linguistische Berichte (Forschung Information Diskussion) (Vol. 8, pp. 103–127). https://doi.org/10.1007/978-3-663-11116-0_7

Carston, R. (2002). Linguistic Meaning, Communicated Meaning and Cognitive Pragmatics. Mind & Language: Special Issue on Pragmatics and Cognitive Science, 17 (1), 127–148. https://doi.org/10.1111/1468-0017.00192

Cohen, A. D. (1996). Developing the ability to perform speech acts. Studies in Second Language Acquisition, 18(2), 253–267. https://doi.org/10.1017/S027226310001490X

Escandell, M. V. (2004). Aportaciones de la Pragmática. In J. S. Lobato & I. S. Gargallo (Eds.), Vademecum para la formación de profesores de profesores. Enseñar español como segunda lengua (L2)/lengua extranjera (LE) (pp. 179–198). Madrid: SGEL.

EU. (2001). Common European Framework of Reference for Languages: Learning, teaching, assessment. Retrieved from https://rm.coe.int/16802fc1bf

Fulcher, G. (2015). Re-examining language testing: A philosophical and social inquiry. London: Routledge.

Gallardo-Paúls, B. (1995). El sobreentendido. Pragmalingüística, 3(4), 351–381.

Gallardo-Paúls, B. (2005). El lenguaje y la mente. In A. López & B. Gallardo-Paúls (Eds.),Conocimiento y lenguaje. Valencia: PUV.

Grabowski, K. C. (2009). Investigating the construct validity of a test designed to measure grammatical and pragmatic knowledge in the context of speaking (Unpublished doctoral dissertation). Columbia University, Columbia USA.

Gutiérrez, S. (2004). La subcompetencia pragmática. In J. S. Lobato & I. S. Gargallo (Eds.), Vademecum para la formación de profesores de profesores. Enseñar español como segunda lengua (L2)/lengua extranjera (LE) (pp. 533–552). Madrid: SGEL.

Ifantidou, E., & Tzanne, A. (2012). Levels of pragmatic competence in an EFL academic context: A tool for assessment. Intercultural Pragmatics, 9(1), 47–70. https://doi.org/ 10.1515/ip-2012-0003

Jian-Da, L. (2007). Assessing EFL learners’ interlanguage pragmatic knowledge: Implications for testers and teachers. Reflections on English Language Teaching(5), 1–22.

Jordá, M. P. S. (2005).

Kasper, G., & Rose, K. R. (2001). Pragmatics in language teaching. Cambridge: Cambridge University Press.

Liao, S. (2009). Variation in the use of discourse markers by Chinese teaching assistants in the US. Journal of Pragmatics, 41(7), 1313–1328. https://doi.org/10.1016/j.pragma.2008.09.026

Linn, R. L. (2000). Assessments and Accountability. Educational Researcher, 29, 4–16. https:// doi.org/10.3102/0013189x029002004

Liu, J. (2006). Measuring interlanguage pragmatic knowledge of EFL learners. Frankfurt: Peter Lang.

Martínez, M. A., Sánchez, A., Toledo, E., & Faulín, J. (2006). Bioestadística amigable. Madrid: Díaz de Santos.

Martínez-Flor, A., & Usó-Juan, E. (2010). Speech act performance: Theoretical, empirical and methodological issues. London: John Benjamins Publishing. https://doi.org/10.1075/ lllt.26

Martínez-Rizo, F. (2008). Proyecto de creación del INEE. México: Instituto Nacional para la Evaluación del Educación. Retrieved from https://www.inee.edu.mx/wp-content/ uploads/2019/01/P1C226.pdf

Martín-Marchante, B. (2015). La evaluación de la competencia pragmática en lengua extranjera a través de una prueba adaptativa (Doctoral dissertation, Universidad Politécnica de Valencia). Retrieved from https://doi.org/10.4995/Thesis/10251/59437

Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational Measurement (pp. 13–103). New York, NY: Macmillan.

Morrow, K. (1981). ELT Documents. 111 Issues in Language Testing. In J. C. Alderson & A. Hughes (Eds.), Communicative language Testing: revolution or evolution (pp. 9–25). London: British Council.

Norris, J. M. (2001). Use of address terms on the German Speaking Test. In K. R. Rose (Ed.), Pragmatics in Language Teaching (pp. 248–282). Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9781139524797.018

Oller, J. W. (1979). Language Tests at School. London: Longman.

Omar, A. S. (1990). How Learners Greet in Kiswahili: A Cross Sectional Survey. Retrieved from http://files.eric.ed.gov/fulltext/ED326061.pdf

Purpura, J. E. (2004). Assessing Grammar. Cambridge: Cambridge University Press. Purpura, J. E. (2009). Retrieved from https://www.oxfordenglishtesting.com/uploadedfiles/6_New_Look_and_Feel/Content/oopt_measure.pdf

Reyes, G. (1990). La pragmática lingüística. Barcelona: Editorial Montesinos.

Roever, C. (2006). Validation of a web-based test of ESL pragmalinguistics. Language Testing, 23(2), 229–256. https://doi.org/10.1191/0265532206lt329oa

Roever, C. (2011). Testing of second language pragmatics: Past and future. Language Testing, 28(4), 463–481. https://doi.org/10.1177/0265532210394633

Shepard, L. A. (2006). Classroom assessment. Educational measurement, 4, 623–646. Shepard, L. A., Hammerness, K., Darling-Hammond, L., Rust, F. W., Snowden, J. B., Gordon, E., … Pacheco, A. (2005). Assessment . In L. Darling-Hammond & J. Bransford (Eds.), Preparing teachers for a changing world. What teachers should learn and be able to do (pp. 169–200). San Francisco, CA: Wiley.

Soler, A., E., Flor, M., & A. (Eds.). (2008). Investigating pragmatics in foreign language learning, teaching, and testing. London: Multilingual Matters.

Soler, E. A., & Martínez-Flor, A. (2005). Editors’ introduction to pragmatics in instructed language learning. System, 33(3), 381–384. Retrieved from https://dx.doi.org/10.1016/ j.system.2005.06.002 10.1016/j.system.2005.06.002

Takahashi, S. (2010). Assessing learnability in second language pragmatics. In A. Trosborg (Ed.), Pragmatics across languages and cultures (pp. 391–422). De Gruyter Mouton. https://doi.org/10.1515/9783110214444.3.391

Takahashi, T., & Beebe, L. M. (1987). The development of pragmatic competence by Japanese learners of English. JALT journal, 8(2), 131–155. Retrieved from https://jalt-publications.org/sites/default/files/pdf-article/jj-8.2-art3.pdf

Tsutagawa, F. S. (2013). Pragmatic knowledge and ability in the applied linguistics and second language assessment literature. Working Papers in TESOL & Applied Linguistics, 13(2), 1–20.

Xiao, F. (2015). Proficiency effect on L2 pragmatic competence. Studies in Second Language Learning and Teaching, 5(4), 557–581. https://doi.org/10.14746/sllt.2015.5.4.3

Yamashita, S. O. (2008). Investigating interlanguage pragmatic ability: what are we testing?. In E. A. Soler & A. Martínez-Flor (Eds.), Investigating pragmatics in foreign language learning, teaching, and testing (pp. 201–223). London: Multilingual Matters.

Yule, G. (1996). Pragmatics. Oxford: Oxford University Press.

Downloads

Additional Files

Published

2021-01-20

How to Cite

Martín Marchante, B. (2021). Relationship between grammatical and pragmatic competence in EFL of Spanish learners through a computer adaptive test. Research in Education and Learning Innovation Archives, (26), 18–34. https://doi.org/10.7203/realia.26.17694
Metrics
Views/Downloads
  • Abstract
    964
  • PDF
    409
  • (Español)
    0
  • EPUB
    357
  • HTML
    312
  • XML
    285

Issue

No. 26 (2021)

Section

ARTICLES

License

Authors who publish with this journal agree to the following terms:

  1. The Universitat de València is the editor of Research in Education and Learning Innovation Archives (REALIA) and retains the copyright of all that is published in the journal, while it allows and favours reuse under a copyleft license.
  2. The originals published in this journal are – unless otherwise specified – under a Creative Commons License: Attribution-NonComercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0).

Research in Education and Learning Innovation Archives (REALIA) encourages authors to disseminate and give visibility to their research published in this journal. For this, REALIA wishes to inform that:

  1. Authors retain copyright and grant the journal right of first publication.
  2. The work is simultaneously licensed under a Creative Commons Attribution License: Attribution-NonComercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0).
  3. Self-archive: Authors are permitted and encouraged to post their work online (e.g. in institutional repositories or on their website) to promote greater visibility and citation, with an acknowledgement of its first publication in this journal.

Metrics

Similar Articles

1 2 3 4 5 6 7 8 > >> 

You may also start an advanced similarity search for this article.