科學教育研究所

Permanent URI for this communityhttp://rportal.lib.ntnu.edu.tw/handle/20.500.12235/61

本所於民國75年秋奉教育部核准設立，經當時理學院吳院長京一、與數學系、物理系、化學系、生物系、地球科學系等系主任，以及本校科學教育學者之籌備和規劃，分別於75年成立博士班，於76學年度招收第1屆博士班學生，83年成立碩士班，於84學年度起正式招收第1屆碩士班學生，87年成立教學碩士班，於88學年度招收第1屆教學碩士班學生。

News

系所網址：http://www.gise.ntnu.edu.tw/

Browse

Author: search.filters.author.Wang, H. C.Subject: search.filters.subject.Automated grading

Search Results

Now showing 1 - 1 of 1
  • No Thumbnail Available
    Item
    Assessing creative problem solving with automated text grading
    (Elsevier, 2008-12-01) Wang, H. C.; Chang, C. Y.; Li, T. Y.
    The work aims to improve the assessment of creative problem-solving in science education by employing language technologies and computational–statistical machine learning methods to grade students’ natural language responses automatically. To evaluate constructs like creative problem-solving with validity, open-ended questions that elicit students’ constructed responses are beneficial. But the high cost required in manually grading constructed responses could become an obstacle in applying open-ended questions. In this study, automated grading schemes have been developed and evaluated in the context of secondary Earth science education. Empirical evaluations revealed that the automated grading schemes may reliably identify domain concepts embedded in students’ natural language responses with satisfactory inter-coder agreement against human coding in two sub-tasks of the test (Cohen’s Kappa = .65–.72). And when a single holistic score was computed for each student, machine-generated scores achieved high inter-rater reliability against human grading (Pearson’s r = .92). The reliable performance in automatic concept identification and numeric grading demonstrates the potential of using automated grading to support the use of open-ended questions in science assessments and enable new technologies for science learning.