Automated Essay Scoring

by Mark D. Shermis

Author	: Mark D. Shermis
Publisher	: Routledge
Total Pages	: 256
Release	: 2003-01-30
Genre	: Education
ISBN	: 1135643601

GET BOOK

This new volume is the first to focus entirely on automated essay scoring and evaluation. It is intended to provide a comprehensive overview of the evolution and state-of-the-art of automated essay scoring and evaluation technology across several disciplines, including education, testing and measurement, cognitive science, computer science, and computational linguistics. The development of this technology has led to many questions and concerns. Automated Essay Scoring attempts to address some of these questions including: *How can automated scoring and evaluation supplement classroom instruction? *How does the technology actually work? *Can it improve students' writing? *How reliable is the technology? *How can these computing methods be used to develop evaluation tools? *What are the state-of the-art essay evaluation technologies and automated scoring systems? Divided into four parts, the first part reviews the teaching of writing and how computers can contribute to it. Part II analyzes actual automated essay scorers including e-raterTM, Intellimetric, and the Intelligent Essay Assessor. The third part analyzes related psychometric issues, and the final part reviews innovations in the field. This book is ideal for researchers and advanced students interested in automated essay scoring from the fields of testing and measurement, education, cognitive science, language, and computational linguistics.

Handbook of Automated Essay Evaluation

by Mark D. Shermis

Author	: Mark D. Shermis
Publisher	: Routledge
Total Pages	: 385
Release	: 2013-07-18
Genre	: Psychology
ISBN	: 1136334807

GET BOOK

This comprehensive, interdisciplinary handbook reviews the latest methods and technologies used in automated essay evaluation (AEE) methods and technologies. Highlights include the latest in the evaluation of performance-based writing assessments and recent advances in the teaching of writing, language testing, cognitive psychology, and computational linguistics. This greatly expanded follow-up to Automated Essay Scoring reflects the numerous advances that have taken place in the field since 2003 including automated essay scoring and diagnostic feedback. Each chapter features a common structure including an introduction and a conclusion. Ideas for diagnostic and evaluative feedback are sprinkled throughout the book. Highlights of the book’s coverage include: The latest research on automated essay evaluation. Descriptions of the major scoring engines including the E-rater®, the Intelligent Essay Assessor, the IntellimetricTM Engine, c-raterTM, and LightSIDE. Applications of the uses of the technology including a large scale system used in West Virginia. A systematic framework for evaluating research and technological results. Descriptions of AEE methods that can be replicated for languages other than English as seen in the example from China. Chapters from key researchers in the field. The book opens with an introduction to AEEs and a review of the "best practices" of teaching writing along with tips on the use of automated analysis in the classroom. Next the book highlights the capabilities and applications of several scoring engines including the E-rater®, the Intelligent Essay Assessor, the IntellimetricTM engine, c-raterTM, and LightSIDE. Here readers will find an actual application of the use of an AEE in West Virginia, psychometric issues related to AEEs such as validity, reliability, and scaling, and the use of automated scoring to detect reader drift, grammatical errors, discourse coherence quality, and the impact of human rating on AEEs. A review of the cognitive foundations underlying methods used in AEE is also provided. The book concludes with a comparison of the various AEE systems and speculation about the future of the field in light of current educational policy. Ideal for educators, professionals, curriculum specialists, and administrators responsible for developing writing programs or distance learning curricula, those who teach using AEE technologies, policy makers, and researchers in education, writing, psychometrics, cognitive psychology, and computational linguistics, this book also serves as a reference for graduate courses on automated essay evaluation taught in education, computer science, language, linguistics, and cognitive psychology.

Machine Scoring of Student Essays

by Patricia Freitag Ericsson

Author	: Patricia Freitag Ericsson
Publisher	:
Total Pages	: 284
Release	: 2006-03-15
Genre	: Education
ISBN	:

GET BOOK

The current trend toward machine-scoring of student work, Ericsson and Haswell argue, has created an emerging issue with implications for higher education across the disciplines, but with particular importance for those in English departments and in administration. The academic community has been silent on the issue—some would say excluded from it—while the commercial entities who develop essay-scoring software have been very active. Machine Scoring of Student Essays is the first volume to seriously consider the educational mechanisms and consequences of this trend, and it offers important discussions from some of the leading scholars in writing assessment. Reading and evaluating student writing is a time-consuming process, yet it is a vital part of both student placement and coursework at post-secondary institutions. In recent years, commercial computer-evaluation programs have been developed to score student essays in both of these contexts. Two-year colleges have been especially drawn to these programs, but four-year institutions are moving to them as well, because of the cost-savings they promise. Unfortunately, to a large extent, the programs have been written, and institutions are installing them, without attention to their instructional validity or adequacy. Since the education software companies are moving so rapidly into what they perceive as a promising new market, a wider discussion of machine-scoring is vital if scholars hope to influence development and/or implementation of the programs being created. What is needed, then, is a critical resource to help teachers and administrators evaluate programs they might be considering, and to more fully envision the instructional consequences of adopting them. And this is the resource that Ericsson and Haswell are providing here.

Handbook of Automated Scoring

by Duanli Yan

Author	: Duanli Yan
Publisher	: CRC Press
Total Pages	: 581
Release	: 2020-02-26
Genre	: Computers
ISBN	: 1351264796

GET BOOK

"Automated scoring engines [...] require a careful balancing of the contributions of technology, NLP, psychometrics, artificial intelligence, and the learning sciences. The present handbook is evidence that the theories, methodologies, and underlying technology that surround automated scoring have reached maturity, and that there is a growing acceptance of these technologies among experts and the public." From the Foreword by Alina von Davier, ACTNext Senior Vice President Handbook of Automated Scoring: Theory into Practice provides a scientifically grounded overview of the key research efforts required to move automated scoring systems into operational practice. It examines the field of automated scoring from the viewpoint of related scientific fields serving as its foundation, the latest developments of computational methodologies utilized in automated scoring, and several large-scale real-world applications of automated scoring for complex learning and assessment systems. The book is organized into three parts that cover (1) theoretical foundations, (2) operational methodologies, and (3) practical illustrations, each with a commentary. In addition, the handbook includes an introduction and synthesis chapter as well as a cross-chapter glossary.

Automated Evaluation of Text and Discourse with Coh-Metrix

by Danielle S. McNamara

Author	: Danielle S. McNamara
Publisher	: Cambridge University Press
Total Pages	: 293
Release	: 2014-03-24
Genre	: Psychology
ISBN	: 1139867091

GET BOOK

Coh-Metrix is among the broadest and most sophisticated automated textual assessment tools available today. Automated Evaluation of Text and Discourse with Coh-Metrix describes this computational tool, as well as the wide range of language and discourse measures it provides. Part I of the book focuses on the theoretical perspectives that led to the development of Coh-Metrix, its measures, and empirical work that has been conducted using this approach. Part II shifts to the practical arena, describing how to use Coh-Metrix and how to analyze, interpret, and describe results. Coh-Metrix opens the door to a new paradigm of research that coordinates studies of language, corpus analysis, computational linguistics, education, and cognitive science. This tool empowers anyone with an interest in text to pursue a wide array of previously unanswerable research questions.

Artificial Intelligence in Education

by Ido Roll

Author	: Ido Roll
Publisher	: Springer Nature
Total Pages	: 536
Release	: 2021-06-11
Genre	: Computers
ISBN	: 3030782700

GET BOOK

This two-volume set LNAI 12748 and 12749 constitutes the refereed proceedings of the 22nd International Conference on Artificial Intelligence in Education, AIED 2021, held in Utrecht, The Netherlands, in June 2021.* The 40 full papers presented together with 76 short papers, 2 panels papers, 4 industry papers, 4 doctoral consortium, and 6 workshop papers were carefully reviewed and selected from 209 submissions. The conference provides opportunities for the cross-fertilization of approaches, techniques and ideas from the many fields that comprise AIED, including computer science, cognitive and learning sciences, education, game design, psychology, sociology, linguistics as well as many domain-specific areas. *The conference was held virtually due to the COVID-19 pandemic.

How to Lie with Statistics

by Darrell Huff

Author	: Darrell Huff
Publisher	: W. W. Norton & Company
Total Pages	: 144
Release	: 2010-12-07
Genre	: Mathematics
ISBN	: 0393070875

GET BOOK

If you want to outsmart a crook, learn his tricks—Darrell Huff explains exactly how in the classic How to Lie with Statistics. From distorted graphs and biased samples to misleading averages, there are countless statistical dodges that lend cover to anyone with an ax to grind or a product to sell. With abundant examples and illustrations, Darrell Huff’s lively and engaging primer clarifies the basic principles of statistics and explains how they’re used to present information in honest and not-so-honest ways. Now even more indispensable in our data-driven world than it was when first published, How to Lie with Statistics is the book that generations of readers have relied on to keep from being fooled.

Automated Speaking Assessment

by Klaus Zechner

Author	: Klaus Zechner
Publisher	: Routledge
Total Pages	: 229
Release	: 2019-11-28
Genre	: Language Arts & Disciplines
ISBN	: 1351676113

GET BOOK

Automated Speaking Assessment: Using Language Technologies to Score Spontaneous Speech provides a thorough overview of state-of-the-art automated speech scoring technology as it is currently used at Educational Testing Service (ETS). Its main focus is related to the automated scoring of spontaneous speech elicited by TOEFL iBT Speaking section items, but other applications of speech scoring, such as for more predictable spoken responses or responses provided in a dialogic setting, are also discussed. The book begins with an in-depth overview of the nascent field of automated speech scoring—its history, applications, and challenges—followed by a discussion of psychometric considerations for automated speech scoring. The second and third parts discuss the integral main components of an automated speech scoring system as well as the different types of automatically generated measures extracted by the system features related to evaluate the speaking construct of communicative competence as measured defined by the TOEFL iBT Speaking assessment. Finally, the last part of the book touches on more recent developments, such as providing more detailed feedback on test takers’ spoken responses using speech features and scoring of dialogic speech. It concludes with a discussion, summary, and outlook on future developments in this area. Written with minimal technical details for the benefit of non-experts, this book is an ideal resource for graduate students in courses on Language Testing and Assessment as well as teachers and researchers in applied linguistics.

Artificial Intelligence in Education

by Elisabeth André

Author	: Elisabeth André
Publisher	: Springer
Total Pages	: 699
Release	: 2017-06-22
Genre	: Computers
ISBN	: 3319614258

GET BOOK

This book constitutes the refereed proceedings of the 18th International Conference on Artificial Intelligence in Education, AIED 2017, held in Wuhan, China, in June/July 2017. The 36 revised full papers presented together with 4 keynotes, 37 poster, presentations, 4 doctoral consortium papers, 5 industry papers, 4 workshop abstracts, and 2 tutorial abstracts were carefully reviewed and selected from 159 submissions. The conference provides opportunities for the cross-fertilization of approaches, techniques and ideas from the many fields that comprise AIED, including computer science, cognitive and learning sciences, education, game design, psychology, sociology, linguistics as well as many domain-specific areas.