E-learning Curve Blog at Edublogs

E-learning Curve Blog is Michael Hanley's elearning blog about skills, knowledge, and organizational development using web-based training and technology in education

Assessing learning programs: advantages and disadvantages of the pre-test design

April 3rd, 2008 · No Comments
Pretest design · case study · e-learning · evaluate · evaluate learning · learning outcomes · measurement · metrics · research methodologies · research methods · training evaluation model · triangulation




When choosing to integrate the retrospective pre-test design method into your learning program evaluation and measurement methodology, the selection must take place in the after very carefully evaluating arguments both for and against its utility. The method has many advantages for the practitioner-researcher (see Table 1) but one must be cognisant of the threats to validity. However, in the context of the case study method, triangulation of data from other sources (questionnaires, surveys, quantitative analysis of access logs, LMS records, summative assessments and so on) can be used to counteract or balance such threats.

Table 1 Advantages and disadvantages of the retrospective pre-test model

Advantages

Disadvantages

Simple and cost-effective

Possibility that results were due to history in the job or organisation

Reduces costs and time for data collection and analysis

Possible distortions in retrospective reports because of response shift bias

Gathers data as part of the learning intervention

Compares post-intervention data with retrospective pre-data

Avoids attrition from the sample being measured

Decreases likelihood of testing effects

Create a free edublog to get your own comment avatar (and more!)

0 responses so far ↓

  • There are no comments yet...Kick things off by filling out the form below.

Leave a Comment

*
To prove you're a person (not a spam script), type the security word shown in the picture.
Anti-Spam Image