Each training package was submitted for refereeing to a pool of academics specialized in the topic covered in the specific package and are content developers. This thorough refereeing covered the package material, sequence and objectives of activities, and how the learning outcomes help realizes the overall goal of the program.
The internal scientific refereeing was conducted by training and program development professionals, by matching the programs and packages with KPTE Program Development Guide, the Program Design Guide and the Training Package Development Criteria.
The internal scientific refereeing was conducted by training and program
development professionals. By matching the programs and packages with
KPTE Program Development Guide, the Program Design Guide and the Training
Package Development Criteria.
Accordingly, feedback was submitted to the developer in the form of an internal review report. It referred to the amendments needed to the training material to comply with the Training Package Development Methodology. It also made sure the contract between KPTE and the developer is respected. The report decides whether the material is entitled for refereeing. If so, it is submitted to the scientific arbitrator, expert professionals, academics, and/or training experts in the field of training program content. Reviewers are contracted by KPTE once their CVs are checked; they have passed personal interviews; and they have a recommendation letter by a former client. KPTE reviews their approach to training and content development. They must meet the minimum required qualifications and have training experience.
Refereeing was gradual. First, reviewer submit an refereeing report including clear and specific instructions to develop the training product. They make the best use of their readings, knowledge and experience. They should not make quantitative data or decision, but rather they review the product at least twice.
Initial refereeing should be conducted in line with the refereeing form approved by KPTE, which is the minimum requirement for the refereeing report. then, they check the amendments made based on the instructions provided in the refereeing report.
It was agreed with the reviewer to consider the following:
| • |
The design of the training program and how to make it updated and
comprehensive to the furthest extent possible; |
| • |
The novelty, thoroughness, credibility and comprehensiveness of the
content and whether its level and language suit the target audience;
|
| • |
The extent to which could the training program achieve the expected
outcomes of training; |
| • |
Whether or not the training activities are suitable for the dedicated time,
achieving the objectives, adult-learning principles and whether they adopt
different learning strategies; |
| • |
Coverage of the reflective activities and whether the assessment suits
the target knowledge and skills; |
| • |
Possibility of introducing updates and revisions based on the recent
research findings; and |
| • |
Whether or not the presentation is suitable for the session organization,
and the flow of training content and activities. |
