Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
A conceptual framework for the design and development of scholarly assessment instruments in higher education
Thesis (PhD (Informatics))--University of Pretoria, 2024.
Saved in:
| Other Authors: | |
|---|---|
| Format: | Thesis |
| Language: | English |
| Published: |
University of Pretoria
2025
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1867613688843730944 |
|---|---|
| access_status_str | Open Access |
| author2 | De Villiers, Carina |
| author_browse | De Villiers, Carina |
| author_facet | De Villiers, Carina |
| collection | Thesis |
| dc_rights_str_mv | © 2023 University of Pretoria. All rights reserved. The copyright in this work vests in the University of Pretoria. No part of this work may be reproduced or transmitted in any form or by any means, without the prior written permission of the University of Pretoria. |
| description | Thesis (PhD (Informatics))--University of Pretoria, 2024. |
| format | Thesis |
| id | oai:repository.up.ac.za:2263/100340 |
| institution | University of Pretoria (South Africa) |
| language | English |
| last_indexed | 2026-06-10T12:40:07.894Z |
| license_str | Other — see source repository |
| provenance_str_mv | Harvested via OAI-PMH from UPSpace — University of Pretoria Institutional Repository |
| publishDate | 2025 |
| publishDateRange | 2025 |
| publishDateSort | 2025 |
| publisher | University of Pretoria |
| publisherStr | University of Pretoria |
| record_format | dspace |
| source_str | UPSpace — University of Pretoria Institutional Repository |
| spelling | oai:repository.up.ac.za:2263/100340 A conceptual framework for the design and development of scholarly assessment instruments in higher education De Villiers, Carina wpcmare@gmail.com Van Amerom, Wilhelmina Phillipina Catharina UCTD Sustainable Development Goals (SDGs) Assessment literacy Design science research Assessment design Assessment instruments Scholarly assessment practice Learning outcomes Constructive alignment Scholarship of assessment Bloom's taxonomy General Systems Theory Scholarly assessor Scholarly assessment Thesis (PhD (Informatics))--University of Pretoria, 2024. Assessment illiteracy amongst higher education lecturers undermines effective assessment practices. The non-mandatory nature of assessor training that appears amongst non-educationally trained lecturers in South African higher education diminishes the quality of assessment practices to that of being unscholarly, unprincipled, and disorganised. Grounded in Design Science Research, the main aim of this research study was to conceptualise a framework for the design and development of scholarly assessment instruments in higher education, validated by an expert panel and informed by the General Systems Theory (GST) of Von Bertalanffy. It was argued that strengthening the assessment literacy of lecturers might promote scholarly thinking when reflecting on, designing, and developing an assessment instrument. Sixteen lecturers from four academic departments residing in two different schools/faculties were sampled, and data were collected using a mixed methods research design. The research participants were subjected to two cognitive mapping sessions, two semi-structured interviews and a workshop intervention resulting in the development of seven interconnected and interdependent information and technology artifacts, namely, an Assessment Literacy Baseline Assessment (ALBA) diagnostic tool, a Scholarly Interpretation Mapping Method (SIMM) consisting of scholarly interpretation steps, a scholarly visualisation method and contextualised taxonomy handouts, a Scholarly Assessment Instrument Design (SAID) workshop, a Scholarly Assessment Instrument Design and Development Application (SAIDA) and a Scholarly Principled Approach to the Practice of Assessment Instrument Design and Development (SPPAIDD). In a higher education institution (such as the selected university), where assessment literacy training is not compulsory, it was found that customised, contextualised assessment instrument design and development advising and training, embedded in a model of cognition using an established learning taxonomy and the amplification of lecturers’ cognition through the visualisation of the assessment instrument design and development process via a software application, can strengthen lecturers’ assessment literacy levels. It is concluded that a scholarly approach to the design and development of assessment instruments is an under-researched phenomenon in the South African higher education context, and that a conceptual framework for the promotion of a scholarly approach to the practice of assessment instrument design and development is long overdue. Engineering, Built Environment and Information Technology PhD (Informatics) Unrestricted Faculty of Economic And Management Sciences SDG-04: Quality Education 2025-01-28T10:10:29Z 2025-01-28T10:10:29Z 2025-05-05 2024-10-31 Thesis * A2025 http://hdl.handle.net/2263/100340 10.25403/UPresearchdata.28263599 en © 2023 University of Pretoria. All rights reserved. The copyright in this work vests in the University of Pretoria. No part of this work may be reproduced or transmitted in any form or by any means, without the prior written permission of the University of Pretoria. application/pdf University of Pretoria |
| spellingShingle | UCTD Sustainable Development Goals (SDGs) Assessment literacy Design science research Assessment design Assessment instruments Scholarly assessment practice Learning outcomes Constructive alignment Scholarship of assessment Bloom's taxonomy General Systems Theory Scholarly assessor Scholarly assessment A conceptual framework for the design and development of scholarly assessment instruments in higher education |
| title | A conceptual framework for the design and development of scholarly assessment instruments in higher education |
| title_full | A conceptual framework for the design and development of scholarly assessment instruments in higher education |
| title_fullStr | A conceptual framework for the design and development of scholarly assessment instruments in higher education |
| title_full_unstemmed | A conceptual framework for the design and development of scholarly assessment instruments in higher education |
| title_short | A conceptual framework for the design and development of scholarly assessment instruments in higher education |
| title_sort | conceptual framework for the design and development of scholarly assessment instruments in higher education |
| topic | UCTD Sustainable Development Goals (SDGs) Assessment literacy Design science research Assessment design Assessment instruments Scholarly assessment practice Learning outcomes Constructive alignment Scholarship of assessment Bloom's taxonomy General Systems Theory Scholarly assessor Scholarly assessment |
| url | http://hdl.handle.net/2263/100340 |