Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
Evaluator characteristics and programme evaluability decisions: an exploratory study of evaluation practice in South Africa, Brazil, the United Kingdom, and the United States of America
Responding to recent calls in the literature for cross-country comparisons of evaluation practice, this simulation study investigated (a) evaluators' perspectives on what determines a programme's evaluability, (b) what criteria evaluators prioritise when assessing a programme's evaluability, and (c)...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English |
| Published: |
Organisational Psychology
2017
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1867613164305121280 |
|---|---|
| access_status_str | Open Access |
| author | Boodhoo Beebee Adiilah, Ibrahim |
| author2 | Louw-Potgieter, Joha |
| author_browse | Boodhoo Beebee Adiilah, Ibrahim Louw-Potgieter, Joha |
| author_facet | Louw-Potgieter, Joha Boodhoo Beebee Adiilah, Ibrahim |
| author_sort | Boodhoo Beebee Adiilah, Ibrahim |
| collection | Thesis |
| description | Responding to recent calls in the literature for cross-country comparisons of evaluation practice, this simulation study investigated (a) evaluators' perspectives on what determines a programme's evaluability, (b) what criteria evaluators prioritise when assessing a programme's evaluability, and (c) the degree to which practice context (developing, developed, or both) and self-reported levels of evaluation experience predict programme evaluability decisions. Valid responses from evaluators practising in the United States of America (n = 94), the United Kingdom (n = 30), Brazil (n = 91) and South Africa (n = 45) were analysed. Q factor analyses using data collected via a Q Sort task revealed four empirically distinct evaluability perspectives. The dominant perspectives were labelled as theory-driven and utilisation-focused. Correspondence analyses demonstrated that participants used different criteria to assess the evaluability of three fictitious evaluation scenarios. Multinomial regression analyses confirmed that practice context and level of experience did not predict the type of evaluability criterion prioritised in any of the scenarios. Evaluators practising in developed countries were more likely to characterise a programme with robust structural features, unfavourable stakeholder characteristics, and unfavourable logistical conditions as evaluable with high difficulty than as evaluable with medium difficulty. Evaluators with limited experience were more likely than unlikely to embark on an evaluation of such a programme. This study represents the first empirical investigation of how evaluators from selected developed and developing countries assess programme evaluability. |
| format | Thesis |
| id | oai:open.uct.ac.za:11427/25260 |
| institution | University of Cape Town (South Africa) |
| language | eng |
| last_indexed | 2026-06-10T12:31:47.142Z |
| license_str | Not specified — see source repository |
| provenance_str_mv | Harvested via OAI-PMH from UCTD — University of Cape Town Open Access Repository |
| publishDate | 2017 |
| publishDateRange | 2017 |
| publishDateSort | 2017 |
| publisher | Organisational Psychology |
| publisherStr | Organisational Psychology |
| record_format | dspace |
| source_str | UCTD — University of Cape Town Open Access Repository |
| spelling | oai:open.uct.ac.za:11427/25260 Evaluator characteristics and programme evaluability decisions: an exploratory study of evaluation practice in South Africa, Brazil, the United Kingdom, and the United States of America Boodhoo Beebee Adiilah, Ibrahim Louw-Potgieter, Joha Organisational Psychology Responding to recent calls in the literature for cross-country comparisons of evaluation practice, this simulation study investigated (a) evaluators' perspectives on what determines a programme's evaluability, (b) what criteria evaluators prioritise when assessing a programme's evaluability, and (c) the degree to which practice context (developing, developed, or both) and self-reported levels of evaluation experience predict programme evaluability decisions. Valid responses from evaluators practising in the United States of America (n = 94), the United Kingdom (n = 30), Brazil (n = 91) and South Africa (n = 45) were analysed. Q factor analyses using data collected via a Q Sort task revealed four empirically distinct evaluability perspectives. The dominant perspectives were labelled as theory-driven and utilisation-focused. Correspondence analyses demonstrated that participants used different criteria to assess the evaluability of three fictitious evaluation scenarios. Multinomial regression analyses confirmed that practice context and level of experience did not predict the type of evaluability criterion prioritised in any of the scenarios. Evaluators practising in developed countries were more likely to characterise a programme with robust structural features, unfavourable stakeholder characteristics, and unfavourable logistical conditions as evaluable with high difficulty than as evaluable with medium difficulty. Evaluators with limited experience were more likely than unlikely to embark on an evaluation of such a programme. This study represents the first empirical investigation of how evaluators from selected developed and developing countries assess programme evaluability. 2017-09-20T13:55:54Z 2017-09-20T13:55:54Z 2017 Doctoral Thesis Doctoral PhD http://hdl.handle.net/11427/25260 eng application/pdf Organisational Psychology Faculty of Commerce University of Cape Town |
| spellingShingle | Organisational Psychology Boodhoo Beebee Adiilah, Ibrahim Evaluator characteristics and programme evaluability decisions: an exploratory study of evaluation practice in South Africa, Brazil, the United Kingdom, and the United States of America |
| thesis_degree_str | Doctoral |
| title | Evaluator characteristics and programme evaluability decisions: an exploratory study of evaluation practice in South Africa, Brazil, the United Kingdom, and the United States of America |
| title_full | Evaluator characteristics and programme evaluability decisions: an exploratory study of evaluation practice in South Africa, Brazil, the United Kingdom, and the United States of America |
| title_fullStr | Evaluator characteristics and programme evaluability decisions: an exploratory study of evaluation practice in South Africa, Brazil, the United Kingdom, and the United States of America |
| title_full_unstemmed | Evaluator characteristics and programme evaluability decisions: an exploratory study of evaluation practice in South Africa, Brazil, the United Kingdom, and the United States of America |
| title_short | Evaluator characteristics and programme evaluability decisions: an exploratory study of evaluation practice in South Africa, Brazil, the United Kingdom, and the United States of America |
| title_sort | evaluator characteristics and programme evaluability decisions an exploratory study of evaluation practice in south africa brazil the united kingdom and the united states of america |
| topic | Organisational Psychology |
| url | http://hdl.handle.net/11427/25260 |
| work_keys_str_mv | AT boodhoobeebeeadiilahibrahim evaluatorcharacteristicsandprogrammeevaluabilitydecisionsanexploratorystudyofevaluationpracticeinsouthafricabraziltheunitedkingdomandtheunitedstatesofamerica |