MGT 5000 - Evaluating Research in Management Chapters 5, 6, 7 May 2, 2017 | Alexis Lake Question 6-1: How do you define pseudo evaluations? A pseudo evaluation is essentially what the authors call evaluations that “fail to produce and report valid assessments of merit or worth to all right-to-know audiences,” (Stufflebeam & Shinkfield, 2007, pg. 145). Essentially this means that pseudo evaluations tend to selectively present information, over generalize particularly negative findings, or even falsify some findings or conclusions from an evaluation. These may look like real or sound evaluations, but they are incomplete, skewed to certain perspective or ideas, and are often narrowly focused. The textbook also mentions that pseudo evaluations are politically motivated - where the client or the evaluator are looking to amplify a certain result or achievement other others. There are five types of pseudo evaluations: public relations inspired (a feel good evaluation focused on the positives of a program, product, etc.), politically controlled (multiple truths uncovered), pandering (driven by the evaluators to receive more client business), evaluation by pretext (the client has a hidden agenda for conducting the evaluation that is unknown to the evaluator) and empowerment under the guise of evaluation (an external evaluator aims to validate an internal evaluation because he/she believes in the greater good of the product, service, program, etc.) Question 6-5: A distorted, very positive view of a program is reported, while problematic facts are withheld. Which form of pseudo evaluation applies to this statement? The type of pseudo evaluation that applies to this statement is the public relations inspired pseudo evaluation. In this evaluation there is an intention to utilize the findings in a way that convinces or persuades a target audience that a product, program, service, etc., is effective. As the textbook outlines, this pseudo evaluation could also be called “ideological marketing,” “advertising,” or “infomercials” (Stufflebeam & Shinkfield, 2007, pg. 146). This approach addresses or focuses on only the strengths and not the weaknesses of a program. Additionally, this approach may include biased samples, biased selection of testimonials, a massaging or softening of the evaluation results, and selective release of only positive results. An real-world example given in the textbook for pseudo evaluations is around a “Lessons Learned” document around the 1991 Gulf War. This document was released by the government and was titled as a study, but really contained misstated facts that aimed to dismantle military or weapons policies, while avoiding the negatives and debates around budgets and the role of the service. Question 6-10: Under what circumstances can evaluators legitimately give private evaluative feedback to clients? According to the textbook, evaluators can legitimately give evaluative feedback to the client or clients when the evaluation is sound in merit, conforms with all applicable laws, statues, policies (whether domestically or internationally) and appropriate contractual agreements on the release and any edits around the findings. Essentially the evaluation should be ethical, legal, and honest in the disclosure of the findings and who conducted the evaluation.
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.