10.2 – Outcomes Assessment
Standard: The agency shall use evaluation results to assess the outcomes of park and recreation programs, services, and facilities and assess the operational effectiveness of the organization. Outcomes show the relationship between resource inputs and the resulting impacts and benefits of the outputs. Outcomes are measurable changes in behaviors, attitudes, knowledge, conditions or skills.
Suggested Evidence of Compliance: Provide examples of how evaluation results are used to determine levels of performance and effectiveness in the organization and how evaluation is used to determine if specific programs, services or facilities are achieving planned or projected results.
COMMENT: Question: Are goals or objectives established in advance of the program offerings? Are the evaluation methods conducted or survey questions asked in a way to determine if goals/objectives were achieved? How do you know that the program/service was effective?
RESPONSE: Yes, goals & objectives are established in advance of program offerings so they can then be tracked via after program reports to determine if they were met. Westchester County PRC uses after program reports as an evaluation tool and the information/questions on the report were established to allow for easy reviewed of program results. The after program report is one tool used to determine if a program/service was effective in achieving the desired outcome. Additionally, the department uses other forms of outcome assessments to determine if participants are meeting the program goals and objectives designated in the Westchester County Parks, Recreation Programming Plan. Outcome assessments come in the form of evaluation results, program evaluation reports, and surveys. Results from assessments are used to help staff determine if any adjustments need to be made in activities, facilities, or programs offered. Management staff reviews evaluations and meets with staff to share results, with the goal of overall improvement moving forward.
COMMENT: Question: Are there any comparable situations where an evaluation is conducted multiple times (e.g., each season/year) to see if there have been any improvement/changes in achieving planned or projected results?
RESPONSE: Objectives are reviewed after each program and evaluated yearly by the Recreation division to assess the value of each program to its targeted constituency. After program reports (evaluations) are completed at the conclusion of each program and evaluated at the yearly meeting. If an event is annual, it is reviewed each year. As an example, the after program report for our Salute to Seniors event is completed each year to ensure that our goals and objectives for the event are met and establish if there needs to be improvements or changes to achieve planned results. These reports are now included as EOC 9.
REVISED AGENCY EVIDENCE OF COMPLIANCE:
10.2 EOC 9 May 2022-2023 Salute to Seniors After Program Report
Narrative:
PRC uses evaluation results to assess the outcomes of programs, services and facilities and operational effectiveness. Program evaluation is vital in determining if goals and objectives have been met, and in deciding if a program or service needs improvement or change.
PRC uses Logic Models to assess programs which include inputs and resources needed, activities, outputs, outcomes and impact of program.
Customer surveys are also used for evaluation, for example, due to the success of the drive-thru light show Westchester’s Winter Wonderland at Kensico Dam Plaza, there were not enough ticketed times available for the demand so a survey question was asked to see if the public would attend the weekend prior to Thanksgiving. Of those surveyed, 95% would not attend therefore dates were not added. Similarly, it was determined 55% of patrons were not satisfied with the treat box sold for the event as they believed the options were not worth the price. As there was not a way to significantly reduce the price or change the contents, the treat box was discontinued.
Another example is the Saxon Woods Senior Pool Party Evaluation Survey. When attendees were asked if they enjoyed the band “Total Soul,” 94% surveyed were either very satisfied or satisfied. As a result the band was booked for the next year.
PRC’s comprehensive Residents Recreation Preferences Survey is conducted every ten years and is used for assessment as well as compared to the prior survey which allows for an umbrella approach of evaluation and change by analyzing facilities conditions, use, needs, programs, benefits and future investment.
Agency Evidence of Compliance:
10.2 – EOC 1 Logic Model – Farmer’s Market at Muscoot Farm
10.2 – EOC 2 Logic Model – Lasdon Train Show
10.2 – EOC 3 Logic Model – Hike for Health at Ward Pound Ridge Reservation
10.2 – EOC 4 Logic Model – Clean River Project for Riverkeeps Sweep on Bronx River
10.2 – EOC 5 Survey Results Summary – Winter Wonderland
10.2 – EOC 6 Survey Results – Winter Wonderland
10.2 – EOC 7 Survey Results – Senior Pool Party
10.2 – EOC 8 PRC Residents Recreation Preferences Survey 2022