Education Project Evaluation - Planning Your Evaluation. Education Project Evaluation an Evaluation. These are the California B- WET grant requirements for your project evaluation. To use the rubric, read through your proposal's evaluation section, then read each question below and the directions for scoring on a scale from 3 to 0 and for tallying your score. A top score is 1. At the start of the grant we will conduct a front- end evaluation (likely via a survey) of program participants (high- school and college students) to determine their prior knowledge and attitudes about the topics they will study. At the end of the summer workshop and twice during the school year, all participants will repeat relevant portions of the front- end survey so we can track changes in knowledge, attitudes and possibly stewardship actions immediately after their experiences as well as over time (a time series evaluation design).
At the end of the grant we will report the summative impact of this project on participants. The broad questions we will attempt to answer with this evaluation are: Do participants’ understanding of the local watershed system improve and do they feel better connected to the local system? Are the topics presented during the workshop relevant to participants? Do they inspire stewardship interests/actions? What impact does the program have on participants’ aspirations toward advanced schooling, interest in/pursuit of science careers, and stewardship actions? What aspects of this program (content, pedagogy, field experiences and/or mentoring) do participants report as having the greatest impacts of them? SAMPLE 2. Project Evaluation.
The target audience for this evaluation is teachers participating in a weeklong summer workshop. The main questions for the evaluation are: Which aspects of the workshop worked well? What changes would improve the workshop? What’s the impact of the workshop on the teachers who attend? Does it change their knowledge or how to teach the content, and in what ways? What impact does the workshop have on classroom practice? Do the teachers use what they learned in the workshop?
Study Designs for Program Evaluation. Study of selected examples. This might involve open-ended surveys. A program conducts a simple needs assessment (exploratory study).
All teacher participants would complete a pre- workshop survey. At the end of each day, teachers would provide feedback on the day’s events and activities via a feedback form. On the last day of the workshop, teachers would complete a post- workshop survey (one similar to the pre- workshop survey). The survey and feedback forms would use a mix of questions to collect qualitative and quantitative data. Data from the pre- workshop survey would be compared to responses on the post- workshop survey to track changes in participants over the week. Responses on the feedback forms will help us improve the delivery of the program.
Get a basic guide to program evaluation in this topic from the Free Management Library. The program evaluation form is used for documenting the effectiveness of a program. This is generally created by professional evaluators that are hired by the.
Step 3 - Identifying evaluation questions and information requirements. Example Scenario: The Koala Shire Enterprising Futures Program Examples of evaluation questions.
Approximately 6 months after the workshop, teacher participants will be asked to complete an online or telephone survey to determine the workshop’s impacts on their teaching and their use of the materials we provided. SAMPLE 3. Project Evaluation. Our main evaluation question is: What’s the impact of the program on students? We want to know if, at the end of the school year, students know/understand more about watersheds than they did at the beginning of the year. This evaluation will focus on program participants—middle school students.
Evaluation is an important part of developing and running an engagement activity. Evaluation examples; Evaluation resources; Student-led evaluation; Survey questions; Ethical and. Planning a Program Evaluation G3658-1. Acknowledgements For their timely and thoughtful review of this publication. Be as specific as possible when you identify potential. SAMPLE EVALUATION INSTRUMENTS. Post Evaluation TITLE OF PROGRAM NAME OF ORGANIZATION Post Evaluation ID Number. Learn how program evaluation makes it easier for everyone involved in community health and development work to evaluate their efforts. Sample Program Evaluation Form . 1=Poor 2=Fair 3=Good 4=Excellent Quality of. Sample Training Evaluation Form Author: camerona Created Date: 10/5/2009 9:54:57 AM.
We plan to collect data using two methods: 1) student concept maps on the concept “watershed” and. A concept map is a knowledge representation tool developed by Joseph Novak and associates in the 1.
Novak, 1. 99. 8, p. Concepts maps “met a need for an evaluation tool that can show easily and precisely changes in students’ conceptual understanding” (Novak, 1. This evaluation method has been found to be reliable and valid by Novak and other researchers (Novak, 1. We plan to use the concept mapping technique as a pre- test in the winter, before students have experienced the program. And then use the same technique late in the school year to post- test students on the same concept. We will gain parents’ permission for students to participate in this evaluation. For students whose parents do not grant permission, we have an art activity for them to complete at test time.
Each test session should take about an hour. During that time we plan to train students on how to create a concept map using a non- watershed concept, then we’ll ask them to construct a concept map on the concept “watershed.”We intend to use Novak’s scoring criteria (Novak, 1. Then we’ll use statistical analyses to compare students’ pre- test and post- test scores (statistical tests to be determined). Our hypothesis is that the program will have a positive impact on students’ knowledge about the local watershed. Novak, J. D. Learning, Creating, and Using Knowledge: Concept maps as facilitative tools in schools and corporations. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
Novak, J. D. Learning How to Learn. Cambridge: Cambridge University Press. SAMPLE 4. Project Evaluation. Of our project objectives, our evaluation will focus on assessing our success at increasing participants’ knowledge about the local watershed, engaging them in quality scientific investigations and increasing their stewardship actions toward the watershed. We will use a mixed- methods evaluation strategy (surveys and observations) to provide us with formative data so we can improve our program and summative data to show our program’s impact. The principal investigators will implement the evaluation with Dr.
XYZ serving as our advisor on the development of assessment instruments, the analysis of data and reporting of results. We will start on the first day of the program with a pre- program survey of participants’ knowledge of local watersheds and their actions regarding wetland conservation. We will conduct a nearly identical post- program survey during the final day of the program. During each field work session, two trained interns will use an observation instrument to assess the quality of participants’ field investigations. The observers will share their findings with the staff after each session so we can improve how we conduct the field work with participants.
Finally, at the end of the program, we will ask participants to complete a survey about their intended actions regarding conservation of the local watershed. All the evaluation data collected will be summarized and included in our final report. These are provided as examples of a poorly planned or articulated evaluation section for a B- WET grant proposal. Parents will also complete an assessment tool to provide feedback. Students will also keep journals and present final projects, which will encompass all they've learned during the program. Evaluation will be both formative and summative with the evaluator compiling and reporting on the results.
At the end of each program we will ask participants to tell us what they thought about the program and suggest ways to improve it. We will also ask them to tell us one thing they learned from that program. This information will help us improve the program so that it better meets our objectives and participants' needs.
This is a good tool to help you think about your project as a whole. The first column includes your objectives, that is, how you believe your audience will be different after they participate in your project. The next three columns are where you list what you will provide/do in order to meet your objectives. The final two columns are your outcomes- how your audience will be different immediately after participating in your project and in the not- to- distant future. Kellogg Foundation, 2.
A logic model is a . Logic models link project outcomes (short- , intermediate- and long- term) with project activities, outputs and inputs (or resources) &. Logic models provide a road map of your project, showing how it is expected to work, the logical order of activities and how the desired outcomes will be achieved. Why use it? The purpose of a logic model is to provide stakeholders with a road map describing the sequence of related events connecting the need for the planned program with the programs' desired results.
Mapping a project helps you visualize and understand how human and financial investments can contribute to achieving your intended program goals and can lead to program improvements. Kellogg Foundation, 2. Pros. Helps you and colleagues/partners link all the components together on the same page.
Helps project/program designers differentiate between objectives and activities, between outputs and outcomes. Helps managers/stakeholders see how all the components fit together. Aids decision making about resources and activities. Helps managers determine where resources will go to achieve impacts. Sets up project/program so that it's easier to evaluate.
Helps individuals see how they contribute to the project/program. Funders are starting to request them.