EVALUATION Developmental Partners In partnership with the Metiri Group and SRI International, VITAL will design and implement formative and summative evaluation procedures consistent with Virginia's Technology Plan and the findings of the recent report to the Commonwealth by the Milken Exchange, NCREL, and SRI. The evaluation plan will address the major goals and objectives of the project, and will align with the Commonwealth of Virginia's Technology Plan, the Virginia Standards of Learning, and the Virginia Technology Standards for Instructional Personnel. Approximately 10% of the project budget will be allocated to the evaluation process. The evaluation team, made up of representatives from each of the developmental partners will work with the developmental partners who are nationally recognized leaders in evaluation of technology in education. SRI and the Milken Exchange, with NCREL, recently worked on a statewide evaluation of education technology usage in Virginia's Public Schools. Both are very familiar with the infrastructure, the Virginia Standards of Learning, and the key technology stakeholders in the Commonwealth.  Formative Evaluation The Metiri Group and SRI will be called on as developmental partners to work with the VITAL steering committee to use systematic feedback to improve the project as it unfolds. This process will be facilitated by using post training surveys of participants Summative Evaluation  In order to evaluate the success in meeting project goals and objectives, it is necessary to break these goals and objectives down into measurable outcomes. Table 1 lists the measurable outcomes, evaluation questions, and methodology that might be used to collect data that will reflect the success or failure of the project. The Metirie Group and SRI, professional competency assessment tool provides a rubric for measuring competency in areas for administrators. The evaluation of the success of this training effort will focus on educational leaders attaining the transformation stage as defined by Metiri. Outcome Research Question Evaluation Methodology  Modeling the effective use of technology Are educational leaders modeling effective use of technology? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained.  Leading and managing systemic change processes Are educational leaders leading and managing systemic change processes? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained.  Supporting professional development Are school leaders supporting professional development? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained. Knowledge of technology and student learning Do educational leaders have knowledge of technologies used and how they impact student learning? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained. School division faculty will be better able to integrate technology into instruction to advance student learning. Are school division faculties better able to integrate technology into instruction to advance student learning? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained. School division technology plans will reflect better decision making and planning. Do school division technology plans reflect better decision making and planning? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained. Outcome Research Question Evaluation Methodology Modeling the effective use of technology Are educational leaders modeling effective use of technology? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained. Leading and managing systemic change processes Are educational leaders leading and managing systemic change processes? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained. Supporting professional development Are school leaders supporting professional development? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained. Knowledge of technology and student learning Do educational leaders have knowledge of technologies used and how they impact student learning? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained. School division faculty will be better able to integrate technology into instruction to advance student learning. Are school division faculties better able to integrate technology into instruction to advance student learning? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained. School division technology plans will reflect better decision making and planning. Do school division technology plans reflect better decision making and planning? Evaluation methods would include surveys, interviews, and focus groups of a sample of educational leaders trained.