Program ReviewRuben Armiñana
- The Sonoma State Program Review aims to maintain and strengthen Sonoma State’s curriculum through a wide-ranging examination of its ideas and institutions. It is a process essential to long-term planning, resource allocation and other decision making within the university.
Some of the principles guiding this endeavor are the following:
- Program review is a process which offers a systematic analysis of the objectives and performance of an academic unit, an analysis based on both quantitative and qualitative evidence.
- The review process shall be considered interactive at all levels, with open, professional dialogue among all participants.
- Successful program review depends on faculty and academic staff’s willingness to engage in a self-study process. The faculty of each department or program will design their own assessment approaches, reflecting the singularity of the discipline, department culture and its students’ needs. (As per Sonoma State’s Assessment Home Page, available at www.sonoma.edu/assessment/front.html.)
- Successful program review depends on adequate resources to engage in that review.
- Program review will be consistent with Sonoma State’s Long-Range Academic Plan, CSU system policies, WASC Standards , and the standards of external accrediting bodies when relevant.
PURPOSES OF PROGRAM REVIEW
A review of academic programs involves a thorough evaluation of:
- program mission and goals, and their alignment with the mission of the Sonoma State University;
- assessment of student learning outcomes;
- the curriculum through which program goals are pursued;
- the quality and diversity of the faculty and staff, and their contributions to the program mission and goals;
- the program’s service and contributions to the community;
- the effectiveness of recruitment, retention and support practices for all students (addressing issues of quality, diversity, academic advising, mentoring, career development and placement);
- the programmatic issues requiring administrative attention and resource issues from the program’s perspective; and
- program revisions based on assessment, and plans for future assessment.
- Program review is a periodic process that incorporates the findings of
ongoing program assessment and focuses attention on specific areas for program
improvement. It is mandated by the CSU Board of Trustees and by WASC accreditation
standards. Detailed assessment of learning outcomes, however, is an accepted
dimension of overall program review, one that may require a higher level of
resources than review of traditional input-based quality measures, particularly
in the initial cycle. The University recognizes that program review and ongoing
assessment, in economic terms, are investments in the future of the University.
Therefore, departments, working in conjunction with the department chairs and school deans, will identify resource needs, such as the need for faculty time to develop and conduct assessment activities and the need for the use of an outside evaluator of the program self-study, in order to meet the requirements of program review and assessment of student learning.
- A review of academic programs involves a thorough evaluation of:
THE ORGANIZATIONAL PROCESS OF PROGRAM REVIEW
- Academic Affairs will maintain the required schedule of five year reviews for each academic unit, developed in consultation with the school Deans, and will inform the department chair, program chair or coordinator when the time for program review is approaching.
The academic program review process consists of:
- The department or program’s preparation of its Self-Study document, using assessment measures determined to be appropriate by the program or department, as per their Interim Program Review
- The site visit and report of external reviewers, who will submit a written report
- Review of the Self-study draft and external evaluator’s report (or equivalent) by the School Curriculum Committee (or equivalent) and the School Dean, including written summary and response.
- Review by the Educational Policies Committee (EPC), adding responses and recommendations as necessary
- Revisions by department or program as needed, based on EPC feedback
- The final report is forwarded to the Provost for review and action and will be made available to the university community.
PROGRAMMATIC SELF STUDY
- A Department’s Self-Study is a structured reflection of its faculty, staff, students and alumni concerning the educational effectiveness of its academic programs. It is important that the self-study engage all of the faculty within the department or program and that input from staff, students and alumni be solicited. The report must be able to substantiate its assertions and conclusions by providing data or citing specific examples.
- The Office of Analytical Studies and Planning can provide programs with necessary technical data (admissions, GPA’s, enrollment figures). In addition, the Office of Analytical Studies and Planning and the Faculty Assessment Coordinator (University or school) can provide technical assistance in developing valid evaluation measures (such as surveys) and analyzing data.
Program Introduction and History
- Description of the academic program or programs offered by the department or academic unit, with reference to prior program reviews and their highlights. See Appendix A, Basic Statistical Data.
The self-Study should document and describe the following elements, for
both majors and minors:
- A list of learning goals for each academic program (undergraduate and graduate, centers and institutes)
- A rationale for learning goals and outcomes (e.g. conceptual frameworks about learning, standards/trends in the discipline, encouragement of diverse perspectives, expectations of equivalent programs at other universities, surveys of students/alumni)
- Dissemination of learning goals to students
- Structuring of the curriculum to reach expected outcomes
- Documentation of effective teaching strategies for helping students achieve expected outcomes
- If applicable, departmental involvement in distance and distributed education courses, including their evaluation
- If applicable, description of cross-departmental courses and how these serve majors from other departments
- If applicable, description of GE courses and how these meet the GE area criteria
Explain how your department, program or unit:
- Addresses the cultural, ethnic and social diversity of the Sonoma State student body in the curriculum
- Accommodates differences in student preparation and access to educational opportunities
- Shows leadership in recruiting and retaining diverse faculty and students, without reliance on discriminatory preferences
- Addresses diversity issues in its advising, mentoring, and career development
- Explain how your department, program or unit:
- Provide a profile of your student body with an overview of their educational needs. Include an assessment of academic advising and its role in meeting those needs.
Evaluate the quality and strengths of your faculty in relation to program
goals and university goals. In particular discuss the following elements:
- Pedagogy: Faculty development for teaching in the major and, when relevant, the teaching of GE courses
- Participation: Faculty participation in governance of the Department, School and University
- Professional Contributions: Document evidence of leadership in the discipline, outstanding teaching, scholarship and creative activity, external funding for individual or collaborative projects, and responsiveness to changes in the discipline. Consider how these are reflected in the program’s RTP policies.
- Evaluate the quality and strengths of your faculty in relation to program goals and university goals. In particular discuss the following elements:
Institutional Support and Resources
In consultation with each Department or Unit, describe and assess how
the following integrate and contribute to student learning objectives:
- Computer technology
- Student support services
- Faculty development and support services
Describe and assess the adequacy of the following:
- Physical facilities
- Financial resources
- Human resources (include workload analysis for both faculty & staff)
- In consultation with each Department or Unit, describe and assess how the following integrate and contribute to student learning objectives:
- Assessment & Findings
- Description of the Department or unit assessment plan (as proposed in the Interim Program Review)
- Analysis of the educational effectiveness of the program, using appropriate assessment data
- Discussion of changes necessary to improve effectiveness of the outcomes of the program
- Description of dissemination of findings, including outside evaluation, to faculty and staff
- Action plan based on findings and recommendations
Description of proposed program revisions in the following areas, as
- Teaching-learning methods
- Course content
- Learning objectives
- Recruitment and mentoring
- Advising and mentoring in the major, in GE (if applicable)
- Other areas deemed to be of importance
- Program Introduction and History
- The purpose of external review is to provide an independent and broader perspective on the program. The process requires at least one external consultant, and the academic unit will nominate its potential reviewers. Consultants should either hold faculty rank (or the equivalent) in the same or similar programs, be individuals of significant professional reputation in the field, or (in the case of an existing external accreditation board) be an official representative of the accrediting body.
- Letters are sent to nominees inviting their participation and requesting a curriculum vitae. After deliberation, the review team submits a list of potential consultants to the School Dean for approval. Upon the Dean’s approval, the review team can formally invite the potential consultant(s) and establish dates for a site visit. The consultant should be provided with a copy of the Self-Study document and other relevant materials for their visit.
- The consultant is expected to submit to the department a written report of his/her findings and recommendations within two weeks of the visit. Copies of these reports will be included in the final program review document. See Appendix B: Guidelines for External Reviewers
GRADUATE PROGRAM REVIEW
- In the case of a Department with both an undergraduate and graduate component, the two programs may be reviewed concurrently or separately. If reviewed concurrently, the Department shall so prepare its report that the two components can be separated, with the graduate program portion being forwarded to the Graduate Studies Subcommittee for evaluation. The Graduate Studies subcommittee shall prepare an evaluation report that will be forwarded to the EPC for incorporation into its evaluation of the Department’s total program review.
- In the case of a review of a freestanding graduate program, the Graduate Studies Subcommittee shall act in lieu of the EPC in formally reviewing the Program Review and supporting documents. The Graduate Studies Subcommittee shall prepare an evaluation report of no more than 5 pages, which shall be forwarded to the EPC, with a copy to the department.
SUBSTITUTION OF AN ACCREDITATION REPORT
- Any currently accredited academic unit which is separately accredited by an external agency or accrediting body may request, with the approval of the school dean, consent from EPC to substitute an accreditation report as the basis for a program review, if the program documents that its accreditation process clearly addresses all or most of the areas of concern to Sonoma State’s process (as articulated in the Self Study Template). By agreeing to accept such a report in lieu of a program review, it is understood that certain questions or sections unique to the Sonoma State review process may be required in addition. At a minimum, the program may coordinate the time frame it uses for its separate accreditation process with its SSU review.
* Academic unit may refer to a degree-granting
program as well as other programs related to academic life (e.g. certificate
programs, library, counseling services and so on). The EPC (Educational Policies
Committee) will determine which academic units should undertake program review
following this policy.
* As per Standard Four of the WASC Accreditation Handbook: “The institution conducts sustained, evidence-based and participatory discussions about how effectively it is accomplishing its purposes and achieving its educational objectives. These activities inform both institutional planning and systematic evaluations of educational effectiveness. The results of institutional inquiry, research and data collection are used to establish priorities at different levels of the institution and to revise institutional purposes, structures and approaches to teaching, learning and scholarly work.”
Updated March 3, 2006 by SSU.firstname.lastname@example.org