Review Process

As part of UF's continuous improvement process, all UF academic programs - undergraduate, graduate, professional, and certificate - submit an annual assessment report for the previous academic year. See calendar and due dates.

Institutional Assessment staff review all Academic Assessment Data Reports using the Academic Data Report Review Rubric presented on this page. The rubric provides the criteria that should be addressed in each section of the report. As staff review the report and determine the degree to which the report addresses or meets these criteria, they rate the report criteria (using the rating scale that follows) and provide comments and suggestions for report modification. Reviews are sent to UF's assessment coordinators, who then share these with the faculty.

Academic Data Report Review Rating Scale:

  • Needs Attention (1):
    • Key items are missing (or incomplete) in the report section. Requires significant revision of narrative(s), sample instruments, SLOs, or other items.
  • Needs Minor Revision (2):
    • Items are addressed but are unclear or unsupported in the report section. Requires some revision, such as, including data in the narrative, providing a sample assessment instrument, or other items to support the narrative.
  • Well Done (3):
    • The section narrative presents a thorough and thoughtful analysis that is fully supported by relevant data. Relevenat documents, including name-redacted data that supports the claims made in the report, are attached.

 

Academic Data Report Review Rubric

  • College Information

College/Unit

Academic Program Name

Academic Year

  • Mission

All programs on campus have a mission statement that describes the purpose of the program. This component is evaluated on two criteria:
(1) Clarity – the mission is clear, concise, and
(2) Aligns with and advances the department (when appropriate), college, and university missions.

These criteria are met when the program mission specifically states how the program advances the department (when appropriate), college, and university missions.

  • Program Goal

Programmatic goal(s) address(es) programmatic elements (i.e., to graduate students who are prepared for the workplace).

Section includes evaluation methods describing how goal will be achieved and what measures will be used.

Section includes results and findings (i.e., What did you find out? Summarize your results here in tables or narrative, and attach redacted data to support your summary).

  • Student Learning Outcomes

Student Learning Outcomes reflect the curriculum, and as curriculum evolves, learning outcomes change. SLOs should be current, relevant, and rigorous. Effective SLOs focus on what students will know and be able to do in terms of observable and measurable actions or behaviors.

Current outcomes reflect current knowledge and practice in the discipline.

Relevant outcomes relate logically and significantly to the discipline.

Rigorous outcomes require an appropriate degree of academic precision and thoroughness to be met successfully.

 

Follow UF's Guide for Developing Program Goals and Student Learning Outcomes

Are approved by the AAC and consistent with the catalog

  • Student Learning Outcomes Section Components

Threshold of acceptability is included (What is the acceptable percentage of students who must achieve the outcome for you to consider the outcome to be met successfully for your program? The Academic Assessment Committee minimum is 70. Please enter only numbers 70 or higher).

Number of students assessed for each outcome is included (Enter only numbers greater than zero (0). If you are using multiple measures for the outcome, provide the total number of students that were assessed across all of the measures).

Number of students who met the outcome is included (Enter only numbers greater than zero (0). If you are using multiple measures for the outcome, combine the results to provide an total number of students that met the outcome, and enter the number of students who passed each individual measure in the Results section).

Percentage of students meeting the outcome is included (Enter only numbers. If you are using multiple measures for the outcome, combine the results to provide the total percentage of students who met the outcome, and enter the percentage of students who passed each individual measure in the Results section).

Threshold of acceptability was met/not met is included (Select yes or no).

  • Results

Report describes findings (What did you find out?).

 
Report presents analysis of effectiveness of assessment methods (Are your assessment methods functioning well?).
 

Report includes student learning strengths and weaknesses from the analysis of results (What specific strengths or weaknesses in student learning do the results reveal?).

Report disaggregates results by delivery mode (If the program is offered at an off-campus instructional site (OCIS), in UF Online, or as a fully online graduate program, disaggregate the results by location and/or delivery mode and compare the results achieved by the on-campus students, online students, and students at a distance).

Results narrative is a stand-alone piece that includes data (within narrative, and/or attached) to support findings (Attach the name-redacted data summaries you used).

  • Use of Results for Improvement Narrative

Narrative includes who reviewed results (Role, not names. E.g., Faculty, faculty committee)

Narrative includes actions taken based on findings from data (What impact did your review of these results have on your program?).

Narrative includes a description of all changes made (What did you decide to do based on what you found out?).

  • Academic Assessment Plan (AAP) Detail

Assessment Cycle (See AAP Instructions p. 3)
The Assessment Cycle is a matrix that graphically organizes the frequency of SLO assessment. Because programs have multiple SLOs in three broad categories, not all SLOs are assessed each year. The Assessment Cycle is usually a multi-year process that is completed in three years; however, the program faculty may choose to assess the SLOs annually or biennially. Program faculty should decide on when and in what year each SLO will be assessed. The Assessment Cycle is evaluated on the following criteria:

All student learning outcomes are measured.

Data is collected at least once in the cycle for each SLO.

There is a date or time-period for data analysis and interpretation.

There is a date for planning improvement actions based on the data analysis.

There is a date for dissemination of results to the appropriate stakeholders.

Assessment Oversight
In this section, list the names and contact information of those who oversee the assessment process in your program using the Assessment Oversight template.

Assessment oversight names and contact information are provided (Name, Department Affiliation, E-mails, and Phone Numbers).

Methods and Procedures - Undergraduate and All Certificate Programs (See AAP Instructions p. 3).
Each unit employs various methods and procedures to assess and collect data on student learning. In this section of the plan, units provide information on their specific methods and procedures for the SLO assessments they identify in their Curriculum Maps. In the Academic Assessment Plan, methods and procedures are evaluated on the following criteria (If applicable):

Methods and procedures are clear.

SLO Matrix is complete (See AAP Instructions p. 7 for template and example).

Measurements occur at appropriate times in the program (e.g., entry and exit).

Measurements are appropriate for the SLOs.

Methods and procedures reflect an appropriate balance of direct and indirect methods (See AAP Instructions pp. 3-4).

At least one example of a rubric used to assess an SLO is provided.

Curriculum Map – Undergraduate Programs (See AAP Instructions p. 5 for template and example).
A Curriculum Map is a matrix that graphically organizes important information about the introduction, reinforcement, and assessment of the SLOs in a degree program. Undergraduate Student Learning Outcomes and General Education SLOs are presented in the online catalog. The Curriculum Map uses a table format to indicate where in the program the SLOs are introduced (I), reinforced (R), or assessed (A). In the Academic Assessment Plan, the Curriculum Map is evaluated on these criteria:

Associates SLOs to program courses.

Identifies where SLOs are introduced, reinforced, and assessed.

Identifies assessments used for each SLO.

Research

Briefly describe the research expectations for students in the degree program. NOTE: If the degree is NOT a research degree, briefly state this, and include a brief description of any research-related activities that students complete in the program.

SLO Measures - Graduate and Professional Programs (See AAP Instructions p. 3).
Briefly describe the measurement tools used for determination of SLO achievement. These include but are not limited to rubrics, exam scores, portfolios, recital judgements, or art show critiques, etc. Please include an example of one of the grading rubrics used. The measurements should include a balance of direct and indirect methods. Direct assessments of student learning are those that provide for direct examination or observation of student knowledge or skills against measurable performance indicators (exams, presentations, papers, projects, etc.). Indirect assessments are those that ascertain the opinion or self-report of the extent or value of learning experiences (surveys, focus groups, interviews, etc.) This section of the plan should meet the following criteria:

Described clearly and concisely.

Measures are appropriate for the SLOs.

Methods and procedures reflect an appropriate balance of direct and indirect methods.

The report presents examples of at least one measurement tool.

Assessment Timeline - Graduate and Professional Programs (See AAP Instructions p. 6 for template and example).
When are the SLOs assessed and measured in the program? The Assessment Timeline is a matrix that graphically organizes the general sequence of SLO assessment in a degree program. Using this template:
Assessment Timelines are reviewed on the following criteria (If applicable):

Assessment Timeline indicates the points in the program where the SLOs are assessed and measured.

Assessment Timeline identifies the assessments used for each SLO.