Update on the Assessment of Undergraduate Learning Outcomes Collegiate Learning Assessment B.4 B.5

Size: px

Start display at page:

Download "Update on the Assessment of Undergraduate Learning Outcomes Collegiate Learning Assessment B.4 B.5"

Chloe Barton
5 years ago
Views:

1 Update on the Assessment of Undergraduate Learning Outcomes Collegiate Learning Assessment B.4 B.5 CAL POLY, SAN LUIS OBISIPO WASC Interim Report, March 2015

2 Appendix B: Update on the Assessment of Undergraduate Learning Outcomes Collegiate Learning Assessment B.4 B.5 (PDF) B.4 Collegiate Learning Assessment: Historical Data Table B.5 Collegiate Learning Assessment:

3 Appendix B.4. Collegiate Learning Assessment Historical Data Original CLA Testing Format: 1/2 students given Performance and 1/2 given Writing Assignment Total Score (% Rank) Performanc e Analytic Writing Make an Argument Critique an Argument Value- Added Total CLA Score Year Cohort Sample Size n= Avg Time on Notes on recruitment & administration Freshmen (78%) 1132 (79%) 1136 (80%) 1109 (71%) 1164 (87%) not available embedded in Freshman Math classes Seniors (86%) Note: Sample size too small for subtest scoring Above not available attempted to embed in senior seminars Median time on Std Dev Time on Freshmen (87%) 1178 (88%) 1226 (84 %) 1232 (86%) 1220 (84%) not available all students were within OCOB Seniors (69%) 1217 (74%) 1273 (66%) 1266 (68%) 1279 (61%) At not available all students were within OCOB not administered Freshmen (60%) 1070 (60%) 1080 (60%) 1101 (69%) 1057 (54%) embedded in Freshman classes Seniors (74%) 1214 (73%) 1214 (72%) 1216 (79%) 1211 (68%) Near seniors invited Freshmen (93%) 1200 (95%) 1164 (91%) 1150 (89%) 1169 (93%) freshmen invited Seniors (90%) 1260 (85%) 1268 (93%) 1230 (85%) 1306 (94%) Near seniors invited Freshmen (94%) 1192 (93%) 1193 (94%) 1201 (96%) 1185 (91%) freshmen invited Seniors (61%) 1207 (68%) 1152 (43%) 1150 (54%) 1156 (39%) Below embedded in senior classes New CLA Testing Format - All students given Performance and Selected Response Questions Year Cohort Sample Size n= Total Score (% Rank) Performanc e Selected Response Questions Subscore: Scientific & Quantitativ e Reasoning Subscore: Critical Reading & Evaluation Subscore: Critique an Argument Perf Avg Time on Perf Median time on Perf Std Dev Time on Question s Avg Time on Question s Median time on Value- Added Freshmen (98%) 1187 (97%) 1197 (98%) Seniors (89%) 1218 (92%) 1218 (86%) Near Note: % Rank = Cal Poly's ranking within all participating institutions Questions Std Dev Time on

4 Appendix B.5 Collegiate Learning Assessment: (Continued) Institutional Report cla+

5 Appendix B.5 Collegiate Learning Assessment: (Continued) TABLE OF CONTENTS Your Results 1 Summary Results, by Class p. 2 2 Distribution of Mastery Levels p. 3 3 Value-Added Estimates p. 4 4 CLA+ Subscores p. 5 5 Student Effort and Engagement p. 6 6 Student Sample Summary p. 7 Institutional Report 1

6 Appendix B.5 Collegiate Learning Assessment: (Continued) SECTION 1: SUMMARY RESULTS, BY CLASS Number of Students Tested, by Class Freshmen: 106 Sophomores: 0 Juniors: 0 Seniors: 140 Summary CLA+ Results, by Class TOTAL CLA+ PERFORMANCE TASK SELECTED- RESPONSE QUESTIONS ENTERING ACADEMIC ABILITY MEAN 25 TH PERCENTILE 75 TH PERCENTILE MEAN PERCENTILE RANK Freshmen Seniors Freshmen Seniors Freshmen Seniors Freshmen Sophomores N/A N/A N/A N/A -- Juniors N/A N/A N/A N/A -- Seniors EFFECT SIZE V. FRESHMEN has a senior Total CLA+ score of 1218 and percentile rank of 89. The corresponding Mastery Level for this score is Proficient. Institutional Report 2

7 Appendix B.5 Collegiate Learning Assessment: (Continued) SECTION 2: DISTRIBUTION OF MASTERY LEVELS Distribution of CLA+ Scores, by Mastery Level FRESHMEN SOPHOMORES JUNIORS SENIORS Mastery Levels, by Class MEAN TOTAL CLA+ MEAN MASTERY LEVEL PERCENT BELOW BASIC PERCENT BASIC PERCENT PROFICIENT PERCENT ADVANCED FRESHMEN 1192 Proficient SOPHOMORES N/A N/A N/A N/A N/A N/A JUNIORS N/A N/A N/A N/A N/A N/A SENIORS 1218 Proficient Institutional Report 3

8 Appendix B.5 Collegiate Learning Assessment: (Continued) SECTION 3: VALUE-ADDED ESTIMATES EXPECTED SENIOR MEAN CLA+ Total CLA+ Score Performance Selected-Response Questions ACTUAL SENIOR MEAN CLA+ VALUE-ADDED PERFORMANCE PERCENTILE CONFIDENCE INTERVAL BOUNDS LEVEL RANK LOWER UPPER Total CLA+ Score 0.11 Near Performance 0.27 Near Selected-Response Questions 0.02 Near Expected vs. Observed CLA+ Scores Institutional Report 4

9 Appendix B.5 Collegiate Learning Assessment: (Continued) SECTION 4: CLA+ SUBS Performance : Distribution of Subscores (in percentages) ANALYSIS & PROBLEM SOLVING WRITING EFFECTIVENESS WRITING MECHANICS FRESHMEN SOPHOMORES JUNIORS SENIORS NOTE: The Performance subscore categories are scored on a scale of 1 through 6. Selected-Response Questions: Mean Subscores SCIENTIFIC & QUANTITATIVE REASONING 25 th 75 th Mean Percentile Percentile Score Score Score CRITICAL READING & EVALUATION 25 th 75 th Mean Percentile Percentile Score Score Score CRITIQUE AN ARGUMENT 25 th 75 th Mean Percentile Percentile Score Score Score FRESHMEN SOPHOMORES N/A N/A N/A N/A N/A N/A N/A N/A N/A JUNIORS N/A N/A N/A N/A N/A N/A N/A N/A N/A SENIORS NOTE: The selected-response section subscores are reported on a scale ranging approximately from 200 to 800. Institutional Report 5

10 Appendix B.5 Collegiate Learning Assessment: (Continued) SECTION 5: STUDENT EFFORT AND ENGAGEMENT Student Effort and Engagement Survey Responses How much effort did you put into the written-response task/ selected-response questions? PERFORMANCE TASK NO EFFORT AT ALL A LITTLE EFFORT A MODERATE AMOUNT OF EFFORT A LOT OF EFFORT MY BEST EFFORT Freshmen 0% 3% 29% 39% 29% SELECTED- RESPONSE QUESTIONS Seniors 0% 5% 29% 34% 32% Freshmen 2% 4% 36% 46% 12% Seniors 1% 9% 37% 29% 24% How engaging did you find the written-response task/ selected-response questions? PERFORMANCE TASK NOT AT ALL ENGAGING SLIGHTLY ENGAGING MODERATELY ENGAGING VERY ENGAGING Freshmen 10% 19% 45% 23% 3% EXTREMELY ENGAGING SELECTED- RESPONSE QUESTIONS Seniors 2% 10% 43% 36% 9% Freshmen 11% 31% 37% 20% 1% Seniors 9% 21% 48% 19% 4% Institutional Report 6

11 Appendix B.5 Collegiate Learning Assessment: (Continued) SECTION 6: STUDENT SAMPLE SUMMARY Student Sample Summary FRESHMEN SOPHOMORES JUNIORS SENIORS DEMOGRAPHIC CHARACTERISTIC N % N % N % N % TRANSFER Transfer Students N/A N/A N/A N/A 0 0% Non-Transfer Students N/A N/A N/A N/A % GENDER PRIMARY LANGUAGE FIELD OF STUDY FIELD/ ETHNICITY PARENT EDUCATION Male 48 45% N/A N/A N/A N/A 85 61% Female 56 53% N/A N/A N/A N/A 51 36% Decline to State 2 2% N/A N/A N/A N/A 4 3% English 99 93% N/A N/A N/A N/A % Other 7 7% N/A N/A N/A N/A 24 17% Sciences & Engineering 71 67% N/A N/A N/A N/A 82 59% Social Sciences 10 9% N/A N/A N/A N/A 12 9% Humanities & Languages 9 8% N/A N/A N/A N/A 5 4% Business 12 11% N/A N/A N/A N/A 14 10% Helping / Services 2 2% N/A N/A N/A N/A 5 4% Undecided / Other / N/A 2 2% N/A N/A N/A N/A 22 16% American Indian / Alaska Native / 0 0% N/A N/A N/A N/A 1 1% Indigenous Asian (including Indian 17 16% N/A N/A N/A N/A 27 19% subcontinent and Philippines) Native Hawaiian or other Pacific 0 0% N/A N/A N/A N/A 1 1% Islander African-American / Black 1 1% N/A N/A N/A N/A 2 1% (including African and Caribbean), non-hispanic Hispanic or Latino 7 7% N/A N/A N/A N/A 15 11% White (including Middle Eastern), 72 68% N/A N/A N/A N/A 83 59% non-hispanic Other 2 2% N/A N/A N/A N/A 1 1% Decline to State 7 7% N/A N/A N/A N/A 10 7% Less than High School 0 0% N/A N/A N/A N/A 9 6% High School 8 8% N/A N/A N/A N/A 10 7% Some College 13 12% N/A N/A N/A N/A 26 19% Bachelor s Degree 32 30% N/A N/A N/A N/A 50 36% Graduate or Post-Graduate Degree 53 50% N/A N/A N/A N/A 45 32% Institutional Report 7

ENROLLMENT MANAGEMENT REPORT COLLEGE PROFILE PHARMACY FALL 2017

ENROLLMENT MANAGEMENT REPORT COLLEGE PROFILE PHARMACY FALL 217 INTRODUCTION COLLEGE PROFILE The following college profile has been developed to tailor our annual enrollment report to your specific college