|
�Measurement Focus |
�Measurement Tool� or Method |
�Action |
Timetable |
�Evaluation Decision(s) |
|||
|
(A) |
|||||||
|
Student performance in program
components, based on objectives developed by faculty: |
|||||||
|
FEH |
IE |
WHHS |
|
|
Per Syllabus |
1. Determine if any course component needs to be modified at the
end of a given quarter; |
|
|
1. H191, H192, H193 |
1.� Basic Skills (lectures) |
1. Basic Skills (lectures) |
1.� Course
Evaluations * |
1. Students complete
evaluations mid-quarter and/or end of quarter.� * |
|||
|
2. Physics 131, 132, 133 |
2.� Fundamental Concepts Labs
(181) |
2. Bicycle Labs |
2. Students are tested
on content, per syllabus schedule. |
2.� Frequent review meetings by
Instructional Team (faculty, TAs, peer mentors, and staff); |
|||
|
3. Mechanical |
3.� Camera Labs (181) |
3. Camera Labs |
3. Instructors evaluate and grade oral presentations. |
||||
|
4. Math 161G, 162G & 263 G |
4.� Ice Cream Labs (181) |
4.� Design/Build Project |
4. Instructors evaluate
and grade lab and project work. |
3. At the end of academic year, determine if any course component
needs to be modified, dropped, or replaced. |
|||
|
5. Math 151A, 152 A, 153A |
5.� Design-Build Project (183) |
|
|
5. Instructors and evaluator(s) review comments. |
|||
|
(B) |
|||||||
|
Quality of instructional materials and delivery methods: |
|||||||
|
1.� Lecture/Basics Presentations
& Reference Materials |
|
|
|
1.� Determine if any course component
needs to be modified at the end of a given quarter |
|||
|
2.� Lab Presentations,
Procedures, & Reference Materials |
2.� Course Evaluations * |
2. Students complete course evaluation* |
End of term. |
||||
|
3.� Assignments |
3.� Student Journals
* |
3. Staff members analyze and summarize
journal entries and course evaluations.*��� |
Weekly(F)�������������������� �����������������������Biweekly(I)������������������ ����������������������As Needed(W) |
||||
|
4.� Online Resources (FEH
Webpage, WebCT) (O) |
4.� Scheduled Observations |
2.� At the end of the academic
year, determine if any course component needs to be modified, dropped, or
replaced. |
|||||
|
5.� Course Packet |
5.� Short lab evaluations; e.g.
"one-minute feedback" (optional) (F) |
4. Staff members present observations at team meetings. |
Per lab schedule |
||||
|
|
6.� Sharing evaluation data
with� Advisory Committee |
|
Ongoing |
||||
|
(C) |
|||||||
|
Basic Engineering Skills |
|||||||
|
FEH |
IE |
WHHS |
|
|
|
|
|
|
1.� Basic Visualization Skills |
1.� Basic Visualization Skills |
1.� Basic Visualization Skills |
1. Purdue Visualization
Test (O) |
1.� Use pre & post test
results as measure of spatial visualization. (O) |
1. First & 10th Weeks of the first quarter of a course sequence. |
Review data on student performance; determine if results indicate a need
for course modification. |
|
|
2.� Computer Usage |
2.� Computer Usage |
2.� Computer Usage |
2. Standard Test Methods |
||||
|
�(a) Graphics (CADD) |
� (a) Excel |
� (a) Excel |
3. Lab Reports |
2.� Exams and lab reports graded
and results analyzed by staff and instructional team to measure competencies.
|
2. Per Syllabus |
||
|
�(b) Programming (Maple/������������ Excel/MATLAB/C++) |
� (b) CADKEY |
� (b) CADKEY |
4. Sorby Test (F) |
3. Timing dependent on measure |
|||
|
�(c) Electronic document
preparation |
�(c) Electronic document
preparation |
�(c) Electronic document
preparation |
5.� Fixed Concepts Inventory
(FCI); Mechanics Baseline Test (MBT) ; Problem Decomposition (PDD); |
|
|||
|
3.� Problem Solving |
� (d) MATLAB |
� (d) MATLAB |
3.� Compare FCI, MBT, & PDD
results with national norms (F) |
|
|||
|
�(a) Calculus |
3.� Data collection and analysis |
3.� Data collection and analysis |
|
||||
|
�(b) Physics (exp'mtl design) |
|
||||||
|
�(c) Engineering |
4. Problem Solving |
4. Problem Solving |
|
|
|||
|
4.� Design Process |
5. Design Process |
5. Design Process |
|
|
|
||
|
(D) |
|
|
|
|
|
|
|
|
Students� attitudes regarding the engineering discipline and their
first-year experience. |
Online survey developed at The University of Pittsburgh: The
Freshman Attitudes Survey. *�����������
Course Sorcerer version to be piloted SU02 and implemented AU02 (O) |
Students take pre and post versions of the survey. |
Beginning of first term of sequence, end of second term of
sequence.��������� |
1.� Results reviewed by
instructional team.�������������������������
�������������������������������������2.�
Present findings to Core Committee in College Services. (O) |
|||
|
(E) |
|
|
|
|
|
|
|
|
Students� attitudes regarding the instructional team in their first
year. |
1. SEI's (O) |
1.� Students complete
SEI (O) |
End of term. |
1. Faculty coordinator reviews results |
|||
|
2. Journal Entries * |
2.� Students complete journal
entries * |
Per Syllabus |
2. Administration compiles results |
||||
|
3. Course Evaluations* |
3.� Students complete course
evaluation* |
End of term. |
|
||||
|
(E) |
|
|
|
|
|
|
|
|
FEH |
IE |
WHHS |
|
|
|
|
|
|
Attitudes among faculty, GTAs, and UTA's regarding their experience
with the� program. |
Attitudes among instructors,�
GTAs, and peer mentors regarding their experience with the� program. |
Attitudes among instructors and administration regarding their experience
with the� program. |
1. Faculty and staff survey. |
1. Surveys conducted at end of program participation with a focus
on course content and student attitude. |
1.� End of term |
Attitudes among participating faculty, staff, and advisors to be a
major factor in any redesign of format, content, and scope of program; and in
recommending continuation or expansion of the program.� |
|
|
2. Selected interviews with participating instructional team
members |
2.� Ongoing |
||||||
|
3.� Frequent instructional team
meetings. |
2. Interview data shared at team meetings as needed. |
|
|||||
|
(F) |
|
|
|
|
|
|
|
|
OSU |
WHHS |
|
|
|
|
||
|
Selection of major by students. |
Selection of OSU as further education and selecting engineering as
their intended major. |
Journal entries by students * |
1. Data
entered into tracking system;��� |
Beginning of first quarter/semester of the program and end of the
program. |
Survey data will be used to evaluate potential impact of program on
student selection of major. |
||
|
|
2. Analyze data for reasons |
||||||
|
Use of MARX system (O) |
3. Data compiled, and shared with teams and College office. |
||||||
|
(G) |
|
|
|
|
|
|
|
|
OSU |
WHHS |
|
|
|
|
||
|
Retention of students in the program. |
Selection of OSU as further education and selecting engineering as
their intended major. |
1.� Enrollment numbers |
1. Students entered into longitudinal tracking database (O) |
Quarterly as needed; |
Target is "high retention" |
||
|
|
2. Data
compiled and shared with teams and College office. (O) |
|
(Note: Retention data for subsequent years to be tracked until
graduation.) |
||||
|
|
3. Report out of retention results. (O) |
COE's Annual Report |
|
||||
|
(H) |
|
|
|
|
|
|
|
|
OSU |
WHHS |
|
|
|
|
||
|
ABET Competencies - Core and Technical��������������������������������������������������������������������������������
(Criterion 3; a-k) |
|
1. Program Evaluation
|
1. Each course (or course component) has objectives in a
matrix to show linkage with ABET competencies. |
End of each quarter. |
Students' perceptions regarding opportunity to practice and their
level of proficiency will be reviewed in light of ABET competencies to
determine the need for course modification. |
||
|
|
|||||||
|
2. Evaluation data shared with teams and College Office. |
|||||||
|
(I) |
|
|
|
|
|
|
|
|
Technical writing skills for lab and project reports |
1.� Guidelines developed and
provided by instructor(s)���������������������
2.� Assistance available through
the College Technical Communications Resource Center. (O) |
GTA's and instructors collect, grade, and provide feedback to the
students. |
Per syllabus. |
Determine if technical writing component is satisfactory or needs to
be strengthened. |
|||
|
(J) |
|
|
|
|
|
|
|
|
Oral presentation skills |
1.� Skills checklist
used by faculty, TA, peer mentors (provided to students in advance) |
Instructor, TA, and peer mentor observe, analyze, and grade
presentations. |
1.� End of 181, 183, H193 |
Determine if opportunity for oral presentations is satisfactory or if
this component needs to be strengthened. |
|||
|
2.� Weekly progress meetings
with design/build teams (F) |
2.� Weekly during scheduled
class times (F) |
||||||
|
(K) |
|
|
|
|
|
|
|
|
OSU |
WHHS |
|
|
|
|
||
|
Co-op and Internship participation |
|
Selected interviews and surveys |
Compare participation levels with past participation levels |
As needed |
Periodic reports as needed |
||
|
(L) |
|
|
|
|
|
|
|
|
Teamwork skills. |
1. Peer and team evaluation using online �Team
Developer�. |
Faculty observes throughout the academic year.�� |
�Team Developer� used up to two times per quarter after students are
in designated teams |
After completing evaluation online, students view individual and team
profiles� to assist them in further
developing their teamwork skills. |
|||
|
2. Faculty observations, impressions. |
Analysis of data and debriefing at Instructional Team meetings to
further assist students in team development.�
|
||||||
|
(Students provided with team evaluation critieria at the beginning of
each term.) |
|||||||
|
(M) |
|
|
|
|
|
|
|
|
�Project Management skills |
1. Design / Build project reports. (183, H193) |
1.� Grading and review of reports
at Instructional Team meetings |
1.� Weekly/Periodically |
Review data on student performance; determine if results indicate a
need for course modification. |
|||
|
2.� Project Notebooks
(183, H193) |
2.� Weekly Review |
||||||
|
3.� Weekly review, progress
meetings |
3.� End of 183 & H193 |
Feedback provided on each stage of project development in weekly
design review meetings with instructor. |
|||||
|
4.� Final Course Evaluation |
|
||||||