Freshman Programs :    Assessment Plan

 Measurement Focus

 Measurement Tool  or Method

 Action

Timetable

 Evaluation Decision(s)

(A)

Student performance in program components, based on objectives developed by faculty:

FEH

IE

WHHS

 

 

Per Syllabus

1. Determine if any course component needs to be modified at the end of a given quarter;

1. H191, H192, H193

1.  Basic Skills (lectures)

1. Basic Skills (lectures)

1.  Course Evaluations *

1.  Students complete evaluations mid-quarter and/or end of quarter.  *

2. Physics 131, 132, 133

2.  Fundamental Concepts Labs (181)

2. Bicycle Labs

2. Standard Test Methods

2. Students are tested on content, per syllabus schedule.

2.  Frequent review meetings by Instructional Team (faculty, TAs, peer mentors, and staff);

3. Mechanical Eng. H210

3.  Camera Labs (181)

3. Camera Labs

3. Lab & Project Reports

3.  Instructors evaluate and grade oral presentations.

4. Math 161G, 162G & 263 G

4.  Ice Cream Labs (181)

4.  Design/Build Project

4. Oral Presentations

4.  Instructors evaluate and grade lab and project work.

3. At the end of academic year, determine if any course component needs to be modified, dropped, or replaced.

5. Math 151A, 152 A, 153A

5.  Design-Build Project (183)

 

 

5. Instructors and evaluator(s) review comments.

(B)

Quality of instructional materials and delivery methods:

1.  Lecture/Basics Presentations & Reference Materials

 

 

 

1.  Determine if any course component needs to be modified at the end of a given quarter

2.  Lab Presentations, Procedures, & Reference Materials

2.  Course Evaluations *

2. Students complete course evaluation*

End of term.

3.  Assignments

3.  Student Journals *

3. Staff members analyze and summarize journal entries and course evaluations.*   

Weekly(F)                                            Biweekly(I)                                         As Needed(W)

4.  Online Resources (FEH Webpage, WebCT) (O)

4.  Scheduled Observations

2.  At the end of the academic year, determine if any course component needs to be modified, dropped, or replaced.

5.  Course Packet

5.  Short lab evaluations; e.g. "one-minute feedback" (optional) (F)

4. Staff members present observations at team meetings.

Per lab schedule

 

6.  Sharing evaluation data with  Advisory Committee

 

Ongoing

(C)

Basic Engineering Skills

FEH

IE

WHHS

 

 

 

 

1.  Basic Visualization Skills

1.  Basic Visualization Skills

1.  Basic Visualization Skills

1. Purdue Visualization Test (O)

1.  Use pre & post test results as measure of spatial visualization. (O)

1. First & 10th Weeks of the first quarter of a course sequence.

Review data on student performance; determine if results indicate a need for course modification.

2.  Computer Usage

2.  Computer Usage

2.  Computer Usage

2. Standard Test Methods

 (a) Graphics (CADD)

  (a) Excel

  (a) Excel

3. Lab Reports

2.  Exams and lab reports graded and results analyzed by staff and instructional team to measure competencies.

2. Per Syllabus

 (b) Programming (Maple/             Excel/MATLAB/C++)

  (b) CADKEY

  (b) CADKEY

4. Sorby Test (F)

3. Timing dependent on measure

 (c) Electronic document preparation

 (c) Electronic document preparation

 (c) Electronic document preparation

5.  Fixed Concepts Inventory (FCI); Mechanics Baseline Test (MBT) ; Problem Decomposition (PDD); Maryland Physics Expectation Survey (MPEX); Conceptual Survey of Electricity and Magnetism (SEM) (F)

 

3.  Problem Solving

  (d) MATLAB

  (d) MATLAB

3.  Compare FCI, MBT, & PDD results with national norms (F)

 

 (a) Calculus

3.  Data collection and analysis

3.  Data collection and analysis

 

 (b) Physics (exp'mtl design)

 

 (c) Engineering

4. Problem Solving

4. Problem Solving

 

 

4.  Design Process

5. Design Process

5. Design Process

 

 

 

(D)

 

 

 

 

 

 

Students’ attitudes regarding the engineering discipline and their first-year experience.

Online survey developed at The University of Pittsburgh: The Freshman Attitudes Survey. *            Course Sorcerer version to be piloted SU02 and implemented AU02 (O)

Students take pre and post versions of the survey.

Beginning of first term of sequence, end of second term of sequence.         

1.  Results reviewed by instructional team.                                                               2.  Present findings to Core Committee in College Services. (O)

(E)

 

 

 

 

 

 

Students’ attitudes regarding the instructional team in their first year.

1. SEI's (O)

1.  Students complete SEI (O)

End of term.

1. Faculty coordinator reviews results

2. Journal Entries *

2.  Students complete journal entries *

Per Syllabus

2. Administration compiles results

3. Course Evaluations*

3.  Students complete course evaluation*

End of term.

 

(E)

 

 

 

 

 

 

FEH

IE

WHHS

 

 

 

 

Attitudes among faculty, GTAs, and UTA's regarding their experience with the  program.

Attitudes among instructors,  GTAs, and peer mentors regarding their experience with the  program.

Attitudes among instructors and administration regarding their experience with the  program.

1.  Faculty and staff survey.

1. Surveys conducted at end of program participation with a focus on course content and student attitude.

1.  End of term

Attitudes among participating faculty, staff, and advisors to be a major factor in any redesign of format, content, and scope of program; and in recommending continuation or expansion of the program. 

2. Selected interviews with participating instructional team members

2.  Ongoing

3.  Frequent instructional team meetings.

2. Interview data shared at team meetings as needed.

 

(F)

 

 

 

 

 

 

OSU

WHHS

 

 

 

 

Selection of major by students.

Selection of OSU as further education and selecting engineering as their intended major.

Journal entries by students *

1. Data entered into tracking system;   

Beginning of first quarter/semester of the program and end of the program.

Survey data will be used to evaluate potential impact of program on student selection of major.

 

2. Analyze data for reasons

Use of MARX system (O)

3.  Data compiled, and shared with teams and College office.

(G)

 

 

 

 

 

 

OSU

WHHS

 

 

 

 

Retention of students in the program.

Selection of OSU as further education and selecting engineering as their intended major.

1.  Enrollment numbers

1.  Students entered into longitudinal tracking database (O)

Quarterly as needed;

Target is "high retention"

 

2.  Data compiled and shared with teams and College office. (O)

 

(Note: Retention data for subsequent years to be tracked until graduation.)

 

3.  Report out of retention results. (O)

COE's Annual Report

 

(H)

 

 

 

 

 

 

OSU

WHHS

 

 

 

 

ABET Competencies - Core and Technical                                                                                 (Criterion 3; a-k)

 

1. Program Evaluation

1. Each course (or course component) has objectives in a matrix to show linkage with ABET competencies.

End of each quarter.

Students' perceptions regarding opportunity to practice and their level of proficiency will be reviewed in light of ABET competencies to determine the need for course modification.

 

2. Evaluation data shared with teams and College Office.

(I)

 

 

 

 

 

 

Technical writing skills for lab and project reports

1.  Guidelines developed and provided by instructor(s)                      2.  Assistance available through the College Technical Communications Resource Center. (O)

GTA's and instructors collect, grade, and provide feedback to the students.

Per syllabus.

Determine if technical writing component is satisfactory or needs to be strengthened.

(J)

 

 

 

 

 

 

Oral presentation skills

1.  Skills checklist used by faculty, TA, peer mentors (provided to students in advance)

Instructor, TA, and peer mentor observe, analyze, and grade presentations.

1.  End of 181, 183, H193

Determine if opportunity for oral presentations is satisfactory or if this component needs to be strengthened.

2.  Weekly progress meetings with design/build teams (F)

2.  Weekly during scheduled class times (F)

(K)

 

 

 

 

 

 

OSU

WHHS

 

 

 

 

Co-op and Internship participation

 

Selected interviews and surveys

Compare participation levels with past participation levels

As needed

Periodic reports as needed

(L)

 

 

 

 

 

 

Teamwork skills.

1. Peer and team evaluation using online “Team Developer”.

Faculty observes throughout the academic year.  

“Team Developer” used up to two times per quarter after students are in designated teams

After completing evaluation online, students view individual and team profiles  to assist them in further developing their teamwork skills.

2. Faculty observations, impressions.

Analysis of data and debriefing at Instructional Team meetings to further assist students in team development. 

(Students provided with team evaluation critieria at the beginning of each term.)

(M)

 

 

 

 

 

 

 Project Management skills

1.  Design / Build project reports. (183, H193)

1.  Grading and review of reports at Instructional Team meetings

1.  Weekly/Periodically

Review data on student performance; determine if results indicate a need for course modification.

2.  Project Notebooks (183, H193)

2.  Weekly Review

3.  Weekly review, progress meetings

3.  End of 183 & H193

Feedback provided on each stage of project development in weekly design review meetings with instructor.

4.  Final Course Evaluation