Telecommunications Engineering The University of Texas at Dallas The Erik Jonsson School of...

25
Telecommunications Engineering The University of Texas at Dallas The Erik Jonsson School of Engineering and Computer Science Fall 2006 Industrial Advisory Board Meeting for Accreditation Board for Engineering and Technology (ABET) S. Venkatesan Pete Bernardin UTD Telecommunications Program October 28, 2006

Transcript of Telecommunications Engineering The University of Texas at Dallas The Erik Jonsson School of...

Telecommunications EngineeringThe University of Texas at Dallas

The Erik Jonsson School of Engineering and Computer Science

Fall 2006 Industrial Advisory Board Meeting for Accreditation Board for Engineering and

Technology(ABET)

S. Venkatesan

Pete Bernardin

UTD Telecommunications Program

October 28, 2006

The Erik Jonsson School of Engineering and Computer Science

Goal of Today’s Meeting: Report on the ABET Progress

Proposed 2006 TE Program Educational Objectives Some Examples where TE Program has formally measured

program assessment Provide documentation and some evidence that TE Program is

“Closing the Loop” on the assessment processes Show that the TE program has had regular program evaluations

and demonstrate that appropriate corrections have been made to improve the program

Demonstrate that TE program has published its objectives and Mission Statement http://www.ecs.utdallas.edu/welcome/eemission.html

Present the proposed Non-Tenure Track Faculty Development Plan and your plan to addresses “level of scholarship” and “participation in professional societies” issues

TE’s plan for Program’s Senior Design Course that will provide the culminating design experience that ABET requires

The Erik Jonsson School of Engineering and Computer Science

TE Mission and Program Educational Objectives

2005 Mission and PEOs

Goals (Program Educational Objectives)– Build a foundation for successful, long lived, engineering careers– Perform, review and assess sophisticated engineering design– Further the necessities of innovation, functionality, safety, and economy in

engineering– Critical thinking, decision making and communicating effectively– Ability to contribute to engineering teams – Place engineering design and decision making in a market and societal context

The focus of the Telecommunications Engineering degrees is to provide excellent education in modern communications networks and systems. Our graduates are uniquely qualified to apply traditional engineering design and problem solving skills in modern telecommunications.

Additional Aims of the Telecommunications Engineering program are to grow and maintain an outstanding faculty that remains motivated and empowered and to maintain excellent facilities, including teaching laboratories, computing facilities and classrooms.

The Erik Jonsson School of Engineering and Computer Science

TE Mission and Program Educational Objectives

Proposed 2006 Mission an PEOs

Goals (Program Educational Objectives) More Measurable than 2005– Graduates will be able to apply knowledge of mathematics and engineering to solve

a variety of telecommunications problems ( =Criterion a)– Graduates will be able to design and conduct experiments as well as to analyze

and interpret data (=Criterion b)– Graduates will be able to design a system, component, or process to meet desired

needs (=Criterion c)– Graduates will be able to identify, formulate, and solve engineering problems

(=Criterion e)

The mission of the Telecommunications Engineering BS degree program is to provide education in modern communications networks and systems. The TE BS program provides graduates that have achieved a senior level command of a variety of subfields of telecommunication engineering at the systems level. These graduates are key contributors to a variety of telecommunications fields such as data communications, network architecture, wireless, optical networking, and next generation networks.

The Erik Jonsson School of Engineering and Computer Science

UTD’s Student Satisfaction Survey Data

http://uot.windowssharepointservices.com/TeacherEvaluations.aspx

The Erik Jonsson School of Engineering and Computer Science

In-Class Assessments By Faculty

Assessment of TE3307 (DISCRETE MATHEMATICS)Instructor: C.P.Bernardin Section: 001 Semester: Fall 2005

Use this form to assess the student's performance in the course, based on all or selectedsets of examinations, homework, or projects assigned for this course.

On a scale of 1 to 5, with 5 being exceptional and 1 being poor, rate the student's:ABET Material Criteria

Class learning objectives Rating objective Used Used

1 Understand and use logic, sets, functions 3.67 a,b,k HW1&2, Exam1 5=A, [3,4=B], 2=C, 1=D2 Know basic algorithmic techniques and recurrences & Numerical Methods 3.75 a,b,e,k HW3, Exam1 5=A, [3,4=B], 2=C, 1=D3 Understand and use Random numbers 3.94 a,e,k HW4, Exam1, Project 5=A, [3,4=B], 2=C, 1=D4 Understand and use concept of Central Limit Theorem 3.94 a,e,k HW4,Exam1, Project 5=A, [3,4=B], 2=C, 1=D

5 Ability to design Linear Congruential Uniform Random Number Generators 4.27 a,b,e,k HW5, Exam1 5=A, [3,4=B], 2=C, 1=D6 Understand Euclid's GCD/LCM algorithm 4.09 a,b,c,k HW5, Final 5=A, [3,4=B], 2=C, 1=D7 Understand and use basic probability and statistical functions in MS Excel 4.42 a,b,e,k Project 5=A, [3,4=B], 2=C, 1=D

8 Know basic sorting algorithms: selection, insertion, shell, heapsort, 3.66 a,b,e,k HW3 5=A, [3,4=B], 2=C, 1=Dmergesort, quicksort, indirect sorting

9 Know and be able to apply solutions of linear systems of equations, 3.54 a,b,e,k HW6, Final 5=A, [3,4=B], 2=C, 1=D and the related concepts of determinant, rank, row echelon form, etc.

10 Ability to apply basic number theory and understand Sieve of Eratosthenes 4.78 a,b,e,k HW5, In-Class Lab 5=A, [3,4=B], 2=C, 1=D

Mean ABET Score 4.00

a. An ability to apply knowledge of mathematics, science and engineering

b. An ability to design and construct experiments, as well as to analyze and interpret data

e. An ability to identify, formulate and solve engineering problems

k. An abilitiy to use the techniques, skills,and modern engineering tools necessary for engineering practice

http://assess.utdallas.edu/ee_abet_forms/index.html

The Erik Jonsson School of Engineering and Computer Science

First Senior Design Presentation to IAB

Senior Design Presentation Day, Monday, May 1 , 2006in

TI Conference Room

Projects Supervisor Project Title Group No. PresentationTime

1 Marco Tacca VoIP management and operation and TCP/IP analysis

I 9:00 AM

2 Marco Tacca VoIP management and operation and TCP/IP analysis

II 9:20 AM

3 Andy Blanchard Antenna measurement and Design I 9:40 AM

4 Farokh Bastani Context-Aware Tele-Presence Anywhere Conferencing (CATPAC) System

I 10:00 AM

5 Farokh Bastani Context-Aware Tele-Presence Anywhere Conferencing (CATPAC) System

II 10:20 AM

6 Andrew Cilia Autonomous Robotic Cat I 10:40 AM

7 Andrew Cilia Wireless keyless entry system I 11:00 AM

8 Andrew Cilia Autonomous Underwater robot I 11:20 AM

9 Andrew Cilia Autonomous Underwater robot II 11:40 AM

10 Andrew Cilia Autonomous Underwater robot III 12:00 PM

11 Muhammad Kalam Design and Configuration of a SONET ring from a linear setup

I 12:20 PM

12 Muhammad Kalam Design and Configuration of a 3-node Optical Network with Gigabit Switch Router

I 12:40 PM

The Erik Jonsson School of Engineering and Computer Science

TE Senior Design Course Improvement Plan

Senior Design Proposals for Fall 2006 – A list of all proposals have been collected and evaluated

Senior Design Presentation Day – A suitable day during the second half of November will be chosen and announced.

Industrial Advisory Board Meetings held in October Posting of Senior Design Activities on the Web page

– Department heads would initiate this process. Please read your handouts on Senior Design

Courses (note: last 2 pages which are for IAB Course Evaluation)

The Erik Jonsson School of Engineering and Computer Science

Non-Tenure Track Faculty Development Plan

Non Tenure TrackDevelopment Process

Performance evaluation for past year (n-1) plusdevelopment plan for next year

Implement Plan

Performance evaluation for year (n) plusdevelopment plan for next year (n+1)

Includeevaluation of

development forpast year

GoalsThe goal of this policy is to further the Erik JonssonSchool of Engineering and Computer Science’s goals in education and dissemination of knowledge through the following: • Fostering the development and continuance of excellence among the faculty. • Aiding the administration of the Jonsson School

and University in understanding the motivations, strengths, accomplishments, goals, and plans of individual faculty members.

• Furtherance of communication and understanding between the faculty and the Jonsson School and University administrations.

• See Handout

The Erik Jonsson School of Engineering and Computer Science

Closing the Quality Loopwith ABET

ProgramOutcomes:Short-Term

Goals

Develop Educational

Program, including Curriculum

Develop and Document Processes to

Produce Outcomes

Determine Outcomes

Needed to Achieve Objectives

Deliver educational program, including

curriculum

Establish Goals for Outcomes

that will lead to Achievement of

Objectives

Determine How Outcomes will be Assessed

EvaluateAchievement of

Objectives

Determine,Update, Publish

Objectives

PEO’s:Long-Term

Goals

Provide students, faculty, facilities, andresources that are consistent with Objectives

DevelopProgram

Assess Outcomes

DemonstrateAchievement of

Outcomes

Graduation

The Erik Jonsson School of Engineering and Computer Science

Mapping Mission Statement and IAB Input

to PEOs and Assessing Performance

UTD MISSION& GOALS

PEOs:Program Educational Objectives

Constituents assess if objectives met & Documents

Constituents take corrective action & Documents

Input from Industrial

Constituents(IAB)

If no

if yes

PEO’s:Long-Term

Goals

Telecommunications EngineeringThe University of Texas at Dallas

The Erik Jonsson School of Engineering and Computer Science

APPENDIXIntroduction to the Accreditation Board for

Engineering and Technology(ABET)

Pete Bernardin

UTD Telecommunications Program

The Erik Jonsson School of Engineering and Computer Science

Accreditation: raison d'être

In the United States, accreditation is used to ensure quality in educational institutions and programs. Accreditation is a voluntary, non-governmental process of peer review. It requires an educational institution or program to meet certain, defined standards or criteria. Accreditation is sometimes confused with certification. In general, institutions and programs are accredited, and individuals are certified.

The Accreditation Board for Engineering and Technology (ABET) is a professional accrediting organization that accredits engineering programs, not institutions

Accreditation serves to notify: Parents and prospective students that a program has met minimum standards Faculty, deans and administrators of a program’s strengths and weaknesses and

of ways to improve the program Employers that graduates are prepared to begin professional practice Taxpayers that their funds are spent well The public that graduates are aware of public health and safety considerations

A general requirement of most Professional Engineering (PE) licenses is graduation from an ABET accredited school

ABET website - http://www.abet.org

The Erik Jonsson School of Engineering and Computer Science

Definition of Key ABET Terms

Program Educational Objectives -- statements that describe the expected accomplishments of graduates during the first few years after graduation

Program Outcomes – statements that describe what students are expected to know and are able to do by the time of graduation

Assessment – one or more processes that identify, collect, use and prepare data that can be used to evaluate achievement of program outcomes, educational objectives or for program improvement

Evaluation – one or more processes for interpretation of the data and evidence accumulated through assessment practices that a) determine the extent to which program outcomes or educational objectives are being achieved; or b) result in decisions and actions taken to improve the program (e.g. curriculum or methodology)

The Erik Jonsson School of Engineering and Computer Science

Accreditation Criteria: Evaluator’s Check List

1. Students -Documented Process for Advising, Monitoring, Evaluation?-Policies for accepting and transferring students equitably?

2. Program Educational Objectives- Are they published and consistent with UTD’s Mission Statement? - Is there a process to determine and update PEO’s? - Are they based on the needs of (Industrial) Constituencies?- Are the results used to Improve the effectiveness of the Program?

3. Program Outcomes - Is there an assessment process with documented measurements? - Are the results used to improve the Program? - Does the Process demonstrate that graduates have “Criteria a-k”?

4. Professional Component- Major Design Experience- One Year of Math and Basic Science- One and one-half years of Engineering Topics- General Education Component that complements technical curricular content

The Erik Jonsson School of Engineering and Computer Science

Accreditation Criteria: Evaluator’s Check List (continued)

5. Faculty-Sufficient Number and Competencies to Cover All Curricular Areas -Levels of Student-Faculty Interaction -Student Advising and Counseling -University Service Activities -Professional Development -Interaction with Practitioners and Employers

6. Facilities-Classrooms -Laboratories -Equipment and Tools -Computing and Information Infrastructure

7. Institutional Support and Financial Resources-Sufficient to Assure Quality and Continuity of the Program -Sufficient to Attract and Retain a Well-Qualified Faculty -Sufficient to Acquire, Maintain, and Operate Facilities and Equipment

The Erik Jonsson School of Engineering and Computer Science

Closing the Quality Loopwith ABET

ProgramOutcomes:Short-Term

Goals

Develop Educational

Program, including Curriculum

Develop and Document Processes to

Produce Outcomes

Determine Outcomes

Needed to Achieve Objectives

Deliver educational program, including

curriculum

Establish Goals for Outcomes

that will lead to Achievement of

Objectives

Determine How Outcomes will be Assessed

EvaluateAchievement of

Objectives

Determine,Update, Publish

Objectives

PEO’s:Long-Term

Goals

Provide students, faculty, facilities, andresources that are consistent with Objectives

DevelopProgram

Assess Outcomes

DemonstrateAchievement of

Outcomes

Graduation

The Erik Jonsson School of Engineering and Computer Science

Program Educational Objectives (PEO’s)

The PEOs are statements that describe the expected accomplishments of graduates during the first few years after graduation

Two types of PEO’s:1) those for all graduates 2) those for top graduates

The audiences for PEO statements are external constituents: – Industrial Advisory Board (IAB)– prospective students, employers– transfer institutions– student sponsors

Programs may choose to have objective statements that would be much broader or longer-term indicators of program success than the definition used here would imply

PEOs are long-term post graduation goals.

The Erik Jonsson School of Engineering and Computer Science

Mapping Mission Statement and IAB Input

to PEOs and Assessing Performance

UTD MISSION& GOALS

PEOs:Program Educational Objectives

Constituents assess if objectives met & Documents

Constituents take corrective action & Documents

Input from Industrial

Constituents(IAB)

If no

if yes

The Erik Jonsson School of Engineering and Computer Science

Provide Proof PEO’s are Created and Updated

Describe the processes used to establish and review the PEOs and the extent to which the program’s various constituencies are involved in these processes. Provide documentation that demonstrates that the processes are working.

Describe how the program curriculum and your processes ensure achievement of the PEOs.

Provide documentation that describes the ongoing evaluation of the level of achievement of these objectives, the results obtained by this periodic evaluation and evidence that the results are being used to improve the effectiveness of the program.

The Erik Jonsson School of Engineering and Computer Science

Program Outcomes

Program Outcomes are statements that describe what students are expected to know and are able to do by the time of graduation

Program Outcomes relate to the skills, knowledge and behaviors that students acquire in their matriculation through the program

Achievement of all of the program outcomes should indicate that the graduate is equipped to achieve the program educational objectives

Achievement of program outcomes by each student should be verified before certification for graduation

The program outcomes of ABET accredited programs must embrace the eleven (a) through (k) requirements

Program Outcomes are Short-Term Pre-Graduation Goals, potentially measured annually

The Erik Jonsson School of Engineering and Computer Science

ABET 11-Key Quality Criteria a-k

a) An ability to apply knowledge of mathematics, science and engineering

b) An ability to design and construct experiments, as well as to analyze and interpret data

c) An ability to design a system, component or process to meet desired needs

d) An ability to function on interdisciplinary teamse) An ability to identify, formulate and solve engineering problemsf) An understanding of professional and ethical responsibilityg) An ability to communicate effectivelyh) The broad education necessary to understand the impact of

engineering in a global and societal contexti) A recognition of the need for, and an ability to engage in life-

long learningj) A knowledge of contemporary issuesk) An ability to use the techniques, skills and modern engineering

tools necessary for engineering practice

The Erik Jonsson School of Engineering and Computer Science

Mapping ABET Quality Criteria to Program Outcomes and Assessing

Performance

11 ABET Engineering Quality Criteria

(a-k)

Curricular Constituents:TE Governing

Committee

Program Outcomes

Constituents assess if objectives met & Documents

Constituents take corrective action & Documents

if yes

If no

The Erik Jonsson School of Engineering and Computer Science

Provide Proof Outcomes Assessment is working

Describe the assessment process, documented assessment results, evidence that results are applied to further development and improvement, and a demonstration of the achievement of each program outcome important to the mission of the institution and the objectives of the program, as required by Criterion 3 (= Program Outcomes)

List the Program Outcomes that have been established based on the Program Educational Objectives and describe how these Program Outcomes relate to the Program Educational Objectives.

Describe how the Program Outcomes chosen by the program encompass and relate to the outcome requirements of Criterion 3.

Describe the processes used to produce and assess each of the program outcomes.

Provide metric goals for each outcome that illustrate the level of quality of outcomes achievement felt necessary to produce graduates that will ultimately achieve the Educational Objectives following their graduation

The Erik Jonsson School of Engineering and Computer Science

Provide Proof Outcomes Assessment is working(continued)

Provide qualitative and quantitative data gathered on a regular basis that are used to assess the quality of achievement of the outcomes and your analysis of those assessment results.

Describe the process by which the assessment results are applied to further develop and improve the program.

Document changes that have been implemented to further develop and improve the program. Provide qualitative and quantitative data used to support these changes.

Describe the materials, including student work and other tangible materials, that will be available for review during the visit to demonstrate achievement of the Program Outcomes and Assessment.

The programs are encouraged to organize these materials on the basis of outcomes, rather than on a course-by-course basis.