SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

37
1 SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW – ENGINEERING & TECHNOLOGY & COMMERCIALIZATION ILLUSTRATION – IEEE SOCIETY FREDERICK BETZ PORTLAND STATE UNIVERSITY

description

SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW – ENGINEERING & TECHNOLOGY & COMMERCIALIZATION ILLUSTRATION – IEEE SOCIETY FREDERICK BETZ PORTLAND STATE UNIVERSITY. ENGINEERING SCIENCE Academic Engineering is organized into disciplinary professions, such as: - PowerPoint PPT Presentation

Transcript of SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

Page 1: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

1

SCIENCE ADMINISTRATION

LECTURE 27

MULTI-DISCIPLINARY PEER REVIEW –

ENGINEERING & TECHNOLOGY & COMMERCIALIZATION

ILLUSTRATION – IEEE SOCIETY

FREDERICK BETZPORTLAND STATE UNIVERSITY

Page 2: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

2

ENGINEERING SCIENCE

Academic Engineering is organized into disciplinary professions, such as: electrical, mechanical, industrial, chemical, civil engineering, etc. Within each are disciplinary specialty areas. For example, within electrical engineering is electrical power, electronics, and computer engineering.

The disciplinary professional organization is principally based upon the science area underlying the technologies of the engineering profession.

Each of these specialty areas in the discipline or inter-disciplines have well-organized research communities, with their own scholarly journals.

Accordingly, peer review of either research proposals or publishable articles in engineering science draw upon published scholars within each specialty for review of quality.

Research performed in each specialty area that is focused on the underlying science can be called ‘engineering science’.

Disciplinary engineering science research proposals can be properly peer reviewed by engineering science specialists.

Page 3: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

3

RESEARCH AREAS

EDUCATIONCURRICULUM

ENGINEERING SCIENCEPEER-REVIEWER

ENGINEERING SCIENCE PEER REVIEWER

UNIVERSITY

SOCIETY

Page 4: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

4

SCIENCE TECHNOLOGY Discovery Bottleneck Theory Invention

ENGINEERING COMMERCIALIZATION Systems Application Design Processes

TYPES OF RESEARCH INQUIRIES

PROFESSION INNOVATION

NATURE

MARKET

EngineeringScience

MULTI-DISCIPLINARY: ENGINEERING & TECHNOLOGY & COMMERCIALIZATION

Page 5: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

5

ILLUSTRATION: U. S. ENGINEERING SOCIETIES

American Institute of Aeronautics and Astronautics American Institute of Chemical EngineersAmerican Society for Engineering Education American Society of Agricultural and Biological EngineersAmerican Society of Civil Engineers American Society of Heating, Refrigerating and Air-Conditioning Engineers American Society of Mechanical EngineersAmerican Society of Plumbing EngineersASM InternationalAssociation for Computing MachineryInstitute of Biological Engineering Institute of Electrical and Electronics Engineers Institute of Industrial Engineers Institute of Transportation Engineers National Academy of Forensic Engineers National Society of Black Engineers National Society of Professional Engineers Order of the EngineerSociety of American Military Engineers Society of Automotive Engineers Society of Fire Protection Engineers Society of Hispanic Professional Engineers Society of Marine Port Engineers Society of Naval Architects and Marine EngineersSociety of Petroleum EngineersSociety of Women EngineersTau Beta Pi Engineering Honor Society The Tire Society

Engineering Science

Engineering & Technology

Engineering & Commercialization

Page 6: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

6

IEEE's Constitution defines the purposes of the organization as "scientific and educational, directed toward the advancement of the theory and practice of electrical, electronics, communications and computer engineering, as well as computer science …"

In pursuing these goals, the IEEE serves as a major publisher of scientific journals and a conference organizer.

It is also a leading developer of industrial standards in a broad range of disciplines, including electric power and energy, biomedical technology and healthcare, information technology, information assurance, telecommunications, consumer electronics, transportation, aerospace, and nanotechnology.

IEEE develops and participates in educational activities such as accreditation of electrical engineering programs in institutes of higher learning.

ILLUSTRATION: Institute of Electrical and Electronics Engineers

Page 7: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

7

IEEE produces 30 percent of the world's literature in the electrical and electronics engineering and computer science fields.

IEEE has developed more than 900 active industry standards.

IEEE sponsors or cosponsors more than 300 international technical conferences each year.

The IEEE consists of 39 societies, organized around specialized technical fields, with more than 300 local organizations that hold regular meetings.

The IEEE publishes an extensive range of peer-reviewed journals, and is a major international standards body (nearly 900 active standards with 700 under development).

Page 8: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

8

The IEEE is incorporated in the State of New York, United States.

It was formed in 1963 by the merger of the Institute of Radio Engineers (IRE, founded 1912) and the American Institute of Electrical Engineers (AIEE, founded 1884).

It has a dual complementary regional and technical structure - with organizational units based on geography (e.g., the IEEE Philadelphia Section) and technical focus (e.g., the IEEE Computer Society).

It manages a separate organizational unit (IEEE-USA) which recommends policies and implements programs specifically intended to benefit the members, the profession and the public in the United States.

The IEEE Standards Association is in charge of the standardization activities of the IEEE.

There are seven steps to its standard setting process, which typically takes 18 months to complete: 1. Securing Sponsorship, 2. Requesting Project Authorization, 3. Assembling a Working Group, 4. Drafting the Standard, 5. Balloting (75% approval required), 6. Review Committee, and 7. Final Vote.

Page 9: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

9

Notable Presidents of IEEE and its founding organizations include:

Elihu Thomson (AIEE, 1889-1890), Alexander Graham Bell (AIEE, 1891-1892), Charles Proteus Steinmetz (AIEE, 1901-1902), Lee De Forest (IRE, 1930), Frederick E. Terman (IRE, 1941), William R. Hewlett (IRE, 1954), Ernst Weber (IRE, 1959; IEEE, 1963),Ivan Getting (IEEE, 1978).

Page 10: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

10

Elihu Thomson (1853 – 1937) was an engineer and inventor who was instrumental in the founding of major electrical companies in the United States, United Kingdom and France.

He was born in England in 1853, but his family moved to Philadelphia in 1858.

By 1880, he established, with Edwin J. Houston, the Thomson-Houston Electric Company. In 1892 this merged with the Edison General Electric Company to become the General Electric Company.

Thomson's name is further commemorated by the British Thomson-Houston Company (BTH), and the French companies Thomson and Alstom. His early companies are also involved in the history of The General Electric Company Limited (GEC) in Britain and the Compagnie Générale d'Electricité in France.

Thomson was a prolific inventor, being awarded over 700 patents.

Page 11: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

11

Alexander Graham Bell (1847 – 1922) was a scientist, inventor, and innovator.

Born and raised in Scotland, he emigrated to Canada in 1870, and then to the United States in 1871, becoming a U.S. citizen in 1882.

Bell was awarded the U.S. patent for the invention of the telephone in 1876. Other inventors including Antonio Meucci claimed the honor, but the Bell patent remained in effect.

Page 12: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

12

Charles Proteus Steinmetz (1865–1923) was an American Mathematician and Electrical Engineer. He fostered the development of alternating current that made possible the expansion of the electric power industry in the United States, formulating mathematical theories for engineers. He made ground-breaking discoveries in the understanding of hysteresis that enabled engineers to better design electric motors for use in industry.

He was born in Prussia in 1865. Steinmetz attended Johannes Gymanasium and astonished his teachers with his proficiency in mathematics and physics. He went on to Wrocław University to begin work on his undergraduate degree in 1883.

He was on the verge of finishing his Doctorate in 1888 when he came under investigation by the German police. He drew attention from the authorities due to his activity in a Socialist University group and articles he had written for a local socialist newspaper (socialist meetings and press were outlawed by Bismarck).

He fled to Zürich in 1888 to escape possible arrest and when the time remaining on his permit dwindled, emigrated to the United States

Page 13: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

13

Lee De Forest, (1873 – 1961) was an American inventor with over 300 patents to his credit.

De Forest invented the Audion, the first electronic vacuum tube with a control grid between cathode and anode. It could applify electrical signal. De Forest is one of the fathers of the "electronic age", as the Audion helped to usher in the widespread use of electronics.

He was involved in several patent lawsuits and he spent a fortune from his inventions on the legal bills.

He had four marriages and several failed companies, he was defrauded by business partners, and he was once indicted for mail fraud, but was later acquitted.

He was a charter member of the Institute of Radio Engineers, one of the two predecessors of the IEEE (the other was the American Institute of Electrical Engineers).

Page 14: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

14

Frederick Emmons Terman (1900-1982) was born in the United States. Terman is widely credited (together with William Shockley) with being the father of Silicon Valley (the growth area of transisterized electronics in California, USA).

Terman was professor and provost at Stanford University. During his tenure as provost of the school, Terman greatly expanded the science, statistics and engineering departments in order to win more research grants from the U.S. Department of Defense.

These grants, in addition to the funds that the patented research generated, helped to catapult Stanford into the ranks of the world's first class educational institutions, as well as spurring the growth of Silicon Valley.

Stanford's Frederick Emmons Terman Engineering Center is named in his honor.

Dr. Terman was also a founding member of the National Academy of Engineering.

Page 15: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

15

William Redington Hewlett (1913 – 2001) was the co-founder, with David Packard, of the Hewlett-Packard Company (HP).

He was born in Ann Arbor, Michigan but moved to San Francisco at the age of 3 years. Hewlett received his Bachelor's degree from Stanford University in 1934, an MS degree from MIT in 1936, and the degree of Electrical Engineer from Stanford in 1939.

Hewlett attended classes taught by Fred Terman at Stanford and became acquainted with David Packard during his undergraduate work at Stanford.

He and Packard began discussing forming a company in August of 1937, and formally incorporated Hewlett-Packard Company on January 1, 1939. In 1939, he also married Flora Lamson, and the couple eventually had five children: Eleanor, Walter, James, William and Mary.

He was President of HP from 1964 to 1977, and served as CEO from 1968 to 1978. He remained chairman of the executive committee until 1983, and then served as vice chairman of the board until 1987.

Page 16: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

16

Technical Societies of the IEEE

Aerospace and Electronic Systems • Antennas and Propagation • Broadcast Technology • Circuits and Systems • Communications •

Components Packaging and Manufacturing and Technology • Computational Intelligence • Computer • Consumer Electronics • Control Systems • Dielectrics and Electrical Insulation • Education • Electromagnetic Compatibility

• Electron Devices • Engineering Management • Engineering in Medicine and Biology • Geoscience and Remote Sensing •

Industrial Electronics • Industry Applications • Information Theory • Intelligent Transportation Systems • Instrumentation and Measurement •

Lasers and Electro-Optics • Magnetics • Microwave Theory and Techniques • Nuclear and Plasma Sciences • Oceanic Engineering • Power Electronics •

Power Engineering • Product Safety Engineering • Professional Communication • Reliability • Robotics and Automation • Signal Processing • Social Implications of Technology • Systems, Man and Cybernetics • Ulrasonics, Ferroelectronics and

Frequency Control • Vehicular Technology

Page 17: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

17

UNIVERSITYENGINEERING DISCIPLINE

ENGINEERINGPROFESSION

ENGINEERINGSOCIETY

SOCIETY

JOURNAL

DEGREES

COURSES

FIE

LD

SP

EC

IAL

TY

REVIEWER

ACCREDITATION

Page 18: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

18

ILLUSTRATION: NSF ENGINEERING DIRECTORATE

DIVISIONS

Chemical, Bioengineering, Environmental, and Transport Systems (CBET) Civil, Mechanical and Manufacturing Innovation (CMMI) Electrical, Communications and Cyber Systems (ECCS) Engineering Education and Centers (EEC) Emerging Frontiers in Research and Innovation (EFRI) Industrial Innovation and Partnerships (IIP)

Page 19: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

19

Biomedical Engineering and Engineering Healthcare Biomedical Engineering Biophotonics Research to Aid Persons with Disabilities Chemical, Biochemical, and Biotechnology Systems Chemical and Biological Separations Biochemical Engineering Biotechnology Catalysis and Biocatalysis Process and Reaction Engineering Environmental Engineering and Sustainability Energy for Sustainability Environmental Engineering Environmental Sustainability Environmental Technology Transport and Thermal Fluids Phenomena Interfacial Processes and Thermodynamics Thermal Transport Processes Combustion, Fire and Plasma Systems Fluid Dynamics Particulate and Multiphase Processes

Division of Chemical, Bioengineering, Environmental, and Transport Systems

Page 20: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

20

Engineering Infrastructure Systems GeoEnvironmental Engineering and GeoHazards Mitigation George E. Brown, Jr. Network for Earthquake Engineering Simulation Research Information Technology and Infrastructure Systems Infrastructure Management and Hazard Response Manufacturing Machines and Equipment Structural Systems and Hazards Mitigation of Structures Innovation Sciences and Decision Engineering Control Systems Program Dynamical Systems Engineering Design Manufacturing Enterprise Systems Operations Research Sensor Innovation and Systems Service Enterprise Engineering Materials Transformation and Mechanics GeoMechanics and GeoTechnical Systems Infrastructure Materials Applications and Structural Mechanics Material Design and Surface Engineering Materials Processing and Manufacturing Mechanics and Structures of Materials Nano and Bio Mechanics NanoManufacturing

Division of Civil, Mechanical and Manufacturing Innovation

Page 21: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

21

Electronics, Photonics & Device Technologies Integrative, Hybrid & Complex Systems Power, Controls and Adaptive Networks

Division of Electrical, Communications and Cyber Systems

Page 22: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

22

Centers Programs Cluster - Engineering Research Centers Engineering Education Programs Cluster - Engineering Education Programs - Faculty Early Career Development (CAREER)

Program - Research Experiences for Teachers (RET) in

Engineering - Research Experiences for Undergraduates

Division of Engineering Education and Centers

Page 23: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

23

Division of Emerging Frontiers in Research and Innovation (EFRI)

Planned Topic Areas for FY 2008. 1. Cognitive Optimization and Prediction through Reverse Engineering2. Resilient and Sustainable Infrastructures

Page 24: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

24

Centers of Research Excellence in Science and Technology Engineering Virtual Organization Grants Grant Opportunities for Academic Liaison with Industry Industry/University Cooperative Research Centers Program Partnerships for Innovation Program Small Business Innovation Research & Small Business Technology Transfer

Division of Industrial Innovation and Partnerships

Page 25: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

25

NSF ENGINEERING DIRECTORATE

Directorate of Engineering

Division of Chemical, Bioengineering, Environmental, and Transport Systems

Process and Reaction Engineering

Specialties

Engineering Research Referees

1

2

3

4

5

6

NSF ENGINEERING SCIENCE LEVELS OF ORGANIZATION TO PEER REVIEW

6Divisions

4Programs

5Sub-Programs

5Specialites

600Engineering

ScienceAreas

Page 26: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

26

Page 27: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

27

The Science & Technological Research Council of Turkey

Page 28: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

28

UNIVERSITYPROFESSOR

UNIVERSITY

UNIVERSITYGRANTSOFFICE

RESEARCHPROPOSAL

RESEARCHPROPOSAL

RESEARCHACCOUNT

RESEARCHGRANT

NSFLOG-IN

ANDDISTRIBUTE

NSFGRANT

PROGRAM

PEERREVIEWERS

IN ACADEMIAAND INDUSTRY

AND GOVERMENT

RESEARCHREVIEWS

RESEARCHPROGRAMBUDGET

RECOMMEND FUNDING

RESEARCH PROJECT

NSF RESEARCHDIVISION DIRECTOR

NSFGRANTAWARD

DIVISION

RESEARCHAWARDAPPROVAL

NSF DIVISION

NSF DIRECTORATE

BUDGETREQUEST

BUDGETALLOCATION

DECLINATION

NSF PROPOSAL FLOW

Page 29: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

29

UNIVERSITY

INDUSTRY

GOVERMENTAL AGENCIES

Page 30: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

30

TARABİS MKYS

İKYSBAYS

ARBİS

TTS

INFORMATION SYSTEMS

UNIVERSITY

Financial Services

Office of Legal Affairs

Administrative Units

Strategic Management

SUPPORT

INDUSTRY

GOVERMENTAL AGENCIES

Page 31: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

31

SCIENCE TECHNOLOGY Discovery Bottleneck Theory Invention

ENGINEERING COMMERCIALIZATION Systems Applications Design Processes

Technology and/or commercialization are principally the domains of industrial research and not university research.

Peer reviewers for technology and commercialization need to be recruited from industry as well as from academia. One source of identifying appropriate industrial peer reviewers can be recommendations from academics, since industrial researchers often do not publish in the technical literatures as do academics. Another source is from patent information.

RESEARCH IN TECHNOLOGY OR COMMERICIALIZATION

Page 32: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

32

SCIENCE & ENGINEERING & TECHNOLOGY & COMMERCIALIZATION

(1) Science & Technology Research – Theory & Bottlenecks.

(2) Science & Engineering Research – Theory & Systems.

(3) Science & Commercialization Research – Theory & Applications.

(4) Engineering & Technology Research – Systems & Bottlenecks.

(5) Engineering & Commercialization Research – Design & Processes.

(6) Science & Engineering & Technology – Theory & Systems & Bottlenecks.

(7) Engineering & Commercialization – Design & Applications.

Research proposals need to be multi-disciplinary proposals -- involving disciplinary specialists in science and/or engineering and also industrial researchers in the relevant areas of technology or commercialization.

Criteria for research proposal selection and research project monitoringmust be multi-criteria -- involving both advances in scientific and engineering knowledge

and in technology transfer from university to industry.

MULTI-DISCIPLINARY REVIEW PANELS

Page 33: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

33

SCIENCERESEARCH

ENGINEERING RESEARCH

TECHNOLOGY

COMMERCIALIZATION

PEER-REVIEWERS for Science & Engineering & Technology

Research Review

PEER-REVIEWERS for Science & Engineering & Commercialization

Research Review

Page 34: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

34

ROLE OF THE PANEL LEADER IN PEER REVIEW PANELS

1. Ensure that the proper kinds of experts relevant to a research proposal are represented in the panel.

2. Ensure that the panel experts understand their professional duty in judging the quality of the proposal objectively and upon high standards of science and innovation.

3. Control for any bias or lack of objectivity of any participant in the panel.

4. Ensure that a panel consensus is reached on the quality of the proposal and grading of the proposal.

5. Ensure that this consensus is properly documented in the panel report on the proposal.

6. Control the time spent by the panel -- so that the work is completed in the time allotted to the panel. The panel’s work must be complete before the panel leaves.

Page 35: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

35

Researchers tend to specialize into two different orientations:

1. problem or field specialist2. technique specialist

Most good research requires both:1. a deep understanding of a problem or field2. a sophisticated understanding of techniques

Some times teams proposed by researchers are unbalanced:

1. a team (or single investigator) who are competent in the problem/field orientation but relatively unsophisticated in techniques.

2. a team (or single investigator) who are sophisticated in in techniques but lack depth in the problem/field to which the techniques are proposed to be applied.

COMMON FLAWS IN THE TEAMS OF RESEARCH PROPOSALS

It is important to quality in research that research teams are properly balance between depth in problem/field knowledge and sophistication in technique/instrumentation skills.

Page 36: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

36

To gain a review consensus in a multi-disciplinary review panel, the program officer must handle the different intellectual perspectives of different disciplinary and professional researchers.

One must look at how researchers specialize intellectually. They specialize in the scientific paradigms that underlay their knowledge area.

This is what we have called the substance of science – scientific ontology – ‘the content of nature’.

For this we must go back to ‘theory’, to review the paradigms of science.The paradigms of science are the basic intellectual frameworks in which science describes and explains nature – natural representations.

Multi-disciplinary peer review panels will use experts from different scientific paradigms. Gaining peer review consensus from such multi-disciplinary teams requires a sophisticated process skill on the part of the panel leader – an understanding of the different frameworks of natural representations – scientific paradigms.

MULTI-DISCIPLINARY PEER REVIEW PANELS

!

Page 37: SCIENCE ADMINISTRATION LECTURE 27 MULTI-DISCIPLINARY PEER REVIEW –

37

LOOKING AHEAD IN SEPTEMBER

PEER REVIEW -- PROCEDURE

PANEL REVIEW -- PROCESS

META-LOGIC -- MANAGEMENT