教育資料思考:如何應用資料科學於OSCE中

109
OSCE 創創創創創創創創創創創創創創 創創創創創創 創創創創創創創創創 OSCE 創 Thinking with educational data: The use of data science for OSCE 創創創 創創創創創創 創創創創創創 創創創創創 Email: [email protected] 2016/12/21 1

Transcript of 教育資料思考:如何應用資料科學於OSCE中

Page 1: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

1

教育資料思考如何應用資料科學於 OSCE 中Thinking with educational data The use of data science for OSCE

劉明機 助理研究學者國立成功大學 工程科學系Email liumingchigmailcom

20161221

OSCE 創新學習與雲端大數據高峰論壇

220161221

bull 教育資料科學家bull 關鍵字歷程的語意分析與推薦bull 情感學習 (Affective learning)

bull 「運用深度學習技術於評量與培養運算思維能力bull 科技部資訊教育學門 兩年期計畫主持人劉明機 博士

liumingchigmailcom

OSCE 創新學習與雲端大數據高峰論壇

3

Outlines 資料科學 PISA OSCE 的相關議題 評分信效度 關卡設計 學習效率 如何應用資料科學於 OSCE 中 資料科學用藥須知 如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

4

什麼是資料科學

20161221

OSCE 創新學習與雲端大數據高峰論壇

5

資料科學 = 統計 + 計算 + 科學

20161221

OSCE 創新學習與雲端大數據高峰論壇

620161221 cs109org

資料科學工作流程

OSCE 創新學習與雲端大數據高峰論壇

7

Data is the New Everything

20161221

OSCE 創新學習與雲端大數據高峰論壇

820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage

OSCE 創新學習與雲端大數據高峰論壇

920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476

OSCE 創新學習與雲端大數據高峰論壇

1020161221

OSCE 創新學習與雲端大數據高峰論壇

11

PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)

PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養

20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 2: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

220161221

bull 教育資料科學家bull 關鍵字歷程的語意分析與推薦bull 情感學習 (Affective learning)

bull 「運用深度學習技術於評量與培養運算思維能力bull 科技部資訊教育學門 兩年期計畫主持人劉明機 博士

liumingchigmailcom

OSCE 創新學習與雲端大數據高峰論壇

3

Outlines 資料科學 PISA OSCE 的相關議題 評分信效度 關卡設計 學習效率 如何應用資料科學於 OSCE 中 資料科學用藥須知 如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

4

什麼是資料科學

20161221

OSCE 創新學習與雲端大數據高峰論壇

5

資料科學 = 統計 + 計算 + 科學

20161221

OSCE 創新學習與雲端大數據高峰論壇

620161221 cs109org

資料科學工作流程

OSCE 創新學習與雲端大數據高峰論壇

7

Data is the New Everything

20161221

OSCE 創新學習與雲端大數據高峰論壇

820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage

OSCE 創新學習與雲端大數據高峰論壇

920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476

OSCE 創新學習與雲端大數據高峰論壇

1020161221

OSCE 創新學習與雲端大數據高峰論壇

11

PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)

PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養

20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 3: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

3

Outlines 資料科學 PISA OSCE 的相關議題 評分信效度 關卡設計 學習效率 如何應用資料科學於 OSCE 中 資料科學用藥須知 如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

4

什麼是資料科學

20161221

OSCE 創新學習與雲端大數據高峰論壇

5

資料科學 = 統計 + 計算 + 科學

20161221

OSCE 創新學習與雲端大數據高峰論壇

620161221 cs109org

資料科學工作流程

OSCE 創新學習與雲端大數據高峰論壇

7

Data is the New Everything

20161221

OSCE 創新學習與雲端大數據高峰論壇

820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage

OSCE 創新學習與雲端大數據高峰論壇

920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476

OSCE 創新學習與雲端大數據高峰論壇

1020161221

OSCE 創新學習與雲端大數據高峰論壇

11

PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)

PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養

20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 4: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

4

什麼是資料科學

20161221

OSCE 創新學習與雲端大數據高峰論壇

5

資料科學 = 統計 + 計算 + 科學

20161221

OSCE 創新學習與雲端大數據高峰論壇

620161221 cs109org

資料科學工作流程

OSCE 創新學習與雲端大數據高峰論壇

7

Data is the New Everything

20161221

OSCE 創新學習與雲端大數據高峰論壇

820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage

OSCE 創新學習與雲端大數據高峰論壇

920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476

OSCE 創新學習與雲端大數據高峰論壇

1020161221

OSCE 創新學習與雲端大數據高峰論壇

11

PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)

PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養

20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 5: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

5

資料科學 = 統計 + 計算 + 科學

20161221

OSCE 創新學習與雲端大數據高峰論壇

620161221 cs109org

資料科學工作流程

OSCE 創新學習與雲端大數據高峰論壇

7

Data is the New Everything

20161221

OSCE 創新學習與雲端大數據高峰論壇

820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage

OSCE 創新學習與雲端大數據高峰論壇

920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476

OSCE 創新學習與雲端大數據高峰論壇

1020161221

OSCE 創新學習與雲端大數據高峰論壇

11

PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)

PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養

20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 6: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

620161221 cs109org

資料科學工作流程

OSCE 創新學習與雲端大數據高峰論壇

7

Data is the New Everything

20161221

OSCE 創新學習與雲端大數據高峰論壇

820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage

OSCE 創新學習與雲端大數據高峰論壇

920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476

OSCE 創新學習與雲端大數據高峰論壇

1020161221

OSCE 創新學習與雲端大數據高峰論壇

11

PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)

PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養

20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 7: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

7

Data is the New Everything

20161221

OSCE 創新學習與雲端大數據高峰論壇

820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage

OSCE 創新學習與雲端大數據高峰論壇

920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476

OSCE 創新學習與雲端大數據高峰論壇

1020161221

OSCE 創新學習與雲端大數據高峰論壇

11

PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)

PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養

20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 8: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

820161221httpwwwslidesharenetcondamoornext-generation-analytics-architecture-for-business-advantage

OSCE 創新學習與雲端大數據高峰論壇

920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476

OSCE 創新學習與雲端大數據高峰論壇

1020161221

OSCE 創新學習與雲端大數據高峰論壇

11

PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)

PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養

20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 9: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

920161221httpwwwslidesharenetAmandaMakulecidentifying-your-audience-40086476

OSCE 創新學習與雲端大數據高峰論壇

1020161221

OSCE 創新學習與雲端大數據高峰論壇

11

PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)

PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養

20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 10: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

1020161221

OSCE 創新學習與雲端大數據高峰論壇

11

PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)

PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養

20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 11: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

11

PISA 國際學生能力評量計劃 PISA (the Programme for International Student Assessment)

PISA 2012 共有 65 個國家或地區參與超過 51 萬名 15 歲學生進行兩小時的紙筆式評量 閱讀數學和科學三大素養

20161221PISA 2012 results in focus What 15-year-olds know and what they can do with what they know (2014) Retrieved from wwwoecdorgpisa

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 12: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

12

What Makes Schools Successful 是什麼讓學校成功Resources Policies and Practice

20161221

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 13: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

1320161221

Allocation of educational resources and mathematics performance教育資源跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 14: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

1420161221

Teachers salaries and mathematics performance教師的薪水跟數學成績

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 15: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

1520161221

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 16: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

16

PISA 的成功告訴我們什麼 用評量告訴我們世界各國家的教育狀況 讓資料說話比任何教育預算政策都有用

20161221httpswwwtedcomtalksandreas_schleicher_use_data_to_build_better_schools

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 17: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

17

Studentslsquo motivation and grouping of students分組方式與動機

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 18: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

18

Why You Shouldnlsquot Trust All Self-reporters為什麼你不該相信所有的自願報告

20161221httpbestreviewscomhow-reliable-are-amazon-ratings

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 19: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

19

The Paid Review Bias付錢評分偏誤

20161221

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 20: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

2020161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

the majority of the respondents remained neutral on many questions thereby limiting the generalizabilty of the results大多數藥學生 沒意見

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 21: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

21

Problems with the OSCE rating systemOSCE 的評分問題 OSCE depends on the ratersrsquo impression of the performance of the students

Even if the raters are well trained using a standardized method of assessment there is no format for presenting the ratersrsquo assessments

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 22: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

22

Malaysian pharmacy studentslsquo assessment of OSCE馬來西亞藥學生對 OSCE 意見 A 13-station OSCE included patient counseling and communication clinical pharmacokinetics (CPK) identification and resolution of drug-related problems (DRPs) and literature evaluationdrug information provision

A majority felt the tasks required in some stations required a higher degree of learning than they had achieved

Future efforts should include providing clearer instructions at OSCE stations and balancing the complexity of the competencies assessed

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 23: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

23

OSCEs are costly requiring significant time teaching staff and spaceOSCE 很花錢 花時間 花人力 花空間(Hussainy Styles amp Duncan 2012)

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 24: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

2420161221

OSCE implementation High-end and Low-end costs estimationOSCE 的花費The high-end costs were euro14523 per student (= NT $5000)the low-end costs were euro3151 per student (= NT $1100)

Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 25: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

25

Strategies for reducing costs如何減少花費 Creating a network of nursing bachelors degree courses for swapping scenarios cases and clinical situations

Cooperating with Patient Associations to involve them as volunteers in the clinical scenarios

Establishing links with hospitals to obtain space for conducting the OSCE

20161221Palese A Bulfone G Venturato E Urli N Bulfone T Zanini A Dante A (2012) The cost of the objective structured clinical examination on an Italian nursing bachelors degree course Nurse Education Today 32(4) 422-426 doi101016jnedt201103003

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 26: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

26

二十年後的公民需要具備什麼核心能力

20161221httpsaylibcomMagContaspxUnit=featurearticlesampid=2096

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 27: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

27

日本藥學檢驗 PhCAT

20161221

httpwwwphcatorjppage_id=319

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 28: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

28

日本 OSCE

20161221 httpwwwphcatorjp

httpphcatorjpapp-defS-102wpwp-contentuploads201202yakugaku_samplemp4

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 29: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

29

OSCE 的相關議題 評分信效度

關卡設計

學習效率

20161221

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 30: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

30

OSCE 評分信效度20161221

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 31: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

31

考官如何 2 秒評分

20161221

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 32: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

32

外表重要嗎

20161221

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 33: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

33

Physical attractiveness on academic performance外表對成績影響

20161221

Photographs of the student IDApproval from the institution

Multiple raters (1-5)The same 50 images for

normalization

Google 大仁科大正妹French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 34: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

34

Grooming has the largest effect on GPA for male students having a very attractive personality is most important for female students乾淨對男生成績比較重要魅力對女生成績比較重要

20161221

Personal appearance measures

ModelsMales (N = 2487) Females (N = 2878)

A B C D E F G HVery physically attractive 0055 minus 0122 0080 minus 0047Below average physical attractiveness minus 0146 minus 0005 minus 0114 minus 0044

Very attractive personality 0145 0081 0173 0145Below average personality attractiveness minus 0182 minus 0114 minus 0128 minus 0091

Very well groomed 0263 0274 0163 0114

Below average groomingminus

0492minus

0468 minus 0197 minus 0155

R squared 0219 0222 0235 0237 029 0294 0293 0297

linear regression results for the effects of personal appearance on overall GPA

French M T Robins P K Homer J F amp Tapsell L M (2009) Effects of physical attractiveness personality and grooming on academic performance in high school Labour Economics 16(4) 373-382 doi101016jlabeco200901001

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 35: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

35

More Attractive female students earn higher grades than unattractive ones (Hernaacutendez-Juliaacuten amp Peters 2015)

Rating of charisma and the display of an attractive photograph were both positively associated with Teaching effectiveness ratings (Rannelli et al 2014)

Scholarslsquo physical appearance is significantly correlated with their research performance (Dilger Lutkenhoner amp Muller 2015)

20161221

Lombarts Kmjmh (2014) A (good) look at the rating of teaching effectiveness Towards holistic and programmatic assessment Medical Education 48(8) 744-747 doi101111medu12491Rannelli L Coderre S Paget M Woloschuk W Wright B amp McLaughlin K (2014) How do medical students form impressions of the effectiveness of classroom teachers Medical Education 48(8) 831-837 doi101111medu12420Hernaacutendez-Juliaacuten Rey amp Peters Christina (2015) Student appearance and academic performance Metropolitan State University of Denver

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 36: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

36

But Attractiveness can be a disadvantage in some situations (Lombarts 2014)

Disadvantaged when applying for militaryLess may be expected of them

Appearance is significantly smaller for both male and female students in online course environments (Hernaacutendez-Juliaacuten amp Peters 2015)

Scholars research performance is especially correlated with perceived trustworthiness (Dilger Lutkenhoner amp Muller 2015)

20161221

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 37: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

37

Reliability and validity of OSCEOSCE 的信效度議題 Interrater reliability Internal consistency Testndashretest reliability Marking tools Pass mark Concurrent and predictive validity Validity as lsquoReal Worldrsquo assessment

20161221 Rushforth H E (2007) Objective structured clinical examination (OSCE) Review of literature and implications for nursing education Nurse Education Today 27(5) 481-490 doi101016jnedt200608009

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 38: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

38

Limitations of OSCEsOSCE 的限制 Since 2 parallel OSCEs were conducted the training emphasized consistency in grading between each pair of examiners to ensure the same scores were achieved by a student

However no data were generated to support the sufficiency of this in ensuring the validity and reliability of the examination

Overall scores on the OSCE are often not very reliable

20161221 Awaisu A Abd Rahman N S Mohamed M H N Bux S amp Nazar N I M (2010) Malaysian pharmacy students assessment of an objective structured clinical examination (OSCE) American Journal of Pharmaceutical Education 74(2) 9

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 39: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

39

It is more difficult to reliably assess communication skills than clinical skills溝通能力比診斷能力難評量

20161221 Brannick M T Erol-Korkmaz H T amp Prewett M (2011) A systematic review of the reliability of objective structured clinical examination scores Medical Education 45(12) 1181-1189 doi101111j1365-2923201104075x

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 40: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

40

Assessment of pharmacy studentsrsquo communication competence評量藥學生的溝通能力 The patient case used for the OSCE was that of a diabetic patient Interview to gather information regarding the patientrsquos medical history Each interview was limited to 5 minutes The 3 raters who evaluated the students who were certified as official raters by the Common Achievement Test Organization in Japan

The raters used a 6-point global rating scale (6=the studentrsquos performance did not differ from that of a real pharmacist)

20161221Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 41: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

4120161221

Roter Interaction Analysis System (RIAS) A method for coding medical dialogue

Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 42: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

4220161221

Figure 2 Relationship between the studentsrsquo global rating score and number of utterances in the business category (R = 04305 P = 01092)

Figure 1 Relationship between the studentsrsquo global rating score and number of utterances in the socio-emotional category (R= 0662 P lt 001)

A good interview in the OSCE has been defined as one consisting of a numerous variety of utterances especially in the socio-emotional category 跟社會情感有關的對話越多OSCE成績越高Kubota Y Yano Y Seki S Takada K Sakuma M Morimoto T Hiraide A (2011) Assessment of pharmacy students communication competence using the roter interaction analysis system during objective structured clinical examinations American Journal of Pharmaceutical Education 75(3) 6

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 43: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

43

OSCE 關卡設計20161221

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 44: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

44

人類沒有工作的那一天20161221

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 45: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

20161221 45

( 世界經濟論壇 ) 2020 年 500 萬份工作被機器人取代( 日本野村綜合研究所 ) 20 年後 49 職業由機器人取代

( 數位時代 ) 機器人可能讓全人類都沒有工作

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 46: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

46

Robots that can adapt like animals機器人像動物一樣適應

20161221Cully Antoine Clune Jeff Tarapore Danesh amp Mouret Jean-Baptiste (2015) Robots that can adapt like animals Nature 521(7553) 503-U476 doi101038nature14422

Using the Intelligent Trial and Error algorithm robots like animals can quickly adapt to recover from damage

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 47: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

47

Computers had mastered the art of telling sports and finance stories 電腦寫體育與財經報告(Stats Monkey)

20161221httpsingularityhubcom20091109is-software-set-to-replace-sports-journalists

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 48: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

4820161221httpsenwikipediaorgwikiInfinite_monkey_theorem

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 49: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

49

Eureqa The Robot Scientist機器科學家

20161221httpwwwwiredcom200904newtonaihttpwwwwiredcom200912download-robot-scientist

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 50: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

5020161221httpkrishnaorgevolution-from-scientist-to-monkey

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 51: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

51

智慧科技 走入日本居家式照護

20161221

「日本再興戰略」將機器人列入重點發展項目「藉由照護機器人促進自立減輕照護負擔之五年計畫」將長照保險適用範圍擴大至照護機器人降低使用者負擔

httpwwwchinatimescomnewspapers20160126000336-260207

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 52: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

52

人工智慧來了 淘金潮 vs失業潮

20161221 httpswwwyoutubecomwatchv=571p_v4wriM

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 53: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

53

機器人上陣 配藥零失誤

20161221 httpudncomnewsstory73311827544

讓醫護人員可不用再直接接觸有毒的化療藥物而且還具備配藥零失誤率與高效率等優點

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 54: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

54

科技性失業 人類不適任的未來

20161221httpswwwyoutubecomwatchv=X439JRyoyXo

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 55: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

55

未來人類的互動技巧越來越重要 創意問題解決能力 說故事溝通能力

情感能力

20161221 httpwwwnytimescomroomfordebate20160309does-alphago-mean-artificial-intelligence-is-the-real-dealthe-skills-of-human-interaction-will-become-most-valuable-in-the-future

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 56: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

56

模擬藥局 Students had to imagine patientsrsquo characteristics and

could not observe important aspects such as body language which help a pharmacist appropriately communicate with a patient

20161221 Hussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 57: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

57

A virtual practice environment

20161221

Figure 2 Example of how a case was presented to students in the Communication and Counseling TutorialsHussainy S Y Styles K amp Duncan G (2012) A virtual practice environment to develop

communication skills in pharmacy students American Journal of Pharmaceutical Education 76(10) 8 doi105688ajpe7610202

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 58: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

58

Scenario-based simulation course training on nurseslsquo communication competence以模擬課程訓練護生溝通技巧 Compare the effect of a traditional course versus scenario-based simulation training on

nurses communication competency communication self-efficacy and communication performance in discharge planning OSCE

20161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 59: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

5920161221

Table 2 Study Protocol for the Two Groups

Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 60: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

6020161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 61: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

6120161221 Hsu L L Chang W H amp Hsieh S I (2015) The effects of scenario-based simulation course training on nurses communication competence and self-efficacy A randomized controlled trial Journal of Professional Nursing 31(1) 37-49 doi101016jprofnurs201405007

Table 5 Between-Subjects Effects of the Communication Training Course on the Communication Competence and Self-Efficacy at the First Posttest (N = 116)

Table 6 Between-Subjects Effects of the Communication Training Course on the Learning Satisfaction and Communication Performance at the First or Second Posttest (N = 116 at T2 and n = 78 at T3)

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 62: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

62

Empathy is related to OSCE scores同理心跟 OSCE 分數有關

20161221 Ogle J Bushnell J A amp Caputi P (2013) Empathy is related to clinical competence in medical care Medical Education 47(8) 824-831 doi101111medu12232

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7not at all a lot(1) Did the physician provide the opportunity for the patient to give hisher opinion(2) Did the physician treat the patient as an equal partner(3) Did the physician show understanding of the patientrsquos point of view(4) Did the physician try to put himherself in the position of the patient(5) Did the physician show interest in the patientrsquos opinion(6) Did the physician put the patient under pressure(7) Did the physician preach(8) Did the physician admonish the patient(9) Was the physician responsive to the patient

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 63: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

63

如何自動評估情感能力

20161221

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 64: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

64

Microsoft Emotion Recognition API

20161221httpswwwprojectoxfordaidemoEmotion

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 65: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

65

蕭博駿到底喜不喜歡當工具人

20161221

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 66: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

66

Emotion recognition with the facial expression software用表情辨識軟體辨識情緒 Studentsrsquo emotional states from the recorded clips were recognized by using FaceReader facial expression software (httpwwwnolduscomfacereaderfacereader-online)

The method for indicating whether the emotional status of the subject is positive or negative is based on a valence value

The valence indicates whether the facial expressions are positive or negative

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 67: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

67

Emotional states of the clips

Figure 4 The valences of an example clip indicating the generally negative emotion of a student

N ValenceMean SD 95 CI to mean

24 -007 014 -013 to -001Table 7 Valence mean scores standard deviations

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 68: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

68

Muldner K amp Burleson W (2015) Utilizing sensor data to model studentslsquo creativity in a digital environment Computers in Human Behavior 42 127-137使用感測器量測創造力

20161221

Input data

EEG

Eye movement

Physiological signals

Dialogue

情緒角度個體處於正向情感將有助於產生更多元化的資訊更多樣性的聯想因而增強個體的思考彈性 (Alice M Isen 1990 Murray Sujan Hirt amp Sujan 1990)

引起個體負向的情感 ( 如 焦慮 ) 會導致傾向使用僵硬的策略而且厭煩的情緒會使個體降低注意力造成淺層的知識處理

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 69: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

69

Target problem

20161221

為什麼用這個 task1 過去用過2 不需要領域知識3 很好評分

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 70: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

70

Reliable differences in sensor features characterizing low vs high creativity students高低創造力成績的差異

20161221

The low creativity students hadndash marginally fewer total fixationsndash significantly shorter total saccade path lengthndash significantly lower average saccade speedndash marginally lower saccade speed standard deviationndash marginally more short term excitementndash marginally greater standard deviation of frustration

Classifier TPR FPR F-measureRule Nnge 857 214 854Naive bayes ndash simple 762 333 757

True Positive Rate higher is betterFalse Positive Rate lower is better

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 71: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

71

毅力的重要性

20161221

「當你遭遇失敗後才會找到解決失敗的課題把失敗付諸一笑然後採取新的行動這才是最重要的事」-日本太陽 Parts 公司社長城岡陽志「人的一生為什麼要努力因為最痛苦的事不是失敗是我本來可以」 - 網絡名言

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 72: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

72

怎麼量測毅力

20161221

乙武洋匡雖然沒有四肢但是他卻擁有超越一般人的毅力

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 73: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

73

Flappy Bird game

20161221FLAPPY BIRD DEATH MONTAGE (iOS Gameplay Video)httpswwwyoutubecomwatchv=FxKb_zx9cUg

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 74: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

74

Flappy Bird 誤我一生

20161221httpswwwyoutubecomwatchv=RLYINpY-zLw

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 75: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

75

遊戲培養團隊合作

20161221httpswwwyoutubecomwatchv=gPBnJO1Niww

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 76: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

76

Ventura Matthew amp Shute Valerie (2013) The validity of a game-based assessment of persistence Computers in Human Behavior 29(6) 2568-2572用遊戲量測毅力

20161221Example problem in a physics video game

NP session logsPerformance measure of persistence (PMP)Game-based assessment of persistence (GAP)Physics testSelf-report measure of persistenceEnjoyment questionVideo game experience

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 77: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

77

The GAP silver and unsolved times significantly relate to the PMP and the physics posttest scores for low performers遊戲測毅力對低成就比較有用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 51

Unsolved 47 96

Silver 42 81 62

Gold 00 22 14 32Enjoy 23 08 02 18 06Self P 10 minus01 minus01 00 03 minus05

Physics post test 30 33 31 29 08 18 15Correlations for 70 low performers in Newtonrsquos Playground

GAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 78: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

78

The GAP relates much lower to the PMP for high performers versus low performers遊戲測毅力對高成就比較沒用

20161221

PMP GAP Unsolved Silver Gold Enjoy Self-p

GAP 22

Unsolved 12 94

Silver 31 84 60

Gold 12 30 36 11Enjoy 10 11 11 09 minus03Self P 09 minus06 minus05 minus05 minus13 07

Physics post test 16 02 01 04 minus21 15 15

Correlations for 84 high performers in Newtonrsquos PlaygroundGAP = unsolved and silver times unsolved = unsolved time silver = silver time gold = gold time enjoy = I enjoyed playing NP self P = self-report measure of persistence

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 79: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

79

OSCE 學習效率20161221

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 80: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

8020161221

Work Smart Not Hard

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 81: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

81

Upload knowledge to your brain記憶吐司 穿顱直流電刺激 tDCS Working memory is linked primarily with brain activity in the dorsolateral prefrontal cortex (DLPFC)

Skill acquisition and procedural learning is linked primarily with brain activity in primary motor cortex (M1)

20161221

Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 82: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

82

Flight path deviation between subjects and autopilot有刺激比較能控制

20161221Choe Jaehoon Coffman Brian A Bergstedt Dylan T Ziegler Matthias amp Phillips Matthew E (2016) Transcranial direct current stimulation modulates neuronal activity and learning in pilot training Frontiers in Human Neuroscience 10 25 doi103389fnhum201600034

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 83: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

8320161221httpwwwdispatchcomcontentstoriesbusiness20150615company-creates-wearable-tech-to-alter-mind-bodyhtml

Send electrical impulses to users nerves to make the person calmer or more energized你累了嗎

Thync

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 84: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

84

OSCE 很有壓力 Majority of the students stated that the OSCE was very stressful (755) and more than half of them found the exam more stressful than the other exams (511)(Selim Ramadan El-Gueneidy amp Gaafer 2012)

An OSCE could then be seen as limiting for students who lack verbal skills as well as for those who are unable to overcome nerves during a stressful event(Baid 2011)

OSCE might hinder their performance as a result of the stress of being assessed in a simulated environment (Hemingway Stephenson Roberts amp McCann 2014)

The OSCE was seen as stressful to students (Bouchoucha Wikander amp Wilkin 2013)

20161221

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 85: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

85

造成壓力的原因 Students stress and anxiety are related to the new experience with OSCE

Students were stressed by the lack of enough time to deal with the scenario in some stations

20161221 Selim A A Ramadan F H El-Gueneidy M M amp Gaafer M M (2012) Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education Is it reliable and valid Nurse Education Today 32(3) 283-288 doi101016jnedt201104006

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 86: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

86

護理師壓力大

20161221

訓練期短縮 新進護理人員壓力遽增httpswwwyoutubecomwatchv=_DxFidVtcb8

趕搭哈味風潮急診部護理跳「哈味舞」紓壓httpswwwyoutubecomwatchv=1R8rpaWsaAg

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 87: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

87

危機同時也是轉機 An opportunity for students to develop skills in presenting information to others and managing stressful clinical situations which are essential aspects of intensive care nursing practice

Learning to manage anxiety during an OSCE may actually help overall performance of clinical skills in practice (Byrne amp Smyth 2008)

20161221 Baid H (2011) The objective structured clinical examination within intensive care nursing education Nursing in Critical Care 16(2) 99-105 doi101111j1478-5153201000396x

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 88: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

88

如何設計可提升正向情感的測驗回饋Liu Chia-Ju Huang Chin-Fei Liu Ming-Chi Chien Yu-Cheng Lai Chia-Hung amp Huang Yueh-Min (2015) Does gender influence emotions resulting from positive applause feedback in self-assessment testing Evidence from neuroscience Educational Technology amp Society 18(1) 337-350

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 89: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

89

Positive applause feedback in self-assessment testing Rewarding with applause sound during computerized test

掌聲鼓勵

>

枑鼎漆講秞虴匼第刲坰狟婥督昢

撈奀刲坰ㄛ婓盄煦砅

2010

秞虷厙 - Yisellcom

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 90: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

90

Two tests

the controlled task the experimental task

30 students (15 males 15 females mean age plusmn SD = 192 plusmn 20 years) participated in this experiment

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 91: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

91

Timeline of experimental procedure

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 92: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

92

Gender differences in anxiety

The controlled task The experimental task

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 93: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

93

Applause decrease malersquos anxiety Topographical map of the brain

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 94: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

94

如何應用資料科學於 OSCE 中 評分信效度 收集對話將自動將資料編碼給予評分參考 收集表情判斷情緒給予評分參考 關卡設計 收集臨床 CASE 對話影片提供更擬真的 CASE 著重在未來不容易被取代的技能 ( 溝通情感創意問題解決 ) 建置電腦化自動化評量降低關卡成本 學習效率 收集學習歷程 (認知技能情意 ) 分析學生的問題 利用資料分析發展有效的學習回饋20161221

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 95: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

95

Data Science Pitfalls資料科學注意事項

20161221

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 96: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

96

用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦

20161221httpwww5678newscomnews_detailsphpn=201607160849213852

資料科學注意事項

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 97: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

97

A correlation of 085 was obtained

20161221

A comparison of model estimates for the mid-Atlantic region (black) against Disease Control and Prevention (CDC)-reported influenza-like illness ILI percentages (red) including points over which the model was fit and validated

Ginsberg J Mohebbi M H Patel R S Brammer L Smolinski M S amp Brilliant L (2009) Detecting influenza epidemics using search engine query data Nature 457(7232) 1012-U1014

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 98: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

98

Google Flu Trends 的成功 1 Data 分析能夠創造神奇般準確的結果 2 每一個 Data 都能不被遺漏使得舊有的統計抽樣方法過時 3 不用再煩惱 Data 間的因果關係因為統計的相關性會告訴我們我們想要的資訊科學的或是統計的模型不再需要因為套一句 2008 年在 Wired 發表的論文《 The End of Theory 》裡的話「有了足夠的資料數字會自己說話」20161221Big data- are we making a big mistakehttpbuzzorangecomtechorange20140604big-data-making-big-mistake

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 99: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

99

相關不等於因果 新聞中充斥著流感可怕的故事而這些故事可能會引起健康的人們在網路上搜尋相關資訊 Google 自身擁有的搜尋演算法可說是「朝夕令改」是不斷的在轉變的當人們進入醫療症狀時它開始自動地建議診斷情形

20161221

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 100: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

100

大數據已死

20161221

「大數據」是個非常差勁的命名因為它讓人們直接聯想到「大」但數據的大小其實是最無趣的部分最重要的其實是那些你從來沒有想過可以用的數據以及那些非傳統的資料我認為這才是人們對大數據應有的認知[專訪 ]美國 Top 4 技術長寶立明大數據即將在五年內消失httpwwwbnextcomtwarticleviewid35404

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 101: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

101

Data規模大小稱不上一回事 1936 年美國總統選舉預測選戰結果 The Literary Digest 郵寄 1000 萬名民眾問卷收到 240 萬個回覆花了超過兩個月的時間 Literary Digest 宣布它的結果 Landon 55 gt 41 Franklin

實際選舉的結果 Franklin 61 gt 37 Landon

George Gallup 的小樣本調查反而更接近最終選戰的結果20161221Harford Tim (2014) Big data A big mistake Significance 11(5) 14-19

doi101111j1740-9713201400778x

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 102: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

102

壞樣本的毛病 1 對調查母體沒有定義清楚 2母體裡面的個體有些永遠不可能被抽中

20161221

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 103: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

103

龐大的資料量底下不要犯相同傳統的統計錯誤 The Literary Digest 所寄出的郵件名單是同時從車輛登記及電話簿中編纂而成的名單至少在 1936 年的那時是非常不成比例的 在所有郵寄回復的 240 萬個問卷結果中 Landon 的支持者更樂於將他們的結果交還給 The Literary Digest

20161221

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 104: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

104

Battling bad science (實驗法 ) 不要安慰劑跟最佳的方法比才能幫助做決定 不能將舊方法效用調低或是調高 不能隱藏資料

20161221

Battling bad sciencehttpswwwtedcomtalksben_goldacre_battling_bad_science

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 105: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

105

如何提升資料素養

20161221

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 106: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

10620161221 1 Thinking with data

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 107: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

10720161221 2 Frame your problem

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 108: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

108

資料科學傳教士 2016台灣資料科學愛好者年會有志一同教育大數據共同主持人 「統計與生活」通識 「專家系統」融入課程推薦股價預測商品分類球探等實務案例 「電腦軟體應用」通識 Excel 資料處理技巧 「教育中的資料科學深又大」 slideshare

Liu Ming-Chi amp Huang Yueh-Min (In Press) The use of data science for education The case of social-emotional learning Smart Learning Environments

20161221

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109
Page 109: 教育資料思考:如何應用資料科學於OSCE中

OSCE 創新學習與雲端大數據高峰論壇

10920161221

Thank You for Listening

Email liumingchigmailcom

劉明機

  • 教育資料思考 如何應用資料科學於OSCE中 Thinking with educational data The us
  • Slide 2
  • Outlines
  • 什麼是資料科學
  • 資料科學 = 統計 + 計算 + 科學
  • Slide 6
  • Data is the New Everything
  • Slide 8
  • Slide 9
  • Slide 10
  • PISA 國際學生能力評量計劃
  • What Makes Schools Successful 是什麼讓學校成功
  • Slide 13
  • Slide 14
  • Slide 15
  • PISA的成功告訴我們什麼
  • Studentslsquo motivation and grouping of students 分組方式與動機
  • Why You Shouldnlsquot Trust All Self-reporters 為什麼你不該相信所有的自願報告
  • The Paid Review Bias 付錢評分偏誤
  • Slide 20
  • Problems with the OSCE rating system OSCE的評分問題
  • Malaysian pharmacy studentslsquo assessment of OSCE 馬來西亞藥學生對OSCE意見
  • OSCEs are costly requiring significant time teaching staff a
  • Slide 24
  • Strategies for reducing costs 如何減少花費
  • 二十年後的公民需要具備什麼核心能力
  • 日本藥學檢驗PhCAT
  • 日本OSCE
  • OSCE的相關議題
  • OSCE評分信效度
  • 考官如何2秒評分
  • 外表重要嗎
  • Physical attractiveness on academic performance 外表對成績影響
  • Grooming has the largest effect on GPA for male students havin
  • More
  • But
  • Reliability and validity of OSCE OSCE的信效度議題
  • Limitations of OSCEs OSCE的限制
  • It is more difficult to reliably assess communication skills th
  • Assessment of pharmacy studentsrsquo communication competence 評量藥學生
  • Slide 41
  • Slide 42
  • OSCE關卡設計
  • 人類沒有工作的那一天
  • Slide 45
  • Robots that can adapt like animals 機器人像動物一樣適應
  • Computers had mastered the art of telling sports and finance st
  • Slide 48
  • EureqaThe Robot Scientist 機器科學家
  • Slide 50
  • 智慧科技 走入日本居家式照護
  • 人工智慧來了 淘金潮vs失業潮
  • 機器人上陣 配藥零失誤
  • 科技性失業 人類不適任的未來
  • 未來人類的互動技巧越來越重要
  • 模擬藥局
  • A virtual practice environment
  • Scenario-based simulation course training on nurseslsquo communicat
  • Slide 59
  • Slide 60
  • Slide 61
  • Empathy is related to OSCE scores 同理心跟OSCE分數有關
  • 如何自動評估情感能力
  • Microsoft Emotion Recognition API
  • 蕭博駿到底喜不喜歡當工具人
  • Emotion recognition with the facial expression software 用表情辨識軟體
  • Emotional states of the clips
  • Muldner K amp Burleson W (2015) Utilizing sensor data to mo
  • Target problem
  • Reliable differences in sensor features characterizing low vs
  • 毅力的重要性
  • 怎麼量測毅力
  • Flappy Bird game
  • Flappy Bird 誤我一生
  • 遊戲培養團隊合作
  • Ventura Matthew amp Shute Valerie (2013) The validity of a g
  • The GAP silver and unsolved times significantly relate to the
  • The GAP relates much lower to the PMP for high performers versu
  • OSCE學習效率
  • Slide 80
  • Upload knowledge to your brain 記憶吐司
  • Flight path deviation between subjects and autopilot 有刺激比較能控制
  • Slide 83
  • OSCE很有壓力
  • 造成壓力的原因
  • 護理師壓力大
  • 危機同時也是轉機
  • 如何設計可提升正向情感的測驗回饋
  • Positive applause feedback in self-assessment testing
  • Two tests
  • Timeline of experimental procedure
  • Gender differences in anxiety
  • Applause decrease malersquos anxiety
  • 如何應用資料科學於OSCE中
  • Data Science Pitfalls 資料科學注意事項
  • 用藥沒看清肛門塞劑吞下肚眼藥水乎乾啦
  • A correlation of 085 was obtained
  • Google Flu Trends 的成功
  • 相關不等於因果
  • 大數據已死
  • Data規模大小稱不上一回事
  • 壞樣本的毛病
  • 龐大的資料量底下不要犯相同傳統的統計錯誤
  • Battling bad science (實驗法)
  • 如何提升資料素養
  • Slide 106
  • Slide 107
  • 資料科學傳教士
  • Slide 109