Triage Your Data - Amazon S3...Triage Deﬁnition The assignment of degrees of urgency to wounds or...

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BYDECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Triage Your Data

1

Michael Harris

DECEMBER 11, 2019 ● GEORGE WASHINGTON UNIVERSITY ● SPONSORED BY

Using NLP for data triage

2


Triage DefinitionThe assignment of degrees of urgency to wounds or illnesses to decide the order of treatment.

3


Triage: Need lifesaving now

4


Triage: Can delay

5


Triage: You’re ok

6


Triage: you’re already dead

7


Stream processing: Apache Kafka

8


Stream processing: producers

9


Step 1: Data Collection

10



11



12



13


Stream processing: Producers

14


Stream processing: Processors

15


Processors: NLP

NLP:

Language Identification

16


Processors: NLP

NLP:

Sentiment Analysis

17


Processors: NLP

Sentiment Analysis

“Look at George, he’s in perfect shape. For a circle.”

18


Processors: NLP

Sentiment Analysis - sarcasm

“Look at George, he’s in perfect shape. For a circle.”{ "type": "PERSON", "mention": "George", ], "entityId": "T0", "confidence": 0.13598967, "sentiment": { "label": "pos",

19


Processors: NLP

Sentiment Analysis - effective with volume

20


Processors: NLP

Deduplication

21


Processors: NLP

Categorization

22


Processors: NLP

Categorization

Lily Collins is in talks to join Nicholas Hoult in Chernin Entertainment and Fox Searchlight's J.R.R. Tolkien biopic Tolkien. Anthony Boyle, known for playing Scorpius Malfoy in the British play Harry Potter and the Cursed Child, also has signed on for the film centered on the famed author. In Tolkien, Hoult will play the author of the Hobbit and Lord of the Rings book series that were later adapted into two Hollywood trilogies from Peter Jackson. Dome Karukoski is directing the project.

23


Processors: NLP

Categorization: Concepts

"phrase": "Fantasy", "salience": 0.15207518, "conceptId": "Q7151195"

"phrase": "Hobbit", "salience": 0.12163848, "conceptId": "Q74359"

"phrase": "English culture" , "salience": 0.10928583, "conceptId": "Q7151900"

24


Processors: NLP

Categorization: Keyphrases

"phrase": "J.R.R. Tolkien biopic Tolkien" , "salience": 1

"phrase": "Lily Collins", "salience": 0.52003408

"phrase": "Chernin Entertainment" , "salience": 0.38167696

25


Processors: NLP

Entity Extraction

Name Comparison

26


Processors: NLP

Relationships

27


Processors: NLP

Relationships

28


Processors: NLP

Relationships

29


Stream processing: Consumer app

30



31



32


Top 3: What is Data Triage

33


Top 3: Data Triage Pipeline

34


Top 3: NLP assists data triage

35



36



37



38



Multi-linqual

39

Triage Your Data - Amazon S3...Triage Deﬁnition The assignment of degrees of urgency to wounds or...

Documents

Transcript of Triage Your Data - Amazon S3...Triage Deﬁnition The assignment of degrees of urgency to wounds or...