Claw | data centric expert system

17
project Claw PV243 Advanced Java technologies Michal Karm Babacek Faculty of Informatics, Masaryk University 2014-06-18 ver.: git commit b5909b5, 2014-06-18, by Karm, [email protected]

description

School pet project on real-time data mining and analysis. Handouts: http://urbangaming.cz/share/claw.pdf

Transcript of Claw | data centric expert system

Page 1: Claw | data centric expert system

project ClawPV243 Advanced Java technologies

Michal Karm BabacekFaculty of Informatics, Masaryk University

2014-06-18

ver.: git commit b5909b5, 2014-06-18, by Karm, [email protected]

Page 2: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Outline

1 What is it good for?2 Technologies3 Success vs. Failure4 Outlook5 References

2 / 13

Page 3: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Mission

• Intelligence gathering

• Real-time data mining

• Supervised machine learning

• Possibly inspired by Palantir ª

• ...on a microscopic scale

3 / 13

Page 4: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Mission

• Intelligence gathering

• Real-time data mining

• Supervised machine learning

• Possibly inspired by Palantir ª

• ...on a microscopic scale

3 / 13

Page 5: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Mission

• Intelligence gathering

• Real-time data mining

• Supervised machine learning

• Possibly inspired by Palantir ª

• ...on a microscopic scale

3 / 13

Page 6: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Mission

• Intelligence gathering

• Real-time data mining

• Supervised machine learning

• Possibly inspired by Palantir ª

• ...on a microscopic scale

3 / 13

Page 7: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Mission

• Intelligence gathering

• Real-time data mining

• Supervised machine learning

• Possibly inspired by Palantir ª

• ...on a microscopic scale

3 / 13

Page 8: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Tech — overview, P2P

4 / 13

Page 9: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Tech — data collection

5 / 13

Page 10: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Tech — in memory cache

6 / 13

Page 11: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Tech — cache store

7 / 13

Page 12: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Tech — hibernate seach

8 / 13

Page 13: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Tech — ML Weka

9 / 13

Page 14: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Tech — real-time visuals

10 / 13

Page 15: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Implemented — small pilot

11 / 13

Page 16: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

Outlook

• Play with Weka and integrate it

• Add more data sources

• Visualize with Processing

• OpenShift

• Docker?

12 / 13

Page 17: Claw | data centric expert system

project Claw

Michal KarmBabacek

What is it good for?

Technologies

Success vs. Failure

Outlook

References

References

I Infinispan infinispan.org

I WildFly wildfly.org

I Hibernate — search hibernate.org/search

I Weka cs.waikato.ac.nz/ml/weka

I Palantir palantir.com

I Processing processing.org

I Mongo DB mongodb.org

I Postgre SQL postgresql.org

I Twitter API dev.twitter.com13 / 13