東京電機大学 ポータルサイトUNIPAからの情報抽出と再利用
-
Upload
koki-hashimoto -
Category
Documents
-
view
7.882 -
download
2
description
Transcript of 東京電機大学 ポータルサイトUNIPAからの情報抽出と再利用
- 1. UNIPA @nullpoo 2012/8/25
2. Koki Hashimoto Twitter @nullpoo 3. UNIPA etc 4. UNIPA
UNIVERSAL PASSPORT http://www.jast-gakuen.com/ 5. ()UNIPA XMLUNIPA
6. UNIPA 7. Operaabout:blank 8. 9. 10. UNIPA 11. API () 12. C# C#
Visual Studio Python Linux Java 13. 14. FirefoxTamper Data 15.
Tamper Data Web HTTP Web 16. Cookie ID POST 17. Cookie Cookie
.NETCookieContainer Python cj = cookielib.CookieJar() //cj opener =
urllib2.build_opener()
opener.add_handler(urllib2.HTTPCookieProcessor(cj)) res =
opener.open(req) result = res.read() 18. .NETSgmlReaderLINQ!LINQ!
PythonBeautifulSoupMechanize BeautifulSoup 19. // soup =
BeautifulSoup(srchtml) //inputidhogehoge q = soup.findAll(input,
id=hogehoge") //0value session_id = q[0][value] 20. - 1
20120507
6
7/142
225029401
22705
5/7
. .: : : : : : : : :: :::: :: :: :
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: . . : :
: :: : : :: : ::: :: : :::: :: ::: :::
::::::::::::::::::::::::::::::::::::::. . .... ..: : :: :: :::
:::::: :::::::::::: : :::::::::::::::::::::::::::::::::::::::::::::
. . . .: : : ::: : :: ::::::::: ::::::::::::::::::::::::::::: 21.
22. - 2 20120711 7/12()4 718() 7/26 5/19,6/2,6/23,6/30,7/14()
.,,..,,,,_/ , 3 `l _`---" 23. () 24. 20120707()772012-07-07p1 =
re.compile(u"^(d+)?d+d+?:*")_date = p1.match(_date).group()_date =
_date.replace(u,-).replace(u,-).replace(u ,) 25. API MySQL 26. API
?fdate=20120808&tdate=20120831?campus=[senju or hatoyama]
JSONXML 27. Cron () 28. UNIPA 29. - 1 UNIPA API
http://nullserver.jp/nullpo/sqlout.py JSON UNIPA BOT @TDU_UNIPA_BOT
30. - 2 iOS(TDU) () Android 31. - 3 Java Java Twitter 07/11()6
----------------------------------------------------------------
Wed Jul 11 12:35:39 JST 2012:JUNJUN593:@XxHKRxX Wed Jul 11 04:34:43
JST 2012:ForbesFortune48: http://t.co/G64IpQFz Tue Jul 10 20:53:50
JST 2012:horipyon2: ; ; Tue Jul 10 16:35:56 JST 2012:taisukes07:!!
PowerPoint600etc Tue Jul 10 10:38:53 JST 2012:taaakaaa1111: 32. 33.
UNIPA UNIPA MVP 34.