形態素列パターンマッチャーMIURAをつくりました @DSIRNLP#6
-
Upload
yuya-unno -
Category
Technology
-
view
2.250 -
download
0
description
Transcript of 形態素列パターンマッチャーMIURAをつくりました @DSIRNLP#6
³¨ÁÅPIZSKJU MIURA:%�7/�! �
�� Preferred Infrastructure �q�ÊÍ @unnonouno �
2014/10/11 @DSIRNLP#6�
aÆϱ�
�q�ÊÍ (@unnonouno) ! �� Preferred Infrastructure ! �¬£y(�~Ð|½37/�
! �ɣy1#4$(37/�
! NLP¦c,\,�f�u_*)7/�!
��
grep | sort | uniq �85+��
! “text”,o�,]'��µÅ:�HM�&�A>ZM�
��
cat text | grep -o [0-9]+ | sort | uniq –c�
grep"(�9�'�)��
! »¬���69)�
! �Ò'Î7�0)�
��
MIURA:��/�4���
��
MIURA)6��)8��
! “text”,o�,]'��ÒÅ:�HM�&�A>ZM�
��
cat text | miura –o “<pos=�Ò>*” | sort | uniq –c�
�;)j1���
��
cat text | miura –o “<pos=³�Ò><surface='�>” | sort | uniq –c�
MIURA(-�
! ³¨ÁÅ*h�8�¿}�SKJU ! ºrn��§¥¨@MSMZ*58wÀ ! B?XPIZ�¬ ! 9b*����'v¾�9!NLP¦c,\EZRF>T'vd�!�
��
MIURA�¼�PIZ�ECZG,�x»�-³¨Á ! .
! ��,³¨Á*SKJ
! <pos=x> ! �Ò�x,³¨Á*SKJ
! <surface=x> ! }��x,³¨Á*SKJ
! X* ! X,1���,Ä7©�
! X|Y ! X�Y*SKJ
��
�¿�¬(�§@MSMZ�
���
“<pos=�Ò>*<pos=²Ò>”
ε� ε�
pos=���
pos=���
Repeat(Cond(pos=�Ò))::Cond(pos=²Ò) �
s,wÀ-�,¥¨,//��&/��
�����
��!'#%#&�
$"'&� �
ºrn��§@MSMZ (1/3) �
���
ÃÑ� -� Ó� '� �8�
ε� ε�
pos=���
pos=���
�µÅ,� e�
¥¨,� e�
ºrn��§@MSMZ (2/3) �
���
ÃÑ� -� Ó� '� �8�
ε� ε�
pos=���
pos=���
ºrn��§@MSMZ (3/3) �
���
ÃÑ� -� Ó� '� �8�
ε� ε�
pos=���
pos=���
�k*Ì°�!6DY�
��®�
! �µÅ,� e(¥¨,� e,�` �¶ ��)�,'¤m��®- O(nm)
! Ô-¢ON,^��),'�zpË�!,�jm��® O(nmd)
n: �µÅ,_�
m: ¥¨,� d: ^���
���
s,wÀ-�¸expjm��7SG�
'��[pypi*¹´�5�(�!6����
���
(((
�lª$!��(^o^)�
���
https://pypi.python.org/pypi/miura�
{¯����
���
3.���lª$!�
�l¡�9.���2; MIRA(��
Miura�6Mira������
���
�rep*�/�!��
���
³¨ÁÅPIZSKJU MREP:%�7/�! �
�� Preferred Infrastructure �q�ÊÍ @unnonouno �
=ZGMYit�
mecab-python3:�$&8,'�mecab 0.996��� «0,L<GMXQVEWZ"(�HG�6g98���7�
���
pip install mrep�
�·�PKJÈ���
���
�ÂÇ�7�(����/�!�
※���� �wikipedia���