ºìÁªLinuxÃÅ»§
Linux°ïÖú

WebMagic 0.4.1·¢²¼£¬JavaÅÀ³æ¿ò¼Ü

·¢²¼Ê±¼ä:2013-11-28 15:59:39À´Ô´:ºìÁª×÷Õß:empast
´Ë´Î¸üмÓÇ¿ÁËAjaxץȡµÄ¹¦ÄÜ£¬²¢½øÐÐÁËһЩ¹¦ÄܸĽø¡£Í¬Ê±ÒýÈëÁËÖØÒªµÄ½Å±¾»¯¹¦ÄÜ"webmagic-script"£¬Îª½ñºóµÄWebMagic-Avalon¼Æ»®×ö×¼±¸¡£

¹¦ÄÜÔöÇ¿£º

ÐÞ¸´ÁËץȡÍêÒ³Ãæºó£¬Spiderż¶ûÎÞ·¨Í˳öµÄÎÊÌâ¡£ÏêϸÎÊÌâµÄ·ÖÎö£¬ÓÐÐËȤµÄ¿ÉÒÔµãÕâÀï²é¿´¡£
½«³éÈ¡ÕýÎĵÄSmartContentSelectorÖеÄËã·¨¸ÄΪ¹þ¹¤´óµÄÕýÎijéÈ¡Ëã·¨https://code.google.com/p/cx-extractor/ £¬¾­¹ý²âÊÔ£¬ÓнϺõÄЧ¹û¡£ ʹÓ÷½·¨£ºHtml.getSmartContent()¡£
ΪPage¼ÓÈëÁ˸ü¶àµÄHttpÐÅÏ¢£¬°üÀ¨http״̬Âë"Page.getStatusCode()"ºÍδ½âÎö¹ýµÄÕýÎÄ"Page.getRawText()"¡£
ΪSpiderÔö¼ÓһЩ¼à¿ØÐÅÏ¢£¬°üÀ¨×¥È¡µÄÒ³ÃæÊý"Spider.getPageCount()"£¬ÔËÐÐ״̬"Spider.getStatus()"ºÍÖ´ÐÐÏß³ÌÊý"Spider.getThreadAlive()"¡£
Ajax·½Ã棬ÔÚ×¢½âģʽ£¬ÒýÈëÁËJsonPath±í´ïʽÀ´½øÐгéÈ¡¡£

JsonPath±í´ïʽµÄº¬Òå¼°¾ßÌåÓ÷¨¿´ÕâÀhttp://www.oschina.net/p/jsonpath

WebMagic½ñºóµÄÄ¿±êÊÇÒ»¸öÍêÕûµÄ²úÆ·£¬Èü´Ê¹²»»á±àÂëµÄÈËÒ²ÄÜͨ¹ý¼òµ¥½Å±¾£¬Íê³É»ù±¾µÄÅÀ³æ¿ª·¢£¬²¢´Ù½ø½Å±¾·ÖÏí¡£Õâ¾ÍÊÇWebMagic-Avalon¼Æ»®¡£´ó¼Ò¿ÉÒԲ鿴https://github.com/code4craft/webmagic/issues/43 ½øÐй¦ÄÜÌÖÂÛ£¬»¶Ó­¸÷ÖÖ½¨Òé¡£

ĿǰµÚÒ»ÆÚÊÇÒª×öµ½½Å±¾»¯£¬¶ÔÓ¦Îĵµ£º

https://github.com/code4craft/webmagic/tree/master/webmagic-scripts

webmagicÓʼþ×飺https://groups.google.com/forum/#!forum/webmagic-java

À´×Ô:¿ªÔ´ÖйúÉçÇø
ÎÄÕÂÆÀÂÛ

¹²ÓÐ 0 ÌõÆÀÂÛ