ºìÁªLinuxÃÅ»§
Linux°ïÖú

Pholcus 0.7.3·¢²¼£¬GoÅÀ³æÈí¼þ

·¢²¼Ê±¼ä:2015-10-21 09:11:35À´Ô´:ºìÁª×÷Õß:empast
Pholcus 0.7.3 ·¢²¼£¬¸üÐÂÄÚÈÝÈçÏ£º

È«ÃæÉý¼¶
Ò»¡¢½çÃæÉý¼¶£º
1. WindowsϱàÒëʱ×Ô¶¯Ìí¼Óͼ±ê
2. web¼°cmd°æµÄÃüÁîÐд°¿ÚÌí¼ÓÈí¼þÃû³Æ

¶þ¡¢ÏÂÔØÆ÷Ïà¹ØÉý¼¶£º
1. ³õ²½Ôö¼ÓPhantomJSÏÂÔØÆ÷£¬ÊµÏÖË«ÏÂÔØÒýÇæ£¬¿ÉÔÚÇëÇóÖÐÖ¸¶¨
2. ÏÂÔØ¿ØÖÆ×ªÒÆÖÁRequestÖУ¬´Ó¶øÏÂÔØ¸üÁé»î
3. RequestÔö¼ÓÖØ¶¨ÏòÌø×ª´ÎÊý¿ØÖƹ¦ÄÜ
4. Request¿ÉÒÔÖ§³ÖÎÞÏÞÖØÔØ
5. RequestÔö¼ÓÐòÁл¯·½·¨
6. ÏÂÔØÆ÷ʵÀý¸ÄΪȫ¾ÖΨһ

Èý¡¢¹æÔòÓï·¨Éý¼¶£º
1. Îı¾½á¹ûÊä³ö·½·¨¸ÄΪOutput(ruleName string, resp context.Response, item interface{})
2. ÎļþÊä³ö·½·¨½¨ÒéÓÃFileOutput(resp *context.Response, name ...string)
3. ¸ü¸Ä½âÎöº¯ÊýParse(resp *context.Response, ruleName ...string)£¬ruleNameΪ¿Õʱµ÷ÓÃRootº¯Êý
4. OutFeild()·½·¨¸ÄΪIndexOutFeild()
5. Spider½á¹¹ÌåÐÂÔöCreatItem(ruleName string, item map[int]interface{}) map[string]interface{}£¬½«mapË÷Òý×Ô¶¯×ª»»ÎªOutFeild×Ö¶Î
6. Spider½á¹¹ÌåÐÂÔö´úÀí·þÎñÆ÷Áбí
6. AddQueue()½ÓÊÕRequest²ÎÊý£¬UseCookie¸ÄΪEnableCookie
7. ¹æÔò·½·¨¿âÖÐÉý¼¶timer¼ÆÊ±Æ÷

ËÄ¡¢Êý¾Ý¿â²Ù×÷Éý¼¶£º
1. ÓÅ»¯¸üÐÂmongodb²Ù×÷·½·¨¿â
2. Êý¾Ý¿âÁ¬½Ó³ØÔö¼Ó¿ÕÏÐÁ¬½Ó¶¨Ê±»ØÊÕ

Pholcus£¨ÓÄÁéÖ룩ÊÇÒ»¿î´¿GoÓïÑÔ±àдµÄÖØÁ¿¼¶ÅÀ³æÈí¼þ£¬ÇåеÄGUI½çÃæ£¬ÓÅÑŵÄÅÀ³æ¹æÔò¡¢¿É¿ØµÄ¸ß²¢·¢¡¢ÈÎÒâµÄÅúÁ¿ÈÎÎñ¡¢¶àÖÖÊä³ö·½Ê½¡¢´óÁ¿Demo£¬Ö§³Öºá×ÝÏòÁ½ÖÖץȡģʽ£¬Ö§³ÖÄ£ÄâµÇ¼ºÍÈÎÎñÈ¡ÏûµÈ£¬²¢ÇÒ¿¼ÂÇÁËÖ§³Ö·Ö²¼Ê½²¼¾Ö¡£

ÏÂÔØµØÖ·£ºhttps://github.com/henrylee2cn/pholcus/releases/tag/v0.7.3

À´×Ô:¿ªÔ´ÖйúÉçÇø
ÎÄÕÂÆÀÂÛ

¹²ÓÐ 0 ÌõÆÀÂÛ