ºìÁªLinuxÃÅ»§
Linux°ïÖú
µ±Ç°Î»ÖÃ: ºìÁªLinuxÃÅ»§ > Ubuntu

ÔÚEclipse3.3ÏÂÔËÐÐNutch 0.9(½â¾öGenerator: 0ÎÊÌâ)

·¢²¼Ê±¼ä:2008-08-31 16:03:26À´Ô´:ºìÁª×÷Õß:qdtantao
Platform: Ubuntu 7.04, JDK 1.6.3, Nutch 0.9, Eclipse 3.3

1¡¢ Nutch 0.9 with Eclipse 3.3 in Ubuntu

²Î¿´NutchµÄ¹Ù·½Îĵµ £¬ÀïÃæËµµÃºÜÏêϸÁË£¬ÕâÀï²»ÔÚ׸Êö¡£

2¡¢µ¼ÈëhadoopµÄÔ´´úÂëºÍ£¬¿É·½±ãÔÚEclipseÖе÷ÊÔ´úÂëºÍ²é¿´APIÎĵµ¡£¾ßÌå·½·¨ÈçÏ£º

Project properties--> Java Build Path-->Libraries-->hadoop-0.12.2-core.jar£¬µã»÷Ç°ÃæÈý½Ç·ûºÅ£¬Õ¹¿ª±à¼­ Source attachment , Ñ¡ÔñhadoopÏàÓ¦°æ±¾µÄsrc ¡£

3¡¢ ÅäÖÃNative-hadoop Library£¬¿ÉÒÔÌá¸ßÔËÐÐЧÂÊ£¬µ«Êǵ÷ÊÔ»·¾³Ï¹ØÏµ²»´ó£¬²»ÅäÖÃÒ²¿É¡£

Project properties--> Java Build Path-->Libraries-->hadoop-0.12.2-core.jar£¬µã»÷Ç°ÃæÈý½Ç·ûºÅ£¬Õ¹¿ª ±à¼­ Native library location£¬¼ÓÈënutch-0.9/lib/native/Linux-i386-32 ¼´¿É¡£

4¡¢½â¾ö ¡°Generator: 0 records selected for fetching, exiting ...¡±ÎÊÌâ

¾­¹ýÉÏÃæµÄÅäÖã¬ÒѾ­¿ÉÒÔÔÚEclipse»·¾³ÖÐÆô¶¯NutchÁË£¬µ«ÊdzÌÐòÈ´²»ÄÜÕý³£ÔËÐУ¬¶ø³öÏÖÒ»¸ö "Generator: 0 records selected for fetching, exiting ..."±¨¸æ£¬³ÌÐòÖÕÖ¹¡£

¾­¹ýµ÷ÊÔ£¬ ·¢ÏÖÔËÐе½ Generator.java:424 :

ÒýÓÃ:
if (readers == null || readers.length == 0 || !readers[0].next(
new FloatWritable())) {


LOG.warn("Generator: 0 records selected for fetching, exiting ..."); ÓÉÓÚ readers[0].next( new FloatWritable() )Ϊfalse¶øµ¼Ö¸ôíÎóµÄ³öÏÖ¡£ÍøÉÏÏà¹ØÎÄÕÂÌá³öÊÊÓÃNUTCH-503½â¾ö¸ÃÎÊÌ⣬µ«ÊǸò¹¶¡Õë¶ÔµÄÊÇ·Ö²¼Ê½²¿Êðʱ³öÏÖµÄÎÊÌ⣬ÔÚÕâÀï²¢²»ÊÊÓ㬶øÇÒ¾­²âÊÔÒ²²»Äܽâ¾öÎÊÌâ¡£

½â¾ö·½·¨£º½«tmp_build£¬Ò²¾ÍÊÇÏîÄ¿µÄĬÈÏÊä³öĿ¼(default output folder)Ï嵀 nutch-site.xml Îļþɾµô »òÕß½«¸ÃÎļþÖÐÏÂÁÐÊôÐÔ×¢Ê͵ô¡£

ÒýÓÃ:

plugin.includes
.*
Enable all plugins during unit testing.
ÎÄÕÂÆÀÂÛ

¹²ÓÐ 0 ÌõÆÀÂÛ