Java Mailing List Archive

http://www.java2.5341.com/

Home » nutch-user.lucene »

Re: nutch-0.9 and hadoop-0.15.0

ogjunk-nutch

2008-06-09


Author LoginPost Reply
Note that "df -k". That's a UNIX command for checking free disk
space. Maybe that's some old bug from Hadoop 0.15.0. If I were you I
would use Nutch from the trunk/head.

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch


----- Original Message ----
> From: m.harig <m.harig@(protected)>
> To: nutch-dev@(protected)
> Sent: Monday, June 9, 2008 12:17:07 PM
> Subject: nutch-0.9 and hadoop-0.15.0
>
>
> hi all
>
>   i upgraded nutch-0.9 to hadoop-0.15.0 on windows. when i start the crawl
> am getting the following error
> anyone help me what error is this
>
>
> 2008-06-09 15:43:28,906 WARN mapred.LocalJobRunner - job_local_1
> java.io.IOException: CreateProcess: df -k F:\tmp\hadoop-Admin\mapred\local
> error=2
>   at java.lang.ProcessImpl.create(Native Method)
>   at java.lang.ProcessImpl.(ProcessImpl.java:81)
>   at java.lang.ProcessImpl.start (ProcessImpl.java:30)
>   at java.lang.ProcessBuilder.start (ProcessBuilder.java:451)
>   at java.lang.Runtime.exec (Runtime.java:591)
>   at java.lang.Runtime.exec (Runtime.java:464)
>   at org.apache.hadoop.fs.ShellCommand.runCommand(ShellCommand.java:48)
>   at org.apache.hadoop.fs.ShellCommand.run(ShellCommand.java:42)
>   at org.apache.hadoop.fs.DF.getAvailable (DF.java:72)
>   at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:264)
>   at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite (LocalDirAllocator.java:124)
>   at
> org.apache.hadoop.mapred.MapOutputFile.getSpillFileForWrite (MapOutputFile.java:88)
>   at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpillToDisk(MapTask.java:382)
>   at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:604)
>   at org.apache.hadoop.mapred.MapTask.run (MapTask.java:193)
>   at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:132)
> --
> View this message in context:
> http://www.nabble.com/nutch-0.9-and-hadoop-0.15.0-tp17729948p17729948.html
> Sent from the Nutch - Dev mailing list archive at Nabble.com.

©2008 java2.5341.com - Jax Systems, LLC, U.S.A.