Hadoop - MapReduce eclipse plugin not pointing to hdfs

-

MapReduce Eclipse plugin not pointing to local file system rather hdfs.


On your first run of WordCount from eclipse -> run on hadoop you may notice the java program uses local file system instead hdfs.

Adding hdfs location in your Configuration object solves this issue. In case of WordCount.java add the below into your main method.


public static void main(String[] args) throws Exception {
Configuration conf = new Configuration();

conf.addResource(new Path(HADOOP_INSTALL+"/conf/core-site.xml"));
conf.addResource(new Path(HADOOP_INSTALL+"/conf/hdfs-site.xml"));

}

Comments

Post a Comment

Popular posts from this blog

Ubuntu / kubuntu - Laptop key board cursor jumping issue

-
Image
Ubuntu cursor jumping problem Issue : When you type in Ubuntu/Kubuntu you may get annoyed by cursor jumping here and there in the screen. This happens across all the applications. You might have tried adjusting key board settings, key stroke speed etc. But this is not related to your key board, but the touch pad! Cause: The cause of this issue is your touch pad. Yes, while typing parts of your hand/fingers often touch the keyboard. In windows this touch will not be deducted while typing. But for Ubuntu it is.  So when you type something and un-intentionally unknowingly touch your touch pad will take your cursor to the appropriate mouse position with respect to your touch forgetting you are typing something!!! Solution: Simple. Say your touch pad not to care the touches while I am eagerly typing something important.. How to say that? Open Synaptix Touch pad manager  Check Automatically switch of touch pad on keyboard activity Time to wait before switching touc
More posts »

SVN File Creation Date

-
SVN Find File creation date. @echo off  REM Thi batch files iterates over svn to print first verison of files REM that is exactly when a file is added into svn set file=%1 if [%file%] == [] (   echo Usage: "%0 <file>"   exit /b ) rem first revision as full text for /F "tokens=1" %%R in ('" svn ls -R %file%"') do ( IF NOT EXIST %%R\NUL (                 @echo %%R                 svn log -r 1:HEAD -l 1 %%R  -q                 ) )
More posts »

XML to Java code generation

-
Image
 XML to Java code generation using CASTOR and JAXB This tutorial explains the code generation from xml to java by using Castor and JAXB in brief.  Procedure   Generate XSD from XML using CASTOR   Generate Java objects from XSD JAXB. http://castor.codehaus.org/  Each of the steps in detail below. XSD Generation    There are lot of tools available to generate XSD from XML including a few online tools. CASTOR is one such tool can be used to generate XSD form XML. Castor is the Open Source data binding framework for Java. Mainly it consists of two features Castor XML and Castor JDO. Download and install castor from http://castor.codehaus.org/ The Castor JARs, docs, DTDs, command line tools, and examples can be downloaded from http://dist.codehaus.org/castor/1.3.3-RC1/castor-1.3.3-RC1.tgz     XML Instance to Schema Follow the below steps to generate Schema from XML. Open command prompt Java_home should point to java install directory Set
More posts »