Professional Documents
Culture Documents
What types ?
Configuration
www.semtech-solutions.co.nzinfo@semtech-solutions.co.nz
User commands
Administration commands
Generic options for all commands Configuration options
Environment
www.semtech-solutions.co.nzinfo@semtech-solutions.co.nz
www.semtech-solutions.co.nzinfo@semtech-solutions.co.nz
lsr recursive ls
www.semtech-solutions.co.nzinfo@semtech-solutions.co.nz
www.semtech-solutions.co.nzinfo@semtech-solutions.co.nz
www.semtech-solutions.co.nzinfo@semtech-solutions.co.nz
www.semtech-solutions.co.nzinfo@semtech-solutions.co.nz
www.semtech-solutions.co.nzinfo@semtech-solutions.co.nz
Hadoop Environment
See the .bashrc for environment set up
##export HADOOP_HOME=/usr/local/hadoop ## deprecated export HADOOP_PREFIX=/usr/local/hadoop export JAVA_HOME=/usr/lib/jvm/java-6-openjdk-i386 unalias hfs &> /dev/null alias hfs="hadoop fs" unalias hls &> /dev/null ; alias hls="hfs -ls" unalias hup1 &> /dev/null ; alias hup1="cd $HADOOP_PREFIX/bin ; ./start-dfs.sh" unalias hup2 &> /dev/null ; alias hup2="cd $HADOOP_PREFIX/bin ; ./start-mapred.sh" unalias hdwn1 &> /dev/null ; alias hdwn1="cd $HADOOP_PREFIX/bin ; ./stop-mapred.sh" unalias hdwn2 &> /dev/null ; alias hdwn2="cd $HADOOP_PREFIX/bin ; ./stop-dfs.sh" # if using LZO compression then add entry here for viewing # LZO compressed files ##PATH=$PATH:$HADOOP_HOME/bin PATH=$PATH:$HADOOP_PREFIX/bin PATH=$PATH:$JAVA_HOME/bin export PATH ## deprecated
www.semtech-solutions.co.nzinfo@semtech-solutions.co.nz
Hadoop Configuration
Initial set up in
core-site.xml hdfs-site.xml
mapred-site.xml
<property> <name>hadoop.tmp.dir</name> <value>/app/hadoop/tmp</value> <description>A base for other temporary directories.</description> </property>
www.semtech-solutions.co.nzinfo@semtech-solutions.co.nz
Contact Us
www.semtech-solutions.co.nz
info@semtech-solutions.co.nz