shell小工具檢視Hadoop中System.out輸出的日志

#!/bin/bash

rm ~/log.log

echo "Please Input JobID:"

read NAME

map_log="/home/grid/hadoop-1.2.1/logs/userlogs/${NAME}/attempt_${NAME#*job_}_m_000000_0/stdout"

red_log="/home/grid/hadoop-1.2.1/logs/userlogs/${NAME}/attempt_${NAME#*job_}_r_000000_0/stdout"

echo "=========================================START=====================================" >> log.log

echo "Map:" >> log.log

cat $map_log >> log.log

echo "Reduce:" >> log.log

cat $red_log >> log.log

echo "==========================================END======================================" >> log.log

cat log.log

使用說明：

1.需要輸入JobID，如：job_201407121609_0029

2.需要修改map_log和red_log這兩個變量的值，以便适用于本機

3.注意：在JOB所在的機器運作，否則會報找不到目錄