天天看点

Oozie.java节点

Eclipse

1.oozie.HelloOozie

public class HelloOozie {
		public static void main(String[] args) {
			System.out.println("Hello Oozie!");
		}
	}
           

2.将其导出jar,名称为hellooozie.jar

Hue

1.文件浏览器界面

创建HDFS目录:/user/workflow/lib

上传本地文件:hellooozie.jar(到/user/workflow/lib)

创建HDFS文件:/user/workflow/java/workflow.xml

<workflow-app xmlns="uri:oozie:workflow:0.3" name="mr-wc-wf">
		<start to="mr-node"/>
		<action name="mr-node">
			<java>
				<job-tracker>${jobTracker}</job-tracker>
				<name-node>${nameNode}</name-node>
				<prepare>
					<delete path="${nameNode}/user/path"/>
					<mkdir path="${nameNode}/user/path"/>
				</prepare>
				<configuration>
					<property>
						<name>mapred.job.queue.name</name>
						<value>${queueName}</value>
					</property>
				</configuration>
				<main-class>oozie.HelloOozie</main-class>
			</java>
			<ok to="end"/>
			<error to="fail"/>
		</action>
		<kill name="fail">
			<message>Map/Reduce failed.error message [${wf:errorMessage(${wf:lastErrorNode()})}]</message>
		</kill>
		<end name="end"/>
	</workflow-app>
           

YARN

1.yarn-site.xml中的两处配置加大一点:

1)容器内存:yarn.nodemanager.resource.memory-mb设置为2048

2)最大容器内存:yarn.scheduler.maximum-allocation-mb设置为2048