当前位置: 代码迷 >> Eclipse >> Mac环境下Hadoop与Eclipse的集成(二)
  详细解决方案

Mac环境下Hadoop与Eclipse的集成(二)

热度:124   发布时间:2016-04-22 23:50:45.0
Mac环境下Hadoop与Eclipse的集成(2)

在这一节中我们来说一下应该怎样把Hadoop集成到Eclipse中的,在官方中提供的有相关插件来集成eclipse的,但都是对Hadoop1.x的集成,下面我们进行自己适合版本的插件的生成。

如图:

为了能够自定义插件,我们需要hadoop2.x的插件的源码包,hadoop2x-eclipse-plugin-master.zip这个源码包在网上不太容易找到,在这里提供下载。

1、解压下载后的源码包

2、cd src/contrib/eclipse-plugin,进入到eclipse-plugin目录

3、删除掉这个目录下的ivy和ivy.xml这两个文件

4、修改build.xml文件,如下修改property的前5处配置

<?xml version="1.0" encoding="UTF-8" standalone="no"?> <!--   Licensed to the Apache Software Foundation (ASF) under one or more   contributor license agreements.  See the NOTICE file distributed with   this work for additional information regarding copyright ownership.   The ASF licenses this file to You under the Apache License, Version 2.0   (the "License"); you may not use this file except in compliance with   the License.  You may obtain a copy of the License at        http://www.apache.org/licenses/LICENSE-2.0    Unless required by applicable law or agreed to in writing, software   distributed under the License is distributed on an "AS IS" BASIS,   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.   See the License for the specific language governing permissions and   limitations under the License.--> <project default="jar" name="eclipse-plugin">     <property name="jdk.home" value="/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home />    <property name="hadoop.version" value="2.2.0" />    <property name="hadoop.home" value="/usr/local/soft/hadoop-2.2.0" />    <property name="eclipse.version" value="3.8" />    <property name="eclipse.home" value="/Applications/adt-bundle/eclipse" />    <property name="root" value="${basedir}" />    <property file="${root}/build.properties" />    <property name="name" value="${ant.project.name}" />    <property name="src.dir" location="${root}/src" />    <property name="build.contrib.dir" location="${root}/build/contrib" />    <property name="build.dir" location="${build.contrib.dir}/${name}" />    <property name="build.classes" location="${build.dir}/classes" />    <property name="javac.deprecation" value="off" />    <property name="javac.debug" value="on" />    <property name="build.encoding" value="UTF-8" />         <path id="eclipse-sdk-jars">        <fileset dir="${eclipse.home}/plugins/">            <include name="org.eclipse.ui*.jar" />        <include name="org.eclipse.jdt*.jar" />        <include name="org.eclipse.core*.jar" />        <include name="org.eclipse.equinox*.jar" />        <include name="org.eclipse.debug*.jar" />        <include name="org.eclipse.osgi*.jar" />        <include name="org.eclipse.swt*.jar" />        <include name="org.eclipse.jface*.jar" />        <include name="org.eclipse.team.cvs.ssh2*.jar" />        <include name="com.jcraft.jsch*.jar" />            </fileset>    </path>         <path id="project-jars">        <fileset file="${build.dir}/lib/*.jar" />    </path>         <target name="init" unless="skip.contrib">        <echo message="contrib: ${name}" />        <mkdir dir="${build.dir}" />        <mkdir dir="${build.classes}" />        <mkdir dir="${build.dir}/lib" />        <copy todir="${build.dir}/lib/" verbose="true">            <fileset dir="${hadoop.home}/share/hadoop/mapreduce">            <include name="hadoop*.jar" />            <exclude name="*test*" />            <exclude name="*example*" />        </fileset>        <fileset dir="${hadoop.home}/share/hadoop/common">            <include name="hadoop*.jar" />            <exclude name="*test*" />            <exclude name="*example*" />        </fileset>        <fileset dir="${hadoop.home}/share/hadoop/hdfs">            <include name="hadoop*.jar" />            <exclude name="*test*" />            <exclude name="*example*" />        </fileset>        <fileset dir="${hadoop.home}/share/hadoop/yarn">            <include name="hadoop*.jar" />            <exclude name="*test*" />            <exclude name="*example*" />        </fileset>        <fileset dir="${hadoop.home}/share/hadoop/common/lib">            <include name="protobuf-java-*.jar" />            <include name="log4j-*.jar" />            <include name="commons-cli-*.jar" />            <include name="commons-collections-*.jar" />            <include name="commons-configuration-*.jar" />            <include name="commons-lang-*.jar" />            <include name="jackson-core-asl-*.jar" />            <include name="jackson-mapper-asl-*.jar" />            <include name="slf4j-log4j12-*.jar" />            <include name="slf4j-api-*.jar" />            <include name="guava-*.jar" />            <include name="hadoop-annotations-*.jar" />            <include name="hadoop-auth-*.jar" />            <include name="commons-cli-*.jar" />            <include name="netty-*.jar" />        </fileset>        </copy>    </target>    <target name="compile" depends="init" unless="skip.contrib">        <echo message="contrib: ${name}" />        <javac fork="true" executable="${jdk.home}/bin/javac" encoding="${build.encoding}" srcdir="${src.dir}" includes="**/*.java" destdir="${build.classes}" debug="${javac.debug}" deprecation="${javac.deprecation}" includeantruntime="on">            <classpath refid="eclipse-sdk-jars" />            <classpath refid="project-jars" />        </javac>    </target>        <target name="jar" depends="compile" unless="skip.contrib">        <pathconvert property="mf.classpath" pathsep=",lib/">        <path refid="project-jars" />            <flattenmapper />        </pathconvert>        <jar jarfile="${build.dir}/hadoop-${hadoop.version}-eclipse-${eclipse.version}-plugin.jar" manifest="${root}/META-INF/MANIFEST.MF">        <manifest>            <attribute name="Bundle-ClassPath" value="classes/,lib/${mf.classpath}" />        </manifest>        <fileset dir="${build.dir}" includes="classes/ lib/" />        <fileset dir="${root}" includes="resources/ plugin.xml" />        </jar>    </target>    <target name="clean">        <echo message="contrib: ${name}" />        <delete dir="${build.dir}" />    </target></project>

5、在这个build.xml文件所在的目录中运行ant jar


6、把生成的插件命名为hadoop-eclipse-plugin-2.2.0.jar,并复制到eclipse安装目录的plugins中,并重新打开eclipse

7、配置eclipse中的hadoop


  相关解决方案