Hadoop的JavaAPI

2022/4/24 9:42:35

本文主要是介绍Hadoop的JavaAPI,对大家解决编程问题具有一定的参考价值,需要的程序猿们随着小编来一起学习吧!

1.配置winutil的环境变量

然后在Path变量中加入

 

 

 

2.测试

创建一个普通的Java工程测试

FileSystem fs = null;
    
    @Before
    public void init() throws Exception{
        fs = FileSystem.get(new URI("hdfs://itcast01:9000"), new Configuration(), "root");
    }
    
    @Test
    public void testUpload() throws Exception{
        InputStream in = new FileInputStream("/root/install.log");
        OutputStream out = fs.create(new Path("/log123.log"));
        IOUtils.copyBytes(in, out, 1024, true);
    }
    
    @Test
    public void testMkdir() throws IllegalArgumentException, IOException{
        boolean  flag = fs.mkdirs(new Path("/a/aa"));
        System.out.println(flag);
    }
    
    @Test
    public void testDel() throws IllegalArgumentException, IOException{
        boolean flag = fs.delete(new Path("/a"), true);
        System.out.println(flag);
    }
    
    
    
    public static void main(String[] args) throws Exception {
        FileSystem fs = FileSystem.get(new URI("hdfs://itcast01:9000"), new Configuration());
        InputStream in = fs.open(new Path("/jdk"));
        OutputStream out = new FileOutputStream("/home/jdk1.7.tar.gz");
        IOUtils.copyBytes(in, out, 4096, true);
        
    }

3.处理Java连不上hdfs

①删除tmp(路径是个人安装在linux系统中hadoop下的tmp文件)

 

②修改配置修改namenode的地址为具体IP(之前写的localhost) 修改slaves文件,为具体IP   ③格式化hdfshadoopnamenode–format    

 



这篇关于Hadoop的JavaAPI的文章就介绍到这儿,希望我们推荐的文章对大家有所帮助,也希望大家多多支持为之网!


扫一扫关注最新编程教程