Win7: win7出现卡顿如何解决

2020-12-24 02:27

阅读:749

标签:本地   ctf   文件   任务计划   现在   ffffff   管理   郑州   http   

一、Hadoop集群安装

1. 环境准备

(1) 准备三台机器:hadoop0(192.168.11.10)、hadoop1(192.168.11.11)、hadoop2(192.168.11.12)

技术图片

 (2)每台机器安装好JAVA环境以及SSH打通(SSH免密登录;关闭防火墙)

2. 下载Hadoop安装包 并解压至相关目录

3. 配置Hadoop相关配置文件

(1)hadoop-env.sh 添加Java环境变量

export JAVA_HOME=/home/vagrant/share/jdk1.8.0_211

(2)core-site.xml

configuration>
        property>
                name>fs.defaultFSname>
                value>hdfs://hadoop0:9000value>
        property>
        property>
                name>io.file.buffer.sizename>
                value>131072value>
        property>
        property>
                name>hadoop.tmp.dirname>
                value>file:/home/vagrant/share/hadoop-2.9.2/tmpvalue>
        property>
        property>
                name>hadoop.proxyuser.root.hostsname>
                value>*value>
        property>
        property>
                name>hadoop.proxyuser.root.groupsname>
                value>*value>
        property>
configuration>

(3)hdfs-site.xml

configuration>
        property>
                name>dfs.namenode.secondary.http-addressname>
                value>hadoop0:9001value>
        property>
        property>
                name>dfs.namenode.name.dirname>
                value>file:/home/vagrant/share/hadoop-2.9.2/dfs/namevalue>
        property>
        property>
                name>dfs.datanode.data.dirname>
                value>file:/home/vagrant/share/hadoop-2.9.2/dfs/datavalue>
        property>
        property>
                name>dfs.replicationname>
                value>2value>
        property>
        property>
                name>dfs.webhdfs.enabledname>
                value>truevalue>
        property>
        property>
                name>dfs.permissionsname>
                value>falsevalue>
        property>
        property>
                name>dfs.web.uginame>
                value>supergroupvalue>
        property>
configuration>

(4)mapred-site.xml

configuration>
        property>
                name>mapreduce.framework.namename>
                value>yarnvalue>
        property>
        property>
                name>mapreduce.jobhistory.addressname>
                value>hadoop0:10020value>
        property>
        property>
                name>mapreduce.jobhistory.webapp.addressname>
                value>hadoop0:19888value>
        property>
configuration>

(5)yarn-site.xml

configuration>
        property>
                name>yarn.nodemanager.aux-servicesname>
                value>mapreduce_shufflevalue>
        property>
        property>
                name>yarn.nodemanager.aux-services.mapreduce.shuffle.classname>
                value>org.apache.hadoop.mapred.ShuffleHandlervalue>
        property>
        property>
                name>yarn.resourcemanager.addressname>
                value>hadoop0:8032value>
        property>
        property>
                name>yarn.resourcemanager.scheduler.addressname>
                value>hadoop0:8030value>
        property>
        property>
                name>yarn.resourcemanager.resource-tracker.addressname>
                value>hadoop0:8031value>
        property>
        property>
                name>yarn.resourcemanager.admin.addressname>
                value>hadoop0:8033value>
        property>
        property>
                name>yarn.resourcemanager.webapp.addressname>
                value>hadoop0:8088value>
        property>
configuration>

(6)slaves

hadoop1
hadoop2

配置完成以上几个配置文件之后,将其拷贝至另外两台机器。

4.启动Hadoop集群

(1)执行命令格式化name node:./bin/hadoop namenode -format

(2)启动Hadoop:./sbin/start-all.sh

(3)jps查看每个机器进程情况

 - 主节点

   NameNode
   SecondaryNameNode
   ResourceManager

 -从节点

   DataNode
   NodeManager

5. 问题

(1)tmp/nm-local-dir is not a valid path. Path should be with file scheme or without schem

  解决:使用hadoop默认的tmp目录

Win7: win7出现卡顿如何解决

标签:本地   ctf   文件   任务计划   现在   ffffff   管理   郑州   http   

原文地址:https://www.cnblogs.com/penguin0601/p/13470313.html


评论


亲,登录后才可以留言!