OSTeching
  • About

Hadoop启动陷阱

By Julian Zhu On February 3, 2012 · Leave a Comment

最近在CentOS 6.2 上搭建了Hadoop-1.0.0 测试环境,遇到了很多地雷。这里记录下Hadoop 环境搭建的陷阱,以后少走完路,陆续补充中:

0/ ssh 无密码登录
注意authoried_keys 权限是 0600,否则一直提示输入密码

1/  修改主机名,不要用localhost
注意同时修改 /etc/hosts 和 /etc/sysconfig/network,否则不能远程启动data node

2/ 注意把所有节点都加入到/etc/hosts
否则ssh 会报警,不能启动
提示信息是 reverse mapping checking getaddrinfo for xxx [192.168.1.133] failed – POSSIBLE BREAK-IN ATTEMPT!

3/ hdfs 工作目录 name 和data 的权限要是755

4/ 关闭部署机的防火墙
否则mapred 不能启动,任务不能提交

5/ 注意直执行./hadoop namenode -format 一次
[...]

Continue Reading →
  • Recent Posts

    • Hadoop启动陷阱
    • SLF4J MDC and Marker
    • Lite-Mongo a very thin wrapper of MongoDB Java Driver
    • What is the better mobile phone contacts
    • 移动互联网时代手机能干什么
    • Small talk about SOA
    • Scala flexible syntax: bad or good
    • Tricks to extend your own Tuscany Binding
    • 中小企业如何开展SOA
    • 闻名不如见面-南山坡专题技术讨论活动
  • Recent Comments

    • Ken on SLF4J MDC and Marker
    • Ken on SLF4J MDC and Marker
  • Categories

    • ESB
    • Essays
    • Hadoop
    • JEE
    • Mobile Internet
    • NoSQL
    • OSGi
    • SCA
    • Scala
    • Scrum
    • SOA
  • Archives

    • February 2012 (1)
    • December 2011 (1)
    • August 2011 (1)
    • April 2011 (1)
    • March 2011 (1)
    • January 2011 (14)
  • Links

    • Jackyrong
    • Rosen
    • 牛开B
    • 颠覆软件
    • 龙居
"ok, ask for an offer, seriously," — julian0zzx

OSTeching

Pages

  • About

The Latest

  • Hadoop启动陷阱
    最近在CentOS 6.2 上搭建了Hadoop-1.0.0 测试环境,遇到了很多地雷。这里记录下Hadoop 环境搭建的陷阱,以后少走完路,陆续补充中: 0/ ssh 无密码登录 注意authoried_keys 权限是 0600,否则一直提示输入密码 1/ […]

More

Creative Commons License
© 2006~2012 OSTeching
Platform by PageLines