Sam的程式筆記

  • About Me
  • Archive
  • feeds

Posts match “ hadoop ” tag:

about 9 years ago

Hadoop 2 完全分佈式 安裝步驟

已經有新版本的安裝練習了可以參考新的
Hadoop2.6偽分佈式安裝

0.準備軟體&環境

CentOS-6.5-i386-bin-DVD1.iso
jdk-6u45-linux-i586.bin
hadoop-2.2.0.tar.gz

虛擬機四台,如下

電腦名稱 IP 執行的服務
master 192.168.200.101 NameNode、SecondaryNameNode、ResourceManager
slave1 192.168.200.102 DataNode、NodeManager
slave2 192.168.200.103 DataNode、NodeManager
slave3 192.168.200.104 DataNode、NodeManager

因為裝在64位元系統上會有要不要重新編譯的問題,所以這邊僅用32位元安裝
參考來源

Read on →
  • hadoop
  • YARN
  • V2
  • December 26, 2013 16:33
  • Permalink
  • Comments
 
about 9 years ago

Hadoop 2 完全分佈式安裝 HBase Zookeeper

延續前一篇請看這邊 安裝 Hadoop 2.2 完全分布式

0.準備軟體&環境

zookeeper-3.4.5.tar.gz
hbase-0.96.1.1-hadoop2-bin.tar.gz

虛擬機四台加上之前運行的Hadoop,架構上如下

電腦名稱 IP Hadoop的服務 Zookeeper的服務 HBase的服務
master 192.168.200.101 NameNode、SecondaryNameNode、ResourceManager QuorumPeerMain HMaster
slave1 192.168.200.102 DataNode、NodeManager X HRegionServer
slave2 192.168.200.103 DataNode、NodeManager X HRegionServer
slave3 192.168.200.104 DataNode、NodeManager X HRegionServer
Read on →
  • hadoop
  • Zookeeper
  • hbase
  • fully-distributed
  • December 27, 2013 18:14
  • Permalink
  • Comments
 
about 9 years ago

用Eclipse開發HBase應用程式

如果你也安裝完這兩篇完全分佈式安裝Hadoop、完全分佈式安裝Zookeeper與HBase

那接下來可以開發HBase的應用程式了

0 準備軟體&環境

Eclipse Java EE IDE for Web Developers. Version: Kepler Release 下載去
hbase-0.96.1.1-hadoop2-bin.tar.gz 下載去

Read on →
  • hadoop
  • hbase
  • eclipse
  • January 03, 2014 10:27
  • Permalink
  • Comments
 
almost 9 years ago

Mahout 0.9 安裝 驗證 記錄

練習安裝Mahout跟驗證

1.準備環境

CentOS-6.5-x64
jdk-6u45-linux-i586.bin
hadoop-2.2.0.tar.gz
可參考之前安裝Hadoop完全分散式

2.安裝 Mahout 0.9

使用hduser帳戶

sudo wget http://apache.osuosl.org/mahout/0.9/mahout-distribution-0.9.tar.gz
sudo tar zxvf mahout-distribution-0.9.tar.gz
export MAHOUT_HOME=/opt/mahout-distribution-0.9
export PATH=$MAHOUT_HOME/bin:$PATH
Read on →
  • hadoop
  • mahout
  • April 06, 2014 01:08
  • Permalink
  • Comments
 
about 8 years ago

Spark teaching (1) -Hadoop2.6 installation

這次練習用Hadoop2.6來安裝
安裝後看起來也可以正常跑在x64上,因為沒有出現錯誤提示
OS:CentOS 7
JDK:8u25
Hadoop:2.6

Read on →
  • hadoop
  • YARN
  • 2.6
  • January 15, 2015 12:55
  • Permalink
  • Comments
 
about 8 years ago

Spark teaching (2) -Spark1.2 installation

Spark1.2.0 for Hadoop 2.4 or later的版本安裝
Spark安裝比Hadoop簡單很多,但是要記得先安裝Scala啊

Read on →
  • hadoop
  • Spark
  • January 16, 2015 23:52
  • Permalink
  • Comments
 

Copyright © 2013 samchu . Powered by Logdown.
Based on work at subtlepatterns.com.