Skip to content

datanode job from hadoop/1

Github source: c1538147 or master branch

Properties

datanode

data_dir

Directory where DataNodes should store the blocks

Default
/var/vcap/store/hadoop/hdfs/dn

http_port

Datanode HTTP port

Default
50075

ipc_port

Datanode IPC port

Default
8010

port

Datanode port

Default
50010

dfs

address

HDFS address

blocksize

HDFS default block size

Default
1.34217728e+08

checkpoint_size

Default
0.5

max_replication

HDFS maximum replication

Default
50

port

HDFS port

Default
8020

replication

HDFS replication

Default
3

trash_interval

HDFS Trash interval

Default
1440

ganglia

mond

address

Ganglia mond master address

port

Ganglia mond port

Default
8649

journalnode

edits_dir

Directory where JournalNode should store the edits and other local state

Default
/var/vcap/store/hadoop/hdfs/jn

http_port

Journalnode HTTP port

Default
8480

namenode

checkpoint_dir

Directory where SecondaryNameNode should store the checkpoint image

Default
/var/vcap/store/hadoop/hdfs/snn

checkpoint_edits_dir

Directory where SecondaryNameNode should store the temporary edits to merge

Default
/var/vcap/store/hadoop/hdfs/nns

handler_count

The number of server threads for the namenode

Default
100

http_port

Namenode HTTP port

Default
50070

https_port

Namenode HTTPS port

Default
50470

name_dir

Directory where NameNode should store the file system image

Default
/var/vcap/store/hadoop/hdfs/nn

secondarynamenode

http_port

Secondary Namenode HTTP port

Default
50090

Templates

Templates are rendered and placed onto corresponding instances during the deployment process. This job's templates will be placed into /var/vcap/jobs/datanode/ directory (learn more).

  • bin/datanode_ctl (from bin/datanode_ctl)
  • config/commons-logging.properties (from config/commons-logging.properties)
  • config/core-site.xml (from config/core-site.xml.erb)
  • config/hadoop-env.sh (from config/hadoop-env.sh)
  • config/hadoop-metrics2.properties (from config/hadoop-metrics2.properties.erb)
  • config/hadoop-policy.xml (from config/hadoop-policy.xml)
  • config/hdfs-site.xml (from config/hdfs-site.xml.erb)
  • config/log4j.properties (from config/log4j.properties)
  • config/slaves (from config/slaves)
  • data/properties.sh (from data/properties.sh.erb)

Packages

Packages are compiled and placed onto corresponding instances during the deployment process. Packages will be placed into /var/vcap/packages/ directory.