Skip to content

historyserver job from hadoop/1

Github source: c1538147 or master branch

Properties

dfs

address

HDFS address

checkpoint_size

Default
0.5

port

HDFS port

Default
8020

trash_interval

HDFS Trash interval

Default
1440

ganglia

mond

address

Ganglia mond master address

port

Ganglia mond port

Default
8649

jobhistory

address

JobHistory address

port

JobHistory port

Default
10020

webapp_port

JobHistory webapp port

Default
19888

mapreduce

map_java_opts

MapReduce map java opts

Default
-Xmx1024M

reduce_java_opts

MapReduce reduce java opts

Default
-Xmx2560M

namenode

checkpoint_dir

Directory where SecondaryNameNode should store the checkpoint image

Default
/var/vcap/store/hadoop/hdfs/snn

checkpoint_edits_dir

Directory where SecondaryNameNode should store the temporary edits to merge

Default
/var/vcap/store/hadoop/hdfs/nns

nodemanager

port

Nodemanager port

Default
45454

resource_cpu_vcores

Nodemanager resource cpu vcores

Default
8

resource_memory_mb

Nodemanager resource memory mb

Default
8192

vmem_pmem_ratio

Nodemanager vmem-pmem-ratio

Default
2.1

resourcemanager

address

Resourcemanager address

admin_port

Resourcemanager admin port

Default
8141

port

Resourcemanager port

Default
8050

resource_tracker_port

Resourcemanager resource tracker port

Default
8025

scheduler_port

Resourcemanager scheduler port

Default
8030

webapp_port

Resourcemanager webapp port

Default
8088

yarn

local_dir

Directory where YARN should store temporary data

Default
/var/vcap/store/hadoop/yarn/local

local_log_dir

Directory where YARN should store container log data

Default
/var/vcap/store/hadoop/yarn/log

scheduler_minimum_allocation_mb

Default
1024

scheduler_minimum_allocation_vcores

Default
1

Templates

Templates are rendered and placed onto corresponding instances during the deployment process. This job's templates will be placed into /var/vcap/jobs/historyserver/ directory (learn more).

  • bin/historyserver_ctl (from bin/historyserver_ctl)
  • config/capacity-scheduler.xml (from config/capacity-scheduler.xml)
  • config/commons-logging.properties (from config/commons-logging.properties)
  • config/container-executor.cfg (from config/container-executor.cfg.erb)
  • config/core-site.xml (from config/core-site.xml.erb)
  • config/hadoop-env.sh (from config/hadoop-env.sh)
  • config/hadoop-metrics2.properties (from config/hadoop-metrics2.properties.erb)
  • config/hadoop-policy.xml (from config/hadoop-policy.xml)
  • config/log4j.properties (from config/log4j.properties)
  • config/mapred-queue-acls.xml (from config/mapred-queue-acls.xml)
  • config/mapred-site.xml (from config/mapred-site.xml.erb)
  • config/yarn-site.xml (from config/yarn-site.xml.erb)
  • data/properties.sh (from data/properties.sh.erb)

Packages

Packages are compiled and placed onto corresponding instances during the deployment process. Packages will be placed into /var/vcap/packages/ directory.