Skip to content

kafka job from kafka/2.4.2

Github source: e3c820b or master branch

Properties

advertised

listener

List of hostname and port of an advertised listener for each kafka broker, e.g. - cluster1.foo.com:9092 # for broker1 - cluster2.foo.com:9092 # for broker2 - cluster3.foo.com:9092 # for broker3

auto

create

topics
enable

Controls when Kafka enables auto creation of topic on the server.

delete_topic

Switch to enable topic deletion or not

Default
false

enable_sasl_scram

Whether to use SASL/SCRAM for authentication

Default
false

heap_size

set KAFKA_HEAP_OPTS

jaas_admin

password

admin password used in JAAS configuration

Default
admin-secret

username

admin username used in JAAS configuration

Default
admin

jmx_port

The port to listen for JMX connections, disabled by default

Default
""

keystore_password

Keystore password

Default
notasecret

listen_port

The port to listen for client connections

Default
9092

offsets

topic

replication
factor

The replication factor for the offsets topic

Default
3

tls

ca_certs

List of CA certs used to verify clients (and other Kafka brokers) that connect to us

Default
[]

certificate

Certificate (needs private_key and certificate) used to act as both server, and client to other brokers

topics

List of topics to create - name: test replication_factor: 1 partitions: 1

Default
[]

transaction

state

log
min
isr

Overridden min.insync.replicas config for the transaction topic

Default
2
replication
factor

The replication factor for the transaction topic

Default
3

Templates

Templates are rendered and placed onto corresponding instances during the deployment process. This job's templates will be placed into /var/vcap/jobs/kafka/ directory (learn more).

  • bin/bpm-pre-start (from bin/pre-start)
  • bin/ctl (from bin/ctl)
  • bin/post-deploy (from bin/post-deploy)
  • config/bpm.yml (from config/bpm.yml)
  • config/ca_certs.pem (from config/ca_certs.pem)
  • config/cert.pem (from config/cert.pem)
  • config/kafka_server_jaas.conf (from config/kafka_server_jaas.conf)
  • config/key.pem (from config/key.pem)
  • config/log4j.properties (from config/log4j.properties)
  • config/server.properties (from config/server.properties)

Packages

Packages are compiled and placed onto corresponding instances during the deployment process. Packages will be placed into /var/vcap/packages/ directory.