Kakfa Ingress Connector

Bootstrap Server *

A comma separated list of bootstrap server hostname:port pairs for the consumer(s) to connect to Kafka

Topic Name *

The name of the topic from which the messages are read/consumed

Group Id

The consumer group id of the Kafka consumer

Client Id

An id string to pass to the server when making requests. The purpose of this is to be able to track the source of requests beyond just ip/port by allowing a logical application name to be included in server-side request logging

Consumer Count

Number of concurrent consumer threads. Default is 1, using single consumer.

Commit Automatically

Whether offsets are committed automatically with a frequency controlled by the Auto Commit Interval. Default is true

Auto Commit Interval

The interval in milliseconds at which the offsets are committed, if the Auto Commits are enabled. Default is 5000

Auto Offset Reset

What to do when there is no initial offset in Kafka or if the current offset does not exist any more on the server (e.g. because that data has been deleted). Default is LATEST and the other options are as follows.

Exclude Internal Topics

Whether records from internal topics (such as offsets) should be exposed to the consumer. If set to true the only way to receive records from an internal topic is subscribing to it. Default is true.

Isolation Level

Controls how to read messages written transactionally. Default is READ_UNCOMMITTED and the other options are as follows.

Non-transactional messages are received in both the modes

Maximum Poll Interval

The maximum delay in milliseconds between invocations of poll when using consumer group management. Default is 300000

Maximum Poll Records

The maximum number of records returned in a single call to poll(). Default is 500

Partition Assignment Strategy

The class name of the partition assignment strategy that the client will use to distribute partition ownership amongst consumer instances when group management is used. Default is class org.apache.kafka.clients.consumer.RangeAssignor

Automatically Check CRC32

Automatically check the CRC32 of the records consumed. This ensures no on-the-wire or on-disk corruption to the messages occurred. This check adds some overhead, so it may be disabled in cases seeking extreme performance. Default is true

Interceptor Classes

A comma separated list of classes to use as interceptors. Implementing the ConsumerInterceptor interface allows you to intercept (and possibly mutate) records received by the consumer

Metadata Maximum Age

The period of time in milliseconds after which we force a refresh of metadata even if we haven’t seen any partition leadership changes to proactively discover any new brokers or partitions. Default is 300000

Kerberos Service Name

The Kerberos principal name that Kafka runs as

Kerberos KInit Command

Kerberos kinit command path. Default is /usr/bin/kinit

Kerberos Minimum Time Before Re-login

Login thread sleep time in milliseconds between refresh attempts. Default is 60000

Kerberos Ticket Renew Jitter

Percentage of random jitter added to the renewal time. Default is 0.05

Kerberos Ticket Renew Window Factor

Login thread will sleep until the specified window factor of time from last refresh to ticket’s expiry has been reached, at which time it will try to renew the ticket. Default is 0.8

Metrics Reporters

A comma separated list of classes to use as metrics reporters. Implementing the MetricReporter interface allows plugging in classes that will be notified of new metric creation. The JmxReporter is always included to register JMX statistics

Sample Count

The number of samples maintained to compute metrics. Default is 2

Recording Level

The highest recording level for metrics. Default is INFO and following are the available options.

Sample Window

The window of time in milliseconds a metrics sample is computed over. Default is 30000

Session Timeout

The session timeout of the Kafka connection in milliseconds. Default is 10000

Request Timeout

The configuration controls the maximum amount of time in milliseconds the client will wait for the response of a request. Default is 305000

Heart Beat Interval

The expected time in milliseconds between heartbeats to the consumer coordinator when using Kafka’s group management facilities. Default is 3000

Connection Maximum Idle Time

Close idle connections after the number of milliseconds specified by this config. Default is 540000

Minimum Fetch Bytes

The minimum amount of data the server should return for a fetch request. If insufficient data is available. the request will wait for that much data to accumulate before answering the request. Default is 1

Maximum Fetch Bytes

The maximum amount of data the server should return for a fetch request. Default is 52428800

Maximum Bytes Fetch per Partition

The maximum amount of data per-partition the server will return. Default is 1048576

Receive Buffer Size

The size of the TCP receive buffer (SO_RCVBUF) in bytes to use when reading data. If the value is -1, the OS default will be used. Default is 65536

Send Buffer Size

The size of the TCP send buffer (SO_SNDBUF) in bytes to use when sending data. If the value is -1, the OS default will be used. Default is 131072

Fetch Maximum Wait Time

The maximum amount of time in milliseconds the server will block before answering the fetch request if there isn’t sufficient data to immediately satisfy the requirement given by fetch.min.bytes. Default is 500

Reconnect Back-Off

The base amount of time in milliseconds to wait before attempting to reconnect to a given host. This avoids repeatedly connecting to a host in a tight loop. This backoff applies to all connection attempts by the client to a broker. Default is 50

Maximum Reconnect Back-Off

The maximum amount of time in milliseconds to wait when re-connecting to a broker that has repeatedly failed to connect. If provided, the backoff per host will increase exponentially for each consecutive connection failure, up to this maximum. After calculating the backoff increase, 20% random jitter is added to avoid connection storms. Default is 1000

Retry Back-Off

The amount of time in milliseconds to wait before attempting to retry a failed request to a given topic partition. This avoids repeatedly sending requests in a tight loop under some failure scenarios. Default is 100

Trust Keystore Location

The location of the trust store file used for two-way authentication for client

Trust Keystore Password

The password for the trust store file

Trust Keystore Type

The file format of the trust store file. Default is JKS

Identity Keystore Location

The location of the key store file used for two-way authentication for client

Identity Keystore Password

The store password for the key store file. This is only needed if Identity Keystore Location is configured

Identity Keystore Type

The file format of the key store file. Default is JKS

Identity Key Password

The password of the private key in the key store file

Enabled SSL Protocols

A comma separated list of protocols enabled for SSL connections from TLSv1, TLSv1.1 and TLSv1.2, SSLv1, SSLv2 and SSLv3. Default is TLSv1.2,TLSv1.1,TLSv1

SSL Protocol

The SSL protocol used to generate the SSLContext. Default setting is TLS, which is fine for most cases. Allowed values in recent JVMs are TLS, TLSv1.1 and TLSv1.2. SSL, SSLv2 and SSLv3 may be supported in older JVMs, but their usage is discouraged due to known security vulnerabilities

SSL Provider

The name of the security provider used for SSL connections. Default value is the default security provider of the JVM

SSL Cipher Suites

A comma separated list of cipher suites. This is a named combination of authentication, encryption, MAC and key exchange algorithm used to negotiate the security settings for a network connection using TLS or SSL network protocol. By default all the available cipher suites are supported

Endpoint Identification Algorithm

The endpoint identification algorithm to validate server hostname using server certificate

Keymanager Algorithm

The algorithm used by key manager factory for SSL connections. Default value is the key manager factory algorithm configured for the Java Virtual Machine (SunX509)

Trustmanager Algorithm

The algorithm used by trust manager factory for SSL connections. Default value is the trust manager factory algorithm configured for the Java Virtual Machine (PKIX)

Secure Random Implementation

The SecureRandom PRNG implementation to use for SSL cryptography operations

Security Protocol

Protocol used to communicate with brokers. Default is PLAINTEXT and the other options are as follows

SASL Mechanism

SASL mechanism used for client connections. This may be any mechanism for which a security provider is available. Default is GSSAPI

JAAS Config

JAAS login context parameters for SASL connections in the format used by JAAS configuration files