Package org.apache.solr.crossdc.common

Class KafkaCrossDcConf

java.lang.Object

org.apache.solr.crossdc.common.CrossDcConf

org.apache.solr.crossdc.common.KafkaCrossDcConf

public class KafkaCrossDcConf
extends CrossDcConf

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.solr.crossdc.common.CrossDcConf

CrossDcConf.CollapseUpdates, CrossDcConf.ExpandDbq

Field Summary

Fields

Modifier and Type	Field	Description
static final String	BATCH_SIZE_BYTES
static final String	BOOTSTRAP_SERVERS
static final String	BUFFER_MEMORY_BYTES
static final List<ConfigProperty>	CONFIG_PROPERTIES
static final String	CONSUMER_PROCESSING_THREADS
static final String	DEFAULT_BATCH_SIZE_BYTES
static final String	DEFAULT_BUFFER_MEMORY_BYTES
static final String	DEFAULT_ENABLE_DATA_COMPRESSION
static final String	DEFAULT_FETCH_MAX_BYTES
static final String	DEFAULT_LINGER_MS
static final String	DEFAULT_MAX_PARTITION_FETCH_BYTES
static final String	DEFAULT_MAX_POLL_INTERVAL_MS
static final String	DEFAULT_MAX_POLL_RECORDS
static final String	DEFAULT_MAX_REQUEST_SIZE
static final String	DEFAULT_NUM_RETRIES
static final String	DEFAULT_PORT
static final String	DEFAULT_REQUEST_TIMEOUT
static final String	DEFAULT_SESSION_TIMEOUT_MS
static final String	DEFAULT_SLOW_SEND_THRESHOLD
static final String	DELIVERY_TIMEOUT_MS
static final String	DLQ_TOPIC_NAME
static final String	ENABLE_DATA_COMPRESSION
static final String	FETCH_MAX_BYTES
static final String	FETCH_MAX_WAIT_MS
static final String	FETCH_MIN_BYTES
static final String	GROUP_ID
static final String	INDEX_UNMIRRORABLE_DOCS
static final String	LINGER_MS
static final String	MAX_ATTEMPTS
static final String	MAX_PARTITION_FETCH_BYTES
static final String	MAX_POLL_INTERVAL_MS	The maximum delay between invocations of poll() when using consumer group management.
static final String	MAX_POLL_RECORDS
static final String	MAX_REQUEST_SIZE_BYTES
static final String	MIRROR_COLLECTIONS
static final String	MIRROR_COMMITS
static final String	NUM_RETRIES
static final String	PORT
static final String	REQUEST_TIMEOUT_MS
static final String	RETRY_BACKOFF_MS
static final List<ConfigProperty>	SECURITY_CONFIG_PROPERTIES
static final String	SESSION_TIMEOUT_MS
static final String	SLOW_SUBMIT_THRESHOLD_MS
static final String	TOPIC_NAME
static final String	ZK_CONNECT_STRING

Fields inherited from class org.apache.solr.crossdc.common.CrossDcConf

COLLAPSE_UPDATES, CROSSDC_PROPERTIES, EXPAND_DBQ, MAX_COLLAPSE_RECORDS, ZK_CROSSDC_PROPS_PATH

Constructor Summary

Constructors

Constructor	Description
KafkaCrossDcConf(Map<String,Object> properties)

Method Summary

Modifier and Type	Method	Description
static void	addSecurityProps(KafkaCrossDcConf conf, Properties kafkaConsumerProps)
String	get(String property)
Map<String,Object>	getAdditionalProperties()
Boolean	getBool(String property)
Integer	getInt(String property)
static void	readZkProps(Map<String,Object> properties, Properties zkProps)
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

DEFAULT_BATCH_SIZE_BYTES

public static final String DEFAULT_BATCH_SIZE_BYTES

See Also:

• Constant Field Values

DEFAULT_BUFFER_MEMORY_BYTES

public static final String DEFAULT_BUFFER_MEMORY_BYTES

See Also:

• Constant Field Values

DEFAULT_LINGER_MS

public static final String DEFAULT_LINGER_MS

See Also:

• Constant Field Values

DEFAULT_REQUEST_TIMEOUT

public static final String DEFAULT_REQUEST_TIMEOUT

See Also:

• Constant Field Values

DEFAULT_MAX_REQUEST_SIZE

public static final String DEFAULT_MAX_REQUEST_SIZE

See Also:

• Constant Field Values

DEFAULT_ENABLE_DATA_COMPRESSION

public static final String DEFAULT_ENABLE_DATA_COMPRESSION

See Also:

• Constant Field Values

DEFAULT_SLOW_SEND_THRESHOLD

public static final String DEFAULT_SLOW_SEND_THRESHOLD

See Also:

• Constant Field Values

DEFAULT_NUM_RETRIES

public static final String DEFAULT_NUM_RETRIES

DEFAULT_MAX_POLL_RECORDS

public static final String DEFAULT_MAX_POLL_RECORDS

See Also:

• Constant Field Values

DEFAULT_FETCH_MAX_BYTES

public static final String DEFAULT_FETCH_MAX_BYTES

See Also:

• Constant Field Values

DEFAULT_MAX_PARTITION_FETCH_BYTES

public static final String DEFAULT_MAX_PARTITION_FETCH_BYTES

See Also:

• Constant Field Values

DEFAULT_MAX_POLL_INTERVAL_MS

public static final String DEFAULT_MAX_POLL_INTERVAL_MS

See Also:

• Constant Field Values

DEFAULT_SESSION_TIMEOUT_MS

public static final String DEFAULT_SESSION_TIMEOUT_MS

See Also:

• Constant Field Values

DEFAULT_PORT

public static final String DEFAULT_PORT

See Also:

• Constant Field Values

TOPIC_NAME

public static final String TOPIC_NAME

See Also:

• Constant Field Values

DLQ_TOPIC_NAME

public static final String DLQ_TOPIC_NAME

See Also:

• Constant Field Values

MAX_ATTEMPTS

public static final String MAX_ATTEMPTS

See Also:

• Constant Field Values

BOOTSTRAP_SERVERS

public static final String BOOTSTRAP_SERVERS

See Also:

• Constant Field Values

BATCH_SIZE_BYTES

public static final String BATCH_SIZE_BYTES

See Also:

• Constant Field Values

BUFFER_MEMORY_BYTES

public static final String BUFFER_MEMORY_BYTES

See Also:

• Constant Field Values

LINGER_MS

public static final String LINGER_MS

See Also:

• Constant Field Values

REQUEST_TIMEOUT_MS

public static final String REQUEST_TIMEOUT_MS

See Also:

• Constant Field Values

MAX_REQUEST_SIZE_BYTES

public static final String MAX_REQUEST_SIZE_BYTES

See Also:

• Constant Field Values

ENABLE_DATA_COMPRESSION

public static final String ENABLE_DATA_COMPRESSION

See Also:

• Constant Field Values

INDEX_UNMIRRORABLE_DOCS

public static final String INDEX_UNMIRRORABLE_DOCS

See Also:

• Constant Field Values

SLOW_SUBMIT_THRESHOLD_MS

public static final String SLOW_SUBMIT_THRESHOLD_MS

See Also:

• Constant Field Values

NUM_RETRIES

public static final String NUM_RETRIES

See Also:

• Constant Field Values

RETRY_BACKOFF_MS

public static final String RETRY_BACKOFF_MS

See Also:

• Constant Field Values

CONSUMER_PROCESSING_THREADS

public static final String CONSUMER_PROCESSING_THREADS

See Also:

• Constant Field Values

DELIVERY_TIMEOUT_MS

public static final String DELIVERY_TIMEOUT_MS

See Also:

• Constant Field Values

FETCH_MIN_BYTES

public static final String FETCH_MIN_BYTES

See Also:

• Constant Field Values

FETCH_MAX_WAIT_MS

public static final String FETCH_MAX_WAIT_MS

See Also:

• Constant Field Values

MAX_POLL_RECORDS

public static final String MAX_POLL_RECORDS

See Also:

• Constant Field Values

FETCH_MAX_BYTES

public static final String FETCH_MAX_BYTES

See Also:

• Constant Field Values

MAX_POLL_INTERVAL_MS

public static final String MAX_POLL_INTERVAL_MS

The maximum delay between invocations of poll() when using consumer group management. This places an upper bound on the amount of time that the consumer can be idle before fetching more records. If poll() is not called before expiration of this timeout, then the consumer is considered failed and the group will rebalance in order to reassign the partitions to another member. For consumers using a non-null group.instance.id which reach this timeout, partitions will not be immediately reassigned. Instead, the consumer will stop sending heartbeats and partitions will be reassigned after expiration of session.timeout.ms. This mirrors the behavior of a static consumer which has shutdown.

See Also:

• Constant Field Values

SESSION_TIMEOUT_MS

public static final String SESSION_TIMEOUT_MS

See Also:

• Constant Field Values

MAX_PARTITION_FETCH_BYTES

public static final String MAX_PARTITION_FETCH_BYTES

See Also:

• Constant Field Values

ZK_CONNECT_STRING

public static final String ZK_CONNECT_STRING

See Also:

• Constant Field Values

MIRROR_COLLECTIONS

public static final String MIRROR_COLLECTIONS

See Also:

• Constant Field Values

MIRROR_COMMITS

public static final String MIRROR_COMMITS

See Also:

• Constant Field Values

CONFIG_PROPERTIES

public static final List<ConfigProperty> CONFIG_PROPERTIES

SECURITY_CONFIG_PROPERTIES

public static final List<ConfigProperty> SECURITY_CONFIG_PROPERTIES

PORT

public static final String PORT

See Also:

• Constant Field Values

GROUP_ID

public static final String GROUP_ID

See Also:

• Constant Field Values

Constructor Details

KafkaCrossDcConf

public KafkaCrossDcConf(Map<String,Object> properties)

Method Details

addSecurityProps

public static void addSecurityProps(KafkaCrossDcConf conf,
 Properties kafkaConsumerProps)

get

public String get(String property)

getInt

public Integer getInt(String property)

getBool

public Boolean getBool(String property)

getAdditionalProperties

public Map<String,Object> getAdditionalProperties()

readZkProps

public static void readZkProps(Map<String,Object> properties,
 Properties zkProps)

toString

public String toString()

Overrides:

toString in class Object