Package org.apache.solr.common.cloud
Class ZkStateReader
- java.lang.Object
- 
- org.apache.solr.common.cloud.ZkStateReader
 
- 
- All Implemented Interfaces:
- Closeable,- AutoCloseable
 
 public class ZkStateReader extends Object implements Closeable 
- 
- 
Nested Class SummaryNested Classes Modifier and Type Class Description classZkStateReader.AliasesManagerA class to manage the aliases instance, including watching for changes.static classZkStateReader.ConfigData
 - 
Field Summary
 - 
Constructor SummaryConstructors Constructor Description ZkStateReader(String zkServerAddress, int zkClientTimeout, int zkClientConnectTimeout)ZkStateReader(SolrZkClient zkClient)ZkStateReader(SolrZkClient zkClient, Runnable securityNodeListener)
 - 
Method SummaryAll Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description voidclose()IntegercompareStateVersions(String coll, int version)voidcreateClusterStateWatchersAndUpdate()voidforceUpdateCollection(String collection)Forcibly refresh a collection's internal state from ZK.voidforciblyRefreshAllClusterStateSlow()Forcibly refresh cluster state from ZK.AliasesgetAliases()Get an immutable copy of the present state of the aliases.AutoScalingConfiggetAutoScalingConfig()Get currentAutoScalingConfig.AutoScalingConfiggetAutoScalingConfig(org.apache.zookeeper.Watcher watcher)Get currentAutoScalingConfig.StringgetBaseUrlForNodeName(String nodeName)Returns the baseURL corresponding to a given node's nodeName -- NOTE: does not (currently) imply that the nodeName (or resulting baseURL) exists in the cluster.Map<String,Object>getClusterProperties()Get all cluster properties for this cluster N.B.<T> TgetClusterProperty(String key, T defaultValue)Get a cluster property N.B.<T> TgetClusterProperty(List<String> keyPath, T defaultValue)Same as the above but allows a full json path as a list of partsClusterStategetClusterState()static DocCollectiongetCollectionLive(ZkStateReader zkStateReader, String coll)static StringgetCollectionPath(String coll)static StringgetCollectionPathRoot(String coll)Map<String,String>getCollectionProperties(String collection)Get collection properties for a given collection.ZkConfigManagergetConfigManager()ReplicagetLeader(String collection, String shard)ReplicagetLeader(Set<String> liveNodes, DocCollection docCollection, String shard)ReplicagetLeaderRetry(String collection, String shard)Get shard leader properties, with retry if none exist.ReplicagetLeaderRetry(String collection, String shard, int timeout)Get shard leader properties, with retry if none exist.StringgetLeaderUrl(String collection, String shard, int timeout)List<ZkCoreNodeProps>getReplicaProps(String collection, String shardId, String thisCoreNodeName)List<ZkCoreNodeProps>getReplicaProps(String collection, String shardId, String thisCoreNodeName, Replica.State mustMatchStateFilter)List<ZkCoreNodeProps>getReplicaProps(String collection, String shardId, String thisCoreNodeName, Replica.State mustMatchStateFilter, Replica.State mustNotMatchStateFilter)List<ZkCoreNodeProps>getReplicaProps(String collection, String shardId, String thisCoreNodeName, Replica.State mustMatchStateFilter, Replica.State mustNotMatchStateFilter, EnumSet<Replica.Type> acceptReplicaType)ZkStateReader.ConfigDatagetSecurityProps(boolean getFresh)Returns the content of /security.json from ZooKeeper as a Map If the files doesn't exist, it returns null.static StringgetShardLeadersElectPath(String collection, String shardId)Get path where shard leader elections ephemeral nodes are.static StringgetShardLeadersPath(String collection, String shardId)Get path where shard leader properties live in zookeeper.ObjectgetUpdateLock()SolrZkClientgetZkClient()StringreadConfigName(String collection)Returns config set name for collection.voidregisterCloudCollectionsListener(CloudCollectionsListener cloudCollectionsListener)Register a CloudCollectionsListener to be called when the set of collections within a cloud changes.voidregisterCollectionPropsWatcher(String collection, CollectionPropsWatcher propsWatcher)voidregisterCollectionStateWatcher(String collection, CollectionStateWatcher stateWatcher)Register a CollectionStateWatcher to be called when the state of a collection changesvoidregisterCore(String collection)Notify this reader that a local Core is a member of a collection, and so that collection state should be watched.voidregisterLiveNodesListener(LiveNodesListener listener)voidremoveCloudCollectionsListener(CloudCollectionsListener cloudCollectionsListener)Remove a registered CloudCollectionsListener.voidremoveCollectionPropsWatcher(String collection, CollectionPropsWatcher watcher)voidremoveCollectionStateWatcher(String collection, CollectionStateWatcher watcher)Remove a watcher from a collection's watch list.voidremoveLiveNodesListener(LiveNodesListener listener)voidunregisterCore(String collection)Notify this reader that a local core that is a member of a collection has been closed.voidupdateLiveNodes()Refresh the set of live nodes.voidwaitForLiveNodes(long wait, TimeUnit unit, LiveNodesPredicate predicate)Block until a LiveNodesStatePredicate returns true, or the wait times out Note that the predicate may be called again even after it has returned true, so implementors should avoid changing state within the predicate call itself.voidwaitForState(String collection, long wait, TimeUnit unit, CollectionStatePredicate predicate)Block until a CollectionStatePredicate returns true, or the wait times out Note that the predicate may be called again even after it has returned true, so implementors should avoid changing state within the predicate call itself.
 
- 
- 
- 
Field Detail- 
STATE_UPDATE_DELAYpublic static final int STATE_UPDATE_DELAY 
 - 
BASE_URL_PROPpublic static final String BASE_URL_PROP - See Also:
- Constant Field Values
 
 - 
NODE_NAME_PROPpublic static final String NODE_NAME_PROP - See Also:
- Constant Field Values
 
 - 
CORE_NODE_NAME_PROPpublic static final String CORE_NODE_NAME_PROP - See Also:
- Constant Field Values
 
 - 
ROLES_PROPpublic static final String ROLES_PROP - See Also:
- Constant Field Values
 
 - 
STATE_PROPpublic static final String STATE_PROP - See Also:
- Constant Field Values
 
 - 
FORCE_SET_STATE_PROPpublic static final String FORCE_SET_STATE_PROP - See Also:
- Constant Field Values
 
 - 
CORE_NAME_PROPpublic static final String CORE_NAME_PROP SolrCore name.- See Also:
- Constant Field Values
 
 - 
COLLECTION_PROPpublic static final String COLLECTION_PROP - See Also:
- Constant Field Values
 
 - 
ELECTION_NODE_PROPpublic static final String ELECTION_NODE_PROP - See Also:
- Constant Field Values
 
 - 
SHARD_ID_PROPpublic static final String SHARD_ID_PROP - See Also:
- Constant Field Values
 
 - 
REPLICA_PROPpublic static final String REPLICA_PROP - See Also:
- Constant Field Values
 
 - 
SHARD_RANGE_PROPpublic static final String SHARD_RANGE_PROP - See Also:
- Constant Field Values
 
 - 
SHARD_STATE_PROPpublic static final String SHARD_STATE_PROP - See Also:
- Constant Field Values
 
 - 
SHARD_PARENT_PROPpublic static final String SHARD_PARENT_PROP - See Also:
- Constant Field Values
 
 - 
NUM_SHARDS_PROPpublic static final String NUM_SHARDS_PROP - See Also:
- Constant Field Values
 
 - 
LEADER_PROPpublic static final String LEADER_PROP - See Also:
- Constant Field Values
 
 - 
SHARED_STORAGE_PROPpublic static final String SHARED_STORAGE_PROP - See Also:
- Constant Field Values
 
 - 
PROPERTY_PROPpublic static final String PROPERTY_PROP - See Also:
- Constant Field Values
 
 - 
PROPERTY_PROP_PREFIXpublic static final String PROPERTY_PROP_PREFIX - See Also:
- Constant Field Values
 
 - 
PROPERTY_VALUE_PROPpublic static final String PROPERTY_VALUE_PROP - See Also:
- Constant Field Values
 
 - 
MAX_AT_ONCE_PROPpublic static final String MAX_AT_ONCE_PROP - See Also:
- Constant Field Values
 
 - 
MAX_WAIT_SECONDS_PROPpublic static final String MAX_WAIT_SECONDS_PROP - See Also:
- Constant Field Values
 
 - 
STATE_TIMESTAMP_PROPpublic static final String STATE_TIMESTAMP_PROP - See Also:
- Constant Field Values
 
 - 
COLLECTIONS_ZKNODEpublic static final String COLLECTIONS_ZKNODE - See Also:
- Constant Field Values
 
 - 
LIVE_NODES_ZKNODEpublic static final String LIVE_NODES_ZKNODE - See Also:
- Constant Field Values
 
 - 
ALIASESpublic static final String ALIASES - See Also:
- Constant Field Values
 
 - 
CLUSTER_STATEpublic static final String CLUSTER_STATE - See Also:
- Constant Field Values
 
 - 
CLUSTER_PROPSpublic static final String CLUSTER_PROPS - See Also:
- Constant Field Values
 
 - 
COLLECTION_PROPS_ZKNODEpublic static final String COLLECTION_PROPS_ZKNODE - See Also:
- Constant Field Values
 
 - 
REJOIN_AT_HEAD_PROPpublic static final String REJOIN_AT_HEAD_PROP - See Also:
- Constant Field Values
 
 - 
SOLR_SECURITY_CONF_PATHpublic static final String SOLR_SECURITY_CONF_PATH - See Also:
- Constant Field Values
 
 - 
SOLR_AUTOSCALING_CONF_PATHpublic static final String SOLR_AUTOSCALING_CONF_PATH - See Also:
- Constant Field Values
 
 - 
SOLR_AUTOSCALING_EVENTS_PATHpublic static final String SOLR_AUTOSCALING_EVENTS_PATH - See Also:
- Constant Field Values
 
 - 
SOLR_AUTOSCALING_TRIGGER_STATE_PATHpublic static final String SOLR_AUTOSCALING_TRIGGER_STATE_PATH - See Also:
- Constant Field Values
 
 - 
SOLR_AUTOSCALING_NODE_ADDED_PATHpublic static final String SOLR_AUTOSCALING_NODE_ADDED_PATH - See Also:
- Constant Field Values
 
 - 
SOLR_AUTOSCALING_NODE_LOST_PATHpublic static final String SOLR_AUTOSCALING_NODE_LOST_PATH - See Also:
- Constant Field Values
 
 - 
REPLICATION_FACTORpublic static final String REPLICATION_FACTOR - See Also:
- Constant Field Values
 
 - 
MAX_SHARDS_PER_NODEpublic static final String MAX_SHARDS_PER_NODE - See Also:
- Constant Field Values
 
 - 
AUTO_ADD_REPLICASpublic static final String AUTO_ADD_REPLICAS - See Also:
- Constant Field Values
 
 - 
MAX_CORES_PER_NODEpublic static final String MAX_CORES_PER_NODE - See Also:
- Constant Field Values
 
 - 
PULL_REPLICASpublic static final String PULL_REPLICAS - See Also:
- Constant Field Values
 
 - 
NRT_REPLICASpublic static final String NRT_REPLICAS - See Also:
- Constant Field Values
 
 - 
TLOG_REPLICASpublic static final String TLOG_REPLICAS - See Also:
- Constant Field Values
 
 - 
ROLESpublic static final String ROLES - See Also:
- Constant Field Values
 
 - 
CONFIGS_ZKNODEpublic static final String CONFIGS_ZKNODE - See Also:
- Constant Field Values
 
 - 
CONFIGNAME_PROPpublic static final String CONFIGNAME_PROP - See Also:
- Constant Field Values
 
 - 
LEGACY_CLOUDpublic static final String LEGACY_CLOUD - See Also:
- Constant Field Values
 
 - 
COLLECTION_DEF@Deprecated public static final String COLLECTION_DEF Deprecated.useCollectionAdminParams.DEFAULTSinstead.- See Also:
- Constant Field Values
 
 - 
URL_SCHEMEpublic static final String URL_SCHEME - See Also:
- Constant Field Values
 
 - 
REPLICA_TYPEpublic static final String REPLICA_TYPE - See Also:
- Constant Field Values
 
 - 
clusterStateprotected volatile ClusterState clusterState A view of the current state of all collections; combines all the different state sources into a single view.
 - 
LEADER_ELECT_ZKNODEpublic static final String LEADER_ELECT_ZKNODE - See Also:
- Constant Field Values
 
 - 
SHARD_LEADERS_ZKNODEpublic static final String SHARD_LEADERS_ZKNODE - See Also:
- Constant Field Values
 
 - 
ELECTION_NODEpublic static final String ELECTION_NODE - See Also:
- Constant Field Values
 
 - 
aliasesManagerpublic final ZkStateReader.AliasesManager aliasesManager Access to theAliases.
 
- 
 - 
Constructor Detail- 
ZkStateReaderpublic ZkStateReader(SolrZkClient zkClient) 
 - 
ZkStateReaderpublic ZkStateReader(SolrZkClient zkClient, Runnable securityNodeListener) 
 - 
ZkStateReaderpublic ZkStateReader(String zkServerAddress, int zkClientTimeout, int zkClientConnectTimeout) 
 
- 
 - 
Method Detail- 
getAutoScalingConfigpublic AutoScalingConfig getAutoScalingConfig() throws org.apache.zookeeper.KeeperException, InterruptedException Get currentAutoScalingConfig.- Returns:
- current configuration from autoscaling.json. NOTE: this data is retrieved from ZK on each call.
- Throws:
- org.apache.zookeeper.KeeperException
- InterruptedException
 
 - 
getAutoScalingConfigpublic AutoScalingConfig getAutoScalingConfig(org.apache.zookeeper.Watcher watcher) throws org.apache.zookeeper.KeeperException, InterruptedException Get currentAutoScalingConfig.- Parameters:
- watcher- optional- Watcherto set on a znode to watch for config changes.
- Returns:
- current configuration from autoscaling.json. NOTE: this data is retrieved from ZK on each call.
- Throws:
- org.apache.zookeeper.KeeperException
- InterruptedException
 
 - 
readConfigNamepublic String readConfigName(String collection) Returns config set name for collection.- Parameters:
- collection- to return config set name for
 
 - 
getConfigManagerpublic ZkConfigManager getConfigManager() 
 - 
forciblyRefreshAllClusterStateSlowpublic void forciblyRefreshAllClusterStateSlow() throws org.apache.zookeeper.KeeperException, InterruptedExceptionForcibly refresh cluster state from ZK. Do this only to avoid race conditions because it's expensive. It is cheaper to callforceUpdateCollection(String)on a single collection if you must.- Throws:
- org.apache.zookeeper.KeeperException
- InterruptedException
- NOTE: This API is for internal purposes only and might change in incompatible ways in the next release.
 
 - 
forceUpdateCollectionpublic void forceUpdateCollection(String collection) throws org.apache.zookeeper.KeeperException, InterruptedException Forcibly refresh a collection's internal state from ZK. Try to avoid having to resort to this when a better design is possible.- Throws:
- org.apache.zookeeper.KeeperException
- InterruptedException
 
 - 
updateLiveNodespublic void updateLiveNodes() throws org.apache.zookeeper.KeeperException, InterruptedExceptionRefresh the set of live nodes.- Throws:
- org.apache.zookeeper.KeeperException
- InterruptedException
 
 - 
createClusterStateWatchersAndUpdatepublic void createClusterStateWatchersAndUpdate() throws org.apache.zookeeper.KeeperException, InterruptedException- Throws:
- org.apache.zookeeper.KeeperException
- InterruptedException
 
 - 
registerCloudCollectionsListenerpublic void registerCloudCollectionsListener(CloudCollectionsListener cloudCollectionsListener) Register a CloudCollectionsListener to be called when the set of collections within a cloud changes.
 - 
removeCloudCollectionsListenerpublic void removeCloudCollectionsListener(CloudCollectionsListener cloudCollectionsListener) Remove a registered CloudCollectionsListener.
 - 
registerLiveNodesListenerpublic void registerLiveNodesListener(LiveNodesListener listener) 
 - 
removeLiveNodesListenerpublic void removeLiveNodesListener(LiveNodesListener listener) 
 - 
getClusterStatepublic ClusterState getClusterState() - Returns:
- information about the cluster from ZooKeeper
 
 - 
getUpdateLockpublic Object getUpdateLock() 
 - 
closepublic void close() - Specified by:
- closein interface- AutoCloseable
- Specified by:
- closein interface- Closeable
 
 - 
getLeaderUrlpublic String getLeaderUrl(String collection, String shard, int timeout) throws InterruptedException - Throws:
- InterruptedException
 
 - 
getLeaderpublic Replica getLeader(Set<String> liveNodes, DocCollection docCollection, String shard) 
 - 
getLeaderRetrypublic Replica getLeaderRetry(String collection, String shard) throws InterruptedException Get shard leader properties, with retry if none exist.- Throws:
- InterruptedException
 
 - 
getLeaderRetrypublic Replica getLeaderRetry(String collection, String shard, int timeout) throws InterruptedException Get shard leader properties, with retry if none exist.- Throws:
- InterruptedException
 
 - 
getShardLeadersPathpublic static String getShardLeadersPath(String collection, String shardId) Get path where shard leader properties live in zookeeper.
 - 
getShardLeadersElectPathpublic static String getShardLeadersElectPath(String collection, String shardId) Get path where shard leader elections ephemeral nodes are.
 - 
getReplicaPropspublic List<ZkCoreNodeProps> getReplicaProps(String collection, String shardId, String thisCoreNodeName) 
 - 
getReplicaPropspublic List<ZkCoreNodeProps> getReplicaProps(String collection, String shardId, String thisCoreNodeName, Replica.State mustMatchStateFilter) 
 - 
getReplicaPropspublic List<ZkCoreNodeProps> getReplicaProps(String collection, String shardId, String thisCoreNodeName, Replica.State mustMatchStateFilter, Replica.State mustNotMatchStateFilter) 
 - 
getReplicaPropspublic List<ZkCoreNodeProps> getReplicaProps(String collection, String shardId, String thisCoreNodeName, Replica.State mustMatchStateFilter, Replica.State mustNotMatchStateFilter, EnumSet<Replica.Type> acceptReplicaType) 
 - 
getZkClientpublic SolrZkClient getZkClient() 
 - 
getClusterPropertypublic <T> T getClusterProperty(String key, T defaultValue) Get a cluster property N.B. Cluster properties are updated via ZK watchers, and so may not necessarily be completely up-to-date. If you need to get the latest version, then use aClusterPropertiesinstance.- Type Parameters:
- T- the type of the property
- Parameters:
- key- the property to read
- defaultValue- a default value to use if no such property exists
- Returns:
- the cluster property, or a default if the property is not set
 
 - 
getClusterPropertypublic <T> T getClusterProperty(List<String> keyPath, T defaultValue) Same as the above but allows a full json path as a list of parts- Parameters:
- keyPath- path to the property example ["collectionDefauls", "numShards"]
- defaultValue- a default value to use if no such property exists
- Returns:
- the cluster property, or a default if the property is not set
 
 - 
getClusterPropertiespublic Map<String,Object> getClusterProperties() Get all cluster properties for this cluster N.B. Cluster properties are updated via ZK watchers, and so may not necessarily be completely up-to-date. If you need to get the latest version, then use aClusterPropertiesinstance.- Returns:
- a Map of cluster properties
 
 - 
getCollectionPropertiespublic Map<String,String> getCollectionProperties(String collection) Get collection properties for a given collection. If the collection is watched, simply return it from the cache, otherwise fetch it directly from zookeeper.
 - 
getSecurityPropspublic ZkStateReader.ConfigData getSecurityProps(boolean getFresh) Returns the content of /security.json from ZooKeeper as a Map If the files doesn't exist, it returns null.
 - 
getBaseUrlForNodeNamepublic String getBaseUrlForNodeName(String nodeName) Returns the baseURL corresponding to a given node's nodeName -- NOTE: does not (currently) imply that the nodeName (or resulting baseURL) exists in the cluster.- WARNING: This API is experimental and might change in incompatible ways in the next release.
 
 - 
getCollectionLivepublic static DocCollection getCollectionLive(ZkStateReader zkStateReader, String coll) 
 - 
registerCorepublic void registerCore(String collection) Notify this reader that a local Core is a member of a collection, and so that collection state should be watched. Not a public API. This method should only be called from ZkController. The number of cores per-collection is tracked, and adding multiple cores from the same collection does not increase the number of watches.- Parameters:
- collection- the collection that the core is a member of
- See Also:
- unregisterCore(String)
 
 - 
unregisterCorepublic void unregisterCore(String collection) Notify this reader that a local core that is a member of a collection has been closed. Not a public API. This method should only be called from ZkController. If no cores are registered for a collection, and there are noCollectionStateWatchers for that collection either, the collection watch will be removed.- Parameters:
- collection- the collection that the core belongs to
 
 - 
registerCollectionStateWatcherpublic void registerCollectionStateWatcher(String collection, CollectionStateWatcher stateWatcher) Register a CollectionStateWatcher to be called when the state of a collection changes
 - 
waitForStatepublic void waitForState(String collection, long wait, TimeUnit unit, CollectionStatePredicate predicate) throws InterruptedException, TimeoutException Block until a CollectionStatePredicate returns true, or the wait times out Note that the predicate may be called again even after it has returned true, so implementors should avoid changing state within the predicate call itself.- Parameters:
- collection- the collection to watch
- wait- how long to wait
- unit- the units of the wait parameter
- predicate- the predicate to call on state changes
- Throws:
- InterruptedException- on interrupt
- TimeoutException- on timeout
 
 - 
waitForLiveNodespublic void waitForLiveNodes(long wait, TimeUnit unit, LiveNodesPredicate predicate) throws InterruptedException, TimeoutExceptionBlock until a LiveNodesStatePredicate returns true, or the wait times out Note that the predicate may be called again even after it has returned true, so implementors should avoid changing state within the predicate call itself.- Parameters:
- wait- how long to wait
- unit- the units of the wait parameter
- predicate- the predicate to call on state changes
- Throws:
- InterruptedException- on interrupt
- TimeoutException- on timeout
 
 - 
removeCollectionStateWatcherpublic void removeCollectionStateWatcher(String collection, CollectionStateWatcher watcher) Remove a watcher from a collection's watch list. This allows Zookeeper watches to be removed if there is no interest in the collection.- Parameters:
- collection- the collection
- watcher- the watcher
 
 - 
registerCollectionPropsWatcherpublic void registerCollectionPropsWatcher(String collection, CollectionPropsWatcher propsWatcher) 
 - 
removeCollectionPropsWatcherpublic void removeCollectionPropsWatcher(String collection, CollectionPropsWatcher watcher) 
 - 
getAliasespublic Aliases getAliases() Get an immutable copy of the present state of the aliases. References to this object should not be retained in any context where it will be important to know if aliases have changed.- Returns:
- The current aliases, Aliases.EMPTY if not solr cloud, or no aliases have existed yet. Never returns null.
 
 
- 
 
-