Class BaseCloudSolrClient
- java.lang.Object
-
- org.apache.solr.client.solrj.SolrClient
-
- org.apache.solr.client.solrj.impl.BaseCloudSolrClient
-
- All Implemented Interfaces:
Closeable,Serializable,AutoCloseable
- Direct Known Subclasses:
CloudHttp2SolrClient,CloudSolrClient
public abstract class BaseCloudSolrClient extends SolrClient
- See Also:
- Serialized Form
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static classBaseCloudSolrClient.RouteExceptionstatic classBaseCloudSolrClient.RouteResponse<T extends LBSolrClient.Req>
-
Field Summary
Fields Modifier and Type Field Description protected org.apache.solr.client.solrj.impl.BaseCloudSolrClient.StateCachecollectionStateCachestatic StringSTATE_VERSION
-
Constructor Summary
Constructors Modifier Constructor Description protectedBaseCloudSolrClient(boolean updatesToLeaders, boolean parallelUpdates, boolean directUpdatesToLeadersOnly)
-
Method Summary
All Methods Static Methods Instance Methods Abstract Methods Concrete Methods Modifier and Type Method Description voidclose()BaseCloudSolrClient.RouteResponsecondenseResponse(NamedList response, int timeMillis)protected <T extends BaseCloudSolrClient.RouteResponse>
TcondenseResponse(NamedList response, int timeMillis, Supplier<T> supplier)voidconnect()Connect to the zookeeper ensemble.voidconnect(long duration, TimeUnit timeUnit)Connect to a cluster.protected Map<String,? extends LBSolrClient.Req>createRoutes(UpdateRequest updateRequest, ModifiableSolrParams routableParams, DocCollection col, DocRouter router, Map<String,List<String>> urlMap, String idField)abstract ClusterStateProvidergetClusterStateProvider()StringgetDefaultCollection()Gets the default collection for requestprotected DocCollectiongetDocCollection(String collection, Integer expectedVersion)StringgetIdField()protected abstract LBSolrClientgetLbClient()intgetMinAchievedReplicationFactor(String collection, NamedList resp)Useful for determining the minimum achieved replication factor across all shards involved in processing an update request, typically useful for gauging the replication factor of a batch.ResponseParsergetParser()RequestWritergetRequestWriter()protected BaseCloudSolrClient.RouteExceptiongetRouteException(SolrException.ErrorCode serverError, NamedList<Throwable> exceptions, Map<String,? extends LBSolrClient.Req> routes)Map<String,Integer>getShardReplicationFactor(String collection, NamedList resp)Walks the NamedList response after performing an update request looking for the replication factor that was achieved in each shard involved in the request.StringgetZkHost()ZkStateReadergetZkStateReader()booleanisDirectUpdatesToLeadersOnly()booleanisParallelUpdates()Gets whether direct updates are sent in parallelbooleanisUpdatesToLeaders()protected static ArrayList<Object>objectList(int n)voidregisterCollectionStateWatcher(String collection, CollectionStateWatcher watcher)Register a CollectionStateWatcher to be called when the cluster state for a collection changes Note that the watcher is unregistered after it has been called once.NamedList<Object>request(SolrRequest request, String collection)Execute a request against a Solr server for a given collectionprotected NamedList<Object>requestWithRetryOnStaleState(SolrRequest request, int retryCount, List<String> inputCollections)As this class doesn't watch external collections on the client side, there's a chance that the request will fail due to cached stale state, which means the state must be refreshed from ZK and retried.protected NamedList<Object>sendRequest(SolrRequest request, List<String> inputCollections)voidsetCollectionCacheTTl(int seconds)Sets the cache ttl for DocCollection Objects cached .voidsetDefaultCollection(String collection)Sets the default collection for requestvoidsetIdField(String idField)voidsetParallelCacheRefreshes(int n)If caches are expired they are refreshed after acquiring a lock.voidsetParser(ResponseParser processor)Note: This setter method is not thread-safe.voidsetRequestWriter(RequestWriter requestWriter)voidsetRetryExpiryTime(int secs)This is the time to wait to refetch the state after getting the same state version from ZKvoidsetZkClientTimeout(int zkClientTimeout)Set the timeout to the zookeeper ensemble in msvoidsetZkConnectTimeout(int zkConnectTimeout)Set the connect timeout to the zookeeper ensemble in msvoidwaitForState(String collection, long wait, TimeUnit unit, CollectionStatePredicate predicate)Block until a collection state matches a predicate, or a timeout Note that the predicate may be called again even after it has returned true, so implementors should avoid changing state within the predicate call itself.protected abstract booleanwasCommError(Throwable t)-
Methods inherited from class org.apache.solr.client.solrj.SolrClient
add, add, add, add, add, add, add, add, add, add, addBean, addBean, addBean, addBean, addBeans, addBeans, addBeans, addBeans, addBeans, addBeans, commit, commit, commit, commit, commit, commit, deleteById, deleteById, deleteById, deleteById, deleteById, deleteById, deleteById, deleteById, deleteByQuery, deleteByQuery, deleteByQuery, deleteByQuery, getBinder, getById, getById, getById, getById, getById, getById, getById, getById, optimize, optimize, optimize, optimize, optimize, optimize, ping, query, query, query, query, queryAndStreamResponse, queryAndStreamResponse, queryAndStreamResponse, request, rollback, rollback
-
-
-
-
Field Detail
-
STATE_VERSION
public static final String STATE_VERSION
- See Also:
- Constant Field Values
-
collectionStateCache
protected final org.apache.solr.client.solrj.impl.BaseCloudSolrClient.StateCache collectionStateCache
-
-
Method Detail
-
setRetryExpiryTime
public void setRetryExpiryTime(int secs)
This is the time to wait to refetch the state after getting the same state version from ZKsecs
-
setCollectionCacheTTl
public void setCollectionCacheTTl(int seconds)
Sets the cache ttl for DocCollection Objects cached . This is only applicable for collections which are persisted outside of clusterstate.json- Parameters:
seconds- ttl value in seconds
-
getLbClient
protected abstract LBSolrClient getLbClient()
-
getClusterStateProvider
public abstract ClusterStateProvider getClusterStateProvider()
-
wasCommError
protected abstract boolean wasCommError(Throwable t)
-
close
public void close() throws IOException- Throws:
IOException
-
getParser
public ResponseParser getParser()
-
setParser
public void setParser(ResponseParser processor)
Note: This setter method is not thread-safe.- Parameters:
processor- Default Response Parser chosen to parse the response if the parser were not specified as part of the request.- See Also:
SolrRequest.getResponseParser()
-
getRequestWriter
public RequestWriter getRequestWriter()
-
setRequestWriter
public void setRequestWriter(RequestWriter requestWriter)
-
getZkHost
public String getZkHost()
- Returns:
- the zkHost value used to connect to zookeeper.
-
getZkStateReader
public ZkStateReader getZkStateReader()
-
setIdField
public void setIdField(String idField)
- Parameters:
idField- the field to route documents on.
-
getIdField
public String getIdField()
- Returns:
- the field that updates are routed on.
-
setDefaultCollection
public void setDefaultCollection(String collection)
Sets the default collection for request
-
getDefaultCollection
public String getDefaultCollection()
Gets the default collection for request
-
setZkConnectTimeout
public void setZkConnectTimeout(int zkConnectTimeout)
Set the connect timeout to the zookeeper ensemble in ms
-
setZkClientTimeout
public void setZkClientTimeout(int zkClientTimeout)
Set the timeout to the zookeeper ensemble in ms
-
isParallelUpdates
public boolean isParallelUpdates()
Gets whether direct updates are sent in parallel
-
connect
public void connect()
Connect to the zookeeper ensemble. This is an optional method that may be used to force a connect before any other requests are sent.
-
connect
public void connect(long duration, TimeUnit timeUnit) throws TimeoutException, InterruptedExceptionConnect to a cluster. If the cluster is not ready, retry connection up to a given timeout.- Parameters:
duration- the timeouttimeUnit- the units of the timeout- Throws:
TimeoutException- if the cluster is not ready after the timeoutInterruptedException- if the wait is interrupted
-
waitForState
public void waitForState(String collection, long wait, TimeUnit unit, CollectionStatePredicate predicate) throws InterruptedException, TimeoutException
Block until a collection state matches a predicate, or a timeout Note that the predicate may be called again even after it has returned true, so implementors should avoid changing state within the predicate call itself.- Parameters:
collection- the collection to watchwait- how long to waitunit- the units of the wait parameterpredicate- aCollectionStatePredicateto check the collection state- Throws:
InterruptedException- on interruptTimeoutException- on timeout
-
registerCollectionStateWatcher
public void registerCollectionStateWatcher(String collection, CollectionStateWatcher watcher)
Register a CollectionStateWatcher to be called when the cluster state for a collection changes Note that the watcher is unregistered after it has been called once. To make a watcher persistent, it should re-register itself in itsCollectionStateWatcher.onStateChanged(Set, DocCollection)call- Parameters:
collection- the collection to watchwatcher- a watcher that will be called when the state changes
-
getRouteException
protected BaseCloudSolrClient.RouteException getRouteException(SolrException.ErrorCode serverError, NamedList<Throwable> exceptions, Map<String,? extends LBSolrClient.Req> routes)
-
createRoutes
protected Map<String,? extends LBSolrClient.Req> createRoutes(UpdateRequest updateRequest, ModifiableSolrParams routableParams, DocCollection col, DocRouter router, Map<String,List<String>> urlMap, String idField)
-
condenseResponse
protected <T extends BaseCloudSolrClient.RouteResponse> T condenseResponse(NamedList response, int timeMillis, Supplier<T> supplier)
-
condenseResponse
public BaseCloudSolrClient.RouteResponse condenseResponse(NamedList response, int timeMillis)
-
request
public NamedList<Object> request(SolrRequest request, String collection) throws SolrServerException, IOException
Description copied from class:SolrClientExecute a request against a Solr server for a given collection- Specified by:
requestin classSolrClient- Parameters:
request- the request to executecollection- the collection to execute the request against- Returns:
- a
NamedListcontaining the response from the server - Throws:
SolrServerException- if there is an error on the serverIOException- If there is a low-level I/O error.
-
requestWithRetryOnStaleState
protected NamedList<Object> requestWithRetryOnStaleState(SolrRequest request, int retryCount, List<String> inputCollections) throws SolrServerException, IOException
As this class doesn't watch external collections on the client side, there's a chance that the request will fail due to cached stale state, which means the state must be refreshed from ZK and retried.- Throws:
SolrServerExceptionIOException
-
sendRequest
protected NamedList<Object> sendRequest(SolrRequest request, List<String> inputCollections) throws SolrServerException, IOException
- Throws:
SolrServerExceptionIOException
-
isUpdatesToLeaders
public boolean isUpdatesToLeaders()
-
isDirectUpdatesToLeadersOnly
public boolean isDirectUpdatesToLeadersOnly()
- Returns:
- true if direct updates are sent to shard leaders only
-
setParallelCacheRefreshes
public void setParallelCacheRefreshes(int n)
If caches are expired they are refreshed after acquiring a lock. use this to set the number of locks
-
getDocCollection
protected DocCollection getDocCollection(String collection, Integer expectedVersion) throws SolrException
- Throws:
SolrException
-
getMinAchievedReplicationFactor
public int getMinAchievedReplicationFactor(String collection, NamedList resp)
Useful for determining the minimum achieved replication factor across all shards involved in processing an update request, typically useful for gauging the replication factor of a batch.
-
getShardReplicationFactor
public Map<String,Integer> getShardReplicationFactor(String collection, NamedList resp)
Walks the NamedList response after performing an update request looking for the replication factor that was achieved in each shard involved in the request. For single doc updates, there will be only one shard in the return value.
-
-