Package org.apache.solr.common.cloud

Class ZkMaintenanceUtils

java.lang.Object

org.apache.solr.common.cloud.ZkMaintenanceUtils

public class ZkMaintenanceUtils
extends Object

Class to hold ZK upload/download/move common code. With the advent of the upconfig/downconfig/cp/ls/mv commands in bin/solr it made sense to keep the individual transfer methods in a central place, so here it is.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ZkMaintenanceUtils.VISIT_ORDER
static interface	ZkMaintenanceUtils.ZkVisitor

Field Summary

Fields

Modifier and Type	Field	Description
static String	CONFIGS_ZKNODE	ZkNode where named configs are stored
static Set<String>	DEFAULT_FORBIDDEN_FILE_TYPES
static String	FORBIDDEN_FILE_TYPES_ENV
static String	FORBIDDEN_FILE_TYPES_PROP
static Pattern	UPLOAD_FILENAME_EXCLUDE_PATTERN	files matching this pattern will not be uploaded to ZkNode /configs
static String	UPLOAD_FILENAME_EXCLUDE_REGEX

Method Summary

Modifier and Type	Method	Description
static void	clean(SolrZkClient zkClient, String path)
static void	clean(SolrZkClient zkClient, String path, Predicate<String> filter)	Delete a path and all of its sub nodes
static String	createZkNodeName(String zkRoot, Path root, Path file)
static void	downloadFromZK(SolrZkClient zkClient, String zkPath, Path file)
static String	getZkParent(String path)
static boolean	isFileForbiddenInConfigSets(String filePath)
static String	listZnode(SolrZkClient zkClient, String path, Boolean recurse)	Lists a ZNode child and (optionally) the znodes of all the children.
static void	moveZnode(SolrZkClient zkClient, String src, String dst)
static void	traverseZkTree(SolrZkClient zkClient, String path, ZkMaintenanceUtils.VISIT_ORDER visitOrder, ZkMaintenanceUtils.ZkVisitor visitor)	Recursively visit a zk tree rooted at path and apply the given visitor to each path.
static void	uploadToZK(SolrZkClient zkClient, Path fromPath, String zkPath, Pattern filenameExclusions)
static void	zkTransfer(SolrZkClient zkClient, String src, Boolean srcIsZk, String dst, Boolean dstIsZk, Boolean recurse)	Copy between local file system and Zookeeper, or from one Zookeeper node to another, optionally copying recursively.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CONFIGS_ZKNODE

public static final String CONFIGS_ZKNODE

ZkNode where named configs are stored

See Also:

Constant Field Values

UPLOAD_FILENAME_EXCLUDE_REGEX

public static final String UPLOAD_FILENAME_EXCLUDE_REGEX

See Also:

Constant Field Values

UPLOAD_FILENAME_EXCLUDE_PATTERN

public static final Pattern UPLOAD_FILENAME_EXCLUDE_PATTERN

files matching this pattern will not be uploaded to ZkNode /configs

FORBIDDEN_FILE_TYPES_PROP

public static final String FORBIDDEN_FILE_TYPES_PROP

See Also:

Constant Field Values

FORBIDDEN_FILE_TYPES_ENV

public static final String FORBIDDEN_FILE_TYPES_ENV

See Also:

Constant Field Values

DEFAULT_FORBIDDEN_FILE_TYPES

public static final Set<String> DEFAULT_FORBIDDEN_FILE_TYPES

Method Detail

listZnode

public static String listZnode(SolrZkClient zkClient,
                               String path,
                               Boolean recurse)
                        throws org.apache.zookeeper.KeeperException,
                               InterruptedException,
                               org.apache.solr.client.solrj.SolrServerException

Lists a ZNode child and (optionally) the znodes of all the children. No data is dumped.

Parameters:

path - The node to remove on Zookeeper

recurse - Whether to remove children.

Returns:

an indented list of the znodes suitable for display

Throws:

org.apache.zookeeper.KeeperException - Could not perform the Zookeeper operation.

InterruptedException - Thread interrupted

org.apache.solr.client.solrj.SolrServerException - zookeeper node has children and recurse not specified.

zkTransfer

public static void zkTransfer(SolrZkClient zkClient,
                              String src,
                              Boolean srcIsZk,
                              String dst,
                              Boolean dstIsZk,
                              Boolean recurse)
                       throws org.apache.solr.client.solrj.SolrServerException,
                              org.apache.zookeeper.KeeperException,
                              InterruptedException,
                              IOException

Copy between local file system and Zookeeper, or from one Zookeeper node to another, optionally copying recursively.

Parameters:

src - Source to copy from. Both src and dst may be Znodes. However, both may NOT be local

dst - The place to copy the files too. Both src and dst may be Znodes. However both may NOT be local

recurse - if the source is a directory, reccursively copy the contents iff this is true.

Throws:

org.apache.solr.client.solrj.SolrServerException - Explanatory exception due to bad params, failed operation, etc.

org.apache.zookeeper.KeeperException - Could not perform the Zookeeper operation.

InterruptedException - Thread interrupted

IOException

moveZnode

public static void moveZnode(SolrZkClient zkClient,
                             String src,
                             String dst)
                      throws org.apache.solr.client.solrj.SolrServerException,
                             org.apache.zookeeper.KeeperException,
                             InterruptedException

Throws:

org.apache.solr.client.solrj.SolrServerException

org.apache.zookeeper.KeeperException

InterruptedException

clean

public static void clean(SolrZkClient zkClient,
                         String path)
                  throws InterruptedException,
                         org.apache.zookeeper.KeeperException

Throws:

InterruptedException

org.apache.zookeeper.KeeperException

clean

public static void clean(SolrZkClient zkClient,
                         String path,
                         Predicate<String> filter)
                  throws InterruptedException,
                         org.apache.zookeeper.KeeperException

Delete a path and all of its sub nodes

Parameters:

filter - for node to be deleted

Throws:

InterruptedException

org.apache.zookeeper.KeeperException

uploadToZK

public static void uploadToZK(SolrZkClient zkClient,
                              Path fromPath,
                              String zkPath,
                              Pattern filenameExclusions)
                       throws IOException

Throws:

IOException

downloadFromZK

public static void downloadFromZK(SolrZkClient zkClient,
                                  String zkPath,
                                  Path file)
                           throws IOException

Throws:

IOException

traverseZkTree

public static void traverseZkTree(SolrZkClient zkClient,
                                  String path,
                                  ZkMaintenanceUtils.VISIT_ORDER visitOrder,
                                  ZkMaintenanceUtils.ZkVisitor visitor)
                           throws InterruptedException,
                                  org.apache.zookeeper.KeeperException

Recursively visit a zk tree rooted at path and apply the given visitor to each path. Exists as a separate method because some of the logic can get nuanced.

Parameters:

path - the path to start from

visitOrder - whether to call the visitor at the at the ending or beginning of the run.

visitor - the operation to perform on each path

Throws:

InterruptedException

org.apache.zookeeper.KeeperException

getZkParent

public static String getZkParent(String path)

createZkNodeName

public static String createZkNodeName(String zkRoot,
                                      Path root,
                                      Path file)

isFileForbiddenInConfigSets

public static boolean isFileForbiddenInConfigSets(String filePath)