org.apache.solr.update

Class HdfsUpdateLog

java.lang.Object

org.apache.solr.update.UpdateLog

org.apache.solr.update.HdfsUpdateLog

All Implemented Interfaces:

AutoCloseable, SolrMetricProducer, PluginInfoInitialized

public class HdfsUpdateLog
extends UpdateLog

WARNING: This API is experimental and might change in incompatible ways in the next release.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.solr.update.UpdateLog

UpdateLog.DBQ, UpdateLog.LogPtr, UpdateLog.RecentUpdates, UpdateLog.RecoveryInfo, UpdateLog.State, UpdateLog.SyncLevel

Field Summary

Fields

Modifier and Type	Field and Description
static AtomicLong	INIT_FAILED_LOGS_COUNT

Fields inherited from class org.apache.solr.update.UpdateLog

ADD, applyingBufferedOpsMeter, BUFFER_TLOG_NAME, bufferedOpsGauge, bufferTlog, cancelApplyBufferUpdate, COMMIT, copyOverOldUpdatesMeter, dataDir, defaultSyncLevel, DELETE, DELETE_BY_QUERY, deleteByQueries, existOldBufferLog, FLAGS_IDX, globalStrings, lastDataDir, LOG_FILENAME_PATTERN, logs, map, maxNumLogsToKeep, maxVersionFromIndex, metricManager, newestLogsOnStartup, numDeletesByQueryToKeep, numDeletesToKeep, numOldRecords, numRecordsToKeep, numVersionBuckets, oldDeletes, OPERATION_MASK, PREV_POINTER_IDX, PREV_VERSION_IDX, prevMap, prevMap2, prevMapLog, prevMapLog2, prevTlog, prevTlogOnPrecommit, recoveryInfo, registryName, replayOpsMeter, state, testing_logReplayFinishHook, testing_logReplayHook, tlog, TLOG_NAME, tlogFiles, UPDATE_INPLACE, VERSION_IDX, versionInfo

Constructor Summary

Constructors

Constructor and Description
HdfsUpdateLog()
HdfsUpdateLog(String confDir)

Method Summary

Modifier and Type	Method and Description
void	clearLog(SolrCore core, PluginInfo ulogPluginInfo) Clears the logs on the file system.
void	close(boolean committed)
void	close(boolean committed, boolean deleteOnClose)
protected void	deleteBufferLogs()
protected void	ensureBufferTlog()
protected void	ensureLog()
static String[]	getBufferLogList(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path tlogDir)
String	getLogDir()
static String[]	getLogList(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path tlogDir)
String[]	getLogList(org.apache.hadoop.fs.Path tlogDir)
void	init(PluginInfo info)
void	init(UpdateHandler uhandler, SolrCore core)
void	preSoftCommit(CommitUpdateCommand cmd)
String	toString() Returns true if we were able to drop buffered updates and return to the ACTIVE state

Methods inherited from class org.apache.solr.update.UpdateLog

add, add, addOldLog, applyBufferedUpdates, applyPartialUpdates, bufferUpdates, commitAndSwitchToNewTlog, convertTlogEntryToAddUpdateCommand, copyOverBufferingUpdates, copyOverOldUpdates, copyOverOldUpdates, delete, deleteAll, deleteByQuery, deleteFile, dropBufferedUpdates, existOldBufferLog, finish, getBufferLogList, getCurrentLogSizeFromStream, getCurrentMaxVersion, getDBQNewer, getFs, getLastLogId, getLogList, getMaxNumLogsToKeep, getNumRecordsToKeep, getNumVersionBuckets, getRecentUpdates, getStartingVersions, getState, getTlogDir, getTotalLogsNumber, getTotalLogsSize, getVersionInfo, hasUncommittedChanges, initializeMetrics, lookup, lookupVersion, newMap, newTransactionLog, objToInt, openRealtimeSearcher, postCommit, postSoftCommit, preCommit, recoverFromCurrentLog, recoverFromLog, seedBucketsWithHighestVersion, seedBucketsWithHighestVersion

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.solr.metrics.SolrMetricProducer

close, getSolrMetricsContext, getUniqueMetricTag, initializeMetrics

Field Detail

INIT_FAILED_LOGS_COUNT

public static AtomicLong INIT_FAILED_LOGS_COUNT

Constructor Detail

HdfsUpdateLog

public HdfsUpdateLog()

HdfsUpdateLog

public HdfsUpdateLog(String confDir)

Method Detail

init

public void init(PluginInfo info)

Specified by:

init in interface PluginInfoInitialized

Overrides:

init in class UpdateLog

init

public void init(UpdateHandler uhandler,
                 SolrCore core)

Overrides:

init in class UpdateLog

getLogDir

public String getLogDir()

Overrides:

getLogDir in class UpdateLog

getBufferLogList

public static String[] getBufferLogList(org.apache.hadoop.fs.FileSystem fs,
                                        org.apache.hadoop.fs.Path tlogDir)

getLogList

public static String[] getLogList(org.apache.hadoop.fs.FileSystem fs,
                                  org.apache.hadoop.fs.Path tlogDir)

close

public void close(boolean committed)

Overrides:

close in class UpdateLog

close

public void close(boolean committed,
                  boolean deleteOnClose)

Overrides:

close in class UpdateLog

ensureBufferTlog

protected void ensureBufferTlog()

Overrides:

ensureBufferTlog in class UpdateLog

deleteBufferLogs

protected void deleteBufferLogs()

Overrides:

deleteBufferLogs in class UpdateLog

ensureLog

protected void ensureLog()

Overrides:

ensureLog in class UpdateLog

clearLog

public void clearLog(SolrCore core,
                     PluginInfo ulogPluginInfo)

Clears the logs on the file system. Only call before init.

Overrides:

clearLog in class UpdateLog

Parameters:

core - the SolrCore

ulogPluginInfo - the init info for the UpdateHandler

preSoftCommit

public void preSoftCommit(CommitUpdateCommand cmd)

Overrides:

preSoftCommit in class UpdateLog

getLogList

public String[] getLogList(org.apache.hadoop.fs.Path tlogDir)
                    throws FileNotFoundException,
                           IOException

Throws:

FileNotFoundException

IOException

toString

public String toString()

Returns true if we were able to drop buffered updates and return to the ACTIVE state

Overrides:

toString in class UpdateLog