Package org.apache.solr.hdfs.update

Class HdfsUpdateLog

java.lang.Object

org.apache.solr.update.UpdateLog

org.apache.solr.hdfs.update.HdfsUpdateLog

All Implemented Interfaces:

AutoCloseable, SolrMetricProducer, PluginInfoInitialized

public class HdfsUpdateLog
extends UpdateLog

WARNING: This API is experimental and might change in incompatible ways in the next release.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.solr.update.UpdateLog

UpdateLog.DBQ, UpdateLog.DeleteUpdate, UpdateLog.LogPtr, UpdateLog.RecentUpdates, UpdateLog.RecoveryInfo, UpdateLog.State, UpdateLog.SyncLevel, UpdateLog.Update

Field Summary

Fields

Modifier and Type	Field	Description
static AtomicLong	INIT_FAILED_LOGS_COUNT

Fields inherited from class org.apache.solr.update.UpdateLog

ADD, applyingBufferedOpsMeter, BUFFER_TLOG_NAME, bufferedOpsGauge, bufferTlog, cancelApplyBufferUpdate, COMMIT, copyOverOldUpdatesMeter, dataDir, defaultSyncLevel, DELETE, DELETE_BY_QUERY, deleteByQueries, existOldBufferLog, FLAGS_IDX, globalStrings, id, LOG_FILENAME_PATTERN, logs, map, maxNumLogsToKeep, newestLogsOnStartup, numDeletesByQueryToKeep, numDeletesToKeep, numOldRecords, numRecordsToKeep, oldDeletes, OPERATION_MASK, PREV_POINTER_IDX, PREV_VERSION_IDX, prevMap, prevMap2, prevMapLog, prevMapLog2, prevTlog, prevTlogOnPrecommit, recoveryInfo, releaseTlogDir, replayOpsMeter, solrMetricsContext, startingVersions, state, testing_logReplayFinishHook, testing_logReplayHook, tlog, TLOG_NAME, tlogDir, tlogFiles, uhandler, UPDATE_INPLACE, VERSION_IDX, versionInfo

Constructor Summary

Constructors

Constructor	Description
HdfsUpdateLog()
HdfsUpdateLog(String confDir)

Method Summary

Modifier and Type	Method	Description
void	clearLog()	Clears the logs on the file system.
void	close(boolean committed)
protected void	deleteBufferLogs()
protected void	ensureBufferTlog()
protected void	ensureLog()
static String[]	getBufferLogList(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path tlogDir)
static String[]	getLogList(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path tlogDir)
String[]	getLogList(org.apache.hadoop.fs.Path tlogDir)
String	getTlogDir()
void	init(PluginInfo info)
protected void	initTlogDir(SolrCore core)
void	preSoftCommit(CommitUpdateCommand cmd)
protected String	resolveDataDir(SolrCore core, String path)
String	toString()	Returns true if we were able to drop buffered updates and return to the ACTIVE state

Methods inherited from class org.apache.solr.update.UpdateLog

add, add, addOldLog, applyBufferedUpdates, applyPartialUpdates, bufferUpdates, close, commitAndSwitchToNewTlog, convertTlogEntryToAddUpdateCommand, copyOverBufferingUpdates, copyOverOldUpdates, copyOverOldUpdates, delete, deleteAll, deleteByQuery, deleteFile, dropBufferedUpdates, existOldBufferLog, finish, getCurrentLogSizeFromStream, getDBQNewer, getLastLogId, getLocks, getLogList, getMaxNumLogsToKeep, getNumRecordsToKeep, getRecentUpdates, getSolrMetricsContext, getStartingVersions, getState, getTotalLogsNumber, getTotalLogsSize, getUlogDir, getVersionInfo, hasUncommittedChanges, init, initializeMetrics, lookup, lookupVersion, maybeClearLog, newMap, newTransactionLog, objToInt, openRealtimeSearcher, postCommit, postSoftCommit, preCommit, recoverFromCurrentLog, recoverFromLog, trackDeleteByQuery, ulogToTlogDir

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.solr.metrics.SolrMetricProducer

close

Field Detail

INIT_FAILED_LOGS_COUNT

public static AtomicLong INIT_FAILED_LOGS_COUNT

Constructor Detail

HdfsUpdateLog

public HdfsUpdateLog()

HdfsUpdateLog

public HdfsUpdateLog(String confDir)

Method Detail

init

public void init(PluginInfo info)

Specified by:

init in interface PluginInfoInitialized

Overrides:

init in class UpdateLog

initTlogDir

protected void initTlogDir(SolrCore core)

Overrides:

initTlogDir in class UpdateLog

resolveDataDir

protected String resolveDataDir(SolrCore core,
                                String path)

Overrides:

resolveDataDir in class UpdateLog

getTlogDir

public String getTlogDir()

Overrides:

getTlogDir in class UpdateLog

getBufferLogList

public static String[] getBufferLogList(org.apache.hadoop.fs.FileSystem fs,
                                        org.apache.hadoop.fs.Path tlogDir)

getLogList

public static String[] getLogList(org.apache.hadoop.fs.FileSystem fs,
                                  org.apache.hadoop.fs.Path tlogDir)

close

public void close(boolean committed)

Overrides:

close in class UpdateLog

ensureBufferTlog

protected void ensureBufferTlog()

Overrides:

ensureBufferTlog in class UpdateLog

deleteBufferLogs

protected void deleteBufferLogs()

Overrides:

deleteBufferLogs in class UpdateLog

ensureLog

protected void ensureLog()

Overrides:

ensureLog in class UpdateLog

clearLog

public void clearLog()

Clears the logs on the file system. Only call before init.

Overrides:

clearLog in class UpdateLog

preSoftCommit

public void preSoftCommit(CommitUpdateCommand cmd)

Overrides:

preSoftCommit in class UpdateLog

getLogList

public String[] getLogList(org.apache.hadoop.fs.Path tlogDir)
                    throws FileNotFoundException,
                           IOException

Throws:

FileNotFoundException

IOException

toString

public String toString()

Returns true if we were able to drop buffered updates and return to the ACTIVE state

Overrides:

toString in class UpdateLog