org.apache.pulsar.zookeeper

Class ZkIsolatedBookieEnsemblePlacementPolicy

java.lang.Object

org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicyImpl

org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicy

org.apache.pulsar.zookeeper.ZkIsolatedBookieEnsemblePlacementPolicy

All Implemented Interfaces:

EnsemblePlacementPolicy, ITopologyAwareEnsemblePlacementPolicy<org.apache.bookkeeper.net.BookieNode>, ZooKeeperCache.Deserializer<BookiesRackConfiguration>

public class ZkIsolatedBookieEnsemblePlacementPolicy
extends RackawareEnsemblePlacementPolicy
implements ZooKeeperCache.Deserializer<BookiesRackConfiguration>

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	TopologyAwareEnsemblePlacementPolicy.EnsembleForReplacementWithNoConstraints
protected static class	TopologyAwareEnsemblePlacementPolicy.RRTopologyAwareCoverageEnsemble
protected static class	TopologyAwareEnsemblePlacementPolicy.TruePredicate

Nested classes/interfaces inherited from interface org.apache.bookkeeper.client.ITopologyAwareEnsemblePlacementPolicy

ITopologyAwareEnsemblePlacementPolicy.Ensemble<T extends org.apache.bookkeeper.net.Node>, ITopologyAwareEnsemblePlacementPolicy.Predicate<T extends org.apache.bookkeeper.net.Node>

Nested classes/interfaces inherited from interface org.apache.bookkeeper.client.EnsemblePlacementPolicy

EnsemblePlacementPolicy.PlacementPolicyAdherence, EnsemblePlacementPolicy.PlacementResult<T>

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.bookkeeper.proto.BookieAddressResolver	bookieAddressResolver
protected Map<org.apache.bookkeeper.net.BookieNode,WeightedRandomSelection.WeightedObject>	bookieInfoMap
protected org.apache.bookkeeper.stats.OpStatsLogger	bookiesJoinedCounter
protected org.apache.bookkeeper.stats.OpStatsLogger	bookiesLeftCounter
protected org.apache.bookkeeper.net.DNSToSwitchMapping	dnsResolver
static String	ISOLATION_BOOKIE_GROUPS
protected Map<org.apache.bookkeeper.net.BookieId,org.apache.bookkeeper.net.BookieNode>	knownBookies
protected com.google.common.collect.ImmutableSet<org.apache.bookkeeper.net.BookieId>	readOnlyBookies
protected ReentrantReadWriteLock	rwLock
static String	SECONDARY_ISOLATION_BOOKIE_GROUPS
protected org.apache.bookkeeper.net.NetworkTopology	topology
protected org.apache.bookkeeper.client.WeightedRandomSelection<org.apache.bookkeeper.net.BookieNode>	weightedSelection

Fields inherited from class org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicyImpl

enforceDurability, enforceMinNumRacksPerWriteQuorum, failedToResolveNetworkLocationCounter, ignoreLocalNodeInPlacementPolicy, localNode, minNumRacksPerWriteQuorum, numWritableBookiesInDefaultRack, readReorderedCounter, reorderReadsRandom, reorderThresholdPendingRequests, REPP_DNS_RESOLVER_CLASS, REPP_RANDOM_READ_REORDERING, slowBookies, stabilizePeriodSeconds, statsLogger, timer

Constructor Summary

Constructors

Constructor and Description
ZkIsolatedBookieEnsemblePlacementPolicy()

Method Summary

Modifier and Type	Method and Description
protected Set<org.apache.bookkeeper.net.Node>	convertBookiesToNodes(Collection<org.apache.bookkeeper.net.BookieId> arg0)
protected org.apache.bookkeeper.net.BookieNode	createBookieNode(org.apache.bookkeeper.net.BookieId arg0)
protected org.apache.bookkeeper.net.BookieNode	createDummyLocalBookieNode(String arg0)
BookiesRackConfiguration	deserialize(String key, byte[] content)
RackawareEnsemblePlacementPolicyImpl	initialize(org.apache.bookkeeper.conf.ClientConfiguration conf, Optional<org.apache.bookkeeper.net.DNSToSwitchMapping> optionalDnsResolver, io.netty.util.HashedWheelTimer timer, org.apache.bookkeeper.feature.FeatureProvider featureProvider, org.apache.bookkeeper.stats.StatsLogger statsLogger, org.apache.bookkeeper.proto.BookieAddressResolver bookieAddressResolver)
EnsemblePlacementPolicy.PlacementResult<List<org.apache.bookkeeper.net.BookieId>>	newEnsemble(int ensembleSize, int writeQuorumSize, int ackQuorumSize, Map<String,byte[]> customMetadata, Set<org.apache.bookkeeper.net.BookieId> excludeBookies)
EnsemblePlacementPolicy.PlacementResult<org.apache.bookkeeper.net.BookieId>	replaceBookie(int ensembleSize, int writeQuorumSize, int ackQuorumSize, Map<String,byte[]> customMetadata, List<org.apache.bookkeeper.net.BookieId> currentEnsemble, org.apache.bookkeeper.net.BookieId bookieToReplace, Set<org.apache.bookkeeper.net.BookieId> excludeBookies)
protected String	resolveNetworkLocation(org.apache.bookkeeper.net.BookieId arg0)

Methods inherited from class org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicy

handleBookiesThatJoined, handleBookiesThatLeft, initialize, newEnsemble, onClusterChanged, reorderReadLACSequence, reorderReadSequence, selectFromNetworkLocation, selectFromNetworkLocation, selectFromNetworkLocation, uninitalize

Methods inherited from class org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicyImpl

addDefaultRackBookiesIfMinNumRacksIsEnforced, areAckedBookiesAdheringToPlacementPolicy, getDefaultRack, isEnsembleAdheringToPlacementPolicy, newEnsembleInternal, registerSlowBookie, selectRandom, selectRandomFromRack, selectRandomInternal, withDefaultRack

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.bookkeeper.client.ITopologyAwareEnsemblePlacementPolicy

onBookieRackChange

Methods inherited from interface org.apache.bookkeeper.client.EnsemblePlacementPolicy

areAckedBookiesAdheringToPlacementPolicy, getStickyReadBookieIndex, isEnsembleAdheringToPlacementPolicy, registerSlowBookie, updateBookieInfo

Field Detail

ISOLATION_BOOKIE_GROUPS

public static final String ISOLATION_BOOKIE_GROUPS

See Also:

Constant Field Values

SECONDARY_ISOLATION_BOOKIE_GROUPS

public static final String SECONDARY_ISOLATION_BOOKIE_GROUPS

See Also:

Constant Field Values

knownBookies

protected final Map<org.apache.bookkeeper.net.BookieId,org.apache.bookkeeper.net.BookieNode> knownBookies

rwLock

protected final ReentrantReadWriteLock rwLock

bookieInfoMap

protected Map<org.apache.bookkeeper.net.BookieNode,WeightedRandomSelection.WeightedObject> bookieInfoMap

readOnlyBookies

protected com.google.common.collect.ImmutableSet<org.apache.bookkeeper.net.BookieId> readOnlyBookies

weightedSelection

protected org.apache.bookkeeper.client.WeightedRandomSelection<org.apache.bookkeeper.net.BookieNode> weightedSelection

topology

protected org.apache.bookkeeper.net.NetworkTopology topology

dnsResolver

protected org.apache.bookkeeper.net.DNSToSwitchMapping dnsResolver

bookieAddressResolver

protected org.apache.bookkeeper.proto.BookieAddressResolver bookieAddressResolver

bookiesJoinedCounter

@StatsDoc(name="BOOKIES_JOINED",
          help="The distribution of number of bookies joined the cluster on each network topology change")
protected org.apache.bookkeeper.stats.OpStatsLogger bookiesJoinedCounter

bookiesLeftCounter

@StatsDoc(name="BOOKIES_LEFT",
          help="The distribution of number of bookies left the cluster on each network topology change")
protected org.apache.bookkeeper.stats.OpStatsLogger bookiesLeftCounter

Constructor Detail

ZkIsolatedBookieEnsemblePlacementPolicy

public ZkIsolatedBookieEnsemblePlacementPolicy()

Method Detail

initialize

public RackawareEnsemblePlacementPolicyImpl initialize(org.apache.bookkeeper.conf.ClientConfiguration conf,
                                                       Optional<org.apache.bookkeeper.net.DNSToSwitchMapping> optionalDnsResolver,
                                                       io.netty.util.HashedWheelTimer timer,
                                                       org.apache.bookkeeper.feature.FeatureProvider featureProvider,
                                                       org.apache.bookkeeper.stats.StatsLogger statsLogger,
                                                       org.apache.bookkeeper.proto.BookieAddressResolver bookieAddressResolver)

Specified by:

initialize in interface EnsemblePlacementPolicy

Overrides:

initialize in class RackawareEnsemblePlacementPolicyImpl

newEnsemble

public EnsemblePlacementPolicy.PlacementResult<List<org.apache.bookkeeper.net.BookieId>> newEnsemble(int ensembleSize,
                                                                                                     int writeQuorumSize,
                                                                                                     int ackQuorumSize,
                                                                                                     Map<String,byte[]> customMetadata,
                                                                                                     Set<org.apache.bookkeeper.net.BookieId> excludeBookies)
                                                                                              throws BKException.BKNotEnoughBookiesException

Specified by:

newEnsemble in interface EnsemblePlacementPolicy

Overrides:

newEnsemble in class RackawareEnsemblePlacementPolicy

Throws:

BKException.BKNotEnoughBookiesException

replaceBookie

public EnsemblePlacementPolicy.PlacementResult<org.apache.bookkeeper.net.BookieId> replaceBookie(int ensembleSize,
                                                                                                 int writeQuorumSize,
                                                                                                 int ackQuorumSize,
                                                                                                 Map<String,byte[]> customMetadata,
                                                                                                 List<org.apache.bookkeeper.net.BookieId> currentEnsemble,
                                                                                                 org.apache.bookkeeper.net.BookieId bookieToReplace,
                                                                                                 Set<org.apache.bookkeeper.net.BookieId> excludeBookies)
                                                                                          throws BKException.BKNotEnoughBookiesException

Specified by:

replaceBookie in interface EnsemblePlacementPolicy

Overrides:

replaceBookie in class RackawareEnsemblePlacementPolicy

Throws:

BKException.BKNotEnoughBookiesException

deserialize

public BookiesRackConfiguration deserialize(String key,
                                            byte[] content)
                                     throws Exception

Specified by:

deserialize in interface ZooKeeperCache.Deserializer<BookiesRackConfiguration>

Throws:

Exception

createBookieNode

protected org.apache.bookkeeper.net.BookieNode createBookieNode(org.apache.bookkeeper.net.BookieId arg0)

createDummyLocalBookieNode

protected org.apache.bookkeeper.net.BookieNode createDummyLocalBookieNode(String arg0)

resolveNetworkLocation

protected String resolveNetworkLocation(org.apache.bookkeeper.net.BookieId arg0)

convertBookiesToNodes

protected Set<org.apache.bookkeeper.net.Node> convertBookiesToNodes(Collection<org.apache.bookkeeper.net.BookieId> arg0)