A B C D E F G H I L M N O P R S T U V W X Y Z

A

AbstractFileOutputFormat<T> - Class in org.openstreetmap.atlas.generator.persistence

Abstract implementation of FileOutputFormat that takes care of the RecordWriter

AbstractFileOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

AbstractMultipleAtlasBasedOutputFormat<Type> - Class in org.openstreetmap.atlas.generator.persistence

Default MultipleOutputFormat for the Atlas jobs.

AbstractMultipleAtlasBasedOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AbstractMultipleAtlasBasedOutputFormat

accept(Path) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.CountrySpecificAtlasFilePathFilter

AddedAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

FileOutputFormat that writes an AtlasStatistics.

AddedAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.AddedAtlasDeltaOutputFormat

AddedMultipleAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

MultipleOutputFormat for the AtlasStatistics, based on the model of MultipleTextOutputFormat

AddedMultipleAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.AddedMultipleAtlasDeltaOutputFormat

ADDITIONAL_SPARK_OPTIONS - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

addResource(String, Resource) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

append(Path, int, Progressable) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

apply(SparkConf) - Method in class org.openstreetmap.atlas.generator.tools.spark.context.DefaultSparkContextProvider

ATLAS_FLAVOR - Static variable in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

ATLAS_FOLDER - Static variable in class org.openstreetmap.atlas.generator.AtlasGenerator

ATLAS_SCHEME - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

AtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

FileOutputFormat that writes an AtlasStatistics.

AtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.AtlasDeltaOutputFormat

atlasFetcher(HadoopAtlasFileCache, String, Set<Shard>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

atlasFiles(JavaSparkContext, String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.input.SparkInput

Load Atlas files from an input path

atlasForShard(String, Iterable<String>) - Method in class org.openstreetmap.atlas.generator.AtlasLocator

atlasForShard(String, String) - Method in class org.openstreetmap.atlas.generator.AtlasLocator

AtlasGenerator - Class in org.openstreetmap.atlas.generator

Generate Atlas Shards for a specific version and a specific set of countries

AtlasGenerator() - Constructor for class org.openstreetmap.atlas.generator.AtlasGenerator

AtlasGeneratorHelper - Class in org.openstreetmap.atlas.generator

Utility class for AtlasGenerator.

AtlasGeneratorHelper.NamedAtlasStatistics - Class in org.openstreetmap.atlas.generator

AtlasGeneratorParameters - Class in org.openstreetmap.atlas.generator

AtlasGeoJsonOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

AtlasGeoJsonOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AtlasGeoJsonOutputFormat

AtlasLocator - Class in org.openstreetmap.atlas.generator

Locate Atlas Files.

AtlasLocator(Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.AtlasLocator

AtlasMissingShardVerifier - Class in org.openstreetmap.atlas.generator.sharding

Checks intersection of country boundary and shards to validate missing shards.

AtlasMissingShardVerifier() - Constructor for class org.openstreetmap.atlas.generator.sharding.AtlasMissingShardVerifier

AtlasOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

FileOutputFormat that writes an Atlas.

AtlasOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AtlasOutputFormat

AtlasProtoOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

FileOutputFormat that writes an Atlas in protocol buffer format.

AtlasProtoOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AtlasProtoOutputFormat

AtlasSharding - Class in org.openstreetmap.atlas.generator.sharding

Convenience methods to get a sharding for the AtlasGenerator

AtlasShardVerifier - Class in org.openstreetmap.atlas.generator.sharding

AtlasShardVerifier() - Constructor for class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

AtlasStatisticsOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

FileOutputFormat that writes an AtlasStatistics.

AtlasStatisticsOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AtlasStatisticsOutputFormat

B

backwardConvert(Configuration) - Method in class org.openstreetmap.atlas.generator.tools.filesystem.converters.SparkConfToHadoopConfigurationConverter

binaryFile(JavaSparkContext, String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.input.SparkInput

Get an RDD from a binary file input

BOUNDARIES - Static variable in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

BOUNDARIES - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

bounds() - Method in class org.openstreetmap.atlas.generator.PbfLocator.LocatedPbf

buildAtlasLoadingOption(CountryBoundaryMap, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

buildCompactQuery(String, Rectangle) - Static method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

buildCompoundQuery(String, String, String, Rectangle) - Static method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

buildQuery(String, Rectangle) - Static method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

buildQuery(String, String, String, Rectangle) - Static method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

C

ChangedAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

FileOutputFormat that writes an AtlasStatistics.

ChangedAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.ChangedAtlasDeltaOutputFormat

ChangedMultipleAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

MultipleOutputFormat for the AtlasStatistics, based on the model of MultipleTextOutputFormat

ChangedMultipleAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.ChangedMultipleAtlasDeltaOutputFormat

close() - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

CODE_VERSION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

CODE_VERSION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

collectAtlasFiles(String, String, boolean) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Returns a list of Atlas Resources for the given country in the supplied directory

collectSourceFile(String, PathFilter...) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Returns an Atlas Resource for the given location URI string.

collectSourceFiles(String, boolean, PathFilter...) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Returns an list of Atlas Resources from the given location URI string.

combine(String, String...) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Combines given paths

commit(SparkFilePath) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Renames the SparkFilePath.temporaryPath to the SparkFilePath.targetPath, taking care to avoid producing nested directories.

commitByCopy(SparkFilePath) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Copies the SparkFilePath.temporaryPath to the SparkFilePath.targetPath, taking care to avoid producing nested directories.

compile(SlippyTile) - Method in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

compile(String, String, String) - Method in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

COMPRESS_OUTPUT - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

computeAtlasDelta(Map<String, String>, String) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

configuration() - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

configurationMap() - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

configuredConf() - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

configuredConfiguration() - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

convert(SparkConf) - Method in class org.openstreetmap.atlas.generator.tools.filesystem.converters.SparkConfToHadoopConfigurationConverter

convert(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.context.SparkContextProviderFinder

convert(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.converters.SparkOptionsStringConverter

convert(FileStatus) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

COUNTRIES - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

COUNTRIES - Static variable in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

COUNTRY - Static variable in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

COUNTRY_SHAPES - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

COUNTRY_SHAPES - Static variable in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

COUNTRY_STATISTICS_FOLDER - Static variable in class org.openstreetmap.atlas.generator.AtlasGenerator

CountrySpecificAtlasFilePathFilter - Class in org.openstreetmap.atlas.generator.tools.spark.utilities

Filters out country-specific Atlas files given a Hadoop file Path

CountrySpecificAtlasFilePathFilter(String) - Constructor for class org.openstreetmap.atlas.generator.tools.spark.utilities.CountrySpecificAtlasFilePathFilter

Constructs a filter for given country

create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

D

DATA_VERSION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

DATA_VERSION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

DataLocator<T> - Class in org.openstreetmap.atlas.generator.tools.spark

Locate and retrieve resources from a data store.

DataLocator(Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.spark.DataLocator

DataLocator.ResourceLocator - Class in org.openstreetmap.atlas.generator.tools.spark

Locator that returns Resources.

debug(Consumer<String>) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

DEFAULT_SCHEME - Static variable in class org.openstreetmap.atlas.generator.PbfLocator

DEFAULT_SCHEME - Static variable in class org.openstreetmap.atlas.generator.persistence.AbstractMultipleAtlasBasedOutputFormat

DefaultSparkContextProvider - Class in org.openstreetmap.atlas.generator.tools.spark.context

Default SparkContextProvider that provides a JavaSparkContext

DefaultSparkContextProvider() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.context.DefaultSparkContextProvider

delete(String, boolean, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

Deletes given path using given configuration settings.

delete(Path, boolean) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

deleteDirectory(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Deletes given directory and all it's child items

DIRECTORY_SEPARATOR - Static variable in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

directoryContainsExpectedCountryAtlases(String, StringList, boolean) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Verifies that the input directory containing Atlas files contains all the expected countries

E

EDGE_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

EDGE_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

EMPTY_STRING - Static variable in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

EmptySparkJob - Class in org.openstreetmap.atlas.generator.tools.spark.testing

EmptySparkJob() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

executeRename(Callable<Boolean>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemPerformanceHelper

exists(String) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

Check if the given path exists.

exists(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

Check if the given path exists.

exists(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

exists() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

EXITED_FILE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

EXTENSION_SEPARATOR - Static variable in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

extensionStartingWithSeparator(String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Removes EXTENSION_SEPARATOR from the beginning of given path

extractAtlasLoadingProperties(CommandMap, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

F

FAIL_FAST_CACHE_MISS - Static variable in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

FAILED_FILE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasGeoJsonOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasProtoOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasStatisticsOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.delta.AtlasDeltaOutputFormat

files() - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

FileSystemCreator - Class in org.openstreetmap.atlas.generator.tools.filesystem

Utility class that helps create a FileSystem using some Spark/Hadoop configuration key-values.

FileSystemCreator() - Constructor for class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemCreator

FileSystemHelper - Class in org.openstreetmap.atlas.generator.tools.filesystem

Utility class that helps generating Resource and WritableResource from a Hadoop Path.

FileSystemPerformanceHelper - Class in org.openstreetmap.atlas.generator.tools.filesystem

When working with a FileSystem that is slow at renaming, this provides a hack to speed up the rename of output files.

forString(String, Configuration) - Static method in class org.openstreetmap.atlas.generator.sharding.AtlasSharding

Parse a sharding definition string

forString(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.sharding.AtlasSharding

Parse a sharding definition string

from(Consumer<WritableResource>, SparkFilePath, String, String, String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileOutput

Constructs a SparkFileOutput from given parameters

from(Consumer<WritableResource>, String, String, String, String, String, String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileOutput

Constructs a SparkFileOutput from given parameters

G

generateAtlasStatistics(Broadcast<Sharding>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

generateFileNameForKeyValue(String, Type, String) - Method in class org.openstreetmap.atlas.generator.persistence.AbstractMultipleAtlasBasedOutputFormat

generateFileNameForKeyValue(String, AtlasStatistics, String) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasCountryStatisticsOutputFormat

generateRawAtlas(Broadcast<CountryBoundaryMap>, Map<String, String>, Broadcast<Map<String, String>>, PbfContext, SlippyTilePersistenceScheme) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

generateRawAtlas(String, Shard) - Method in class org.openstreetmap.atlas.generator.PbfLoader

generateTasks(StringList, CountryBoundaryMap, Sharding) - Static method in class org.openstreetmap.atlas.generator.AtlasGenerator

Generates a List of AtlasGenerationTasks for given countries using given CountryBoundaryMap and Sharding strategy.

get(String, Shard) - Method in class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Get an Optional of an atlas resource specified by the given parameters.

get(String, Configuration) - Method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemCreator

Create a FileSystem from a Hadoop Configuration

get(String, Map<String, String>) - Method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemCreator

Create a FileSystem from an agnostic configuration map

get(String, SparkConf) - Method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemCreator

Create a FileSystem from a SparkConf

getAlternateParallelFolderOutput(String, String) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

Get an alternate output based on the main output folder used for monitoring

getAlternateSubFolderOutput(String, String) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

Get an alternate output based on the main output folder used for monitoring.

getAtlasStatistics() - Method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper.NamedAtlasStatistics

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.delta.AddedMultipleAtlasDeltaOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.delta.ChangedMultipleAtlasDeltaOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.delta.MultipleAtlasDeltaOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.delta.RemovedMultipleAtlasDeltaOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasCountryStatisticsOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasGeoJsonOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasProtoOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasStatisticsOutputFormat

getContext() - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

getFileStatus(Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

getIdentifier() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

getLatitude() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

getLongitude() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

getName() - Method in class org.openstreetmap.atlas.generator.AtlasGenerator

getName() - Method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper.NamedAtlasStatistics

getName() - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

getName() - Method in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

getNodeIdentifiers() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

getOperationName() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileOutput

getOsmIdentifier() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

getPath() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileOutput

getPath() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

getPbfPath() - Method in class org.openstreetmap.atlas.generator.PbfContext

getPos() - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

getRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

getResource() - Method in class org.openstreetmap.atlas.generator.PbfLocator.LocatedPbf

getResponse(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

getRetries() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

getRetryWait() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

getSaveFunction() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileOutput

getScheme() - Method in class org.openstreetmap.atlas.generator.PbfContext

getScheme() - Method in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

getSharding() - Method in class org.openstreetmap.atlas.generator.PbfContext

getStandardConfigurationFrom(Resource) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

getTaggableFilterFrom(Resource) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

getTags() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

getTags() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

getTargetPath() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFilePath

getTemporaryPath() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFilePath

getUri() - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

getWorkingDirectory() - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

H

HadoopAtlasFileCache - Class in org.openstreetmap.atlas.generator.tools.caching

Cache an atlas file stored in the standard way (parentpath/COUNTRY/COUNTRY_z-x-y.atlas) to a system temporary location.

HadoopAtlasFileCache(String, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

HadoopAtlasFileCache(String, SlippyTilePersistenceScheme, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

HadoopAtlasFileCache(String, String, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

HadoopAtlasFileCache(String, String, SlippyTilePersistenceScheme, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

hasTooMuchResponseData() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

hasUnknownError() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

HDFSFile - Class in org.openstreetmap.atlas.generator.tools.streaming.resource

Readable and Writable resource for HDFS files

HDFSFile(Path) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSFile(Path, Configuration) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSFile(String) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSFile(String, Configuration) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSFile(String, int, String) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSFile(String, int, String, Configuration) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSWalker - Class in org.openstreetmap.atlas.generator.tools.streaming.resource

Inspired by Files.walk (https://docs.oracle.com/javase/8/docs/api/java/nio/file/Files.html#walk-java.nio.file.Path-int- java.nio.file.FileVisitOption...-), either retrieve a Stream of HDFS file status objects or convert them to HDFSFile objects.

HDFSWalker() - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

HDFSWalker(int) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

I

initialize(URI, Configuration) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

INPUT - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

input(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

invalidate(String, Shard) - Method in class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Invalidate a given shard for a given country.

isAppendToFile() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasGeoJsonOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasProtoOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasStatisticsOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.delta.AtlasDeltaOutputFormat

isDirectory(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

isDirectory() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

L

LENGTH - Static variable in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

length() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

list(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

listResourcesRecursively(String, Map<String, String>, PathFilter) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

listStatus(Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

LocatedPbf(Resource, Rectangle) - Constructor for class org.openstreetmap.atlas.generator.PbfLocator.LocatedPbf

M

main(String[]) - Static method in class org.openstreetmap.atlas.generator.AtlasGenerator

main(String[]) - Static method in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

main(String[]) - Static method in class org.openstreetmap.atlas.generator.sharding.AtlasMissingShardVerifier

main(String[]) - Static method in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

main(String[]) - Static method in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

main(String[]) - Static method in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

MASTER - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

mkdir(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

Creates a new directory for given path using given configuration settings.

mkdir(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Creates a directory via given path

mkdirs(boolean) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

mkdirs(Path, FsPermission) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

MultipleAtlasCountryStatisticsOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleOutputFormat for the country AtlasStatistics, based on the model of MultipleTextOutputFormat

MultipleAtlasCountryStatisticsOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleAtlasCountryStatisticsOutputFormat

MultipleAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

MultipleOutputFormat for the AtlasStatistics, based on the model of MultipleTextOutputFormat

MultipleAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.MultipleAtlasDeltaOutputFormat

MultipleAtlasGeoJsonOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleAtlasGeoJsonOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleAtlasGeoJsonOutputFormat

MultipleAtlasOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleOutputFormat for the Atlas, based on the model of MultipleTextOutputFormat

MultipleAtlasOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleAtlasOutputFormat

MultipleAtlasProtoOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleAtlasProtoOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleAtlasProtoOutputFormat

MultipleAtlasStatisticsOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleOutputFormat for the shard AtlasStatistics, based on the model of MultipleTextOutputFormat

MultipleAtlasStatisticsOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleAtlasStatisticsOutputFormat

N

NamedAtlasStatistics(String, AtlasStatistics) - Constructor for class org.openstreetmap.atlas.generator.AtlasGeneratorHelper.NamedAtlasStatistics

nodeIdsFromWayQuery(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

Makes a way Overpass query, parses the response xml, and returns the identifiers of nodes that make up the ways that match the query

nodesFromQuery(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

Makes a node Overpass query, parses the response xml, and returns the nodes that match the query

NUMBER_POOL_THREADS - Static variable in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemPerformanceHelper

O

onRead() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

onRun(CommandMap) - Method in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

onRun(CommandMap) - Method in class org.openstreetmap.atlas.generator.sharding.AtlasMissingShardVerifier

onRun(CommandMap) - Method in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

onRun(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

onRun(CommandMap) - Method in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

onWrite() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

open(Path, int) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

openRenamePool() - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemPerformanceHelper

org.openstreetmap.atlas.generator - package org.openstreetmap.atlas.generator

org.openstreetmap.atlas.generator.creator - package org.openstreetmap.atlas.generator.creator

org.openstreetmap.atlas.generator.persistence - package org.openstreetmap.atlas.generator.persistence

org.openstreetmap.atlas.generator.persistence.delta - package org.openstreetmap.atlas.generator.persistence.delta

org.openstreetmap.atlas.generator.persistence.scheme - package org.openstreetmap.atlas.generator.persistence.scheme

org.openstreetmap.atlas.generator.sharding - package org.openstreetmap.atlas.generator.sharding

org.openstreetmap.atlas.generator.tools.caching - package org.openstreetmap.atlas.generator.tools.caching

org.openstreetmap.atlas.generator.tools.filesystem - package org.openstreetmap.atlas.generator.tools.filesystem

org.openstreetmap.atlas.generator.tools.filesystem.converters - package org.openstreetmap.atlas.generator.tools.filesystem.converters

org.openstreetmap.atlas.generator.tools.spark - package org.openstreetmap.atlas.generator.tools.spark

org.openstreetmap.atlas.generator.tools.spark.context - package org.openstreetmap.atlas.generator.tools.spark.context

org.openstreetmap.atlas.generator.tools.spark.converters - package org.openstreetmap.atlas.generator.tools.spark.converters

org.openstreetmap.atlas.generator.tools.spark.input - package org.openstreetmap.atlas.generator.tools.spark.input

org.openstreetmap.atlas.generator.tools.spark.sharded - package org.openstreetmap.atlas.generator.tools.spark.sharded

org.openstreetmap.atlas.generator.tools.spark.testing - package org.openstreetmap.atlas.generator.tools.spark.testing

org.openstreetmap.atlas.generator.tools.spark.utilities - package org.openstreetmap.atlas.generator.tools.spark.utilities

org.openstreetmap.atlas.generator.tools.streaming - package org.openstreetmap.atlas.generator.tools.streaming

org.openstreetmap.atlas.generator.tools.streaming.resource - package org.openstreetmap.atlas.generator.tools.streaming.resource

org.openstreetmap.atlas.generator.world - package org.openstreetmap.atlas.generator.world

OUTPUT - Static variable in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

OUTPUT - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

output(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

outputToClean(CommandMap) - Method in class org.openstreetmap.atlas.generator.AtlasGenerator

outputToClean(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

Define all the folders to clean before a run.

OverpassClient - Class in org.openstreetmap.atlas.generator.sharding

OverpassClient() - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassClient

OverpassClient(String) - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassClient

OverpassClient(String, HttpHost) - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassClient

OverpassOsmNode - Class in org.openstreetmap.atlas.generator.sharding

This node represents an Osm Node returned from an overpass query.

OverpassOsmNode(String, String, String) - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

OverpassOsmNode(String, String, String, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

OverpassOsmWay - Class in org.openstreetmap.atlas.generator.sharding

This way represents an osm way returned from an overpass query.

OverpassOsmWay(String, List<String>, HashMap<String, String>) - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

P

parentPath(String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Returns parent of given path

pathNotEndingWithSeparator(String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Removes PATH_SEPARATOR from the end of given path

pathNotStartingWithSeparator(String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Removes PATH_SEPARATOR from the beginning of given path.

PBF_NODE_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_NODE_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

PBF_PATH - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_PATH - Static variable in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

PBF_RELATION_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_RELATION_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

PBF_SCHEME - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_SHARDING - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_SHARDING - Static variable in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

PBF_WAY_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_WAY_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

PbfContext - Class in org.openstreetmap.atlas.generator

PbfContext(String, Sharding, SlippyTilePersistenceScheme) - Constructor for class org.openstreetmap.atlas.generator.PbfContext

PbfLoader - Class in org.openstreetmap.atlas.generator

Load a set of Resources pbfs and build a single Atlas from it, following the wanted country border and shard

PbfLoader(PbfContext, Map<String, String>, CountryBoundaryMap, AtlasLoadingOption, String, String, Set<Shard>) - Constructor for class org.openstreetmap.atlas.generator.PbfLoader

Construct

PbfLocator - Class in org.openstreetmap.atlas.generator

Locate the right PBF Resources from a store

PbfLocator(PbfContext, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.PbfLocator

Construct

PbfLocator.LocatedPbf - Class in org.openstreetmap.atlas.generator

pbfsCovering(MultiPolygon) - Method in class org.openstreetmap.atlas.generator.PbfLocator

pbfsCovering(Polygon) - Method in class org.openstreetmap.atlas.generator.PbfLocator

POOL_MINUTES_BEFORE_KILL - Static variable in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemPerformanceHelper

PREVIOUS_OUTPUT_FOR_DELTA - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

printContents() - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

R

RAW_ATLAS_FOLDER - Static variable in class org.openstreetmap.atlas.generator.AtlasGenerator

RawAtlasCreator - Class in org.openstreetmap.atlas.generator.creator

This tool allows the user to replicate raw flow AtlasGenerator conditions on a certain shard.

RawAtlasCreator() - Constructor for class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

read() - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

read(long, byte[], int, int) - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

readFrom(Resource) - Method in class org.openstreetmap.atlas.generator.AtlasLocator

readFrom(Resource) - Method in class org.openstreetmap.atlas.generator.tools.spark.DataLocator

Transform a resource into a fetched object

readFrom(Resource) - Method in class org.openstreetmap.atlas.generator.tools.spark.DataLocator.ResourceLocator

readFully(long, byte[]) - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

readFully(long, byte[], int, int) - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

reduceAtlasStatistics() - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

remove(boolean) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

CAUTION: Please use this wisely in case of removing directories recursively

RemovedAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

FileOutputFormat that writes an AtlasStatistics.

RemovedAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.RemovedAtlasDeltaOutputFormat

RemovedMultipleAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

MultipleOutputFormat for the AtlasStatistics, based on the model of MultipleTextOutputFormat

RemovedMultipleAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.RemovedMultipleAtlasDeltaOutputFormat

rename(String, String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

Renames a source path to a destination path using the given configuration settings.

rename(String, String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Renames a source path to destination path

rename(Path, Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

resource(String) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

resource(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

resource(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

resource(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

RESOURCE_FILE_SYSTEM_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

ResourceFileSystem - Class in org.openstreetmap.atlas.generator.tools.streaming

FileSystem that is based on a set of resources.

ResourceFileSystem() - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

resourceFileSystemScheme() - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemCreator

ResourceLocator(Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.spark.DataLocator.ResourceLocator

resources(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

List resources, but omit the hadoop "_SUCCESS" file.

resources(String, Map<String, String>, PathFilter) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

retrieve(Iterable<String>) - Method in class org.openstreetmap.atlas.generator.tools.spark.DataLocator

Retrieve some resources

retrieve(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.DataLocator

Retrieve a resource

retry() - Method in class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

S

save(T, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

save(Atlas, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.AtlasGeoJsonOutputFormat

save(Atlas, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.AtlasOutputFormat

save(Atlas, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.AtlasProtoOutputFormat

save(AtlasStatistics, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.AtlasStatisticsOutputFormat

save(AtlasDelta, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.delta.AddedAtlasDeltaOutputFormat

save(AtlasDelta, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.delta.AtlasDeltaOutputFormat

save(AtlasDelta, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.delta.ChangedAtlasDeltaOutputFormat

save(AtlasDelta, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.delta.RemovedAtlasDeltaOutputFormat

save(List<SparkFileOutput>) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Executes SparkFileOutput#getSaveFunc() for given SparkFileOutputs

save(SparkFileOutput...) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Executes SparkFileOutput#getSaveFunc() for given SparkFileOutputs

SAVING_SEPARATOR - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

SCHEME - Static variable in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

sectionRawAtlas(Broadcast<CountryBoundaryMap>, Broadcast<Sharding>, Map<String, String>, Broadcast<Map<String, String>>, String, SlippyTilePersistenceScheme, List<AtlasGenerationTask>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

seek(long) - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

SeekableResourceStream - Class in org.openstreetmap.atlas.generator.tools.streaming

Fake a Seekable stream from a Resource for testing

SeekableResourceStream(Resource) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

seekToNewSource(long) - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

SENSITIVE_CONFIGURATION_PATTERN - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

sequenceFile(JavaSparkContext, String, Class<K>, Class<V>) - Static method in class org.openstreetmap.atlas.generator.tools.spark.input.SparkInput

Get an RDD from a sequence file input

setAppendToFile(boolean) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

setAtlasSaveFolder(File) - Static method in class org.openstreetmap.atlas.generator.PbfLoader

setContext(JavaSparkContext) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

setFileSystemCreator(FileSystemCreator) - Static method in class org.openstreetmap.atlas.generator.tools.spark.input.SparkInput

setHadoopFileSystemConfiguration(Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

setIdentifier(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

setLatitude(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

setLongitude(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

setNodeIdentifiers(List<String>) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

setOsmIdentifier(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

setRetries(int) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

setRetryWait(Duration) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

setTags(HashMap<String, String>) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

setWorkingDirectory(Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

SHARD_DELTAS_ADDED_FOLDER - Static variable in class org.openstreetmap.atlas.generator.AtlasGenerator

SHARD_DELTAS_CHANGED_FOLDER - Static variable in class org.openstreetmap.atlas.generator.AtlasGenerator

SHARD_DELTAS_FOLDER - Static variable in class org.openstreetmap.atlas.generator.AtlasGenerator

SHARD_DELTAS_REMOVED_FOLDER - Static variable in class org.openstreetmap.atlas.generator.AtlasGenerator

SHARD_STATISTICS_FOLDER - Static variable in class org.openstreetmap.atlas.generator.AtlasGenerator

ShardedSparkJob - Class in org.openstreetmap.atlas.generator.tools.spark.sharded

Spark job that takes care of reading the sharding and country list and starts with a JavaPairRDD of CountryName to Shard

ShardedSparkJob() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

SHARDING_TYPE - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

SHARDING_TYPE - Static variable in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

SHARDING_TYPE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

SHOULD_ALWAYS_SLICE_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

SHOULD_ALWAYS_SLICE_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

simpleconfiguration() - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

SIZE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

size(AtomicLong) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

SLICED_CACHE_PATH - Static variable in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

SLICED_RAW_ATLAS_FOLDER - Static variable in class org.openstreetmap.atlas.generator.AtlasGenerator

sliceRawAtlas(Broadcast<CountryBoundaryMap>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

SlippyTilePersistenceScheme - Class in org.openstreetmap.atlas.generator.persistence.scheme

SlippyTilePersistenceScheme(String) - Constructor for class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

SPARK_CONTEXT_PROVIDER - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

SPARK_OPTIONS - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

SparkConfToHadoopConfigurationConverter - Class in org.openstreetmap.atlas.generator.tools.filesystem.converters

Convert back and forth between Spark's configuration and Hadoop's configuration.

SparkConfToHadoopConfigurationConverter() - Constructor for class org.openstreetmap.atlas.generator.tools.filesystem.converters.SparkConfToHadoopConfigurationConverter

SparkContextProvider - Interface in org.openstreetmap.atlas.generator.tools.spark.context

Function that provides a SparkContext

SparkContextProviderFinder - Class in org.openstreetmap.atlas.generator.tools.spark.context

Find a SparkContextProvider using its class name

SparkContextProviderFinder() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.context.SparkContextProviderFinder

SparkFileHelper - Class in org.openstreetmap.atlas.generator.tools.spark.utilities

Helper class for listing and validating the presence of Atlas files

SparkFileHelper(Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Constructs a helper with given context

SparkFileOutput - Class in org.openstreetmap.atlas.generator.tools.spark.utilities

Helper class to hide details of output operations for SparkJobs

SparkFilePath - Class in org.openstreetmap.atlas.generator.tools.spark.utilities

A helper class to handle temporary and target paths

SparkFilePath(String, String) - Constructor for class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFilePath

Default constructor

SparkInput - Class in org.openstreetmap.atlas.generator.tools.spark.input

Utility tools to load RDDs from elastic file systems (S3 for example), skipping the slowness of the SparkContext textFile and sequenceFile functions.

SparkJob - Class in org.openstreetmap.atlas.generator.tools.spark

Skeleton for a Spark Job

SparkJob() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.SparkJob

SparkOptionsStringConverter - Class in org.openstreetmap.atlas.generator.tools.spark.converters

StringConverter that does the parsing of additional Spark context string values.

SparkOptionsStringConverter() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.converters.SparkOptionsStringConverter

splitAndSaveAsHadoopFile(JavaPairRDD<String, T>, String, Class<T>, Class<? extends MultipleOutputFormat<String, T>>, Function<String, String>) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

Instead of saving a full RDD(String, T) in a single folder, this function allows to save subsets of an RDD(String, T) in separate folders.

start(CommandMap) - Method in class org.openstreetmap.atlas.generator.AtlasGenerator

start(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

start(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

The spark Job

start(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

start2(CommandMap, Sharding, MultiMap<String, Shard>) - Method in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

STARTED_FILE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

STARTED_FOLDER - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

streamPathsRecursively(String, Map<String, String>, PathFilter) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

SUCCESS_FILE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

switches() - Method in class org.openstreetmap.atlas.generator.AtlasGenerator

switches() - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

switches() - Method in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

switches() - Method in class org.openstreetmap.atlas.generator.sharding.AtlasMissingShardVerifier

switches() - Method in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

switches() - Method in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

switches() - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

switches() - Method in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

switches() - Method in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

T

TEMPORARY_FOLDER_NAME - Static variable in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

textFile(JavaSparkContext, String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.input.SparkInput

Get an RDD from a Text file input

TILE - Static variable in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

toString() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

toString() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

toString() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFilePath

U

USE_JAVA_ATLAS - Static variable in class org.openstreetmap.atlas.generator.creator.RawAtlasCreator

USE_JAVA_FORMAT - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

usingConfiguration(Configuration) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

V

verifier(CountryBoundaryMap, Set<CountryShard>, File, String, HttpHost) - Method in class org.openstreetmap.atlas.generator.sharding.AtlasMissingShardVerifier

W

waitForAndCloseRenamePool() - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemPerformanceHelper

walk(Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

WALK_ALL - Static variable in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

walkFiles(Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

WAY_SECTIONING_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

waysFromQuery(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

Makes a way Overpass query, parses the response xml, and returns the ways that match the query

WorldAtlasGenerator - Class in org.openstreetmap.atlas.generator.world

Single threaded process taking an OSM PBF file and making an Atlas from it.

WorldAtlasGenerator() - Constructor for class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

writableResource(String) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

writableResource(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

write(String, String, byte[]) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Writes given content into given directory with given filename

write(String, String, String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Writes given content into given directory with given filename

X

X_INDEX - Static variable in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

Y

Y_INDEX - Static variable in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

Z

ZOOM - Static variable in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

A B C D E F G H I L M N O P R S T U V W X Y Z