A B C D E F G H I L M N O P R S T U V W X Y Z
All Classes All Packages

A

AbstractFileOutputFormat<T> - Class in org.openstreetmap.atlas.generator.persistence

Abstract implementation of FileOutputFormat that takes care of the RecordWriter

AbstractFileOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

AbstractMultipleAtlasBasedOutputFormat<T> - Class in org.openstreetmap.atlas.generator.persistence

Default MultipleOutputFormat for the Atlas jobs.

AbstractMultipleAtlasBasedOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AbstractMultipleAtlasBasedOutputFormat

accept(Path) - Method in class org.openstreetmap.atlas.generator.sharding.PbfFilePathFilter

accept(Path) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.CountrySpecificAtlasFilePathFilter

accept(Path) - Method in class org.openstreetmap.atlas.generator.world.AtlasFilePathFilter

AddedAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

FileOutputFormat that writes an AtlasStatistics.

AddedAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.AddedAtlasDeltaOutputFormat

AddedMultipleAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

MultipleOutputFormat for the AtlasStatistics, based on the model of MultipleTextOutputFormat

AddedMultipleAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.AddedMultipleAtlasDeltaOutputFormat

ADDITIONAL_SPARK_OPTIONS - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

addResource(String, String) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

addResource(String, String, boolean) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

addResource(String, String, boolean, Class<?>) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

addResource(String, Resource) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

addResourceContents(String, String) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

append(Path, int, Progressable) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

apply(SparkConf) - Method in class org.openstreetmap.atlas.generator.tools.spark.context.DefaultSparkContextProvider

ATLAS_FOLDER - Static variable in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

ATLAS_SCHEME - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

atlasAreasToDataFrame(JavaRDD<Atlas>, JavaSparkContext) - Static method in class org.openstreetmap.atlas.generator.dataframe.AtlasDataFrame

AtlasDataFrame - Class in org.openstreetmap.atlas.generator.dataframe

Methods for converting an Atlas RDD to Dataset

AtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

FileOutputFormat that writes an AtlasStatistics.

AtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.AtlasDeltaOutputFormat

atlasEdgesToDataFrame(JavaRDD<Atlas>, JavaSparkContext) - Static method in class org.openstreetmap.atlas.generator.dataframe.AtlasDataFrame

atlasFetcher(HadoopAtlasFileCache, HadoopAtlasFileCache, String, Shard) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

atlasFetcher(HadoopAtlasFileCache, Atlas, CountryBoundaryMap, String, Shard) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

AtlasFilePathFilter - Class in org.openstreetmap.atlas.generator.world

Filter that only accepts .atlas files.

AtlasFilePathFilter() - Constructor for class org.openstreetmap.atlas.generator.world.AtlasFilePathFilter

atlasFiles(JavaSparkContext, String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.input.SparkInput

Load Atlas files from an input path

atlasForShard(String, Iterable<String>) - Method in class org.openstreetmap.atlas.generator.AtlasLocator

atlasForShard(String, String) - Method in class org.openstreetmap.atlas.generator.AtlasLocator

AtlasGenerator - Class in org.openstreetmap.atlas.generator

Generate Atlas Shards for a specific version and a specific set of countries

AtlasGenerator() - Constructor for class org.openstreetmap.atlas.generator.AtlasGenerator

AtlasGeneratorHelper - Class in org.openstreetmap.atlas.generator

Utility class for AtlasGenerator.

AtlasGeneratorHelper.NamedAtlasStatistics - Class in org.openstreetmap.atlas.generator

AtlasGeneratorJobGroup - Enum in org.openstreetmap.atlas.generator

AtlasGeneratorParameters - Class in org.openstreetmap.atlas.generator

AtlasGeoJsonOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

AtlasGeoJsonOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AtlasGeoJsonOutputFormat

atlasLinesToDataFrame(JavaRDD<Atlas>, JavaSparkContext) - Static method in class org.openstreetmap.atlas.generator.dataframe.AtlasDataFrame

AtlasLocator - Class in org.openstreetmap.atlas.generator

Locate Atlas Files.

AtlasLocator(Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.AtlasLocator

AtlasMissingShardVerifier - Class in org.openstreetmap.atlas.generator.sharding

Checks intersection of country boundary and shards to validate missing shards.

AtlasMissingShardVerifier() - Constructor for class org.openstreetmap.atlas.generator.sharding.AtlasMissingShardVerifier

atlasNodesToDataFrame(JavaRDD<Atlas>, JavaSparkContext) - Static method in class org.openstreetmap.atlas.generator.dataframe.AtlasDataFrame

AtlasOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

FileOutputFormat that writes an Atlas.

AtlasOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AtlasOutputFormat

atlasPointsToDataFrame(JavaRDD<Atlas>, JavaSparkContext) - Static method in class org.openstreetmap.atlas.generator.dataframe.AtlasDataFrame

AtlasProtoOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

FileOutputFormat that writes an Atlas in protocol buffer format.

AtlasProtoOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AtlasProtoOutputFormat

atlasRelationsToDataFrame(JavaRDD<Atlas>, JavaSparkContext) - Static method in class org.openstreetmap.atlas.generator.dataframe.AtlasDataFrame

AtlasSharding - Class in org.openstreetmap.atlas.generator.sharding

Convenience methods to get a sharding for the AtlasGenerator

AtlasShardVerifier - Class in org.openstreetmap.atlas.generator.sharding

AtlasShardVerifier() - Constructor for class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

AtlasStatisticsOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

FileOutputFormat that writes an AtlasStatistics.

AtlasStatisticsOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.AtlasStatisticsOutputFormat

B

backwardConvert(Configuration) - Method in class org.openstreetmap.atlas.generator.tools.filesystem.converters.SparkConfToHadoopConfigurationConverter

binaryFile(JavaSparkContext, String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.input.SparkInput

Get an RDD from a binary file input

boundaries(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.persistence.PersistenceTools

BOUNDARIES - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

BOUNDARIES_FILE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.persistence.PersistenceTools

BOUNDARIES_META - Static variable in class org.openstreetmap.atlas.generator.tools.spark.persistence.PersistenceTools

bounds() - Method in class org.openstreetmap.atlas.generator.PbfLocator.LocatedPbf

buildAllPbfs(List<Resource>) - Method in class org.openstreetmap.atlas.generator.sharding.PbfVerifier

buildAtlasLoadingOption(CountryBoundaryMap, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

buildCompactQuery(String, Rectangle) - Static method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

buildCompoundQuery(String, String, String, Rectangle) - Static method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

buildQuery(String, String, String, Rectangle) - Static method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

buildQuery(String, Rectangle) - Static method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

C

ChangedAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

FileOutputFormat that writes an AtlasStatistics.

ChangedAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.ChangedAtlasDeltaOutputFormat

ChangedMultipleAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

MultipleOutputFormat for the AtlasStatistics, based on the model of MultipleTextOutputFormat

ChangedMultipleAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.ChangedMultipleAtlasDeltaOutputFormat

checkForMissingPbfs(HashMap<String, Rectangle>, List<Resource>, int) - Method in class org.openstreetmap.atlas.generator.sharding.PbfVerifier

clear() - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

close() - Method in class org.openstreetmap.atlas.generator.PbfLoader

close() - Method in class org.openstreetmap.atlas.generator.PbfLocator

close() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

close() - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

CLUSTER - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

CODE_VERSION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

CODE_VERSION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

collectAtlasFiles(String, String, boolean) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Returns a list of Atlas Resources for the given country in the supplied directory

collectSourceFile(String, PathFilter...) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Returns an Atlas Resource for the given location URI string.

collectSourceFiles(String, boolean, PathFilter...) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Returns an list of Atlas Resources from the given location URI string.

combine(String, String...) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Combines given paths

commit(SparkFilePath) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Renames the SparkFilePath temporaryPath to the SparkFilePath targetPath, taking care to avoid producing nested directories.

commitByCopy(SparkFilePath) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Copies the SparkFilePath temporaryPath to the SparkFilePath targetPath, taking care to avoid producing nested directories.

compile(String, String, String) - Method in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

compile(SlippyTile) - Method in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

COMPRESS_OUTPUT - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

computeAtlasDiff(Map<String, String>, String) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

configuration() - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

ConfigurationConverter - Class in org.openstreetmap.atlas.generator.tools.spark.converters

configurationMap() - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

CONFIGURED_FILTER_NAME - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

CONFIGURED_FILTER_OUTPUT - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

CONFIGURED_FILTERED_OUTPUT - org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

configuredConf() - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

configuredConfiguration() - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

convert(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.context.SparkContextProviderFinder

convert(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.converters.SparkOptionsStringConverter

convert(FileStatus) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

convert(SparkConf) - Method in class org.openstreetmap.atlas.generator.tools.filesystem.converters.SparkConfToHadoopConfigurationConverter

COPY_SHARDING_AND_BOUNDARIES - Static variable in class org.openstreetmap.atlas.generator.tools.spark.persistence.PersistenceTools

copyShardingAndBoundariesToOutput(String, String) - Method in class org.openstreetmap.atlas.generator.tools.spark.persistence.PersistenceTools

copyToOutput(CommandMap, String, String) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

COUNTRIES - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

COUNTRIES - Static variable in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

COUNTRIES - Static variable in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

COUNTRY_SHAPES - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

COUNTRY_SHAPES - Static variable in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

COUNTRY_STATISTICS - org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

CountrySpecificAtlasFilePathFilter - Class in org.openstreetmap.atlas.generator.tools.spark.utilities

Filters out country-specific Atlas files given a Hadoop file Path

CountrySpecificAtlasFilePathFilter(String) - Constructor for class org.openstreetmap.atlas.generator.tools.spark.utilities.CountrySpecificAtlasFilePathFilter

Constructs a filter for given country

create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

createJsonKey(String, String, String) - Static method in class org.openstreetmap.atlas.generator.tools.json.PersistenceJsonParser

Create a JSON key with a given country and shard.

createJsonKey(String, String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.json.PersistenceJsonParser

Create a JSON key with a given country and shard.

createQueryList(CountryBoundaryMap, Set<CountryShard>, int) - Static method in class org.openstreetmap.atlas.generator.sharding.AtlasMissingShardVerifier

D

DATA_VERSION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

DATA_VERSION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

DataLocator<T> - Class in org.openstreetmap.atlas.generator.tools.spark

Locate and retrieve resources from a data store.

DataLocator(Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.spark.DataLocator

DataLocator.ResourceLocator - Class in org.openstreetmap.atlas.generator.tools.spark

Locator that returns Resources.

debug(Consumer<String>) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

DEFAULT_SCHEME - Static variable in class org.openstreetmap.atlas.generator.PbfLocator

DefaultSparkContextProvider - Class in org.openstreetmap.atlas.generator.tools.spark.context

Default SparkContextProvider that provides a JavaSparkContext

DefaultSparkContextProvider() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.context.DefaultSparkContextProvider

delete(String, boolean, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

Deletes given path using given configuration settings.

delete(Path, boolean) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

deleteDirectory(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Deletes given directory and all it's child items

DIFFS - org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

DIRECTORY_SEPARATOR - Static variable in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

directoryContainsExpectedCountryAtlases(String, StringList, boolean) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Verifies that the input directory containing Atlas files contains all the expected countries

dumpToDisk(File) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

E

EDGE_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

EDGE_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

EDGE_SUB - org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

EMPTY - org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

EMPTY_STRING - Static variable in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

EmptySparkJob - Class in org.openstreetmap.atlas.generator.tools.spark.testing

EmptySparkJob() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

ERROR_MESSAGE - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

executeRename(Callable<Boolean>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemPerformanceHelper

exists() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

exists(String) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

Check if the given path exists.

exists(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

exists(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

Check if the given path exists.

EXPECTED_SHARDS - Static variable in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

EXTENSION_SEPARATOR - Static variable in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

extensionStartingWithSeparator(String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Removes EXTENSION_SEPARATOR from the beginning of given path

extractAtlasLoadingProperties(CommandMap, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

F

FAILED_FILE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

FeatureChangeOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

FeatureChangeOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.FeatureChangeOutputFormat

FILE_NOT_FOUND - Static variable in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasGeoJsonOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasProtoOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasStatisticsOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.delta.AtlasDeltaOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.FeatureChangeOutputFormat

fileExtension() - Method in class org.openstreetmap.atlas.generator.persistence.LineDelimitedGeojsonOutputFormat

files() - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

FileSystemCreator - Class in org.openstreetmap.atlas.generator.tools.filesystem

Utility class that helps create a FileSystem using some Spark/Hadoop configuration key-values.

FileSystemCreator() - Constructor for class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemCreator

FileSystemHelper - Class in org.openstreetmap.atlas.generator.tools.filesystem

Utility class that helps generating Resource and WritableResource from a Hadoop Path.

FileSystemPerformanceHelper - Class in org.openstreetmap.atlas.generator.tools.filesystem

When working with a FileSystem that is slow at renaming, this provides a hack to speed up the rename of output files.

FINISHED_MESSAGE - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

forPolygon(Polygon) - Static method in class org.openstreetmap.atlas.generator.sharding.PbfVerifier

forString(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.sharding.AtlasSharding

Parse a sharding definition string

forString(String, Configuration) - Static method in class org.openstreetmap.atlas.generator.sharding.AtlasSharding

Parse a sharding definition string

from(Consumer<WritableResource>, String, String, String, String, String, String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileOutput

Constructs a SparkFileOutput from given parameters

from(Consumer<WritableResource>, SparkFilePath, String, String, String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileOutput

Constructs a SparkFileOutput from given parameters

G

generateAtlasStatistics(Broadcast<Sharding>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

generateFileNameForKeyValue(String, AtlasStatistics, String) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasCountryStatisticsOutputFormat

generateFileNameForKeyValue(String, T, String) - Method in class org.openstreetmap.atlas.generator.persistence.AbstractMultipleAtlasBasedOutputFormat

generateRawAtlas(String, Shard) - Method in class org.openstreetmap.atlas.generator.PbfLoader

generateRawAtlas(Broadcast<CountryBoundaryMap>, Map<String, String>, Broadcast<Map<String, String>>, PbfContext, SlippyTilePersistenceScheme) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

generateShardedAtlasRDD(JavaSparkContext, String, CountryBoundaryMap, String, Sharding, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.spark.rdd.ShardedAtlasRDDLoader

Load sharded atlas file and turn it into spark RDD

generateTasks(List<String>, CountryBoundaryMap, Sharding) - Static method in class org.openstreetmap.atlas.generator.AtlasGenerator

Generates a List of AtlasGenerationTasks for given countries using given CountryBoundaryMap and Sharding strategy.

get(String, Map<String, String>) - Method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemCreator

Create a FileSystem from an agnostic configuration map

get(String, Configuration) - Method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemCreator

Create a FileSystem from a Hadoop Configuration

get(String, SparkConf) - Method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemCreator

Create a FileSystem from a SparkConf

get(String, Shard) - Method in class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Get an Optional of an atlas resource specified by the given parameters.

getAlternateParallelFolderOutput(String, String) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

Get an alternate output based on the main output folder used for monitoring

getAlternateSubFolderOutput(String, String) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

Get an alternate output based on the main output folder used for monitoring.

getAtlas(String) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

getAtlasOrElse(String) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

getAtlasStatistics() - Method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper.NamedAtlasStatistics

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.delta.AddedMultipleAtlasDeltaOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.delta.ChangedMultipleAtlasDeltaOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.delta.MultipleAtlasDeltaOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.delta.RemovedMultipleAtlasDeltaOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasCountryStatisticsOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasFeatureChangeOutput

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasGeoJsonOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasProtoOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleAtlasStatisticsOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleFeatureChangeOutputFormat

getBaseRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.MultipleLineDelimitedGeojsonOutputFormat

getCacheFolder() - Method in enum org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

getConfiguredFilterFrom(String, String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

getConfiguredFilterFrom(String, String, Resource) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

getConfiguredFilterFrom(String, Resource) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

getConfiguredFilterListFrom(StringList, Resource) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

getConfiguredFilterListFrom(StringList, StringList, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

getContext() - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

getDescription() - Method in enum org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

getFileStatus(Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

getId() - Method in enum org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

getIdentifier() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

getKeyClass() - Method in enum org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

getLatitude() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

getLongitude() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

getName() - Method in class org.openstreetmap.atlas.generator.AtlasGenerator

getName() - Method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper.NamedAtlasStatistics

getName() - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

getName() - Method in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

getNodeIdentifiers() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

getOperationName() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileOutput

getOsmIdentifier() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

getOutputClass() - Method in enum org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

getPath() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileOutput

getPath() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

getPathFor(CommandMap, Command.Switch<?>) - Method in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

getPbfPath() - Method in class org.openstreetmap.atlas.generator.PbfContext

getPos() - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

getRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

getResource() - Method in class org.openstreetmap.atlas.generator.PbfLocator.LocatedPbf

getResource(String) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

getResourceOrElse(String) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

getResponse(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

getRetries() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

getRetryWait() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

getSaveFunction() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileOutput

getScheme() - Method in class org.openstreetmap.atlas.generator.PbfContext

getScheme() - Method in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

getSchemeInstanceFromString(String) - Static method in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

getSharding() - Method in class org.openstreetmap.atlas.generator.PbfContext

getStandardConfigurationFrom(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

getStandardConfigurationFrom(Resource) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

getSuffix() - Method in enum org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

getTaggableFilterFrom(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

getTaggableFilterFrom(Resource) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

getTags() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

getTags() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

getTargetPath() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFilePath

getTemporaryPath() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFilePath

getType() - Method in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

getUri() - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

getValue() - Method in enum org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

getWorkingDirectory() - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

groupAtlasStatisticsByCountry() - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

H

HadoopAtlasFileCache - Class in org.openstreetmap.atlas.generator.tools.caching

Cache an atlas file stored in the standard way (parentpath/COUNTRY/COUNTRY_z-x-y.atlas) to a system temporary location.

HadoopAtlasFileCache(String, String, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

HadoopAtlasFileCache(String, String, SlippyTilePersistenceScheme, Function<URI, Optional<Resource>>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

HadoopAtlasFileCache(String, String, SlippyTilePersistenceScheme, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

HadoopAtlasFileCache(String, Function<URI, Optional<Resource>>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

HadoopAtlasFileCache(String, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

HadoopAtlasFileCache(String, SlippyTilePersistenceScheme, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

HadoopAtlasFileCache(String, SlippyTilePersistenceScheme, CachingStrategy, Function<URI, Optional<Resource>>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

HadoopAtlasFileCache(String, CachingStrategy, Function<URI, Optional<Resource>>) - Constructor for class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Create a new cache.

hadoopToMapConfiguration(Configuration) - Static method in class org.openstreetmap.atlas.generator.tools.spark.converters.ConfigurationConverter

hadoopToSparkConfiguration(Configuration) - Static method in class org.openstreetmap.atlas.generator.tools.spark.converters.ConfigurationConverter

hasTooMuchResponseData() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

hasUnknownError() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

HDFSFile - Class in org.openstreetmap.atlas.generator.tools.streaming.resource

Readable and Writable resource for HDFS files

HDFSFile(String) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSFile(String, int, String) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSFile(String, int, String, Configuration) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSFile(String, Configuration) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSFile(Path) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSFile(Path, Configuration) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

HDFSWalker - Class in org.openstreetmap.atlas.generator.tools.streaming.resource

Inspired by Files.walk (https://docs.oracle.com/javase/8/docs/api/java/nio/file/Files.html#walk-java.nio.file.Path-int- java.nio.file.FileVisitOption...-), either retrieve a Stream of HDFS file status objects or convert them to HDFSFile objects.

HDFSWalker() - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

HDFSWalker(int) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

I

initialize(URI, Configuration) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

input(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

INPUT - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

invalidate(String, Shard) - Method in class org.openstreetmap.atlas.generator.tools.caching.HadoopAtlasFileCache

Invalidate a given shard for a given country.

isAppendToFile() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasGeoJsonOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasProtoOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.AtlasStatisticsOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.delta.AtlasDeltaOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.FeatureChangeOutputFormat

isCompressed() - Method in class org.openstreetmap.atlas.generator.persistence.LineDelimitedGeojsonOutputFormat

isDirectory() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

isDirectory(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

isDirectory(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

isFile(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

L

length() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

LENGTH - Static variable in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

LINE_DELIMITED_GEOJSON_OUTPUT - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

LINE_DELIMITED_GEOJSON_STATISTICS_FOLDER - Static variable in class org.openstreetmap.atlas.generator.AtlasGenerator

LineDelimitedGeojsonOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

FileOutputFormat that writes an Atlas as line delimited GeoJson.

LineDelimitedGeojsonOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.LineDelimitedGeojsonOutputFormat

list(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

LIST_DEPTH - Static variable in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

listResourcesRecursively(String, Map<String, String>, PathFilter) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

listStatus(Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

loadOneAtlasShard(String, String, String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.spark.rdd.ShardedAtlasRDDLoader

LocatedPbf(Resource, Rectangle) - Constructor for class org.openstreetmap.atlas.generator.PbfLocator.LocatedPbf

M

main(String[]) - Static method in class org.openstreetmap.atlas.generator.AtlasGenerator

main(String[]) - Static method in class org.openstreetmap.atlas.generator.sharding.AtlasMissingShardVerifier

main(String[]) - Static method in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

main(String[]) - Static method in class org.openstreetmap.atlas.generator.sharding.PbfVerifier

main(String[]) - Static method in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

main(String[]) - Static method in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

main(String[]) - Static method in class org.openstreetmap.atlas.generator.world.WorldMultiAtlasGenerator

mapToHadoopConfiguration(Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.spark.converters.ConfigurationConverter

mapToSparkConfiguration(Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.spark.converters.ConfigurationConverter

MEMORY_MESSAGE - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

mkdir(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Creates a directory via given path

mkdir(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

Creates a new directory for given path using given configuration settings.

mkdirs(boolean) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

mkdirs(Path, FsPermission) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

MultipleAtlasCountryStatisticsOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleOutputFormat for the country AtlasStatistics, based on the model of MultipleTextOutputFormat

MultipleAtlasCountryStatisticsOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleAtlasCountryStatisticsOutputFormat

MultipleAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

MultipleOutputFormat for the AtlasStatistics, based on the model of MultipleTextOutputFormat

MultipleAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.MultipleAtlasDeltaOutputFormat

MultipleAtlasFeatureChangeOutput - Class in org.openstreetmap.atlas.generator.persistence

MultipleAtlasFeatureChangeOutput() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleAtlasFeatureChangeOutput

MultipleAtlasGeoJsonOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleAtlasGeoJsonOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleAtlasGeoJsonOutputFormat

MultipleAtlasOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleOutputFormat for the Atlas, based on the model of MultipleTextOutputFormat

MultipleAtlasOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleAtlasOutputFormat

MultipleAtlasProtoOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleAtlasProtoOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleAtlasProtoOutputFormat

MultipleAtlasStatisticsOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleOutputFormat for the shard AtlasStatistics, based on the model of MultipleTextOutputFormat

MultipleAtlasStatisticsOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleAtlasStatisticsOutputFormat

MultipleFeatureChangeOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleFeatureChangeOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleFeatureChangeOutputFormat

MultipleLineDelimitedGeojsonOutputFormat - Class in org.openstreetmap.atlas.generator.persistence

MultipleOutputFormat for the shard Atlas to line delimited geojson, based on the model of MultipleTextOutputFormat

MultipleLineDelimitedGeojsonOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.MultipleLineDelimitedGeojsonOutputFormat

N

NamedAtlasStatistics(String, AtlasStatistics) - Constructor for class org.openstreetmap.atlas.generator.AtlasGeneratorHelper.NamedAtlasStatistics

nodeIdsFromWayQuery(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

Makes a way Overpass query, parses the response xml, and returns the identifiers of nodes that make up the ways that match the query

nodesFromQuery(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

Makes a node Overpass query, parses the response xml, and returns the nodes that match the query

NUMBER_POOL_THREADS - Static variable in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemPerformanceHelper

O

onRead() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

onRun(CommandMap) - Method in class org.openstreetmap.atlas.generator.sharding.AtlasMissingShardVerifier

onRun(CommandMap) - Method in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

onRun(CommandMap) - Method in class org.openstreetmap.atlas.generator.sharding.PbfVerifier

onRun(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

onRun(CommandMap) - Method in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

onRun(CommandMap) - Method in class org.openstreetmap.atlas.generator.world.WorldMultiAtlasGenerator

onWrite() - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

open(Path, int) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

openRenamePool() - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemPerformanceHelper

org.openstreetmap.atlas.generator - package org.openstreetmap.atlas.generator

org.openstreetmap.atlas.generator.dataframe - package org.openstreetmap.atlas.generator.dataframe

org.openstreetmap.atlas.generator.persistence - package org.openstreetmap.atlas.generator.persistence

org.openstreetmap.atlas.generator.persistence.delta - package org.openstreetmap.atlas.generator.persistence.delta

org.openstreetmap.atlas.generator.persistence.scheme - package org.openstreetmap.atlas.generator.persistence.scheme

org.openstreetmap.atlas.generator.sharding - package org.openstreetmap.atlas.generator.sharding

org.openstreetmap.atlas.generator.tools.caching - package org.openstreetmap.atlas.generator.tools.caching

org.openstreetmap.atlas.generator.tools.filesystem - package org.openstreetmap.atlas.generator.tools.filesystem

org.openstreetmap.atlas.generator.tools.filesystem.converters - package org.openstreetmap.atlas.generator.tools.filesystem.converters

org.openstreetmap.atlas.generator.tools.json - package org.openstreetmap.atlas.generator.tools.json

org.openstreetmap.atlas.generator.tools.spark - package org.openstreetmap.atlas.generator.tools.spark

org.openstreetmap.atlas.generator.tools.spark.context - package org.openstreetmap.atlas.generator.tools.spark.context

org.openstreetmap.atlas.generator.tools.spark.converters - package org.openstreetmap.atlas.generator.tools.spark.converters

org.openstreetmap.atlas.generator.tools.spark.input - package org.openstreetmap.atlas.generator.tools.spark.input

org.openstreetmap.atlas.generator.tools.spark.persistence - package org.openstreetmap.atlas.generator.tools.spark.persistence

org.openstreetmap.atlas.generator.tools.spark.rdd - package org.openstreetmap.atlas.generator.tools.spark.rdd

org.openstreetmap.atlas.generator.tools.spark.sharded - package org.openstreetmap.atlas.generator.tools.spark.sharded

org.openstreetmap.atlas.generator.tools.spark.testing - package org.openstreetmap.atlas.generator.tools.spark.testing

org.openstreetmap.atlas.generator.tools.spark.utilities - package org.openstreetmap.atlas.generator.tools.spark.utilities

org.openstreetmap.atlas.generator.tools.streaming - package org.openstreetmap.atlas.generator.tools.streaming

org.openstreetmap.atlas.generator.tools.streaming.resource - package org.openstreetmap.atlas.generator.tools.streaming.resource

org.openstreetmap.atlas.generator.world - package org.openstreetmap.atlas.generator.world

output(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

OUTPUT - Static variable in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

OUTPUT - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

outputToClean(CommandMap) - Method in class org.openstreetmap.atlas.generator.AtlasGenerator

outputToClean(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

Define all the folders to clean before a run.

OverpassClient - Class in org.openstreetmap.atlas.generator.sharding

OverpassClient() - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassClient

OverpassClient(String) - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassClient

OverpassClient(String, HttpHost) - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassClient

OverpassOsmNode - Class in org.openstreetmap.atlas.generator.sharding

This node represents an Osm Node returned from an overpass query.

OverpassOsmNode(String, String, String) - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

OverpassOsmNode(String, String, String, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

OverpassOsmWay - Class in org.openstreetmap.atlas.generator.sharding

This way represents an osm way returned from an overpass query.

OverpassOsmWay(String, List<String>, HashMap<String, String>) - Constructor for class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

P

parentPath(String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Returns parent of given path

parseCountry(String) - Static method in class org.openstreetmap.atlas.generator.tools.json.PersistenceJsonParser

Given a valid JSON key, parse and return the value of the "country" property.

parseMetadata(String) - Static method in class org.openstreetmap.atlas.generator.tools.json.PersistenceJsonParser

Given a valid JSON key, parse and return the "metadata" property as a string to string Map.

parseScheme(String) - Static method in class org.openstreetmap.atlas.generator.tools.json.PersistenceJsonParser

Given a valid JSON key, parse and return the value of the "scheme" property within the "metadata" object, if present.

parseShard(String) - Static method in class org.openstreetmap.atlas.generator.tools.json.PersistenceJsonParser

Given a valid JSON key, parse and return the value of the "shard" property.

parseSlippyTileFile(Resource) - Static method in class org.openstreetmap.atlas.generator.sharding.PbfVerifier

PATH_FILTER_REGEX - Static variable in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

pathNotEndingWithSeparator(String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Removes PATH_SEPARATOR from the end of given path

pathNotStartingOrEndingWithSeparator(String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

pathNotStartingWithSeparator(String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Removes PATH_SEPARATOR from the beginning of given path.

PBF_NODE_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_NODE_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

PBF_PATH - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_RELATION_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_RELATION_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

PBF_SCHEME - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_SHARDING - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_WAY_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

PBF_WAY_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

PbfContext - Class in org.openstreetmap.atlas.generator

PbfContext(String, Sharding, SlippyTilePersistenceScheme) - Constructor for class org.openstreetmap.atlas.generator.PbfContext

PbfFilePathFilter - Class in org.openstreetmap.atlas.generator.sharding

Filters out non pbf files and directories.

PbfFilePathFilter() - Constructor for class org.openstreetmap.atlas.generator.sharding.PbfFilePathFilter

PbfLoader - Class in org.openstreetmap.atlas.generator

Load a set of Resources pbfs and build a single Atlas from it, following the wanted country border and shard

PbfLoader(PbfContext, Map<String, String>, CountryBoundaryMap, AtlasLoadingOption, String, String, Set<Shard>) - Constructor for class org.openstreetmap.atlas.generator.PbfLoader

Construct

PbfLocator - Class in org.openstreetmap.atlas.generator

Locate the right PBF Resources from a store

PbfLocator(PbfContext, Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.PbfLocator

Construct

PbfLocator.LocatedPbf - Class in org.openstreetmap.atlas.generator

pbfsCovering(MultiPolygon) - Method in class org.openstreetmap.atlas.generator.PbfLocator

pbfsCovering(Polygon) - Method in class org.openstreetmap.atlas.generator.PbfLocator

PbfVerifier - Class in org.openstreetmap.atlas.generator.sharding

Command that verifies all expected PBF files exist and can be converted to atlas.

PbfVerifier() - Constructor for class org.openstreetmap.atlas.generator.sharding.PbfVerifier

PersistenceJsonParser - Class in org.openstreetmap.atlas.generator.tools.json

Define a JSON format for the RDD keys used by the spark job.

PersistenceTools - Class in org.openstreetmap.atlas.generator.tools.spark.persistence

PersistenceTools(Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.spark.persistence.PersistenceTools

POOL_MINUTES_BEFORE_KILL - Static variable in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemPerformanceHelper

PREVIOUS_OUTPUT_FOR_DELTA - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

printContents() - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

R

RAW - org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

read() - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

read(long, byte[], int, int) - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

readFrom(Resource) - Method in class org.openstreetmap.atlas.generator.AtlasLocator

readFrom(Resource) - Method in class org.openstreetmap.atlas.generator.tools.spark.DataLocator

Transform a resource into a fetched object

readFrom(Resource) - Method in class org.openstreetmap.atlas.generator.tools.spark.DataLocator.ResourceLocator

readFully(long, byte[]) - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

readFully(long, byte[], int, int) - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

reduceAtlasStatistics() - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

registerResourceExtractionClass(Class<?>) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

remove(boolean) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

CAUTION: Please use this wisely in case of removing directories recursively

RemovedAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

FileOutputFormat that writes an AtlasStatistics.

RemovedAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.RemovedAtlasDeltaOutputFormat

RemovedMultipleAtlasDeltaOutputFormat - Class in org.openstreetmap.atlas.generator.persistence.delta

MultipleOutputFormat for the AtlasStatistics, based on the model of MultipleTextOutputFormat

RemovedMultipleAtlasDeltaOutputFormat() - Constructor for class org.openstreetmap.atlas.generator.persistence.delta.RemovedMultipleAtlasDeltaOutputFormat

rename(String, String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Renames a source path to destination path

rename(String, String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

Renames a source path to a destination path using the given configuration settings.

rename(Path, Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

resetTooMuchDataError() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

resource(String) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

resource(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

resource(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

resource(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

RESOURCE_FILE_SYSTEM_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

ResourceFileSystem - Class in org.openstreetmap.atlas.generator.tools.streaming

FileSystem that is based on a set of resources.

ResourceFileSystem() - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

resourceFileSystemScheme() - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemCreator

ResourceLocator(Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.spark.DataLocator.ResourceLocator

resources(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

List resources, but omit the hadoop "_SUCCESS" file.

resources(String, Map<String, String>, PathFilter) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

retrieve(Iterable<String>) - Method in class org.openstreetmap.atlas.generator.tools.spark.DataLocator

Retrieve some resources

retrieve(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.DataLocator

Retrieve a resource

retry() - Method in class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

runStatistics(CommandMap) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

S

save(List<SparkFileOutput>) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Executes SparkFileOutput#getSaveFunc() for given SparkFileOutputs

save(List<FeatureChange>, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.FeatureChangeOutputFormat

save(SparkFileOutput...) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Executes SparkFileOutput#getSaveFunc() for given SparkFileOutputs

save(Atlas, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.AtlasGeoJsonOutputFormat

save(Atlas, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.AtlasOutputFormat

save(Atlas, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.AtlasProtoOutputFormat

save(Atlas, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.LineDelimitedGeojsonOutputFormat

save(AtlasDelta, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.delta.AddedAtlasDeltaOutputFormat

save(AtlasDelta, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.delta.AtlasDeltaOutputFormat

save(AtlasDelta, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.delta.ChangedAtlasDeltaOutputFormat

save(AtlasDelta, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.delta.RemovedAtlasDeltaOutputFormat

save(AtlasStatistics, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.AtlasStatisticsOutputFormat

save(T, AbstractWritableResource) - Method in class org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat

SAVING_SEPARATOR - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

SCHEME - Static variable in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

sectionAtlas(Broadcast<CountryBoundaryMap>, Broadcast<Sharding>, Map<String, String>, Broadcast<Map<String, String>>, String, String, SlippyTilePersistenceScheme) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

seek(long) - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

SeekableResourceStream - Class in org.openstreetmap.atlas.generator.tools.streaming

Fake a Seekable stream from a Resource for testing

SeekableResourceStream(Resource) - Constructor for class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

seekToNewSource(long) - Method in class org.openstreetmap.atlas.generator.tools.streaming.SeekableResourceStream

sequenceFile(JavaSparkContext, String, Class<K>, Class<V>) - Static method in class org.openstreetmap.atlas.generator.tools.spark.input.SparkInput

Get an RDD from a sequence file input

setAppendToFile(boolean) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

setAtlasSaveFolder(File) - Static method in class org.openstreetmap.atlas.generator.PbfLoader

setContext(JavaSparkContext) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

setFileSystemCreator(FileSystemCreator) - Static method in class org.openstreetmap.atlas.generator.tools.spark.input.SparkInput

setHadoopFileSystemConfiguration(Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

setIdentifier(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

setLatitude(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

setLongitude(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

setNodeIdentifiers(List<String>) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

setOsmIdentifier(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

setRetries(int) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

setRetryWait(Duration) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSFile

setTags(HashMap<String, String>) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

setWorkingDirectory(Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

SHARD_STATISTICS - org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

ShardedAtlasRDDLoader - Class in org.openstreetmap.atlas.generator.tools.spark.rdd

ShardedAtlasRDDLoader() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.rdd.ShardedAtlasRDDLoader

ShardedSparkJob - Class in org.openstreetmap.atlas.generator.tools.spark.sharded

Spark job that takes care of reading the sharding and country list and starts with a JavaPairRDD of CountryName to Shard

ShardedSparkJob() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

sharding(String) - Method in class org.openstreetmap.atlas.generator.tools.spark.persistence.PersistenceTools

SHARDING_FILE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.persistence.PersistenceTools

SHARDING_META - Static variable in class org.openstreetmap.atlas.generator.tools.spark.persistence.PersistenceTools

SHARDING_TYPE - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

SHARDING_TYPE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

SHOULD_ALWAYS_SLICE_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

SHOULD_INCLUDE_FILTERED_OUTPUT_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

simpleconfiguration() - Static method in class org.openstreetmap.atlas.generator.tools.streaming.ResourceFileSystem

size(AtomicLong) - Static method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

SIZE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

sliceAtlas(Broadcast<CountryBoundaryMap>, Broadcast<Map<String, String>>, Broadcast<Sharding>, String, SlippyTilePersistenceScheme, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

SLICED - org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

SLICED_SUB - org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

SLICING_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

SlippyTilePersistenceScheme - Class in org.openstreetmap.atlas.generator.persistence.scheme

This class helps users construct storage paths dynamically based on the name of the target resource to be saved.

SlippyTilePersistenceScheme(SlippyTilePersistenceSchemeType) - Constructor for class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

SlippyTilePersistenceSchemeType - Enum in org.openstreetmap.atlas.generator.persistence.scheme

Definitions for various types of SlippyTilePersistenceSchemes.

SPARK_CONTEXT_PROVIDER - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

SPARK_OPTIONS - Static variable in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

SPARK_OPTIONS - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

SparkConfToHadoopConfigurationConverter - Class in org.openstreetmap.atlas.generator.tools.filesystem.converters

Convert back and forth between Spark's configuration and Hadoop's configuration.

SparkConfToHadoopConfigurationConverter() - Constructor for class org.openstreetmap.atlas.generator.tools.filesystem.converters.SparkConfToHadoopConfigurationConverter

SparkContextProvider - Interface in org.openstreetmap.atlas.generator.tools.spark.context

Function that provides a SparkContext

SparkContextProviderFinder - Class in org.openstreetmap.atlas.generator.tools.spark.context

Find a SparkContextProvider using its class name

SparkContextProviderFinder() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.context.SparkContextProviderFinder

SparkFileHelper - Class in org.openstreetmap.atlas.generator.tools.spark.utilities

Helper class for listing and validating the presence of Atlas files

SparkFileHelper(Map<String, String>) - Constructor for class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Constructs a helper with given context

SparkFileOutput - Class in org.openstreetmap.atlas.generator.tools.spark.utilities

Helper class to hide details of output operations for SparkJobs

SparkFilePath - Class in org.openstreetmap.atlas.generator.tools.spark.utilities

A helper class to handle temporary and target paths

SparkFilePath(String, String) - Constructor for class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFilePath

Default constructor

SparkInput - Class in org.openstreetmap.atlas.generator.tools.spark.input

Utility tools to load RDDs from elastic file systems (S3 for example), skipping the slowness of the SparkContext textFile and sequenceFile functions.

SparkJob - Class in org.openstreetmap.atlas.generator.tools.spark

Skeleton for a Spark Job

SparkJob() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.SparkJob

sparkOptions(CommandMap) - Method in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

SparkOptionsStringConverter - Class in org.openstreetmap.atlas.generator.tools.spark.converters

StringConverter that does the parsing of additional Spark context string values.

SparkOptionsStringConverter() - Constructor for class org.openstreetmap.atlas.generator.tools.spark.converters.SparkOptionsStringConverter

sparkToHadoopConfiguration(SparkConf) - Static method in class org.openstreetmap.atlas.generator.tools.spark.converters.ConfigurationConverter

splitAndSaveAsHadoopFile(JavaPairRDD<String, T>, String, Class<T>, Class<? extends MultipleOutputFormat<String, T>>, UnaryOperator<String>) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

Instead of saving a full RDD(String, T) in a single folder, this function allows to save subsets of an RDD(String, T) in separate folders.

start(CommandMap) - Method in class org.openstreetmap.atlas.generator.AtlasGenerator

start(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

start(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

The spark Job

start(CommandMap) - Method in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

start2(CommandMap, Sharding, MultiMap<String, Shard>) - Method in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

STARTED_MESSAGE - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

STATISTICS - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

streamPathsRecursively(String, Map<String, String>, PathFilter) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

streamPathsRecursively(String, Map<String, String>, PathFilter, int) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

subatlas(Predicate<AtlasEntity>, AtlasCutType) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

subatlas(ConfiguredFilter, AtlasCutType) - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorHelper

SUCCESS_FILE - Static variable in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

switches() - Method in class org.openstreetmap.atlas.generator.AtlasGenerator

switches() - Static method in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

switches() - Method in class org.openstreetmap.atlas.generator.sharding.AtlasMissingShardVerifier

switches() - Method in class org.openstreetmap.atlas.generator.sharding.AtlasShardVerifier

switches() - Method in class org.openstreetmap.atlas.generator.sharding.PbfVerifier

switches() - Method in class org.openstreetmap.atlas.generator.tools.spark.sharded.ShardedSparkJob

switches() - Method in class org.openstreetmap.atlas.generator.tools.spark.SparkJob

switches() - Method in class org.openstreetmap.atlas.generator.tools.spark.testing.EmptySparkJob

switches() - Method in class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

switches() - Method in class org.openstreetmap.atlas.generator.world.WorldMultiAtlasGenerator

T

TAGGABLE_FILTERED_OUTPUT - org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

TEMPORARY_FOLDER_NAME - Static variable in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

textFile(JavaSparkContext, String) - Static method in class org.openstreetmap.atlas.generator.tools.spark.input.SparkInput

Get an RDD from a Text file input

toString() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmNode

toString() - Method in class org.openstreetmap.atlas.generator.sharding.OverpassOsmWay

toString() - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFilePath

U

usingConfiguration(Configuration) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

V

valueOf(String) - Static method in enum org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

Returns an array containing the constants of this enum type, in the order they are declared.

verifier(CountryBoundaryMap, Set<CountryShard>, File, String, HttpHost, ConfiguredTaggableFilter, Integer) - Method in class org.openstreetmap.atlas.generator.sharding.AtlasMissingShardVerifier

W

waitForAndCloseRenamePool() - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemPerformanceHelper

walk(Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

WALK_ALL - Static variable in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

walkFiles(Path) - Method in class org.openstreetmap.atlas.generator.tools.streaming.resource.HDFSWalker

WAY_SECTIONED_PBF - org.openstreetmap.atlas.generator.AtlasGeneratorJobGroup

WAY_SECTIONING_CONFIGURATION - Static variable in class org.openstreetmap.atlas.generator.AtlasGeneratorParameters

waysFromQuery(String) - Method in class org.openstreetmap.atlas.generator.sharding.OverpassClient

Makes a way Overpass query, parses the response xml, and returns the ways that match the query

WorldAtlasGenerator - Class in org.openstreetmap.atlas.generator.world

Single threaded process taking an OSM PBF file and making an Atlas from it.

WorldAtlasGenerator() - Constructor for class org.openstreetmap.atlas.generator.world.WorldAtlasGenerator

WorldMultiAtlasGenerator - Class in org.openstreetmap.atlas.generator.world

Command that multiatlases together all atlas shards within an input directory.

WorldMultiAtlasGenerator() - Constructor for class org.openstreetmap.atlas.generator.world.WorldMultiAtlasGenerator

writableResource(String) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

writableResource(String, Map<String, String>) - Static method in class org.openstreetmap.atlas.generator.tools.filesystem.FileSystemHelper

write(String, String, byte[]) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Writes given content into given directory with given filename

write(String, String, String) - Method in class org.openstreetmap.atlas.generator.tools.spark.utilities.SparkFileHelper

Writes given content into given directory with given filename

X

X_INDEX - Static variable in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

Y

Y_INDEX - Static variable in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

Z

ZOOM - Static variable in class org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceScheme

ZZ_SLASH_XX_YY_OSMPBF - org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

ZZ_SLASH_XX_YY_PBF - org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

ZZ_SLASH_ZZ_XX_YY_OSMPBF - org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

ZZ_SUBFOLDER - org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

ZZ_XX_YY_OSMPBF - org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

ZZ_XX_YY_PBF - org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

ZZ_XX_YY_SUBFOLDERS_OSMPBF - org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

ZZ_XX_YY_SUBFOLDERS_PBF - org.openstreetmap.atlas.generator.persistence.scheme.SlippyTilePersistenceSchemeType

A B C D E F G H I L M N O P R S T U V W X Y Z
All Classes All Packages