All Classes Interface Summary Class Summary Enum Summary
| Class |
Description |
| AbstractFileOutputFormat<T> |
Abstract implementation of FileOutputFormat that takes care of the RecordWriter
|
| AbstractMultipleAtlasBasedOutputFormat<T> |
Default MultipleOutputFormat for the Atlas jobs.
|
| AddedAtlasDeltaOutputFormat |
FileOutputFormat that writes an AtlasStatistics.
|
| AddedMultipleAtlasDeltaOutputFormat |
MultipleOutputFormat for the AtlasStatistics, based on the model of
MultipleTextOutputFormat
|
| AtlasDeltaOutputFormat |
FileOutputFormat that writes an AtlasStatistics.
|
| AtlasFilePathFilter |
Filter that only accepts .atlas files.
|
| AtlasGenerator |
Generate Atlas Shards for a specific version and a specific set of countries
|
| AtlasGeneratorHelper |
|
| AtlasGeneratorHelper.NamedAtlasStatistics |
|
| AtlasGeneratorJobGroup |
|
| AtlasGeneratorParameters |
|
| AtlasGeoJsonOutputFormat |
|
| AtlasLocator |
Locate Atlas Files.
|
| AtlasMissingShardVerifier |
Checks intersection of country boundary and shards to validate missing shards.
|
| AtlasOutputFormat |
FileOutputFormat that writes an Atlas.
|
| AtlasProtoOutputFormat |
FileOutputFormat that writes an Atlas in protocol buffer format.
|
| AtlasSharding |
|
| AtlasShardVerifier |
|
| AtlasStatisticsOutputFormat |
FileOutputFormat that writes an AtlasStatistics.
|
| ChangedAtlasDeltaOutputFormat |
FileOutputFormat that writes an AtlasStatistics.
|
| ChangedMultipleAtlasDeltaOutputFormat |
MultipleOutputFormat for the AtlasStatistics, based on the model of
MultipleTextOutputFormat
|
| ConfigurationConverter |
|
| CountrySpecificAtlasFilePathFilter |
Filters out country-specific Atlas files given a Hadoop file Path
|
| DataLocator<T> |
Locate and retrieve resources from a data store.
|
| DataLocator.ResourceLocator |
Locator that returns Resources.
|
| DefaultSparkContextProvider |
|
| EmptySparkJob |
|
| FeatureChangeOutputFormat |
|
| FileSystemCreator |
Utility class that helps create a FileSystem using some Spark/Hadoop configuration
key-values.
|
| FileSystemHelper |
Utility class that helps generating Resource and WritableResource from a Hadoop
Path.
|
| FileSystemPerformanceHelper |
When working with a FileSystem that is slow at renaming, this provides a hack to speed up the
rename of output files.
|
| HadoopAtlasFileCache |
Cache an atlas file stored in the standard way (parentpath/COUNTRY/COUNTRY_z-x-y.atlas) to a
system temporary location.
|
| HDFSFile |
Readable and Writable resource for HDFS files
|
| HDFSWalker |
Inspired by Files.walk
(https://docs.oracle.com/javase/8/docs/api/java/nio/file/Files.html#walk-java.nio.file.Path-int-
java.nio.file.FileVisitOption...-), either retrieve a Stream of HDFS file status objects or
convert them to HDFSFile objects.
|
| LineDelimitedGeojsonOutputFormat |
FileOutputFormat that writes an Atlas as line delimited GeoJson.
|
| MultipleAtlasCountryStatisticsOutputFormat |
MultipleOutputFormat for the country AtlasStatistics, based on the model of
MultipleTextOutputFormat
|
| MultipleAtlasDeltaOutputFormat |
MultipleOutputFormat for the AtlasStatistics, based on the model of
MultipleTextOutputFormat
|
| MultipleAtlasFeatureChangeOutput |
|
| MultipleAtlasGeoJsonOutputFormat |
|
| MultipleAtlasOutputFormat |
MultipleOutputFormat for the Atlas, based on the model of
MultipleTextOutputFormat
|
| MultipleAtlasProtoOutputFormat |
|
| MultipleAtlasStatisticsOutputFormat |
MultipleOutputFormat for the shard AtlasStatistics, based on the model of
MultipleTextOutputFormat
|
| MultipleFeatureChangeOutputFormat |
|
| MultipleLineDelimitedGeojsonOutputFormat |
MultipleOutputFormat for the shard Atlas to line delimited geojson, based on the
model of MultipleTextOutputFormat
|
| OverpassClient |
|
| OverpassOsmNode |
This node represents an Osm Node returned from an overpass query.
|
| OverpassOsmWay |
This way represents an osm way returned from an overpass query.
|
| PbfContext |
|
| PbfFilePathFilter |
Filters out non pbf files and directories.
|
| PbfLoader |
Load a set of Resources pbfs and build a single Atlas from it, following the wanted
country border and shard
|
| PbfLocator |
Locate the right PBF Resources from a store
|
| PbfLocator.LocatedPbf |
|
| PbfVerifier |
Command that verifies all expected PBF files exist and can be converted to atlas.
|
| PersistenceJsonParser |
Define a JSON format for the RDD keys used by the spark job.
|
| PersistenceTools |
|
| RawAtlasCreator |
This tool allows the user to replicate raw flow AtlasGenerator conditions on a certain
shard. |
| RemovedAtlasDeltaOutputFormat |
FileOutputFormat that writes an AtlasStatistics.
|
| RemovedMultipleAtlasDeltaOutputFormat |
MultipleOutputFormat for the AtlasStatistics, based on the model of
MultipleTextOutputFormat
|
| ResourceFileSystem |
FileSystem that is based on a set of resources.
|
| SeekableResourceStream |
Fake a Seekable stream from a Resource for testing
|
| ShardedAtlasRDDLoader |
|
| ShardedSparkJob |
Spark job that takes care of reading the sharding and country list and starts with a
JavaPairRDD of CountryName to Shard
|
| SlippyTilePersistenceScheme |
This class helps users construct storage paths dynamically based on the name of the target
resource to be saved.
|
| SlippyTilePersistenceSchemeType |
|
| SparkConfToHadoopConfigurationConverter |
Convert back and forth between Spark's configuration and Hadoop's configuration.
|
| SparkContextProvider |
Function that provides a SparkContext
|
| SparkContextProviderFinder |
|
| SparkFileHelper |
Helper class for listing and validating the presence of Atlas files
|
| SparkFileOutput |
Helper class to hide details of output operations for SparkJobs |
| SparkFilePath |
A helper class to handle temporary and target paths
|
| SparkInput |
Utility tools to load RDDs from elastic file systems (S3 for example), skipping the slowness of
the SparkContext textFile and sequenceFile functions.
|
| SparkJob |
Skeleton for a Spark Job
|
| SparkOptionsStringConverter |
StringConverter that does the parsing of additional Spark context string values.
|
| WorldAtlasGenerator |
Single threaded process taking an OSM PBF file and making an Atlas from it.
|
| WorldMultiAtlasGenerator |
Command that multiatlases together all atlas shards within an input directory.
|