Package org.openstreetmap.atlas.generator.tools.spark.rdd

Class ShardedAtlasRDDLoader

  • public class ShardedAtlasRDDLoader
extends java.lang.Object

    • Method Summary

      All Methods Static Methods Concrete Methods 
      Modifier and Type Method Description
      static org.apache.spark.api.java.JavaPairRDD<org.openstreetmap.atlas.geography.sharding.Shard,​org.openstreetmap.atlas.geography.atlas.Atlas> generateShardedAtlasRDD​(org.apache.spark.api.java.JavaSparkContext context, java.lang.String country, org.openstreetmap.atlas.geography.boundary.CountryBoundaryMap boundaries, java.lang.String atlasDirectory, org.openstreetmap.atlas.geography.sharding.Sharding atlasSharding, java.util.Map<java.lang.String,​java.lang.String> configurationMap)
      Load sharded atlas file and turn it into spark RDD
      static org.openstreetmap.atlas.geography.atlas.Atlas loadOneAtlasShard​(java.lang.String country, java.lang.String shardName, java.lang.String atlasDirectory, java.util.Map<java.lang.String,​java.lang.String> configurationMap)  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • ShardedAtlasRDDLoader

        protected ShardedAtlasRDDLoader()

    • Method Detail

      • generateShardedAtlasRDD

        public static org.apache.spark.api.java.JavaPairRDD<org.openstreetmap.atlas.geography.sharding.Shard,​org.openstreetmap.atlas.geography.atlas.Atlas> generateShardedAtlasRDD​(org.apache.spark.api.java.JavaSparkContext context,
                                                                                                                                                                                  java.lang.String country,
                                                                                                                                                                                  org.openstreetmap.atlas.geography.boundary.CountryBoundaryMap boundaries,
                                                                                                                                                                                  java.lang.String atlasDirectory,
                                                                                                                                                                                  org.openstreetmap.atlas.geography.sharding.Sharding atlasSharding,
                                                                                                                                                                                  java.util.Map<java.lang.String,​java.lang.String> configurationMap)
        Load sharded atlas file and turn it into spark RDD
        Parameters:
        context - - spark context for loading atlas files
        country - - country name
        boundaries - - boundaries
        atlasDirectory - - directory that contains atlas files
        atlasSharding - - atlas sharding information
        configurationMap - - configuration
        Returns:
        JavaPairRDD - Shard and Atlas pair

      • loadOneAtlasShard

        public static org.openstreetmap.atlas.geography.atlas.Atlas loadOneAtlasShard​(java.lang.String country,
                                                                              java.lang.String shardName,
                                                                              java.lang.String atlasDirectory,
                                                                              java.util.Map<java.lang.String,​java.lang.String> configurationMap)
        Parameters:
        country - - country name
        shardName - - shard name
        atlasDirectory - - directory that contains atlas file
        configurationMap - - configuration
        Returns:
        Atlas
        Throws:
        org.openstreetmap.atlas.exception.CoreException - potential CoreException while reading files