org.openstreetmap.atlas.generator.tools.filesystem

Class FileSystemCreator

java.lang.Object

org.openstreetmap.atlas.generator.tools.filesystem.FileSystemCreator

public class FileSystemCreator
extends java.lang.Object

Utility class that helps create a FileSystem using some Spark/Hadoop configuration key-values.

Constructor Summary

Constructors

Constructor and Description
FileSystemCreator()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.fs.FileSystem	get(java.lang.String path, org.apache.hadoop.conf.Configuration configuration) Create a FileSystem from a Hadoop Configuration
org.apache.hadoop.fs.FileSystem	get(java.lang.String path, java.util.Map<java.lang.String,java.lang.String> configuration) Create a FileSystem from an agnostic configuration map
org.apache.hadoop.fs.FileSystem	get(java.lang.String path, org.apache.spark.SparkConf configuration) Create a FileSystem from a SparkConf
static java.util.Map<java.lang.String,java.lang.String>	resourceFileSystemScheme()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FileSystemCreator

public FileSystemCreator()

Method Detail

resourceFileSystemScheme

public static final java.util.Map<java.lang.String,java.lang.String> resourceFileSystemScheme()

Returns:

The configuration needed to get a ResourceFileSystem setup.

get

public org.apache.hadoop.fs.FileSystem get(java.lang.String path,
                                           org.apache.hadoop.conf.Configuration configuration)

Create a FileSystem from a Hadoop Configuration

Parameters:

path - The path that defines the FileSystem

configuration - The Configuration

Returns:

The corresponding FileSystem

get

public org.apache.hadoop.fs.FileSystem get(java.lang.String path,
                                           java.util.Map<java.lang.String,java.lang.String> configuration)

Create a FileSystem from an agnostic configuration map

Parameters:

path - The path that defines the FileSystem

configuration - The agnostic configuration map

Returns:

The corresponding FileSystem

get

public org.apache.hadoop.fs.FileSystem get(java.lang.String path,
                                           org.apache.spark.SparkConf configuration)

Create a FileSystem from a SparkConf

Parameters:

path - The path that defines the FileSystem

configuration - The SparkConf

Returns:

The corresponding FileSystem