ExternalDataFetcher (atlas-checks 6.3.7 API)

java.lang.Object
- org.openstreetmap.atlas.checks.base.ExternalDataFetcher

All Implemented Interfaces:

java.io.Serializable, java.util.function.Function<java.lang.String,java.util.Optional<org.openstreetmap.atlas.streaming.resource.Resource>>
```
public class ExternalDataFetcher
extends java.lang.Object
implements java.util.function.Function<java.lang.String,java.util.Optional<org.openstreetmap.atlas.streaming.resource.Resource>>, java.io.Serializable
```
The fetcher to use for generic resources. The fetcher uses hadoop cache to reduce remote reads. See ShardedIntegrityChecksSparkJob.atlasFetcher(java.lang.String, java.lang.String, java.util.Map<java.lang.String, java.lang.String>). This a separate class so that it can implement Serializable

See Also:

Serialized Form

Constructor Summary

Constructors
Constructor	Description
`ExternalDataFetcher(java.lang.String input, java.util.Map<java.lang.String,java.lang.String> configuration)`	Create the fetcher to use for generic resources.

Method Summary

All Methods Instance Methods Concrete Methods
Modifier and Type	Method	Description
`java.util.Optional<org.openstreetmap.atlas.streaming.resource.Resource>`	`apply(java.lang.String string)`
`void`	`setSilent(boolean silent)`	Make missed file messages silent (use when checking for files -- please log actual issues when this is used) Unfortunately, this does not suppress all messages from missed files.

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.function.Function
andThen, compose

- Constructor Detail
  - ExternalDataFetcher
```
public ExternalDataFetcher(java.lang.String input,
                           java.util.Map<java.lang.String,java.lang.String> configuration)
```
    Create the fetcher to use for generic resources. The fetcher uses hadoop cache to reduce remote reads. See ShardedIntegrityChecksSparkJob.atlasFetcher(java.lang.String, java.lang.String, java.util.Map<java.lang.String, java.lang.String>).
    
    Parameters:
    
    input - String input folder path
    
    configuration - SparkJob configuration map
- Method Detail
  - apply
```
public java.util.Optional<org.openstreetmap.atlas.streaming.resource.Resource> apply(java.lang.String string)
```
    Specified by:
    
    apply in interface java.util.function.Function<java.lang.String,java.util.Optional<org.openstreetmap.atlas.streaming.resource.Resource>>
  - setSilent
```
public void setSilent(boolean silent)
```
    Make missed file messages silent (use when checking for files -- please log actual issues when this is used) Unfortunately, this does not suppress all messages from missed files.
    
    Parameters:
    
    silent - true suppresses some logging messages from non-existent files