Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##(): Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  val AzureStorageAccountKeyName: String
5.  val S3AccessKeyName: String
6.  val S3SecretKeyName: String
7.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

8.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... ) @native()

9.  def constructAbsoluteObjectPaths(objectsRelativePathsDF: DataFrame, srcNamespace: String, storageType: String): Dataset[String]
10.  def constructDistCpCommand(hadoopProps: Array[(String, String)], absoluteAddressesTextFilePath: String, dstNamespaceForHadoopFs: String): Array[String]
11.  def eliminatePathsOfNonExistingObjects(absolutePathsDF: Dataset[String], hc: Configuration): Dataset[String]

    Eliminate objects that don't exist on the underlying object store from the path list.

    Eliminate objects that don't exist on the underlying object store from the path list.

    absolutePathsDF

    a data frame containing object absolute paths

    hc

    hadoop configurations

    returns

    a dataset only including absolute paths of objects that exist on the underlying object store

12.  final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

13.  def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

14.  def finalize(): Unit

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

15.  final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

16.  def getTextFileLocation(prefix: String, hc: Configuration): String
17.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

18.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

19.  def main(args: Array[String]): Unit

    Required arguments are the following:

    Required arguments are the following:

    1. address of parquet that includes the relative paths of files to backup or restore, created by a gc run 2. src: the namespace to backup or restore objects from/to (i.e. repo storage namespace, or an external location compatibly) 3. backup/restore destination: the namespace to backup or restore objects from/to (i.e. an external location or repo storage namespace compatibly) 4. Object storage type: "s3" or "azure"
20.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

21.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

22.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

23.  lazy val spark: SparkSession
24.  final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

25.  def toString(): String

    Definition Classes

    AnyRef → Any

26.  def validateAndParseHadoopConfig(hc: Configuration, storageType: String): Array[(String, String)]
27.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

28.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

29.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... ) @native()