p

io.treeverse

clients

package clients

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. case class APIConfigurations(apiUrl: String, accessKey: String, secretKey: String, connectionTimeoutSec: String = "", readTimeoutSec: String = "") extends Product with Serializable
  2. class ApiClient extends AnyRef
  3. trait BulkRemover extends AnyRef
  4. class Conf extends ScallopConf

    Conf options and arguments usage is documented in https://github.com/scallop/scallop/wiki

  5. class ConfigMapper extends Serializable
  6. class EntryRecord[Proto <: Message] extends AnyRef
  7. class EntryRecordReader[Proto <: GeneratedMessage with Message[Proto]] extends RecordReader[Array[Byte], WithIdentifier[Proto]]
  8. case class ExportStatus(path: String, success: Boolean, msg: String) extends Serializable with Product

    Export status of a single file

    Export status of a single file

    path

    of the file

    success

    indicates if the file export succeeded

    msg

    additional information of the status

  9. class Exporter extends AnyRef
  10. class GarbageCollector extends Serializable
  11. class GravelerSplit extends InputSplit with Writable
  12. class Handler extends Callable[ExportStatus] with Serializable
  13. class Item[T] extends AnyRef
  14. trait KeyFilter extends Serializable
  15. class LakeFSAllRangesInputFormat extends LakeFSBaseInputFormat
  16. abstract class LakeFSBaseInputFormat extends InputFormat[Array[Byte], WithIdentifier[Entry]]
  17. class LakeFSCommitInputFormat extends LakeFSBaseInputFormat
  18. class LakeFSRangeGetter extends RangeGetter
  19. trait RangeGetter extends Serializable
  20. class RequestRetryWrapper extends AnyRef
  21. trait S3ClientBuilder extends Serializable

    Interface to build an S3 client.

    Interface to build an S3 client. The object io.treeverse.clients.conditional.S3ClientBuilder -- conditionally defined in a separate file according to the supported Hadoop version -- implements this trait. (Scala requires companion objects to be defined in the same file, so it cannot be a companion.)

  22. class SSTableIterator[Proto <: GeneratedMessage with Message[Proto]] extends Iterator[Item[Proto]]
  23. class SSTableReader[Proto <: GeneratedMessage with Message[Proto]] extends Closeable
  24. class SparkFilter extends KeyFilter
  25. class WithIdentifier[Proto <: GeneratedMessage with Message[Proto]] extends AnyRef

Value Members

  1. object BulkRemoverFactory
  2. object Exporter
  3. object GarbageCollector extends Serializable
  4. object GravelerSplit
  5. object LakeFSContext
  6. object LakeFSInputFormat
  7. object Main

    Main exports lakeFS object to an object-store location.

    Main exports lakeFS object to an object-store location. There are 3 options to run the Export main:

    1. Export all objects from branch 'main' on 'example-repo' repository to s3 location 's3://example-bucket/prefix/': submit example-repo s3://example-bucket/prefix/ --branch=main 2. Export all objects from a commit 'c805e49bafb841a0875f49cd555b397340bbd9b8' on 'example-repo' repository to s3 location 's3://example-bucket/prefix/': submit example-repo s3://example-bucket/prefix/ --commit_id=c805e49bafb841a0875f49cd555b397340bbd9b8 3. Export only the diff between branch 'main' and commit 'c805e49bafb841a0875f49cd555b397340bbd9b8' on 'example-repo' repository to s3 location 's3://example-bucket/prefix/': submit example-repo s3://example-bucket/prefix/ --branch=main --prev_commit_id=c805e49bafb841a0875f49cd555b397340bbd9b8
  8. object SSTableReader
  9. object StorageClientType extends Enumeration
  10. object StorageUtils
  11. object URLResolver extends Serializable
  12. object VarInt

    from https://github.com/addthis/stream-lib/blob/master/src/main/java/com/clearspring/analytics/util/Varint.java

Ungrouped