p

io.treeverse

clients

package clients

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. case class APIConfigurations(apiUrl: String, accessKey: String, secretKey: String, connectionTimeoutSec: String = "", readTimeoutSec: String = "", source: String = "") extends Product with Serializable

    source

    a string describing the application using the client. Will be sent as part of the X-Lakefs-Client header.

  2. class ApiClient extends AnyRef
  3. trait BulkRemover extends AnyRef
  4. class Conf extends ScallopConf

    Conf options and arguments usage is documented in https://github.com/scallop/scallop/wiki

  5. class ConfigMapper extends Serializable

    Maps a broadcast object including hadoop configuration values into hadoop configuration.

  6. class EntryRecord[Proto <: Message] extends AnyRef
  7. class EntryRecordReader[Proto <: GeneratedMessage with Message[Proto]] extends RecordReader[Array[Byte], WithIdentifier[Proto]]
  8. case class ExportStatus(path: String, success: Boolean, msg: String) extends Serializable with Product

    Export status of a single file

    Export status of a single file

    path

    of the file

    success

    indicates if the file export succeeded

    msg

    additional information of the status

  9. class Exporter extends AnyRef
  10. class GarbageCollector extends Serializable
  11. class GravelerSplit extends InputSplit with Writable
  12. class Handler extends Callable[ExportStatus] with Serializable
  13. class Item[T] extends AnyRef
  14. trait KeyFilter extends Serializable
  15. class LakeFSAllRangesInputFormat extends LakeFSBaseInputFormat
  16. abstract class LakeFSBaseInputFormat extends InputFormat[Array[Byte], WithIdentifier[Entry]]
  17. class LakeFSCommitInputFormat extends LakeFSBaseInputFormat
  18. class LakeFSJobParams extends AnyRef

  19. class LakeFSRangeGetter extends RangeGetter
  20. trait RangeGetter extends Serializable
  21. class RequestRetryWrapper extends AnyRef
  22. trait S3ClientBuilder extends Serializable

    Interface to build an S3 client.

    Interface to build an S3 client. The object io.treeverse.clients.conditional.S3ClientBuilder -- conditionally defined in a separate file according to the supported Hadoop version -- implements this trait. (Scala requires companion objects to be defined in the same file, so it cannot be a companion.)

  23. class S3RetryCondition extends SDKDefaultRetryCondition
  24. class SSTableIterator[Proto <: GeneratedMessage with Message[Proto]] extends Iterator[Item[Proto]]
  25. class SSTableReader[Proto <: GeneratedMessage with Message[Proto]] extends Closeable
  26. class SparkFilter extends KeyFilter
  27. class WithIdentifier[Proto <: GeneratedMessage with Message[Proto]] extends AnyRef

Value Members

  1. object ApiClient
  2. object BuildInfo extends Product with Serializable

    This object was generated by sbt-buildinfo.

  3. object BulkRemoverFactory
  4. object Exporter
  5. object GarbageCollector extends Serializable
  6. object GravelerSplit
  7. object HadoopUtils
  8. object LakeFSContext
  9. object LakeFSInputFormat
  10. object LakeFSJobParams
  11. object Main

    Main exports lakeFS object to an object-store location.

    Main exports lakeFS object to an object-store location. There are 3 options to run the Export main:

    1. Export all objects from branch 'main' on 'example-repo' repository to s3 location 's3://example-bucket/prefix/': submit example-repo s3://example-bucket/prefix/ --branch=main 2. Export all objects from a commit 'c805e49bafb841a0875f49cd555b397340bbd9b8' on 'example-repo' repository to s3 location 's3://example-bucket/prefix/': submit example-repo s3://example-bucket/prefix/ --commit_id=c805e49bafb841a0875f49cd555b397340bbd9b8 3. Export only the diff between branch 'main' and commit 'c805e49bafb841a0875f49cd555b397340bbd9b8' on 'example-repo' repository to s3 location 's3://example-bucket/prefix/': submit example-repo s3://example-bucket/prefix/ --branch=main --prev_commit_id=c805e49bafb841a0875f49cd555b397340bbd9b8
  12. object SSTableReader
  13. object StorageClientType extends Enumeration
  14. object StorageUtils
  15. object URLResolver extends Serializable
  16. object VarInt

    from https://github.com/addthis/stream-lib/blob/master/src/main/java/com/clearspring/analytics/util/Varint.java

Ungrouped