Class/Object

org.apache.spark.sql.execution.closedform

StatCounterWithFullCount

Related Docs: object StatCounterWithFullCount | package closedform

Permalink

class StatCounterWithFullCount extends InternalRow with BaseGenericInternalRow with ClosedFormStats

A class for tracking the statistics of a set of numbers (count, mean, variance and weightedCount) in a numerically robust way. Includes support for merging two counters.

Taken from Spark's StatCounter implementation removing max and min.

Linear Supertypes
ClosedFormStats, StatVarianceCounter, BaseGenericInternalRow, InternalRow, Serializable, Serializable, SpecializedGetters, AnyRef, Any
Known Subclasses
MultiTableStatCounterWithFullCount
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StatCounterWithFullCount
  2. ClosedFormStats
  3. StatVarianceCounter
  4. BaseGenericInternalRow
  5. InternalRow
  6. Serializable
  7. Serializable
  8. SpecializedGetters
  9. AnyRef
  10. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StatCounterWithFullCount(grow: InternalRow)

    Permalink

  2. new StatCounterWithFullCount()

    Permalink

    No-arg constructor for serialization.

  3. new StatCounterWithFullCount(weightedCount: Double, trueSum: Double, leftWeight: Double = 0.0, rightWeight: Double = 0.0, weight: Double = Double.NaN)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. def add(v: Double): Unit

    Permalink

  5. def anyNull: Boolean

    Permalink
    Definition Classes
    BaseGenericInternalRow → InternalRow

  6. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  7. def cfmerge(value: Double): Unit

    Permalink

  8. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  9. def computeVariance(aggregateType: Type): Unit

    Permalink

  10. def copy(): StatCounterWithFullCount

    Permalink
    Definition Classes
    StatCounterWithFullCount → StatVarianceCounter → InternalRow

  11. def copy(other: ClosedFormStats): Unit

    Permalink
    Definition Classes
    StatCounterWithFullCount → ClosedFormStats

  12. final var count: Long

    Permalink
    Definition Classes
    StatVarianceCounter

  13. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  14. def equals(o: Any): Boolean

    Permalink
    Definition Classes
    BaseGenericInternalRow → AnyRef → Any

  15. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  16. def genericGet(ordinal: Int): Any

    Permalink
    Attributes
    protected
    Definition Classes
    ClosedFormStats

  17. def get(ordinal: Int, dataType: DataType): AnyRef

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  18. def getArray(ordinal: Int): ArrayData

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  19. def getBinary(ordinal: Int): Array[Byte]

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  20. def getBoolean(ordinal: Int): Boolean

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  21. def getByte(ordinal: Int): Byte

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  22. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  23. def getDecimal(ordinal: Int, precision: Int, scale: Int): Decimal

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  24. def getDouble(ordinal: Int): Double

    Permalink
    Definition Classes
    ClosedFormStats

  25. def getFloat(ordinal: Int): Float

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  26. def getInt(ordinal: Int): Int

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  27. def getInterval(ordinal: Int): CalendarInterval

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  28. def getLong(ordinal: Int): Long

    Permalink
    Definition Classes
    ClosedFormStats

  29. def getMap(ordinal: Int): MapData

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  30. def getShort(ordinal: Int): Short

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  31. def getString(ordinal: Int): String

    Permalink
    Definition Classes
    InternalRow

  32. def getStruct(ordinal: Int, numFields: Int): InternalRow

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  33. def getUTF8String(ordinal: Int): UTF8String

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  34. def hashCode(): Int

    Permalink
    Definition Classes
    BaseGenericInternalRow → AnyRef → Any

  35. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  36. def isNullAt(ordinal: Int): Boolean

    Permalink
    Definition Classes
    BaseGenericInternalRow → SpecializedGetters

  37. var leftWeight: Double

    Permalink

  38. final var mean: Double

    Permalink
    Definition Classes
    StatVarianceCounter

  39. def merge(other: ClosedFormStats): Unit

    Permalink
    Definition Classes
    ClosedFormStats

  40. final def merge(other: StatVarianceCounter): Unit

    Permalink
    Definition Classes
    StatVarianceCounter

  41. final def merge(values: TraversableOnce[Double]): Unit

    Permalink
    Definition Classes
    StatVarianceCounter

  42. final def merge(value: Double): Unit

    Permalink
    Definition Classes
    StatVarianceCounter

  43. def mergeDistinctCounter(other: ClosedFormStats): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    ClosedFormStats

  44. def mergeDistinctCounter(other: StatVarianceCounter): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    StatVarianceCounter

  45. def mergeTrueSum(other: ClosedFormStats): Unit

    Permalink
    Definition Classes
    ClosedFormStats

  46. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  47. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  48. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  49. def numFields: Int

    Permalink
    Definition Classes
    ClosedFormStats

  50. def reset(lw: Double, rw: Double, w: Double): Unit

    Permalink

  51. var rightWeight: Double

    Permalink

  52. final def sampleStdev: Double

    Permalink
    Definition Classes
    StatVarianceCounter

  53. final def sampleVariance: Double

    Permalink
    Definition Classes
    StatVarianceCounter

  54. def setBoolean(i: Int, value: Boolean): Unit

    Permalink
    Definition Classes
    InternalRow

  55. def setByte(i: Int, value: Byte): Unit

    Permalink
    Definition Classes
    InternalRow

  56. def setDecimal(i: Int, value: Decimal, precision: Int): Unit

    Permalink
    Definition Classes
    InternalRow

  57. def setDouble(i: Int, value: Double): Unit

    Permalink
    Definition Classes
    InternalRow

  58. def setFloat(i: Int, value: Float): Unit

    Permalink
    Definition Classes
    InternalRow

  59. def setInt(i: Int, value: Int): Unit

    Permalink
    Definition Classes
    InternalRow

  60. def setLong(i: Int, value: Long): Unit

    Permalink
    Definition Classes
    InternalRow

  61. def setNullAt(i: Int): Unit

    Permalink
    Definition Classes
    StatCounterWithFullCount → InternalRow

  62. def setShort(i: Int, value: Short): Unit

    Permalink
    Definition Classes
    InternalRow

  63. final def stdev: Double

    Permalink
    Definition Classes
    StatVarianceCounter

  64. final def sum: Double

    Permalink
    Definition Classes
    StatVarianceCounter

  65. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  66. def toSeq(schema: StructType): Seq[Any]

    Permalink
    Definition Classes
    InternalRow

  67. def toSeq(fieldTypes: Seq[DataType]): Seq[Any]

    Permalink
    Definition Classes
    InternalRow

  68. def toString(): String

    Permalink
    Definition Classes
    StatCounterWithFullCount → StatVarianceCounter → BaseGenericInternalRow → AnyRef → Any

  69. def triggerSerialization(): Unit

    Permalink

    Evaluate once at each partition

    Evaluate once at each partition

    Definition Classes
    StatCounterWithFullCount → ClosedFormStats

  70. var trueSum: Double

    Permalink
    Definition Classes
    StatCounterWithFullCount → ClosedFormStats

  71. def update(i: Int, value: Any): Unit

    Permalink
    Definition Classes
    StatCounterWithFullCount → InternalRow

  72. var valSquareByCount: Double

    Permalink
    Attributes
    protected

  73. final def variance: Double

    Permalink
    Definition Classes
    StatVarianceCounter

  74. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  75. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  76. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  77. var weight: Double

    Permalink

  78. var weightedCount: Double

    Permalink
    Definition Classes
    StatCounterWithFullCount → ClosedFormStats

Inherited from ClosedFormStats

Inherited from StatVarianceCounter

Inherited from BaseGenericInternalRow

Inherited from InternalRow

Inherited from Serializable

Inherited from Serializable

Inherited from SpecializedGetters

Inherited from AnyRef

Inherited from Any

Ungrouped