DataFrameStat

Defined in: data-frame-stat.ts:17

Statistical and approximate-query operations on a DataFrame.

Obtained via DataFrame.stat. Mirrors DataFrameStatFunctions in the JVM Spark API.

Example

const c = await df.stat.corr("height", "weight");
const quantiles = await df.stat.approxQuantile("latency", [0.5, 0.95, 0.99], 0.01);

See

Spark source: DataFrameStatFunctions.scala

Methods

approxQuantile()

approxQuantile(
   cols,
   probabilities,
   relativeError): DataFrame;

Defined in: data-frame-stat.ts:67

Compute approximate quantiles for numerical columns.

Parameters

Parameter	Type
cols	string[]
probabilities	number[]
relativeError	number

Returns

DataFrame

---

corr()

corr(
   col1,
   col2,
   method?): DataFrame;

Defined in: data-frame-stat.ts:26

Compute Pearson correlation between two columns.

Parameters

Parameter	Type	Default value
col1	string	undefined
col2	string	undefined
method	string	"pearson"

Returns

DataFrame

---

cov()

cov(col1, col2): DataFrame;

Defined in: data-frame-stat.ts:37

Compute sample covariance between two columns.

Parameters

Parameter	Type
col1	string
col2	string

Returns

DataFrame

---

crosstab()

crosstab(col1, col2): DataFrame;

Defined in: data-frame-stat.ts:47

Compute a pair-wise frequency table (contingency table).

Parameters

Parameter	Type
col1	string
col2	string

Returns

DataFrame

---

freqItems()

freqItems(cols, support?): DataFrame;

Defined in: data-frame-stat.ts:57

Find frequent items in the given columns.

Parameters

Parameter	Type
cols	string[]
support?	number

Returns

DataFrame