Package dev.vortex.spark

Class ArrowProperties

java.lang.Object

dev.vortex.spark.ArrowProperties

public final class ArrowProperties
extends Object

Turns off the per-value checks of the Arrow that Vortex relocates, as Spark's vectorized readers do for their own Arrow.

Arrow reads these settings once, when it first loads the classes that check bounds and nulls. So the Vortex classes that load first in a JVM call configure() from their static initializers. A setting the user gives as a system property or an environment variable stays as it is.

The readers check bounds and nulls themselves: Spark asks a column for null before it asks for a value, and each value is read at an index below the row count of its batch.

Method Summary

Modifier and Type	Method	Description
static void	configure()	Applies the settings, once per JVM.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

configure

public static void configure()

Applies the settings, once per JVM. The class initializer does the work, so a repeated call costs nothing.