Page tree
Skip to end of metadata
Go to start of metadata

Description:
This property specifies the execution engine to be used for the Kyvos dataset and cube build jobs.

Values and behavior:

  • MapReduce: Kyvos jobs will use the MapReduce engine.
  • Spark: Kyvos jobs will use the Spark engine whenever possible.

NOTE: Certain jobs will be executed with MapReduce, even when the engine is defined as Spark. This is done for performance or compatibility reasons. For example, the User Defined Function tool and Skewed Joins in the Dataset module use MapReduce. Certain indexing jobs when building a cube also use the MapReduce engine.

Default value:
Spark

Dependencies and Related Properties:
When the value is set as MapReduce:

When the value is set as Spark, ensure that Spark is configured for both cluster and Kyvos.

  • No labels