Page tree
Skip to end of metadata
Go to start of metadata

Description:

This property specifies what data should be read from the Distributed filesystems (DFS) like HDFS or S3 when the Kyvos processed data is not found in the local file system.

Values and behavior:

  • NONE: No data will be read from DFS if metadata or cuboids are not available on the local or NFS filesystem, and the query will fail.
  • METADATA: If metadata is not available on the local or NFS filesystem, then it will be read from the DFS. If cuboids are not available on the local or NFS filesystem, then the query will fail.
  • CUBOID: Only cuboids will be read from DFS if they are not found on the local file system. Missing metadata will result in a query failure.
  • ALL: If metadata or cuboids are not available on the local or NFS filesystem, then they will be read from the DFS.

Default value:

CUBOID

Scope:

Cube: If the property is set on a cube, then the value will override the connection level value for that cube’s build job.

Comes into effect:

It comes into effect in a new browsing session after setting the property on the cube. This property does not require a cube rebuild.

Dependencies and related properties:

kyvos.cuboid.replication.type

Recommendation:

For the S3 file system, we recommend setting the replication type to LOCAL or NFS and the above property as NONE due to limited open connections.


IMPORTANT

If reading from DFS is disabled (NONE, CUBOID) and metadata is not available on local or NFS filesystem, then the query will fail with error - “Could not serve the query as cube metadata is not replicated locally. Please wait for metadata replication to complete.”

If reading from DFS is disabled (NONE, METADATA) and cuboid is not available on local or NFS filesystem, then the query will fail with error - “Could not serve the query as cuboid is not replicated locally. Please wait for cuboid replication to complete.”

So check query logs in such cases and set the property value accordingly.

  • No labels