How to manually or custom set the Arcengine scratch directory

From Cloudera Manager, go to the Arcadia Configuration, click on the Arcadia Analytics Engine option, and search for “flagfile”. Within the flagfile snippet you can then add the flag --scratch_dirs with the desired scratch directory path.

1 Like

Tadd,
How do we set this to multiple directories?
In Impala, it is set to multiple locationsin our clusters .

For example:
/data/1/impala
/data/2/impala
/data/3/impala
/data/4/impala
/data/5/impala

Thanks
Srividya

Srividya,

You can set multiple scratch directories by providing a comma separated list of paths in Cloudera Manager under the Arcadia Analytics Engine Advanced Configuration Snippet (Safety Valve) for flagfile settings using the scratch_dirs start-up flag:

--scratch_dirs="/data/1/arcengine,/data/2/arcengine,/data/3/arcengine,/data/4/arcengine,/data/5/arcengine"