Reading data from tables with nested subdirectory structures

By default Arcadia expects that files on the HDFS are not nested in subdirectories within the root directory of a Hive table LOCATION.

Reading data recursively from a nested directory structure can be enabled by altering some of the properties of your table, and then refreshing the metadata for that table in the Arcadia Catalog:

alter table mydbname.mytablename set tblproperties('arcadia.include_subdirectories'='true');

refresh mydbname.mytablename;

1 Like