You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This introduces a backdoor for disabling attempting to download parquet files through the OPENML_SKIP_PQ variable.
If OPENML_SKIP_PQ is set to true (case insensitive), then parquet files will not be downloaded in the get_dataset and OpenMLDataset.get_data calls.
The PR also fixes a bug where an error would be raised if the parquet file failed to download. The str(_get_dataset_parquet_file(self)) would return None if it failed to download, but by converting it to a string the next check is always false and thus it would not fall back to arff.
The reason for using an environment variable:
It's a bit quicker to implement than a configuration option, and it makes it easier to turn it on for a single call.
Compared to adding function arguments, the environment variable (or configuration option) don't need changes to existing scripts. Making it easier for people to start using it now, and stop using it later. We can issue a warning if the environment variable remains set in a later release.
This introduces a backdoor for disabling attempting to download parquet files through the
OPENML_SKIP_PQvariable.If
OPENML_SKIP_PQis set totrue(case insensitive), then parquet files will not be downloaded in theget_datasetandOpenMLDataset.get_datacalls.The PR also fixes a bug where an error would be raised if the parquet file failed to download. The
str(_get_dataset_parquet_file(self))would returnNoneif it failed to download, but by converting it to a string the next check is always false and thus it would not fall back to arff.The reason for using an environment variable: