Dataset is a storage for managing structured tabular data.
The dataset class provides a high-level interface for storing and retrieving structured data
with consistent schema, similar to database tables or spreadsheets. It abstracts the underlying
storage implementation details, offering a consistent API regardless of where the data is
physically stored.
Dataset operates in an append-only mode, allowing new records to be added but not modified
or deleted after creation. This makes it particularly suitable for storing crawling results
and other data that should be immutable once collected.
The class provides methods for adding data, retrieving data with various filtering options,
and exporting data to different formats. You can create a dataset using the open class method,
specifying either a name or ID. The underlying storage implementation is determined by
the configured storage client.
Dataset is a storage for managing structured tabular data.
The dataset class provides a high-level interface for storing and retrieving structured data with consistent schema, similar to database tables or spreadsheets. It abstracts the underlying storage implementation details, offering a consistent API regardless of where the data is physically stored.
Dataset operates in an append-only mode, allowing new records to be added but not modified or deleted after creation. This makes it particularly suitable for storing crawling results and other data that should be immutable once collected.
The class provides methods for adding data, retrieving data with various filtering options, and exporting data to different formats. You can create a dataset using the
openclass method, specifying either a name or ID. The underlying storage implementation is determined by the configured storage client.Usage