MemoryDatasetClient
Hierarchy
- DatasetClient
- MemoryDatasetClient
Index
Methods
__init__
Initialize a new instance.
Preferably use the
MemoryDatasetClient.openclass method to create a new instance.Parameters
keyword-onlymetadata: DatasetMetadata
Returns None
drop
Drop the whole dataset and remove all its items.
The backend method for the
Dataset.dropcall.Returns None
get_data
Get data from the dataset with various filtering options.
The backend method for the
Dataset.get_datacall.
Memory implementation of the dataset client.
This client stores dataset items in memory using Python lists and dictionaries. No data is persisted between process runs, meaning all stored data is lost when the program terminates. This implementation is primarily useful for testing, development, and short-lived crawler operations where persistent storage is not required.
The memory implementation provides fast access to data but is limited by available memory and does not support data sharing across different processes. It supports all dataset operations including sorting, filtering, and pagination, but performs them entirely in memory.