Contents:

basic_dataset_handler#

Module Contents#

`RawDatasetHandler`
`BasicDatasetHandler`

load_contextual_embed(texts, device[, model_name, ...])

load_contextual_embed(texts, device, model_name='all-mpnet-base-v2', show_progress_bar=True)#

class RawDatasetHandler(docs, preprocessing, batch_size=200, device='cpu', as_tensor=False, contextual_embed=False)#

class BasicDatasetHandler(dataset_dir, batch_size=200, read_labels=False, device='cpu', as_tensor=False, contextual_embed=False)#

load_data(path, read_labels)#