Skip to content

data

data provides a collection of data processing utilities for handling data.

While 🤗 datasets is a powerful library for managing datasets, it is a general-purpose tool that may not cover all the specific functionalities of scientific applications.

The data package is designed to complement datasets by offering additional data processing utilities that are commonly used in scientific tasks.

Usage

Load from local data file

Python
1
2
3
from multimolecule.data import Dataset

dataset = Dataset("data/rna/5utr.csv")

Load from 🤗 datasets

Python
1
2
3
4
from multimolecule.data import Dataset

# `split` must be specified if there are more than one split in the dataset
dataset = Dataset("multimolecule/bprna-spot", split="train")

Construct from local data

Python
1
2
3
4
5
6
7
8
from multimolecule.data import Dataset

data = {
    "sequence": ["GCGCAAGCGACGGCGCUA", "AUUCCGAGUAGCUCGGAAU"],
    "labels": ["((((....)))).....", ".....((((.....))))."],
}

dataset = Dataset(data, split="train", pretrained="multimolecule/rna")