• Code
  • Dataset
  • Demo
  • Model

DiffuMT Dataset

Mask, real and synthetic IRM microtubule image triplets

Three rows, each with a binary microtubule mask, the real IRM recording, and the image DiffuMT generated from the mask

Triplets of a binary mask, the real IRM recording and the image DiffuMT generated from that mask, from our NLDL 2027 paper.

Each item of the dataset is a triplet of interference reflection microscopy (IRM) images of in vitro microtubules: a pixel-precise binary mask, the real recording, and the synthetic counterpart that the DiffuMT model generated from the mask. All images are 256 × 256 px. In a two-alternative forced-choice study, domain experts could not reliably tell the synthetic images from the real ones.

The preview shows three triplets: the mask on the left, the real recording in the middle, and the generated image on the right.

The test split (200 triplets) is released now. A train split (2,961 triplets) and an unlabeled split (1,336 real images) will follow.

from datasets import load_dataset

ds = load_dataset("HTW-KI-Werkstatt/DiffuMT", split="test")

The dataset is released under CC BY 4.0.

Other Datasets which might be of interest

  • Two real IRM microtubule images in the top row and the images DiffuMT generated from their masks in the bottom row

    DiffuMT

    A diffusion model that turns a segmentation mask into a realistic IRM microtubule image, for generating labeled training data.
    Read more

  • Redakto

    Everybody wants to paste text into LLMs - but some texts contains sensitive information. To protect your privacy and enable you to use LLMs, we developed and evaluated lightweight transformer models to redact German texts.
    Read more

  • From Heat to Force

    We conducted a comprehensive study to investigate the relationship between the contact forces exerted by the fingers and the thermal signature that people leave behind when interacting with objects. The result is a substantial dataset consisting of 703 thermal imaging videos and precise force measurements from 27 participants.
    Read more

  • SynTabFall

    In collaboration with Charité Berlin we released a synthetic data set for training AI fall risk assessement models. We trained a number of tabular genAI model classes on ~1Mio patient records of Charité Berlin and optimised the models with respect to fidelity, utility and privacy, in close collaboration with data protection officers.
    Read more
  • A synthetic microtubule image, its ground-truth instance masks, and predictions by FIESTA and SAM3Text

    SynthMT

    A synthetic benchmark for microtubule segmentation with pixel-perfect instance masks, plus real IRM images in the same format, from our paper in PLOS Computational Biology.
    Read more
  • Chart: model performance on RamanBench against the model's release date, from PLS to TabPFN

    raman-bench

    The Python package behind RamanBench, our NeurIPS 2026 benchmark. It loads 74 Raman datasets with fixed splits and scores your model against 28 baselines, without re-running them.
    Read more
  • Example Raman spectra from material science, biotechnology, medicine and chemistry

    raman-data

    A Python package that lists, downloads and loads public Raman spectroscopy datasets as arrays, from Kaggle, Hugging Face, Zenodo and other archives. It provides the datasets for RamanBench.
    Read more
  • The same wall clock three times: with a handwritten sticky note reading TAXI (SCAM), with a blank note (NoSCAM), and with the word taxi inserted synthetically (SynthSCAM)

    SCAM

    The largest dataset of real-world typographic attack images, with handwritten notes that try to mislead vision-language models, plus clean and synthetic versions of every image.
    Read more
  • Fluorescence microscopy images of cell nuclei from the Broad Bioimage Benchmark Collection, and a colour-coded segmentation of one of them

    bbbc-datasets

    A Python package that downloads the segmentation datasets of the Broad Bioimage Benchmark Collection (BBBC) and loads them as PyTorch datasets, in 2D and 3D.
    Read more