Cell Segmentation Benchmark – Cell Tracking Challenge

The following table presents the best three results across the 13 included datasets for generalizable submissions and the best three results per dataset for regular submissions, both being evaluated using the OP_CSB, SEG, and DET measures. The detailed evaluation of technical performance of all generalizable submissions can be found in this document, and that of all regular submissions is available here. Refer to Participants for detailed descriptions of individual algorithms and to this document for the mapping between the tags currently used for individual algorithms and their past alternatives.

Inter-annotator variability

The inter-annotator variability is expressed in the form of mean ± standard deviation of the SEG and DET scores for the three manual annotations used to create the gold reference annotations. The NA records correspond to the situations when only one manual tracking annotation exists (Fluo-N3DH-CE, Fluo-N3DL-DRO, Fluo-N3DL-TRIC, and Fluo-N3DL-TRIF) or when no manual annotation was necessary to create due to the existence of ground truth annotations for the computer-generated datasets (Fluo-C3DH-A549-SIM, Fluo-N2DH-SIM+, and Fluo-N3DH-SIM+).

2024-06-12: New regular submission NUDT-CN included.
2024-04-10: The regular submission DESU-US updated.
2023-12-18: New regular submission AC (8) included.
2023-11-10: The regular submission AC (6) updated.
2023-08-01: The benchmark opened for online generalizable submissions.
2023-04-11: New regular submission UCH-CL (2) included. The regular submission UCH-CL renamed to UCH-CL (1).
2023-02-27: New regular submissions AC (6) and HD-GE (BMCV) (4) included.
2022-11-05: New regular submission UFRGS-BR included.
2022-06-01: The regular submission AC (5) renamed to BGU-IL (5). The invited generalizable submissions transferred.

Past History Log

2022-03-14: New regular submissions KIT-Loe-GE, MPI-Br-GE (2), and MSU-RU included. The regular submission MPI-Br-GE renamed to MPI-Br-GE (1).
2021-12-22: New regular submissions BFR-GE (1), BFR-GE (2), JAN-US, ND-US (2), and HD-Wag-GE included. The regular submission DESU-US updated. The regular submission ND-US renamed to ND-US (1).
2021-10-22: New regular submission MON-AU included. The regular submissions BGU-IL (5) and KIT-Sch-GE (2) updated.
2021-08-13: The regular submission AC (4) renamed to UNSW-AU. The regular submission DREX-US updated.
2021-07-19: New regular submission MPI-Ar-GE included. The regular submission MPI-GE renamed to MPI-Br-GE.
2021-05-09: The regular submissions AC (4) and KIT-Sch-GE (2) updated.
2021-04-28: New regular submission IGFL-FR included.
2021-04-13: All ISBI 2021 regular submissions included.
2021-01-15: New regular submissions AC (4), CSU-CN, HDU-CN, and MU-Wa-US included. The regular submission PURD-US updated.
2020-11-15: New regular submission UCH-CL included.
2020-08-01: New regular submission WARW-UK included.
2020-07-28: New regular submission DKFZ-GE included. The regular submission CALT-US updated.
2020-06-05: The regular submission CALT-US updated. The regular submission RWTH-GE split into RWTH-GE (1), RWTH-GE (2), and RWTH-GE (3).
2020-04-03: All ISBI 2020 regular submissions included.
2020-02-12: The regular submission UVA-NL updated.
2020-01-27: New regular submission PURD-US included.
2020-01-14: New regular submission BGU-IL (5) included.
2019-12-19: New regular submissions OX-UK and UVA-NL included. The regular submission MU-Lux-CZ updated.
2019-11-30: The scores for Fluo-N3DH-CE and Fluo-N3DL-DRO updated.
2019-10-14: The regular submission MU-Akb-CZ updated.
2019-09-02: The regular submission MU-Lux-CZ updated.
2019-07-15: The regular submission MU-Lux-CZ updated.
2019-04-30: The regular submission HIT-CN updated.
2019-04-08: All ISBI 2019 regular submissions included. The benchmark opened for online regular submissions.
2018-10-15: The benchmark initiated.