neuroscience-stratify-and-report-detection-metrics

Solid

Use at analysis when a detection or classification result is about to be reported as one accuracy over a pooled population. Covers per-group and per-class precision, recall and confusion matrices at a stated threshold, and sweeping the degradations the recording modality actually suffers.

AI & Automation 804 stars 25 forks Updated today NOASSERTION

Install

View on GitHub

Quality Score: 82/100

Stars 20%
97
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Report per-group and per-class detection metrics, and sweep the modality's own degradations Neuroscience data arrives with grouping factors, and the field reports per group. Before analysing, list every categorical in the design or the file that is not the label - experimental condition, subject or session, region, cell type, acquisition site, artifact class - and make each one a reporting axis. Every headline number is reported per level, with the pooled value as one additional row. A column present in the data but absent from your tables reads as an unreported factor. Events of interest are usually rare, so use the detection metric family rather than accuracy or AUROC: precision, recall and F1 at a stated operating threshold, a precision-recall curve with average precision, and a confusion matrix - per class and per stratum. AUROC is insensitive to the prevalence regime the science operates in; report it only alongside these. Robustness means the corruptions the instrument itself produces - motion, drift, channel or electrode loss, line noise, low SNR, downsampling, session-to-session shift - swept one at a time, each as a degradation curve of the same metric, with the comparison methods on the same axes so relative decay rates are visible. Generic added Gaussian noise does not test this. Open with provenance: source dataset, acquisition modality, physical extent (volume, duration, subjects, cells), how ground-truth labels were obtained, and how it compares in scale a...

Details

Author
tangxiangru
Repository
tangxiangru/AutoR
Created
5 months ago
Last Updated
today
Language
Python
License
NOASSERTION

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category