rseng-fair-ml

Solid

Covers applying FAIR principles to machine learning artifacts: making models findable and reusable with model cards and rich repository metadata, documenting datasets with Croissant and datasheet-style records, licensing models and weights, linking the model-data-code-paper cluster with persistent identifiers, and the RDA FAIR4ML metadata direction. Use when a project trains, fine-tunes, publishes or reuses ML models or ML-ready datasets, when the user mentions model cards, Croissant, datasheets, FAIR4ML or model licensing, when a model heads to a hub or archive, or when evaluating whether a third-party model is documented well enough to build on. (General software FAIR is rseng-fair-software; automated repository scoring is rseng-fairguard.)

AI & Automation 14 stars 2 forks Updated 4 days ago MIT

Install

View on GitHub

Quality Score: 83/100

Stars 20%
39
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# FAIR for machine learning FAIR was written for data, extended to software (FAIR4RS - rseng-fair-software), and is now being worked out for machine learning (the RDA FAIR4ML interest group leads the metadata standardization). ML needs its own treatment because a model is neither data nor ordinary software: its behavior is inseparable from its training data, its "source" includes weights that no license default covers, and reuse without documentation reproduces biases invisibly. The practical FAIR-ML unit is the CLUSTER - model + data + code + evaluation + paper - linked both ways with persistent identifiers. ## Findable: metadata that machines and reviewers read - Model cards are the model's README and its FAIR metadata in one: intended use and out-of-scope uses, training data description, evaluation results with conditions, limitations and biases, licensing. Hub-hosted cards (Hugging Face's structured format) double as searchable metadata; write them from the actual training run, not memory (the experiment config and logs are the source - rseng-reproducibility). - Datasets get Croissant: the MLCommons format describes ML datasets (schema, distribution, provenance) in machine-readable form that major hubs and search index - the ML-ready complement to the generic dataset documentation in rseng-data-management. - Identifiers: archive released models and dataset snapshots with DOIs (rseng-archiving; hub storage is not preservation), and cross-link model...

Details

Author
fdiblen
Repository
fdiblen/rseng-agent-skills
Created
4 days ago
Last Updated
4 days ago
Language
Python
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

rseng-fair-software

Covers how to apply the FAIR principles - findable, accessible, interoperable, reusable - to research software, and how to assess a project's FAIRness. Use when the user asks how to make software FAIR, wants help with findability, discoverability, or software reuse, mentions metadata, persistent identifiers, DOIs, registries, or software citation in a FAIR context, or asks to run a FAIR self-assessment or checklist on a repository. (Automated FAIR4RS scoring, compliance levels and CI gates with the FAIRGuard tool are rseng-fairguard; FAIR for ML models and datasets is rseng-fair-ml; finding existing software to reuse is rseng-software-reuse.)

14 Updated 4 days ago
fdiblen
AI & Automation Solid

rseng-fairguard

Covers assessing research software against the 17 FAIR4RS principles with FAIRGuard (https://www.fairguard.org): compliance scores and levels (bronze to platinum), assessment profiles, quality gates for CI, .fairguard.yml configuration, per-indicator skips, and acting on findings. Use PROACTIVELY on research software projects - at repo intake, before releases, after adding publication metadata - and act on its findings. Also use when the user asks to check FAIR compliance, wants a FAIR score, report or badge level, wants a FAIR quality gate in CI, or mentions fairguard, FAIR4RS or .fairguard.yml. (FAIR concepts, principles and hand-guided improvement are rseng-fair-software; ML artifacts are rseng-fair-ml.)

14 Updated 4 days ago
fdiblen
AI & Automation Listed

fair-check

Audit manuscript and replication package against FAIR open-science principles.

55 Updated yesterday
scdenney