Modelpedia: A Catalog of Model Findings for the Meta-Science of AI
Mirrored from arXiv — Machine Learning for archival readability. Support the source by reading on the original site.
Computer Science > Machine Learning
Title:Modelpedia: A Catalog of Model Findings for the Meta-Science of AI
Abstract:Scientific knowledge about AI models is produced faster than the community can organize it. Every few months a new foundation model reshapes the field and hundreds of papers, blogs, and technical reports document how each behaves or fails. Yet, these findings remain scattered and effectively unretrievable. To address this gap we present Modelpedia, an automated, LLM-assisted framework that extracts findings about models from published papers, links it to the model, dataset, method, and concept it concerns, and aggregates the result into a searchable public catalog. Applying the prototype to accepted ICLR 2024 and 2025 papers, we extract over a thousand findings and, treating the catalog itself as an object of study, run a meta-analysis of how the community investigates models. Now, we invite the community to explore, contribute to, and build on the open catalog, and to help establish model findings as a shared foundation for the meta-science of AI.
| Comments: | For the website, see: this https URL For the codebase, see: this https URL |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2609.01090 [cs.LG] |
| (or arXiv:2609.01090v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2609.01090
arXiv-issued DOI via DataCite (pending registration)
|
Access Paper:
- View PDF
- HTML (experimental)
- TeX Source
References & Citations
Bibliographic and Citation Tools
Code, Data and Media Associated with this Article
Demos
Recommenders and Search Tools
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
More from arXiv — Machine Learning
-
AhaBench: Do Agents Learn from Prior Experience? A Benchmark for Long-Horizon Continual Learning
Sep 10
-
When Do Options Help? Policy Necrosis and Redundant Coverage in Option-Critic
Sep 10
-
Multi-granularity Adaptive Hypergraph Representation Learning via Granular-ball
Sep 10
-
Capsule Lens: Locating and Tracking Concept Geometry in Model Representations
Sep 10
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.