BERT Fine-Tuned on arXiv Metadata
A text-classification checkpoint fine-tuned from `bert-base-uncased` and published as `AyoubChLin/bert-finetuned-Arxiv`.
Timeline
Published on July 16, 2024, with trainer-generated run details and metric table.
Role & Scope
Implemented training/evaluation setup, handled model packaging, and exposed the checkpoint as a public Hugging Face artifact.
Team Setup
Individual model-development workflow with experiment tracking and model-card export from trainer outputs.
Context
Problem: Academic metadata classification needed a reusable baseline model that could be quickly integrated into search/indexing experiments.
Solution: Trained and published a BERT classifier through the Hugging Face Trainer workflow with full training-table metrics in the model card.
Impact: Evaluation table reports F1 up to 0.8872 and ROC AUC 0.9052 after 6 epochs, creating a concrete benchmark artifact for follow-up runs.
Implementation Details
Architecture
BERT-base-uncased fine-tuned for multi-class metadata topic classification on arXiv-derived text features.
Data & Evaluation
Model card logs include validation loss 0.2203, F1 0.8872, ROC AUC 0.9052, and accuracy 0.3438 at epoch 6.
Production & Ops
Published as safetensors + transformers artifact (Apache-2.0), including framework versions and reproducibility metadata.
Lessons Learned
Detailed run logging is critical: without clear dataset/task notes, raw metrics alone are harder to operationalize.
Links
Last verified: September 1, 2026
Public Evidence
Last verified: September 1, 2026