Paper UMLLR Tag-order Ablation

One ordering change at a time, with the regressor held fixed.

Last rendered 2026-04-20 01:12 UTC

← Back to Paper benchmark summary

Fixed benchmark snapshot shared by the Hugging Face notebook, benchmark-only HTML build, and generated TeX includes. Best strategy in this bundle: taxonomy_association (0.263237 mean p-adic loss).

For these UMLLR ablations, Avg active params / classification is the mean number of active coefficients touched while classifying one product.

Ordering methods

The ablation keeps the greedy p-adic regressor fixed and changes only the tag ordering heuristic used before coefficient fitting.

taxonomy_association

Taxonomy-peaked tags first

For each tag, measure the share of its training occurrences that land in its single most common taxonomy. Tags with the strongest one-taxonomy association are scored first.

random

Seeded random control

Uses a seeded random shuffle of the training tag vocabulary as a control condition.

frequency

Most common tags first

Ranks tags by how often they appear in the training products.

battle_elo

Pairwise battle ranking

Ranks tags by fold-local Elo scores estimated from tag battles, while excluding the holdout fold from the ranking fit.

mean_title_position

Average title position

Ranks tags by their average recorded title position in the training products.

UMLLR tag-order ablation chart for paper benchmark view
Bar chart generated from the same bundle rows consumed by the notebook.
StrategyMean p-adic lossΔ vs battle_eloFold winsExact acc.Prefix-2 acc.Avg active params / classification
taxonomy_association0.263237-0.0616885/549.82%65.38%1.11
random0.312856-0.01206921/2543.73%59.89%1.41
frequency0.319671-0.0052544/542.88%60.20%1.91
battle_elo0.3249250.0000000/543.63%59.75%1.42
mean_title_position0.3420060.0170811/542.28%58.67%1.68