Decision Tree Classifier

Interpretable tree-based model using ALL tags

← Back to index

Model overview

Decision tree classifier for predicting taxonomy IDs from product tags. Unlike parameter-constrained models, this classifier uses ALL available tags. The tree structure provides natural interpretability - each decision node tests whether a specific tag is present, leading to a taxonomy prediction at the leaves.

5 CV folds
50.90% Mean accuracy
0.5431 Mean F1
0.217154 Mean p-adic loss
64,105 Avg effective params

Cross-validation results

FoldAccuracyF1P-adic loss (mean)Tree depthNodesEffective params
050.16%0.53320.22104711496,85164,303
151.31%0.54780.21589811466,88564,592
251.67%0.54760.22808311526,83364,089
350.86%0.54700.22715011596,78163,675
450.50%0.54020.19359411656,79763,869

Feature importances (Top 50)

Feature importances are averaged across all 5 folds. The "Folds" column shows how many folds used this feature.

RankTagAvg ImportanceFolds
1ACCESSORIES0.0046235/5
2NEW0.0039935/5
3WOMENS0.0030075/5
4BIRTHDAY0.0029485/5
5WOMEN0.0027935/5
6KIDS0.0026295/5
7RETAIL0.0026045/5
8HAT0.0026015/5
9BLACK0.0025025/5
10MAKEUP0.0024525/5
11BRUSH0.0024475/5
12CLOTHING0.0022835/5
13CAR COASTERS0.0021262/5
14SHOP: PARROT FOOD0.0021241/5
15COOKING OIL0.0021221/5
16SHOP: ZUPREEM0.0021221/5
17FOOD COLOR0.0021194/5
18DRESS0.0021175/5
19PRINTED SILK0.0021173/5
20ALL30MLPRODUCTS0.0021154/5
21_RELATED_HOT-CEREAL-LANDING-PAGE0.0021154/5
22BICYCLES AND MOTORCYCLES0.0021142/5
23SIRUP0.0021125/5
24TOWEL-RAILS0.0021125/5
25THERMOSTATS0.0021125/5
26ELECTRIC-SKATEBOARDS0.0021125/5
27INKYBAY_CUSTOM0.0021125/5
28HEALTH AND BEAUTY0.0021125/5
29IMT TOOLS0.0021125/5
30RAFCAMERA0.0021125/5
31CHEESE TOOL0.0021125/5
32PLANT STANDS AND BENCHES0.0021125/5
33KEYS0.0021125/5
34WARRANTY-SEATS_20.0021125/5
35MOTORCYCLE RAMP0.0021103/5
36CAR ACCESSORIES0.0021042/5
37PRINTED POCKET SQ0.0021042/5
38SHOP: PELLETS0.0021043/5
39PALEO HOT CEREAL0.0020971/5
40NICOTINE0.0020971/5
41CATEGORY_BATHMATS0.0020855/5
42_RELATED_GRANOLA-LANDING-PAGE0.0020515/5
43KNITTED BEAN BAG0.0020461/5
44BEANBAG0.0020251/5
45WIRE MANAGEMENT0.0020175/5
4620240.0020113/5
4713 MONTHS TO 24 MONTHS0.0020032/5
48INTERCHANGEABLE WATCH STRAP0.0019952/5
49SUPER CHUNKY BEAN BAG0.0019951/5
50HALL50OFF0.0019912/5