language data phoible

InventoryID looks like a categorical inventory key stored as an integer, with 3,020 distinct values spread across 105,484 rows and no nulls. The distribution is essentially uniform from 1 to 3,020 (mean 1479, median 1464, skew ≈0, kurtosis ≈-1.15), confirming it's an enumerated identifier rather than a measurement. Each ID recurs roughly 35 times on average, so this is a foreign key linking transactions to an inventory dimension. Treatment: Treat as a categorical key; left-join to the inventory table rather than using as a numeric feature. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

3,020

min

1

max

3,020

mean

1479

median

1,464

std

843.1

q1

769

q3

2,237

iqr

1,468

skew

-0.002397

kurtosis

-1.146

n_outliers

0

outlier_rate

0

zero_rate

0

This column holds Glottocodes — standardized 8-character language identifiers from Glottolog (e.g., 'kham1282', 'dutc1256'). Values are uniformly one word with length tightly clustered at 8 (mean 7.999, min 2, max 8), and there are 2,177 unique codes across 105,484 rows with a 97.9% duplicate rate, indicating each language appears many times. The top code 'kham1282' alone accounts for 622 rows. Treatment: Treat as a categorical foreign key; left-join to a Glottolog reference table for language metadata. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

2,177

len_min

2

len_max

8

len_mean

7.999

len_median

8

len_p95

8

word_mean

1

word_median

1

n_empty

0

n_duplicates

103,307

duplicate_rate

0.9794

vocab_size

2,168

readability_flesch_mean

94.15

emoji_rate

0

url_rate

0

one_word_rate

1

allcaps_rate

0

boilerplate_rate

0

This column holds ISO 639-3 language codes: every value is exactly 3 characters and one word, with 2,095 distinct codes across 105,484 rows. The distribution is heavy-tailed and highly repetitive (98.0% duplicate rate), led by 'mis' (828), 'khg' (622), and 'oss' (525), with familiar codes like 'eng' and 'hin' also prominent. No nulls or empties, and the vocabulary (2,086) closely matches n_unique (2,095), consistent with a clean controlled vocabulary. Treatment: Treat as a categorical key; left-join to an ISO 639-3 reference table or target-encode for modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

2,095

len_min

3

len_max

3

len_mean

3

len_median

3

len_p95

3

word_mean

1

word_median

1

n_empty

0

n_duplicates

103,389

duplicate_rate

0.9801

vocab_size

2,086

readability_flesch_mean

119.5

emoji_rate

0

url_rate

0

one_word_rate

1

allcaps_rate

0

boilerplate_rate

0

This column holds language names, mostly single-word labels (one_word_rate 0.84, word_mean 1.20) with a vocab of 2670 across 2716 unique values over 105484 rows. It is highly repetitive (duplicate_rate 0.974) with top entries like 'Iron Ossetic' (444), 'Dutch' (395), and 'Chechen' (309), and roughly 13% of values are uppercase, suggesting inconsistent casing worth normalising. Compound names use directional modifiers ('northern', 'southern', 'eastern', 'western') indicating dialect-level granularity. Treatment: Normalise case and treat as a categorical label; consider grouping directional dialect variants before modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

2,716

len_min

2

len_max

79

len_mean

7.822

len_median

7

len_p95

16

word_mean

1.201

word_median

1

n_empty

0

n_duplicates

102,768

duplicate_rate

0.9743

vocab_size

2,670

readability_flesch_mean

53.18

emoji_rate

0

url_rate

0

one_word_rate

0.8433

allcaps_rate

0.1314

boilerplate_rate

0

Categorical field naming a specific dialect/sub-variety of a language, with 546 distinct values across 105,484 rows. The distribution is extremely concentrated: 71.9% are the literal string "NA" and another 7,692 rows are empty strings, leaving the remaining 544 dialect labels (e.g., "W2", "Lezgian (Güne)", "Scottish Gaelic (Lewis)") in a long tail topping out at 120 occurrences. Entropy ratio of 0.33 confirms most signal lives in that small tail. Treatment: Normalize "NA" and "" to a single missing token, then treat as high-cardinality categorical (hash or group rare levels) for any downstream use. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

546

top_value

NA

top_rate

0.7187

cardinality

546

entropy

2.969

entropy_ratio

0.3265

GlyphID holds single-token uppercase hexadecimal codes (allcaps_rate 1.0, one_word_rate 1.0, len_min 4, len_median 4) that look like Unicode codepoints — the top values 006D, 0069, 006B map to lowercase Latin letters m, i, k. Despite the ID-sounding name it is highly non-unique: only 3,142 distinct values across 105,484 rows with a 0.97 duplicate rate, so it behaves as a categorical glyph reference rather than a row key. Lengths stretch up to 54 characters (p95 14), hinting that some entries concatenate multiple codepoints. Treatment: Treat as a categorical codepoint reference and left-join to a Unicode/glyph lookup table; do not use as a primary key. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

3,142

len_min

4

len_max

54

len_mean

6.503

len_median

4

len_p95

14

word_mean

1

word_median

1

n_empty

0

n_duplicates

102,342

duplicate_rate

0.9702

vocab_size

1,343

readability_flesch_mean

121.2

emoji_rate

0

url_rate

0

one_word_rate

1

allcaps_rate

1

boilerplate_rate

0

This column holds individual phoneme tokens, almost always a single character (len_mean 1.50, len_median 1, max 11) and always one word (one_word_rate 1.0). With 105,484 rows but only 3,142 unique values and a 97.0% duplicate rate, the same small phoneme inventory repeats heavily; top symbols like 'm' (2,915), 'i' (2,779), and 'k' (2,729) dominate. Vocab_size of 1,339 is larger than n_unique would suggest for single-character entries, hinting that the longer (up to 11-char) values contribute multi-token strings. Treatment: Treat as a categorical token and encode (label or embedding) before modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

3,142

len_min

1

len_max

11

len_mean

1.501

len_median

1

len_p95

3

word_mean

1

word_median

1

n_empty

0

n_duplicates

102,342

duplicate_rate

0.9702

vocab_size

1,339

readability_flesch_mean

114.4

emoji_rate

0

url_rate

0

one_word_rate

1

allcaps_rate

0.001754

boilerplate_rate

0

Column holds short phonetic tokens (allophones), with mean length 2.08 characters and 91.3% being a single word. The distribution is dominated by the literal string 'NA' (53,580 of 105,484 rows, ~50.8%), which likely encodes missing rather than true null since null_rate is 0.0; duplicate_rate is 0.935 across only 6,892 uniques. Top non-NA values are individual phoneme letters like 'm', 'j', 'w', 's', consistent with IPA-style symbols. Treatment: Recode the literal 'NA' to missing, then treat as a categorical/phoneme token (one-hot or embed). high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

6,892

len_min

1

len_max

37

len_mean

2.083

len_median

2

len_p95

4

word_mean

1.129

word_median

1

n_empty

0

n_duplicates

98,592

duplicate_rate

0.9347

vocab_size

1,263

readability_flesch_mean

116.2

emoji_rate

0

url_rate

0

one_word_rate

0.9131

allcaps_rate

0.00291

boilerplate_rate

0

A ternary flag with values FALSE, NA, and TRUE across 105,484 rows. FALSE dominates at 78.9% while TRUE appears only 1,347 times; the 20,874 NA entries are encoded as a literal string rather than null, so null_rate is 0.0 despite roughly a fifth of rows being missing in practice. Treatment: Recode the literal 'NA' string to a true missing value, then treat as a binary indicator. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

3

top_value

FALSE

top_rate

0.7893

cardinality

3

entropy

0.8122

entropy_ratio

0.5125

SegmentClass is a categorical phonological label with only 3 distinct values: consonant, vowel, and tone. The distribution is heavily skewed — consonant accounts for 68.5% of 105,484 rows, vowel for 31,052, and tone for just 2,150, giving an entropy ratio of 0.64. The presence of 'tone' as a rare third class suggests the dataset spans tonal languages but those segments are sparsely represented. Treatment: One-hot encode; consider class imbalance (especially rare 'tone' class) before stratified modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

3

top_value

consonant

top_rate

0.6852

cardinality

3

entropy

1.008

entropy_ratio

0.6357

Categorical provenance tag with 8 distinct sources across 105,484 rows and no nulls. Distribution is fairly balanced (entropy ratio 0.90), though 'ph' leads at 34.4% followed by 'ea' (16,883) and 'upsid' (13,966). Looks like a dataset-origin code identifying which linguistic database each record came from. Treatment: one-hot encode or keep as categorical for stratification and source-bias checks high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

8

top_value

ph

top_rate

0.3439

cardinality

8

entropy

2.697

entropy_ratio

0.8991

Binary categorical flag with values "0" and "+", almost certainly a tone/sentiment indicator. The distribution is severely imbalanced: "0" covers 97.96% of 105,484 rows while "+" appears only 2,150 times, yielding entropy of just 0.144. No nulls are present. Treatment: Use as a binary label but apply class-imbalance handling (resampling or class weights) before modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

2

top_value

0

top_rate

0.9796

cardinality

2

entropy

0.1436

entropy_ratio

0.1436

Binary categorical flag with only two observed values, '-' and '0', across 105484 rows and no nulls. The column is severely imbalanced: '-' covers 97.96% of records (103334) while '0' accounts for the remaining 2150, yielding an entropy ratio of just 0.144. The '-' likely encodes a missing or default state rather than a true category, making this near-constant. Treatment: Treat '-' as missing and consider dropping; near-constant with little signal. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

2

top_value

-

top_rate

0.9796

cardinality

2

entropy

0.1436

entropy_ratio

0.1436

This is a phonological feature column encoding the [syllabic] distinctive feature, with 8 distinct values across 105,484 rows and no nulls. Most entries are simple '-' (68.5%) or '+', but 2,532 rows carry composite codes like '0', '+,-', or '-,+,-' that suggest contour/multi-segment annotations. Entropy ratio of 0.35 confirms the distribution is heavily concentrated on the negative value. Treatment: One-hot encode, optionally collapsing rare composite codes into an 'other' bucket. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

8

top_value

-

top_rate

0.6849

cardinality

8

entropy

1.042

entropy_ratio

0.3472

A 4-level categorical with values '-', '0', '+', and '-,+' — likely a strand or sign indicator. It is severely imbalanced: '-' covers 97.76% of 105,484 rows, leaving only 2,150 zeros, 204 plus signs, and 5 mixed '-,+' entries. Entropy ratio is just 0.082, so the column carries almost no information as-is. Treatment: Consider dropping or collapsing into a binary '-' vs other indicator given the extreme imbalance. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

4

top_value

-

top_rate

0.9776

cardinality

4

entropy

0.1645

entropy_ratio

0.08225

Categorical flag with only 6 distinct values dominated by '-' at 89.9% (94844/105484), followed by '+' (8386) and '0' (2150). The remaining three categories are comma-joined combinations like '-,+' and '+,-' with tiny counts (63, 40, 1), suggesting concatenated multi-record values rather than clean single labels. Low entropy ratio (0.214) confirms the column is highly imbalanced toward '-'. Treatment: Split the comma-joined compound values, then one-hot encode; expect '-' to dominate. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

6

top_value

-

top_rate

0.8991

cardinality

6

entropy

0.5537

entropy_ratio

0.2142

This is a phonological feature column flagging segments as consonantal, with five distinct values across 105,484 rows and no nulls. The vast majority are binary +/- (64,257 and 39,041 respectively, with + dominating at 60.9%), plus 2,151 zero/underspecified entries and just 35 rows with mixed values like '+,-' or '-,+'. Entropy ratio of 0.47 reflects the heavy + skew, and the lone '-,+' singleton is worth noting as a likely encoding artifact. Treatment: Map to a small categorical encoding; consider collapsing the rare mixed/zero values or treating them as a separate 'underspecified' level. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

5

top_value

+

top_rate

0.6092

cardinality

5

entropy

1.085

entropy_ratio

0.4672

This is a phonological feature column encoding the [sonorant] value of a segment, dominated by binary '+'/'-' marks (53.0% '+', plus 45322 '-'). The presence of '0' (2150) and comma-joined sequences like '+,-' (1948) and rarer '+,-,-', '+,-,+', '+,-,+,-' suggests contour/complex segments where multiple values are concatenated. Cardinality is 8 with entropy ratio 0.41, so the long tail is sparse but meaningful. Treatment: Split comma-separated contour values into ordered sub-features or treat as categorical with a rare-bucket for the contour cases. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

8

top_value

+

top_rate

0.5301

cardinality

8

entropy

1.245

entropy_ratio

0.4149

Categorical flag with 9 distinct values across 105,484 rows and no nulls, dominated by '+' (54.9%) and '-' (~42%), with '0' a distant third at 2,151 occurrences. The remaining six categories are comma-joined sequences like '-,+' or '0,0,-,+' that look like concatenated multi-step states rather than atomic labels — only 796 rows total fall into these compound buckets. Entropy ratio of 0.37 confirms heavy concentration in the two primary signs. Treatment: Collapse rare comma-joined sequences into an 'other' bucket (or split on comma) before one-hot encoding. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

9

top_value

+

top_rate

0.5494

cardinality

9

entropy

1.172

entropy_ratio

0.3696

A categorical flag named delayedRelease with 7 distinct values across 105484 rows and no nulls. Values are dominated by '0' (55.0%), followed by '-' (27384) and '+' (19533), but a long tail of comma-joined combinations like '-,+', '0,-,+', '+,-', and '0,0,-,+' suggests rows where multiple labels were concatenated rather than normalized. Entropy ratio of 0.52 confirms a skewed but not single-valued distribution. Treatment: Split the comma-joined values and one-hot encode the three base levels (0, -, +) before modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

7

top_value

0

top_rate

0.5502

cardinality

7

entropy

1.471

entropy_ratio

0.5238

A low-cardinality categorical with only 6 distinct values dominated by sign tokens '-' (55.9%) and '+' (≈42%), plus a small '0' bucket (2,150 rows) and rare comma-joined combinations like '-,+', '-,-,+', '+,-'. The compound values suggest this field occasionally stores multiple approximant signs concatenated rather than a single label. No nulls across 105,484 rows, and entropy ratio is 0.43, reflecting the heavy '-'/'+' imbalance. Treatment: Split the comma-joined values or collapse rare combos into an 'other' bucket, then one-hot encode. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

6

top_value

-

top_rate

0.559

cardinality

6

entropy

1.12

entropy_ratio

0.4333

A categorical flag with only 5 distinct values dominated by '-' at 96.7% of 105484 rows, with '0' and '+' as minor categories and two rare composite codes ('-,+', '-,-,+') appearing 25 and 15 times. Entropy ratio of 0.104 confirms extreme imbalance, so this column carries very little discriminative signal on its own. The composite values suggest the field occasionally concatenates multiple states, which is worth verifying against the source schema. Treatment: Collapse rare composites and treat as a low-signal binary indicator, or drop if downstream models penalise near-constant features. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

5

top_value

-

top_rate

0.9672

cardinality

5

entropy

0.2421

entropy_ratio

0.1043

A categorical flag with only 6 distinct values across 105,484 rows, almost certainly encoding a trill or sign indicator ("-", "0", "+", and a few comma-joined sequences). The distribution is severely imbalanced: "-" alone covers 96.15% of rows, leaving entropy at just 0.276 (entropy ratio 0.107). The compound values like "-,+", "-,-,+" and "+,-" appear fewer than 30 times each, hinting at concatenated multi-event records that may need parsing. Treatment: Collapse rare compound codes and consider dropping or one-hot encoding given the 96% dominance of a single value. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

6

top_value

-

top_rate

0.9615

cardinality

6

entropy

0.2762

entropy_ratio

0.1069

A categorical flag for nasal presence/absence, dominated by '-' at 80.8% with '+' a distant second (15,941 of 105,484). The presence of compound values like '+,-', '-,+', and '+,-,-' suggests concatenated multi-observation records rather than a clean binary indicator, and a '0' category (2,150) is a third encoding that doesn't match the +/- scheme. Treatment: Normalize encodings (collapse '0' and split comma-joined sequences) before using as a categorical feature. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

8

top_value

-

top_rate

0.8084

cardinality

8

entropy

0.897

entropy_ratio

0.299

Categorical flag with 8 distinct values dominated by '-' at 93.8% of 105484 rows, followed by '+' (4211) and '0' (2150). The remaining categories are comma-joined composites like '-,+' or '-,-,+' with counts in the single or double digits, suggesting multi-observation concatenations rather than clean labels. Entropy ratio is just 0.134, so the column carries little information as-is. Treatment: Collapse rare composite values into 'mixed' or split on comma before one-hot encoding; expect minimal predictive signal due to severe imbalance. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

8

top_value

-

top_rate

0.9382

cardinality

8

entropy

0.4012

entropy_ratio

0.1337

A categorical flag for labial articulation, dominated by '-' (68.2%) and '+' (27%), with '0' and various comma-joined combinations like '-,+' and '-,-,+' suggesting multi-segment or sequence-level annotations rather than atomic values. Cardinality is 15 across 105,484 rows with no nulls, and entropy ratio is only 0.30, so the signal is highly concentrated in the binary +/- distinction. The presence of compound tokens is the main surprise and indicates inconsistent encoding granularity. Treatment: Normalise compound values (split or collapse to first segment) before one-hot encoding. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

15

top_value

-

top_rate

0.6822

cardinality

15

entropy

1.182

entropy_ratio

0.3025

Categorical column with 8 distinct values dominated by '0' (70.3% of 105484 rows), followed by '+' (16956) and '-' (14082). The tokens look like rounding/sign indicators, and a long tail of compound values like '-,+', '-,-,+', and '0,-,+' (each with 1-269 occurrences) suggests concatenated multi-step rounding sequences. No nulls, but entropy_ratio of 0.398 confirms heavy concentration on the single dominant category. Treatment: Collapse rare compound sequences into an 'other' bucket and one-hot encode the resulting categories. medium · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

8

top_value

0

top_rate

0.703

cardinality

8

entropy

1.194

entropy_ratio

0.398

This column appears to be a phonological feature flag indicating whether a phoneme is labiodental, encoded with values like "0", "-", "+", and a few comma-separated combinations. The distribution is dominated by "0" at 70.3% of 105,484 rows, with "-" at 28,726 and "+" at only 2,574; mixed values like "+,-", "-,+", and "+,+,-" appear in fewer than 60 rows combined and likely represent multi-segment entries. Entropy of 1.01 (ratio 0.39) confirms heavy concentration on the default "0" code. Treatment: Treat as categorical; collapse rare comma-separated combinations or one-hot encode the three primary levels. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

6

top_value

0

top_rate

0.7027

cardinality

6

entropy

1.006

entropy_ratio

0.3891

A low-cardinality categorical with 7 distinct values dominated by sign tokens '-' (62.8%) and '+' (about 36,955 of 105,484), plus a small '0' bucket of 2,160 rows. The presence of comma-joined combinations like '+,-', '-,+', '-,-,+' and '+,-,+' suggests multi-valued entries collapsed into a single string rather than a clean atomic category. Entropy ratio of 0.385 confirms heavy concentration on the two main signs. Treatment: Split the comma-joined values and encode as a small categorical (or multi-hot) before modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

7

top_value

-

top_rate

0.6279

cardinality

7

entropy

1.08

entropy_ratio

0.3848

A low-cardinality categorical with 6 distinct values dominated by '0' (64.8% of 105484 rows), '+' (25704), and '-' (11391). The remaining three categories are concatenated combinations like '-,+', '+,-', and '-,-,+' totaling only 17 rows, suggesting this field originally allowed multi-valued entries that were collapsed into comma-joined strings. Entropy ratio of 0.48 confirms heavy concentration on the single mode. Treatment: Split comma-separated values or bucket the rare combinations into 'other', then one-hot encode. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

6

top_value

0

top_rate

0.6482

cardinality

6

entropy

1.251

entropy_ratio

0.4839

A low-cardinality categorical with 11 distinct values dominated by '0' (66.0% of 105,484 rows), followed by '-' and '+'. The remaining eight categories are concatenated combinations like '-,+' or '-,-,+' that together account for fewer than 350 rows, suggesting multi-event encoding squeezed into a single field. Entropy ratio of 0.368 confirms the heavy concentration on the top class. Treatment: Split the comma-delimited combinations into separate flags or collapse rare categories before encoding. medium · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

11

top_value

0

top_rate

0.6602

cardinality

11

entropy

1.273

entropy_ratio

0.3681

This appears to be a phonological feature column encoding the [strident] distinctive feature, with values '0' (unspecified), '-' (non-strident), and '+' (strident) covering the vast majority of 105484 rows. About 64.9% are '0' and there are no nulls, but a long tail of 6 composite values like '-,+' and '0,0,-,+' (totaling 625 rows) suggests multi-segment entries where the feature varies across positions. Entropy ratio of 0.41 confirms heavy concentration on the unspecified category. Treatment: Split composite comma-separated values or one-hot encode the three primary categories before modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

9

top_value

0

top_rate

0.6485

cardinality

9

entropy

1.287

entropy_ratio

0.406

This column appears to encode a dorsal sign or polarity flag, dominated by two values: '+' (54,535, 51.7%) and '-' (47,052). A third value '0' appears 2,160 times, and the remaining 10 categories are compound comma-separated combinations like '-,+' or '+,-,+', suggesting concatenated multi-observation records collapsed into one cell. Cardinality is 13 with entropy ratio 0.33, so the long tail is negligible but structurally inconsistent with a clean categorical. Treatment: Split comma-separated compounds into list-valued or first-token features before encoding. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

13

top_value

+

top_rate

0.517

cardinality

13

entropy

1.235

entropy_ratio

0.3338

This appears to be a categorical 'high' indicator encoding directional movement signs, with '0' (no change) the dominant value at 46.7% of 105,484 rows, followed by '+' and '-'. Compound values like '-,+' and '+,-' suggest concatenated multi-step sign sequences, but they tail off sharply (845, 627, then single digits). Entropy ratio of 0.46 confirms heavy concentration in the top three single-symbol categories; cardinality is 11 with no nulls. Treatment: Collapse rare compound sequences into an 'other' bucket, then one-hot encode the three primary signs. medium · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

11

top_value

0

top_rate

0.4669

cardinality

11

entropy

1.594

entropy_ratio

0.4609

A low-cardinality categorical with 8 distinct tokens dominated by '-' (47.3%) and '0' (~49,244 of 105,484), with '+' a distant third at 5,598. The remaining values are comma-joined sequences like '+,-', '-,+,-', suggesting this column encodes a sign or direction trace, possibly concatenated across events. The long tail (down to a single '+,-,-') indicates rare composite states worth bucketing. Treatment: Collapse rare composite sequences into an 'other' bucket and one-hot encode the remaining categories. medium · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

8

top_value

-

top_rate

0.4733

cardinality

8

entropy

1.305

entropy_ratio

0.4351

Categorical column encoding a front-side signal with 13 distinct values dominated by three primitives: "0" (49,316), "-" (34,225), and "+" (20,683), together covering nearly all 105,484 rows. The remaining categories are comma-joined combinations like "-,+" (838) or "-,-,+" (24), suggesting multi-event concatenations rather than clean atomic labels. Top rate is 0.468 and entropy ratio 0.43, so the distribution is skewed toward "0" but not degenerate. No nulls. Treatment: Split the comma-separated combinations into multi-hot indicators for -, 0, + before modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

13

top_value

0

top_rate

0.4675

cardinality

13

entropy

1.592

entropy_ratio

0.4302

A low-cardinality categorical with 12 distinct values dominated by the tokens "0" (46.7%), "-", and "+", suggesting a sign/state flag for some "back" attribute. The remaining values are comma-separated combinations like "+,-" or "+,-,-", indicating multiple events concatenated into one cell — a compound encoding rather than a clean atomic category. No nulls across 105,484 rows, and entropy ratio of 0.42 confirms the heavy skew toward "0". Treatment: split the comma-separated tokens into a list and one-hot or count-encode the +/-/0 components before modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

12

top_value

0

top_rate

0.4671

cardinality

12

entropy

1.521

entropy_ratio

0.4244

This is a categorical 'tense' field with only 8 distinct values across 105,484 rows and no nulls, dominated by '0' at 71.3% and '+' at ~22%. The remaining categories are sparse markers ('-', '+,-', '-,+') and a long tail of compound sequences with as few as 1-6 occurrences, suggesting a linguistic encoding of tense polarity rather than free text. Low entropy ratio (0.37) confirms heavy concentration in the top class. Treatment: Collapse rare compound categories into an 'other' bucket before one-hot encoding. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

8

top_value

0

top_rate

0.7132

cardinality

8

entropy

1.114

entropy_ratio

0.3712

Categorical encoding of the retracted-tongue-root (RTR) phonological feature, with 7 distinct values across 105,484 rows and no nulls. The column is severely imbalanced: '-' covers 97.4% of rows, '0' another ~2%, and the remaining five values (including compound codes like '-,+' and '-,-,+') together account for under 500 rows. Entropy ratio of 0.069 confirms almost no information content as-is. Treatment: Collapse rare codes or binarize ('-' vs other); likely low predictive value due to extreme imbalance. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

7

top_value

-

top_rate

0.9744

cardinality

7

entropy

0.1935

entropy_ratio

0.06892

This column encodes the advanced tongue root (ATR) phonological feature, taking three values: '-', '0', and '+'. It is severely imbalanced — '-' covers 97.87% of 105,484 rows, '0' appears 2,235 times, and '+' only 11 times, yielding an entropy ratio of just 0.094. The near-absence of '+' values means this feature carries almost no discriminative signal as-is. Treatment: Consider dropping or collapsing to a binary indicator due to extreme imbalance. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

3

top_value

-

top_rate

0.9787

cardinality

3

entropy

0.1496

entropy_ratio

0.09438

Phonological feature flag for periodic glottal source (voicing), with 7 distinct values across 105,484 rows and no nulls. The vast majority are simple binary tags: '+' at 67.97% (71,694) and '-' (31,179), with a small '0' class (2,139) and rare comma-joined sequences like '+,-' (371) suggesting multi-segment or contour entries. Low entropy ratio (0.3745) confirms heavy concentration on '+'. Treatment: Collapse rare composite values into an 'other' bucket and one-hot encode. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

7

top_value

+

top_rate

0.6797

cardinality

7

entropy

1.051

entropy_ratio

0.3745

A categorical phonological feature (epilaryngeal source) with only 3 distinct values: '-', '0', and '+'. The column is severely imbalanced — '-' accounts for 97.93% of the 105,484 rows, '0' for 2,150 rows, and '+' for just 31 rows, yielding a very low entropy ratio of 0.093. With no nulls but near-constant values, it carries little discriminative signal. Treatment: Consider dropping or collapsing to a binary indicator; near-constant with extreme imbalance. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

3

top_value

-

top_rate

0.9793

cardinality

3

entropy

0.1474

entropy_ratio

0.09303

This appears to be a phonological feature column encoding the [spread glottis] distinctive feature, with values '-', '+', '0' and comma-separated combinations for segments with multiple specifications. The distribution is extremely lopsided: '-' covers 91.8% of 105,484 rows and entropy ratio is just 0.149, meaning the column carries little information on its own. The long tail of compound values like '-,+', '+,0,-', and '+,-,+' (some with only 1-5 occurrences) suggests multi-segment or contour entries that may need parsing. Treatment: Split compound values on comma and one-hot encode; consider dropping if downstream model is sensitive to near-constant features. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

10

top_value

-

top_rate

0.9182

cardinality

10

entropy

0.4965

entropy_ratio

0.1495

Categorical flag for a 'constricted glottis' phonological feature, with 7 distinct values across 105,484 rows and no nulls. Heavily dominated by '-' at 94.5% (99,727 rows), with '+' and '0' as minor categories and a long tail of comma-joined sequences ('+,-', '-,+', and two singletons) suggesting multi-segment annotations. Low entropy ratio (0.13) confirms the column carries little information in isolation. Treatment: Collapse rare composite values and binarize against '-' before modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

7

top_value

-

top_rate

0.9454

cardinality

7

entropy

0.3717

entropy_ratio

0.1324

A 3-level categorical flag dominated by '-' (68.1% of 105,484 rows), with '0' covering most of the rest and '+' appearing only 415 times. The skew toward '-' and the tiny '+' class (entropy ratio 0.589) suggest a sign/direction indicator rather than a balanced category. No nulls, so the encoding is complete as-is. Treatment: One-hot encode; consider merging the rare '+' class or treating it as a minority signal. medium · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

3

top_value

-

top_rate

0.6813

cardinality

3

entropy

0.9335

entropy_ratio

0.589

A ternary categorical flag with values '-', '0', and '+', likely encoding a linguistic lenition feature (lenis/fortis/neutral). The distribution is highly imbalanced: '-' covers 68.1% of 105,484 rows and '0' another 33,202, while '+' appears only 416 times. No nulls, but the rare '+' class may be too sparse for stable modelling. Treatment: One-hot encode, but consider merging or upweighting the rare '+' class before modelling. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

3

top_value

-

top_rate

0.6813

cardinality

3

entropy

0.9336

entropy_ratio

0.589

This is a categorical phonological feature flag for 'raisedLarynxEjective', taking values like '-', '+', '0', and a few comma-separated combinations across 105484 rows with no nulls. The distribution is severely imbalanced: '-' covers 96.37% of rows and entropy ratio is just 0.103, with rare compound values like '-,-,+' appearing only once. The 6-way cardinality plus mixed-delimiter codes ('-,+' vs '+,-') suggests multi-segment annotations that may need parsing. Treatment: Treat as low-signal categorical; consider collapsing rare compound codes or dropping due to extreme imbalance. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

6

top_value

-

top_rate

0.9637

cardinality

6

entropy

0.2675

entropy_ratio

0.1035

Categorical phonological feature flagging lowered larynx implosives, with 5 distinct values across 105,484 rows and no nulls. The distribution is severely imbalanced: '-' covers 97.27% of rows, while '0' (2,150), '+' (716), and the mixed codes '-,+' (7) and '+,-' (2) are rare. Entropy ratio of 0.088 confirms the column carries very little information as-is. Treatment: Collapse to a binary present/absent indicator or drop given the 97% dominance of '-'. high · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

5

top_value

-

top_rate

0.9727

cardinality

5

entropy

0.2034

entropy_ratio

0.08759

Categorical flag with only 5 distinct values dominated by '-' (68.2% of 105,484 rows) and '0' (33,202), suggesting a click/interaction indicator where '-' likely means no click and '0' a recorded null/zero. The '+' class is rare (253) and the compound values '+,-' (52) and '-,+' (6) hint at concatenated multi-event records that break the single-label assumption. Entropy ratio of 0.40 confirms the heavy imbalance. Treatment: Normalize the compound '+,-'/'-,+' rows and collapse '-'/'0' semantics before using as a binary click target. medium · anthropic:claude-opus-4-7

n

105,484

nulls

0 (0.0%)

unique

5

top_value

-

top_rate

0.6823

cardinality

5

entropy

0.9283

entropy_ratio

0.3998