saturn·

parquet languages

source /home/coolhand/servers/diachronica/etymology_atlas/parquet/languages.parquet 19,401 rows 11 columns profiled 2026-05-01 raw JSON static .html .ipynb Report Notebook

Reading

dataset summary · high confidence anthropic:claude-opus-4-7

This dataset catalogues 19,401 world languages, each identified by a unique Glottocode and name, with attributes like geographic coordinates, macroarea, language family, ISO code, and phoneme count. Two things stand out for closer inspection: phoneme_count is missing for 88.8% of rows and is heavily right-skewed (mean ~38, max 231), so any analysis of phonological inventories will rely on a small subsample with notable outliers. Latitude and longitude are also null for 59.1% of rows, which will limit mapping coverage. On the categorical side, macroarea is well-distributed across six regions but dominated by Africa (32%), while the status column is uninformative since every language is labelled 'living'.

citing: phoneme_count · latitude · longitude · macroarea · status · name · glottocode

Schema

11 columns
Per-column summary. Click column name to jump to its detail.
Alerts
glottocode text 0.0% 19,401
near_unique one_word short_text
iso_639_3 unknown 0.0%
skipped
name text 0.0% 19,401
near_unique one_word
family_name unknown 0.0%
skipped
family_glottocode unknown 0.0%
skipped
macroarea categorical 4.3% 6
latitude numeric 59.1% 7,786
null_rate
longitude numeric 59.1% 7,745
null_rate
status categorical 0.0% 1
imbalance
speakers_count unknown 0.0%
skipped
phoneme_count numeric 88.8% 100
null_rate high_skew

glottocode

text identifier near_unique one_word short_text
This column holds Glottocodes, the standard 8-character identifiers for languages in the Glottolog catalogue (e.g. 'aala1237', 'aari1239'). Every one of the 19,401 rows is unique with length exactly 8 and a single token, and there are no nulls or duplicates, consistent with a primary key over languages. Nothing anomalous: the column is a clean identifier rather than analysable text. Treatment: Use as the primary key; left-join other language metadata on this code rather than modelling it. high · anthropic:claude-opus-4-7
n
19,401
nulls
0 (0.0%)
unique
19,401
len_min
8
len_max
8
len_mean
8
len_median
8
len_p95
8
word_mean
1
word_median
1
n_empty
0
n_duplicates
0
duplicate_rate
0
vocab_size
19,401
readability_flesch_mean
93.3
emoji_rate
0
url_rate
0
one_word_rate
1
allcaps_rate
0
boilerplate_rate
0

iso_639_3

unknown metadata skipped
This column is named iso_639_3, suggesting it should hold ISO 639-3 three-letter language codes. Saturn skipped profiling (kind=unknown), so no uniqueness or value distribution is available; only the row count of 19401 and a 0.0 null rate are confirmed. Without cardinality or sample values, the actual contents and their alignment with the ISO 639-3 standard cannot be verified here. Treatment: Re-profile with explicit string typing to recover cardinality, then use as a categorical language tag. low · anthropic:claude-opus-4-7
n
19,401
nulls
0 (0.0%)
unique

name

text identifier near_unique one_word
This is a short-text 'name' field with 19401 entirely unique values (n_unique equals n) and no nulls or duplicates. Entries are mostly single tokens — 71.7% are one_word and word_median is 1 — averaging 9.2 characters and capping at 58. The top vocabulary (nuclear, sign, language, central, southern, western, northern, eastern) suggests these are labels for things like categories, regions, or articles rather than person names. Treatment: Treat as a unique key — join or display only, do not use as a model feature. high · anthropic:claude-opus-4-7
n
19,401
nulls
0 (0.0%)
unique
19,401
len_min
1
len_max
58
len_mean
9.211
len_median
7
len_p95
20
word_mean
1.369
word_median
1
n_empty
0
n_duplicates
0
duplicate_rate
0
vocab_size
17,861
readability_flesch_mean
60.53
emoji_rate
0
url_rate
0
one_word_rate
0.7169
allcaps_rate
0
boilerplate_rate
0

family_name

unknown other skipped
This column is named family_name and was skipped by the profiler, so no type, uniqueness, or value statistics are available beyond a row count of 19401 and a null rate of 0.0. The name suggests surnames or a taxonomic family label, but without distribution evidence the actual content cannot be confirmed. The only notable signal is the explicit 'skipped' alert, meaning downstream consumers are flying blind on this field. Treatment: Re-run profiling with this column included before deciding how to use it. low · anthropic:claude-opus-4-7
n
19,401
nulls
0 (0.0%)
unique

family_glottocode

unknown foreign_key skipped
The column was skipped by the profiler, so beyond a complete absence of nulls across 19,401 rows there is no distributional evidence to draw on. The name family_glottocode points to Glottolog family identifiers (a linguistic taxonomy code), but uniqueness, cardinality, and value distribution are all unknown here. Treatment: Re-profile with string handling enabled, then left-join to a Glottolog reference table. low · anthropic:claude-opus-4-7
n
19,401
nulls
0 (0.0%)
unique

macroarea

categorical feature
Six-valued geographic grouping that bins records into continental-scale macroareas (Africa, Eurasia, Papunesia, South America, North America, Australia), suggesting linguistic or biogeographic data. Distribution is uneven: Africa leads at 32.1% of rows while Australia holds only 602, and entropy ratio of 0.84 confirms moderate but not extreme imbalance. About 4.3% of rows are null. Treatment: One-hot encode and impute or flag the 4.3% nulls. high · anthropic:claude-opus-4-7
n
19,401
nulls
839 (4.3%)
unique
6
top_value
Africa
top_rate
0.3208
cardinality
6
entropy
2.176
entropy_ratio
0.8418

latitude

numeric feature null_rate
This is a geographic latitude coordinate, with values spanning -55.2748 to 73.1354 and a median of 6.2918, consistent with degrees north/south of the equator. Nearly 59% of rows are null, which is the dominant concern; among present values, the distribution is mildly right-skewed (0.54) and roughly centered north of the equator (mean 8.16). Only 7,786 unique values across 19,401 rows suggests repeated locations rather than per-row precise coordinates. Treatment: Pair with longitude for geospatial features; impute or flag missingness given the 59% null rate before modelling. high · anthropic:claude-opus-4-7
n
19,401
nulls
11,472 (59.1%)
unique
7,786
min
-55.27
max
73.14
mean
8.164
median
6.292
std
18.96
q1
-5.139
q3
19.27
iqr
24.41
skew
0.5425
kurtosis
0.3048
n_outliers
135
outlier_rate
0.01703
zero_rate
0

longitude

numeric feature null_rate
Geographic longitude in decimal degrees, with values spanning -178.785 to 179.306 and a median of 47.57 consistent with a global coordinate range. The distribution is mildly left-skewed (-0.48) and platykurtic (-0.78), with only 13 outliers (0.16%), but 59.13% of rows are null, meaning location is missing for most records. Of 19,401 rows, 7,745 unique values suggest repeated locations rather than per-record GPS fixes. Treatment: Pair with latitude for geospatial features; impute or add a missingness flag given the high null rate. high · anthropic:claude-opus-4-7
n
19,401
nulls
11,472 (59.1%)
unique
7,745
min
-178.8
max
179.3
mean
51.22
median
47.57
std
81.15
q1
7.18
q3
124.1
iqr
117
skew
-0.4814
kurtosis
-0.7765
n_outliers
13
outlier_rate
0.00164
zero_rate
0

status

categorical metadata imbalance
This is a single-value categorical field where every one of the 19,401 rows is "living". With cardinality 1 and entropy 0, it carries no information and cannot discriminate between records. Treatment: Drop; constant column with zero entropy. high · anthropic:claude-opus-4-7
n
19,401
nulls
0 (0.0%)
unique
1
top_value
living
top_rate
1
cardinality
1
entropy
0
entropy_ratio
0

speakers_count

unknown other skipped
The column is named speakers_count, which suggests a numeric tally of speakers per record, but saturn skipped profiling and returned no type, uniqueness, or distribution stats. The only confirmed signals are 19401 rows and a 0.0 null rate. Without kind or summary statistics, nothing further can be said about its actual contents. Treatment: Re-profile this column with type inference forced before deciding on downstream use. low · anthropic:claude-opus-4-7
n
19,401
nulls
0 (0.0%)
unique

phoneme_count

numeric feature null_rate high_skew
Counts of phonemes per record, ranging 11 to 231 with median 34 and IQR 20. The distribution is heavily right-skewed (skew 2.32, kurtosis 11.5) with 79 outliers (3.6%), and critically 88.8% of rows are null so only ~2,170 values are present. Treatment: Impute or flag missingness and log-transform before modelling given the 88.8% null rate and skew of 2.32. high · anthropic:claude-opus-4-7
n
19,401
nulls
17,228 (88.8%)
unique
100
min
11
max
231
mean
38.2
median
34
std
17.78
q1
26
q3
46
iqr
20
skew
2.325
kurtosis
11.54
n_outliers
79
outlier_rate
0.03636
zero_rate
0