top of page

Methodology

Data Sources

State Finance

U.S. Census Bureau — State Government Finance Time Series (GS00SG01)
File: GOVSTIMESERIES.GS00SG01-Data.csv (public release).
Coverage: 2012–2023; Geography: 50 U.S. states + national totals.
Note: District of Columbia is excluded from the 2023 finance release because of inconsistent function coverage.

Homelessness

HUD — Point-in-Time (PIT) counts and related homelessness data.
Source tables are Continuum of Care (CoC)–level; aggregated to state totals using HUD’s CoC-to-state mapping for the given year.
HUD metrics appear on “population/homeless” views and are not used in computing budget shares.

 

Social & Living Indicators

 

ACS Data Sources (1-Year Estimates)

Income, Housing, and Costs

  • B19013_001E — Median household income

  • B25064_001E — Median gross rent

  • B25077_001E — Median home value

  • S2503_C03_001E — Rent burden: % of renter households paying ≥35% of income

Poverty & Employment

  • DP03_0128PE — Poverty rate (% of people below poverty level, past 12 months)

  • DP03_0009PE — Unemployment rate (civilian labor force, % unemployed)

Education

  • DP02_0068PE — Educational attainment: % of adults (25+) with bachelor’s degree or higher

  • DP02_0059PE — School enrollment: % of population 3+ years enrolled in school

Population

          DP05_0001E — Total population

Crime

Annual state series (current product):
FBI Crime Data Explorer (CDE) — Estimated Crimes (State-Year).
File used: estimated_crimes_1979_2024.csv (public distribution).
Coverage: 1979–2024; Geography: 50 states + District of Columbia + U.S. national line.
Offenses included: violent crime total, property crime total, and components (homicide, rape (legacy & revised), robbery, aggravated assault, burglary, larceny, motor-vehicle theft). Arson is not present in this file.

 

Processing (State Finance Shares)

 Select direct-general function rows & denominator.
From GS00SG01, keep:

  • Function dollars: labels beginning General Expenditure, by Function:

  • Denominator: Total Expenditure – General Expenditure – Direct General Expenditure.

 Harmonize to Census functional categories

  • Public Welfare

  • Education

  • Health & Hospitals

  • Highways

  • Corrections

  • Police Protection

  • Financial Administration

  • Natural Resources

  • Parks & Recreation

  • Interest on Debt

  • Other

 Compute per state–year (2012–2023)

  • Amounts ($): published function dollars.

  • Shares (%): function_dollars ÷ Direct General Expenditure × 100.

  • Shares rounded to one decimal place in outputs.

 National (United States) line
Sum state dollars by function and sum the Direct General denominator, then compute national shares = national_function ÷ national_total × 100 (a     composition, not an average of state percentages).   

Note on Shares: Functional budget shares are rounded to one decimal place. As a result, totals may not equal exactly 100%. This rounding convention follows common statistical reporting standards.

 

Processing (Crime)

 

Annual state series

  Input columns (from CDE Estimated Crimes): year, state_abbr, state_name, population, violent_crime, homicide, rape_legacy, rape_revised, robbery,                aggravated_assault, property_crime, burglary, larceny, motor_vehicle_theft.

  Transformations

  • Totals:

    • violent_total = published violent_crime. Where needed for consistency checks, we treat rape = revised if available, else legacy.

    • property_total = published property_crime (burglary + larceny + motor-vehicle theft).

  • Rates (per 100,000): count ÷ population × 100000 for violent and property totals (and components where shown).

  • National line: population-weighted composition: for each year we sum state counts and sum population, then compute national rates and totals.

  • District of Columbia: included in crime products as its own state‐equivalent; national uses all 50 states + DC. (Finance national line excludes DC per Census finance coverage note.)

Outputs

  • CSV (state-year): totals + rates.

  • Charts: Violent vs. property rate over time; property subcomponents (burglary, larceny, vehicle theft) over time.

Important notes & limitations

  • SRS → NIBRS transition (circa 2021): agency participation and imputation vary; some states show measurement breaks or increased volatility.

  • Rape definitions: legacy and revised series coexist across years; totals prefer revised where available, else legacy.

  • Arson: not present in the Estimated Crimes state-year file used here.

  • Revisions: FBI periodically updates estimates; later downloads may differ slightly from earlier releases.

 

Processing (Homelessness)

  HUD homelessness: Aggregate CoC-level PIT to state totals; join by year to the state table for display. HUD values do not affect finance shares.

  ACS indicators: Pulled via API and joined by state FIPS; displayed alongside finance shares and Living Data.

 

Quality Assurance

  • Finance shares per state–year sum to ≈100% (allowing for rounding).

  • Crime totals: internal checks that property ≈ burglary + larceny + motor-vehicle theft and that violent ≈ homicide + rape (legacy/revised) + robbery + aggravated assault; flag and annotate exceptions coming from source definitions.

  • Large YoY/MoM deltas flagged and spot-checked against source series (finance & crime).

  • Dollars are nominal (no inflation adjustment).

  • Shares describe composition, not service levels or policy outcomes.

  • Territories and DC: excluded from finance calculations; DC is included in crime products as a state-equivalent and can be filtered in UI/exports.

City Social Data (2010–2024)

Sources
Data for U.S. cities are derived from the U.S. Census Bureau’s American Community Survey (ACS) 1-Year Estimates, the Bureau of Labor Statistics (BLS), and HUD’s housing indicators, harmonized for consistency across years and geographies.
Coverage includes all U.S. cities and census-designated places with population ≥ 65,000, spanning 2010–2024.

I

ndicators
The following indicators are extracted annually for each city:

  • Education

    • High School Enrollment (%) — school enrollment share of population ages 14–18 (DP02_0059PE and derived ACS cross-tab).

    • High School Graduation (%) — share of adults (25+) with a high school diploma or higher (DP02_0058PE).

    • College Enrollment (%) — share of population 18–24 enrolled in college or graduate school (DP02_0068PE subset).

    • College Graduation (%) — share of adults (25+) with a bachelor’s degree or higher (DP02_0068PE).

  • Poverty & Employment

    • Poverty Rate (%) — DP03_0128PE (population below poverty line, past 12 months).

    • Unemployment Rate (%) — DP03_0009PE (civilian labor force, % unemployed).

  • Housing

    • Rent Burden (%) — S2503_C03_001E (renter households paying ≥ 35% of income on rent).

 

Processing

  • Each ACS variable is retrieved via the Census API, rounded to one decimal place, and stored by place FIPS, city name, state abbreviation, and year.

  • Where ACS tables report estimates as percentages, values are preserved as published.

  • City-level series are aligned by year and filtered to maintain consistent population coverage across time.

  • Minor gaps from sampling error or suppressed estimates are left blank rather than interpolated.

 

Outputs

  • Annual city-level CSV/XLSX datasets (2010–2024).

  • Charts showing trends in education, poverty, employment, and rent burden per city.

  • Optional national and state averages for comparative visualization.

 

Limitations

  • Some smaller cities intermittently fall below ACS 1-year publication thresholds; those years appear as missing.

  • Estimates represent survey-derived percentages, not administrative counts.

  • Rent burden and enrollment variables reflect Census Bureau methodology and may differ from local education or housing reports.

Attribution & Licensing

  • Finance, HUD, ACS: per their public terms and documentation.

  • Crime (annual): FBI Crime Data Explorer “Estimated Crimes” (public distribution).

  • Include attribution and note any transforms when redistributing data packs.

bottom of page