Observed firm-year employment
This dataset measures the number of distinct workers observed at each firm in
each calendar year.
flowchart LR
relationships[(Worker-firm relationships)] --> expand[Expand active years<br/>and count workers]
expand --> counts[(Observed firm-year employment)]
classDef source fill:#e8eef7,stroke:#52739e
classDef process fill:#fff0cc,stroke:#a66b00
classDef data fill:#e2f2e7,stroke:#3b7a4b
class relationships source
class expand process
class counts data
Inputs
Build
| Component |
Location |
| Builder |
shared/data/build_processed.py |
| Runtime |
hct-tower-model-cuda-… (CPU execution) |
| Entry point |
python -m shared.data.build_processed --target company-year-counts / build-processed |
Output
| Dataset |
File / location |
Grain |
Key and variables |
| Observed firm-year employment |
company_year_observed_counts.parquet in /data/<coverage>/processed/ |
Firm-year |
Key: company_id, year Variables: observed_active_users |
Command reference
Each relationship is expanded from its start year through its end year. An
open-ended relationship is expanded through the latest year observed in the
relationship data. The builder then counts distinct user_id values by firm
and year as observed_active_users.
These are counts in Revelio, not true firm employment. Their main use is to
construct the observed_size_bucket attached to the
firm table.