Skip to content

Executive and governance build workflow

Run this workflow after the employment and accounting/market workflows. It needs completed employment events, processed Compustat, and the Revelio--Compustat mapping. Direct Python commands use the model CUDA image (hct-tower-model-cuda-…); no project Slurm wrappers currently exist.

Legacy workflow

Several commands below still require the retired mapping_revelio_compustat.parquet input. They are retained for reference but are not runnable in the current supported data workflow. New public-firm work must use mapping_rcid_gvkey.parquet and resolve PERMNO through dated CCM links.

  1. Build the ExecuComp worker mapping and annual matched-pay product.

    cd /hct-tower
    python -m shared.data.build_datasets.match_execucomp_revelio
    python -m shared.data.build_datasets.enrich_execucomp_revelio_matches
    

    No project Slurm wrapper exists for these builders.

    Produces
    Dataset File / dataset directory Folder
    ExecuComp--Revelio unique matches execucomp_revelio_unique_matches.parquet /data/full/raw/execucomp/
    Matched executive compensation execucomp_revelio_matched_pay.parquet /data/full/raw/execucomp/
    ExecuComp match diagnostics execucomp_revelio_match_summary.json /data/full/raw/execucomp/
  2. Build HR-leadership and public-company CHRO products.

    cd /hct-tower
    python -m shared.data.build_datasets.chro_panel
    python -m shared.data.build_datasets.chro_public_panel
    

    No project Slurm wrapper exists for these builders.

    Produces
    Dataset File / dataset directory Folder
    HR leadership (firm-year) revelio_hr_exec_firm_year.parquet /data/full/raw/chro/
    HR leadership (spells) revelio_hr_exec_spells.parquet /data/full/raw/chro/
    Public-company CHRO panel revelio_chro_public_firm_year.parquet /data/full/raw/chro/
    Public-company CHRO coverage diagnostics revelio_chro_public_*_coverage_by_year.parquet /data/full/raw/chro/
  3. Build the ISS director-compensation panel and optionally validate the CHRO and ExecuComp products.

    cd /hct-tower
    python -m shared.data.build_datasets.director_comp_panel
    python -m shared.data.build_datasets.validate_chro_execucomp
    

    No project Slurm wrapper exists for these builders.

    Produces
    Dataset File / dataset directory Folder
    Director compensation iss_director_annual_comp.parquet /data/full/raw/iss/
    Director-compensation coverage diagnostics iss_director_annual_comp_coverage_by_year.parquet /data/full/raw/iss/

    The validation command writes reports only to its log; it does not create a dataset.

The matched-executive-pay documentation records a current legacy output-path mismatch. Resolve that operational path before continuing to its MQ-linked analysis dataset; do not silently copy a file to satisfy a downstream path.