This dataset encodes cleaned company descriptions for the HCT company tower.
flowchart LR
firms[(Firms with about text)] --> embed[Sentence-transformer<br/>encoding]
embed --> output[(Company-description embeddings)]
classDef source fill:#e8eef7,stroke:#52739e
classDef process fill:#fff0cc,stroke:#a66b00
classDef data fill:#e2f2e7,stroke:#3b7a4b
class firms source
class embed process
class output data
The builder reads about_clean from the firm table and writes the
identifier plus wide emb_* columns. Firms without usable text are omitted and
receive zeros at model runtime. The current default encoder is
sentence-transformers/all-MiniLM-L6-v2.
Command reference
Option
Required / default
Source-defined effect
--config PATH
Required
Shared YAML config; supplies company input/output paths and the about_embeddings model, batch-size, and truncation settings.