feat(tables): Add enrichment table column type

[TheodoreSpeaks]

Summary

• Code-defined enrichments: a TS registry (apps/sim/enrichments/) that runs directly per table row on the existing workflow-group rails — no workflow needed
• Provider fallback cascade (first-result-wins) calling real data tools via executeTool with hosted-key/BYOK injection. v1: Work Email (Hunter→PDL), Phone (PDL), Company Domain (PDL), Company Info (PDL→Hunter)
• Bill hosted-key cost to the table owner via recordUsage (new enrichment usage source + migration); all-providers-errored surfaces an errored cell; abort-safe
• Table UI: enrichments catalog/sidebar, per-row input mapping, columns show the enrichment name + icon, configure opens the enrichments sidebar (edit mode), plain column editor for output columns, per-output column naming
• Copilot: list_enrichments + add_enrichment tools so Mothership can add enrichment columns

Type of Change

• New feature

Testing

Tested manually; tsc clean, biome check clean, bun run check:api-validation:strict passes, copilot tool tests pass (13/13)

Checklist

• Code follows project style guidelines
• Self-reviewed my changes
• Tests added/updated and passing
• No new warnings introduced
• I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment

Project	Deployment	Actions	Updated (UTC)
docs	Skipped		May 27, 2026 7:12am

[cursor]

PR Summary

High Risk
Touches per-row execution, third-party API calls, and hosted-key billing; incorrect cascade or mapping logic could charge users or write wrong cell states at scale.

Overview
Adds code-defined table enrichments that run per row without a workflow, reusing workflow-group storage and the column execution pipeline.

A new apps/sim/enrichments/ registry defines four v1 enrichments (work email, phone, company domain, company info) with ordered provider cascades via executeTool (hosted keys / BYOK). The background executor branches for type: 'enrichment', maps inputs from columns, bills enrichment usage, and distinguishes misses ("Not found") from all-provider failures (error cells).

Table UX: + New column → Enrichments opens a catalog sidebar and config (input mapping, output column names, auto-run deps). Groups persist enrichmentId, inputMappings, and optional type; API PATCH accepts inputMappings / type. Enrichment groups show registry icons in the meta header; workflow sidebar gains optional Start-block input mappings for manual groups.

Copilot catalog gains list_enrichments / add_enrichment; internal docs add /add-enrichment. Shared CollapsibleCard refactors workflow input-mapping UI.

^{Reviewed by Cursor Bugbot for commit f859a0c. Bugbot is set up for automated code reviews on this repo. Configure here.}

[greptile-apps]

Greptile Summary

This PR introduces code-defined enrichment columns for tables: a TypeScript registry (apps/sim/enrichments/) of data-enrichment providers (Work Email via Hunter→PDL, Phone via PDL, Company Domain via PDL, Company Info via PDL→Hunter) that run per table row on the existing workflow-group execution rail without needing a workflow. A new enrichments sidebar, copilot tools (list_enrichments, add_enrichment), and a usage_log_source DB migration round out the feature.

• Enrichment execution (enrichments/run.ts, background/workflow-column-execution.ts): provider cascade (first-result-wins), 404-as-clean-miss handling, hosted-key billing via recordUsage, and abort-safe status writes all reuse the existing workflow-group cell execution infrastructure.
• UI (enrichments-sidebar/, table-grid/, workflow-sidebar/): catalog list, per-input column mapping, per-output column naming, and edit mode opening from the group header; enrichment columns route to plain column editor, not the workflow config panel.
• isHosted = true hardcoded in feature-flags.ts — a debugging leftover that must be reverted before merge (see inline comment).

Confidence Score: 2/5

Not safe to merge until the hardcoded isHosted = true in feature-flags.ts is reverted — every deployment will inject Sim's hosted API keys for PDL and Hunter enrichment calls.

The isHosted = true debug line in feature-flags.ts causes injectHostedKeyIfNeeded in tools/index.ts to skip the !isHosted early-return and inject Sim's own PDL/Hunter credentials on every enrichment call across all deployments, including self-hosted instances. This would leak Sim's hosted-key quota to arbitrary deployments and could trigger rate limits or unexpected billing against Sim's own accounts.

apps/sim/lib/core/config/feature-flags.ts — the hardcoded isHosted = true must be reverted before this ships.

Security Review

• Hosted-key injection on all deployments (apps/sim/lib/core/config/feature-flags.ts): isHosted is hardcoded to true, causing injectHostedKeyIfNeeded in tools/index.ts to inject Sim's own PDL and Hunter API credentials for every enrichment call on every deployment — including self-hosted instances. Self-hosted users would silently consume Sim's hosted-key quota with no billing back to them.

Important Files Changed

Filename	Overview
apps/sim/lib/core/config/feature-flags.ts	isHosted hardcoded to true — a debugging artifact that causes every deployment to inject Sim's hosted API keys for PDL/Hunter enrichment calls.
apps/sim/enrichments/run.ts	New enrichment runner with provider cascade logic; 404 is treated as a clean no-match (correct), cost is accumulated correctly for successful calls.
apps/sim/background/workflow-column-execution.ts	Adds enrichment execution path alongside the existing workflow path; correctly skips own output columns from input mapping, handles abort signals, and wraps billing failures so they don't error the cell.
apps/sim/lib/table/service.ts	Cascades column renames into inputMappings and uses outputId-keyed diff for enrichment outputs; correct output key fallback logic.
apps/sim/app/workspace/[workspaceId]/tables/[tableId]/components/enrichments-sidebar/enrichment-config.tsx	New enrichment config panel with input mapping, output column naming, and auto-run settings; handles both create and edit modes.
apps/sim/lib/copilot/tools/server/table/user-table.ts	Adds list_enrichments and add_enrichment copilot operations; validates required inputs, column existence, and output column naming before calling addWorkflowGroup.
packages/db/migrations/0213_wealthy_sue_storm.sql	Adds enrichment to the usage_log_source enum; migration is correct and schema.ts is kept in sync.
apps/sim/tools/index.ts	Surfaces HTTP status on the error output object so run.ts can distinguish 404 no-match from auth/rate-limit failures; targeted and correct change.

Sequence Diagram

sequenceDiagram
    participant Scheduler
    participant CellExecutor as workflow-column-execution
    participant RunEnrichment as enrichments/run.ts
    participant ExecuteTool as tools/index.ts
    participant Provider as PDL / Hunter API
    participant UsageLog as billing/usage-log

    Scheduler->>CellExecutor: runWorkflowAndWriteTerminal(group)
    CellExecutor->>CellExecutor: "group.type === enrichment?"
    CellExecutor->>CellExecutor: map inputMappings to enrichInputs
    CellExecutor->>CellExecutor: check missingRequired, skip row if true
    CellExecutor->>RunEnrichment: runEnrichment(enrichment, inputs, ctx)
    loop Provider cascade (first-result-wins)
        RunEnrichment->>ExecuteTool: executeTool(toolId, params + workspaceId)
        ExecuteTool->>Provider: HTTP request (BYOK or hosted key)
        Provider-->>ExecuteTool: response
        ExecuteTool-->>RunEnrichment: success, output, error
        alt 404 clean miss
            RunEnrichment->>RunEnrichment: continue to next provider
        else success + non-empty result
            RunEnrichment-->>CellExecutor: result, cost, error null
        else error
            RunEnrichment->>RunEnrichment: errorCount++ try next
        end
    end
    RunEnrichment-->>CellExecutor: result empty, cost, error
    alt "cost > 0"
        CellExecutor->>UsageLog: recordUsage(enrichment cost)
    end
    CellExecutor->>CellExecutor: writeState completed or error with dataPatch

Loading

_{Reviews (3): Last reviewed commit: "fix lint" | Re-trigger Greptile}

[TheodoreSpeaks]

Addressed review feedback in 0ce8bea05:

Cursor Bugbot

• Wrong branch for enrichment type (High): the enrichment cell path is now guarded on group.enrichmentId too, so a group typed 'enrichment' without a registry id falls through to the workflow path instead of erroring. (In practice type: 'enrichment' is only ever set alongside an enrichmentId, but the guard makes it robust.)
• Skip leaves stale output values (Med): the missing-required-input skip now clears any prior output values, so the cell isn't left completed-and-filled and the auto cascade re-enriches once inputs return.
• Abort leaves running status (Med): the enrichment path now writes a terminal state on abort (matching the workflow path), so a cancel between the cascade returning and the terminal write can't leave the cell stuck running.

Greptile

• Save button gating: saveDisabled now includes showValidation && missingRequired, consistent with outputsInvalid.
• Partial rename on multi-output edit: the group update (mappings / deps / auto-run) now runs before the per-column renames, so the primary edit always lands even if a later rename fails. (No atomic multi-rename API exists; client-side validation still prevents the common collision/empty failures.)
• O(n) find in hot paths: both the context-menu and action-bar lookups now use the pre-built workflowGroupById map for O(1) access.

tsc + biome clean.

[TheodoreSpeaks]

@greptile review

[TheodoreSpeaks]

Addressed the second-pass review in `61343a11a`:

• Output diff collapses enrichments (High): updateWorkflowGroup's output diff now keys on outputId (falling back to blockId::path for workflow outputs). Enrichment outputs all share empty blockId/path, so the old key collapsed every sibling into one entry — now each is distinct, so passing outputs for an enrichment group can't drop columns. (The edit flow doesn't send outputs, so this was latent, but it's fixed regardless.)
• Miss leaves stale enrichment values (Med): the terminal write now writes every output column — the result value when present, else clears it — so a partial/empty re-run blanks the columns it didn't fill instead of leaving prior values.
• Edit enrichment shows catalog (Med): editing a group whose enrichmentId is no longer in the registry now shows an explanatory panel instead of silently dropping into the new-enrichment catalog.

tsc + biome clean.

[cursor]

Empty-string workflow outputs now show incorrect running state

Medium Severity

Changing the guard from !isNull to !isEmpty affects all workflow-group columns, not just enrichment ones. When a regular workflow block finishes with an empty string output while other blocks in the group are still running, the cell now falls through to the inFlight branch and incorrectly renders as "queued" or "pending-upstream" instead of showing the completed (empty) value. The isEnrichmentOutput guard for "Not found" only helps enrichment columns — regular workflow columns with legitimate '' outputs regress to showing an active-running indicator after the block has finished.

 

^{Reviewed by Cursor Bugbot for commit 4e7b751. Configure here.}

[TheodoreSpeaks]

Latest review pass:

• Blank miss re-eligible on run-all (Med) — fixed in `a3c92eaf1`. Eligibility now treats an enrichment's completed status as terminal even with empty outputs (a no-match is a real result), so the auto cascade no longer re-invokes billable provider calls on every no-match row each dispatch. Genuine input changes still clear the exec entry (deriveExecClearsForDataPatch), so real re-runs are unaffected; explicit "Run all" still re-runs.
• Miss leaves stale enrichment values (Med) — already addressed in `61343a11a` (the bot re-flagged the pre-fix commit fb6bbd0cd). The terminal write now writes every output column, clearing any the result didn't fill.

Also shipped `4e7b75196`: completed-but-empty enrichment cells render a "Not found" badge instead of a blank.

tsc + biome clean.

[TheodoreSpeaks]

@greptile review

[cursor]

Cursor Bugbot has reviewed your changes and found 1 potential issue.

There are 2 total unresolved issues (including 1 from previous review).

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

^{Reviewed by Cursor Bugbot for commit f859a0c. Configure here.}