Skip to content

Enhance Tableau insights with custom scrapers#70

Closed
rapsoj wants to merge 7 commits into
mainfrom
fix-tableau
Closed

Enhance Tableau insights with custom scrapers#70
rapsoj wants to merge 7 commits into
mainfrom
fix-tableau

Conversation

@rapsoj

@rapsoj rapsoj commented Jul 15, 2026

Copy link
Copy Markdown
Collaborator

Addressed issue in #66 using solution 2 recommended in #50 :

Separate headless-browser refresh job (Playwright) that loads the dashboard, reads the count, and writes it into the snapshot — run as step 0 of each forecast refresh. Fully automated, keeps the browser dependency out of the main curl-based pipeline. Open risk: Akamai may also block headless/automated browsers unless stealth-configured; needs a feasibility test.

@smodee

smodee commented Jul 17, 2026

Copy link
Copy Markdown
Collaborator

Thanks @rapsoj! The USDA Playwright fetch landed in #74 — verified live end-to-end, with the dependency corrected to playwright plus a documented playwright install chromium step. Leaving this open for you to close when ready.

@smodee

smodee commented Jul 18, 2026

Copy link
Copy Markdown
Collaborator

Closing with @rapsoj's OK — superseded by #74 (scrapers) and the follow-up in #75 (live PAHO fetch). Thanks Jess!

@smodee smodee closed this Jul 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants