Skip to content

feat: support multiple --url arguments with per-URL format and headers#211

Merged
vmvarela merged 4 commits into
masterfrom
feature/multiple-urls
Jul 18, 2026
Merged

feat: support multiple --url arguments with per-URL format and headers#211
vmvarela merged 4 commits into
masterfrom
feature/multiple-urls

Conversation

@vmvarela

Copy link
Copy Markdown
Owner

Summary

Implements support for multiple arguments with per-URL format and headers.

Changes

Core Features

  • **Repeatable **:
  • Named URLs:
  • Per-URL format: applies to the last
  • Per-URL headers: applies to the last
  • **Global **: Single value applies to all URLs

Table Naming

  • Anonymous URLs: , , , ...
  • Named URLs: Custom table name from
  • stdin table: when URLs/files exist, else

Updated Modes

  • : Works with multiple URLs
  • : Works with multiple URLs
  • REPL mode: Works with multiple URLs

Shell Completions

  • Updated for repeatable
  • Added descriptions for per-URL flags

Testing

  • All manual tests pass
  • Test suite: 366/368 steps pass (same as before - 2 pre-existing failures unrelated to this change)
  • 20/20 unit tests pass

Breaking Changes

  • Single now creates table (was )
  • No backward compatibility (no existing users)

Files Modified

    • Argument parsing and types
    • Load pipeline and table naming
    • Schema mode
    • Stats mode
    • Shell completions
    • Test updates for new table naming

- Allow repeatable --url flag (--url URL1 --url URL2 ...)
- Support named URLs: --url NAME=URL
- Per-URL format: --url URL --input-format json
- Per-URL headers: --url URL --http-header 'X: 1'
- Global --max-body-size applies to all URLs
- Anonymous URLs get table names url0, url1, ...
- Named URLs use custom table name
- stdin table name: 'stdin' when URLs/files exist, else 't'
- Updated --schema and --stats modes for multiple URLs
- Updated shell completions
@github-actions github-actions Bot added the type:feature New functionality label Jul 18, 2026
vmvarela added 3 commits July 18, 2026 13:31
- Add explicit -I json for JSON HTTP endpoints in tests
- Fix global input_format_explicit fallback for URLs
- Update test table names to url0/stdin
- Update duplicate table name test for new stdin naming
- Remove duplicate --input-format handler (was setting input_format_explicit
  globally, overriding per-URL format)
- Remove unused error variants (UrlFormatRequiresUrl, UrlFlagsRequireUrl)
- Clarify help text for per-URL flag behavior
- Add integration test for per-URL --input-format and --http-header
@vmvarela
vmvarela merged commit 92d373f into master Jul 18, 2026
4 checks passed
@vmvarela
vmvarela deleted the feature/multiple-urls branch July 18, 2026 12:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

type:feature New functionality

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant