Allow configuring the collation of asset name columns

[1fanwang]

closes: #31373

The name, uri and group columns on the asset tables hard-code the
latin1_general_cs collation on MySQL. The reasoning is sound — the values are
ASCII, and a single-byte charset keeps the 1500-character unique indexes inside
the 3072-byte index limit that utf8mb4 would blow past — but it is baked into
the ORM column definitions, so it cannot be overridden. A MySQL-compatible engine
that does not ship that collation cannot create Airflow's schema at all:

(1273, "Unsupported collation when new collation is enabled: 'latin1_general_cs'")

sql_engine_collation_for_ids already exists for the same reason on the
StringID columns. This adds the equivalent knob for the asset columns,
defaulting to today's value so nothing changes unless it is set.

The collation was repeated inline at ten sites; they now share one constant,
which is where the net line reduction comes from.

Design suggested by @hussein-awala in #31373 ("Adding a new Airflow configuration
to configure the table collation and set its default value to
latin1_general_cs can do the job").

Testing Done

Against TiDB v8.5.1, which offers 13 collations and no latin1_general_cs. Its
latin1_bin is the equivalent substitute — single-byte, case-sensitive, indexes
VARCHAR(1500) — verified by inserting 'Abc' and 'abc' under a unique key
and confirming both are accepted.

With the option unset, the emitted DDL is byte-identical to before.

Raw logs

Before, airflow db migrate cannot create the first asset table:

sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError)
(1273, "Unsupported collation when new collation is enabled: 'latin1_general_cs'")
[SQL:
CREATE TABLE asset_alias (
        id INTEGER NOT NULL AUTO_INCREMENT,
        name VARCHAR(1500) COLLATE latin1_general_cs NOT NULL,
        `group` VARCHAR(1500) COLLATE latin1_general_cs NOT NULL,
        CONSTRAINT asset_alias_pkey PRIMARY KEY (id)
)
]

After, with AIRFLOW__DATABASE__SQL_ENGINE_COLLATION_FOR_ASSET_NAMES=latin1_bin:

[info] Creating Airflow database tables from the ORM
[info] Running stamp_revision  -> 7a98f1b7dbd3
[info] Database migration done!

tables created: 71
foreign keys : 86
latin1 columns: asset.name/uri/group, asset_active.name/uri,
                asset_alias.name/group, asset_watcher.name  -> all latin1_bin

Default unchanged — with the option unset, MySQL 8.4 still gets
COLLATE latin1_general_cs in the generated DDL.

A real DAG through the resulting schema (dynamic task mapping, XCom, fan-in):

sum of squares = 55
DagRun Finished: dag_id=tidb_smoke, run_duration=4.42, state=success

Regressions: tests/unit/models/test_base.py, test_asset.py,
tests/unit/core/test_configuration.py, tests/unit/utils/test_sqlalchemy.py
— 242 passed.

---

Was generative AI tooling used to co-author this PR?

• Yes — GitHub Copilot CLI (Claude Opus 5)

Generated-by: GitHub Copilot CLI (Claude Opus 5) following the guidelines