Sqlfluff

Highlights

* Rewrote `diff-quality` plugin to run SQLFluff as a subprocess. More reliable, easier to switch between `diff-quality` and running `sqlfluff lint` directly.
* New rule L067 enforces consistent syntax for type casts.
* New rule L068 enforces a consistent number of columns in set queries (e.g. UNION).
* Initial support for Materialize dialect.

What's Changed
* Add flyway variables support via placeholder templater [4026](https://github.com/sqlfluff/sqlfluff/pull/4026) [srjonemed](https://github.com/srjonemed)
* Fix Spark comparison parsing [4066](https://github.com/sqlfluff/sqlfluff/pull/4066) [ms32035](https://github.com/ms32035)
* Add errors and fails to pytest summary [4076](https://github.com/sqlfluff/sqlfluff/pull/4076) [alanmcruickshank](https://github.com/alanmcruickshank)
* Storage reference segment [4057](https://github.com/sqlfluff/sqlfluff/pull/4057) [YilangHe](https://github.com/YilangHe)
* New rule L069: Consistent syntax for sql type casting [3747](https://github.com/sqlfluff/sqlfluff/pull/3747) [bolajiwahab](https://github.com/bolajiwahab)
* Postgres: Views and named notations [4073](https://github.com/sqlfluff/sqlfluff/pull/4073) [davetapley](https://github.com/davetapley)
* Switch reflow buffer from LintFix to LintResult [4083](https://github.com/sqlfluff/sqlfluff/pull/4083) [alanmcruickshank](https://github.com/alanmcruickshank)
* Support parallel linting when many individual files specified [4084](https://github.com/sqlfluff/sqlfluff/pull/4084) [barrywhart](https://github.com/barrywhart)
* Rule: check number of columns in set operations match [4028](https://github.com/sqlfluff/sqlfluff/pull/4028) [erevear](https://github.com/erevear)
* Fix syntax in indentation sample code docs [4087](https://github.com/sqlfluff/sqlfluff/pull/4087) [PBalsdon](https://github.com/PBalsdon)
* Remove "mystery" binary file added in PR 2923 [4088](https://github.com/sqlfluff/sqlfluff/pull/4088) [barrywhart](https://github.com/barrywhart)
* Fix mypy issue with regex [4097](https://github.com/sqlfluff/sqlfluff/pull/4097) [barrywhart](https://github.com/barrywhart)
* Enable variable reference names to have leading underscore for snowflake dialect [4098](https://github.com/sqlfluff/sqlfluff/pull/4098) [gavin-tsang](https://github.com/gavin-tsang)
* Fix flake8 issue with segment_predicates.py [4101](https://github.com/sqlfluff/sqlfluff/pull/4101) [barrywhart](https://github.com/barrywhart)
* Fix bug in example rule plugin [4103](https://github.com/sqlfluff/sqlfluff/pull/4103) [barrywhart](https://github.com/barrywhart)
* Fix bug where L034 should ignore INSERT or "CREATE TABLE AS SELECT" with CTE [4108](https://github.com/sqlfluff/sqlfluff/pull/4108) [barrywhart](https://github.com/barrywhart)
* Postgres: Alter type rename value [4100](https://github.com/sqlfluff/sqlfluff/pull/4100) [greg-finley](https://github.com/greg-finley)
* Bug fix: dbt templater ignores .sqlfluff file encoding on Windows [4109](https://github.com/sqlfluff/sqlfluff/pull/4109) [barrywhart](https://github.com/barrywhart)
* Add initial Materialize dialect [4112](https://github.com/sqlfluff/sqlfluff/pull/4112) [bobbyiliev](https://github.com/bobbyiliev)
* L015: Handle COUNT(DISTINCT(col)) [4110](https://github.com/sqlfluff/sqlfluff/pull/4110) [barrywhart](https://github.com/barrywhart)
* [Snowflake] format type options extensions for copy_into_location [4129](https://github.com/sqlfluff/sqlfluff/pull/4129) [YilangHe](https://github.com/YilangHe)
* Fix tox arguments [4144](https://github.com/sqlfluff/sqlfluff/pull/4144) [greg-finley](https://github.com/greg-finley)
* [DB2] Fix parsing of string identifiers [4134](https://github.com/sqlfluff/sqlfluff/pull/4134) [borchero](https://github.com/borchero)
* BigQuery: Allow double quoted literal in export_option_list [4126](https://github.com/sqlfluff/sqlfluff/pull/4126) [yoichi](https://github.com/yoichi)
* Only upload 3 sets of test results to codecov (possible workaround for hanging builds) [4147](https://github.com/sqlfluff/sqlfluff/pull/4147) [barrywhart](https://github.com/barrywhart)
* SparkSQL: ILIKE [4138](https://github.com/sqlfluff/sqlfluff/pull/4138) [greg-finley](https://github.com/greg-finley)
* SparkSQL: Mark `AS` as optional keyword for CTE & CTS [4127](https://github.com/sqlfluff/sqlfluff/pull/4127) [ulixius9](https://github.com/ulixius9)
* Fix passenv to work with tox 4 [4154](https://github.com/sqlfluff/sqlfluff/pull/4154) [tunetheweb](https://github.com/tunetheweb)
* Allow deprecated --disable_progress_bar flag for fix command [4151](https://github.com/sqlfluff/sqlfluff/pull/4151) [pdebelak](https://github.com/pdebelak)
* Implement diff_quality_plugin using command-line rather than Python [4148](https://github.com/sqlfluff/sqlfluff/pull/4148) [barrywhart](https://github.com/barrywhart)
* L037: insert ASC just after column_reference [4149](https://github.com/sqlfluff/sqlfluff/pull/4149) [yoichi](https://github.com/yoichi)

New Contributors
* [srjonemed](https://github.com/srjonemed) made their first contribution in [#4026](https://github.com/sqlfluff/sqlfluff/pull/4026)
* [ms32035](https://github.com/ms32035) made their first contribution in [#4066](https://github.com/sqlfluff/sqlfluff/pull/4066)
* [davetapley](https://github.com/davetapley) made their first contribution in [#4073](https://github.com/sqlfluff/sqlfluff/pull/4073)
* [PBalsdon](https://github.com/PBalsdon) made their first contribution in [#4087](https://github.com/sqlfluff/sqlfluff/pull/4087)
* [gavin-tsang](https://github.com/gavin-tsang) made their first contribution in [#4098](https://github.com/sqlfluff/sqlfluff/pull/4098)
* [bobbyiliev](https://github.com/bobbyiliev) made their first contribution in [#4112](https://github.com/sqlfluff/sqlfluff/pull/4112)
* [ulixius9](https://github.com/ulixius9) made their first contribution in [#4127](https://github.com/sqlfluff/sqlfluff/pull/4127)

Highlights

This release is less about internals and much more about some quality of life
improvements and dialect changes. The most notable are:
- The introduction of a `sqlfluff render` command to preview the results of
templated sql.
- Linting errors within templated loops should now only appear once in the
linting output.
- Indentation around jinja `{% set %}` statements should now be more consistent.
- Linting errors around unparsable code are now more appropriately handled (with
more to come soon on that front).
- Error messages when specified files aren't found are now more specific.

We've also got dialect improvements for Redshift, SOQL & SparkSQL.

What’s Changed

* Fix type error in `get_rules` hook of plugin example [4060](https://github.com/sqlfluff/sqlfluff/pull/4060) [Samyak2](https://github.com/Samyak2)
* L003: Add missing "pragma: no cover" [4058](https://github.com/sqlfluff/sqlfluff/pull/4058) [barrywhart](https://github.com/barrywhart)
* Fix bug in sparksql SELECT statement termination at UNION 4050 [4052](https://github.com/sqlfluff/sqlfluff/pull/4052) [anna-azizian](https://github.com/anna-azizian)
* Deduplicate violations in the source space [4041](https://github.com/sqlfluff/sqlfluff/pull/4041) [alanmcruickshank](https://github.com/alanmcruickshank)
* Use "docker compose", not "docker-compose" [4055](https://github.com/sqlfluff/sqlfluff/pull/4055) [barrywhart](https://github.com/barrywhart)
* Allow warnings for specific rules [4053](https://github.com/sqlfluff/sqlfluff/pull/4053) [alanmcruickshank](https://github.com/alanmcruickshank)
* Better file not found error 1023 [4051](https://github.com/sqlfluff/sqlfluff/pull/4051) [alanmcruickshank](https://github.com/alanmcruickshank)
* Filter out issues in unparsable sections [4032](https://github.com/sqlfluff/sqlfluff/pull/4032) [alanmcruickshank](https://github.com/alanmcruickshank)
* Snowflake: ADD and DROP without COLUMN [4049](https://github.com/sqlfluff/sqlfluff/pull/4049) [greg-finley](https://github.com/greg-finley)
* Make render command [4043](https://github.com/sqlfluff/sqlfluff/pull/4043) [alanmcruickshank](https://github.com/alanmcruickshank)
* Bump after_n_builds to 10 [4046](https://github.com/sqlfluff/sqlfluff/pull/4046) [greg-finley](https://github.com/greg-finley)
* Redshift: allows for parenthesis around FROM content [3962](https://github.com/sqlfluff/sqlfluff/pull/3962) [adam-tokarski](https://github.com/adam-tokarski)
* Update CI to use Python 3.11 [4038](https://github.com/sqlfluff/sqlfluff/pull/4038) [greg-finley](https://github.com/greg-finley)
* Classify self contained set statements as templated [4034](https://github.com/sqlfluff/sqlfluff/pull/4034) [alanmcruickshank](https://github.com/alanmcruickshank)
* Date and Datetime literals in SOQL [4037](https://github.com/sqlfluff/sqlfluff/pull/4037) [alanmcruickshank](https://github.com/alanmcruickshank)
* mypy edits for 0.990 [4035](https://github.com/sqlfluff/sqlfluff/pull/4035) [alanmcruickshank](https://github.com/alanmcruickshank)
* sparksql: support for create/remove widget clause [4021](https://github.com/sqlfluff/sqlfluff/pull/4021) [Coola4kov](https://github.com/Coola4kov)
* Redshift CREATE EXTERNAL FUNCTION statement [4011](https://github.com/sqlfluff/sqlfluff/pull/4011) [rpr-ableton](https://github.com/rpr-ableton)
* Update Redshift bare functions [4012](https://github.com/sqlfluff/sqlfluff/pull/4012) [rpr-ableton](https://github.com/rpr-ableton)


New Contributors
* [Coola4kov](https://github.com/Coola4kov) made their first contribution in [#4021](https://github.com/sqlfluff/sqlfluff/pull/4021)
* [anna-azizian](https://github.com/anna-azizian) made their first contribution in [#4052](https://github.com/sqlfluff/sqlfluff/pull/4052)

Highlights

This is a fix to the configuration migration from 1.4.0. In that release, the configuration
of leading/trailing operators would be migrated the wrong way around and precedence between
new and old configuration values behaved unexpectedly.

What’s Changed

* Config precedence [4007](https://github.com/sqlfluff/sqlfluff/pull/4007) [alanmcruickshank](https://github.com/alanmcruickshank)
* Redshift CREATE/ATTACH/DETACH/DROP RLS POLICY statements [4004](https://github.com/sqlfluff/sqlfluff/pull/4004) [rpr-ableton](https://github.com/rpr-ableton)
* Redshift: Add support for APPROXIMATE functions [3997](https://github.com/sqlfluff/sqlfluff/pull/3997) [rpr-ableton](https://github.com/rpr-ableton)
* hotfix to config migration [4005](https://github.com/sqlfluff/sqlfluff/pull/4005) [alanmcruickshank](https://github.com/alanmcruickshank)

Highlights

This release brings several internal changes, and acts as a prelude to 2.0.0 which
will be released fairly soon. In particular, the following config values have changed:
- `sqlfluff:rules:L007:operator_new_lines` has been changed to
`sqlfluff:layout:type:binary_operator:line_position`.
- `sqlfluff:rules:comma_style` and `sqlfluff:rules:L019:comma_style` have both been
consolidated into `sqlfluff:layout:type:comma:line_position`.

If any of these values have been set in your config, they will be automatically
translated to the new values at runtime, and a warning will be shown. To silence
the warning, update your config file to the new values. For more details on
configuring layout (including some changes yet to come in future versions)
see [the docs](https://docs.sqlfluff.com/en/latest/layout.html#configuring-layout).

These changes are driven by underlying centralisation in the routines which control
layout. While for this release, no breaking changes are expected - you may find
slight differences in how SQLFluff handles edge cases. We believe in the majority
of cases these are _more_ consistent, but if you find any which are problematic
then do post an issue on GitHub as usual.

Other highlights from this release:
- Better dbt supportfor graph nodes and avoiding dependency conflicts.
- Numerous dialect improvements to T-SQL, MySQL, SparkSQL, SQLite, Athena
Snowflake, Hive, Postgres & Databricks.

There have also been first time contributions from **10 new contributors**! 🎉🎉🎉


What’s Changed

* Snowflake partition nonreserved keyword [3972](https://github.com/sqlfluff/sqlfluff/pull/3972) [YilangHe](https://github.com/YilangHe)
* Hive: Add support for EXCHANGE PARTITION in ALTER TABLE [3991](https://github.com/sqlfluff/sqlfluff/pull/3991) [nahuelverdugo](https://github.com/nahuelverdugo)
* Resolve parse error on multiple bracketed statements [3994](https://github.com/sqlfluff/sqlfluff/pull/3994) [yoichi](https://github.com/yoichi)
* Enable parsing of CLONE keyword in bigquery dialect [3984](https://github.com/sqlfluff/sqlfluff/pull/3984) [realLyans](https://github.com/realLyans)
* BigQuery: allow nesting of SetExpressionSegment [3990](https://github.com/sqlfluff/sqlfluff/pull/3990) [yoichi](https://github.com/yoichi)
* feat(clickhouse): Support non-standard CREATE TABLE statement [3986](https://github.com/sqlfluff/sqlfluff/pull/3986) [tomasfarias](https://github.com/tomasfarias)
* Fix Windows CI check [3992](https://github.com/sqlfluff/sqlfluff/pull/3992) [greg-finley](https://github.com/greg-finley)
* Snowflake tag reference segment [3985](https://github.com/sqlfluff/sqlfluff/pull/3985) [WittierDinosaur](https://github.com/WittierDinosaur)
* Fix Jinja templater issue where undefined callable threw an exception [3982](https://github.com/sqlfluff/sqlfluff/pull/3982) [barrywhart](https://github.com/barrywhart)
* Reflow Documentation V1 [3970](https://github.com/sqlfluff/sqlfluff/pull/3970) [alanmcruickshank](https://github.com/alanmcruickshank)
* Allow lambda argument columns to be unqualified [3971](https://github.com/sqlfluff/sqlfluff/pull/3971) [olagjo](https://github.com/olagjo)
* document inline configuration [3981](https://github.com/sqlfluff/sqlfluff/pull/3981) [alanmcruickshank](https://github.com/alanmcruickshank)
* [BUGFIX] Changing cwd temporarily on manifest load as dbt is not using project_dir to read/write target folder [3979](https://github.com/sqlfluff/sqlfluff/pull/3979) [barrywhart](https://github.com/barrywhart)
* Fix type annotation of user_rules in `Linter` [3977](https://github.com/sqlfluff/sqlfluff/pull/3977) [Samyak2](https://github.com/Samyak2)
* Unpin `markupsafe` [3967](https://github.com/sqlfluff/sqlfluff/pull/3967) [judahrand](https://github.com/judahrand)
* Snowflake frame clause variables [3969](https://github.com/sqlfluff/sqlfluff/pull/3969) [WittierDinosaur](https://github.com/WittierDinosaur)
* SparkSQL: added support for : (colon sign) operator (Databricks SQL) [3956](https://github.com/sqlfluff/sqlfluff/pull/3956) [karabulute](https://github.com/karabulute)
* Athena: Add support for using underscore aliases [3965](https://github.com/sqlfluff/sqlfluff/pull/3965) [hectcastro](https://github.com/hectcastro)
* Snowflake: ALTER TABLE constraint actions [3959](https://github.com/sqlfluff/sqlfluff/pull/3959) [erevear](https://github.com/erevear)
* MySQL: Support REPLACE statement [3964](https://github.com/sqlfluff/sqlfluff/pull/3964) [yoichi](https://github.com/yoichi)
* TSQL: Add support for UPDATE STATISTICS option FULLSCAN [3950](https://github.com/sqlfluff/sqlfluff/pull/3950) [hectcastro](https://github.com/hectcastro)
* ANSI: fixed typos in docstrings and comments [3953](https://github.com/sqlfluff/sqlfluff/pull/3953) [karabulute](https://github.com/karabulute)
* Postgres: ALTER PROCEDURE [3949](https://github.com/sqlfluff/sqlfluff/pull/3949) [krokofant](https://github.com/krokofant)
* T-SQL: Allow arbitrary expressions in PARTITION BY clause [3939](https://github.com/sqlfluff/sqlfluff/pull/3939) [borchero](https://github.com/borchero)
* Enable dumping of performance information to csv. [3937](https://github.com/sqlfluff/sqlfluff/pull/3937) [alanmcruickshank](https://github.com/alanmcruickshank)
* Consolidate comma style configs [3945](https://github.com/sqlfluff/sqlfluff/pull/3945) [alanmcruickshank](https://github.com/alanmcruickshank)
* Adding missing KeywordSegments for different file types in Athena dialect [3898](https://github.com/sqlfluff/sqlfluff/pull/3898) [CommonCrisis](https://github.com/CommonCrisis)
* Add templated block uuids [3936](https://github.com/sqlfluff/sqlfluff/pull/3936) [alanmcruickshank](https://github.com/alanmcruickshank)
* Load the full dbt manifest [3926](https://github.com/sqlfluff/sqlfluff/pull/3926) [davajm](https://github.com/davajm)
* MySQL: Support optional "IF NOT EXISTS" with CREATE TRIGGER [3943](https://github.com/sqlfluff/sqlfluff/pull/3943) [yoichi](https://github.com/yoichi)
* T-SQL: Allow to parse SYNONYM statements [3941](https://github.com/sqlfluff/sqlfluff/pull/3941) [borchero](https://github.com/borchero)
* Hive: Add support for LATERAL VIEW clause [3935](https://github.com/sqlfluff/sqlfluff/pull/3935) [hectcastro](https://github.com/hectcastro)
* Fix crash in L042 on "UNION" or other "set" queries [3931](https://github.com/sqlfluff/sqlfluff/pull/3931) [barrywhart](https://github.com/barrywhart)
* Refactor Lexer: Split apart elements_to_segments and refine placement of meta segments. [3925](https://github.com/sqlfluff/sqlfluff/pull/3925) [alanmcruickshank](https://github.com/alanmcruickshank)
* Add INSERT INTO <> DEFAULT VALUES to ANSI SQL and T-SQL [3934](https://github.com/sqlfluff/sqlfluff/pull/3934) [borchero](https://github.com/borchero)
* Break apart reflow classes and extract methods [3919](https://github.com/sqlfluff/sqlfluff/pull/3919) [alanmcruickshank](https://github.com/alanmcruickshank)
* T-SQL: Fix indendentation of OUTER APPLY [3932](https://github.com/sqlfluff/sqlfluff/pull/3932) [borchero](https://github.com/borchero)
* MySQL: Fix create trigger [3928](https://github.com/sqlfluff/sqlfluff/pull/3928) [adam-tokarski](https://github.com/adam-tokarski)
* SparkSQL: Fixed bug with `QUALIFY` usage without `WHERE` clause (applies also for Databricks dialect) [3930](https://github.com/sqlfluff/sqlfluff/pull/3930) [karabulute](https://github.com/karabulute)
* T-SQL: Allow specifying join hints [3921](https://github.com/sqlfluff/sqlfluff/pull/3921) [borchero](https://github.com/borchero)
* SQLite: Add support for table-level CHECK constraint [3923](https://github.com/sqlfluff/sqlfluff/pull/3923) [hectcastro](https://github.com/hectcastro)
* sparksql: added * EXCEPT for SELECT clause [3922](https://github.com/sqlfluff/sqlfluff/pull/3922) [adam-tokarski](https://github.com/adam-tokarski)
* Map old configs to new configs [3915](https://github.com/sqlfluff/sqlfluff/pull/3915) [alanmcruickshank](https://github.com/alanmcruickshank)
* [issue_3794] allow to use 'usage' as identifier for postgres [3914](https://github.com/sqlfluff/sqlfluff/pull/3914) [adam-tokarski](https://github.com/adam-tokarski)
* `DATABRICKS`: Add Support for Delta Live Tables (DLT) Syntax [3899](https://github.com/sqlfluff/sqlfluff/pull/3899) [R7L208](https://github.com/R7L208)
* Postgres Revoke fix [3912](https://github.com/sqlfluff/sqlfluff/pull/3912) [greg-finley](https://github.com/greg-finley)
* fix: Click output to stderr on errors [3902](https://github.com/sqlfluff/sqlfluff/pull/3902) [KingMichaelPark](https://github.com/KingMichaelPark)
* fix issue with empty enum for postgres [3910](https://github.com/sqlfluff/sqlfluff/pull/3910) [adam-tokarski](https://github.com/adam-tokarski)
* feat: Optional numerics for postgres arrays [3903](https://github.com/sqlfluff/sqlfluff/pull/3903) [KingMichaelPark](https://github.com/KingMichaelPark)
* fix(test): Return ParseExample namedtuple in get_parse_fixtures [3911](https://github.com/sqlfluff/sqlfluff/pull/3911) [tomasfarias](https://github.com/tomasfarias)
* Fix typos [3901](https://github.com/sqlfluff/sqlfluff/pull/3901) [kianmeng](https://github.com/kianmeng)
* provide custom DeprecatedOption [3904](https://github.com/sqlfluff/sqlfluff/pull/3904) [adam-tokarski](https://github.com/adam-tokarski)
* fix(redshift): Allow keywords in qualified references [3905](https://github.com/sqlfluff/sqlfluff/pull/3905) [tomasfarias](https://github.com/tomasfarias)
* Reflow centralisation 2: Rebreak (operators & commas) [3847](https://github.com/sqlfluff/sqlfluff/pull/3847) [alanmcruickshank](https://github.com/alanmcruickshank)
* Bring L008 into reflow work [3908](https://github.com/sqlfluff/sqlfluff/pull/3908) [alanmcruickshank](https://github.com/alanmcruickshank)
* Snowflake: Create network policy ip lists [3888](https://github.com/sqlfluff/sqlfluff/pull/3888) [greg-finley](https://github.com/greg-finley)
* MySQL: Implement (key_part, ...) in index definitions [3887](https://github.com/sqlfluff/sqlfluff/pull/3887) [yoichi](https://github.com/yoichi)
* Reflow centralisation 1: Scope + Respace [3824](https://github.com/sqlfluff/sqlfluff/pull/3824) [alanmcruickshank](https://github.com/alanmcruickshank)
* Update github badge and add docker badge [3884](https://github.com/sqlfluff/sqlfluff/pull/3884) [alanmcruickshank](https://github.com/alanmcruickshank)


New Contributors
* [kianmeng](https://github.com/kianmeng) made their first contribution in [#3901](https://github.com/sqlfluff/sqlfluff/pull/3901)
* [KingMichaelPark](https://github.com/KingMichaelPark) made their first contribution in [#3903](https://github.com/sqlfluff/sqlfluff/pull/3903)
* [hectcastro](https://github.com/hectcastro) made their first contribution in [#3923](https://github.com/sqlfluff/sqlfluff/pull/3923)
* [karabulute](https://github.com/karabulute) made their first contribution in [#3930](https://github.com/sqlfluff/sqlfluff/pull/3930)
* [davajm](https://github.com/davajm) made their first contribution in [#3926](https://github.com/sqlfluff/sqlfluff/pull/3926)
* [CommonCrisis](https://github.com/CommonCrisis) made their first contribution in [#3898](https://github.com/sqlfluff/sqlfluff/pull/3898)
* [krokofant](https://github.com/krokofant) made their first contribution in [#3949](https://github.com/sqlfluff/sqlfluff/pull/3949)
* [Samyak2](https://github.com/Samyak2) made their first contribution in [#3977](https://github.com/sqlfluff/sqlfluff/pull/3977)
* [realLyans](https://github.com/realLyans) made their first contribution in [#3984](https://github.com/sqlfluff/sqlfluff/pull/3984)
* [nahuelverdugo](https://github.com/nahuelverdugo) made their first contribution in [#3991](https://github.com/sqlfluff/sqlfluff/pull/3991)
* [YilangHe](https://github.com/YilangHe) made their first contribution in [#3972](https://github.com/sqlfluff/sqlfluff/pull/3972)

Highlights

This is primarily a release for dialect fixes and improvements with additions
and changes to TSQL, Snowflake, MySQL & Redshift. The other changes of note are:
1. Support for warnings when users set old removed config values. This supports
future change work by allowing a mechanism to warn if they are used.
2. Improvements to the fix routines for L014 and L042 to handle some trickier
cases.

What’s Changed

* Add CreateUserSegment for Snowflake dialect [3880](https://github.com/sqlfluff/sqlfluff/pull/3880) [Gal40n04ek](https://github.com/Gal40n04ek)
* raw_segments_with_ancestors [3878](https://github.com/sqlfluff/sqlfluff/pull/3878) [alanmcruickshank](https://github.com/alanmcruickshank)
* Adjust TSQL Operators [3877](https://github.com/sqlfluff/sqlfluff/pull/3877) [alanmcruickshank](https://github.com/alanmcruickshank)
* Refactor path_to [3875](https://github.com/sqlfluff/sqlfluff/pull/3875) [alanmcruickshank](https://github.com/alanmcruickshank)
* Support Removed warning on configs [3874](https://github.com/sqlfluff/sqlfluff/pull/3874) [alanmcruickshank](https://github.com/alanmcruickshank)
* MySQL: Support column-path operator for JSON type [3864](https://github.com/sqlfluff/sqlfluff/pull/3864) [yoichi](https://github.com/yoichi)
* T-SQL: ALTER FUNCTION/PROCEDURE/VIEW parsing [3867](https://github.com/sqlfluff/sqlfluff/pull/3867) [differgroup](https://github.com/differgroup)
* MySQL: Support hexadecimal literals and bit value literals [3869](https://github.com/sqlfluff/sqlfluff/pull/3869) [yoichi](https://github.com/yoichi)
* MySQL: Treat double quotes the same as single quotes [3871](https://github.com/sqlfluff/sqlfluff/pull/3871) [yoichi](https://github.com/yoichi)
* Snowflake: COMMIT WORK [3862](https://github.com/sqlfluff/sqlfluff/pull/3862) [rglbr](https://github.com/rglbr)
* Snowflake: AlterShareStatementSegment and CreateDatabaseFromShareStatementSegment [3858](https://github.com/sqlfluff/sqlfluff/pull/3858) [moreaupascal56](https://github.com/moreaupascal56)
* MySQL: Add CREATE/ALTER VIEW [3859](https://github.com/sqlfluff/sqlfluff/pull/3859) [wfelipew](https://github.com/wfelipew)
* Redshift: CREATE TABLE LIKE enhancements [3853](https://github.com/sqlfluff/sqlfluff/pull/3853) [greg-finley](https://github.com/greg-finley)
* L014 leading underscore capitalization inference fix [3841](https://github.com/sqlfluff/sqlfluff/pull/3841) [j-svensmark](https://github.com/j-svensmark)
* MySQL: Add extended DROP TRIGGER functionality [3846](https://github.com/sqlfluff/sqlfluff/pull/3846) [yoichi](https://github.com/yoichi)
* Allow standalone aliases in L027 [3848](https://github.com/sqlfluff/sqlfluff/pull/3848) [olagjo](https://github.com/olagjo)
* L042: Enable autofix for some tricky cases [3700](https://github.com/sqlfluff/sqlfluff/pull/3700) [barrywhart](https://github.com/barrywhart)
* Snowflake: CREATE FUNCTION IF NOT EXISTS [3845](https://github.com/sqlfluff/sqlfluff/pull/3845) [greg-finley](https://github.com/greg-finley)
* ignore functions with more than one element ... [3792](https://github.com/sqlfluff/sqlfluff/pull/3792) [fmms](https://github.com/fmms)
* MySQL: support remaining constraint parts of CREATE/ALTER TABLE [3827](https://github.com/sqlfluff/sqlfluff/pull/3827) [yoichi](https://github.com/yoichi)

New Contributors

* [olagjo](https://github.com/olagjo) made their first contribution in [#3848](https://github.com/sqlfluff/sqlfluff/pull/3848)
* [j-svensmark](https://github.com/j-svensmark) made their first contribution in [#3841](https://github.com/sqlfluff/sqlfluff/pull/3841)
* [wfelipew](https://github.com/wfelipew) made their first contribution in [#3859](https://github.com/sqlfluff/sqlfluff/pull/3859)
* [moreaupascal56](https://github.com/moreaupascal56) made their first contribution in [#3858](https://github.com/sqlfluff/sqlfluff/pull/3858)
* [rglbr](https://github.com/rglbr) made their first contribution in [#3862](https://github.com/sqlfluff/sqlfluff/pull/3862)
* [differgroup](https://github.com/differgroup) made their first contribution in [#3867](https://github.com/sqlfluff/sqlfluff/pull/3867)

Highlights

* More refactoring of parse structures in preparation for upcoming refactor of
formatting/whitespace rules.
* Fixes some bugs in L003 (indentation).
* New config flag `large_file_skip_byte_limit` which applies **prior to**
loading the file.

What’s Changed

* Snowflake: Fix syntax errors in tests [3834](https://github.com/sqlfluff/sqlfluff/pull/3834) [JamesRTaylor](https://github.com/JamesRTaylor)
* Add support for additional magic methods on DummyUndefined [3835](https://github.com/sqlfluff/sqlfluff/pull/3835) [barrywhart](https://github.com/barrywhart)
* MySQL: support variable assignments by assignment operator := [3829](https://github.com/sqlfluff/sqlfluff/pull/3829) [yoichi](https://github.com/yoichi)
* MYSQL: improve lexing for single-quoted strings [3831](https://github.com/sqlfluff/sqlfluff/pull/3831) [mdahlman](https://github.com/mdahlman)
* MySQL: More support for index definition in CREATE TABLE [3826](https://github.com/sqlfluff/sqlfluff/pull/3826) [yoichi](https://github.com/yoichi)
* Typed matching and ripping out the rest of .name [3819](https://github.com/sqlfluff/sqlfluff/pull/3819) [alanmcruickshank](https://github.com/alanmcruickshank)
* sparksql dialect to support lambda expressions (->) [3821](https://github.com/sqlfluff/sqlfluff/pull/3821) [juhoautio](https://github.com/juhoautio)
* Fixed broken main branch [3825](https://github.com/sqlfluff/sqlfluff/pull/3825) [alanmcruickshank](https://github.com/alanmcruickshank)
* Enable file name logging for multi-files w/ --show-lint-violations flag [3788](https://github.com/sqlfluff/sqlfluff/pull/3788) [thechopkins](https://github.com/thechopkins)
* Take database and schema out of Snowflake reserved keywords list [3818](https://github.com/sqlfluff/sqlfluff/pull/3818) [NiallRees](https://github.com/NiallRees)
* Remove a chunk of name references [3814](https://github.com/sqlfluff/sqlfluff/pull/3814) [alanmcruickshank](https://github.com/alanmcruickshank)
* Fix typo in Snowflake dialect [3813](https://github.com/sqlfluff/sqlfluff/pull/3813) [Gal40n04ek](https://github.com/Gal40n04ek)
* Allow the use of libraries in macro definitions [3803](https://github.com/sqlfluff/sqlfluff/pull/3803) [bjgbeelen](https://github.com/bjgbeelen)
* Indentation fixes and rule logging improvements [3808](https://github.com/sqlfluff/sqlfluff/pull/3808) [alanmcruickshank](https://github.com/alanmcruickshank)
* Fixes a recursion error in JinjaTemplater handling of undefined values [3809](https://github.com/sqlfluff/sqlfluff/pull/3809) [barrywhart](https://github.com/barrywhart)
* Snowflake: extend `GRANT` syntax [3807](https://github.com/sqlfluff/sqlfluff/pull/3807) [Gal40n04ek](https://github.com/Gal40n04ek)
* add warehouse_type in snowflake dialect [3805](https://github.com/sqlfluff/sqlfluff/pull/3805) [Gal40n04ek](https://github.com/Gal40n04ek)
* add Create Notification Integration syntax [3801](https://github.com/sqlfluff/sqlfluff/pull/3801) [Gal40n04ek](https://github.com/Gal40n04ek)
* T-SQL: fix parsing PARTITION BY NULL in window function [3790](https://github.com/sqlfluff/sqlfluff/pull/3790) [fmms](https://github.com/fmms)
* SparkSQL: Update L014 rule to not flag Delta Change Data Feed Session & Table Property [3689](https://github.com/sqlfluff/sqlfluff/pull/3689) [R7L208](https://github.com/R7L208)
* Snowflake: OVER (ORDER BY) clause required for first_value (fixes 3797) [3798](https://github.com/sqlfluff/sqlfluff/pull/3798) [JamesRTaylor](https://github.com/JamesRTaylor)
* add Alter Pipe syntax for snowflake dialect [3796](https://github.com/sqlfluff/sqlfluff/pull/3796) [Gal40n04ek](https://github.com/Gal40n04ek)
* BigQuery: Parse WEEK(<WEEKDAY>) in date_part [3787](https://github.com/sqlfluff/sqlfluff/pull/3787) [yoichi](https://github.com/yoichi)
* Postgres: Support setting user properties using intrinsic ON & OFF values [3793](https://github.com/sqlfluff/sqlfluff/pull/3793) [chris-codaio](https://github.com/chris-codaio)
* extend SF dialect for File Format statements [3774](https://github.com/sqlfluff/sqlfluff/pull/3774) [Gal40n04ek](https://github.com/Gal40n04ek)
* Add QUALIFY to SparkSQL dialect [3778](https://github.com/sqlfluff/sqlfluff/pull/3778) [ThijsKoot](https://github.com/ThijsKoot)
* fix regex for S3Path [3782](https://github.com/sqlfluff/sqlfluff/pull/3782) [Gal40n04ek](https://github.com/Gal40n04ek)
* Snowflake: add Optional parameter ERROR INTEGRATION for PIPE [3785](https://github.com/sqlfluff/sqlfluff/pull/3785) [Gal40n04ek](https://github.com/Gal40n04ek)
* Add a file size check in bytes [3770](https://github.com/sqlfluff/sqlfluff/pull/3770) [alanmcruickshank](https://github.com/alanmcruickshank)
* Require importlib_metadata >=1.0.0 [3769](https://github.com/sqlfluff/sqlfluff/pull/3769) [alanmcruickshank](https://github.com/alanmcruickshank)

New Contributors

* [Gal40n04ek](https://github.com/Gal40n04ek) made their first contribution in [#3785](https://github.com/sqlfluff/sqlfluff/pull/3785)
* [ThijsKoot](https://github.com/ThijsKoot) made their first contribution in [#3778](https://github.com/sqlfluff/sqlfluff/pull/3778)
* [chris-codaio](https://github.com/chris-codaio) made their first contribution in [#3793](https://github.com/sqlfluff/sqlfluff/pull/3793)
* [JamesRTaylor](https://github.com/JamesRTaylor) made their first contribution in [#3798](https://github.com/sqlfluff/sqlfluff/pull/3798)
* [fmms](https://github.com/fmms) made their first contribution in [#3790](https://github.com/sqlfluff/sqlfluff/pull/3790)
* [bjgbeelen](https://github.com/bjgbeelen) made their first contribution in [#3803](https://github.com/sqlfluff/sqlfluff/pull/3803)
* [thechopkins](https://github.com/thechopkins) made their first contribution in [#3788](https://github.com/sqlfluff/sqlfluff/pull/3788)