mirror of
https://github.com/postgres/postgres.git
synced 2026-02-03 20:40:14 -05:00
d809fd0008
There are a couple of places in our grammar that fail to be strict LALR(1), by requiring more than a single token of lookahead to decide what to do. Up to now we've dealt with that by using a filter between the lexer and parser that merges adjacent tokens into one in the places where two tokens of lookahead are necessary. But that creates a number of user-visible anomalies, for instance that you can't name a CTE "ordinality" because "WITH ordinality AS ..." triggers folding of WITH and ORDINALITY into one token. I realized that there's a better way. In this patch, we still do the lookahead basically as before, but we never merge the second token into the first; we replace just the first token by a special lookahead symbol when one of the lookahead pairs is seen. This requires a couple extra productions in the grammar, but it involves fewer special tokens, so that the grammar tables come out a bit smaller than before. The filter logic is no slower than before, perhaps a bit faster. I also fixed the filter logic so that when backing up after a lookahead, the current token's terminator is correctly restored; this eliminates some weird behavior in error message issuance, as is shown by the one change in existing regression test outputs. I believe that this patch entirely eliminates odd behaviors caused by lookahead for WITH. It doesn't really improve the situation for NULLS followed by FIRST/LAST unfortunately: those sequences still act like a reserved word, even though there are cases where they should be seen as two ordinary identifiers, eg "SELECT nulls first FROM ...". I experimented with additional grammar hacks but couldn't find any simple solution for that. Still, this is better than before, and it seems much more likely that we *could* somehow solve the NULLS case on the basis of this filter behavior than the previous one. |
||
|---|---|---|
| .. | ||
| .gitignore | ||
| analyze.h | ||
| gramparse.h | ||
| keywords.h | ||
| kwlist.h | ||
| parse_agg.h | ||
| parse_clause.h | ||
| parse_coerce.h | ||
| parse_collate.h | ||
| parse_cte.h | ||
| parse_expr.h | ||
| parse_func.h | ||
| parse_node.h | ||
| parse_oper.h | ||
| parse_param.h | ||
| parse_relation.h | ||
| parse_target.h | ||
| parse_type.h | ||
| parse_utilcmd.h | ||
| parser.h | ||
| parsetree.h | ||
| scanner.h | ||
| scansup.h | ||