k"gg`dZddlZddlmZddlmZddlmZmZddl m Z GddZ d d Z y) z SQL LexerN)Lock) TextIOBase)tokenskeywords)consumecXeZdZdZdZeZedZdZ dZ dZ dZ dZ d d Zy) LexerzrThe Lexer supports configurable syntax. To add support for additional keywords, use the `add_keywords` method.Nc|j5|j&||_|jjddd|jS#1swY|jSxYw)zRReturns the lexer instance used internally by the sqlparse core functions.N)_lock_default_instancedefault_initialization)clss G/var/www/html/djangosite/lib/python3.12/site-packages/sqlparse/lexer.pyget_default_instancezLexer.get_default_instance0s_YY ?$$,(+%%%<<> ?$$$  ?$$$s 3AA(c|j|jtj|j tj |j tj |j tj|j tj|j tj|j tj|j tj|j tj|j tjy)zlInitialize the lexer with default dictionaries. Useful if you need to revert custom syntax settings.N)clear set_SQL_REGEXr SQL_REGEX add_keywordsKEYWORDS_COMMONKEYWORDS_ORACLEKEYWORDS_MYSQLKEYWORDS_PLPGSQL KEYWORDS_HQLKEYWORDS_MSACCESSKEYWORDS_SNOWFLAKEKEYWORDS_BIGQUERYKEYWORDSselfs rr zLexer.default_initialization:s  8--. (223 (223 (112 (334 (//0 (445 (556 (445 (++,c g|_g|_y)zClear all syntax configurations. Useful if you want to load a reduced set of syntax configurations. After this call, regexps and keyword dictionaries need to be loaded to make the lexer functional again.N) _SQL_REGEX _keywordsrs rrz Lexer.clearIs r!ctjtjz}|Dcgc]'\}}tj||j|f)c}}|_ycc}}w)z.Set the list of regex that will parse the SQL.N)re IGNORECASEUNICODEcompilematchr#)r rFLAGSrxtts rrzLexer.set_SQL_REGEXQsO  *$ BZZE " ( (" -  s,Ac:|jj|y)zhAdd keyword dictionaries. Keywords are looked up in the same order that dictionaries were added.N)r$append)r rs rrzLexer.add_keywordsYs h'r!c|j}|jD]}||vs|||fcStj|fS)zChecks for a keyword. If the given value is in one of the KEYWORDS_* dictionary it's considered a keyword. Otherwise, tokens.Name is returned. )upperr$rName)r valuevalkwdicts r is_keywordzLexer.is_keyword^sI kkmnn &Ff}c{E)) &;;% %r!c#Kt|tr|j}t|trnZt|tr'|r|j |}n6 |j d}n#tdjt|t|}|D]\}}|jD]\}}|||}|st|tjr||jfn3|tj ur!|j#|jt%||j'|z dz tj(|fy#t $r|j d}YwxYww)a Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined. Also preprocess the text, i.e. expand tabs and strip it if wanted and applies registered filters. Split ``text`` into (tokentype, text) pairs. ``stack`` is the initial stack (default: ``['root']``) zutf-8zunicode-escapez+Expected text or file-like object, got {!r}N) isinstancerreadstrbytesdecodeUnicodeDecodeError TypeErrorformattype enumerater#r _TokenTypegrouprPROCESS_AS_KEYWORDr6rendError) r textencodingiterableposcharrexmatchactionms r get_tokenszLexer.get_tokensksP dJ '99;D dC  e ${{8,9;;w/DI"F4:.0 0T?! )IC$(OO ) &T3'(9(9: !'')++x::://!'')44!%%'C-!"34 )llD(( )*9;;'78D9s+AE;E*C1E;E85E;7E88E;N)__name__ __module__ __qualname____doc__r rr classmethodrr rrrr6rPr!rr r sIN FE(%% - ( &-)r!r cJtjj||S)zTokenize sql. Tokenize *sql* using the :class:`Lexer` and return a 2-tuple stream of ``(token type, value)`` items. )r rrP)sqlrIs rtokenizerZs  % % ' 2 23 AAr!rQ) rUr& threadingriorsqlparserrsqlparse.utilsrr rZrWr!rr_s. %"A)A)HBr!