HEX
Server: Apache/2.4.52 (Ubuntu)
System: Linux spn-python 5.15.0-89-generic #99-Ubuntu SMP Mon Oct 30 20:42:41 UTC 2023 x86_64
User: arjun (1000)
PHP: 8.1.2-1ubuntu2.20
Disabled: NONE
$ pwd: /home/arjun/projects/env/lib/python3.10/site-packages/jinja2/__pycache__/
Upload Files
File: //home/arjun/projects/env/lib/python3.10/site-packages/jinja2/__pycache__/lexer.cpython-310.pyc
o

%wet�@sLUdZddlZddlZddlmZddlmZddlm	Z	ddl
mZddl
mZdd	lmZejr<ddlZdd
lmZed�Zejejdfed
<e�d�Ze�d�Ze�dej�Ze�dejej B�Z!e�dejej B�Z"e	d�Z#e	d�Z$e	d�Z%e	d�Z&e	d�Z'e	d�Z(e	d�Z)e	d�Z*e	d�Z+e	d�Z,e	d�Z-e	d�Z.e	d�Z/e	d �Z0e	d!�Z1e	d"�Z2e	d#�Z3e	d$�Z4e	d%�Z5e	d&�Z6e	d'�Z7e	d(�Z8e	d)�Z9e	d*�Z:e	d+�Z;e	d,�Z<e	d-�Z=e	d.�Z>e	d/�Z?e	d0�Z@e	d1�ZAe	d2�ZBe	d3�ZCe	d4�ZDe	d5�ZEe	d6�ZFe	d7�ZGe	d8�ZHe	d9�ZIe	d:�ZJe	d;�ZKe	d<�ZLe	d=�ZMe	d>�ZNe	d?�ZOe	d@�ZPe	dA�ZQe	dB�ZRe	dC�ZSidDe#�dEe;�dFe'�dGe*�dHe3�dIe2�dJe6�dKe<�dLe.�dMe8�dNe/�dOe9�dPe-�dQe7�dRe)�dSe4�dTe+�e,e0e1e$e(e%e5e&e:dU�	�ZTdVdW�eT�U�D�ZVeWeT�eWeV�k�s�JdX��e�dNdY�XdZd[�eYeTd\d]�d^�D���dO��ZZe[eIeKeJe=eNeOePg�Z\e[e=eQeKePg�Z]d_e^d`e^fdadb�Z_dcddd`e^fdedf�Z`dge^d`e^fdhdi�Zadje^d`ebfdkdl�Zcdmdnd`ejdeje^e^ffdodp�ZeGdqdr�dr�ZfGdsdd�ddejg�ZhGdtdu�du�ZiGdvdw�dw�Zjddxdy�ZkGdzd{�d{el�ZmGd|d}�d}ejg�ZnGd~d�d�ZodS)�z�Implements a Jinja / Python combination lexer. The ``Lexer`` class
is used to do some preprocessing. It filters out invalid operators like
the bitshift operators we don't allow in templates. It separates
template code and python code in expressions.
�N)�literal_eval)�deque)�intern�)�pattern)�TemplateSyntaxError)�LRUCache)�Environment�2�Lexer�_lexer_cachez\s+z(\r\n|\r|\n)z7('([^'\\]*(?:\\.[^'\\]*)*)'|"([^"\\]*(?:\\.[^"\\]*)*)")z�
    (
        0b(_?[0-1])+ # binary
    |
        0o(_?[0-7])+ # octal
    |
        0x(_?[\da-f])+ # hex
    |
        [1-9](_?\d)* # decimal
    |
        0(_?0)* # decimal zero
    )
    z�
    (?<!\.)  # doesn't start with a .
    (\d+_)*\d+  # digits, possibly _ separated
    (
        (\.(\d+_)*\d+)?  # optional fractional part
        e[+\-]?(\d+_)*\d+  # exponent part
    |
        \.(\d+_)*\d+  # required fractional part
    )
    �add�assign�colon�comma�div�dot�eq�floordiv�gt�gteq�lbrace�lbracket�lparen�lt�lteq�mod�mul�ne�pipe�pow�rbrace�rbracket�rparen�	semicolon�sub�tilde�
whitespace�float�integer�name�string�operator�block_begin�	block_end�variable_begin�variable_end�	raw_begin�raw_end�
comment_begin�comment_end�comment�linestatement_begin�linestatement_end�linecomment_begin�linecomment_end�linecomment�data�initial�eof�+�-�/z//�*�%z**�~�[�]�(�)�{�}z==z!=�>)	z>=�<z<=�=�.�:�|�,�;cCsi|]\}}||�qS�rR)�.0�k�vrRrR�E/home/arjun/projects/env/lib/python3.10/site-packages/jinja2/lexer.py�
<dictcomp>�srWzoperators droppedrOccs�|]}t�|�VqdS�N)�re�escape�rS�xrRrRrV�	<genexpr>���r]cCs
t|�SrX)�len�r\rRrRrV�<lambda>�s
ra)�key�
token_type�returncCsL|tvrt|Stdtdtdtdtdtdtdtdt	dt
d	td
tdi�
||�S)Nzbegin of commentzend of commentr5zbegin of statement blockzend of statement blockzbegin of print statementzend of print statementzbegin of line statementzend of line statementztemplate data / textzend of template)�reverse_operators�TOKEN_COMMENT_BEGIN�TOKEN_COMMENT_END�
TOKEN_COMMENT�TOKEN_LINECOMMENT�TOKEN_BLOCK_BEGIN�TOKEN_BLOCK_END�TOKEN_VARIABLE_BEGIN�TOKEN_VARIABLE_END�TOKEN_LINESTATEMENT_BEGIN�TOKEN_LINESTATEMENT_END�
TOKEN_DATA�	TOKEN_EOF�get)rcrRrRrV�_describe_token_type�s"�
�rs�token�TokencCs|jtkr|jSt|j�S)z#Returns a description of the token.)�type�
TOKEN_NAME�valuers)rtrRrRrV�describe_token�s

ry�exprcCs8d|vr|�dd�\}}|tkr|St|�S|}t|�S)z0Like `describe_token` but for token expressions.rNr)�splitrwrs)rzrvrxrRrRrV�describe_token_expr�s�r|rxcCstt�|��S)zsCount the number of newline characters in the string.  This is
    useful for extensions that filter a stream.
    )r_�
newline_re�findall)rxrRrRrV�count_newlines��r�environmentr	cCs�tj}t|j�t||j�ft|j�t||j�ft|j�t||j�fg}|j	dur8|�
t|j	�td||j	�f�|jdurM|�
t|j�t
d||j�f�dd�t|dd�D�S)zACompiles all the rules from the environment into a list of rules.Nz	^[ \t\v]*z(?:^|(?<=\S))[^\S\r\n]*cSsg|]}|dd��qS)rNrRr[rRrRrV�
<listcomp>�sz!compile_rules.<locals>.<listcomp>T)�reverse)rYrZr_�comment_start_stringrf�block_start_stringrj�variable_start_stringrl�line_statement_prefix�appendrn�line_comment_prefix�TOKEN_LINECOMMENT_BEGIN�sorted)r��e�rulesrRrRrV�
compile_rules�s:����
��
��r�c@sFeZdZdZefdedejeddfdd�Zde	d	edd
fdd�Z
dS)
�FailurezjClass that raises a `TemplateSyntaxError` if called.
    Used by the `Lexer` to specify known errors.
    �message�clsrdNcCs||_||_dSrX)r��error_class)�selfr�r�rRrRrV�__init__s
zFailure.__init__�lineno�filenamezte.NoReturncCs|�|j||��rX)r�r�)r�r�r�rRrRrV�__call__szFailure.__call__)�__name__�
__module__�__qualname__�__doc__r�str�t�Typer��intr�rRrRrRrVr��s���
�r�c@sXeZdZUeed<eed<eed<defdd�Zdedefdd	�Zd
edefdd�Z	d
S)rur�rvrxrdcC�t|�SrX)ry�r�rRrRrV�__str__�z
Token.__str__rzcCs2|j|krdSd|vr|�dd�|j|jgkSdS)z�Test a token against a token expression.  This can either be a
        token type or ``'token_type:token_value'``.  This can only test
        against string values and types.
        TrNrF)rvr{rx�r�rzrRrRrV�tests

z
Token.test�iterablecst�fdd�|D��S)z(Test against multiple token expressions.c3s�|]}��|�VqdSrX)r�)rSrzr�rRrVr]$r^z!Token.test_any.<locals>.<genexpr>)�any)r�r�rRr�rV�test_any"szToken.test_anyN)
r�r�r�r��__annotations__r�r��boolr�r�rRrRrRrVrus
c@s2eZdZdZddd�Zd
dd	�Zdefd
d�ZdS)�TokenStreamIteratorz`The iterator for tokenstreams.  Iterate over the stream
    until the eof token is reached.
    �stream�TokenStreamrdNcCs
||_dSrX)r�)r�r�rRrRrVr�,s
zTokenStreamIterator.__init__cCs|SrXrRr�rRrRrV�__iter__/szTokenStreamIterator.__iter__cCs.|jj}|jtur|j��t�t|j�|SrX)r��currentrvrq�close�
StopIteration�next�r�rtrRrRrV�__next__2s


zTokenStreamIterator.__next__)r�r�rdN)rdr�)r�r�r�r�r�r�rur�rRrRrRrVr�'s


r�c@s�eZdZdZdejedejedejefdd�Z	de
fdd	�Zdefd
d�Z
edefdd
��Zdeddfdd�Zdefdd�Zd#deddfdd�Zdedejefdd�Zdedefdd�Zdefdd�Zd$dd �Zdedefd!d"�ZdS)%r�z�A token stream is an iterable that yields :class:`Token`\s.  The
    parser however does not iterate over it but calls :meth:`next` to go
    one token ahead.  The current active token is stored as :attr:`current`.
    �	generatorr*r�cCs>t|�|_t�|_||_||_d|_tdtd�|_	t
|�dS)NFr�)�iter�_iterr�_pushedr*r��closedru�
TOKEN_INITIALr�r�)r�r�r*r�rRrRrVr�Cs
zTokenStream.__init__rdcCr�rX)r�r�rRrRrVr�Qr�zTokenStream.__iter__cCst|j�p
|jjtuSrX)r�r�r�rvrqr�rRrRrV�__bool__TszTokenStream.__bool__cCs|S)z Are we at the end of the stream?rRr�rRrRrV�eosWszTokenStream.eosrtNcCs|j�|�dS)z Push a token back to the stream.N)r�r�r�rRrRrV�push\szTokenStream.pushcCs"t|�}|j}|�|�||_|S)zLook at the next token.)r�r�r�)r��	old_token�resultrRrRrV�look`s

zTokenStream.lookr�ncCst|�D]}t|�qdS)zGot n tokens ahead.N)�ranger�)r�r��_rRrRrV�skiphs
�zTokenStream.skiprzcCs|j�|�r
t|�SdS)zqPerform the token test and return the token if it matched.
        Otherwise the return value is `None`.
        N)r�r�r�r�rRrRrV�next_ifmszTokenStream.next_ifcCs|�|�duS)z8Like :meth:`next_if` but only returns `True` or `False`.N)r�r�rRrRrV�skip_ifvszTokenStream.skip_ifcCs\|j}|jr|j��|_|S|jjtur,z	t|j�|_W|Sty+|��Y|Sw|S)z|Go one token ahead and return the old one.

        Use the built-in :func:`next` instead of calling this directly.
        )	r�r��popleftrvrqr�r�r�r�)r��rvrRrRrVr�zs��
�zTokenStream.__next__cCs&t|jjtd�|_td�|_d|_dS)zClose the stream.r�rRTN)rur�r�rqr�r�r�r�rRrRrVr��s

zTokenStream.closecCsn|j�|�s3t|�}|jjturtd|�d�|jj|j|j��td|�dt	|j���|jj|j|j��t
|�S)z}Expect a given token type and return it.  This accepts the same
        argument as :meth:`jinja2.lexer.Token.test`.
        z%unexpected end of template, expected rMzexpected token z, got )r�r�r|rvrqrr�r*r�ryr�r�rRrRrV�expect�s 
��zTokenStream.expect)r)rdN)r�r�r�r�r��Iterableru�Optionalr�r�r�r�r�r��propertyr�r�r�r�r�r�r�r�r�r�rRrRrRrVr�=s*��
�	
r�cCsZ|j|j|j|j|j|j|j|j|j|j	|j
|jf}t�
|�}|dur+t|�t|<}|S)z(Return a lexer which is probably cached.N)r��block_end_stringr��variable_end_stringr��comment_end_stringr�r��trim_blocks�
lstrip_blocks�newline_sequence�keep_trailing_newlinerrrr)r�rb�lexerrRrRrV�	get_lexer�s"�
r�cs$eZdZdZdZ�fdd�Z�ZS)�OptionalLStripzWA special tuple for marking a point in the state that can have
    lstrip applied.
    rRcst��||�SrX)�super�__new__)r��members�kwargs��	__class__rRrVr��szOptionalLStrip.__new__)r�r�r�r��	__slots__r��
__classcell__rRrRr�rVr��sr�c@sNeZdZUejeed<ejeejedfeje	fed<ej
eed<dS)�_Ruler.�tokens�commandN)r�r�r�r��Patternr�r��Union�Tupler�r�rRrRrRrVr��s
$r�c@s�eZdZdZddd�Zdedefd	d
�Z			ddedejed
ejedejede	f
dd�Z
		ddejeje
eefdejed
ejedejefdd�Z		ddedejed
ejedejedejeje
eeff
dd�ZdS)ra
Class that implements a lexer for a given environment. Automatically
    created by the environment class, usually you don't have to do that.

    Note that the lexer is not automatically bound to an environment.
    Multiple environments can share the same lexer.
    r�r	rdNc
Cs&tj}dtdtjtfdd�}tttd�ttt	d�tt
td�ttt
d�tttd�tttd�g}t|�}||j�}||j�}||j�}||j�}	|jrLdnd}
|j|_|j|_|j|_d|�d|�d	|�d
�}d�|gdd
�|D��}dt|d|�d��ttd�d�t|d�td�gtt|d|�d|�d	|�|
�d
��tt fd�t|d�t!d�fd�gt"t|d|�d|�d	|�|
�d��t#d�g|t$t|d|	�d	|	���t%d�g|t&t|d|�d|�d|�d	|�|
�d
�
�ttt'�d�t|d�t!d�fd�gt(t|d�t)d�g|t*t|d�t+t,fd�gi|_-dS)Nr\rdcSst�|tjtjB�SrX)rY�compile�M�Sr`rRrRrV�c�szLexer.__init__.<locals>.cz\n?r�z(?P<raw_begin>z(\-|\+|)\s*raw\s*(?:\-z\s*|z))rOcSs"g|]
\}}d|�d|�d��qS)z(?P<rJz	(\-|\+|))rR)rSr��rrRrRrVr�s"z"Lexer.__init__.<locals>.<listcomp>�rootz(.*?)(?:rG�#bygroupz.+z(.*?)((?:\+z|\-�#popz(.)zMissing end of comment tagz(?:\+z\-z	(.*?)((?:z(\-|\+|))\s*endraw\s*(?:\+zMissing end of raw directivez	\s*(\n|$)z(.*?)()(?=\n|$)).rYrZr�r�r�r��
whitespace_re�TOKEN_WHITESPACE�float_re�TOKEN_FLOAT�
integer_re�
TOKEN_INTEGER�name_rerw�	string_re�TOKEN_STRING�operator_re�TOKEN_OPERATORr�r�r�r�r�r�r�r�r��joinr�rprfrhrgr�rjrkrlrm�TOKEN_RAW_BEGIN�
TOKEN_RAW_ENDrnror�ri�TOKEN_LINECOMMENT_ENDr�)
r�r�r�r��	tag_rules�root_tag_rules�block_start_re�block_end_re�comment_end_re�variable_end_re�block_suffix_re�root_raw_re�
root_parts_rerRrRrVr��s�





�



����������������
����	������	�
����
�zLexer.__init__rxcCst�|j|�S)z`Replace all newlines with the configured sequence in strings
        and template data.
        )r}r%r�)r�rxrRrRrV�_normalize_newlinesTr�zLexer._normalize_newlines�sourcer*r��statecCs&|�||||�}t|�|||�||�S)z:Calls tokeniter + tokenize and wraps it in a token stream.)�	tokeniterr��wrap)r�rr*r�rr�rRrRrV�tokenizeZszLexer.tokenizer�c
csT�|D]�\}}}|tvr
q|}|tkrt}n�|tkrt}n�|ttfvr$q|tkr.|�|�}nr|dkr5|}nk|t	krG|}|�
�sFtd|||��nY|tkr}z|�|dd���
dd��d�}WnBty|}zt|��d�d��}	t|	|||�|�d	}~ww|tkr�t|�d
d�d�}n|tkr�t|�d
d��}n|tkr�t|}t|||�Vqd	S)
z�This is called with the stream as returned by `tokenize` and wraps
        every token in a :class:`Token` and converts the value.
        �keywordzInvalid character in identifierr����ascii�backslashreplacezunicode-escaperNNr�r�r)�ignored_tokensrnrjrorkr�r�rprrw�isidentifierrr��encode�decode�	Exceptionr�r{�stripr�r��replacer�rr��	operatorsru)
r�r�r*r�r�rt�	value_strrxr��msgrRrRrVr
esR�	������z
Lexer.wrapccs"�t�|�ddd�}|js|ddkr|d=d�|�}d}d}dg}|dur:|dkr:|d	vs3Jd
��|�|d�|j|d}	t|�}
g}d}d}
	|	D�]�\}}}|�||�}|dur_qN|ri|tt	t
fvriqNt|t��r2|�
�}t|t�r�|d}td
d�|ddd�D��}|dkr�|��}|t|�d��d�}|g|dd��}n.|dkr�|jr�|���t�s�|�d�d}|dks�|
r�t�||�r�|d|�g|dd��}t|�D]W\}}|jtur�|||��|dk�r|����D]\}}|du�r
|||fV||�d�7}nq�t|�d���q�||}|�s|tv�r%|||fV||�d�|7}d}q�ni|��}|t k�r�|dk�rF|�d�n@|dk�rQ|�d�n5|dk�r\|�d�n*|dv�r�|�sot!d|�d�|||��|�"�}||k�r�t!d|�d|�d�|||��|�s�|tv�r�|||fV||�d�7}|��dd�dk}
|�#�}|du�r�|dk�r�|�"�n*|dk�r�|����D]\}}|du�r�|�|�n	�q�t|�d���n|�|�|j|d}	n||k�r�t|�d���|}n||
k�rdSt!d ||�d!|��|||��qL)"aThis method tokenizes the text and returns the tokens in a
        generator. Use this method if you just want to tokenize a template.

        .. versionchanged:: 3.0
            Only ``\n``, ``\r\n`` and ``\r`` are treated as line
            breaks.
        N�r
r��
rrr�)�variable�blockz
invalid state�_beginTcss�|]	}|dur|VqdSrXrR)rS�grRrRrVr]�s�z"Lexer.tokeniter.<locals>.<genexpr>r?r>r�z= wanted to resolve the token dynamically but no group matchedrHrIrFrGrDrE)rIrGrEzunexpected '�'z
', expected 'r�zA wanted to resolve the new state dynamically but no group matchedz* yielded empty string without stack changezunexpected char z at )$r}r{r�r�r�r�r_�matchrmrkro�
isinstance�tuple�groupsr�r��rstrip�countr��	groupdictrrrl�rfindr��	fullmatch�	enumerater�r��items�RuntimeError�ignore_if_empty�groupr�r�pop�end)r�rr*r�r�lines�posr��stack�statetokens�
source_length�balancing_stack�newlines_stripped�
line_starting�regexr��	new_state�mr$�text�
strip_sign�stripped�l_pos�idxrtrbrxr;�expected_op�pos2rRrRrVr	�s��
�
��



����




�
�





���

�
���zLexer.tokeniter)r�r	rdN)NNN)NN)r�r�r�r�r�r�rr�r�r�rr�r�r��Iteratorrur
r	rRrRrRrVr�sT
w	�����
�����
�:������)r�r	rdr)pr�rY�typingr��astr�collectionsr�sysr�_identifierrr��
exceptionsr�utilsr�
TYPE_CHECKING�typing_extensions�ter�r	r�MutableMappingr�r�r�r�r}r�r��
IGNORECASE�VERBOSEr�r��	TOKEN_ADD�TOKEN_ASSIGN�TOKEN_COLON�TOKEN_COMMA�	TOKEN_DIV�	TOKEN_DOT�TOKEN_EQ�TOKEN_FLOORDIV�TOKEN_GT�
TOKEN_GTEQ�TOKEN_LBRACE�TOKEN_LBRACKET�TOKEN_LPAREN�TOKEN_LT�
TOKEN_LTEQ�	TOKEN_MOD�	TOKEN_MUL�TOKEN_NE�
TOKEN_PIPE�	TOKEN_POW�TOKEN_RBRACE�TOKEN_RBRACKET�TOKEN_RPAREN�TOKEN_SEMICOLON�	TOKEN_SUB�TOKEN_TILDEr�r�r�rwr�r�rjrkrlrmr�r�rfrgrhrnror�r�rirpr�rqrr+rer_r�r�r��	frozensetrr-r�rsryr|r�r�Listr�r��
NamedTuplerur�r�r�r#r�r�rrRrRrRrV�<module>s.

�

�

���������	�
���
������&���
�
")
m

@ Telegram