/usr/local/lib/python3.6/site-packages/jinja2/__pycache__
Edit: /usr/local/lib/python3.6/site-packages/jinja2/__pycache__/lexer.cpython-36.pyc (19983B)
3
^TBgt @ s U d Z ddlZddlZddlmZ ddlmZ ddlm Z ddl
m Z ddl
mZ dd lmZ ejrxddlZdd
lmZ ed Zejejd f ejd
ZejdZejdej Z ejdej ej B Z ejdej ej B Z!e dZ"e dZ#e dZ$e dZ%e dZ&e dZ'e dZ(e dZ)e dZ*e dZ+e d Z,e d Z-e d Z.e d Z/e d Z0e d!Z1e d"Z2e d#Z3e d$Z4e d%Z5e d&Z6e d'Z7e d(Z8e d)Z9e d*Z:e d+Z;e d,Z
e d/Z?e d0Z@e d1ZAe d2ZBe d3ZCe d4ZDe d5ZEe d6ZFe d7ZGe d8ZHe d9ZIe d:ZJe d;ZKe d<ZLe d=ZMe d>ZNe d?ZOe d@ZPe dAZQe dBZRe"e:e&e)e2e1e5e;e-e7e.e8e,e6e(e3e*e+e/e0e#e'e$e4e%e9dCZSdDdE eSjT D ZUeVeSeVeUkstWdFejdGdHjXdIdJ eYeSdKdL dMD dNZZe[eHeJeIez>= s r> zoperators droppedr- r6 c c s | ]}t j|V qd S )N)reescape)r: xr9 r9 r= s rB c C s
t | S )N)len)rA r9 r9 r= s rD )keyr. )
token_typereturnc C sL | t krt | S tdtdtdtdtdtdtdtdt dt
d t d
t d i j
| | S ) Nzbegin of commentzend of commentr! zbegin of statement blockzend of statement blockzbegin of print statementzend of print statementzbegin of line statementzend of line statementztemplate data / textzend of template)reverse_operatorsTOKEN_COMMENT_BEGINTOKEN_COMMENT_END
TOKEN_COMMENTTOKEN_LINECOMMENTTOKEN_BLOCK_BEGINTOKEN_BLOCK_ENDTOKEN_VARIABLE_BEGINTOKEN_VARIABLE_ENDTOKEN_LINESTATEMENT_BEGINTOKEN_LINESTATEMENT_END
TOKEN_DATA TOKEN_EOFget)rF r9 r9 r= _describe_token_type s rV Token)tokenrG c C s | j tkr| jS t| j S )z#Returns a description of the token.)type
TOKEN_NAMEvaluerV )rX r9 r9 r= describe_token s
r\ )exprrG c C s2 d| kr&| j dd\}}|tkr*|S n| }t|S )z0Like `describe_token` but for token expressions.r5 r )splitrZ rV )r] rY r[ r9 r9 r= describe_token_expr s r_ )r[ rG c C s t tj| S )zsCount the number of newline characters in the string. This is
useful for extensions that filter a stream.
)rC
newline_refindall)r[ r9 r9 r= count_newlines s rb r ) environmentrG c C s t j}t| jt|| jft| jt|| jft| jt|| jfg}| j dk rp|j
t| j t d|| j f | j dk r|j
t| j t
d|| j f dd t|ddD S )zACompiles all the rules from the environment into a list of rules.Nz ^[ \t\v]*z(?:^|(?<=\S))[^\S\r\n]*c S s g | ]}|d d qS )r Nr9 )r: rA r9 r9 r=
s z!compile_rules..T)reverse)r? r@ rC comment_start_stringrI block_start_stringrM variable_start_stringrO line_statement_prefixappendrQ line_comment_prefixTOKEN_LINECOMMENT_BEGINsorted)rc erulesr9 r9 r=
compile_rules s*
rp c @ s> e Zd ZdZefeeje ddddZe edddd Z
dS )
FailurezjClass that raises a `TemplateSyntaxError` if called.
Used by the `Lexer` to specify known errors.
N)messageclsrG c C s || _ || _d S )N)rr error_class)selfrr rs r9 r9 r= __init__ s zFailure.__init__z te.NoReturn)linenofilenamerG c C s | j | j||d S )N)rt rr )ru rw rx r9 r9 r= __call__ s zFailure.__call__) __name__
__module__ __qualname____doc__r strtTyperv intry r9 r9 r9 r= rq s rq c @ sH e Zd ZU eeeedddZee dddZ
ee ddd Z d
S ) rW )rG c C s t | S )N)r\ )ru r9 r9 r= __str__ s z
Token.__str__)r] rG c C s2 | j |krdS d|kr.|jdd| j | jgkS dS )zTest a token against a token expression. This can either be a
token type or ``'token_type:token_value'``. This can only test
against string values and types.
Tr5 r F)rY r^ r[ )ru r] r9 r9 r= test s
z
Token.test)iterablerG c s t fdd|D S )z(Test against multiple token expressions.c 3 s | ]} j |V qd S )N)r )r: r] )ru r9 r= rB $ s z!Token.test_any..)any)ru r r9 )ru r= test_any" s zToken.test_anyN) rz r{ r| r rw r~ rY r[ r boolr r r9 r9 r9 r= rW s
c @ s< e Zd ZdZdddddZd ddd Zedd
d ZdS ) TokenStreamIteratorz`The iterator for tokenstreams. Iterate over the stream
until the eof token is reached.
TokenStreamN)streamrG c C s
|| _ d S )N)r )ru r r9 r9 r= rv , s z TokenStreamIterator.__init__)rG c C s | S )Nr9 )ru r9 r9 r= __iter__/ s z TokenStreamIterator.__iter__c C s. | j j}|jtkr | j j tt| j |S )N)r currentrY rT close
StopIterationnext)ru rX r9 r9 r= __next__2 s
z TokenStreamIterator.__next__)rz r{ r| r} rv r rW r r9 r9 r9 r= r ' s r c @ s e Zd ZdZeje eje eje dddZ e
dddZ e ddd Z
ee dd
d Zed d
ddZedddZd!ed dddZeeje dddZee dddZeddd Zd dd d Zeedd d Zd S )"r zA token stream is an iterable that yields :class:`Token`\s. The
parser however does not iterate over it but calls :meth:`next` to go
one token ahead. The current active token is stored as :attr:`current`.
) generatorr rx c C s> t || _t | _|| _|| _d| _tdtd| _ t
| d S )NFr ) iter_iterr _pushedr rx closedrW
TOKEN_INITIALr r )ru r r rx r9 r9 r= rv C s
zTokenStream.__init__)rG c C s t | S )N)r )ru r9 r9 r= r Q s zTokenStream.__iter__c C s t | jp| jjtk S )N)r r r rY rT )ru r9 r9 r= __bool__T s zTokenStream.__bool__c C s | S )z Are we at the end of the stream?r9 )ru r9 r9 r= eosW s zTokenStream.eosN)rX rG c C s | j j| dS )z Push a token back to the stream.N)r rj )ru rX r9 r9 r= push\ s zTokenStream.pushc C s" t | }| j}| j| || _|S )zLook at the next token.)r r r )ru Z old_tokenresultr9 r9 r= look` s
zTokenStream.lookr )nrG c C s xt |D ] }t| q
W dS )zGot n tokens ahead.N)ranger )ru r _r9 r9 r= skiph s zTokenStream.skip)r] rG c C s | j j|rt| S dS )zqPerform the token test and return the token if it matched.
Otherwise the return value is `None`.
N)r r r )ru r] r9 r9 r= next_ifm s zTokenStream.next_ifc C s | j |dk S )z8Like :meth:`next_if` but only returns `True` or `False`.N)r )ru r] r9 r9 r= skip_ifv s zTokenStream.skip_ifc C sX | j }| jr| jj | _ n:| j jtk rTyt| j| _ W n tk
rR | j Y nX |S )z|Go one token ahead and return the old one.
Use the built-in :func:`next` instead of calling this directly.
) r r popleftrY rT r r r r )ru rvr9 r9 r= r z s zTokenStream.__next__c C s& t | jjtd| _tf | _d| _dS )zClose the stream.r TN)rW r rw rT r r r )ru r9 r9 r= r s
zTokenStream.closec C sn | j j|sft|}| j jtkr>td|d| j j| j| jtd|dt | j | j j| j| jt
| S )z}Expect a given token type and return it. This accepts the same
argument as :meth:`jinja2.lexer.Token.test`.
z%unexpected end of template, expected r4 zexpected token z, got ) r r r_ rY rT r rw r rx r\ r )ru r] r9 r9 r= expect s
zTokenStream.expect)r )rz r{ r| r} r IterablerW Optionalr~ rv r r r r propertyr r r r r r r r r r r9 r9 r9 r= r = s
r c C sZ | j | j| j| j| j| j| j| j| j| j | j
| j f }t j
|}|dkrVt| t |< }|S )z(Return a lexer which is probably cached.N)rg block_end_stringrh variable_end_stringrf comment_end_stringri rk trim_blocks
lstrip_blocksnewline_sequencekeep_trailing_newline _lexer_cacherU r )rc rE lexerr9 r9 r= get_lexer s
r c s$ e Zd ZdZf Z fddZ ZS )OptionalLStripzWA special tuple for marking a point in the state that can have
lstrip applied.
c s t j| |S )N)super__new__)rs memberskwargs) __class__r9 r= r s zOptionalLStrip.__new__)rz r{ r| r} __slots__r
__classcell__r9 r9 )r r= r s r c @ sB e Zd ZU eje ejeejedf eje f
ej e dS )_Rule.N)
rz r{ r| r Patternr~ r UnionTuplerq tokensr commandr9 r9 r9 r= r s
r c
@ s e Zd ZdZdddddZeeddd Zdeeje eje eje e d
d d Z
dej ej e
eef eje eje eje d
ddZdeeje eje eje ejej e
eef d
ddZdS )r a
Class that implements a lexer for a given environment. Automatically
created by the environment class, usually you don't have to do that.
Note that the lexer is not automatically bound to an environment.
Multiple environments can share the same lexer.
r N)rc rG c
C s0 t j}ttjt ddd}tttd ttt d tt
t d tt t
d tttd tttd g}t|}||j}||j}||j}||j} |jrdnd}
|jr|dnd | _|j| _|j| _d| d| d | d
} d j | gd d
|D } dt|d| dt t ddt|dt d gt t|d| d| d | |
d
t t!fdt|dt"dfd gt#t|d| d| d | |
dt$dg| t%t|d| d | t&dg| t't|d| d| d| d | |
d
t t t(dt|dt"d fd gt)t|d t*dg| t+t|d t,t-fdgi| _.d S ) N)rA rG c S s t j| t jt jB S )N)r? compileMS)rA r9 r9 r= c s zLexer.__init__..cz\n?r z[^ \t]z(?Pz(\-|\+|)\s*raw\s*(?:\-z\s*|z))r6 c S s" g | ]\}}d | d| dqS )z(?P.rootz(.*?)(?:r. z#bygroupz.+z (.*?)((?:\+z|\-z#popz(.)zMissing end of comment tagz(?:\+z\-z (.*?)((?:z(\-|\+|))\s*endraw\s*(?:\+z Missing end of raw directivez \s*(\n|$)z(.*?)()(?=\n|$))/r? r@ r~ r r r
whitespace_reTOKEN_WHITESPACEfloat_re TOKEN_FLOAT
integer_re
TOKEN_INTEGERname_rerZ string_re TOKEN_STRING operator_reTOKEN_OPERATORrp rg r r r r r lstrip_unless_rer r joinr rS rI rK rJ rq rM rN rO rP TOKEN_RAW_BEGIN
TOKEN_RAW_ENDrQ rR rl rL TOKEN_LINECOMMENT_ENDro )
ru rc rn r Z tag_rulesZroot_tag_rulesZblock_start_reZ block_end_reZcomment_end_reZvariable_end_reZblock_suffix_reZ root_raw_reZ
root_parts_rer9 r9 r= rv sz
"zLexer.__init__)r[ rG c C s t j| j|S )z`Replace all newlines with the configured sequence in strings
and template data.
)r` r r )ru r[ r9 r9 r= _normalize_newlinesV s zLexer._normalize_newlines)sourcer rx staterG c C s& | j ||||}t| j|||||S )z:Calls tokeniter + tokenize and wraps it in a token stream.) tokeniterr wrap)ru r r rx r r r9 r9 r= tokenize\ s zLexer.tokenize)r r rx rG c
c sz xr|D ]h\}}}|t kr q|}|tkr2t}n2|tkrBt}n"|ttfkrTqn|tkrj| j|} n|dkrx|}n|t kr|}|j
st d|||n|t kry$| j|dd j
ddjd}W nJ tk
r } z,t|jdd
j } t | ||||W Y dd}~X nX nL|tkr6t|jd d
d }n.|tkrRt|jd d
}n|tkrdt| }t|||V qW dS )zThis is called with the stream as returned by `tokenize` and wraps
every token in a :class:`Token` and converts the value.
keywordz Invalid character in identifierr asciibackslashreplacezunicode-escaper5 Nr r r r )ignored_tokensrQ rM rR rN r r rS r rZ isidentifierr r encodedecode Exceptionr~ r^ stripr r replacer r r operatorsrW )
ru r r rx rw rX Z value_strr[ rn msgr9 r9 r= r g sD
$
z
Lexer.wrapc c sZ t j|ddd }| j r.|d! dkr.|d"= dj|}d}d}dg}|dk rt|dkrt|d#ksftd
|j|d | j|d$ } t|}
g } | j} d}
d }xx| D ]x\}}}|j ||}|dkrq| r|t
t t fkrqt
|tr|j }t
|tr|d }td
d |ddd D }|dkr^|j }|t|d jd}
|f|dd }nl|dkr| dk r|j jt r|jdd }|dks|r| j||s|d| f|dd }xt|D ]\}}|jtkr|||n|dkrPx|j j D ]0\}}|dk r |||fV ||jd7 }P q W t |dn:|| } | sh|t krt||| fV || jd|
7 }d}
qW n|j } |t kr:| dkr| jd n| dkr| jd nj| dkr| jd nT| d%kr:| s t!d| d|||| j" } | | kr:t!d| d| d|||| sJ|t krV||| fV || jd7 }|j d&d dk}|j# } |dk r|d kr|j" nV|dkrxJ|j j D ] \}}|dk r|j| P qW t |d n
|j| | j|d' } n| |kr t |d | }P qW ||
kr4dS t!d || d | |||qW dS )(a This method tokenizes the text and returns the tokens in a
generator. Use this method if you just want to tokenize a template.
.. versionchanged:: 3.0
Only ``\n``, ``\r\n`` and ``\r`` are treated as line
breaks.
N r r
r r variableblockz
invalid stateZ_beginTc s s | ]}|d k r|V qd S )Nr9 )r: gr9 r9 r= rB s z"Lexer.tokeniter..r& r% z#bygroupz= wanted to resolve the token dynamically but no group matchedr/ r0 r- r. r+ r, z unexpected ''z
', expected 'z#popzA wanted to resolve the new state dynamically but no group matchedz* yielded empty string without stack changezunexpected char z at r r )r r r )r0 r. r, r r )$r` r^ r r AssertionErrorrj ro rC r matchrP rN rR
isinstancetuplegroupsr r rstripcount groupdictrU rO rfindsearch enumerater rq items RuntimeErrorignore_if_emptygroupr r popend) ru r r rx r linesposrw stackZ statetokensZ
source_lengthZbalancing_stackr Znewlines_strippedZ
line_startingregexr Z new_statemr textZ
strip_signstrippedZl_posidxrX rE r[ r" Z expected_oppos2r9 r9 r= r s
zLexer.tokeniter)NNN)NN)NN)rz r{ r| r} rv r~ r r r r r r r r IteratorrW r r r9 r9 r9 r= r s y &5 )pr} r? Ztypingr Zastr collectionsr sysr Z _identifierr r
exceptionsr utilsr Z
TYPE_CHECKINGZtyping_extensionsterc r r MutableMappingr r r r` r r
IGNORECASEVERBOSEr r Z TOKEN_ADDZ TOKEN_ASSIGNZ TOKEN_COLONZ TOKEN_COMMAZ TOKEN_DIVZ TOKEN_DOTZTOKEN_EQZTOKEN_FLOORDIVZTOKEN_GTZ
TOKEN_GTEQZ TOKEN_LBRACEZTOKEN_LBRACKETZ TOKEN_LPARENZTOKEN_LTZ
TOKEN_LTEQZ TOKEN_MODZ TOKEN_MULZTOKEN_NEZ
TOKEN_PIPEZ TOKEN_POWZ TOKEN_RBRACEZTOKEN_RBRACKETZ TOKEN_RPARENZTOKEN_SEMICOLONZ TOKEN_SUBZ TOKEN_TILDEr r r rZ r r rM rN rO rP r r rI rJ rK rQ rR rl r rL rS r rT r r rH rC r r rm r frozensetr r r~ rV r\ r_ r rb ZListrp rq Z
NamedTuplerW r r r r r r r r9 r9 r9 r= s
*
) m