�
,�]c @` s� d Z d d l m Z d d l m Z d d l m Z d d l m Z d d l m Z m Z m Z m
Z
m Z d d l Z d d l
m Z m Z d d l m Z m Z d d
l m Z d d l m Z d d l m Z e d
� Z e e d � BZ e d � Z e e BZ e e d � Z e e d � Z e e d � Be d � Z e e BZ e e d � BZ! e! e BZ" e" e d � Z# d � Z$ d e% f d � � YZ& d e f d � � YZ' d e' f d � � YZ( d e' f d � � YZ) d e' f d � � YZ* d e' f d! � � YZ+ d" e( f d# � � YZ, d$ e' f d% � � YZ- d& e' f d' � � YZ. d( e' f d) � � YZ/ d* e' f d+ � � YZ0 d, e0 f d- � � YZ1 d. e( f d/ � � YZ2 d0 e' f d1 � � YZ3 d2 e' f d3 � � YZ4 d4 e' f d5 � � YZ5 d6 e' f d7 � � YZ6 d8 e' f d9 � � YZ7 d: e' f d; � � YZ8 d< e' f d= � � YZ9 d> e' f d? � � YZ: d@ e' f dA � � YZ; dB e' f dC � � YZ< dD e' f dE � � YZ= dF e' f dG � � YZ> dH e' f dI � � YZ? dJ e' f dK � � YZ@ dL e' f dM � � YZA dN e* f dO � � YZB dP e' f dQ � � YZC dR e' f dS � � YZD dT e' f dU � � YZE dV e' f dW � � YZF dX eF f dY � � YZG dZ e' f d[ � � YZH d\ e' f d] � � YZI d^ e' f d_ � � YZJ d` e' f da � � YZK db e' f dc � � YZL dd eL f de � � YZM df eL f dg � � YZN dh e' f di � � YZO dj e' f dk � � YZP dl e' f dm � � YZQ dn e f do � � YZR dp eR f dq � � YZS dr eR f ds � � YZT dt eS f du � � YZU eT d dv � ZV eT dw dx � ZW eT dy dz � ZX e jY d{ jZ d| j[ e � � � j\ Z] e jY d} jZ d| j[ e � j^ d~ d � j^ d� d� � � � j_ Z` e jY d� � ja Zb e jY d} jZ d| j[ e � j^ d~ d � j^ d� d� � � � j_ Zc e jY d} jZ d| j[ e" � j^ d~ d � j^ d� d� � � � j_ Zd e jY d} jZ d| j[ e# � j^ d~ d � j^ d� d� � � � j_ Ze d� � Zf d� � Zg d� � Zh d� � Zi d� � Zj d� � Zk d� � Zl d� � Zm d� � Zn d� � Zo d� � Zp d� � Zq d� � Zr d� � Zs d� � Zt d� � Zu d� � Zv d� � Zw d� � Zx d� � Zy d� � Zz d� � Z{ d� � Z| d� � Z} d� � Z~ d� � Z d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d� � Z� d S(� ul Header value parser implementing various email-related RFC parsing rules.
The parsing methods defined in this module implement various email related
parsing rules. Principal among them is RFC 5322, which is the followon
to RFC 2822 and primarily a clarification of the former. It also implements
RFC 2047 encoded word decoding.
RFC 5322 goes to considerable trouble to maintain backward compatibility with
RFC 822 in the parse phase, while cleaning up the structure on the generation
phase. This parser supports correct RFC 5322 generation by tagging white space
as folding white space only when folding is allowed in the non-obsolete rule
sets. Actually, the parser is even more generous when accepting input than RFC
5322 mandates, following the spirit of Postel's Law, which RFC 5322 encourages.
Where possible deviations from the standard are annotated on the 'defects'
attribute of tokens that deviate.
The general structure of the parser follows RFC 5322, and uses its terminology
where there is a direct correspondence. Where the implementation requires a
somewhat different structure than that used by the formal grammar, new terms
that mimic the closest existing terms are used. Thus, it really helps to have
a copy of RFC 5322 handy when studying this code.
Input to the parser is a string that has already been unfolded according to
RFC 5322 rules. According to the RFC this unfolding is the very first step, and
this parser leaves the unfolding step to a higher level message parser, which
will have already detected the line breaks that need unfolding while
determining the beginning and end of each header.
The output of the parser is a TokenList object, which is a list subclass. A
TokenList is a recursive data structure. The terminal nodes of the structure
are Terminal objects, which are subclasses of str. These do not correspond
directly to terminal objects in the formal grammar, but are instead more
practical higher level combinations of true terminals.
All TokenList and Terminal objects have a 'value' attribute, which produces the
semantically meaningful value of that part of the parse subtree. The value of
all whitespace tokens (no matter how many sub-tokens they may contain) is a
single space, as per the RFC rules. This includes 'CFWS', which is herein
included in the general class of whitespace tokens. There is one exception to
the rule that whitespace tokens are collapsed into single spaces in values: in
the value of a 'bare-quoted-string' (a quoted-string with no leading or
trailing whitespace), any whitespace that appeared between the quotation marks
is preserved in the returned value. Note that in all Terminal strings quoted
pairs are turned into their unquoted values.
All TokenList and Terminal objects also have a string value, which attempts to
be a "canonical" representation of the RFC-compliant form of the substring that
produced the parsed subtree, including minimal use of quoted pair quoting.
Whitespace runs are not collapsed.
Comment tokens also have a 'content' attribute providing the string found
between the parens (including any nested comments) with whitespace preserved.
All TokenList and Terminal objects have a 'defects' attribute which is a
possibly empty list all of the defects found while creating the token. Defects
may appear on any token in the tree, and a composite list of all defects in the
subtree is available through the 'all_defects' attribute of any node. (For
Terminal notes x.defects == x.all_defects.)
Each object in a parse tree is called a 'token', and each has a 'token_type'
attribute that gives the name from the RFC 5322 grammar that it represents.
Not all RFC 5322 nodes are produced, and there is one non-RFC 5322 node that
may be produced: 'ptext'. A 'ptext' is a string of printable ascii characters.
It is returned in place of lists of (ctext/quoted-pair) and
(qtext/quoted-pair).
XXX: provide complete list of token types.
i ( t print_function( t unicode_literals( t division( t absolute_import( t intt ranget strt supert listN( t
namedtuplet OrderedDict( t unquotet unquote_to_bytes( t _encoded_words( t errors( t utilsu u (u
()<>@,:;.\"[]u .u ."(u /?=u *'%u %c C` s* d t | � j d d � j d d � d S( Nu "u \u \\u \"( R t replace( t value( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt quote_stringd s t _Foldedc B` sA e Z d � Z d � Z d � Z d � Z d � Z d d � Z RS( c C` sF | | _ | | _ d | _ d | _ t | _ g | _ t � | _ d S( Ni (
t maxlent policyt lastlent Nonet stickyspacet Truet firstlinet doneR t current( t selfR R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt __init__m s c C` sC | j j | j � | j j | j j � | j j � d | _ d S( Ni ( R t extendR t appendR t linesept clearR ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt newlinev s
c C` s | j r | j � n d S( N( R R# ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt finalize| s c C` s d j | j � S( Nu ( t joinR ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt __str__� s c C` s | j j | � d S( N( R R ( R t stoken( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR � s c C` s� | d k r t | � } n t | � } | j d k r+t | j � } | j | | | j k r� | j j | j � | j | 7_ | j j | � | j | 7_ d | _ t | _ t
S| j r| j � } | d k r� | j t | � 7_ | t | � 7} n | j
| � t
S| r�| d | j k r�| j | } d | k oM| k n r�| | } | j j | j | � | j | | _ | } n | j � | j j | j � | j j | � | | | _ d | _ t | _ t
S| j s�| j � n | j j | j � | j j | � d | _ t | _ t
S| j | | j k rd| j j | � | j | 7_ t
S| | j k r�| j � | j j | � | | _ t
St S( Ni i ( R R t lenR R R R R t FalseR R t has_fwst pop_leading_fwst _foldR# ( R t tokenR' t lt stickyspace_lent wst margint trim( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt append_if_fits� sf
N( t __name__t
__module__R R# R$ R& R R R3 ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR k s t TokenListc B` s� e Z d Z d � Z d � Z d � Z e d � � Z e d � � Z e d � � Z
d � Z d � Z d � Z
e d � � Z d
� Z e d � � Z d � Z d
� Z d � Z d � Z d d � Z d d � Z d d � Z RS( c O` s& t t | � j | | � g | _ d S( N( R R6 R t defects( R t argst kw( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR � s c C` s d j d � | D� � S( Nu c s` s | ] } t | � Vq d S( N( R ( t .0t x( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s ( R% ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR& � s c C` s% d j | j j t t | � j � � S( Nu {}({})( t formatt __class__R4 R R6 t __repr__( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR> � s c C` s d j d � | D� � S( Nu c s` s! | ] } | j r | j Vq d S( N( R ( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s ( R% ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR � s c C` s t d � | D� | j � S( Nc s` s | ] } | j Vq d S( N( t all_defects( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s ( t sumR7 ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR? � s c c` s� | j } t � } x� | D]� } | j � rh | rh t | � d k rM | d n | | � V| j � qh n | j � } | j | � | r | | � V| g } q q W| r� t | � d k r� | d n | | � Vn d S( Ni i ( R= R t startswith_fwsR( R" t pop_trailing_wsR ( R t klasst thisR- t end_ws( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt parts� s
'
c C` s | d j � S( Ni ( RA ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRA s c C` s. | d j d k r | j d � S| d j � S( Ni u fws( t
token_typet popR+ ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR+ s
c C` s. | d j d k r | j d � S| d j � S( Ni����u cfws( RG RH RB ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRB s
c C` s" x | D] } | j r t Sq Wt S( N( R* R R) ( R t part( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR* s
c C` s | d j � S( Ni ( t has_leading_comment( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRJ " s c C` s+ g } x | D] } | j | j � q
W| S( N( R t comments( R RK R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRK % s
c K` sV | d } | d =| j p# t d � } t | | � } | j | � | j � t | � S( Nu policyu +inf( t max_line_lengtht floatR R, R$ R ( R t _3to2kwargsR R t folded( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt fold, s
c C` s� g } | j � } | r( | j | � n | d j d k rJ | j d � n d } | j t j t | � | � � | j | � d j | � S( Ni����u fwsu ( R+ R RG RH t _ewt encodeR R% ( R t charsett resR0 t trailer( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt as_encoded_word5 s (
c C` s= g } x' | D] } | j | j | | � � q
Wd j | � S( Nu ( R t
cte_encodeR% ( R RS R RT RI ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRW A s
c C` s7 x0| j D]%} t | � } t | � } y t | � j d � WnZ t k
r� t d � | j D� � rq d } n d } | j | | j � } t | � } n X| j | | � r� q
n | j
� } | d k r� t | j d � � | _
| j | � r� q
q� n | j r| j | � q
n | j | � | j � q
Wd S( Nu us-asciic s` s! | ] } t | t j � Vq d S( N( t
isinstanceR t UndecodableBytesDefect( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>N s u unknown-8bitu utf-8i ( RF R R( RR t UnicodeEncodeErrort anyR? RW R R3 R+ R RH R R* R, R R# ( R RO RI t tstrt tlenRS R0 ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR, G s0
u c C` s# t d j | j d d � � � d S( Nu
t indentu ( t printR% t _pp( R R^ ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt pprinti s c C` s d j | j d d � � S( Nu
R^ u ( R% R` ( R R^ ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt ppstrl s c c` s� d j | | j j | j � VxU | D]M } t | d � sN | d j | � Vq$ x | j | d � D] } | Vqb Wq$ W| j r� d j | j � } n d } d j | | � Vd S( Nu {}{}/{}(u _ppu* !! invalid element in token list: {!r}u u Defects: {}u u {}){}( R< R= R4 RG t hasattrR` R7 ( R R^ R- t linet extra( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR` o s
N( R4 R5 R RG R R& R> t propertyR R? RF RA R+ RB R* RJ RK RP RV RW R, Ra Rb R` ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR6 � s( + " t WhiteSpaceTokenListc B` s& e Z e d � � Z e d � � Z RS( c C` s d S( Nu ( ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR � s c C` s) g | D] } | j d k r | j ^ q S( Nu comment( RG t content( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRK � s ( R4 R5 Rf R RK ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRg � s t UnstructuredTokenListc B` s e Z d Z d � Z d � Z RS( u unstructuredc C` s3 t d � | D� � r# | j | � Sd } x| j D]�} t | � } t } y t | � j d � Wn� t k
r_t d � | j D� � r� d } n d } | d k rGt d j
| j | | g � � j | � } t
d � | j | D� � } t | � } t | � }
| |
| j k rG| j | 3| j | � | |
| _ q3 qGn | j | � } t } n X| j | | � r�| r3 t | j � d } q3 q3 n | s�| r�| j | � q3 n | j � } | d k r�t | � | _ | j | � r�q3 q�n | j r| j | � q3 n | j | � | j � d } q3 Wd S( Nc s` s | ] } | j d k Vq d S( u encoded-wordN( RG ( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s u us-asciic s` s! | ] } t | t j � Vq d S( N( RX R RY ( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s u unknown-8bitu utf-8u c s` s | ] } t | � Vq d S( N( R( ( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s i ( R[ t
_fold_encodedR RF R R) RR RZ R? t get_unstructuredR% R RV R@ R( R R R R R3 t _fold_as_ewR+ R R* RP R# ( R RO t last_ewRI R\ t is_ewRS t chunkt
oldlastlent schunkt lchunkR0 ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR, � sX
)
c C` s� g } d } x� | D]� } t | � } y | j d � | j | � Wq t k
r� | d k r� | j | j | | � � t | � } q� t d j | | | g � � } | j | j � � q Xq Wd j | � S( Nu us-asciiu (
R R RR R RZ RW R( Rk R% RV ( R RS R RT Rm RI t spartt tl( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRW � s
( R4 R5 RG R, RW ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRi � s 8t Phrasec B` s e Z d Z d � Z d � Z RS( u phrasec C` s< d } x/| j D]$} t | � } t | � } t } y t | � j d � Wnzt k
r�t d � | j D� � r} d } n d } | d k r�| j � r�| d j
d k r� | j r� | j d � } n d } x= t
| � D]/ \ } }
|
j
d k r� t |
� | | <q� q� Wt d j | j | | g � � j | � } t | � } t | � }
| |
| j k r�| j | 3| j | � t d � | j D� � | _ q q�n | j | � } t | � } t } n X| j | | � r'| r | j r t | j � d
} q | j s| j
d k r d } q q n | j | � q Wd S( Nu us-asciic s` s! | ] } t | t j � Vq d S( N( RX R RY ( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s u unknown-8bitu utf-8i����u cfwsu u bare-quoted-stringc s` s | ] } t | � Vq d S( N( R( ( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>
s i u
quoted-string( R RF R R( R) RR RZ R[ R? RJ RG RK RH t enumerateRi Rk R% R RV R R R@ R R R3 R, ( R RO Rm RI R\ R] t has_ewRS t remaindert iR- Ro Rq Rr ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR, � sL
)
c C` s� g } d } t } xs| D]k} t | � } y | j d � | j | � Wnt k
r[t } | d k r� | j s� t | � } n | j | j | | � � q\| j
� s\| d j d k r� | j r� | j d � } n d } x= t
| � D]/ \ } }
|
j d k r� t |
� | | <q� q� Wt d j | | | g � � } | j | � g | | )q\n X| j s{| r | j d k r d } q q Wd j | � S( Nu us-asciii����u cfwsu u bare-quoted-stringu
quoted-string( R R) R RR R RZ R RK R( RW RJ RG RH Rv Ri Rk R% RV ( R RS R RT Rm Rn RI Rs Rx Ry R- Rt ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRW s4
( R4 R5 RG R, RW ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRu � s >t Wordc B` s e Z d Z RS( u word( R4 R5 RG ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRz : s t CFWSListc B` s e Z d Z d � Z RS( u cfwsc C` s
t | j � S( N( t boolRK ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRJ C s ( R4 R5 RG RJ ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR{ ? s t Atomc B` s e Z d Z RS( u atom( R4 R5 RG ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR} G s t Tokenc B` s e Z d Z RS( u token( R4 R5 RG ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR~ L s t EncodedWordc B` s/ e Z d Z d Z d Z d Z e d � � Z RS( u encoded-wordc C` s3 | j d k r | j St j t | � | j � d S( N( t cteR RQ RR R RS ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt encodedX s N( R4 R5 RG R R� RS t langRf R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR Q s
t QuotedStringc B` s; e Z d Z e d � � Z e d � � Z e d � � Z RS( u
quoted-stringc C` s+ x$ | D] } | j d k r | j Sq Wd S( Nu bare-quoted-string( RG R ( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRh d s
c C` sY g } xC | D]; } | j d k r8 | j t | � � q
| j | j � q
Wd j | � S( Nu bare-quoted-stringu ( RG R R R R% ( R RT R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt quoted_valuej s
c C` s+ x$ | D] } | j d k r | j Sq Wd S( Nu bare-quoted-string( RG R ( R R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt stripped_valuet s
( R4 R5 RG Rf Rh R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� ` s
t BareQuotedStringc B` s& e Z d Z d � Z e d � � Z RS( u bare-quoted-stringc C` s t d j d � | D� � � S( Nu c s` s | ] } t | � Vq d S( N( R ( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s ( R R% ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR& s c C` s d j d � | D� � S( Nu c s` s | ] } t | � Vq d S( N( R ( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s ( R% ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR � s ( R4 R5 RG R& Rf R ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� { s t Commentc B` s> e Z d Z d � Z d � Z e d � � Z e d � � Z RS( u commentc C` sA d j t d g g | D] } | j | � ^ q d g g g � � S( Nu u (u )( R% R@ t quote( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR& � s
c C` sG | j d k r t | � St | � j d d � j d d � j d d � S( Nu commentu \u \\u (u \(u )u \)( RG R R ( R R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s
c C` s d j d � | D� � S( Nu c s` s | ] } t | � Vq d S( N( R ( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s ( R% ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRh � s c C` s
| j g S( N( Rh ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRK � s ( R4 R5 RG R& R� Rf Rh RK ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s
t AddressListc B` s; e Z d Z e d � � Z e d � � Z e d � � Z RS( u address-listc C` s& g | D] } | j d k r | ^ q S( Nu address( RG ( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt addresses� s c C` s t d � | D� g � S( Nc s` s' | ] } | j d k r | j Vq d S( u addressN( RG t mailboxes( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s ( R@ ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s c C` s t d � | D� g � S( Nc s` s' | ] } | j d k r | j Vq d S( u addressN( RG t
all_mailboxes( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>� s ( R@ ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s ( R4 R5 RG Rf R� R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t Addressc B` s; e Z d Z e d � � Z e d � � Z e d � � Z RS( u addressc C` s" | d j d k r | d j Sd S( Ni u group( RG t display_name( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s c C` s@ | d j d k r | d g S| d j d k r5 g S| d j S( Ni u mailboxu invalid-mailbox( RG R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s
c C` sG | d j d k r | d g S| d j d k r< | d g S| d j S( Ni u mailboxu invalid-mailbox( RG R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s
( R4 R5 RG Rf R� R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t MailboxListc B` s, e Z d Z e d � � Z e d � � Z RS( u mailbox-listc C` s& g | D] } | j d k r | ^ q S( Nu mailbox( RG ( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s c C` s& g | D] } | j d k r | ^ q S( Nu mailboxu invalid-mailbox( u mailboxu invalid-mailbox( RG ( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s
( R4 R5 RG Rf R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t GroupListc B` s, e Z d Z e d � � Z e d � � Z RS( u
group-listc C` s) | s | d j d k r g S| d j S( Ni u mailbox-list( RG R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s c C` s) | s | d j d k r g S| d j S( Ni u mailbox-list( RG R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s ( R4 R5 RG Rf R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t Groupc B` s; e Z d Z e d � � Z e d � � Z e d � � Z RS( u groupc C` s" | d j d k r g S| d j S( Ni u
group-list( RG R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s c C` s" | d j d k r g S| d j S( Ni u
group-list( RG R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s c C` s | d j S( Ni ( R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s ( R4 R5 RG Rf R� R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t NameAddrc B` sY e Z d Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z RS( u name-addrc C` s! t | � d k r d S| d j S( Ni i ( R( R R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s c C` s | d j S( Ni����( t
local_part( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s c C` s | d j S( Ni����( t domain( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s c C` s | d j S( Ni����( t route( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s c C` s | d j S( Ni����( t addr_spec( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s ( R4 R5 RG Rf R� R� R� R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s t AngleAddrc B` sJ e Z d Z e d � � Z e d � � Z e d � � Z e d � � Z RS( u
angle-addrc C` s+ x$ | D] } | j d k r | j Sq Wd S( Nu addr-spec( RG R� ( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s
c C` s+ x$ | D] } | j d k r | j Sq Wd S( Nu addr-spec( RG R� ( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� & s
c C` s+ x$ | D] } | j d k r | j Sq Wd S( Nu obs-route( RG t domains( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� , s
c C` s/ x( | D] } | j d k r | j Sq Wd Sd S( Nu addr-specu <>( RG R� ( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� 2 s
( R4 R5 RG Rf R� R� R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s
t ObsRoutec B` s e Z d Z e d � � Z RS( u obs-routec C` s) g | D] } | j d k r | j ^ q S( Nu domain( RG R� ( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� ? s ( R4 R5 RG Rf R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� ; s t Mailboxc B` sY e Z d Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z RS( u mailboxc C` s" | d j d k r | d j Sd S( Ni u name-addr( RG R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� H s c C` s | d j S( Ni ( R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� M s c C` s | d j S( Ni ( R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� Q s c C` s" | d j d k r | d j Sd S( Ni u name-addr( RG R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� U s c C` s | d j S( Ni ( R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� Z s ( R4 R5 RG Rf R� R� R� R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� D s t InvalidMailboxc B` s/ e Z d Z e d � � Z e Z Z Z Z RS( u invalid-mailboxc C` s d S( N( R ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� c s ( R4 R5 RG Rf R� R� R� R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� _ s t Domainc B` s e Z d Z e d � � Z RS( u domainc C` s d j t t | � j j � � S( Nu ( R% R R� R t split( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� n s ( R4 R5 RG Rf R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� j s t DotAtomc B` s e Z d Z RS( u dot-atom( R4 R5 RG ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s s t DotAtomTextc B` s e Z d Z RS( u
dot-atom-text( R4 R5 RG ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� x s t AddrSpecc B` sJ e Z d Z e d � � Z e d � � Z e d � � Z e d � � Z RS( u addr-specc C` s | d j S( Ni ( R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s c C` s! t | � d k r d S| d j S( Ni i����( R( R R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s c C` sJ t | � d k r | d j S| d j j � | d j | d j j � S( Ni i i i ( R( R t rstript lstrip( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR � s c C` sh t | j � } t | � t | t � k r= t | j � } n | j } | j d k rd | d | j S| S( Nu @( t setR� R( t
DOT_ATOM_ENDSR R� R ( R t namesett lp( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s ( R4 R5 RG Rf R� R� R R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� } s
t ObsLocalPartc B` s e Z d Z RS( u obs-local-part( R4 R5 RG ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t DisplayNamec B` s, e Z d Z e d � � Z e d � � Z RS( u display-namec C` s� t | � } | d j d k r/ | j d � n2 | d d j d k ra t | d d � | d <n | d j d k r� | j � n2 | d d j d k r� t | d d � | d <n | j S( Ni u cfwsi i����( R6 RG RH R ( R RT ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s
c C` s� t } | j r t } n) x& | D] } | j d k r t } q q W| r� d } } | d j d k s{ | d d j d k r� d } n | d j d k s� | d d j d k r� d } n | t | j � | St t | � j Sd S( Nu
quoted-stringu i u cfwsu i����( R) R7 R RG R R� R R� R ( R R� R; t pret post( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR � s
* * ( R4 R5 RG Rf R� R ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t LocalPartc B` s, e Z d Z e d � � Z e d � � Z RS( u
local-partc C` s- | d j d k r | d j S| d j Sd S( Ni u
quoted-string( RG R� R ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR � s c C` s
t g } t } t } x� | d t g D]� } | j d k rB q' n | r� | j d k r� | d j d k r� t | d � | d <n t | t � } | r� | j d k r� | d j d k r� | j t | d � � n
| j | � | d } | } q' Wt | d d !� } | j S( Ni u cfwsu doti����i ( t DOTR) RG R6 RX R R ( R RT t lastt
last_is_tlt tokt is_tl( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s$
( R4 R5 RG Rf R R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t
DomainLiteralc B` s, e Z d Z e d � � Z e d � � Z RS( u domain-literalc C` s d j t t | � j j � � S( Nu ( R% R R� R R� ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s c C` s+ x$ | D] } | j d k r | j Sq Wd S( Nu ptext( RG R ( R R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt ip� s
( R4 R5 RG Rf R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t MIMEVersionc B` s e Z d Z d Z d Z RS( u mime-versionN( R4 R5 RG R t majort minor( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t Parameterc B` s> e Z d Z e Z e Z d Z e d � � Z e d � � Z RS( u parameteru us-asciic C` s | j r | d j Sd S( Ni i ( t sectionedt number( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt section_number s c C` s� x� | D]x } | j d k r# | j S| j d k r xJ | D]? } | j d k r9 x' | D] } | j d k rU | j SqU Wq9 q9 Wq q Wd S( Nu valueu
quoted-stringu bare-quoted-stringu ( RG R� ( R R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt param_value s
(
R4 R5 RG R) R� t extendedRS Rf R� R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s t InvalidParameterc B` s e Z d Z RS( u invalid-parameter( R4 R5 RG ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s t Attributec B` s e Z d Z e d � � Z RS( u attributec C` s. x' | D] } | j j d � r | j Sq Wd S( Nu attrtext( RG t endswithR ( R R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� ' s
( R4 R5 RG Rf R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� # s t Sectionc B` s e Z d Z d Z RS( u sectionN( R4 R5 RG R R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� - s t Valuec B` s e Z d Z e d � � Z RS( u valuec C` sF | d } | j d k r& | d } n | j j d � r? | j S| j S( Ni u cfwsi u
quoted-stringu attributeu extended-attribute( u
quoted-stringu attributeu extended-attribute( RG R� R� R ( R R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� 7 s
( R4 R5 RG Rf R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� 3 s t MimeParametersc B` s& e Z d Z e d � � Z d � Z RS( u mime-parametersc c` s� t � } x� | D]} } | j j d � s. q n | d j d k rG q n | d j j � } | | k rs g | | <n | | j | j | f � q Wx^| j � D]P\ } } t | � } g } | d d j } xt
| � D]� \ } \ } } | | k r| j j t j
d � � n | j }
| j r�y t |
� }
Wn# t k
r[t |
d d �}
q�Xy |
j | d � }
Wn# t k
r�|
j d d � }
n Xt j |
� r�| j j t j � � q�n | j |
� q� Wd
j | � }
| |
f Vq� Wd S( Nu parameteri u attributei u* inconsistent multipart parameter numberingt encodingu latin-1u surrogateescapeu us-asciiu ( R
RG R� R t stripR R� t itemst sortedRS Rv R7 R t InvalidHeaderDefectR� R� R RZ R t decodet LookupErrorR t _has_surrogatesRY R% ( R t paramsR- t nameRF t value_partsRS Ry R� t paramR ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� F sB
c C` sv g } xL | j D]A \ } } | rD | j d j | t | � � � q | j | � q Wd j | � } | rr d | Sd S( Nu {}={}u ; u u ( R� R R< R R% ( R R� R� R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR& y s "( R4 R5 RG Rf R� R& ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� B s 3t ParameterizedHeaderValuec B` s& e Z e d � � Z e d � � Z RS( c C` s1 x* t | � D] } | j d k r
| j Sq
Wi S( Nu mime-parameters( t reversedRG R� ( R R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s c C` s< | r/ | d j d k r/ t | d | d � St | � j S( Ni����u mime-parameters( RG R6 RF ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRF � s ( R4 R5 Rf R� RF ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t ContentTypec B` s e Z d Z d Z d Z RS( u content-typeu textu plain( R4 R5 RG t maintypet subtype( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t ContentDispositionc B` s e Z d Z d Z RS( u content-dispositionN( R4 R5 RG R t content_disposition( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t ContentTransferEncodingc B` s e Z d Z d Z RS( u content-transfer-encodingu 7bit( R4 R5 RG R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t HeaderLabelc B` s e Z d Z RS( u header-label( R4 R5 RG ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t Headerc B` s e Z d Z d � Z RS( u headerc C` s� | j t | j d � � � t | j d � | _ | d j d k rZ t | j d � � n d | _ | j d � } | r� t d � � n | j | � d S( Ni u cfwsu u Malformed Header token list(
R R RH R( R R RG R t
ValueErrorR, ( R RO t rest( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR, � s 1( R4 R5 RG R, ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t Terminalc B` sq e Z d � Z d � Z e d � � Z d d � Z d � Z d � Z d � Z e d � � Z
d � Z d
� Z RS( c C` s1 t t | � j | | � } | | _ g | _ | S( N( R R� t __new__RG R7 ( t clsR RG R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s c C` s% d j | j j t t | � j � � S( Nu {}({})( R< R= R4 R R� R> ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR> � s c C` s
t | j � S( N( R R7 ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR? � s u c C` sO d j | | j j | j t t | � j � | j s9 d n d j | j � � g S( Nu
{}{}/{}({}){}u u {}( R< R= R4 RG R R� R> R7 ( R R^ ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR` � s c C` sF t | � } y | j d � | SWn t k
rA t j | | � SXd S( Nu us-ascii( R RR RZ RQ ( R RS R R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRW � s
c C` s d S( N( R ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRB � s c C` s d S( N( R ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR+ � s c C` s g S( N( ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRK � s c C` s t S( N( R) ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRJ � s c C` s t | � | j f S( N( R RG ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt __getnewargs__� s (
R4 R5 R� R> Rf R? R` RW RB R+ RK RJ R� ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t WhiteSpaceTerminalc B` s& e Z e d � � Z d � Z e Z RS( c C` s d S( Nu ( ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR � s c C` s t S( N( R ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRA s ( R4 R5 Rf R RA R R* ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� � s t
ValueTerminalc B` s/ e Z e d � � Z d � Z e Z d � Z RS( c C` s | S( N( ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR s c C` s t S( N( R) ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRA s c C` s t j t | � | � S( N( RQ RR R ( R RS ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRV s ( R4 R5 Rf R RA R) R* RV ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s t EWWhiteSpaceTerminalc B` s5 e Z e d � � Z e d � � Z d � Z e Z RS( c C` s d S( Nu ( ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR s c C` s | S( N( ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s c C` s d S( Nu ( ( R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR& s ( R4 R5 Rf R R� R& R R* ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR� s u dotu ,u list-separatoru @u route-component-markeru ([{}]+)u u [^{}]+u \u \\u ]u \]u [\x00-\x20\x7F]c C` s] t | � } | r. | j j t j | � � n t j | � rY | j j t j d � � n d S( u@ If input token contains ASCII non-printables, register a defect.u* Non-ASCII characters found in header tokenN( t _non_printable_finderR7 R R t NonPrintableDefectR R� RY ( t xtextt non_printables( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt _validate_xtextO s c C` s� t t | d � � } | d | d g \ } } g } t } t } x� t t | � � D]k } | | d k r� | r� t } t } q� t } qU n | r� t } n | | | k r� Pn | j | | � qU W| d } d j | � d j | | g | � | f S( uk Scan printables/quoted-pairs until endchars and return unquoted ptext.
This function turns a run of qcontent, ccontent-without-comments, or
dtext-with-quoted-printables into a single string by unquoting any
quoted printables. It returns the string, the remaining value, and
a flag that is True iff there were any quoted printables decoded.
i u \u ( R t
_wsp_splitterR) R R( R R R% ( R t endcharst _3to2listt fragmentRx t vcharst escapet had_qpt pos( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt _get_ptext_to_endcharsY s&
c
C` s� g } g } d } x� | r� y t | d � \ } } } Wn% t k
r^ | d d } } } n X| j d � oz | j d � s� d j | � | | | | | f St j | � \ } } } } | j | � | j | � | } q Wd j | � | | f S( u" Decode a run of RFC2047 encoded words.
_decode_ew_run(value) -> (text, value, defects)
Scans the supplied value for a run of tokens that look like they are RFC
2047 encoded words, decodes those words into text according to RFC 2047
rules (whitespace between encoded words is discarded), and returns the text
and the remaining value (including any leading whitespace on the remaining
value), as well as a list of any defects encountered while decoding. The
input value may not have any leading whitespace.
u i u =?u ?=( R� R� t
startswithR� R% RQ R� R R (
R RT R7 t last_wsR� R0 t textRS R� t new_defects( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt _decode_ew_runx s
"
c C` s9 | j � } t | t | � t | � d � } | | f S( u� FWS = 1*WSP
This isn't the RFC definition. We're using fws to represent tokens where
folding can be done, but when we are parsing the *un*folding has already
been done so we don't need to watch out for CRLF.
u fws( R� R� R( ( R t newvaluet fws( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_fws� s #c C` sm t � } | j d � s3 t j d j | � � � n t | d j d d � � } | d | d g \ } } | | d k r� t j d j | � � � n d j | � } | d j � r� t | j d d � � } | d | d g \ } } | d | } n t | j � � d k r,| j
j t j d � � n | | _
d j | � } y' t j d | d � \ } } }
} Wn, t k
r�t j d j | j
� � � n X| | _ |
| _ | j
j | � x� | rb| d t k r�t | � \ } } | j | � q�n t t | d � � }
|
d |
d g \ } } t | d
� } t | � | j | � d j | � } q�W| | f S( uE encoded-word = "=?" charset "?" encoding "?" encoded-text "?="
u =?u" expected encoded word but found {}i u ?=i u u whitespace inside encoded wordu! encoded word format invalid: '{}'i u vtext( R R� R t HeaderParseErrorR< R R� R% t isdigitR( R7 R R� R� RQ R� R� RS R� R t WSPR� R� R� R� ( R t ewt
_3to2list1R� Rx t remstrt
_3to2list3R� R� RS R� R7 R- t
_3to2list5t charst vtext( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_encoded_word� sN
'
c C` s� t � } x�| r�| d t k rG t | � \ } } | j | � q n | j d � r.y t | � \ } } Wn t j k
r� q.Xt } t | � d k r� | d j
d k r� | j j t j d � � t
} q� n | rt | � d k r| d j
d k rt | d d � | d <qn | j | � q n t t | d � � } | d | d g \ } } t | d � } t | � | j | � d
j | � } q W| S( uO unstructured = (*([FWS] vchar) *WSP) / obs-unstruct
obs-unstruct = *((*LF *CR *(obs-utext) *LF *CR)) / FWS)
obs-utext = %d0 / obs-NO-WS-CTL / LF / CR
obs-NO-WS-CTL is control characters except WSP/CR/LF.
So, basically, we have printable runs, plus control characters or nulls in
the obsolete syntax, separated by whitespace. Since RFC 2047 uses the
obsolete syntax in its specification, but requires whitespace on either
side of the encoded words, I can see no reason to need to separate the
non-printable-non-whitespace from the printable runs if they occur, so we
parse this into xtext tokens separated by WSP tokens.
Because an 'unstructured' value must by definition constitute the entire
value, this 'get' routine does not return a remaining value, only the
parsed TokenList.
i u =?i����u fwsu& missing whitespace before encoded wordi i����u encoded-wordu vtextu ( Ri R� R� R R� R R R� R R( RG R7 R� R) R� R R� R� R� R% ( R t unstructuredR- t have_wst
_3to2list7R� Rx R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyRk � s<
c C` s; t | d � \ } } } t | d � } t | � | | f S( u ctext = <printable ascii except \ ( )>
This is not the RFC ctext, since we are handling nested comments in comment
and unquoting quoted-pairs here. We allow anything except the '()'
characters, but if we find any ASCII other than the RFC defined printable
ASCII an NonPrintableDefect is added to the token's defects list. Since
quoted pairs are converted to their unquoted values, what is returned is
a 'ptext' token. In this case it is a WhiteSpaceTerminal, so it's value
is ' '.
u ()u ptext( R� R� R� ( R t ptextt _( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_qp_ctext s
c C` s; t | d � \ } } } t | d � } t | � | | f S( uo qcontent = qtext / quoted-pair
We allow anything except the DQUOTE character, but if we find any ASCII
other than the RFC defined printable ASCII an NonPrintableDefect is
added to the token's defects list. Any quoted pairs are converted to their
unquoted values, so what is returned is a 'ptext' token. In this case it
is a ValueTerminal.
u "u ptext( R� R� R� ( R R R ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_qcontent s
c C` sl t | � } | s- t j d j | � � � n | j � } | t | � } t | d � } t | � | | f S( u� atext = <matches _atext_matcher>
We allow any non-ATOM_ENDS in atext, but add an InvalidATextDefect to
the token's defects list if we find non-atext characters.
u expected atext but found '{}'u atext( t _non_atom_end_matcherR R� R< t groupR( R� R� ( R t mt atext( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_atext$ s
c C` s� | d d k r+ t j d j | � � � n t � } | d } x^ | r� | d d k r� | d t k r| t | � \ } } n t | � \ } } | j | � qA W| s� | j j t j d � � | | f S| | d f S( u� bare-quoted-string = DQUOTE *([FWS] qcontent) [FWS] DQUOTE
A quoted-string without the leading or trailing white space. Its
value is the text between the quote marks, with whitespace
preserved and quoted pairs decoded.
i u "u expected '"' but found '{}'i u" end of header inside quoted string(
R R� R< R� R� R� R R R7 R� ( R t bare_quoted_stringR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_bare_quoted_string4 s
c C` s | r1 | d d k r1 t j d j | � � � n t � } | d } x� | r� | d d k r� | d t k r� t | � \ } } n7 | d d k r� t | � \ } } n t | � \ } } | j | � qG W| s� | j j t j
d � � | | f S| | d f S( u� comment = "(" *([FWS] ccontent) [FWS] ")"
ccontent = ctext / quoted-pair / comment
We handle nested comments here, and quoted-pair in our qp-ctext routine.
i u (u expected '(' but found '{}'i u )u end of header inside comment( R R� R< R� R� R� t get_commentR R R7 R� ( R t commentR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR L s"
c C` st t � } x^ | ri | d t k ri | d t k rG t | � \ } } n t | � \ } } | j | � q W| | f S( u, CFWS = (1*([FWS] comment) [FWS]) / FWS
i ( R{ t CFWS_LEADERR� R� R R ( R t cfwsR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_cfwse s c C` s� t � } | rA | d t k rA t | � \ } } | j | � n t | � \ } } | j | � | r� | d t k r� t | � \ } } | j | � n | | f S( u� quoted-string = [CFWS] <bare-quoted-string> [CFWS]
'bare-quoted-string' is an intermediate class defined by this
parser and not by the RFC grammar. It is the quoted string
without any attached CFWS.
i ( R� R R R R ( R t
quoted_stringR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_quoted_stringr s
c C` s� t � } | rA | d t k rA t | � \ } } | j | � n | rr | d t k rr t j d j | � � � n t | � \ } } | j | � | r� | d t k r� t | � \ } } | j | � n | | f S( u" atom = [CFWS] 1*atext [CFWS]
i u expected atom but found '{}'( R} R R R t ATOM_ENDSR R� R< R
( R t atomR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_atom� s
c C` s� t � } | s | d t k r; t j d j | � � � n xi | r� | d t k r� t | � \ } } | j | � | r> | d d k r> | j t � | d } q> q> W| d t k r� t j d j d | � � � n | | f S( u( dot-text = 1*atext *("." 1*atext)
i u8 expected atom at a start of dot-atom-text but found '{}'u .i i����u4 expected atom at end of dot-atom-text but found '{}'( R� R R R� R< R
R R� ( R t
dot_atom_textR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_dot_atom_text� s
c C` s� t � } | d t k r; t | � \ } } | j | � n t | � \ } } | j | � | r� | d t k r� t | � \ } } | j | � n | | f S( u- dot-atom = [CFWS] dot-atom-text [CFWS]
i ( R� R R R R ( R t dot_atomR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_dot_atom� s
c C` s� | d t k r% t | � \ } } n d } | d d k rP t | � \ } } n= | d t k r{ t j d j | � � � n t | � \ } } | d k r� | g | d *n | | f S( u� word = atom / quoted-string
Either atom or quoted-string may start with CFWS. We have to peel off this
CFWS first to determine which type of word to parse. Afterward we splice
the leading CFWS, if any, into the parsed sub-token.
If neither an atom or a quoted-string is found before the next special, a
HeaderParseError is raised.
The token returned is either an Atom or a QuotedString, as appropriate.
This means the 'word' level of the formal grammar is not represented in the
parse tree; this is because having that extra layer when manipulating the
parse tree is more confusing than it is helpful.
i u "u1 Expected 'atom' or 'quoted-string' but found '{}'N( R R R R t SPECIALSR R� R< R ( R t leaderR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_word� s c C` sA t � } y# t | � \ } } | j | � Wn- t j k
r[ | j j t j d � � n Xx� | r6| d t k r6| d d k r� | j t � | j j t j d � � | d } q_ y t | � \ } } WnU t j k
r%| d t
k r t | � \ } } | j j t j d � � q&� n X| j | � q_ W| | f S( u� phrase = 1*word / obs-phrase
obs-phrase = word *(word / "." / CFWS)
This means a phrase can be a sequence of words, periods, and CFWS in any
order as long as it starts with at least one word. If anything other than
words is detected, an ObsoleteHeaderDefect is added to the token's defect
list. We also accept a phrase that starts with CFWS followed by a dot;
this is registered as an InvalidHeaderDefect, since it is not supported by
even the obsolete grammar.
u phrase does not start with wordi u .u period in 'phrase'i u comment found without atom( Ru R R R R� R7 R� t PHRASE_ENDSR� t ObsoleteHeaderDefectR R ( R t phraseR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt
get_phrase� s.
c C` s� t � } d } | d t k r4 t | � \ } } n | sU t j d j | � � � n y t | � \ } } Wnp t j k
r� y t | � \ } } Wq� t j k
r� | d d k r� | d t k r� � n t
� } q� Xn X| d k r� | g | d *n | j | � | r�| d d k s-| d t k r�t t
| � | � \ } } | j d k rt| j j t j d � � n | j j t j d � � | | d <n y | j j d � Wn* t k
r�| j j t j d � � n X| | f S(
u= local-part = dot-atom / quoted-string / obs-local-part
i u" expected local-part but found '{}'u \u invalid-obs-local-partu< local-part is not dot-atom, quoted-string, or obs-local-partu, local-part is not a dot-atom (contains CFWS)u asciiu) local-part contains non-ASCII characters)N( R� R R R R R� R< R R R! R6 R t get_obs_local_partR RG R7 R� R" R RR RZ t NonASCIILocalPartDefect( R R� R R- t obs_local_part( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_local_part� sB
&
c C` sP t � } t } xu| r�| d d k s8 | d t k r�| d d k r� | rj | j j t j d � � n | j t � t } | d } q nY | d d k r� | j t | d d � � | d } | j j t j d � � t } q n | r| d j
d k r| j j t j d
� � n y t | � \ } } t } Wn< t j k
ru| d t
k r`� n t | � \ } } n X| j | � q W| d j
d k s�| d j
d k r�| d j
d k r�| j j t j d � � n | d j
d k s| d j
d k r1| d
j
d k r1| j j t j d � � n | j rFd | _
n | | f S( u' obs-local-part = word *("." word)
i u \u .u invalid repeated '.'i u misplaced-specialu/ '\' character outside of quoted-string/ccontenti����u dotu missing '.' between wordsu cfwsu! Invalid leading '.' in local parti����u" Invalid trailing '.' in local partu invalid-obs-local-part( R� R) R! R7 R R R� R� R R� RG R R� R R ( R R' t last_non_ws_was_dotR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyR% $ sV )
c C` s] t | d � \ } } } t | d � } | rI | j j t j d � � n t | � | | f S( u dtext = <printable ascii except \ [ ]> / obs-dtext
obs-dtext = obs-NO-WS-CTL / quoted-pair
We allow anything except the excluded characters, but if we find any
ASCII other than the RFC defined printable ASCII an NonPrintableDefect is
added to the token's defects list. Quoted pairs are converted to their
unquoted values, so what is returned is a ptext token, in this case a
ValueTerminal. If there were quoted-printables, an ObsoleteHeaderDefect is
added to the returned token's defect list.
u []u ptextu( quoted printable found in domain-literal( R� R� R7 R R R" R� ( R R R� ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_dtextS s
c C` s: | r
t S| j t j d � � | j t d d � � t S( Nu" end of input inside domain-literalu ]u domain-literal-end( R) R R R� R� R ( R t domain_literal( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt _check_for_early_dl_endg s
c C` s� t � } | d t k r; t | � \ } } | j | � n | sS t j d � � n | d d k r~ t j d j | � � � n | d } t | | � r� | | f S| j t d d � � | d t k r� t
| � \ } } | j | � n t | � \ } } | j | � t | | � r!| | f S| d t k rSt
| � \ } } | j | � n t | | � rl| | f S| d d k r�t j d j | � � � n | j t d d � � | d } | r�| d t k r�t | � \ } } | j | � n | | f S(
uB domain-literal = [CFWS] "[" *([FWS] dtext) [FWS] "]" [CFWS]
i u expected domain-literalu [u6 expected '[' at start of domain-literal but found '{}'i u domain-literal-startu ]u4 expected ']' at end of domain-literal but found '{}'u domain-literal-end( R� R R R R R� R< R, R� R� R� R* ( R R+ R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_domain_literalo sD
c C` s� t � } d } | d t k r4 t | � \ } } n | sU t j d j | � � � n | d d k r� t | � \ } } | d k r� | g | d *n | j | � | | f Sy t | � \ } } Wn& t j k
r� t
| � \ } } n X| d k r| g | d *n | j | � | r�| d d k r�| j j t j d � � | d j
d k rb| d | (n xM | r�| d d k r�| j t � t
| d � \ } } | j | � qeWn | | f S( u] domain = dot-atom / domain-literal / obs-domain
obs-domain = atom *("." atom))
i u expected domain but found '{}'u [u .u( domain is not a dot-atom (contains CFWS)u dot-atomi N( R� R R R R R� R< R- R R R R7 R" RG R� ( R R� R R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt
get_domain� s<
c C` s� t � } t | � \ } } | j | � | s? | d d k rb | j j t j d � � | | f S| j t d d � � t | d � \ } } | j | � | | f S( u( addr-spec = local-part "@" domain
i u @u" add-spec local part with no domainu address-at-symboli ( R� R( R R7 R R� R� R. ( R R� R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt
get_addr_spec� s
c C` s t � } x� | r� | d d k s2 | d t k r� | d t k rd t | � \ } } | j | � q | d d k r | j t � | d } q q W| s� | d d k r� t j d j | � � � n | j t � t | d � \ } } | j | � x� | r�| d d k r�| j t � | d } | s.Pn | d t k r`t | � \ } } | j | � n | d d k r� | j t � t | d � \ } } | j | � q� q� W| s�t j d � � n | d d k r�t j d j | � � � n | j t
d d � � | | d f S(
u� obs-route = obs-domain-list ":"
obs-domain-list = *(CFWS / ",") "@" domain *("," [CFWS] ["@" domain])
Returns an obs-route token with the appropriate sub-tokens (that is,
there is no obs-domain-list in the parse tree).
i u ,i u @u( expected obs-route domain but found '{}'u% end of header while parsing obs-routeu :u4 expected ':' marking end of obs-route but found '{}'u end-of-obs-route-marker( R� R R R t
ListSeparatorR R� R< t RouteComponentMarkerR. R� ( R t obs_routeR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt
get_obs_route� sB )
c C` s+ t � } | d t k r; t | � \ } } | j | � n | sR | d d k rm t j d j | � � � n | j t d d � � | d } | d d k r� | j t d d � � | j j t j d � � | d } | | f Sy t
| � \ } } Wn� t j k
r�y/ t | � \ } } | j j t j d � � Wn, t j k
rft j d
j | � � � n X| j | � t
| � \ } } n X| j | � | r�| d d k r�| d } n | j j t j d � � | j t d d � � | r!| d t k r!t | � \ } } | j | � n | | f S( u� angle-addr = [CFWS] "<" addr-spec ">" [CFWS] / obs-angle-addr
obs-angle-addr = [CFWS] "<" obs-route addr-spec ">" [CFWS]
i u <u" expected angle-addr but found '{}'u angle-addr-starti u >u angle-addr-endu null addr-spec in angle-addru* obsolete route specification in angle-addru. expected addr-spec or obs-route but found '{}'u" missing trailing '>' on angle-addr(
R� R R R R R� R< R� R7 R� R/ R3 R" ( R t
angle_addrR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_angle_addr� sJ
c C` s@ t � } t | � \ } } | j | � | j | _ | | f S( u� display-name = phrase
Because this is simply a name-rule, we don't return a display-name
token containing a phrase, but rather a display-name token with
the content of the phrase.
( R� R$ R R7 ( R R� R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_display_name! s
c C` s> t � } d } | d t k rU t | � \ } } | sU t j d j | � � � qU n | d d k r� | d t k r� t j d j | � � � n t | � \ } } | s� t j d j | � � � n | d k r� | g | d d *d } n | j | � n t
| � \ } } | d k r'| g | d *n | j | � | | f S( u, name-addr = [display-name] angle-addr
i u! expected name-addr but found '{}'u <N( R� R R R R R� R< R! R6 R R5 ( R t name_addrR R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt
get_name_addr0 s0
c C` s� t � } y t | � \ } } WnY t j k
rz y t | � \ } } Wq{ t j k
rv t j d j | � � � q{ Xn Xt d � | j D� � r� d | _ n | j | � | | f S( u& mailbox = name-addr / addr-spec
u expected mailbox but found '{}'c s` s! | ] } t | t j � Vq d S( N( RX R R� ( R: R; ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pys <genexpr>] s u invalid-mailbox(
R� R8 R R� R/ R< R[ R? RG R ( R t mailboxR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_mailboxN s
c C` s� t � } xp | r{ | d | k r{ | d t k rY | j t | d d � � | d } q t | � \ } } | j | � q W| | f S( u� Read everything up to one of the chars in endchars.
This is outside the formal grammar. The InvalidMailbox TokenList that is
returned acts like a Mailbox, but the data attributes are None.
i u misplaced-speciali ( R� R! R R� R$ ( R R� t invalid_mailboxR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_invalid_mailboxc s
c C` sF t � } x0| r;| d d k r;y# t | � \ } } | j | � WnYt j k
r�d
} | d t k rt | � \ } } | s� | d d k r� | j | � | j j t j d � � q�t
| d � \ } } | d
k r� | g | d *n | j | � | j j t j d � � q�| d d k rF| j j t j d � � q�t
| d � \ } } | d
k rw| g | d *n | j | � | j j t j d � � n X| r| d d k r| d } d | _ t
| d � \ } } | j
| � | j j t j d � � n | r | d d k r | j t � | d } q q W| | f S( uJ mailbox-list = (mailbox *("," mailbox)) / obs-mbox-list
obs-mbox-list = *([CFWS] ",") mailbox *("," [mailbox / CFWS])
For this routine we go outside the formal grammar in order to improve error
handling. We recognize the end of the mailbox list only at the end of the
value or at a ';' (the group terminator). This is so that we can turn
invalid mailboxes into InvalidMailbox tokens and continue parsing any
remaining valid mailboxes. We also allow all mailbox entries to be null,
and this condition is handled appropriately at a higher level.
i u ;u ,;u empty element in mailbox-listu invalid mailbox in mailbox-listu ,i����u invalid-mailboxi N( R� R: R R R� R R R R7 R" R< R� RG R R0 ( R t mailbox_listR- R R9 ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_mailbox_listu sN
c C` sf t � } | s2 | j j t j d � � | | f Sd } | r� | d t k r� t | � \ } } | s� | j j t j d � � | j | � | | f S| d d k r� | j | � | | f Sn t | � \ } } t | j
� d k r3| d k r| j | � n | j | � | j j t j d � � | | f S| d k rO| g | d *n | j | � | | f S( ug group-list = mailbox-list / CFWS / obs-group-list
obs-group-list = 1*([CFWS] ",") [CFWS]
u end of header before group-listi u end of header in group-listu ;u group-list with empty entriesN(
R� R7 R R R� R R R R> R( R� R R" ( R t
group_listR R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_group_list� s8
c C` s� t � } t | � \ } } | s2 | d d k rM t j d j | � � � n | j | � | j t d d � � | d } | r� | d d k r� | j t d d � � | | d f St | � \ } } | j | � | s� | j j t j d � � n | d d k r t j d j | � � � n | j t d d � � | d } | rx| d t
k rxt | � \ } } | j | � n | | f S(
u7 group = display-name ":" [group-list] ";" [CFWS]
i u :u8 expected ':' at end of group display name but found '{}'u group-display-name-terminatori u ;u group-terminatoru end of header in groupu) expected ';' at end of group but found {}( R� R6 R R� R< R R� R@ R7 R� R R ( R R
R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_group� s2
c C` s� t � } y t | � \ } } WnY t j k
rz y t | � \ } } Wq{ t j k
rv t j d j | � � � q{ Xn X| j | � | | f S( u� address = mailbox / group
Note that counter-intuitively, an address can be either a single address or
a list of addresses (a group). This is why the returned Address object has
a 'mailboxes' attribute which treats a single address as a list of length
one. When you need to differentiate between to two cases, extract the single
element, which is either a mailbox or a group token.
u expected address but found '{}'( R� RA R R� R: R< R ( R t addressR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_address� s
c C` sG t � } x1| r<y# t | � \ } } | j | � Wnmt j k
r�} d
} | d t k rt | � \ } } | s� | d d k r� | j | � | j j t j d � � q�t
| d � \ } } | d
k r� | g | d *n | j t | g � � | j j t j d � � q�| d d k rA| j j t j d � � q�t
| d � \ } } | d
k rr| g | d *n | j t | g � � | j j t j d � � n X| r| d d k r| d d } d | _
t
| d � \ } } | j | � | j j t j d � � n | r | j t d d � � | d } q q W| | f S( u� address_list = (address *("," address)) / obs-addr-list
obs-addr-list = *([CFWS] ",") address *("," [address / CFWS])
We depart from the formal grammar here by continuing to parse until the end
of the input, assuming the input to be entirely composed of an
address-list. This is always true in email parsing, and allows us
to skip invalid addresses to parse additional valid ones.
i u ,u" address-list entry with no contentu invalid address in address-listu empty element in address-listi����u invalid-mailboxu list-separatori N( R� RC R R R� R R R R7 R" R< R� R� RG R R� ( R t address_listR- t errR R9 ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_address_list sN
c C` s| t � } | s, | j j t j d � � | S| d t k r� t | � \ } } | j | � | s� | j j t j d � � q� n d } xB | r� | d d k r� | d t k r� | | d 7} | d } q� W| j � s| j j t j d j | � � � | j t
| d � � n% t | � | _ | j t
| d � � | ro| d t k rot | � \ } } | j | � n | s�| d d k r�| j d k r�| j j t j d
� � n | r�| j t
| d � � n | S| j t
d d � � | d } | r,| d t k r,t | � \ } } | j | � n | sa| j d k r]| j j t j d
� � n | Sd } x2 | r�| d t k r�| | d 7} | d } qjW| j � s�| j j t j d j | � � � | j t
| d � � n% t | � | _ | j t
| d � � | r@| d t k r@t | � \ } } | j | � n | rx| j j t j d
� � | j t
| d � � n | S( uE mime-version = [CFWS] 1*digit [CFWS] "." [CFWS] 1*digit [CFWS]
u% Missing MIME version number (eg: 1.0)i u0 Expected MIME version number but found only CFWSu u .i u1 Expected MIME major version number but found {!r}u xtextu digitsu0 Incomplete MIME version; found only major numberu version-separatoru1 Expected MIME minor version number but found {!r}u' Excess non-CFWS text after MIME versionN( R� R7 R R t HeaderMissingRequiredValueR R R� R� R< R� R R� R R� ( R t mime_versionR- t digits( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt parse_mime_versionL sv
)
c C` s� t � } xp | r{ | d d k r{ | d t k rY | j t | d d � � | d } q t | � \ } } | j | � q W| | f S( u� Read everything up to the next ';'.
This is outside the formal grammar. The InvalidParameter TokenList that is
returned acts like a Parameter, but the data attributes are None.
i u ;u misplaced-speciali ( R� R! R R� R$ ( R t invalid_parameterR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_invalid_parameter� s
c C` sl t | � } | s- t j d j | � � � n | j � } | t | � } t | d � } t | � | | f S( u8 ttext = <matches _ttext_matcher>
We allow any non-TOKEN_ENDS in ttext, but add defects to the token's
defects list if we find non-ttext characters. We also register defects for
*any* non-printables even though the RFC doesn't exclude all of them,
because we follow the spirit of RFC 5322.
u expected ttext but found '{}'u ttext( t _non_token_end_matcherR R� R< R
R( R� R� ( R R t ttext( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_ttext� s
c C` s� t � } | rA | d t k rA t | � \ } } | j | � n | rr | d t k rr t j d j | � � � n t | � \ } } | j | � | r� | d t k r� t | � \ } } | j | � n | | f S( u� token = [CFWS] 1*ttext [CFWS]
The RFC equivalent of ttext is any US-ASCII chars except space, ctls, or
tspecials. We also exclude tabs even though the RFC doesn't.
The RFC implies the CFWS but is not explicit about it in the BNF.
i u expected token but found '{}'( R~ R R R t
TOKEN_ENDSR R� R< RO ( R t mtokenR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_token� s
c C` sl t | � } | s- t j d j | � � � n | j � } | t | � } t | d � } t | � | | f S( uQ attrtext = 1*(any non-ATTRIBUTE_ENDS character)
We allow any non-ATTRIBUTE_ENDS in attrtext, but add defects to the
token's defects list if we find non-attrtext characters. We also register
defects for *any* non-printables even though the RFC doesn't exclude all of
them, because we follow the spirit of RFC 5322.
u expected attrtext but found {!r}u attrtext( t _non_attribute_end_matcherR R� R< R
R( R� R� ( R R t attrtext( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_attrtext� s
c C` s� t � } | rA | d t k rA t | � \ } } | j | � n | rr | d t k rr t j d j | � � � n t | � \ } } | j | � | r� | d t k r� t | � \ } } | j | � n | | f S( uH [CFWS] 1*attrtext [CFWS]
This version of the BNF makes the CFWS explicit, and as usual we use a
value terminal for the actual run of characters. The RFC equivalent of
attrtext is the token characters, with the subtraction of '*', "'", and '%'.
We include tab in the excluded set just as we do for token.
i u expected token but found '{}'( R� R R R t ATTRIBUTE_ENDSR R� R< RU ( R t attributeR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt
get_attribute� s
c C` sl t | � } | s- t j d j | � � � n | j � } | t | � } t | d � } t | � | | f S( u� attrtext = 1*(any non-ATTRIBUTE_ENDS character plus '%')
This is a special parsing routine so that we get a value that
includes % escapes as a single string (which we decode as a single
string later).
u) expected extended attrtext but found {!r}u extended-attrtext( t# _non_extended_attribute_end_matcherR R� R< R
R( R� R� ( R R RT ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_extended_attrtext� s
c C` s� t � } | rA | d t k rA t | � \ } } | j | � n | rr | d t k rr t j d j | � � � n t | � \ } } | j | � | r� | d t k r� t | � \ } } | j | � n | | f S( u� [CFWS] 1*extended_attrtext [CFWS]
This is like the non-extended version except we allow % characters, so that
we can pick up an encoded value as a single string.
i u expected token but found '{}'( R� R R R t EXTENDED_ATTRIBUTE_ENDSR R� R< RZ ( R RW R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_extended_attribute
s
c C` s0 t � } | s | d d k r; t j d j | � � � n | j t d d � � | d } | ss | d j � r� t j d j | � � � n d } x2 | r� | d j � r� | | d 7} | d } q� W| d d k r| d k r| j j t j d � � n t | � | _
| j t | d
� � | | f S( u6 '*' digits
The formal BNF is more complicated because leading 0s are not allowed. We
check for that and add a defect. We also assume no CFWS is allowed between
the '*' and the digits, though the RFC is not crystal clear on that.
The caller should already have dealt with leading CFWS.
i u *u Expected section but found {}u section-markeri u$ Expected section number but found {}u u 0u& section numberhas an invalid leading 0u digits( R� R R� R< R R� R� R7 t InvalidHeaderErrorR R� ( R t sectionRI ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_section
s$
c C` s� t � } | s! t j d � � n d } | d t k rL t | � \ } } n | sm t j d j | � � � n | d d k r� t | � \ } } n t | � \ } } | d k r� | g | d *n | j | � | | f S( u quoted-string / attribute
u& Expected value but found end of stringi u Expected value but found only {}u "N(
R� R R� R R R R< R R\ R ( R t vR R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt get_value<
s
c C` s� t � } t | � \ } } | j | � | s? | d d k rk | j j t j d j | � � � | | f S| d d k ry, t | � \ } } t | _ | j | � Wn t j
k
r� n X| s� t j
d � � n | d d k r| j t d d � � | d } t | _ qn | d d k r7t j
d � � n | j t d d
� � | d } d } | r�| d t k r�t | � \ } } | j | � n d } | } | j r�| r�| d d k r�t | � \ } } | j } t } | j d k rC| r| d d k rt } qrt | � \ } } | rr| d d k rrt } qrn/ y t | � \ } } Wn n X| srt } n | r�| j j t j d
� � | j | � x. | D]& }
|
j d k r�g |
(|
} Pq�q�W| } q�d } | j j t j d � � n | r| d d k rd } n t | � \ } } | j sD| j d k r�| s[| d d k r�| j | � | d k r�| s�t | � � | } n | | f S| j j t j d � � n | s�| j j t j d � � | j | � | d k r5| | f Sn:| d k rTx! | D] }
|
j d k rPqqW|
j d k | j |
� |
j | _ n | d d k rt j
d j | � � � n | j t d d � � | d } | r| d d k rt | � \ } } | j | � | j | _ | s�| d d k rt j
d j | � � � qn | j t d d � � | d } | d k r�t � } xN | r�| d t k rxt | � \ } } n t | � \ } } | j | � qMW| } n t | � \ } } | j | � | d k r�| s�t | � � | } n | | f S( uY attribute [section] ["*"] [CFWS] "=" value
The CFWS is implied by the RFC but not made explicit in the BNF. This
simplified form of the BNF from the RFC is made to conform with the RFC BNF
through some extra checks. We do it this way because it makes both error
recovery and working with the resulting parse tree easier.
i u ;u) Parameter contains name ({}) but no valueu *u Incomplete parameteru extended-parameter-markeri u =u Parameter not followed by '='u parameter-separatoru "u 'u5 Quoted string value for extended parameter is invalidu bare-quoted-stringuZ Parameter marked as extended but appears to have a quoted string value that is non-encodeduc Apparent initial-extended-value but attribute was not marked as extended or was not initial sectionu( Missing required charset/lang delimitersu extended-attrtextu attrtextu= Expected RFC2231 char/lang encoding delimiter, but found {!r}u RFC2231 delimiteru; Expected RFC2231 char/lang encoding delimiter, but found {}N( R� RX R R7 R R� R< R_ R R� R� R� R� R R R R R� R) R� RU RZ RG Ra t AssertionErrorR RS R� R� R� R� R ( R R� R- R Rx t appendtot qstringt inner_valuet
semi_validR� t tR` ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt
get_parameterR
s�
c C` s� t � } x�| r�y# t | � \ } } | j | � Wn� t j k
r.} d
} | d t k ru t | � \ } } n | s� | j | � | S| d d k r� | d
k r� | j | � n | j j t j d � � q/t
| � \ } } | r� | g | d *n | j | � | j j t j d j | � � � n X| r�| d d k r�| d } d | _ t
| � \ } } | j
| � | j j t j d j | � � � n | r | j t d d � � | d } q q W| S( u! parameter *( ";" parameter )
That BNF is meant to indicate this routine should only be called after
finding and handling the leading ';'. There is no corresponding rule in
the formal RFC grammar, but it is more convenient for us for the set of
parameters to be treated as its own TokenList.
This is 'parse' routine because it consumes the reminaing value, but it
would never be called to parse a full header. Instead it is called to
parse everything after the non-parameter value of a specific MIME header.
i u ;u parameter entry with no contentu invalid parameter {!r}i����u invalid-parameteru) parameter with invalid trailing text {!r}u parameter-separatori N( R� Rh R R R� R R R R7 R� RL R< RG R R� ( R t mime_parametersR- RE R R� ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt parse_mime_parameters�
sD
c C` s� xp | rr | d d k rr | d t k rP | j t | d d � � | d } q t | � \ } } | j | � q W| s} d S| j t d d � � | j t | d � � d S( uB Do our best to find the parameters in an invalid MIME header
i u ;u misplaced-speciali Nu parameter-separator( R! R R� R$ Rj ( t tokenlistR R- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt _find_mime_parameters s
c C` s* t � } t } | s2 | j j t j d � � | Sy t | � \ } } WnD t j k
r� | j j t j d j | � � � t
| | � | SX| j | � | s� | d d k r� | j j t j d � � | r� t
| | � n | S| j j � j
� | _ | j t d d � � | d } y t | � \ } } WnD t j k
rz| j j t j d j | � � � t
| | � | SX| j | � | j j � j
� | _ | s�| S| d d k r�| j j t j d
j | � � � | ` | ` t
| | � | S| j t d d � � | j t | d � � | S( u� maintype "/" subtype *( ";" parameter )
The maintype and substype are tokens. Theoretically they could
be checked against the official IANA list + x-token, but we
don't do that.
u" Missing content type specificationu( Expected content maintype but found {!r}i u /u Invalid content typeu content-type-separatori u' Expected content subtype but found {!r}u ;u< Only parameters are valid after content type, but found {!r}u parameter-separator( R� R) R7 R R RG RR R� R� R< Rl R R� t lowerR� R� R� Rj ( R t ctypet recoverR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt parse_content_type_header! sX
c C` s, t � } | s, | j j t j d � � | Sy t | � \ } } WnD t j k
r� t j j t j d j | � � � t
| | � | SX| j | � | j j � j
� | _ | s� | S| d d k r� | j j t j d j | � � � t
| | � | S| j t d d � � | j t | d � � | S( u* disposition-type *( ";" parameter )
u Missing content dispositionu+ Expected content disposition but found {!r}i u ;uC Only parameters are valid after content disposition, but found {!r}u parameter-separatori ( R� R7 R R RG RR R� Rn R� R< Rl R R� Rm R� R� Rj ( R t disp_headerR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt parse_content_disposition_headerZ s2
c C` s* t � } | s, | j j t j d � � | Sy t | � \ } } Wn6 t j k
rz t j j t j d j | � � � n& X| j | � | j
j � j � | _
| s� | Sxy | r%| j j t j d � � | d t k r| j t | d d � � | d } q� t | � \ } } | j | � q� W| S( u mechanism
u! Missing content transfer encodingu1 Expected content trnasfer encoding but found {!r}u* Extra text after content transfer encodingi u misplaced-speciali ( R� R7 R R RG RR R� Rn R� R< R R� Rm R� R! R� R$ ( R t
cte_headerR- ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt& parse_content_transfer_encoding_headerx s.
(� t __doc__t
__future__R R R R t future.builtinsR R R R R t ret collectionsR R
t future.backports.urllib.parseR R t future.backports.emailR
RQ R R R� R� R R R R� R! t TSPECIALSRP t ASPECIALSRV R[ R t objectR R6 Rg Ri Ru Rz R{ R} R~ R R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R0 R1 t compileR< R% R� R� R t matchR t findallR� RM RS RY R� R� R� R� R Rk R R R
R R R R R R R R R$ R( R% R* R, R- R. R/ R3 R5 R6 R8 R: R< R> R@ RA RC RF RJ RL RO RR RU RX RZ R\ R_ Ra Rh Rj Rl Rp Rr Rt ( ( ( sO /usr/lib/python2.7/site-packages/future/backports/email/_header_value_parser.pyt <module>D s (
T� N_ '#
B3 $ 0 0 0 !
, 7
& ' / ' $ ) . 9 % > D � 4 9
Anons79 File Manager Version 1.0, Coded By Anons79
Email: [email protected]
Anons79 Mini Shell