MINI MINI MANI MO
3
\ @ s d Z dZddgZddlZddlZddlZddlZddlZddlZddl m
Z
m Z m Z m
Z
mZ G dd deZd d
ZdddZdd Zdd Zdd Zedkrejee dS )zZParser driver.
This provides a high-level interface to parse a file into a syntax tree.
z#Guido van Rossum <guido@python.org>Driver load_grammar N )grammarparsetokentokenizepgenc @ sH e Zd ZdddZdddZdddZdd d
Zdd d Zdd
dZdS )r Nc C s& || _ |d krtj }|| _|| _d S )N)r logging getLoggerloggerconvert)selfr r
r r ,/usr/lib64/python3.6/lib2to3/pgen2/driver.py__init__ s
zDriver.__init__Fc C s t j| j| j}|j d}d}d } } } } }
d} xR|D ]4} | \}}}} }
|||fkr||f|ks|t||f|f|\}
}||
k r| d|
| 7 } |
}d}||k r| |
|| 7 } |}|tjtjfkr| |7 } | \}}|j dr@|d7 }d}q@|t
j krtj | }|r,| j
jdt
j| || |j||| |frT|rR| j
jd P d} | \}}|j dr@|d7 }d}q@W t jd||| |f|jS ) z4Parse a series of tokens and return the syntax tree.r r N
z%s %r (prefix=%r)zStop.zincomplete input)r ZParserr r
ZsetupAssertionErrorr COMMENTNLendswithr OPZopmapr debugtok_nameZaddtokenZ
ParseErrorZrootnode)r tokensr plinenocolumntypevaluestartendZ line_textprefixZ quintupleZs_linenoZs_columnr r r parse_tokens' sT
zDriver.parse_tokensc C s t j|j}| j||S )z*Parse a stream and return the syntax tree.)r generate_tokensreadliner$ )r streamr r r r r parse_stream_rawW s zDriver.parse_stream_rawc C s | j ||S )z*Parse a stream and return the syntax tree.)r( )r r' r r r r parse_stream\ s zDriver.parse_streamc
C s* t j|d|}z | j||S |j X dS )z(Parse a file and return the syntax tree.rN)codecsopenr) close)r filenameencodingr r' r r r
parse_file` s zDriver.parse_filec C s t jtj|j}| j||S )z*Parse a string and return the syntax tree.)r r% ioStringIOr& r$ )r textr r r r r parse_stringh s zDriver.parse_string)NN)F)F)F)NF)F) __name__
__module__ __qualname__r r$ r( r) r0 r4 r r r r r s
0
c C s: t jj| \}}|dkr d}|| djtttj d S )Nz.txtr .z.pickle)ospathsplitextjoinmapstrsys version_info)gtheadtailr r r _generate_pickle_namen s rD Grammar.txtTFc C s |dkrt j }|dkr t| n|}|s4t|| r|jd| tj| }|r|jd| y|j| W q tk
r } z|jd| W Y dd}~X qX nt j
}|j | |S )z'Load the grammar (maybe from a pickle).Nz!Generating grammar tables from %sz Writing grammar tables to %szWriting failed: %s) r
r rD _newerinfor Zgenerate_grammardumpOSErrorr Grammarload)rA Zgpsaveforcer ger r r r u s
c C s8 t jj| sdS t jj|s dS t jj| t jj|kS )z0Inquire whether file a was written since file b.FT)r9 r: existsgetmtime)abr r r rF s
rF c C sF t jj|rt|S tt jj|}tj| |}tj }|j
| |S )a Normally, loads a pickled grammar by doing
pkgutil.get_data(package, pickled_grammar)
where *pickled_grammar* is computed from *grammar_source* by adding the
Python version and using a ``.pickle`` extension.
However, if *grammar_source* is an extant file, load_grammar(grammar_source)
is called instead. This facilitates using a packaged grammar file when needed
but preserves load_grammar's automatic regeneration behavior when possible.
) r9 r: isfiler rD basenamepkgutilget_datar rJ loads)packageZgrammar_sourceZ pickled_namedatarN r r r load_packaged_grammar s
r[ c G sF | st jdd } tjtjt jdd x| D ]}t|ddd q,W dS )zMain program, when run as a script: produce grammar pickle files.
Calls load_grammar for each argument, a path to a grammar text file.
r Nz %(message)s)levelr' formatT)rL rM )r? argvr
Z basicConfigINFOstdoutr )argsrA r r r main s
rb __main__)rE NTFN)__doc__
__author____all__r+ r1 r9 r
rV r? r r r r r r objectr rD r rF r[ rb r5 exitintr r r r <module> s$ P
OHA YOOOO