U ڲg@sddlZddlmZddlZddlZddlmZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZz ddlZWnek rdZYnXddlZddlZddlZddlZddlZz ddlZWnek rddlZYnXddlZddlmZddlmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/e 0e1Z2e 3dZ4e 3dZ5e 3d Z6e 3d Z7e 3d Z8e 3d Z9e 3d Z:e 3dZ;ddZddZ?ddZ@dddZAddZBddZCdd ZDejEd!d"ZFejEd#d$ZGejEdd&d'ZHGd(d)d)eIZJd*d+ZKGd,d-d-eIZLd.d/ZMGd0d1d1eIZNe 3d2e jOZPd3d4ZQdd5d6ZRd7d8ZSd9d:ZTd;d<ZUd=d>ZVd?d@ZWe 3dAe jXZYe 3dBZZddCdDZ[e 3dEZ\dFdGZ]dHdIZ^dJdKZ_dLZ`dMdNZadOdPZbGdQdRdReIZcGdSdTdTeIZdGdUdVdVeIZedWZfddYdZZgd[d\Zhd]ZiGd^d_d_eIZje 3d`Zke 3daZle 3dbZmdcddZdedfZnerddglmoZpmqZqmrZrGdhdidie$jsZsGdjdkdkepZoGdldmdmeoe&ZtGdndodoe%juZuerGdpdqdqe%jvZvGdrdsdse%jwZwdtduZxGdvdwdweIZyGdxdydyeyZzGdzd{d{eyZ{Gd|d}d}e'Z|Gd~ddeIZ}ddZ~GdddeIZddZddZddZddddZddZdS)N)deque)iglob)DistlibException) string_types text_typeshutil raw_inputStringIOcache_from_sourceurlopenurljoinhttplib xmlrpclib HTTPHandlerBaseConfigurator valid_ident Container configparserURLErrorZipFilefsdecodeunquoteurlparsez^([\w\.-]+)\s*z^([\w\.*+-]+)\s*z^(<=?|>=?|={2,3}|[~!]=)\s*z*^((<=?)|(>=?)|={2,3}|[~!]=|in|not\s+in)\s*z^or\b\s*z ^and\b\s*z(\S+)\s*z(([\s\w\.{}()*+#:;,/?!~`@$%^&=|<>\[\]-]+)cs6ddfddfddfdd|S) ae Parse a marker string and return a dictionary containing a marker expression. The dictionary will contain keys "op", "lhs" and "rhs" for non-terminals in the expression grammar, or strings. A string contained in quotes is to be interpreted as a literal string, and a string not contained in quotes is a variable (such as os_name). cSs.t|}|r,|d}||d}n|s:tdn|d}|dkrVtd|d|d}|dd}|g}|r|d|krqqt|d|kr|||dd}qtt|}|std|||d||d}qtd|}td|||d|}|dd }||fS) Nrzunexpected end of inputz'"zinvalid expression: %srzerror in string literal: %szunterminated string: %s) IDENTIFIERmatchgroupsend SyntaxErrorreplaceappend STRING_CHUNKjoinlstrip) remainingmresultqoqpartssr,0/tmp/pip-unpacked-wheel-mq592sfu/distlib/util.py marker_varBs>              z parse_marker..marker_varcs|rR|ddkrR|dd\}}|ddkr@td||dd}nZ|\}}|rt|}|srq|d}||d}|\}}|||d}q^|}||fS)Nr(r)unterminated parenthesis: %soplhsrhs)r$r MARKER_OPrrr)r%r'r4r&r3r5)markerr.r,r- marker_exprgs       z!parse_marker..marker_exprcsR|\}}|rJt|}|s qJ||d}|\}}d||d}q ||fS)Nandr2)ANDrrr%r4r&r5)r8r,r- marker_andzs   z parse_marker..marker_andcsR|\}}|rJt|}|s qJ||d}|\}}d||d}q ||fS)Norr2)ORrrr;)r<r,r-r7s   zparse_marker..markerr,) marker_stringr,)r7r<r8r.r- parse_marker8s % r@cCs0|}|r|drdSt|}|s4td||d}||d}d}}}}|r:|ddkr:|dd}|dkrtd||d|} ||dd}g}| r0t| }|std | | |d| |d} | sq0| dd krtd | | dd} q|s:d}|r|dd kr|dd}t |}|sztd ||d}t |} | j r| j std|||d}ndd} |ddkr| |\}}n|dd}|dkrtd||d|} ||dd}t| r@| | \}} nXt| }|s\td| |d} | |d} | rtd| d| fg}|r|ddkrtd||dd}t|\}}|r|ddkrtd||s|}nd|ddd|Df}t||||||dS)z Parse a requirement passed in as a string. Return a Container whose attributes contain the various parts of the requirement. #Nzname expected: %sr[]rzunterminated extra: %szmalformed extra: %s,zcomma expected in extras: %s@zinvalid URI: %szInvalid URL: %scSst|}d}|rg}|d}||d}t|}|sLtd||d}|||f||d}|r|ddkrq|dd}|sqt|}|std|q|sd}||fS)z| Return a list of operator, version tuples if any are specified, else None. Nrzinvalid version: %srDrinvalid constraint: %s) COMPARE_OPrrrVERSION_IDENTIFIERrr!r$) ver_remainingr&versionsr3vr,r,r- get_versionss6     z'parse_requirement..get_versionsr/r0r1rFz~=;zinvalid requirement: %szunexpected trailing data: %s%s %s, cSsg|] }d|qS)rNr,).0conr,r,r- sz%parse_requirement..)nameextras constraintsr7url requirement)strip startswithrrrrrfindr$r! NON_SPACErschemenetlocrGrHr@r#r)reqr%r&distnamerT mark_exprrJuriir+trL_rKrsr,r,r-parse_requirements             "             rfcCsdd}i}|D]\}}}tj||}t|D]p}tj||} t| D]T} ||| } |dkrn|| dqJ||| } |tjjdd} | d| || <qJq0q|S)z%Find destinations for resources filescSsD|tjjd}|tjjd}||s.t|t|ddSN/)r ospathseprYAssertionErrorlenr$)rootrjr,r,r- get_rel_pathsz)get_resources_dests..get_rel_pathNrh)rirjr#rpopr rkrstrip)resources_rootrulesro destinationsbasesuffixdestprefixabs_baseabs_globabs_path resource_filerel_pathrel_destr,r,r-get_resources_destss    rcCs(ttdrd}ntjttdtjk}|S)N real_prefixT base_prefix)hasattrsysrxgetattrr'r,r,r-in_venv2s rcCstj}t|tst|}|SN)r executable isinstancerrrr,r,r-get_executable<s  rcCsN|}t|}|}|s|r|}|r|d}||kr6qJ|rd|||f}q|S)Nrz %c: %s %s)r lower)prompt allowed_chars error_promptdefaultpr+cr,r,r-proceedNs rcCs8t|tr|}i}|D]}||kr||||<q|Sr)rrsplit)dkeysr'keyr,r,r-extract_by_key^s rcCsztjddkrtd|}|}t|}zlt|}|ddd}|D]B\}}|D]0\}}d||f}t |} | dk st | ||<q`qP|WSt k r| ddYnXdd } t } z| | |Wn<t jk r|t|}t|}| | |YnXi}| D]R} i|| <}| | D]4\} }d| |f}t |} | dk sft | || <q<q"|S) Nrutf-8 extensionszpython.exportsexportsz%s = %scSs$t|dr||n ||dS)N read_file)rrreadfp)cpstreamr,r,r- read_stream|s  z!read_exports..read_stream)r version_infocodecs getreaderreadr jsonloaditemsget_export_entryrl Exceptionseekr ConfigParserMissingSectionHeaderErrorclosetextwrapdedentsections)rdatajdatar'groupentrieskrKr+entryrrrrSvaluer,r,r- read_exportshsD        rcCstjddkrtd|}t}|D]l\}}|||D]P}|j dkr\|j }nd|j |j f}|j rd|d |j f}| ||j|qFq,||dS)Nrrrz%s:%sz%s [%s]rO)rrr getwriterrrr add_sectionvaluesrvrxflagsr#setrSwrite)rrrrrKrr+r,r,r- write_exportss   rc cs$t}z |VW5t|XdSr)tempfilemkdtemprrmtree)tdr,r,r-tempdirs rc cs.t}zt|dVW5t|XdSr)rigetcwdchdir)rcwdr,r,r-rs   rc cs.t}zt|dVW5t|XdSr)socketgetdefaulttimeoutsetdefaulttimeout)secondsctor,r,r-socket_timeouts   rc@seZdZddZdddZdS)cached_propertycCs ||_dSr)func)selfrr,r,r-__init__szcached_property.__init__NcCs,|dkr |S||}t||jj||Sr)robject __setattr____name__)robjclsrr,r,r-__get__s  zcached_property.__get__)N)r __module__ __qualname__rrr,r,r,r-rsrcCs~tjdkr|S|s|S|ddkr.td||ddkrFtd||d}tj|krh|tjqP|srtjStjj|S)aReturn 'pathname' as a name that will work on the native filesystem. The path is split on '/' and put back together again using the current directory separator. Needed because filenames in the setup script are always supplied in Unix style, and have to be converted to the local convention before we can actually use them in the filesystem. Raises ValueError on non-Unix-ish systems if 'pathname' either starts or ends with a slash. rhrzpath '%s' cannot be absolutezpath '%s' cannot end with '/')rirk ValueErrorrcurdirremoverjr#)pathnamepathsr,r,r- convert_paths       rc@seZdZd$ddZddZddZdd Zd%d d Zd&ddZddZ ddZ ddZ ddZ ddZ d'ddZddZddZd d!Zd"d#Zd S)( FileOperatorFcCs||_t|_|dSr)dry_runrensured _init_record)rrr,r,r-rszFileOperator.__init__cCsd|_t|_t|_dSNF)recordr files_written dirs_createdrr,r,r-rszFileOperator._init_recordcCs|jr|j|dSr)rradd)rrjr,r,r-record_as_writtenszFileOperator.record_as_writtencCsHtj|s tdtj|tj|s0dSt|jt|jkS)aTell if the target is newer than the source. Returns true if 'source' exists and is more recently modified than 'target', or if 'source' exists and 'target' doesn't. Returns false if both exist and 'target' is the same age or younger than 'source'. Raise PackagingFileError if 'source' does not exist. Note that this test is not very accurate: files created in the same second will have the same "age". zfile '%r' does not existT)rirjexistsrabspathstatst_mtime)rsourcetargetr,r,r-newers   zFileOperator.newerTcCs|tj|td|||jsd}|rdtj|rDd|}n tj|rdtj |sdd|}|rtt |dt ||| |dS)z8Copy a file respecting dry-run and force flags. zCopying %s to %sNz%s is a symlinkz%s is a non-regular filez which would be overwritten) ensure_dirrirjdirnameloggerinforislinkrisfilerrcopyfiler)rinfileoutfilecheckmsgr,r,r- copy_files    zFileOperator.copy_fileNcCstj|rt|tj|td|||jsv|dkrJt |d}nt j |d|d}zt ||W5| X||dS)NzCopying stream %s to %swbwencoding)rirjisdirrlrrrrropenrrr copyfileobjr)rinstreamrr outstreamr,r,r- copy_stream's  zFileOperator.copy_streamc Cs\|tj||jsNtj|r.t|t|d}||W5QRX| |dS)Nr) rrirjrrrrrrr)rrjrfr,r,r-write_binary_file6s   zFileOperator.write_binary_filecCs||||dSr)r encode)rrjrrr,r,r-write_text_file?szFileOperator.write_text_filecCsntjdkstjdkrjtjdkrj|D]F}|jr:td|q"t|j|B|@}td||t||q"dS)Nposixjavazchanging mode of %szchanging mode of %s to %o) rirS_namerrrrst_modechmod)rbitsmaskfilesr moder,r,r-set_modeBszFileOperator.set_modecCs|dd|S)Nimi)r)r+r r,r,r-NzFileOperator.cCs|tj|}||jkrxtj|sx|j|tj|\}}||t d||j sft ||j rx|j |dS)Nz Creating %s)rirjrrrrrrrrrmkdirrr)rrjrr r,r,r-rPs    zFileOperator.ensure_dirc Cst|| }td|||js|s0|||rX|s:d}n||sHt|t|d}i}|rvtt drvt j j |d<t j |||df|| ||S)NzByte-compiling %s to %sPycInvalidationModeinvalidation_modeT)r rrrrrYrlrmr py_compiler CHECKED_HASHcompiler) rrjoptimizeforcerxhashed_invalidationdpathdiagpathcompile_kwargsr,r,r- byte_compile\s*  zFileOperator.byte_compilecCstj|rtj|r^tj|s^td||js@t ||j r||j kr|j |nPtj|rpd}nd}td|||jst ||j r||j kr|j |dS)NzRemoving directory tree at %slinkfilezRemoving %s %s)rirjrrrrdebugrrrrrrr)rrjr+r,r,r-ensure_removedus"       zFileOperator.ensure_removedcCsDd}|s@tj|r$t|tj}q@tj|}||kr:q@|}q|Sr)rirjraccessW_OKr)rrjr'parentr,r,r- is_writables  zFileOperator.is_writablecCs"|js t|j|jf}||S)zV Commit recorded changes, turn off recording, return changes. )rrlrrr)rr'r,r,r-commits  zFileOperator.commitcCs|jst|jD]}tj|rt|qt|jdd}|D]F}t |}|rz|dgks^t tj ||d}t |t |q>| dS)NT)reverse __pycache__r)rlistrrirjrrsortedrlistdirrlr#rmdirr)rr dirsrflistsdr,r,r-rollbacks     zFileOperator.rollback)F)T)N)FFNF)rrrrrrrrr r r rset_executable_moderr&r*r.r/r9r,r,r,r-rs(        rcCs^|tjkrtj|}nt|}|dkr,|}n.|d}t||d}|D]}t||}qJ|S)N.r)rmodules __import__rrrp) module_name dotted_pathmodr'r*rr,r,r-resolves    rAc@s6eZdZddZeddZddZddZej Z d S) ExportEntrycCs||_||_||_||_dSrrSrxrvr)rrSrxrvrr,r,r-rszExportEntry.__init__cCst|j|jSr)rArxrvrr,r,r-rszExportEntry.valuecCsd|j|j|j|jfS)NzrCrr,r,r-__repr__s zExportEntry.__repr__cCsDt|tsd}n0|j|jko>|j|jko>|j|jko>|j|jk}|Sr)rrBrSrxrvr)rotherr'r,r,r-__eq__s   zExportEntry.__eq__N) rrrrrrrDrFr__hash__r,r,r,r-rBs   rBz(?P([^\[]\S*)) \s*=\s*(?P(\w+)([:\.]\w+)*) \s*(\[\s*(?P[\w-]+(=\w+)?(,\s*\w+(=\w+)?)*)\s*\])? c Cst|}|s0d}d|ks"d|krtd|n|}|d}|d}|d}|dkrf|d}}n"|dkrztd||d\}}|d } | dkrd|ksd|krtd|g} nd d | d D} t|||| }|S) NrBrCzInvalid specification '%s'rScallable:rrrcSsg|] }|qSr,rX)rPr r,r,r-rRsz$get_export_entry..rD)ENTRY_REsearchr groupdictcountrrB) specificationr&r'rrSrjcolonsrxrvrr,r,r-rs8   rcCs|dkr d}tjdkr.dtjkr.tjd}n tjd}tj|rft|tj}|st d|ns r`cCs`d}}d|kr>|dd\}}d|kr.|}n|dd\}}|rJt|}|rVt|}|||fS)NrErrI)rsplitrr)r]usernamepasswordrxr,r,r-parse_credentialsDsrdcCstd}t||S)N)riumaskrr,r,r-get_process_umaskSs  rgcCs<d}d}t|D]\}}t|tsd}q,q|dk s8t|S)NTF) enumeraterrrl)seqr'rbr+r,r,r-is_string_sequenceYs  rjz3([a-z0-9_]+([.-][a-z_][a-z0-9_]*)*)-([a-z0-9_.+-]+)z -py(\d\.?\d?)cCsd}d}t|dd}t|}|r@|d}|d|}|rt|t|dkrtt |d|}|r| }|d|||dd|f}|dkrt |}|r|d|d|f}|S)zw Extract name, version, python version from a filename (no extension) Return name, version, pyver or None N -rz\br) rr PYTHON_VERSIONrLrstartrmrerescaperPROJECT_NAME_AND_VERSION)filename project_namer'pyverr&nr,r,r-split_filenamejs"   rvz-(?P[\w .-]+)\s*\(\s*(?P[^\s)]+)\)$cCs:t|}|std||}|d|dfS)z A utility method used to get name and version from a string. From e.g. a Provides-Dist value. :param p: A value in a form 'foo (1.0)' :return: The name and version as a tuple. z$Ill-formed name/version string: '%s'rSver)NAME_VERSION_RErrrMrXr)rr&rr,r,r-parse_name_and_versions  rycCst}t|pg}t|pg}d|kr8|d||O}|D]x}|dkrT||q<|dr|dd}||krtd|||kr||q<||krtd|||q<|S)N*rlrzundeclared extra: %s)rrrrYrrX) requested availabler'runwantedr,r,r- get_extrass&        rc Csi}zNt|}|}|d}|ds8td|ntd|}t |}Wn0t k r}zt d||W5d}~XYnX|S)Nz Content-Typezapplication/jsonz(Unexpected response for JSON request: %srz&Failed to get external data for %s: %s) r rgetrYrr)rrrrr exception)rVr'respheadersctreaderer,r,r-_get_external_datas   rz'https://www.red-dove.com/pypi/projects/cCs*d|d|f}tt|}t|}|S)Nz%s/%s/project.jsonrupperr _external_data_base_urlr)rSrVr'r,r,r-get_project_datas rcCs(d|d||f}tt|}t|S)Nz%s/%s/package-%s.jsonrr)rSversionrVr,r,r-get_package_datas rc@s(eZdZdZddZddZddZdS) Cachez A class implementing a cache for resources that need to live in the file system e.g. shared libraries. This class was moved from resources to here because it could be used by other modules, e.g. the wheel module. cCsPtj|st|t|jd@dkr6td|tjtj ||_ dS)zu Initialise an instance. :param base: The base directory where the cache should be located. ?rzDirectory '%s' is not privateN) rirjrrYrrrrXrnormpathru)rrur,r,r-rs    zCache.__init__cCst|S)zN Converts a resource prefix to a directory name in the cache. )r^)rrxr,r,r- prefix_to_dirszCache.prefix_to_dirc Csg}t|jD]r}tj|j|}z>tj|s>tj|rJt|ntj|r`t |Wqt k r| |YqXq|S)z" Clear the cache. ) rir4rurjr#rrrrrrrr!)r not_removedfnr,r,r-clears  z Cache.clearN)rrr__doc__rrrr,r,r,r-rsrc@s:eZdZdZddZdddZddZd d Zd d Zd S) EventMixinz1 A very simple publish/subscribe system. cCs i|_dSr) _subscribersrr,r,r-r szEventMixin.__init__TcCsD|j}||krt|g||<n"||}|r6||n ||dS)a` Add a subscriber for an event. :param event: The name of an event. :param subscriber: The subscriber to be added (and called when the event is published). :param append: Whether to append or prepend the subscriber to an existing subscriber list for the event. N)rrr! appendleft)revent subscriberr!subssqr,r,r-r s  zEventMixin.addcCs,|j}||krtd||||dS)z Remove a subscriber for an event. :param event: The name of an event. :param subscriber: The subscriber to be removed. zNo subscribers: %rN)rrr)rrrrr,r,r-r!s zEventMixin.removecCst|j|dS)z Return an iterator for the subscribers for an event. :param event: The event to return subscribers for. r,)iterrr)rrr,r,r-get_subscribers-szEventMixin.get_subscribersc Oslg}||D]F}z||f||}Wn"tk rHtdd}YnX||qtd|||||S)a^ Publish a event and return a list of values returned by its subscribers. :param event: The event to publish. :param args: The positional arguments to pass to the event's subscribers. :param kwargs: The keyword arguments to pass to the event's subscribers. z"Exception during event publicationNz/publish %s: args = %s, kwargs = %s, result = %s)rrrrr!r))rrargskwargsr'rrr,r,r-publish4s    zEventMixin.publishN)T) rrrrrrrrrr,r,r,r-rs   rc@s^eZdZddZddZdddZdd Zd d Zd d ZddZ e ddZ e ddZ dS) SequencercCsi|_i|_t|_dSr)_preds_succsr_nodesrr,r,r-rQszSequencer.__init__cCs|j|dSr)rrrnoder,r,r-add_nodeVszSequencer.add_nodeFcCs||jkr|j||rt|j|dD]}|||q,t|j|dD]}|||qPt|jD]\}}|sp|j|=qpt|jD]\}}|s|j|=qdS)Nr,)rrrrrrr2r)rredgesrr+rrKr,r,r- remove_nodeYs   zSequencer.remove_nodecCs<||ks t|j|t||j|t|dSr)rlr setdefaultrrr)rpredsuccr,r,r-ris z Sequencer.addcCs||ks tz|j|}|j|}Wn tk rDtd|YnXz||||Wn$tk rtd||fYnXdS)Nz%r not a successor of anythingz%r not a successor of %r)rlrrKeyErrorrr)rrrpredssuccsr,r,r-rns   zSequencer.removecCs||jkp||jkp||jkSr)rrr)rstepr,r,r-is_step{szSequencer.is_stepcCs||std|g}g}t}|||r|d}||krb||kr||||q.|||||j|d}| |q.t |S)Nz Unknown: %rrr,) rrrr!rprrrrextendreversed)rfinalr'todoseenrrr,r,r- get_stepss"         zSequencer.get_stepscsRdggiig|jfddD]}|kr8|q8S)Nrcsd|<d|<dd7<|z |}Wntk rVg}YnX|D]J}|kr|t|||<q\|kr\t|||<q\||krg}}||||krqqt|}|dSNrr)r!rminrptuple)r successors successorconnected_component componentgraphindex index_counterlowlinksr'stack strongconnectr,r-rs,      z3Sequencer.strong_connections..strongconnect)rrr,rr-strong_connectionss# zSequencer.strong_connectionscCsfdg}|jD]*}|j|}|D]}|d||fqq |jD]}|d|q>|dd|S)Nz digraph G {z %s -> %s;z %s;} )rr!rr#)rr'rrrrr,r,r-dots    z Sequencer.dotN)F) rrrrrrrrrrpropertyrrr,r,r,r-rOs   3r).tar.gz.tar.bz2.tar.zip.tgz.tbz.whlTc sZfdd}tjtd}|dkr|dr>d}nH|drRd}d}n4|drfd }d }n |d rzd }d }n td|z|dkrt|d }|r|}|D] }||qn*t ||}|r| }|D] }||q|dkr*t j ddkr*|D]"} t| jts| jd| _qdd} | |_|W5|rT|XdS)NcsRt|ts|d}tjtj|}|rB|tjkrNt d|dS)Nrzpath outside destination: %r) rrdecoderirjrr#rYrkr)rjrdest_dirplenr,r- check_paths   zunarchive..check_path)rrzip)rrtgzzr:gz)rrtbzzr:bz2rtarr}zUnknown format for %rrrrc SsDzt||WStjk r>}ztt|W5d}~XYnXdS)z9Run tarfile.tar_filter, but raise the expected ValueErrorN)tarfileZ tar_filterZ FilterErrorrstr)memberrjexcr,r,r-extraction_filtersz$unarchive..extraction_filter)rirjrrmr_rrrnamelistrrgetnamesrr getmembersrrSrrr extractall) archive_filenamerformatrrarchivernamesrStarinforr,rr- unarchivesL           rc Cs~t}t|}t|dZ}t|D]H\}}}|D]8}tj||}||d} tj| |} ||| q4q&W5QRX|S)z*zip a directory tree into a BytesIO objectrN) ioBytesIOrmrriwalkrjr#r) directoryr'dlenzfrnr6rrSfullrelrwr,r,r-zip_dir%s  r)rKMGTPc@sreZdZdZdddZddZdd Zd d Zd d Ze ddZ e ddZ ddZ e ddZ e ddZdS)ProgressUNKNOWNrdcCs<|dks||kst||_|_||_d|_d|_d|_dS)NrF)rlrcurmaxstartedelapseddone)rminvalmaxvalr,r,r-r=s  zProgress.__init__cCsV|j|kst|jdks&||jks&t||_t}|jdkrF||_n ||j|_dSr)rrlrrtimerr)rcurvalnowr,r,r-updateEs zProgress.updatecCs |dks t||j|dS)Nr)rlrr)rincrr,r,r- incrementOs zProgress.incrementcCs||j|Sr)rrrr,r,r-rnSs zProgress.startcCs |jdk r||jd|_dS)NT)rrrrr,r,r-stopWs  z Progress.stopcCs|jdkr|jS|jSr)runknownrr,r,r-maximum\szProgress.maximumcCsD|jr d}n4|jdkrd}n$d|j|j|j|j}d|}|S)Nz100 %z ?? %gY@z%3d %%)rrrr)rr'rKr,r,r- percentage`s zProgress.percentagecCs:|dkr|jdks|j|jkr$d}ntdt|}|S)Nrz??:??:??z%H:%M:%S)rrrrstrftimegmtime)rdurationr'r,r,r-format_durationkszProgress.format_durationcCs|jrd}|j}n^d}|jdkr&d}nJ|jdks<|j|jkrBd}n.t|j|j}||j|j}|d|j}d|||fS)NDonezETA rrrz%s: %s)rrrrrfloatr)rrxrcr,r,r-ETAts z Progress.ETAcCsL|jdkrd}n|j|j|j}tD]}|dkr6q@|d}q&d||fS)Nrgig@@z%d %sB/s)rrrUNITS)rr'unitr,r,r-speeds  zProgress.speedN)rr)rrrr rrrrnr rr r rrrr,r,r,r-r:s      rz \{([^}]*)\}z[^/\\,{]\*\*|\*\*[^/\\,}]z^[^{]*\}|\{[^}]*$cCs<t|rd}t||t|r4d}t||t|S)zAExtended globbing function that supports ** and {opt1,opt2,opt3}.z7invalid glob %r: recursive glob "**" must be used alonez2invalid glob %r: mismatching set marker '{' or '}')_CHECK_RECURSIVE_GLOBrLr_CHECK_MISMATCH_SET_iglob) path_globrr,r,r-rs    rc cst|d}t|dkrht|dks,t||\}}}|dD]$}td|||fD] }|VqXq@nd|krt|D] }|Vqxn~|dd\}}|dkrd}|dkrd}n|d}|d }t |D]4\}}} tj |}ttj ||D] } | VqqdS) NrrrDrz**r;rzrh\) RICH_GLOBrrmrlrr# std_iglobr$rirrjr) rrich_path_globrxrrvitemrjradicaldirrrr,r,r-rs*         r) HTTPSHandlermatch_hostnameCertificateErrorc@seZdZdZdZddZdS)HTTPSConnectionNTcCs"t|j|jf|j}t|ddr0||_|t tj }t tdrV|j tj O_ t|ddrr||j|ji}|jrtj|_|j|jdttddr|j|d<|j|f||_|jr|jrz$t|j|jtd|jWn0tk r|jtj|jYnXdS) N _tunnel_hostF OP_NO_SSLv2 cert_file)cafileHAS_SNIserver_hostnamezHost verified: %s)rcreate_connectionhostporttimeoutrsock_tunnelssl SSLContextPROTOCOL_SSLv23roptionsr'load_cert_chainr(key_fileca_certs CERT_REQUIRED verify_modeload_verify_locations wrap_socket check_domainr# getpeercertrr)r$shutdown SHUT_RDWRr)rr0contextrr,r,r-connects4       zHTTPSConnection.connect)rrrr8r=rBr,r,r,r-r%sr%c@s&eZdZd ddZddZddZdS) r"TcCst|||_||_dSr)BaseHTTPSHandlerrr8r=)rr8r=r,r,r-rs zHTTPSHandler.__init__cOs$t||}|jr |j|_|j|_|S)a This is called to create a connection instance. Normally you'd pass a connection class to do_open, but it doesn't actually check for a class, and just expects a callable. As long as we behave just as a constructor would have, we should be OK. If it ever changes so that we *must* pass a class, we'll create an UnsafeHTTPSConnection class which just sets check_domain to False in the class definition, and choose which one to pass to do_open. )r%r8r=)rrrr'r,r,r- _conn_makers zHTTPSHandler._conn_makerc CsXz||j|WStk rR}z$dt|jkr@td|jnW5d}~XYnXdS)Nzcertificate verify failedz*Unable to verify server certificate for %s)do_openrDrrreasonr$r-)rr^rr,r,r- https_openszHTTPSHandler.https_openN)T)rrrrrDrGr,r,r,r-r"s r"c@seZdZddZdS)HTTPSOnlyHandlercCstd|dS)NzAUnexpected HTTP request on what should be a secure connection: %s)r)rr^r,r,r- http_opens zHTTPSOnlyHandler.http_openN)rrrrIr,r,r,r-rHsrHc@seZdZdddZddZdS) TransportrcCs||_tj||dSr)r/rrJrrr/ use_datetimer,r,r-r&szTransport.__init__cCsD||\}}}|jr$||jdkr:||_|t|f|_|jdSr) get_host_info _connection_extra_headersrHTTPConnection)rr-hehx509r,r,r-make_connection*s zTransport.make_connectionN)rrrrrrTr,r,r,r-rJ$s rJc@seZdZdddZddZdS) SafeTransportrcCs||_tj||dSr)r/rrVrrKr,r,r-r6szSafeTransport.__init__cCs\||\}}}|si}|j|d<|jr6||jdkrR||_|tj|df|f|_|jdS)Nr/rr)rMr/rNrOrr%)rr-rQrRrr,r,r-rT:s zSafeTransport.make_connectionN)rrUr,r,r,r-rV4s rVc@seZdZddZdS) ServerProxycKst|dd|_}|dk r^t|d}|dd}|dkr@t}nt}|||d|d<}||_tjj ||f|dS)Nr/rrLhttps)rL transport) rpr/rrrVrJrYrrWr)rrarr/r\rLtclsrcr,r,r-rHs  zServerProxy.__init__N)rrrrr,r,r,r-rWFsrWcKs6tjddkr|d7}nd|d<d|d<t||f|S)Nrrbrnewlinerr)rrr)rrrr,r,r- _csv_open_s  r]c@s4eZdZedededdZddZddZd S) CSVBaserD"r) delimiter quotecharlineterminatorcCs|Srr,rr,r,r- __enter__qszCSVBase.__enter__cGs|jdSr)rr)rrTr,r,r-__exit__tszCSVBase.__exit__N)rrrrdefaultsrcrdr,r,r,r-r^js r^c@s(eZdZddZddZddZeZdS) CSVReadercKs\d|kr4|d}tjddkr,td|}||_nt|dd|_tj|jf|j|_dS)Nrrrrrjr}) rrrrrr]csvrre)rrrr,r,r-rzszCSVReader.__init__cCs|Srr,rr,r,r-__iter__szCSVReader.__iter__cCsFt|j}tjddkrBt|D] \}}t|ts |d||<q |SNrrr)nextrrrrhrrr)rr'rbrr,r,r-rjs   zCSVReader.nextN)rrrrrhrj__next__r,r,r,r-rfxs rfc@seZdZddZddZdS) CSVWritercKs$t|d|_tj|jf|j|_dS)Nr)r]rrgwriterre)rrrr,r,r-rs zCSVWriter.__init__cCsNtjddkr>g}|D]"}t|tr.|d}||q|}|j|dSri)rrrrr r!rmwriterow)rrowr}rr,r,r-rns   zCSVWriter.writerowN)rrrrrnr,r,r,r-rlsrlcsHeZdZeejZded<d fdd ZddZdd Zd d Z Z S) Configurator inc_convertincNcs"tt|||pt|_dSr)superrprrirru)rconfigru __class__r,r-rszConfigurator.__init__c sfddd}t|s*|}dd}dd}|r\tfdd|D}fd dD}t|}|||}|r|D]\}} t||| q|S) Ncsvt|ttfr*t|fdd|D}nHt|trhd|krH|}qri}|D]}||||<qPn |}|S)Ncsg|] }|qSr,r,)rPrbconvertr,r-rRszBConfigurator.configure_custom..convert..())rr2rtypedictconfigure_customrx)or'r)rxrr,r-rxs   z.Configurator.configure_custom..convertryr;z[]r,csg|] }|qSr,r,)rPr}rwr,r-rRsz1Configurator.configure_custom..cs$g|]}t|r||fqSr,)r)rPr)rtrxr,r-rRs)rprHrArr{rsetattr) rrtrpropsrrrr'rurKr,)rtrxrr-r|s     zConfigurator.configure_customcCs4|j|}t|tr0d|kr0|||j|<}|S)Nry)rtrr{r|)rrr'r,r,r- __getitem__s zConfigurator.__getitem__c CsFtj|stj|j|}tj|ddd}t|}W5QRX|S)z*Default converter for the inc:// protocol.r}rr) rirjisabsr#rurrrr)rrr r'r,r,r-rqs  zConfigurator.inc_convert)N) rrrr{rvalue_convertersrr|rrq __classcell__r,r,rur-rps   rpc@s*eZdZdZd ddZddZdd ZdS) SubprocessMixinzC Mixin for running subprocesses and capturing their output FNcCs||_||_dSr)verboseprogress)rrrr,r,r-rszSubprocessMixin.__init__cCsj|j}|j}|}|sq^|dk r.|||q |s@tjdntj|dtjq |dS)z Read lines from a subprocess' output stream and either pass to a progress callable (if specified) or write progress information to sys.stderr. Nr;r) rrreadlinerstderrrrflushr)rrrArrr+r,r,r-rs  zSubprocessMixin.readercKstj|ftjtjd|}tj|j|jdfd}|tj|j|jdfd}|| | | |j dk r| ddn|j rt jd|S)N)stdoutrr)rrrzdone.mainzdone. ) subprocessPopenPIPE threadingThreadrrrnrwaitr#rrrr)rcmdrrt1t2r,r,r- run_commands$  zSubprocessMixin.run_command)FN)rrrrrrrr,r,r,r-rs rcCstdd|S)z,Normalize a python package name a la PEP 503z[-_.]+rl)rosubr)rSr,r,r-normalize_namesrc@s.eZdZdZdZd ddZddZdd ZdS) PyPIRCFilezhttps://upload.pypi.org/legacy/pypiNcCs.|dkrtjtjdd}||_||_dS)NrSz.pypirc)rirjr#rWrrrV)rrrVr,r,r-r(szPyPIRCFile.__init__c Csi}tj|jr||jp|j}t}||j| }d|kr*| dd}dd| dD}|gkr~d|kr|dg}n|D]}d|i}| |d|d<d |jfd |j fd fD].\}} | ||r| ||||<q| ||<q|dkr ||jdfkr |j|d <q|d|kr|d |kri}qnRd |kr|d }| |d rT| |d }n|j}| |d| |d |||j d}|S)N distutilsz index-serverscSs g|]}|dkr|qS)rrJ)rPserverr,r,r-rR:s z#PyPIRCFile.read..rrrrb repositoryrealm)rcNz server-loginrc)rbrcrrr)rirjrrrrVDEFAULT_REPOSITORYrRawConfigParserrrrr DEFAULT_REALM has_option) rr'rrtr index_servers_serversrrrr,r,r-r.s\              zPyPIRCFile.readc Cslt}|j}|||ds,|d|dd||dd|t|d}||W5QRXdS)Nrrbrcr) rrrrr has_sectionrrrr)rrbrcrtrr r,r,r-rjs    zPyPIRCFile.update)NN)rrrrrrrrr,r,r,r-r#s  r:r[r"r@rfrrrrrrrcontextmanagerrrrrrrrrArBVERBOSErKrr\r^r`rdrgrjIrqrmrvrxryrrrrrrrrARCHIVE_EXTENSIONSrrrrrrrrr"rCr#r$r%rHrJrVrWr]r^rfrlrprrrrrrrrr,r,r,r-s      X         [   /   B )    ,J D^    "+  81T U