HEX

File: //lib/python3/dist-packages/twisted/web/__pycache__/_newclient.cpython-38.pyc
U

s�@g��@s�dZddlmZmZeZddlZddlmZddl	m
Z
ddlmZddl
mZddlmZdd	lmZmZdd
lmZddlmZmZmZmZddlmZdd
lmZddlmZddl m!Z!m"Z"m#Z#ddl$m%Z%ddl&m'Z'm(Z(ddl&m)Z)m*Z*ddl&m+Z+m,Z,ddl-m.Z.dZ/dZ0dZ1dZ2e.�Z3Gdd�de4�Z5Gdd�de4�Z6Gdd�de4�Z7Gdd �d e7�Z8Gd!d"�d"e4�Z9Gd#d$�d$e9�Z:Gd%d&�d&e9�Z;Gd'd(�d(e4�Z<Gd)d*�d*e4�Z=Gd+d,�d,e4�Z>Gd-d.�d.e9�Z?Gd/d0�d0e?�Z@Gd1d2�d2e4�ZAd3d4�ZBGd5d6�d6e�ZCGd7d8�d8eC�ZDe�Ed9eF��Gd:�f�ZHd;d<�ZIe�Ed=�ZJd>d?�ZKee#�Gd@dA�dA��ZLGdBdC�dC�ZMdDdE�ZNee#�ZOee"�GdFdG�dG��ZPee�GdHdI�dI��ZQee�GdJdK�dK��ZRGdLdM�dMe�ZSdS)Na�
An U{HTTP 1.1<http://www.w3.org/Protocols/rfc2616/rfc2616.html>} client.

The way to use the functionality provided by this module is to:

  - Connect a L{HTTP11ClientProtocol} to an HTTP server
  - Create a L{Request} with the appropriate data
  - Pass the request to L{HTTP11ClientProtocol.request}
  - The returned Deferred will fire with a L{Response} object
  - Create a L{IProtocol} provider which can handle the response body
  - Connect it to the response with L{Response.deliverBody}
  - When the protocol's C{connectionLost} method is called, the response is
    complete.  See L{Response.deliverBody} for details.

Various other classes in this module support this usage:

  - HTTPParser is the basic HTTP parser.  It can handle the parts of HTTP which
    are symmetric between requests and responses.

  - HTTPClientParser extends HTTPParser to handle response-specific parts of
    HTTP.  One instance is created for each request to parse the corresponding
    response.
�)�division�absolute_importN)�implementer)�
networkString)�proxyForInterface)�fullyQualifiedName)�Failure)�	IConsumer�
IPushProducer)�ConnectionDone)�Deferred�succeed�fail�
maybeDeferred)�CancelledError)�Protocol)�LineReceiver)�UNKNOWN_LENGTH�	IResponse�IClientRequest)�Headers)�
NO_CONTENT�NOT_MODIFIED)�	_DataLoss�PotentialDataLoss)�_IdentityTransferDecoder�_ChunkedTransferDecoder)�Logger�STATUS�HEADER�BODY�DONEc@seZdZdZdS)�
BadHeadersz@
    Headers passed to L{Request} were in some way invalid.
    N��__name__�
__module__�__qualname__�__doc__�r(r(�8/usr/lib/python3/dist-packages/twisted/web/_newclient.pyr"=sr"c@seZdZdZdS)�ExcessWritezx
    The body L{IBodyProducer} for a request tried to write data after
    indicating it had finished writing data.
    Nr#r(r(r(r)r*Dsr*c@seZdZdZdd�ZdS)�
ParseErrorzh
    Some received data could not be parsed.

    @ivar data: The string which could not be parsed.
    cCst�|||�||_dS�N)�	Exception�__init__�data)�self�reasonr/r(r(r)r.QszParseError.__init__N�r$r%r&r'r.r(r(r(r)r+Ksr+c@seZdZdZdS)�BadResponseVersionz=
    The version string in a status line was unparsable.
    Nr#r(r(r(r)r3Wsr3c@seZdZdZdd�ZdS)�_WrapperExceptiona,
    L{_WrapperException} is the base exception type for exceptions which
    include one or more other exceptions as the low-level causes.

    @ivar reasons: A L{list} of one or more L{Failure} instances encountered
        during an HTTP request.  See subclass documentation for more details.
    cCst�||�||_dSr,)r-r.�reasons)r0r5r(r(r)r.fsz_WrapperException.__init__Nr2r(r(r(r)r4^sr4c@seZdZdZdS)�RequestGenerationFailedz�
    There was an error while creating the bytes which make up a request.

    @ivar reasons: A C{list} of one or more L{Failure} instances giving the
        reasons the request generation was considered to have failed.
    Nr#r(r(r(r)r6lsr6c@seZdZdZdS)�RequestTransmissionFailedz�
    There was an error while sending the bytes which make up a request.

    @ivar reasons: A C{list} of one or more L{Failure} instances giving the
        reasons the request transmission was considered to have failed.
    Nr#r(r(r(r)r7vsr7c@seZdZdZdS)�ConnectionAbortedzD
    The connection was explicitly aborted by application code.
    Nr#r(r(r(r)r8�sr8c@seZdZdZdS)�WrongBodyLengthz�
    An L{IBodyProducer} declared the number of bytes it was going to
    produce (via its C{length} attribute) and then produced a different number
    of bytes.
    Nr#r(r(r(r)r9�sr9c@seZdZdZdS)�ResponseDonez�
    L{ResponseDone} may be passed to L{IProtocol.connectionLost} on the
    protocol passed to L{Response.deliverBody} and indicates that the entire
    response has been delivered.
    Nr#r(r(r(r)r:�sr:c@seZdZdZddd�ZdS)�ResponseFaileda�
    L{ResponseFailed} indicates that all of the response to a request was not
    received for some reason.

    @ivar reasons: A C{list} of one or more L{Failure} instances giving the
        reasons the response was considered to have failed.

    @ivar response: If specified, the L{Response} received from the server (and
        in particular the status code and the headers).
    NcCst�||�||_dSr,)r4r.�response)r0r5r<r(r(r)r.�szResponseFailed.__init__)Nr2r(r(r(r)r;�sr;c@seZdZdZdS)�ResponseNeverReceivedzU
    A L{ResponseFailed} that knows no response bytes at all have been received.
    Nr#r(r(r(r)r=�sr=c@seZdZdZdS)�RequestNotSentaF
    L{RequestNotSent} indicates that an attempt was made to issue a request but
    for reasons unrelated to the details of the request itself, the request
    could not be sent.  For example, this may indicate that an attempt was made
    to send a request using a protocol which is no longer connected to a
    server.
    Nr#r(r(r(r)r>�sr>cCs.z
|�Wntjdt|�d�YnXdS)z�
    Call C{function}.  If it raises an exception, log it with a minimal
    description of the source.

    @return: L{None}
    z Unexpected exception from {name}��nameN)�
_moduleLog�failurer)Zfunctionr(r(r)�_callAppFunction�s
�rCc	@sleZdZdZdZeddddddd	d
g�Zdd�Zd
d�Zdd�Z	dd�Z
dd�Zdd�Zdd�Z
dd�ZdS)�
HTTPParsera
    L{HTTPParser} handles the parsing side of HTTP processing. With a suitable
    subclass, it can parse either the client side or the server side of the
    connection.

    @ivar headers: All of the non-connection control message headers yet
        received.

    @ivar state: State indicator for the response parsing state machine.  One
        of C{STATUS}, C{HEADER}, C{BODY}, C{DONE}.

    @ivar _partialHeader: L{None} or a C{list} of the lines of a multiline
        header while that header is being received.
    �
�content-length�
connections
keep-alivestestrailers�transfer-encodingsupgradesproxy-connectioncCs t�|_t�|_t|_d|_dSr,)r�headers�connHeadersr�state�_partialHeader�r0r(r(r)�connectionMade�szHTTPParser.connectionMadecCs*|jtkrtd��||_t|_|��dS)z�
        Switch to body parsing mode - interpret any more bytes delivered as
        part of the message body and deliver them to the given decoder.
        zalready in body modeN)rKr �RuntimeError�bodyDecoderZ
setRawMode)r0�decoderr(r(r)�switchToBodyModes

zHTTPParser.switchToBodyModecCs�|dd�dkr|dd�}|jtkr8|�|�t|_nx|jtkr�|rR|ddkr�|jdk	r�d�|j�}|�dd�\}}|��}|�||�|s�|�	�q�|g|_n|j�
|�dS)	z2
        Handle one line from a response.
        ���N�
rs 	��:�)rKr�statusReceivedrrL�join�split�strip�headerReceived�allHeadersReceived�append)r0�line�headerr@�valuer(r(r)�lineReceiveds 





zHTTPParser.lineReceivedcCs|j�|�dS)zM
        Pass data from the message body to the body decoder object.
        N)rP�dataReceived�r0r/r(r(r)�rawDataReceived,szHTTPParser.rawDataReceivedcCs
||jkS)a�
        Return C{True} if the given lower-cased name is the name of a
        connection control header (rather than an entity header).

        According to RFC 2616, section 14.10, the tokens in the Connection
        header are probably relevant here.  However, I am not sure what the
        practical consequences of either implementing or ignoring that are.
        So I leave it unimplemented for the time being.
        )�CONNECTION_CONTROL_HEADERS�r0r@r(r(r)�isConnectionControlHeader3s
z$HTTPParser.isConnectionControlHeadercCsdS)a
        Callback invoked whenever the first line of a new message is received.
        Override this.

        @param status: The first line of an HTTP request or response message
            without trailing I{CR LF}.
        @type status: C{bytes}
        Nr()r0�statusr(r(r)rX@szHTTPParser.statusReceivedcCs0|��}|�|�r|j}n|j}|�||�dS)z<
        Store the given header in C{self.headers}.
        N)�lowerrhrJrIZaddRawHeader)r0r@rarIr(r(r)r\Ks

zHTTPParser.headerReceivedcCs|�d�dS)z�
        Callback invoked after the last header is passed to C{headerReceived}.
        Override this to change to the C{BODY} or C{DONE} state.
        N)rRrMr(r(r)r]WszHTTPParser.allHeadersReceivedN)r$r%r&r'Z	delimiter�setrfrNrRrbrerhrXr\r]r(r(r(r)rD�s($�

rDc@sneZdZdZeeeg�ZdeiZ	dZ
e�Zdd�Z
dd�Zdd	�Zd
d�Zdd
�Zdd�Zdd�Zdd�ZdS)�HTTPClientParseraL
    An HTTP parser which only handles HTTP responses.

    @ivar request: The request with which the expected response is associated.
    @type request: L{Request}

    @ivar NO_BODY_CODES: A C{set} of response codes which B{MUST NOT} have a
        body.

    @ivar finisher: A callable to invoke when this response is fully parsed.

    @ivar _responseDeferred: A L{Deferred} which will be called back with the
        response when all headers in the response have been received.
        Thereafter, L{None}.

    @ivar _everReceivedData: C{True} if any bytes have been received.
    schunkedNcCs||_||_t�|_d|_dS)NF)�request�finisherr�_responseDeferred�_everReceivedData)r0rmrnr(r(r)r.{szHTTPClientParser.__init__cCsd|_t�||�dS)zM
        Override so that we know if any response has been received.
        TN)rprDrcrdr(r(r)rc�szHTTPClientParser.dataReceivedc
Cs�z2|�d�\}}|�d�\}}t|�t|�}}Wn0tk
rb}ztt|�|��W5d}~XYnX|dkst|dkr~td|��|||fS)z�
        Parse version strings of the form Protocol '/' Major '.' Minor. E.g.
        b'HTTP/1.1'.  Returns (protocol, major, minor).  Will raise ValueError
        on bad syntax.
        �/�.Nrzversion may not be negative)rZ�int�
ValueErrorr3�str)r0Z
strversion�protoZ	strnumber�major�minor�er(r(r)�parseVersion�s �zHTTPClientParser.parseVersioncCs�|�dd�}t|�dkr&|\}}d}n"t|�dkr>|\}}}n
td|��zt|�}Wntk
rrtd|��YnXt�|�|�|||j|j	|j
�|_dS)z�
        Parse the status line into its components and create a response object
        to keep track of this response's state.
        � �rU�zwrong number of partsznon-integer status codeN)rZ�lenr+rsrt�Response�
_constructrzrI�	transportrmr<)r0ri�parts�versionZ	codeBytes�phraseZ
statusCoder(r(r)rX�s&
�zHTTPClientParser.statusReceivedcCst|_|�|�dS)a�
        Called to indicate that an entire response has been received.  No more
        bytes will be interpreted by this L{HTTPClientParser}.  Extra bytes are
        passed up and the state of this L{HTTPClientParser} is set to I{DONE}.

        @param rest: A C{bytes} giving any extra bytes delivered to this
            L{HTTPClientParser} which are not part of the response being
            parsed.
        N)r!rKrn�r0�restr(r(r)�	_finished�s
zHTTPClientParser._finishedcCs$|jjdkr|dkrdSt�||�S)z�
        Content-Length in the response to a HEAD request is an entity header,
        not a connection control header.
        �HEADrFF)rm�methodrDrhrgr(r(r)rh�sz*HTTPClientParser.isConnectionControlHeadercsZd|jjkrdkr@nn$|jjd|jjd�|��|`dS|jj|jksZ|jjdkr|d|j_|�	|�
��|j��n�|j�
d�}|r�|j|d��}nn|j�
d	�}|dkr�d�n*t|�d
kr�t|d���|j_ntd���dk�r|�	|�
��d}n�fdd
�}|dk�r$|j��n |j��|�||jj|j	��|j�|j�|`dS)zn
        Figure out how long the response body is going to be by examining
        headers and stuff.
        �d��z#Ignoring unexpected {code} response)�codeNr�rrHrFrWz4Too many Content-Length headers; response is invalidcst�||�Sr,)r)�x�y�Z
contentLengthr(r)�<lambda>s�z5HTTPClientParser.allHeadersReceived.<locals>.<lambda>)r<r��_log�inforN�
NO_BODY_CODESrmr��lengthr�ZclearLineBuffer�_bodyDataFinishedrJ�
getRawHeaders�_transferDecodersrjr~rsrtr��pauseProducingrR�_bodyDataReceivedro�callback)r0ZtransferEncodingHeadersZtransferDecoderZcontentLengthHeadersr(r�r)r]�sR�
���



�	z#HTTPClientParser.allHeadersReceivedc	Cs�|jdk	r�zpz|j��WnRtk
r<|j�t��Yn<tk
rl|j�tt|t�g|j���YnX|j��Wq�|j�	d�Yq�Xn4|j
tkr�|jr�t}nt
}|j�t||g���|`dS)N�)rPZ
noMoreDatarr<r�rrr;r�rBrKr!rpr=ro�errback)r0r1ZexceptionClassr(r(r)�connectionLost+s*
��

zHTTPClientParser.connectionLost)r$r%r&r'rkrrr�rr�rPrr�r.rcrzrXr�rhr]r�r(r(r(r)rl`s�!
Vrls	\A[%s]+\Z)�!�#�$�%�&�'�*�+�-rr�^�_�`�|�~s0-9sA-Zsa-zcCs t�|�r|Std�|���dS)a

    An HTTP method is an HTTP token, which consists of any visible
    ASCII character that is not a delimiter (i.e. one of
    C{"(),/:;<=>?@[\]{}}.)

    @param method: the method to check
    @type method: L{bytes}

    @return: the method if it is valid
    @rtype: L{bytes}

    @raise ValueError: if the method is not valid

    @see: U{https://tools.ietf.org/html/rfc7230#section-3.1.1},
        U{https://tools.ietf.org/html/rfc7230#section-3.2.6},
        U{https://tools.ietf.org/html/rfc5234#appendix-B.1}
    zInvalid method {!r}N)�
_VALID_METHOD�matchrt�format)r�r(r(r)�_ensureValidMethodXs
r�s\A[\x21-\x7e]+\ZcCs t�|�r|Std�|���dS)a
    A valid URI cannot contain control characters (i.e., characters
    between 0-32, inclusive and 127) or non-ASCII characters (i.e.,
    characters with values between 128-255, inclusive).

    @param uri: the URI to check
    @type uri: L{bytes}

    @return: the URI if it is valid
    @rtype: L{bytes}

    @raise ValueError: if the URI is not valid

    @see: U{https://tools.ietf.org/html/rfc3986#section-3.3},
        U{https://tools.ietf.org/html/rfc3986#appendix-A},
        U{https://tools.ietf.org/html/rfc5234#appendix-B.1}
    zInvalid URI {!r}N)�
_VALID_URIr�rtr�)�urir(r(r)�_ensureValidURIts
r�c@sjeZdZdZe�Zddd�Zeddd��Ze	dd	��Z
d
d�Zdd
�Zdd�Z
dd�Zdd�Zdd�ZdS)�Requesta�
    A L{Request} instance describes an HTTP request to be sent to an HTTP
    server.

    @ivar method: See L{__init__}.
    @ivar uri: See L{__init__}.
    @ivar headers: See L{__init__}.
    @ivar bodyProducer: See L{__init__}.
    @ivar persistent: See L{__init__}.

    @ivar _parsedURI: Parsed I{URI} for the request, or L{None}.
    @type _parsedURI: L{twisted.web.client.URI} or L{None}
    FcCs0t|�|_t|�|_||_||_||_d|_dS)at
        @param method: The HTTP method for this request, ex: b'GET', b'HEAD',
            b'POST', etc.
        @type method: L{bytes}

        @param uri: The relative URI of the resource to request.  For example,
            C{b'/foo/bar?baz=quux'}.
        @type uri: L{bytes}

        @param headers: Headers to be sent to the server.  It is important to
            note that this object does not create any implicit headers.  So it
            is up to the HTTP Client to add required headers such as 'Host'.
        @type headers: L{twisted.web.http_headers.Headers}

        @param bodyProducer: L{None} or an L{IBodyProducer} provider which
            produces the content body to send to the remote HTTP server.

        @param persistent: Set to C{True} when you use HTTP persistent
            connection, defaults to C{False}.
        @type persistent: L{bool}
        N)r�r�r�r�rI�bodyProducer�
persistent�
_parsedURI)r0r�r�rIr�r�r(r(r)r.�s

zRequest.__init__NcCs||||||�}||_|S)aS
        Private constructor.

        @param method: See L{__init__}.
        @param uri: See L{__init__}.
        @param headers: See L{__init__}.
        @param bodyProducer: See L{__init__}.
        @param persistent: See L{__init__}.
        @param parsedURI: See L{Request._parsedURI}.

        @return: L{Request} instance.
        )r�)�clsr�r�rIr�r�Z	parsedURIrmr(r(r)r��szRequest._constructcCst|jddd���S)z{
        The absolute URI of the request as C{bytes}, or L{None} if the
        absolute URI cannot be determined.
        ZtoBytescSsdSr,r(r(r(r(r)r��rUz%Request.absoluteURI.<locals>.<lambda>)�getattrr�rMr(r(r)�absoluteURI�szRequest.absoluteURIcs�|j�dd�}t|�dkr"td��g}|�d�t|j�t|j	�dg��|j
sX|�d�|dk	rj|�|�|j��D] \�}|��fdd	�|D��qt|�d
�|�
|�dS)Nshostr(rWz Exactly one Host header requiredr{s
HTTP/1.1
sConnection: close
csg|]}�d|d�qS)s: �
r()�.0�vr?r(r)�
<listcomp>�sz)Request._writeHeaders.<locals>.<listcomp>r�)rIr�r~r"r^rYr�r�r�r�r�ZgetAllRawHeaders�extend�
writeSequence)r0r�ZTEorCLZhostsZrequestLines�valuesr(r?r)�
_writeHeaders�s(���	


zRequest._writeHeaderscsX|��d�t�����|jd�|j���}�fdd�}��fdd�}|�||�|S)z�
        Write this request to the given transport using chunked
        transfer-encoding to frame the body.

        @param transport: See L{writeTo}.
        @return: See L{writeTo}.
        sTransfer-Encoding: chunked
Tcs���dSr,��unregisterProducer�Zignored)�encoderr(r)�
cbProducedsz7Request._writeToBodyProducerChunked.<locals>.cbProducedcs������|Sr,)�_allowNoMoreWritesr���err�r�r�r(r)�
ebProducedsz7Request._writeToBodyProducerChunked.<locals>.ebProduced)r��ChunkedEncoder�registerProducerr��startProducing�addCallbacks)r0r��dr�r�r(r�r)�_writeToBodyProducerChunked�sz#Request._writeToBodyProducerChunkedcs|���td�jjf��t�}t�j�|�����jd��j�������fdd�}||��}�fdd�}|�|�|S)z�
        Write this request to the given transport using content-length to frame
        the body.

        @param transport: See L{writeTo}.
        @return: See L{writeTo}.
        zContent-Length: %d
Tcsf�fdd�}t|��dg����fdd�}���fdd�}����fdd�}|�|�|�||��S)	Ncs���dSr,)�cancel�Zign)�finishedProducingr(r)�cancelConsuming/szSRequest._writeToBodyProducerContentLength.<locals>.combine.<locals>.cancelConsumingcs>�dgkrd�d<��|�n�jjd|t���dd�dS)NrWrz>Buggy state machine in {request}/[{state}]: ebConsuming called)rBrmrK)r�r�rB�reprr�)r0rK�ultimater(r)�ebConsuming9s
�zORequest._writeToBodyProducerContentLength.<locals>.combine.<locals>.ebConsumingcsB�dgkr>d�d<z���Wn���YnX��d�dS)Nr|r)�_noMoreWritesExpectedr�r�)�result)r�rKr�r(r)�cbProducingPs
zORequest._writeToBodyProducerContentLength.<locals>.combine.<locals>.cbProducingcs:�dgkr&d�d<�����|�n�jjd|d�dS)Nr}rzProducer is buggy)rB)r�r�r�rBr�)r�r0rKr�r(r)�ebProducinges

zORequest._writeToBodyProducerContentLength.<locals>.combine.<locals>.ebProducing)rZ
addErrbackr�)Z	consumingZ	producingr�r�r�r�)r�r�r0)rKr�r)�combine+s
z:Request._writeToBodyProducerContentLength.<locals>.combinecs���|Sr,r�)Zpassthrough�r�r(r)�f|sz4Request._writeToBodyProducerContentLength.<locals>.f)	r�rr�r�r�LengthEnforcingConsumerr�r�ZaddBoth)r0r�ZfinishedConsumingr�r�r�r()r�r�r0r�r)�!_writeToBodyProducerContentLengths&��	�P

z)Request._writeToBodyProducerContentLengthcCs|�|d�td�S)z�
        Write this request to the given transport using content-length to frame
        the (empty) body.

        @param transport: See L{writeTo}.
        @return: See L{writeTo}.
        sContent-Length: 0
N)r�r
�r0r�r(r(r)�_writeToEmptyBodyContentLength�sz&Request._writeToEmptyBodyContentLengthcCsR|jdkr.|jdkr |�|�qN|�|d�n |jjtkrD|�|�S|�|�SdS)a 
        Format this L{Request} as an HTTP/1.1 request and write it to the given
        transport.  If bodyProducer is not None, it will be associated with an
        L{IConsumer}.

        @param transport: The transport to which to write.
        @type transport: L{twisted.internet.interfaces.ITransport} provider

        @return: A L{Deferred} which fires with L{None} when the request has
            been completely written to the transport or with a L{Failure} if
            there is any problem generating the request bytes.
        N)sPUTsPOST)r�r�r�r�r�rr�r�r�r(r(r)�writeTo�s


zRequest.writeTocCst|jj�dS)aR
        Stop writing this request to the transport.  This can only be called
        after C{writeTo} and before the L{Deferred} returned by C{writeTo}
        fires.  It should cancel any asynchronous task started by C{writeTo}.
        The L{Deferred} returned by C{writeTo} need not be fired if this method
        is called.
        N)rCr��
stopProducingrMr(r(r)�stopWriting�s
zRequest.stopWriting)F)FN)r$r%r&r'rr�r.�classmethodr��propertyr�r�r�r�r�r�r�r(r(r(r)r��s

�
wr�c@s0eZdZdZdd�Zdd�Zdd�Zdd	�Zd
S)r�a�
    An L{IConsumer} proxy which enforces an exact length requirement on the
    total data written to it.

    @ivar _length: The number of bytes remaining to be written.

    @ivar _producer: The L{IBodyProducer} which is writing to this
        consumer.

    @ivar _consumer: The consumer to which at most C{_length} bytes will be
        forwarded.

    @ivar _finished: A L{Deferred} which will be fired with a L{Failure} if too
        many bytes are written to this consumer.
    cCs|j|_||_||_||_dSr,)r��_length�	_producer�	_consumerr�)r0�producerZconsumerZfinishedr(r(r)r.�sz LengthEnforcingConsumer.__init__cCs
d|_dS�z�
        Indicate that no additional writes are allowed.  Attempts to write
        after calling this method will be met with an exception.
        N)r�rMr(r(r)r��sz*LengthEnforcingConsumer._allowNoMoreWritescCsp|jdkr|j��t��t|�|jkrH|jt|�8_|j�|�n$t|jj�|j�	t
d��|��dS)z�
        Write C{bytes} to the underlying consumer unless
        C{_noMoreWritesExpected} has been called or there are/have been too
        many bytes.
        Nztoo many bytes written)r�r�r�r*r~r�r��writerCr�r9r��r0�bytesr(r(r)r��s

zLengthEnforcingConsumer.writecCs$|jdk	r |��|jr td��dS)z�
        Called to indicate no more bytes will be written to this consumer.
        Check to see that the correct number have been written.

        @raise WrongBodyLength: If not enough bytes have been written.
        Nztoo few bytes written)r�r�r�r9rMr(r(r)r��s
z-LengthEnforcingConsumer._noMoreWritesExpectedN)r$r%r&r'r.r�r�r�r(r(r(r)r��s
r�cs�fdd�}|j|_|S)a}
    Given a I{dispatch} name and a function, return a function which can be
    used as a method and which, when called, will call another method defined
    on the instance and return the result.  The other method which is called is
    determined by the value of the C{_state} attribute of the instance.

    @param name: A string which is used to construct the name of the subsidiary
        method to invoke.  The subsidiary method is named like C{'_%s_%s' %
        (name, _state)}.

    @param template: A function object which is used to give the returned
        function a docstring.

    @return: The dispatcher function.
    cs@t|d�d|jd�}|dkr6td|�|jf��|||�S)N�_z%r has no %s method in state %s)r��_staterO)r0�args�kwargs�funcr?r(r)�
dispatchers�z*makeStatefulDispatcher.<locals>.dispatcher)r')r@�templater�r(r?r)�makeStatefulDispatchersr�c@s�eZdZdZeZdZdZdd�Ze	dd��Z
dd	�Zd
d�Ze
de�Zd
d�Zdd�Zdd�Zdd�Zdd�Ze
de�Zdd�Zdd�Zdd�Zdd�Zd+d d!�Ze
d"e�Zd,d#d$�Zd-d%d&�Zd'd(�Zd)d*�ZdS).ra
    A L{Response} instance describes an HTTP response received from an HTTP
    server.

    L{Response} should not be subclassed or instantiated.

    @ivar _transport: See L{__init__}.

    @ivar _bodyProtocol: The L{IProtocol} provider to which the body is
        delivered.  L{None} before one has been registered with
        C{deliverBody}.

    @ivar _bodyBuffer: A C{list} of the strings passed to C{bodyDataReceived}
        before C{deliverBody} is called.  L{None} afterwards.

    @ivar _state: Indicates what state this L{Response} instance is in,
        particularly with respect to delivering bytes from the response body
        to an application-supplied protocol object.  This may be one of
        C{'INITIAL'}, C{'CONNECTED'}, C{'DEFERRED_CLOSE'}, or C{'FINISHED'},
        with the following meanings:

          - INITIAL: This is the state L{Response} objects start in.  No
            protocol has yet been provided and the underlying transport may
            still have bytes to deliver to it.

          - DEFERRED_CLOSE: If the underlying transport indicates all bytes
            have been delivered but no application-provided protocol is yet
            available, the L{Response} moves to this state.  Data is
            buffered and waiting for a protocol to be delivered to.

          - CONNECTED: If a protocol is provided when the state is INITIAL,
            the L{Response} moves to this state.  Any buffered data is
            delivered and any data which arrives from the transport
            subsequently is given directly to the protocol.

          - FINISHED: If a protocol is provided in the DEFERRED_CLOSE state,
            the L{Response} moves to this state after delivering all
            buffered data to the protocol.  Otherwise, if the L{Response} is
            in the CONNECTED state, if the transport indicates there is no
            more data, the L{Response} moves to this state.  Nothing else
            can happen once the L{Response} is in this state.
    @type _state: C{str}
    NFcCs:||_||_||_||_||_g|_d|_d|_d|_dS)a�
        @param version: HTTP version components protocol, major, minor. E.g.
            C{(b'HTTP', 1, 1)} to mean C{b'HTTP/1.1'}.

        @param code: HTTP status code.
        @type code: L{int}

        @param phrase: HTTP reason phrase, intended to give a short description
            of the HTTP status code.

        @param headers: HTTP response headers.
        @type headers: L{twisted.web.http_headers.Headers}

        @param _transport: The transport which is delivering this response.
        ZINITIALN)	r�r�r�rI�
_transport�_bodyBufferr�rm�previousResponse)r0r�r�r�rIr�r(r(r)r.[szResponse.__init__cCst|||||�}t|�|_|S)aM
        Private constructor.

        @param version: See L{__init__}.
        @param code: See L{__init__}.
        @param phrase: See L{__init__}.
        @param headers: See L{__init__}.
        @param _transport: See L{__init__}.
        @param request: See L{IResponse.request}.

        @return: L{Response} instance.
        )r�_ClientRequestProxyrm)r�r�r�r�rIr�rmr<r(r(r)r�vs
zResponse._constructcCs
||_dSr,)r�)r0r�r(r(r)�setPreviousResponse�szResponse.setPreviousResponsecCsdS)zi
        Dispatch the given L{IProtocol} depending of the current state of the
        response.
        Nr(�r0�protocolr(r(r)�deliverBody�szResponse.deliverBodyrcCsD|�|j�||_|jD]}|j�|�qd|_d|_|j��dS)z�
        Deliver any buffered data to C{protocol} and prepare to deliver any
        future data to it.  Move to the C{'CONNECTED'} state.
        NZ	CONNECTED)�makeConnectionr��
_bodyProtocolr�rcr��resumeProducing�r0r�r/r(r(r)�_deliverBody_INITIAL�s
zResponse._deliverBody_INITIALcCstd|jf��dS)z�
        It is invalid to attempt to deliver data to a protocol when it is
        already being delivered to another protocol.
        z:Response already has protocol %r, cannot deliverBody againN)rOrr�r(r(r)�_deliverBody_CONNECTED�s
��zResponse._deliverBody_CONNECTEDcCs>|�|j�|jD]}|�|�qd|_|�|j�d|_dS)z�
        Deliver any buffered data to C{protocol} and then disconnect the
        protocol.  Move to the C{'FINISHED'} state.
        N�FINISHED)rr�r�rcr��_reasonr�rr(r(r)�_deliverBody_DEFERRED_CLOSE�s

z$Response._deliverBody_DEFERRED_CLOSEcCstd��dS)z�
        It is invalid to attempt to deliver data to a protocol after the
        response body has been delivered to another protocol.
        z2Response already finished, cannot deliverBody now.N�rOr�r(r(r)�_deliverBody_FINISHED�s�zResponse._deliverBody_FINISHEDcCsdS)z�
        Called by HTTPClientParser with chunks of data from the response body.
        They will be buffered or delivered to the protocol passed to
        deliverBody.
        Nr(rdr(r(r)r��szResponse._bodyDataReceivedZbodyDataReceivedcCs|j�|�dS)a
        Buffer any data received for later delivery to a protocol passed to
        C{deliverBody}.

        Little or no data should be buffered by this method, since the
        transport has been paused and will not be resumed until a protocol
        is supplied.
        N)r�r^rdr(r(r)�_bodyDataReceived_INITIAL�s	z"Response._bodyDataReceived_INITIALcCs|j�|�dS)zk
        Deliver any data received to the protocol to which this L{Response}
        is connected.
        N)rrcrdr(r(r)�_bodyDataReceived_CONNECTED�sz$Response._bodyDataReceived_CONNECTEDcCstd��dS)z�
        It is invalid for data to be delivered after it has been indicated
        that the response body has been completely delivered.
        z0Cannot receive body data after _bodyDataFinishedNr
rdr(r(r)� _bodyDataReceived_DEFERRED_CLOSE�sz)Response._bodyDataReceived_DEFERRED_CLOSEcCstd��dS)zz
        It is invalid for data to be delivered after the response body has
        been delivered to a protocol.
        z4Cannot receive body data after protocol disconnectedNr
rdr(r(r)�_bodyDataReceived_FINISHED�sz#Response._bodyDataReceived_FINISHEDcCsdS)z�
        Called by HTTPClientParser when no more body data is available.  If the
        optional reason is supplied, this indicates a problem or potential
        problem receiving all of the response body.
        Nr(�r0r1r(r(r)r��szResponse._bodyDataFinishedZbodyDataFinishedcCs$d|_|dkrttd��}||_dS)z}
        Move to the C{'DEFERRED_CLOSE'} state to wait for a protocol to
        which to deliver the response body.
        ZDEFERRED_CLOSEN�Response body fully received)r�rr:rrr(r(r)�_bodyDataFinished_INITIAL	sz"Response._bodyDataFinished_INITIALcCs0|dkrttd��}|j�|�d|_d|_dS)zN
        Disconnect the protocol and move to the C{'FINISHED'} state.
        Nrr)rr:rr�r�rr(r(r)�_bodyDataFinished_CONNECTEDs
z$Response._bodyDataFinished_CONNECTEDcCstd��dS)��
        It is invalid to attempt to notify the L{Response} of the end of the
        response body data more than once.
        z&Cannot finish body data more than onceNr
rMr(r(r)� _bodyDataFinished_DEFERRED_CLOSEsz)Response._bodyDataFinished_DEFERRED_CLOSEcCstd��dS)rz3Cannot finish body data after protocol disconnectedNr
rMr(r(r)�_bodyDataFinished_FINISHED'sz#Response._bodyDataFinished_FINISHED)N)N)N)r$r%r&r'rr�rZ
_bodyFinishedr.r�r�r�rr�rrr	rr�rr
rrr�rrrrr(r(r(r)r(s<,


	�	
�

rc@s8eZdZdZdd�Zdd�Zdd�Zdd	�Zd
d�ZdS)
r�z�
    Helper object which exposes L{IConsumer} on top of L{HTTP11ClientProtocol}
    for streaming request bodies to the server.
    cCs
||_dSr,r�r�r(r(r)r.8szChunkedEncoder.__init__cCs
d|_dSr�r�rMr(r(r)r�<sz!ChunkedEncoder._allowNoMoreWritescCs|j�||�dS)zE
        Register the given producer with C{self.transport}.
        N)r�r�)r0r�Z	streamingr(r(r)r�DszChunkedEncoder.registerProducercCs2|jdkrt��|j�tdt|��|df�dS)z�
        Write the given request body bytes to the transport using chunked
        encoding.

        @type data: C{bytes}
        Nz%x
r�)r�r*r�rr~rdr(r(r)r�Ks
�zChunkedEncoder.writecCs |�d�|j��|��dS)zT
        Indicate that the request body is complete and finish the request.
        rUN)r�r�r�r�rMr(r(r)r�Xs

z!ChunkedEncoder.unregisterProducerN)	r$r%r&r'r.r�r�r�r�r(r(r(r)r�1s
r�c@sDeZdZdZdZdd�Zdd�Zdd�Zd	d
�Zdd�Z	d
d�Z
dS)�TransportProxyProducera'
    An L{twisted.internet.interfaces.IPushProducer} implementation which
    wraps another such thing and proxies calls to it until it is told to stop.

    @ivar _producer: The wrapped L{twisted.internet.interfaces.IPushProducer}
    provider or L{None} after this proxy has been stopped.
    FcCs
||_dSr,�r�)r0r�r(r(r)r.tszTransportProxyProducer.__init__cCs
d|_dS)z�
        Stop forwarding calls of L{twisted.internet.interfaces.IPushProducer}
        methods to the underlying L{twisted.internet.interfaces.IPushProducer}
        provider.
        NrrMr(r(r)�stopProxyingxsz#TransportProxyProducer.stopProxyingcCs|jdk	r|j��dS)zl
        Proxy the stoppage to the underlying producer, unless this proxy has
        been stopped.
        N)r�r�rMr(r(r)r��s
z$TransportProxyProducer.stopProducingcCs|jdk	r|j��dS)zn
        Proxy the resumption to the underlying producer, unless this proxy has
        been stopped.
        N)r�rrMr(r(r)r�s
z&TransportProxyProducer.resumeProducingcCs|jdk	r|j��dS)zi
        Proxy the pause to the underlying producer, unless this proxy has been
        stopped.
        N)r�r�rMr(r(r)r��s
z%TransportProxyProducer.pauseProducingcCs|jdk	r|j��dS)z�
        Proxy the request to lose the connection to the underlying producer,
        unless this proxy has been stopped.
        N)r��loseConnectionrMr(r(r)r�s
z%TransportProxyProducer.loseConnectionN)r$r%r&r'Z
disconnectingr.rr�rr�rr(r(r(r)rbs				rc@s�eZdZdZdZdZdZdZdZdZ	e
�Zdd�fdd�Ze
dd	��Zd
d�Zdd
�Zede�Zdd�ZeZdd�Zdd�Zdd�Zdd�Zede�Zdd�Zdd�Zdd�Zd d!�Zd"d#�Zd$d%�Zd&d'�ZdS)(�HTTP11ClientProtocola(
    L{HTTP11ClientProtocol} is an implementation of the HTTP 1.1 client
    protocol.  It supports as few features as possible.

    @ivar _parser: After a request is issued, the L{HTTPClientParser} to
        which received data making up the response to that request is
        delivered.

    @ivar _finishedRequest: After a request is issued, the L{Deferred} which
        will fire when a L{Response} object corresponding to that request is
        available.  This allows L{HTTP11ClientProtocol} to fail the request
        if there is a connection or parsing problem.

    @ivar _currentRequest: After a request is issued, the L{Request}
        instance used to make that request.  This allows
        L{HTTP11ClientProtocol} to stop request generation if necessary (for
        example, if the connection is lost).

    @ivar _transportProxy: After a request is issued, the
        L{TransportProxyProducer} to which C{_parser} is connected.  This
        allows C{_parser} to pause and resume the transport in a way which
        L{HTTP11ClientProtocol} can exert some control over.

    @ivar _responseDeferred: After a request is issued, the L{Deferred} from
        C{_parser} which will fire with a L{Response} when one has been
        received.  This is eventually chained with C{_finishedRequest}, but
        only in certain cases to avoid double firing that Deferred.

    @ivar _state: Indicates what state this L{HTTP11ClientProtocol} instance
        is in with respect to transmission of a request and reception of a
        response.  This may be one of the following strings:

          - QUIESCENT: This is the state L{HTTP11ClientProtocol} instances
            start in.  Nothing is happening: no request is being sent and no
            response is being received or expected.

          - TRANSMITTING: When a request is made (via L{request}), the
            instance moves to this state.  L{Request.writeTo} has been used
            to start to send a request but it has not yet finished.

          - TRANSMITTING_AFTER_RECEIVING_RESPONSE: The server has returned a
            complete response but the request has not yet been fully sent
            yet.  The instance will remain in this state until the request
            is fully sent.

          - GENERATION_FAILED: There was an error while the request.  The
            request was not fully sent to the network.

          - WAITING: The request was fully sent to the network.  The
            instance is now waiting for the response to be fully received.

          - ABORTING: Application code has requested that the HTTP connection
            be aborted.

          - CONNECTION_LOST: The connection has been lost.
    @type _state: C{str}

    @ivar _abortDeferreds: A list of C{Deferred} instances that will fire when
        the connection is lost.
    �	QUIESCENTNcCsdSr,r()�cr(r(r)r��rUzHTTP11ClientProtocol.<lambda>cCs||_g|_dSr,)�_quiescentCallback�_abortDeferreds)r0ZquiescentCallbackr(r(r)r.�szHTTP11ClientProtocol.__init__cCs|jSr,�r�rMr(r(r)rK�szHTTP11ClientProtocol.statecs��jdkrtt��Sd�_t|j�j����fdd�}t|��_|�_t	�j��_
t|�j��_
�j
��j
��j
j�_�fdd�}�fdd�}��||��jS)	a�
        Issue C{request} over C{self.transport} and return a L{Deferred} which
        will fire with a L{Response} instance or an error.

        @param request: The object defining the parameters of the request to
           issue.
        @type request: L{Request}

        @rtype: L{Deferred}
        @return: The deferred may errback with L{RequestGenerationFailed} if
            the request was not fully written to the transport due to a local
            error.  It may errback with L{RequestTransmissionFailed} if it was
            not fully written to the transport due to a network error.  It may
            errback with L{ResponseFailed} if the request was sent (not
            necessarily received) but some or all of the response was lost.  It
            may errback with L{RequestNotSent} if it is not possible to send
            any more requests using this L{HTTP11ClientProtocol}.
        r�TRANSMITTINGcs2�jdkr���n�j����tt���dS)N)r!�%TRANSMITTING_AFTER_RECEIVING_RESPONSE)r�r�r��abortConnection�_disconnectParserrrr��Z_requestDeferredr0r(r)�
cancelRequests


z3HTTP11ClientProtocol.request.<locals>.cancelRequestcs"�jdkrd�_�j��j�dS)Nr!�WAITING)r�ro�
chainDeferred�_finishedRequestr�rMr(r)�cbRequestWritten#s
z6HTTP11ClientProtocol.request.<locals>.cbRequestWrittencsJ�jdkr2d�_�j���j�tt|g���n�jjd|�jd�dS)Nr!ZGENERATION_FAILEDzJError writing request, but not in valid state to finalize request: {state})rBrK)	r�r�r#r)r�rr6r�rBr�rMr(r)�ebRequestWriting(s

��z6HTTP11ClientProtocol.request.<locals>.ebRequestWriting)r�rr>rr�r�rr)�_currentRequestr�_transportProxyrl�_finishResponse�_parserrror�)r0rmr&r*r+r(r%r)rm�s

	

zHTTP11ClientProtocol.requestcCsdS)a!
        Called by an L{HTTPClientParser} to indicate that it has parsed a
        complete response.

        @param rest: A C{bytes} giving any trailing bytes which were given to
            the L{HTTPClientParser} which were not part of the response it
            was parsing.
        Nr(r�r(r(r)r.;sz$HTTP11ClientProtocol._finishResponseZfinishResponsecCs�|jdkrd|_nd|_|j�|j�|jdkr4dStd�}|jj�dd�}d|ksf|jdksf|jj	sv|�
t|��nF|j�
�z|�|�Wn"|j�d�|j��YnX|�|�dS)	Nr'rr"z
synthetic!rGr(scloser�)r�ror(r)r/rrJr�r,r��_giveUprr�rrr�rBrr$)r0r�r1rJr(r(r)�_finishResponse_WAITINGGs&

�
z,HTTP11ClientProtocol._finishResponse_WAITINGcCsF|jdk	rB|j}d|_d|_d|_d|_|j��d|_|�|�dS)z�
        If there is still a parser, call its C{connectionLost} method with the
        given reason.  If there is not, do nothing.

        @type reason: L{Failure}
        N)r/r,r)ror-rr�)r0r1�parserr(r(r)r$us

z&HTTP11ClientProtocol._disconnectParsercCs|j��|�|�dS)z�
        Lose the underlying connection and disconnect the parser with the given
        L{Failure}.

        Use this method instead of calling the transport's loseConnection
        method directly otherwise random things will break.
        N)r�rr$rr(r(r)r0�s
zHTTP11ClientProtocol._giveUpcCs.z|j�|�Wn|�t��YnXdS)z4
        Handle some stuff from some place.
        N)r/rcr0rr�r(r(r)rc�sz!HTTP11ClientProtocol.dataReceivedcCsdS)zh
        The underlying transport went away.  If appropriate, notify the parser
        object.
        Nr(rr(r(r)r��sz#HTTP11ClientProtocol.connectionLostr�cCs
d|_dS)z{
        Nothing is currently happening.  Move to the C{'CONNECTION_LOST'}
        state but otherwise do nothing.
        �CONNECTION_LOSTNr rr(r(r)�_connectionLost_QUIESCENT�sz.HTTP11ClientProtocol._connectionLost_QUIESCENTcCs
d|_dS)z�
        The connection was in an inconsistent state.  Move to the
        C{'CONNECTION_LOST'} state but otherwise do nothing.
        r3Nr rr(r(r)�!_connectionLost_GENERATION_FAILED�sz6HTTP11ClientProtocol._connectionLost_GENERATION_FAILEDcCs.d|_|j�tt|g���|`|j��dS)z�
        Fail the L{Deferred} for the current request, notify the request
        object that it does not need to continue transmitting itself, and
        move to the C{'CONNECTION_LOST'} state.
        r3N)r�r)r�rr7r,r�rr(r(r)�_connectionLost_TRANSMITTING�s�z1HTTP11ClientProtocol._connectionLost_TRANSMITTINGcCs
d|_dS)z9
        Move to the C{'CONNECTION_LOST'} state.
        r3Nr rr(r(r)�5_connectionLost_TRANSMITTING_AFTER_RECEIVING_RESPONSE�szJHTTP11ClientProtocol._connectionLost_TRANSMITTING_AFTER_RECEIVING_RESPONSEcCs|�|�d|_dS)a
        Disconnect the response parser so that it can propagate the event as
        necessary (for example, to call an application protocol's
        C{connectionLost} method, or to fail a request L{Deferred}) and move
        to the C{'CONNECTION_LOST'} state.
        r3N)r$r�rr(r(r)�_connectionLost_WAITING�s
z,HTTP11ClientProtocol._connectionLost_WAITINGcCs6|�tt���d|_|jD]}|�d�qg|_dS)z�
        Disconnect the response parser with a L{ConnectionAborted} failure, and
        move to the C{'CONNECTION_LOST'} state.
        r3N)r$rr8r�rr�)r0r1r�r(r(r)�_connectionLost_ABORTING�s

z-HTTP11ClientProtocol._connectionLost_ABORTINGcCs8|jdkrtd�S|j��d|_t�}|j�|�|S)zw
        Close the connection and cause all outstanding L{request} L{Deferred}s
        to fire with an error.
        r3NZABORTING)r�r
r�rrrr^)r0r�r(r(r)�abort�s

zHTTP11ClientProtocol.abort)r$r%r&r'r�r/r)r,r-rorr�r.r�rKrmr.r�r1Z_finishResponse_TRANSMITTINGr$r0rcr�r4r5r6r7r8r9r:r(r(r(r)r�s8<
E	
+

r)Tr'Z
__future__rr�typeZ
__metaclass__�reZzope.interfacerZtwisted.python.compatrZtwisted.python.componentsrZtwisted.python.reflectrZtwisted.python.failurerZtwisted.internet.interfacesr	r
Ztwisted.internet.errorrZtwisted.internet.deferrr
rrrZtwisted.internet.protocolrZtwisted.protocols.basicrZtwisted.web.iwebrrrZtwisted.web.http_headersrZtwisted.web.httprrrrrrZtwisted.loggerrrrr r!rAr-r"r*r+r3r4r6r7r8r9r:r;r=r>rCrDrl�compiler�rYr�r�r�r�r�r�r�r�rr�rrr(r(r(r)�<module>s�

		i���
0J
0C