File manager - Edit - /usr/local/CyberPanel/lib/python3.10/site-packages/s3transfer/__pycache__/tasks.cpython-310.pyc
Back
o �h?? � @ sh d dl Z d dlZd dlmZ e�e�ZG dd� d�ZG dd� de�ZG dd� de�Z G d d � d e�Z dS ) � N)� get_callbacksc @ s~ e Zd ZdZ d dd�Zdd� Zedd � �Zd d � Zd d � Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd� ZdS ) �Taskz�A task associated to a TransferFuture request This is a base class for other classes to subclass from. All subclassed classes must implement the main() method. NFc C sP || _ || _| jdu ri | _|| _|du ri | _|| _| jdu r#g | _|| _dS )a� :type transfer_coordinator: s3transfer.futures.TransferCoordinator :param transfer_coordinator: The context associated to the TransferFuture for which this Task is associated with. :type main_kwargs: dict :param main_kwargs: The keyword args that can be immediately supplied to the _main() method of the task :type pending_main_kwargs: dict :param pending_main_kwargs: The keyword args that are depended upon by the result from a dependent future(s). The result returned by the future(s) will be used as the value for the keyword argument when _main() is called. The values for each key can be: * a single future - Once completed, its value will be the result of that single future * a list of futures - Once all of the futures complete, the value used will be a list of each completed future result value in order of when they were originally supplied. :type done_callbacks: list of callbacks :param done_callbacks: A list of callbacks to call once the task is done completing. Each callback will be called with no arguments and will be called no matter if the task succeeds or an exception is raised. :type is_final: boolean :param is_final: True, to indicate that this task is the final task for the TransferFuture request. By setting this value to True, it will set the result of the entire TransferFuture to the result returned by this task's main() method. N)�_transfer_coordinator� _main_kwargs�_pending_main_kwargs�_done_callbacks� _is_final)�self�transfer_coordinator� main_kwargs�pending_main_kwargs�done_callbacks�is_final� r �F/usr/local/CyberPanel/lib/python3.10/site-packages/s3transfer/tasks.py�__init__ s ( z Task.__init__c C s, g d�}| � | j|�}d�| jj| jj|�S )N)�bucket�key� part_number�final_filename�transfer_future�offset� extra_argsz{}(transfer_id={}, {}))�"_get_kwargs_with_params_to_includer �format� __class__�__name__r � transfer_id)r �params_to_display�main_kwargs_to_displayr r r �__repr__T s ��z Task.__repr__c C s | j jS )z8The id for the transfer request that the task belongs to)r r )r r r r r i s zTask.transfer_idc C s& i }|D ] }||v r|| ||< q|S �Nr )r �kwargs�include�filtered_kwargs�paramr r r r n s �z'Task._get_kwargs_with_params_to_includec C s, i }|� � D ] \}}||v rq|||< q|S r! )�items)r r" �excluder$ r% �valuer r r �"_get_kwargs_with_params_to_excludeu s z'Task._get_kwargs_with_params_to_excludec C s� zVz(| � � | �� }| j�� s(| �|�W W | jD ]}|� q| jr'| j�� S S W n ty@ } z | � |� W Y d}~nd}~ww W | jD ]}|� qE| jrU| j�� dS dS | jD ]}|� qZ| jri| j�� w w )z9The callable to use when submitting a Task to an executorN) �_wait_on_dependent_futures�_get_all_main_kwargsr �done� _execute_mainr r � announce_done� Exception�_log_and_set_exception)r r" � done_callback�er r r �__call__} s4 ����� � � �z Task.__call__c C sN dg}| � ||�}t�d| � d|� �� | jdi |��}| jr%| j�|� |S )N�datazExecuting task z with kwargs r )r) �logger�debug�_mainr r � set_result)r r" �params_to_exclude�kwargs_to_display� return_valuer r r r- � s � zTask._execute_mainc C s t jddd� | j�|� d S )NzException raised.T)�exc_info)r5 r6 r � set_exception)r � exceptionr r r r0 � s zTask._log_and_set_exceptionc K � t d��)z�The method that will be ran in the executor This method must be implemented by subclasses from Task. main() can be implemented with any arguments decided upon by the subclass. z_main() must be implemented��NotImplementedError)r r" r r r r7 � s z Task._mainc C sF g }| j �� D ]\}}t|t�r|�|� q|�|� q| �|� d S r! )r r& � isinstance�list�extend�append�_wait_until_all_complete)r �futures_to_wait_on�_�futurer r r r* � s z Task._wait_on_dependent_futuresc C sT t �d| |� |D ]}z t �d| |� |�� W q ty! Y q w t �d| � d S )Nz-%s about to wait for the following futures %sz%s about to wait for %sz%%s done waiting for dependent futures)r5 r6 �resultr/ )r �futuresrI r r r rF � s � �z Task._wait_until_all_completec C s\ t � | j�}| j�� D ] \}}t|t�r#g }|D ] }|�|�� � qn|�� }|||< q |S r! )�copyr r r& rB rC rE rJ )r r" r � pending_valuerJ rI r r r r+ � s � zTask._get_all_main_kwargs)NNNF)r � __module__� __qualname__�__doc__r r �propertyr r r) r3 r- r0 r7 r* rF r+ r r r r r s& �8 r c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �SubmissionTaskz�A base class for any submission task Submission tasks are the top-level task used to submit a series of tasks to execute a particular transfer. c K s� z$| j �� t|d�}|D ]}|� q | j �� | jdd|i|�� W dS tyE } z| �|� | �� | j �� W Y d}~dS d}~ww )a> :type transfer_future: s3transfer.futures.TransferFuture :param transfer_future: The transfer future associated with the transfer request that tasks are being submitted for :param kwargs: Any additional kwargs that you may want to pass to the _submit() method �queuedr Nr ) r �set_status_to_queuedr �set_status_to_running�_submit� BaseExceptionr0 �+_wait_for_all_submitted_futures_to_completer. )r r r" �on_queued_callbacks�on_queued_callbackr2 r r r r7 � s ��zSubmissionTask._mainc K r? )aX The submission method to be implemented :type transfer_future: s3transfer.futures.TransferFuture :param transfer_future: The transfer future associated with the transfer request that tasks are being submitted for :param kwargs: Any additional keyword arguments you want to be passed in z _submit() must be implementedr@ )r r r" r r r rV & s zSubmissionTask._submitc C s: | j j}|r| �|� | j j}||krd S |}|sd S d S r! )r �associated_futuresrF )r �submitted_futures� possibly_more_submitted_futuresr r r rX 2 s � �z:SubmissionTask._wait_for_all_submitted_futures_to_completeN)r rN rO rP r7 rV rX r r r r rR � s / rR c @ � e Zd ZdZdd� ZdS )�CreateMultipartUploadTaskz#Task to initiate a multipart uploadc C s8 |j d||d�|��}|d }| jj|j|||d� |S )aq :param client: The client to use when calling CreateMultipartUpload :param bucket: The name of the bucket to upload to :param key: The name of the key to upload to :param extra_args: A dictionary of any extra arguments that may be used in the initialization. :returns: The upload id of the multipart upload )�Bucket�Key�UploadId)r` ra rb Nr )�create_multipart_uploadr �add_failure_cleanup�abort_multipart_upload)r �clientr r r �response� upload_idr r r r7 Q s ���z CreateMultipartUploadTask._mainN�r rN rO rP r7 r r r r r_ N � r_ c @ r^ )�CompleteMultipartUploadTaskz#Task to complete a multipart uploadc C s" |j d|||d|id�|�� dS )az :param client: The client to use when calling CompleteMultipartUpload :param bucket: The name of the bucket to upload to :param key: The name of the key to upload to :param upload_id: The id of the upload :param parts: A list of parts to use to complete the multipart upload:: [{'Etag': etag_value, 'PartNumber': part_number}, ...] Each element in the list consists of a return value from ``UploadPartTask.main()``. :param extra_args: A dictionary of any extra arguments that may be used in completing the multipart transfer. �Parts)r` ra rb �MultipartUploadNr )�complete_multipart_upload)r rf r r rh �partsr r r r r7 n s � �z!CompleteMultipartUploadTask._mainNri r r r r rk k rj rk ) rL �logging�s3transfer.utilsr � getLoggerr r5 r rR r_ rk r r r r �<module> s \^
| ver. 1.4 |
Github
|
.
| PHP 8.2.28 | Generation time: 0.02 |
proxy
|
phpinfo
|
Settings