File: //home/arjun/projects/env/lib/python3.10/site-packages/celery/app/__pycache__/trace.cpython-310.pyc
o
-weo � @ s� d Z ddlZddlZddlZddlZddlmZ ddlmZm Z m
Z
m Z m Z m
Z
mZmZmZ ddlmZ ddlmZmZ ddlmZ ddlmZ dd lmZ dd
l m Z m Z ddl Z ddl Z dd l m!Z!m"Z"m#Z#m$Z$ dd l%m&Z& dd
l'm(Z( ddl'm)Z* ddl+m,Z,m-Z-m.Z.m/Z/m0Z0 ddl1m2Z2 ddl3m4Z4 ddl5m6Z6 ddl7m8Z8 ddl9m:Z: ddl;m<Z<m=Z=m>Z> dZ?ddl@mAZA e4eB�ZCdZDdZEdZFdZGdZHd ZId ZJed d �ZKeKeId ejLd!d!�ZMeKeHd"ejNdd�ZOeKeGd#ejPd!d!�ZQeKeFd$ejNdd�ZReKeFd%ejSd!d!�ZTe#jUjVZWe#jXjVZYe#jZjVZ[e$j\Z\e$j]Z]e$j^Z^e$j_Z_e$j`Z`e$jaZae$jbZbece^e`e_h�Zdg Zei Zfed&d'�Zgd(d)� Zhd*d+� Zid,d-� Zjd.d/� ZkG d0d1� d1�ZldUd2d3�Zmddd4eld5d5dejnegedf
d6eod7ee j)e jpjqf d8e e jrjsjt d9e eo d:eud;eel d<eud=eud>e e jv d?e g ewf d&eeg d@e eo dAe eoeedBf e
eoef egegf fdCdD�ZxdUdEdF�ZydGdH� ZzedfdIdJ�Z{eddfdKdL�Z|dMdN� Z}dUdOdP�Z~e!fdQdR�ZdSdT� Z�dS )Vz�Trace task execution.
This module defines how the task execution is traced:
errors are recorded, handlers are applied and so on.
� N)�
namedtuple) �Any�Callable�Dict� FrozenSet�Optional�Sequence�Tuple�Type�Union)�warn)�
ExceptionInfo�ExceptionWithTraceback)� EncodeError)�loads)�prepare_accept_content)� safe_repr�safe_str)� current_app�group�signals�states)� _task_stack)�Context)�Task)�BackendGetMetaError�Ignore�InvalidTaskError�Reject�Retry)� AsyncResult)�
get_logger)� gethostname)�
mro_lookup)�saferepr)�get_pickleable_etype�get_pickleable_exception�get_pickled_exception)� TraceInfo� build_tracer�
trace_task�setup_worker_optimizations�reset_worker_optimizations)�successful_requestsz Task %(name)s[%(id)s] receivedzATask %(name)s[%(id)s] succeeded in %(runtime)ss: %(return_value)sz.Task %(name)s[%(id)s] %(description)s: %(exc)sz%Task %(name)s[%(id)s] %(description)sz Task %(name)s[%(id)s] %(exc)sz$Task %(name)s[%(id)s] retry: %(exc)s� log_policy_t)�format� description�severity� traceback�mail�rejected� �ignoredzINTERNAL ERRORzraised expectedzraised unexpected�
trace_ok_t)�retval�info�runtime�retstrc C s t j| |d|id� dS )zzLog 'fmt % context' with severity 'INFO'.
'context' is also passed in extra with key 'data' for custom handlers.
�data)�extraN)�loggerr9 )�fmt�context� rA �I/home/arjun/projects/env/lib/python3.10/site-packages/celery/app/trace.pyr9 ~ s r9 c C s t | j|tthdgd�S )z+Return true if the task overrides ``attr``.zcelery.app.task)�stop�monkey_patched)r# � __class__�BaseTask�object)�task�attrrA rA rB �task_has_custom� s �rJ c C s@ t |t�rtS t |t�rtS |jrtS | jr t || j�r tS t S �N)
�
isinstancer �log_policy_rejectr �log_policy_ignore�internal�log_policy_internal�throws�log_policy_expected�log_policy_unexpected)rH �einfo�excrA rA rB �get_log_policy� s
rV c C s t | dd�p|S )z8Use 'shadow' in request for the task name if applicable.�shadowN)�getattr)�request�defaultrA rA rB �
get_task_name� s r[ c @ sV e Zd ZdZdZddd�Z ddd �Zd
d � Zd d
� Zddd�Z ddd�Z
dd� Z dS )r( z!Information about task execution.��stater8 Nc C s || _ || _d S rK r\ )�selfr] r8 rA rA rB �__init__� s
zTraceInfo.__init__FTc C sF |j r|j}n |r|jrd}n| }t| jt| ji| j ||||d�S )NT)� store_errors�
call_errbacks)�
ignore_result� store_errors_even_if_ignored�store_eager_result�RETRY� handle_retry�FAILURE�handle_failurer] )r^ rH �req�eagerra r` rA rA rB �handle_error_state� s
���z TraceInfo.handle_error_statec K � | � ||t� � d S rK ��
_log_errorr
�r^ rH ri �kwargsrA rA rB �
handle_reject� � zTraceInfo.handle_rejectc K rl rK rm ro rA rA rB �
handle_ignore� rr zTraceInfo.handle_ignorec
K s� t �� \}}}zD| j}t|||f�} |r!|jj|j|j| j|d� |� |j|j|j
|j | � t j
j|||| d� tt|jt||j�t|�d�� | W ~S ~w )zHandle retry exception.�rY )�senderrY �reasonrT )�id�namerU )�sys�exc_infor8 r
�backend�
mark_as_retryrw rU r2 �on_retry�argsrp r �
task_retry�sendr9 � LOG_RETRYr[ rx �str)
r^ rH ri r` rp �type_�_�tbrv rT rA rA rB rf � s& �
�
�zTraceInfo.handle_retryc
C s� | j }t|�}|jdu rt�� \}}|_tt|��}t|||jfd�} |jj |j
|| j |||d� |� ||j
|j
|j| � tjj||j
||j
|j|j| d� | �||| � | S )zHandle exception.N�rz )rY � store_resultra )ru �task_id� exceptionr~ rp r2 rT )r8 r& �
__traceback__ry rz r% �typer
r{ �mark_as_failurerw r2 �
on_failurer~ rp r � task_failurer� rn )
r^ rH ri r` ra �orig_excrU r� �exc_typerT rA rA rB rh � s(
� �zTraceInfo.handle_failurec
C s� t |j� }|_t|t�r|j }|_t|�t|j�|j|� d�p%t|j
�|� d�p.t|j �f\}}}}} t |||�}
|j
|jt||j�|||| |
j|jd� } tj|
j|
j�� | |
jr]|nd d| id� d S )N�argsrepr�
kwargsrepr) �hostnamerw rx rU r2 r~ rp r0 rO r< )rz r= )r' r� rL r rU r r r2 rz �getr~ rp rV r� rw r[ rx r0 rO r> �logr1 r/ �strip) r^ rH ri rT �eobjr� r2 rz �sargs�skwargs�policyr@ rA rA rB rn � s0
�
�
�zTraceInfo._log_errorrK )FT)T)TT) �__name__�
__module__� __qualname__�__doc__� __slots__r_ rk rq rs rf rh rn rA rA rA rB r( � s
�
r( c C s� d }| d urt | d�r| j}nt�� \}}}nt�� \}}}|d ur@z |j�� |jj W n ty6 Y nw |j}|d us"d S d S )Nr� ) �hasattrr� ry rz �tb_frame�clear�f_locals� RuntimeError�tb_next)rU r� r� rA rA rB �traceback_clear s
��r� TFrx rH �loaderr� r` �Inforj � propagate�app� monotonic�
IGNORE_STATES�return.c ! s t �d�r�n�j�|p�j}�j} �j� � o �jo | � �r(| s(�jr(d�n� o-| ��jjs5�jo<�jj o<�j
j ��pAt � ��jj
�|j�
|j� d� d� d�t �d�rZ�j� t �d�rb�j� t �d�rj�j�t�� ��j}
|
j�|
j�tj�tj�t�tj ���j �t j j �t j!j �t j"j �ddl#m$} |j%�t&dfd t#j'j(j)d
t*t+t,t+ f d t-d t.d
t/�t0t0t0f f
����fdd�
�
ddt-dt1t0 dt2t-t0f d t3t2t-t0f d
� f
� ��������� �
� � �
�������������� � � � f dd�
}|S )a= Return a function that traces task execution.
Catches all exceptions and updates result backend with the
state and result.
If the call was successful, it saves the result to the task result
backend, and sets the task status to `"SUCCESS"`.
If the call raises :exc:`~@Retry`, it extracts
the original exception, uses that as the result and sets the task state
to `"RETRY"`.
If the call results in an exception, it saves the exception as the task
result, and sets the task state to `"FAILURE"`.
Return a function that takes the following arguments:
:param uuid: The id of the task.
:param args: List of positional args to pass on to the function.
:param kwargs: Keyword arguments mapping to pass on to the function.
:keyword request: Request dict.
�__call__TN� before_start�
on_success� after_returnr )�canvasrY rU r] ra r� c s2 �r� � ||�}|j �| �|d�}|||j|jfS )z1Handle any errors raised by a `Task`'s execution.)rj ra )rk r] r8 )rY rU r] ra �I�R)r� rj r� rH rA rB �on_error� s
�z build_tracer.<locals>.on_error�uuidr~ rp c sj d } } } } }} d}
� � } �z`z|j W n ty# td��w t|p(i |d|d�}
|
jo7|
j�dd�} �rx| rx|
jtv rI� ||||�W S t|
j�d�}
z|
j } W n t
y^ Y nw | t krxt t
|
jt|
� �dd�� � ||||�W S ��� |
jp�| }�r�|
j�d �nd}�|
� �zZ�r�t�| �||d
� �
| �� � r��jj| ��d �t|
d � z�r��| ||� �|i |�� }}t } W n� ty� } z#�t|�td
d�}}|j |j} }|��|
� t|� W Y d}~�ncd}~w t�y# } z#�t|�td
d�}}|j |j} }|� �|
� t|� W Y d}~�n4d}~w t �yF } z�
|
|t dd�\}}} }t|� W Y d}~�nd}~w t �ye } z�
|
|�\}}} }t|� W Y d}~n�d}~w t �ym � w z��j!j"}|�r�t#�j!j"�dk�r�g g }}|D ]}�|�d�}t$|t%��r�|�&|� �q�|�&|� �q�|D ]
}|j'|f| ||d� �q�|�r�t%|�d�j'|f| ||d� n�|d �d�j'|f| ||d� |
j(}|�r�|�)� �d�}|j'|f|| ||d� �j�*| ||
�� W n t+�y } z�
|
|�\}}} }W Y d}~nDd}~ww t,|��}� � | }� �r(� || ||� ��r1t-�|d� ��rSt t.| t|
� �|||
�d��pFt/|�|
�d��pOt/|�d�� | � v�rd��rd�| || ||d� W zJ��rtt0�| �|||| d� W �� �� ��s�z
�j�1� � � W n� t2t3t4f�y� � t �y� } zt5j6d|d
d� W Y d}~n�d}~ww n��� �� ��s�z
�j�1� � � W w t2t3t4f�y� � t �y� } zt5j6d|d
d� W Y d}~w d}~ww w zJ��r�t0�| �|||| d� W �� �� ��s5z
�j�1� � � W w t2t3t4f�y � t �y4 } zt5j6d|d
d� W Y d}~w d}~ww w �� �� ��spz
�j�1� � � W w t2t3t4f�yU � t �yo } zt5j6d|d
d� W Y d}~w d}~ww w W n; t4�y{ � t �y� } z&t7�| ||||� ��r�� t8�|�}|
du�r��
|
|�\}}}}W Y d}~nd}~ww � ||||�S )zExecute and trace a `Task`.Nz'Task keyword arguments is not a mappingF)r~ �called_directlyrp � redelivered�r� z$Task already completed successfully.)rw rx r0 �priority)ru r� rH r~ rp )�pidr� rt T�rO )ra r5 )� parent_id�root_idr� r )�chainr� r� r� )ru �resultr� r� )rw rx � return_valuer: r~ rp )ru r� rH r~ rp r8 r] zProcess cleanup failed: %rr� )9�items�AttributeErrorr r �
delivery_infor� rw r- r r] r �SUCCESSr9 � LOG_IGNOREDr[ r� � send_prerunr{ r� �STARTEDr �REJECTEDr
r8 rq r� r �IGNOREDrs r re � Exception�
BaseExceptionrY � callbacks�lenrL r �append� apply_asyncr� �pop� mark_as_doner r$ � send_success� LOG_SUCCESSr � send_postrun�process_cleanup�KeyboardInterrupt�
SystemExit� MemoryErrorr> �error�_signal_internal_error�report_internal_error)r� r~ rp rY r� r� �T�Rstrr8 r] � task_request�
time_startr� �rr� �
task_priorityrU r� �sigs�groups�sig�group_r� �_chsigr� ) r� r� �
_does_infor� � deduplicate_successful_tasksrj �funr� �inherit_parent_priority�loader_cleanup�loader_task_initr� rx r� r� � pop_request�pop_task�postrun_receivers�prerun_receivers�publish_result� push_request� push_task�resultrepr_maxsize� signature�success_receiversrH �task_after_return�task_before_start�task_on_successr7 �
track_startedrA rB r* � s�
��
� �
��
���
� � �����
� ����� ��
�
����
�����
�������
�����
�����
��z build_tracer.<locals>.trace_taskrK )4rJ �runr� rb r� rd �conf�task_acks_late� acks_late�#worker_deduplicate_successful_tasksr{ �
persistentr" � task_inherit_parent_priority� on_task_init�on_process_cleanupr� r� r� �os�getpid�
request_stack�pushr� r r> � isEnabledFor�logging�INFOr� r � task_prerun� receivers� task_postrun� task_success�celeryr� �maybe_signaturerg r� rH r r r� r
r� �boolr r r r r )rx rH r� r� r` r� rj r� r� r� r7 r� rb r r� r* rA ) r� r� r� r� r� rj r� r� r� r� r� r� rx r� r� r� r� r� r� r� r� r� r� r� r� r� rH r� r� r� r7 r� rB r) ) s� +
��
���������
��J� Fr) c
K s� |si n|}z| j du rt| j| fi |��| _ | � ||||�W S tyG } z t| |||||� tt| |�tt|�dd�W Y d}~S d}~ww )zTrace task execution.Ng ) � __trace__r) rx r� r� r7 r� r( rg )rH r� r~ rp rY �optsrU rA rA rB r* \ s
&��r* c
C sV z(t �� \}}}t� }t|j�|_t|j�|_tjj | |||||||d� W ~dS ~w )zJSend a special `internal_error` signal to the app for outside body errors.)ru r� r~ rp rY r� r2 rT N)
ry rz r
r& r� r% r� r �task_internal_errorr� ) rH r� r~ rp rY rU r� r� rT rA rA rB r� h s �
r� c K s� |pt �� }d } |r t|jj�}
|||||
d�\} } } n|\} } } t� }
|j| | |
dd�fi | p1i �� t|j| || | ||d�\}}}}|rLd||fS d||fS )N��acceptF�r~ rp r� �is_eagerr� r5 r ) r �_get_current_objectr r� �accept_contentr" �updater* �tasks)rx r� rY �body� content_type�content_encodingr r� �
extra_request�embedr r~ rp r� r� r� r� r� rA rA rB �trace_task_ret} s& �
��
�r# c K s� |st n|}d }
|\} } }|r||||| d�\}
}}
n|\}
}}
|j|
||dd�fi |
p-i �� | | �||
||�\}}}}|rEd||fS d||fS )Nr Fr r5 r )�
_localizedr r )rH r� rY r r r r �_locr� r� r" r r r~ rp r� r� r� r� rA rA rB �fast_trace_task� s$
�
�� �r& c C sR t �� \}}}z | j�|d�}t|||fdd�}ttd�||j��� |W ~S ~w )N�pickleTr� z'Exception raised outside body: {!r}:
{}) ry rz r{ �prepare_exceptionr
r �RuntimeWarningr/ r2 )rH rU �_type�_value�_tbrz rA rA rB r� � s ��r� c C sN |pt � }t� | �� | �� | �� | jt| jj�|gt dd�< d| _
dS )z#Setup worker related optimizations.NT) r" �_install_stack_protection� set_current� set_default�finalize�_tasksr r� r r$ �use_fast_trace_task)r� r� rA rA rB r+ � s
�
r+ c C sP zt td� W n ty Y nw zt�d�t_W n ty" Y nw d| _dS )z*Reset previously configured optimizations.�_stackprotected�BaseTask.__call__FN)�delattrrF r� �_patchedr� r� �KeyErrorr2 r� rA rA rB r, � s � �
r, c s: t tdd�stj td< � � fdd�} | t_dt_d S d S )Nr3 Fr4 c sT | j }|j}|r |js t|�dkr |js d|_| j|i |��S � | g|�R i |��S )Nr5 )r �top�
_protectedr� r� r� )r^ r~ rp �stackri ��origrA rB �__protected_call__� s
z5_install_stack_protection.<locals>.__protected_call__T)rX rF r� r6 r3 )r= rA r; rB r- � s
�r- rK )�r� r
r ry �time� collectionsr �typingr r r r r r r r
r �warningsr �billiard.einfor
r �kombu.exceptionsr �kombu.serializationr �
loads_messager �kombu.utils.encodingr r r �celery.loaders.appr r r r �
celery._stater �celery.app.taskr r rF �celery.exceptionsr r r r r �
celery.resultr �celery.utils.logr! �celery.utils.nodenamesr" �celery.utils.objectsr# �celery.utils.safereprr$ �celery.utils.serializationr% r& r' �__all__�celery.worker.stater- r� r> � LOG_RECEIVEDr� � LOG_FAILURE�LOG_INTERNAL_ERRORr� � LOG_REJECTEDr� r. �WARNrM r rN �CRITICALrP rR �ERRORrS r r� r� r r� r r� r� r� r� r� re rg �EXCEPTION_STATES� frozensetr� r$ r6 r7 r9 rJ rV r[ r( r� r� r� �local� PromiseProxy�loadersr� � AppLoaderr �Celery�intr) r* r� r# r& r� r+ r, r- rA rA rA rB �<module> s� , � � � �
s��� ������ �
� � �"
�
5
�
�