File: //usr/local/lib/python3.10/dist-packages/langsmith/__pycache__/pytest_plugin.cpython-310.pyc
o
���gc2 � @ s d Z ddlZddlZddlZddlZddlZddlmZ ddl m
Z
ddl Z ddl m
Z ddlmZ e�e�Zdd� Zd d
� Ze j�d �rJd d
� Zndd� Ze jdd�dd� �Z e jdd� �Z G dd� d�Z dd� Z de de!d e fd d �Z"d e de!d e fd d!�Z#dS )"zLangSmith Pytest hooks.� N)� defaultdict)�Lock)�utils)�testc C sD z| � dd�}|jddddd� W d S ty! t�d� Y d S w )
zaSet a boolean flag for LangSmith output.
Skip if --langsmith-output is already defined.
� langsmith� LangSmith�--langsmith-output�
store_trueFz'Use LangSmith output (requires 'rich').)�action�default�helpzCLangSmith output flag cannot be added because it's already defined.N)�getgroup� addoption�
ValueError�logger�warning)�parser�group� r �B/usr/local/lib/python3.10/dist-packages/langsmith/pytest_plugin.py�pytest_addoption s �
��r c sf t � fdd�dD ��r/t � fdd�dD ��s � �dd� t � fdd�d D ��s1� �dd
� d S d S d S ) zHandle output arguments.c 3 � � | ]}|� v V qd S �Nr )�.0�opt��argsr r � <genexpr>* � � z&_handle_output_args.<locals>.<genexpr>)r c 3 r r r �r �ar r r r , r )�-qqr r! c 3 r r r r r r r r / r )�-sz --capture=nor" N)�any�insertr r r r �_handle_output_args( s �r% z7.c C s t |� dS )zCCall immediately after command line options are parsed (pytest v7).N�r% )�configr r r r �pytest_cmdline_preparse5 � r( c C s t | � dS )zHandle args in pytest v8+.Nr& r r r r � pytest_load_initial_conftests; r) r* T)� hookwrapperc c s� � | � d�}|rF|r
|jni }| j}tdi |��|�| _t| dd�}|durFd| jvrF|| jd< t| j�| jjd | jj | jj
| jj d�| _dV dS )zEApply LangSmith tracking to tests marked with @pytest.mark.langsmith.r �_requestN�request)r- )�argnames� initialnames�
names_closure�name2fixturedefsr ) �get_closest_marker�kwargs�obj�ls_test�getattr�funcargs�type� _fixtureinfor. r/ r0 r1 )�item�markerr3 �
original_func� request_objr r r �pytest_runtest_call@ s �
�
r> c C s |� d�rdS dS )z7Remove the short test-status character outputs ("./F").r )� r? r? N)� getoption)�reportr' r r r �pytest_report_teststatusX s
�rB c @ s^ e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd d
� Z de
fdd�Z dd� Z dd� Z
dS )�LangSmithPluginz'Plugin for rendering LangSmith results.c C sp ddl m} ddlm} tt�| _i | _i | _t � | _
|� | _ || � � | j dd�| _
| j
�� | j
j �d� dS )z Initialize.r )�Console)�Live�
)�console�refresh_per_secondzCollecting tests...N)� rich.consolerD � rich.liverE r �list� test_suites�test_suite_urls�process_statusr � status_lockrG �generate_tables�live�start�print)�selfrD rE r r r �__init__d s
�
zLangSmithPlugin.__init__c C s& t � | _|jD ] }| j�|j� qdS )zHCall after collection phase is completed and session.items is populated.N)�set�collected_nodeids�items�add�nodeid)rT �sessionr: r r r �pytest_collection_finishv s
�z(LangSmithPlugin.pytest_collection_finishc C s | j | �|� dS )z&Group a test case with its test suite.N)rL �append)rT �
test_suite�
process_idr r r �add_process_to_test_suite| � z)LangSmithPlugin.add_process_to_test_suitec C s | j s
| jj�d� | j�h | j �|i �}|�d�r)i |�di ��|�d��|d< |�d�r=i |�di ��|�d��|d< |�d�rQi |�di ��|�d��|d< |�d�rei |�di ��|�d��|d< i |�|�| j |< W d � n1 sxw Y | j�| �� � dS )zUpdate test results.zRunning tests...�feedback�inputs�reference_outputs�outputsN) rN rQ rG rS rO �get�pop�updaterP )rT r_ �status�current_statusr r r �update_process_status� s>
��
��
��
�� �z%LangSmithPlugin.update_process_statusc C s | � |ddi� dS )z/Initialize live display when first test starts.ri �runningN)rk )rT rZ r r r �pytest_runtest_logstart� ra z'LangSmithPlugin.pytest_runtest_logstartc C s< ddl m} g }| jD ] }| �|�}|�|� q ||� }|S )u� Generate a collection of tables—one per suite.
Returns a 'Group' object so it can be rendered simultaneously by Rich Live.
r )�Group)rI rn rL �_generate_tabler] )rT rn �tables�
suite_name�tabler r r r rP � s
z LangSmithPlugin.generate_tablesrq c sj ddl m} �j| }d|� d�j| � d�}||dd�}|�d� |�d � |�d
� |�d � |�d � |�d
� |�d� td�}td�}t�� }g } tt�}
�fdd�|D �} | � � D ]G\} }
|
�
d|�|
�
d|� }| � |� |
�
di �� � D ]\}}t |t
ttf�r�|
| � |� q|tt|d�d��|�}tt|
�
dd��|�}q_tdd� | �� D ��}tdd� | �� D ��}|| r�||| }|d kr�d nd }d |� d |d!�d"|� d �}nd#}| r�t| �t| � d�d�}nd$}|
r�d%�d&d� |
� � D ��}nd'}t|t|��}�jj|| d( � t� d)�� | � � D ]�\} }
d*d d d+d,��
|
�
dd�d-�}|
�
d|�|
�
d|� }d%�� fd.d�|
�
di �� � D ��}t�|
�
d/i ��}t�|
�
d0i ��}t�|
�
d1i ��} |�tt| �� d2�t|� d2�t|� d2�t| � d2�� d3� d |� d |
�
dd�� d"|� d �||d�d�� �q|�d4d4d4d4d4d4d4� |�d5d4d4d4|||� |S )6zGenerate results table.r )�TablezTest Suite: [bold]z$[/bold]
LangSmith URL: [bright_cyan]z[/bright_cyan]�left)�title�
title_justify�Test�Inputsz Ref outputs�Outputs�Status�Feedback�Durationri �durationc s i | ]}|� j | �qS r )rN )r �pid)rT r r �
<dictcomp>� s z3LangSmithPlugin._generate_table.<locals>.<dictcomp>�end_time�
start_timerb z.2f�s�queuedc s � � | ]
}|� d �dkV qdS )ri �passedN�rf �r r� r r r r � � � z2LangSmithPlugin._generate_table.<locals>.<genexpr>c s r� )ri �failedNr� r� r r r r � r� � �green�red�[�]z.0%z[/z
Passed: --z--s�
c s s. � | ]\}}|� d t |�t|� � �V qdS )�: N)�sum�len�r �k�vr r r r � s �
�z--� � �yellow�cyan)rl r� r� �skipped�whitec 3 s< � | ]\}}t |� d �� dt|t�rt|�n|� �V qdS )��max_lenr� N)� _abbreviate�
isinstance�bool�intr� )�max_dynamic_col_widthr r r � s
� &�
�rc rd re r� Nr? z[bold]Averages[/bold]) �
rich.tablers rL rM �
add_columnr� �timer rK rX rf r] r� �floatr� r� �maxr� �values�joinrG �width�json�dumps�add_row�_abbreviate_test_name�strr� ) rT rq rs � process_idsru rr �
max_status� max_duration�now� durations�numeric_feedbacks�suite_statusesr~ ri r} r� r� � passed_count� failed_count�rate�color�aggregate_status�aggregate_duration�aggregate_feedback� status_colorrb rc rd re r )r� rT r ro � s�
�
�
�
���
�
�
�
z LangSmithPlugin._generate_tablec C s* d|j _|j�d�}|rdd� |_dS dS )z9Disable warning reporting and show no warnings in output.Fzwarnings-pluginc _ s d S r r )r r3 r r r �<lambda> s z2LangSmithPlugin.pytest_configure.<locals>.<lambda>N)�option� showwarnings�
pluginmanager�
get_plugin�warning_summary)rT r' �reporterr r r �pytest_configure s
�z LangSmithPlugin.pytest_configurec C s | j �� | j j�d� dS )z3Stop Rich Live rendering at the end of the session.z
Finishing up...N)rQ �stoprG rS )rT r[ r r r �pytest_sessionfinish! s
z$LangSmithPlugin.pytest_sessionfinishN)�__name__�
__module__� __qualname__�__doc__rU r\ r` rk rm rP r� ro r� r� r r r r rC a s f
rC c C sz | � dd� | �d�r;tj�d�sd}t|��tj�d�r#d}t|��t �
� r-d}t|��| j � t
� d � d
| j_d S d S ) z Register the 'langsmith' marker.�markersz/langsmith: mark test to be tracked in LangSmithr �richzoMust have 'rich' installed to use --langsmith-output. Please install with: `pip install -U 'langsmith[pytest]'`�PYTEST_XDIST_TESTRUNUIDzq--langsmith-output not supported with pytest-xdist. Please remove the '--langsmith-output' option or '-n' option.z�--langsmith-output not supported when env varLANGSMITH_TEST_TRACKING='false'. Please remove the'--langsmith-output' option or enable test tracking.�langsmith_output_pluginFN)�addinivalue_liner@ � importlib�util� find_specr �os�environrf �ls_utils�test_tracking_is_disabledr� �registerrC r� r� )r' �msgr r r r� ' s& �
� �� �r� �xr� �returnc C s$ t | �|kr| d |d � d S | S )N� �...)r� )r� r� r r r r� F s r� � test_namec C sn t | �|kr5| �d�\}}t d| �|kr d||d d � S |t d| � }d|| d � d | S | S )Nz::z.py::r� r� z...::)r� �split)r� r� �filer �file_lenr r r r� M s r� )$r� �importlib.utilr� r� �loggingr� r� � collectionsr � threadingr �pytestr r r� �langsmith.testing._internalr r5 � getLoggerr� r r r% � __version__�
startswithr( r* �hookimplr> rB rC r� r� r� r� r� r r r r �<module> s4
G