File: //usr/local/lib/python3.10/dist-packages/langsmith/__pycache__/anonymizer.cpython-310.pyc
o
���g � @ s> d dl Z d dlZd dlmZ d dlmZ d dlmZmZm Z m
Z
m Z m Z m
Z
G dd� de �ZG dd� de �Zd ed
ed e e fd d
�ZG dd� d�ZG dd� de �ZG dd� de �ZG dd� de�ZG dd� de�Ze
eee e
eef gef e e ef Zded efdd�Zdd�ded e
e d eegef fd d �ZdS ) � N)�abstractmethod)� defaultdict)�Any�Callable�List�Optional�Tuple� TypedDict�Unionc @ s e Zd ZU ee ed< dS )�_ExtractOptions� max_depthN)�__name__�
__module__� __qualname__r �int�__annotations__� r r �?/usr/local/lib/python3.10/dist-packages/langsmith/anonymizer.pyr s
r c @ s0 e Zd ZU dZeed< eeeef ed< dS )�
StringNodez$String node extracted from the data.�value�pathN) r
r r �__doc__�strr r r
r r r r r r s
r �data�options�returnc
C s� |� d�pd}| dg fg}g }|rt|�d�}|d u rq|\}}}t|ttf�rC||kr,q|�� D ]\} }
|�|
|d || g f� q0n/t|t�rd||krMqt|�D ]\} } |�| |d || g f� qQnt|t �rr|�t
||d�� |s|S )Nr �
r � �r r ) �get�pop�
isinstance�dictr �items�append�list� enumerater r )
r r r �queue�result�taskr �depthr �key� nested_value�i�itemr r r �_extract_string_nodes s0
�
�
�r/ c @ s. e Zd ZdZedee dee fdd��ZdS )�StringNodeProcessorz-Processes a list of string nodes for masking.�nodesr c C s dS )z6Accept and return a list of string nodes to be masked.Nr )�selfr1 r r r �
mask_nodes8 s z StringNodeProcessor.mask_nodesN)r
r r r r r r r3 r r r r r0 5 s r0 c @ s, e Zd ZU dZee ed< ee ed< dS )�ReplacerOptionsz3Configuration options for replacing sensitive data.r �
deep_cloneN)r
r r r r r r �boolr r r r r4 = s
r4 c @ s* e Zd ZU dZejed< ee ed< dS )�StringNodeRulez3Declarative rule used for replacing sensitive data.�pattern�replaceN) r
r r r �re�Patternr r r r r r r r7 G s
r7 c @ sL e Zd ZU dZee ed< dee fdd�Zdee dee fdd�Z d S )
�RuleNodeProcessorzJString node processor that uses a list of rules to replace sensitive data.�rulesc C s dd� |D �| _ dS )z.Initialize the processor with a list of rules.c S sP g | ]$}t |d tj�r|d nt�|d �t |�d�t�r"|d ndd��qS )r8 r9 z
[redacted])r8 r9 )r! r: r; �compiler r )�.0�ruler r r �
<listcomp>] s
�
�
���z.RuleNodeProcessor.__init__.<locals>.<listcomp>N�r= )r2 r= r r r �__init__[ s
�zRuleNodeProcessor.__init__r1 r c C s\ g }|D ]'}|d }| j D ] }|d �|d |�}q
||d kr+|�t||d d�� q|S )zMask nodes using the rules.r r8 r9 r r )r= �subr$ r )r2 r1 r( r. � new_valuer@ r r r r3 m s
�z RuleNodeProcessor.mask_nodesN)
r
r r r r r7 r rC r r3 r r r r r< Q s
r< c @ s� e Zd ZU dZeeegef eeeeeef gef f e d< e
e d< deeegef eeeeeef gef f fdd�Z dee dee fdd �Z
d
S ) �CallableNodeProcessorzNString node processor that uses a callable function to replace sensitive data.�func� accepts_pathc C s || _ tt�|�j�dk| _dS )z2Initialize the processor with a callable function.� N)rG �len�inspect� signature�
parametersrH )r2 rG r r r rC � s z CallableNodeProcessor.__init__r1 r c C s\ g }|D ]'}| j r| �|d |d �n| �|d �}||d kr+|�t||d d�� q|S )z'Mask nodes using the callable function.r r r )rH rG r$ r )r2 r1 �retval�node� candidater r r r3 � s � � �z CallableNodeProcessor.mask_nodesN)r
r r r r
r r r r r r6 rC r r3 r r r r rF y s
2,
� rF �replacerc C s* t | t�r
t| d�S t| �rt| d�S | S )NrB )rG )r! r% r< �callablerF )rQ r r r �_get_node_processor� s
rS )r r c s$ t | ��dtdtf� �fdd� }|S )z Create an anonymizer function.r r c sz t | d� pdi�}| }��|�}|D ](}|d s |d }q|}|d d d� D ]}|| }q'|d d }|d ||< q|S )Nr r r r ���)r/ r3 )r r1 � mutate_value� to_updaterO �temp�part� last_part�r � processorr r �
anonymizer� s
z%create_anonymizer.<locals>.anonymizer)rS r )rQ r r\ r rZ r �create_anonymizer� s r] )r: rK �abcr � collectionsr �typingr r r r r r r
r r r/ r0 r4 r7 r< rF r r � ReplacerTyperS r] r r r r �<module> s8 $
(&�� ��� �