File: //usr/local/lib/python3.10/dist-packages/langchain/memory/__pycache__/entity.cpython-310.pyc
o
���gC � @ s� d Z ddlZddlmZmZ ddlmZ ddlmZm Z m
Z
m Z m Z ddl
mZ ddlmZ ddlmZmZ dd lmZ dd
lmZmZmZ dd lmZ dd l m Z dd
l m Z m Z ddl!m"Z" e�#e$�Z%edddd�G dd� dee��Z&edddd�G dd� de&��Z'edddd�G dd� de&��Z(edddd�G dd� de&��Z)edddd�G dd � d e&��Z*edddd�G d d � d e ��Z+dS ) zJDeprecated as of LangChain v0.3.4 and will be removed in LangChain v1.0.0.� N)�ABC�abstractmethod)�islice)�Any�Dict�Iterable�List�Optional)�
deprecated)�BaseLanguageModel)� BaseMessage�get_buffer_string)�BasePromptTemplate)� BaseModel�
ConfigDict�Field)�LLMChain)�BaseChatMemory)�ENTITY_EXTRACTION_PROMPT�ENTITY_SUMMARIZATION_PROMPT)�get_prompt_input_keyz0.3.1z1.0.0z_Please see the migration guide at: https://python.langchain.com/docs/versions/migrating_memory/)�since�removal�messagec @ s� e Zd ZdZeddedee dee fdd��Zededee ddfd d
��Zededdfd d ��Z edede
fd
d��Z eddd��Z dS )�BaseEntityStorez%Abstract base class for Entity store.N�key�default�returnc C � dS )z Get entity value from store.N� ��selfr r r r �B/usr/local/lib/python3.10/dist-packages/langchain/memory/entity.py�get$ � zBaseEntityStore.get�valuec C r )zSet entity value in store.Nr �r! r r% r r r" �set) r$ zBaseEntityStore.setc C r )z Delete entity value from store.Nr �r! r r r r" �delete. r$ zBaseEntityStore.deletec C r )z Check if entity exists in store.Nr r( r r r" �exists3 r$ zBaseEntityStore.existsc C r )z Delete all entities from store.Nr �r! r r r" �clear8 r$ zBaseEntityStore.clear�N�r N)
�__name__�
__module__� __qualname__�__doc__r �strr r# r' r) �boolr* r, r r r r" r s " r c @ s� e Zd ZU dZi Zeeee f ed< ddedee dee fdd�Z ded ee ddfd
d �Z
deddfd d
�Z dede fdd�Z
ddd�ZdS )�InMemoryEntityStorezIn-memory Entity store.�storeNr r r c C s | j �||�S r- )r6 r# r r r r" r# K � zInMemoryEntityStore.getr% c C s || j |< d S r- �r6 r& r r r" r' N r7 zInMemoryEntityStore.setc C s | j |= d S r- r8 r( r r r" r) Q s zInMemoryEntityStore.deletec C s
|| j v S r- r8 r( r r r" r* T �
zInMemoryEntityStore.existsc C s
| j �� S r- )r6 r, r+ r r r" r, W r9 zInMemoryEntityStore.clearr- r. )r/ r0 r1 r2 r6 r r3 r �__annotations__r# r' r) r4 r* r, r r r r" r5 > s
r5 c s� e Zd ZdZ d!deded ed
ed ee d ee d
edef� fdd�
Ze defdd��Z
d"dedee dee fdd�Z dedee ddfdd�Z deddfdd �Z
dedefd d �Zd#d d �Z� ZS )$�UpstashRedisEntityStorez�Upstash Redis backed Entity store.
Entities get a TTL of 1 day by default, and
that TTL is extended by 3 days every time the entity is read back.
r � � memory_store�Q �� �
session_id�url�token�
key_prefix�ttl�
recall_ttl�args�kwargsc
s� zddl m} W n ty td��w t� j|i |�� z | ||d�| _W n ty4 t�d� Y nw || _ || _
|| _ |pA|| _ d S )Nr )�RediszbCould not import upstash_redis python package. Please install it with `pip install upstash_redis`.)rA rB z.Upstash Redis instance could not be initiated.)
�
upstash_redisrH � ImportError�super�__init__� redis_client� Exception�logger�errorr@ rC rD rE )
r! r@ rA rB rC rD rE rF rG rH �� __class__r r" rL j s" �� �z UpstashRedisEntityStore.__init__r c C � | j � d| j� �S �N�:�rC r@ r+ r r r" �full_key_prefix� � z'UpstashRedisEntityStore.full_key_prefixNr c C �J | j j| j� d|� �| jd�p|pd}t�d| j� d|� d|� d�� |S )NrU ��exr< zUpstash Redis MEM get '�': '�'�rM �getexrW rE rO �debug�r! r r �resr r r" r# � � �� zUpstashRedisEntityStore.getr% c
C �X |s| � |�S | jj| j� d|� �|| jd� t�d| j� d|� d|� d| j� �� d S )NrU rZ zRedis MEM set 'r\ �' EX �r) rM r' rW rD rO r` r& r r r" r' � �
�zUpstashRedisEntityStore.setc C � | j �| j� d|� �� d S rT �rM r) rW r( r r r" r) � � z UpstashRedisEntityStore.deletec C � | j �| j� d|� ��dkS �NrU � �rM r* rW r( r r r" r* � rj z UpstashRedisEntityStore.existsc s> dt dt f� fdd� }|d�}|dkr ||� |dksd S d S )N�cursorr c s* � j �| � j� d��\} }� j j|� | S )N�:*)rM �scanrW r) )ro �keys_to_deleter+ r r" �scan_and_delete� s
� z6UpstashRedisEntityStore.clear.<locals>.scan_and_deleter )�int)r! rs ro r r+ r" r, � s
�z UpstashRedisEntityStore.clear)r r< r< r= r> r? r- r. )r/ r0 r1 r2 r3 r rt r rL �propertyrW r# r' r) r4 r* r, �
__classcell__r r rQ r" r; [ s@ �������� � r; c s e Zd ZU dZeed< dZeed< dZeed< dZ e
e ed< d Z e
e ed
< d!ded edede
e d
e
e d
edef� fdd�
Z
edefdd��Zd"dede
e de
e fdd�Zdede
e ddfdd�Zdeddfdd �Zdedefd d �Zd#d d �Z� ZS )$�RedisEntityStorez�Redis-backed Entity store.
Entities get a TTL of 1 day by default, and
that TTL is extended by 3 days every time the entity is read back.
rM r r@ r= rC r> rD r? rE �redis://localhost:6379/0rA rF rG c
s� zdd l }W n ty td��w t� j|i |�� zddlm} W n ty. td��w z | |dd�| _W n |jjyQ }
z t �
|
� W Y d }
~
nd }
~
ww || _ || _ || _
|p^|| _d S )Nr zRCould not import redis python package. Please install it with `pip install redis`.)�
get_clientzzCould not import langchain_community.utilities.redis.get_client. Please install it with `pip install langchain-community`.T)� redis_url�decode_responses)�redisrJ rK rL �#langchain_community.utilities.redisry rM �
exceptions�ConnectionErrorrO rP r@ rC rD rE ) r! r@ rA rC rD rE rF rG r| ry rP rQ r r" rL � s2
�� ����zRedisEntityStore.__init__r c C rS rT rV r+ r r r" rW � rX z RedisEntityStore.full_key_prefixNr c C rY )NrU rZ r< zREDIS MEM get 'r\ r] r^ ra r r r" r# � rc zRedisEntityStore.getr% c
C rd )NrU rZ zREDIS MEM set 'r\ re rf r& r r r" r' � rg zRedisEntityStore.setc C rh rT ri r( r r r" r) rj zRedisEntityStore.deletec C rk rl rn r( r r r" r* rj zRedisEntityStore.existsc C sN dt t dtdt t fdd�}|| j�| j� d��d�D ]}| jj|� q d S )N�iterable�
batch_sizer c s s< � t | �}tt||�� }r |V tt||�� }sd S d S r- )�iter�listr )r� r� �iterator�batchr r r" �batched s
��z'RedisEntityStore.clear.<locals>.batchedrp i� )r r rt rM � scan_iterrW r) )r! r� �keybatchr r r" r, s ��zRedisEntityStore.clear)r rx r= r> r? r- r. )r/ r0 r1 r2 r r: r@ r3 rC rD r rt rE rL ru rW r# r' r) r4 r* r, rv r r rQ r" rw � sD
��������& rw c s� e Zd ZU dZdZeed< dZeed< dZe ed< e
dd �Z
d!ded eded e d
e f
� fdd�
Z e
defdd��Zd"dd�Zd#dedee dee fdd�Zdedee ddfdd�Zdeddfdd �Zdedefd d �Zd"d d �Z� ZS )$�SQLiteEntityStorezSQLite-backed Entity storer r@ r= �
table_nameN�connT)�arbitrary_types_allowed� entities.db�db_filerF rG c sZ zdd l }W n ty td��w t� j|i |�� |�|�| _|| _|| _| �� d S )Nr zVCould not import sqlite3 python package. Please install it with `pip install sqlite3`.) �sqlite3rJ rK rL �connectr� r@ r� �_create_table_if_not_exists)r! r@ r� r� rF rG r� rQ r r" rL ' s �� zSQLiteEntityStore.__init__r c C rS )N�_)r� r@ r+ r r r" �full_table_name= rX z!SQLiteEntityStore.full_table_namec C �F d| j � d�}| j� | j�|� W d � d S 1 s w Y d S )Nz(
CREATE TABLE IF NOT EXISTS zZ (
key TEXT PRIMARY KEY,
value TEXT
)
�r� r� �execute)r! �create_table_queryr r r" r� A s �"�z-SQLiteEntityStore._create_table_if_not_existsr c C s> d| j � d�}| j�||f�}|�� }|d ur |d }|S |S )Nz+
SELECT value
FROM �#
WHERE key = ?
r �r� r� r� �fetchone)r! r r �queryro �resultr% r r r" r# K s �zSQLiteEntityStore.getr% c C sZ |s| � |�S d| j� d�}| j� | j�|||f� W d � d S 1 s&w Y d S )Nz$
INSERT OR REPLACE INTO z0 (key, value)
VALUES (?, ?)
)r) r� r� r� )r! r r% r� r r r" r' X s
�"�zSQLiteEntityStore.setc C sJ d| j � d�}| j� | j�||f� W d � d S 1 s w Y d S )N�
DELETE FROM r� r� )r! r r� r r r" r) b s �"�zSQLiteEntityStore.deletec C s. d| j � d�}| j�||f�}|�� }|d uS )Nz'
SELECT 1
FROM z7
WHERE key = ?
LIMIT 1
r� )r! r r� ro r� r r r" r* j s �zSQLiteEntityStore.existsc C r� )Nr� z
r� )r! r� r r r" r, u s �"�zSQLiteEntityStore.clear)r r� r= r. r- )r/ r0 r1 r2 r@ r3 r: r� r� r r � model_configrL ru r� r� r r# r' r) r4 r* r, rv r r rQ r" r� s<
�������
r� c s
e Zd ZU dZdZeed< dZeed< eed< e Z
e ed< e Z
e ed< g Zee ed < d
Zeed < d Zeed
< eed�Zeed< edee fdd��Zedee fdd��Zdeee f deee f fdd�Z deee f deeef ddf� fdd� Z d d d �Z � Z S ) �ConversationEntityMemorya< Entity extractor & summarizer memory.
Extracts named entities from the recent chat history and generates summaries.
With a swappable entity store, persisting entities across conversations.
Defaults to an in-memory entity store, and can be swapped out for a Redis,
SQLite, or other entity store.
�Human� human_prefix�AI� ai_prefix�llm�entity_extraction_prompt�entity_summarization_prompt� entity_cache� �k�history�chat_history_key)�default_factory� entity_storer c C s | j jS )z Access chat memory messages.)� chat_memory�messagesr+ r r r" �buffer� s z ConversationEntityMemory.bufferc C s
d| j gS )zMWill always return list of memory variables.
:meta private:
�entities)r� r+ r r r" �memory_variables� s
z)ConversationEntityMemory.memory_variables�inputsc
C s� t | j| jd�}| jdu rt|| j�}n| j}t| j| j d d� | j | j
d�}|j ||| d�}|� � dkr;g }n
dd� |�
d �D �}i }|D ] }| j�|d
�||< qI|| _| jrg| j| j d d� } n|} | j| d |iS ) ae
Returns chat history and all generated entities with summaries if available,
and updates or clears the recent entity cache.
New entity name can be found when calling this method, before the entity
summaries are generated, so the entity cache values may be empty if no entity
descriptions are generated yet.
�r� �promptN� �r� r� )r� �input�NONEc S s g | ]}|� � �qS r )�strip)�.0�wr r r" �
<listcomp>� s zBConversationEntityMemory.load_memory_variables.<locals>.<listcomp>�,r< r� )r r� r� � input_keyr r� r
r� r� r� r� �predictr� �splitr� r# r� �return_messagesr� )
r! r� �chain�prompt_input_key�
buffer_string�outputr� �entity_summaries�entityr� r r r" �load_memory_variables� s4
� � �z.ConversationEntityMemory.load_memory_variables�outputsNc
s� t � �||� | jdu rt|| j�}n| j}t| j| j d d� | j| j d�}|| }t
| j | j d�}| j
D ]}| j�|d�}|j||||d�} | j�|| �� � q7dS )z�
Save context from this conversation history to the entity store.
Generates a summary for each entity in the entity cache by prompting
the model, and saves these summaries to the entity store.
Nr� r� r� r< )�summaryr� r� r� )rK � save_contextr� r r� r
r� r� r� r� r r� r� r� r� r# r� r' r� )
r! r� r� r� r� �
input_datar� r� �existing_summaryr� rQ r r" r� � s*
�
��z%ConversationEntityMemory.save_contextc C s" | j �� | j�� | j�� dS )zClear memory contents.N)r� r, r� r� r+ r r r" r, s
z ConversationEntityMemory.clearr. )!r/ r0 r1 r2 r� r3 r: r� r r r� r r r� r� r r� rt r� r r5 r� r ru r r� r� r r r� r� r, rv r r rQ r" r� } s$
"*A*r� ),r2 �logging�abcr r � itertoolsr �typingr r r r r �langchain_core._apir
� langchain_core.language_modelsr �langchain_core.messagesr r
�langchain_core.promptsr �pydanticr r r �langchain.chains.llmr � langchain.memory.chat_memoryr �langchain.memory.promptr r �langchain.memory.utilsr � getLoggerr/ rO r r5 r; rw r� r� r r r r" �<module> sf
� ��N�[�a�