File: //usr/local/lib/python3.10/dist-packages/tiktoken/__pycache__/registry.cpython-310.pyc
o
;��g� � @ s� U d dl mZ d dlZd dlZd dlZd dlZd dlmZmZm Z d dl
Z
d dl Z d dl m
Z
e�� Zi Zded< daded< ejdd d ��Zddd�Zddd�Zddd�ZdS ) � )� annotationsN)�Any�Callable�Sequence)�Encodingzdict[str, Encoding]� ENCODINGSz.dict[str, Callable[[], dict[str, Any]]] | None�ENCODING_CONSTRUCTORS�return�
Sequence[str]c C s6 g } t �tjtjd �}|D ]
\}}}| �|� q| S )N�.)�pkgutil� iter_modules� tiktoken_ext�__path__�__name__�append)�mods� plugin_mods�_�mod_name� r �</usr/local/lib/python3.10/dist-packages/tiktoken/registry.py�_available_plugin_modules s
r �Nonec C s� t �f td ur W d � d S i azCt� D ]=} t�| �}z|j}W n ty7 } z td| � d��|�d }~ww |�� D ]\}}|tv rNtd|� d| � ���|t|< q<qW n
ty_ d a� w W d � d S 1 skw Y d S )Nztiktoken plugin z& does not define ENCODING_CONSTRUCTORSzDuplicate encoding name z in tiktoken plugin ) �_lockr r � importlib�
import_module�AttributeError�
ValueError�items� Exception)r �mod� constructors�e�enc_name� constructorr r r �_find_constructors! s@ �
�����
�� ��"�r& �
encoding_name�strr c C s� t | t�stdt| �� ���| tv rt| S t�J | tv r(t| W d � S td u r5t� td us5J �| tvrItd| � dt� � dt j
� d���t| }t di |� ��}|t| < |W d � S 1 sew Y d S )Nz'Expected a string in get_encoding, got zUnknown encoding z.
Plugins found: z
tiktoken version: z (are you on latest?)r ) �
isinstancer( r �typer r r r& r �tiktoken� __version__r )r' r% �encr r r � get_encoding? s0
� ���$�r. � list[str]c C sJ t � td u rt� td usJ �tt�W d � S 1 s w Y d S )N)r r r& �listr r r r �list_encoding_names[ s $�r1 )r r
)r r )r' r( r r )r r/ )�
__future__r � functoolsr r � threading�typingr r r r r+ �
tiktoken.corer �RLockr r �__annotations__r � lru_cacher r& r. r1 r r r r �<module> s"