File: //proc/self/root/usr/local/lib/python3.10/dist-packages/tiktoken/__pycache__/model.cpython-310.pyc
o
;��g� �
@ sV U d dl mZ ddlmZ ddlmZ ddddddddddddd� Zded < i d
d�d d�d d�d
d�dd�dd�dd�dd�dd�dd�dd�dd�dd�dd�dd�dd�d d�i d d�d d�d d�d d�d!d�d"d�d#d�d$d�d%d�d&d�d'd�d(d)�d*d)�d+d�d,d�d-d�d.d��ddddddd/d/d0��Zded1< d;d5d6�Z d<d8d9�Z
d:S )=� )� annotations� )�Encoding)� get_encoding�
o200k_base� cl100k_base) zo1-zo3-z chatgpt-4o-zgpt-4o-zgpt-4-zgpt-3.5-turbo-z
gpt-35-turbo-z ft:gpt-4ozft:gpt-4zft:gpt-3.5-turbozft:davinci-002zft:babbage-002zdict[str, str]�MODEL_PREFIX_TO_ENCODING�o1�o3zgpt-4ozgpt-4z
gpt-3.5-turbozgpt-3.5z gpt-35-turboz davinci-002z babbage-002ztext-embedding-ada-002ztext-embedding-3-smallztext-embedding-3-largeztext-davinci-003� p50k_baseztext-davinci-002ztext-davinci-001� r50k_baseztext-curie-001ztext-babbage-001z text-ada-001�davinci�curie�babbage�adazcode-davinci-002zcode-davinci-001zcode-cushman-002zcode-cushman-001z
davinci-codexz
cushman-codexztext-davinci-edit-001� p50k_editzcode-davinci-edit-001ztext-similarity-davinci-001ztext-similarity-curie-001ztext-similarity-babbage-001ztext-similarity-ada-001�gpt2)ztext-search-davinci-doc-001ztext-search-curie-doc-001ztext-search-babbage-doc-001ztext-search-ada-doc-001z code-search-babbage-code-001zcode-search-ada-code-001r zgpt-2�MODEL_TO_ENCODING�
model_name�str�returnc C sX d}| t v r t | }nt�� D ]
\}}| �|�r | S q|du r*td| � d��d�|S )zrReturns the name of the encoding used by a model.
Raises a KeyError if the model name is not recognised.
Nz Could not automatically map z_ to a tokeniser. Please use `tiktoken.get_encoding` to explicitly get the tokeniser you expect.)r r �items�
startswith�KeyError)r �
encoding_name� model_prefix�model_encoding_name� r �9/usr/local/lib/python3.10/dist-packages/tiktoken/model.py�encoding_name_for_modelP s
�
��r r c C s t t| ��S )zfReturns the encoding used by a model.
Raises a KeyError if the model name is not recognised.
)r r )r r r r �encoding_for_modeli s r N)r r r r )r r r r ) �
__future__r �corer �registryr r �__annotations__r r r r r r r �<module> s� ������� � � ������������� � � � �!�"�#�%�&�(�)�*�+�,�
8