File: //usr/local/lib/python3.10/dist-packages/charset_normalizer/__pycache__/models.cpython-310.pyc
o
;��gj0 � @ s� d dl mZ d dlmZ d dlmZ d dlmZ d dlm Z d dl
m Z m Z m
Z
mZ ddlmZmZ dd lmZmZmZ G d
d � d �ZG d d
� d
�Zeeef Ze
e ZG dd� d�Z dS )� )� annotations)�aliases)�sha256)�dumps)�sub)�Any�Iterator�List�Tuple� )� RE_POSSIBLE_ENCODING_INDICATION�TOO_BIG_SEQUENCE)� iana_name�is_multi_byte_encoding�
unicode_rangec @ sH e Zd Z dGdHdd�ZdIdd�ZdIdd�ZedJdd��ZdKdd�ZdKd d �Z dLd d �Z
edKd!d"��Z edMd$d%��Z edNd&d'��Z
edNd(d)��ZedMd*d+��ZedKd,d-��ZedJd.d/��ZedJd0d1��ZedJd2d3��ZedJd4d5��ZedOd6d7��ZedPd9d:��ZedNd;d<��ZedMd=d>��ZedMd?d@��ZdQdRdCdD�ZedKdEdF��ZdS )S� CharsetMatchN�payload�bytes�guessed_encoding�str�mean_mess_ratio�float�has_sig_or_bom�bool� languages�CoherenceMatches�decoded_payload�
str | None�preemptive_declarationc C sL || _ || _|| _|| _|| _d | _g | _d| _d | _d | _ || _
|| _ d S )N� ) �_payload� _encoding�_mean_mess_ratio�
_languages�_has_sig_or_bom�_unicode_ranges�_leaves�_mean_coherence_ratio�_output_payload�_output_encoding�_string�_preemptive_declaration)�selfr r r r r r r � r- �D/usr/local/lib/python3.10/dist-packages/charset_normalizer/models.py�__init__ s
zCharsetMatch.__init__�other�object�returnc C s> t |t�st |t�rt|�| jkS dS | j|jko | j|jkS )NF)�
isinstancer r r �encoding� fingerprint�r, r0 r- r- r. �__eq__* s
zCharsetMatch.__eq__c C s� t |t�st�t| j|j �}t| j|j �}|dk r%|dkr%| j|jkS |dk r@|dkr@t| j�tkr:| j|jk S | j |j kS | j|jk S )zQ
Implemented to make sorted available upon CharsetMatches items.
g{�G�z�?g{�G�z�?)
r3 r �
ValueError�abs�chaos� coherence�lenr r
�multi_byte_usage)r, r0 �chaos_difference�coherence_differencer- r- r. �__lt__1 s
zCharsetMatch.__lt__c C s dt t| ��t | j� S )Ng �?)r< r �raw�r, r- r- r. r= G s z CharsetMatch.multi_byte_usagec C s" | j d u rt| j| jd�| _ | j S )N�strict)r* r r r! rB r- r- r. �__str__K s
zCharsetMatch.__str__c C s d| j � d| j� d�S )Nz<CharsetMatch 'z' bytes(z)>)r4 r5 rB r- r- r. �__repr__Q s zCharsetMatch.__repr__�Nonec C s8 t |t�r || krtd�|j���d |_| j�|� d S )Nz;Unable to add instance <{}> as a submatch of a CharsetMatch)r3 r r8 �format� __class__r* r& �appendr6 r- r- r. � add_submatchT s ��zCharsetMatch.add_submatchc C � | j S �N)r! rB r- r- r. r4 _ � zCharsetMatch.encoding� list[str]c C sD g }t �� D ]\}}| j|kr|�|� q| j|kr |�|� q|S )z�
Encoding name are known by many name, using this could help when searching for IBM855 when it's listed as CP855.
)r �itemsr4 rI )r, �
also_known_as�u�pr- r- r. �encoding_aliasesc s
�z CharsetMatch.encoding_aliasesc C rK rL �r$ rB r- r- r. �bomp rM zCharsetMatch.bomc C rK rL rT rB r- r- r. �byte_order_markt rM z CharsetMatch.byte_order_markc C s dd� | j D �S )z�
Return the complete list of possible languages found in decoded sequence.
Usually not really useful. Returned list may be empty even if 'language' property return something != 'Unknown'.
c S s g | ]}|d �qS )r r- )�.0�er- r- r. �
<listcomp>~ � z*CharsetMatch.languages.<locals>.<listcomp>�r# rB r- r- r. r x s zCharsetMatch.languagesc C sp | j s1d| jv r
dS ddlm}m} t| j�r || j�n|| j�}t|�dks+d|v r-dS |d S | j d d S )z�
Most probable language found in decoded sequence. If none were detected or inferred, the property will return
"Unknown".
�ascii�Englishr )�encoding_languages�mb_encoding_languagesz Latin Based�Unknown)r# �could_be_from_charset�charset_normalizer.cdr^ r_ r r4 r< )r, r^ r_ r r- r- r. �language� s
��zCharsetMatch.languagec C rK rL )r" rB r- r- r. r: � rM zCharsetMatch.chaosc C s | j sdS | j d d S )Nr r r r[ rB r- r- r. r; � s zCharsetMatch.coherencec C � t | jd dd�S �N�d � )�ndigits)�roundr: rB r- r- r. �
percent_chaos� � zCharsetMatch.percent_chaosc C rd re )ri r; rB r- r- r. �percent_coherence� rk z CharsetMatch.percent_coherencec C rK )z+
Original untouched bytes.
)r rB r- r- r. rA � s zCharsetMatch.raw�list[CharsetMatch]c C rK rL )r& rB r- r- r. �submatch� rM zCharsetMatch.submatchc C � t | j�dkS �Nr )r< r& rB r- r- r. � has_submatch� s zCharsetMatch.has_submatchc C s@ | j d ur| j S dd� t| �D �}ttdd� |D ���| _ | j S )Nc S s g | ]}t |��qS r- )r )rW �charr- r- r. rY � rZ z*CharsetMatch.alphabets.<locals>.<listcomp>c S s h | ]}|r|�qS r- r- )rW �rr- r- r. � <setcomp>� rZ z)CharsetMatch.alphabets.<locals>.<setcomp>)r% r �sorted�list)r, �detected_rangesr- r- r. � alphabets� s
zCharsetMatch.alphabetsc C s | j gdd� | jD � S )z�
The complete list of encoding that output the exact SAME str result and therefore could be the originating
encoding.
This list does include the encoding available in property 'encoding'.
c S s g | ]}|j �qS r- )r4 )rW �mr- r- r. rY � s z6CharsetMatch.could_be_from_charset.<locals>.<listcomp>)r! r& rB r- r- r. ra � s z"CharsetMatch.could_be_from_charset�utf_8r4 c s~ � j du s
� j |kr<|� _ t� �}� jdur5� j�� dvr5tt� fdd�|dd� dd�}||dd� }|�|d�� _� jS ) z�
Method to get re-encoded bytes payload using given target encoding. Default to UTF-8.
Any errors will be simply ignored by the encoder NOT replaced.
N)zutf-8�utf8rz c s< | j | �� d | �� d � �| �� d t� j��dd��S )Nr r �_�-)�string�span�replace�groupsr r) )ry rB r- r. �<lambda>� s
�z%CharsetMatch.output.<locals>.<lambda>i r )�countr� )r) r r+ �lowerr r �encoder( )r, r4 �decoded_string�patched_headerr- rB r. �output� s
�
�
zCharsetMatch.outputc C s t | �� ��� S )zw
Retrieve the unique SHA256 computed using the transformed (re-encoded) payload. Not the original one.
)r r� � hexdigestrB r- r- r. r5 � s zCharsetMatch.fingerprint)NN)r r r r r r r r r r r r r r )r0 r1 r2 r )r2 r �r2 r )r0 r r2 rF )r2 rN �r2 r )r2 r )r2 rm )rz )r4 r r2 r ) �__name__�
__module__� __qualname__r/ r7 r@ �propertyr= rD rE rJ r4 rS rU rV r rc r: r; rj rl rA rn rq rx ra r� r5 r- r- r- r. r
sX �
r c @ sb e Zd ZdZd d dd�Zd d d
�Zd!dd�Zd"dd�Zd#dd�Zd$dd�Z d%dd�Z
d%d d �Z dS )&�CharsetMatchesz�
Container with every CharsetMatch items ordered by default from most probable to the less one.
Act like a list(iterable) but does not implements all related methods.
N�results�list[CharsetMatch] | Nonec C s |r t |�| _d S g | _d S rL )ru �_results)r, r� r- r- r. r/ � s zCharsetMatches.__init__r2 �Iterator[CharsetMatch]c c s � | j E d H d S rL �r� rB r- r- r. �__iter__� s �zCharsetMatches.__iter__�item� int | strr c C sJ t |t�r
| j| S t |t�r#t|d�}| jD ] }||jv r"| S qt�)z�
Retrieve a single item either by its position or encoding name (alias may be used here).
Raise KeyError upon invalid index or encoding not present in results.
F)r3 �intr� r r ra �KeyError)r, r� �resultr- r- r. � __getitem__ s
�zCharsetMatches.__getitem__r� c C s
t | j�S rL �r< r� rB r- r- r. �__len__ s
zCharsetMatches.__len__r c C ro rp r� rB r- r- r. �__bool__ s zCharsetMatches.__bool__rF c C s| t |t�std�t|j����t|j�tk r0| j D ]}|j
|j
kr/|j |j kr/|� |� dS q| j �
|� t| j �| _ dS )z~
Insert a single match. Will be inserted accordingly to preserve sort.
Can be inserted as a submatch.
z-Cannot append instance '{}' to CharsetMatchesN)r3 r r8 rG r rH r< rA r
r� r5 r: rJ rI ru )r, r� �matchr- r- r. rI s
��
� zCharsetMatches.append�CharsetMatch | Nonec C s | j sdS | j d S )zQ
Simply return the first match. Strict equivalent to matches[0].
Nr r� rB r- r- r. �best) s
zCharsetMatches.bestc C s | � � S )zP
Redundant method, call the method best(). Kept for BC reasons.
)r� rB r- r- r. �first1 s zCharsetMatches.firstrL )r� r� )r2 r� )r� r� r2 r )r2 r� r� )r� r r2 rF )r2 r� ) r� r� r� �__doc__r/ r� r� r� r� rI r� r� r- r- r- r. r� � s
r� c @ s. e Zd Zddd�Zeddd��Zd dd�ZdS ) �CliDetectionResult�pathr r4 r rS rN �alternative_encodingsrc rx r r r: r r; � unicode_path� is_preferredc C sF || _ |
| _|| _|| _|| _|| _|| _|| _|| _| | _ | | _
d S rL ) r� r� r4 rS r� rc rx r r: r; r� ) r, r� r4 rS r� rc rx r r: r; r� r� r- r- r. r/ = s
zCliDetectionResult.__init__r2 �dict[str, Any]c C s2 | j | j| j| j| j| j| j| j| j| j | j
d� S )N� r� r4 rS r� rc rx r r: r; r� r� r� rB r- r- r. �__dict__W s �zCliDetectionResult.__dict__c C s t | jddd�S )NT� )� ensure_ascii�indent)r r� rB r- r- r. �to_jsong s zCliDetectionResult.to_jsonN)r� r r4 r rS rN r� rN rc r rx rN r r r: r r; r r� r r� r )r2 r� r� )r� r� r� r/ r� r� r� r- r- r- r. r� < s
r� N) �
__future__r �encodings.aliasesr �hashlibr �jsonr �rer �typingr r r r
�constantr r
�utilsr r r r r� r r �CoherenceMatchr r� r- r- r- r. �<module> s i C