File manager - Edit - /home/newsbmcs.com/public_html/static/img/logo/archives.zip
Back
PK ,x�Z��2�7 7 $ __pycache__/__init__.cpython-310.pycnu �[��� o -�_gK? � @ sb d dl Z d dlZd dlZd dlZd dlZd dlZd dlmZ d dlm Z dd� Z G dd� d�Z dS )� N)�ProcessPoolExecutor)�file_is_binaryc C s� t �| ��a}tj�|d�}tt ddd� �|_|�� D ]2}tj�||j�}tj� |�}tj� |�}tj� ||g�}||krFt d|� d|� ���|� ||� qtj�||j� d�d � d �d �W d � S 1 siw Y d S ) N�cleaner�fully_trusted_filterc S s | S �N� )�member�pathr r �?/usr/lib/python3/dist-packages/sos/cleaner/archives/__init__.py�<lambda>! s z!extract_archive.<locals>.<lambda>z"Attempted path traversal in tarflez != �/����.tarr )�tarfile�open�osr �join�getattr�extraction_filter� getmembers�name�abspath� commonprefix� Exception�extract�split) � archive_path�tmpdir�archiver r � member_path� abs_directory� abs_target�prefixr r r �extract_archive s& � ��"$�r# c @ s. e Zd ZdZg ZdZdZdZdZdZ i Z dd� Z e dd� �Z ed d � �Zed d � �Zd d� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd � Zed d � �Zd d � Zd!d"� Zd#d$� Z dBd%d&�Z d'd(� Z d)d*� Z d+d,� Z d-d.� Z!d/d0� Z"d1d2� Z#d3d4� Z$d5d6� Z%d7d8� Z&d9d:� Z'd;d<� Z(d=d>� Z)d?d@� Z*dAS )C�SoSObfuscationArchivea A representation of an extracted archive or an sos archive build directory which is used by SoSCleaner. Each archive that needs to be obfuscated is loaded into an instance of this class. All report-level operations should be contained within this class. r � undeterminedFc C s� || _ | j | _|| _| j �d�d �d�d | _| j| _t�d�| _t�d�| _ | � � | _ d| _ | � � d| _| �d | j � d | j� �� d S ) Nr r r r �sos�sos_uiF� zLoaded z as type )r �final_archive_pathr r � archive_name�ui_name�logging� getLogger�soslog�ui_log�_load_skip_list� skip_list� is_extracted� _load_self� archive_root�log_info� description)�selfr r r r r �__init__A s �z SoSObfuscationArchive.__init__c C s t �)z=Check if the archive is a well-known type we directly support)�NotImplementedError)�cls�arc_pathr r r � check_is_typeQ s z#SoSObfuscationArchive.check_is_typec C s d| j j�� v S )Nr& )� __class__�__name__�lower�r7 r r r �is_sosV s z SoSObfuscationArchive.is_sosc C s d| j v S )N�insights)� type_namer@ r r r � is_insightsZ s z!SoSObfuscationArchive.is_insightsc C s | j r t�| j�| _d S d S r )� is_tarfiler r r �tarobjr@ r r r r3 ^ s �z SoSObfuscationArchive._load_selfc C s g S )a/ Return a list of ObfuscationArchives that represent additional archives found within the target archive. For example, an archive from `sos collect` will return a list of ``SoSReportArchive`` objects. This should be overridden by individual types of ObfuscationArchive's r r@ r r r �get_nested_archivesc s z)SoSObfuscationArchive.get_nested_archivesc C s> | j r| jj}|�� r|jS tj�|j�ptjS tj� | j �S )z|Set the root path for the archive that should be prepended to any filenames given to methods in this class. ) rE rF � firstmember�isdirr r r �dirname�sepr r )r7 �toplevelr r r �get_archive_rootl s z&SoSObfuscationArchive.get_archive_rootc C s" | j �| jd d�d|� �� dS )z9Helper to easily format ui messages on a per-report basisz :z<50� N)r/ �infor+ �r7 �msgr r r � report_msgw s "z SoSObfuscationArchive.report_msgc C s d| j � d|� �S )Nz [cleaner:z] )r* rP r r r � _fmt_log_msg{ s z"SoSObfuscationArchive._fmt_log_msgc C � | j �| �|�� d S r )r. �debugrS rP r r r � log_debug~ � z SoSObfuscationArchive.log_debugc C rT r )r. rO rS rP r r r r5 � rW z SoSObfuscationArchive.log_infoc C s g d�S )zyProvide a list of files and file regexes to skip obfuscation on Returns: list of files and file regexes )z proc/kallsymsz sosreport-z sys/firmwarezsys/fszsys/kernel/debugz sys/moduler r@ r r r r0 � s z%SoSObfuscationArchive._load_skip_listc C s$ zt �| j�W S ty Y dS w )NF)r rE r r r@ r r r rE � s �z SoSObfuscationArchive.is_tarfilec C s@ | � |�}|r | �d|� d�� t�|� | jd7 _dS dS )z�Remove a file from the archive. This is used when cleaner encounters a binary file, which we cannot reliably obfuscate. zRemoving binary file 'z' from archive� N)� get_file_pathr5 r �remove�removed_file_count)r7 �fname� full_fnamer r r � remove_file� s �z!SoSObfuscationArchive.remove_filec C s6 | j s| js | �� | _tj�| j|�S tj�| j|�S )z�Based on the type of archive we're dealing with, do whatever that archive requires to a provided **relative** filepath to be able to access it within the archive )r2 r4 rM r r r �extracted_path)r7 r\ r r r �format_file_name� s z&SoSObfuscationArchive.format_file_namec C s� | j du r-| jr-| �|�}z | j�|��� �d�W S ty, | �d|� d�� Y dS w z"t | �|�ddd�� }|�� W d � W S 1 sHw Y W dS t ym } z| �d |� d |� �� W Y d}~dS d}~ww ) z�Return the content from the specified fname. Particularly useful for tarball-type archives so we can retrieve prep file contents prior to extracting the entire archive Fzutf-8zUnable to retrieve z: no such file in archiver( �r)�encodingNzFailed to get contents of z: ) r2 rE r` rF � extractfile�read�decode�KeyErrorrV r r )r7 r\ �filename�to_read�errr r r �get_file_content� s, �� �(���z&SoSObfuscationArchive.get_file_contentc C s^ | j r|s | �d� | �� | _d| _n| j| _t�� dkr�| �d� t� | j�D ]{\}}}z\|D ]}tj � ||�}t� |�j }t�||t jB � q0|D ]<}tj � ||�} tj �| �r`tj �| �raqKt�| tj�rot�| tj�s�| �d| �| j�d � �� t�| t jt jB � qKW q( ty� } z| �d| � �� W Y d } ~ q(d } ~ ww | �d| j� �� d S ) Nz Extracting...Tr z)Verifying permissions of archive contentsz Adding owner rw permissions to r z!Error while trying to set perms: zExtracted path is )rE rR � extract_selfr_ r2 r r �getuidrV �walkr r �stat�st_mode�chmod�S_IRWXU�exists�islink�access�R_OK�W_OKr �S_IRUSR�S_IWUSRr ) r7 �quietrJ �dirs�files�_dir�_dirname� _dir_permsrg r\ ri r r r r � sD ����� ��z SoSObfuscationArchive.extractc C s. | j �| j|�}|| _t�| j |� || _ dS )z�Rename the top-level directory to new_name, which should be an obfuscated string that scrubs the hostname from the top-level dir which would be named after the unobfuscated sos report N)r_ �replacer* r �rename)r7 �new_name�_pathr r r �rename_top_dir� s z$SoSObfuscationArchive.rename_top_dirc C s | j r | j�d�r dS dS dS )z�Return the compression type used by the archive, if any. This is then used by SoSCleaner to generate a policy-derived compression command to repack the archive �xz�gzN)rE r �endswithr@ r r r �get_compression� s z%SoSObfuscationArchive.get_compressionc C s� d}| j d }i }|r&|d|� �7 }|d|� �7 }|dkr"ddi}ndd i}| �d |� �� tj|fd |i|���}|j| j tj�| j�d d � W d � |S 1 sTw Y |S )zIPack the extracted archive as a tarfile to then be re-compressed �wz-obfuscated.tar�:�.r� �preset� � compresslevel� zBuilding tar file �moderX )�arcnameN) r_ rV r r �addr r r r* )r7 �methodr� �tarpath� compr_args�tarr r r �build_tar_file s$ � ��z$SoSObfuscationArchive.build_tar_filec C s� z| � |�| _W n ty } z | �d|� �� � d}~ww | �d| j� �� z| �� W dS tyN } z| �d|� �� | �d� W Y d}~dS d}~ww )z�Execute the compression command, and set the appropriate final archive path for later reference by SoSCleaner on a per-archive basis z(Exception while re-compressing archive: NzCompressed to z'Failed to remove extraction directory: z/Failed to remove temporary extraction directory)r� r) r rV �remove_extracted_pathrR )r7 r� ri r r r �compress s ����z SoSObfuscationArchive.compressc C sv z| � d| j� �� t�| j� W dS ty: t�| jtj� tj � | j�r1t� | j� Y dS t�| j� Y dS w )z�After the tarball has been re-compressed, remove the extracted path so that we don't take up that duplicate space any longer during execution z Removing N) rV r_ �shutil�rmtree�OSErrorr rp rn rx r �isfilerZ r@ r r r r� # s �z+SoSObfuscationArchive.remove_extracted_pathc C sJ t d��}|�t| j| j�}|�� }|W d � S 1 s w Y dS )z}Extract an archive into our tmpdir so that we may inspect it or iterate through its contents for obfuscation rX N)r �submitr# r r �result)r7 �_pool� _path_futurer r r r rk 2 s �$�z"SoSObfuscationArchive.extract_selfc c sr � t �| j�D ]/\}}}|D ]}t j�||�}t j�|�r |V q|D ]}t j�||�}t j�|�r5|V q#qdS )z.Iterator for a list of symlinks in the archiveN)r rm r_ r r rs )r7 rJ rz r{ r| �_dirpathrg �_fnamer r r � get_symlinks= s � � ���z"SoSObfuscationArchive.get_symlinksc c sN � t �| j�D ] \}}}|D ]}t j�||�d��}t j�|�s#|V qqdS )z�Iterator for a list of files in the archive, to allow clean to iterate over. Will not include symlinks, as those are handled separately r N)r rm r_ r r �lstriprs )r7 rJ �_r{ rg r� r r r � get_file_listI s � ���z#SoSObfuscationArchive.get_file_listc C s* g }t �| j�D ] \}}}|�|� q|S )z3Return a list of all directories within the archive)r rm r_ �append)r7 �dir_listrJ r� r r r �get_directory_listU s z(SoSObfuscationArchive.get_directory_listc C s | j �|� | j|7 _dS )z�Called when a file has finished being parsed and used to track total substitutions made and number of files that had changes made N)� file_sub_listr� �total_sub_count)r7 r\ �countr r r �update_sub_count\ s z&SoSObfuscationArchive.update_sub_countc C s* t j�| j|�d��}t j�|�r|S dS )zReturn the filepath of a specific file within the archive so that it may be selectively inspected if it exists r r( )r r r r_ r� rr )r7 r\ r� r r r rY c s z#SoSObfuscationArchive.get_file_pathc C sT t j�| �|��st j�| �|��sdS | jD ]}|�|�s$t�||�r' dS qdS )a% Checks the provided filename against a list of filepaths to not perform obfuscation on, as defined in self.skip_list Positional arguments: :param filename str: Filename relative to the extracted archive root TF) r r r� rY rs r1 � startswith�re�match)r7 rg �_skipr r r �should_skip_filej s � �z&SoSObfuscationArchive.should_skip_filec C sF g d�}|D ] }t �||�r dS q| �|�}tj�|�r!t|�S dS )aa Determine if the file should be removed or not, due to an inability to reliably obfuscate that file based on the filename. :param fname: Filename relative to the extracted archive root :type fname: ``str`` :returns: ``True`` if the file cannot be reliably obfuscated :rtype: ``bool`` ) z.*\.gz$z.*\.xz$z .*\.bzip2$z .*\.tar\..*z.*\.txz$z.*\.tgz$z.*\.bin$z .*\.journal$z.*\~$TF)r� r� rY r r r� r )r7 r\ �obvious_removes�_arc_reg� _full_pathr r r �should_remove_file} s � z(SoSObfuscationArchive.should_remove_fileN)F)+r> � __module__� __qualname__�__doc__r� r� r[ rC r6 � is_nested� prep_filesr8 � classmethodr< �propertyrA rD r3 rG rM rR rS rV r5 r0 rE r^ r` rj r r� r� r� r� r� rk r� r� r� r� rY r� r� r r r r r$ 1 sV % r$ ) r, r r� rn r r� �concurrent.futuresr � sos.utilitiesr r# r$ r r r r �<module> s PK ,x�ZMr�MA A # __pycache__/generic.cpython-310.pycnu �[��� o -�_g� � @ s@ d dl Z d dlZd dlmZ G dd� de�ZG dd� de�ZdS )� N)�SoSObfuscationArchivec @ �, e Zd ZdZdZdZedd� �Zdd� ZdS ) �DataDirArchivez{A plain directory on the filesystem that is not directly associated with any known or supported collection utility �data_dirzunassociated directoryc C s t j�|�S �N)�os�path�isdir��cls�arc_path� r �>/usr/lib/python3/dist-packages/sos/cleaner/archives/generic.py� check_is_type s z DataDirArchive.check_is_typec C s t j�| j�S r )r r �abspath� archive_path��selfr r r �set_archive_root s z DataDirArchive.set_archive_rootN� �__name__� __module__� __qualname__�__doc__� type_name� description� classmethodr r r r r r r s r c @ r ) �TarballArchivezdA generic tar archive that is not associated with any known or supported collection utility �tarballzunassociated tarballc C s" zt �|�W S ty Y dS w )NF)�tarfile� is_tarfile� Exceptionr r r r r ) s �z TarballArchive.check_is_typec C s | j j�� r | j jjS dS )N� )�tarobj� firstmemberr �namer r r r r 0 s z TarballArchive.set_archive_rootNr r r r r r ! s r )r r �sos.cleaner.archivesr r r r r r r �<module> s PK ,x�Z�p�� __pycache__/sos.cpython-310.pycnu �[��� o -�_g7 � @ s` d dl Z d dlZd dlmZ G dd� de�ZG dd� de�ZG dd� de�ZG d d � d e�ZdS ) � N)�SoSObfuscationArchivec @ �$ e Zd ZdZdZdZedd� �ZdS )�SoSReportArchivez�This is the class representing an sos report, or in other words the type the archive the SoS project natively generates �reportzsos report archivec C �* z t �|�o d|v W S ty Y dS w )N� sosreport-F��tarfile� is_tarfile� Exception��cls�arc_path� r �:/usr/lib/python3/dist-packages/sos/cleaner/archives/sos.py� check_is_type � �z SoSReportArchive.check_is_typeN��__name__� __module__� __qualname__�__doc__� type_name� description� classmethodr r r r r r � r c @ r )�SoSReportDirectoryz�This is the archive class representing a build directory, or in other words what `sos report --clean` will end up using for in-line obfuscation � report_dirzsos report directoryc C s t j�|�r dt �|�v S dS )N�sos_logsF��os�path�isdir�listdirr r r r r ) s z SoSReportDirectory.check_is_typeNr r r r r r ! r r c @ s0 e Zd ZdZdZdZdZedd� �Zdd� Z d S ) �SoSCollectorArchivez�Archive class representing the tarball created by ``sos collect``. It will not provide prep files on its own, however it will provide a list of SoSReportArchive's which will then be used to prep the parsers �collectzsos collect tarballTc C r )Nz sos-collectFr r r r r r : r z!SoSCollectorArchive.check_is_typec C s\ | j dd� | j}g }t�|�D ]}tj�||�}d|v r+t�|�r+|�t || j �� q|S )NT)�quietr ) �extract�extracted_pathr r# r! �joinr r �appendr �tmpdir)�self�_path�archives�fname�arc_namer r r �get_nested_archivesA s �z'SoSCollectorArchive.get_nested_archivesN) r r r r r r � is_nestedr r r1 r r r r r$ 0 s r$ c @ r )�SoSCollectorDirectoryz{The archive class representing the temp directory used by ``sos collect`` when ``--clean`` is used during runtime. � collect_dirzsos collect directoryc C s. t j�|�rt �|�D ] }d|v r dS q dS )Nzsos-collector-TFr )r r r/ r r r r T s �z#SoSCollectorDirectory.check_is_typeNr r r r r r3 L r r3 )r r �sos.cleaner.archivesr r r r$ r3 r r r r �<module> s PK ,x�Z� �X X $ __pycache__/insights.cpython-310.pycnu �[��� o -�_gO � @ s( d dl Z d dlmZ G dd� de�ZdS )� N)�SoSObfuscationArchivec @ s, e Zd ZdZdZdZedd� �Zdd� ZdS ) �InsightsArchivezbThis class represents archives generated by the insights-client utility for RHEL systems. �insightszinsights-client archivec C s* z t �|�o d|v W S ty Y dS w )Nz insights-F)�tarfile� is_tarfile� Exception)�cls�arc_path� r �?/usr/lib/python3/dist-packages/sos/cleaner/archives/insights.py� check_is_type s �z InsightsArchive.check_is_typec C s4 | j �d�d �d�d }| jjjdkrd| }|S )N�/���z.tarr �.z./)� archive_path�split�tarobj� firstmember�name)�self�topr r r �get_archive_root s z InsightsArchive.get_archive_rootN) �__name__� __module__� __qualname__�__doc__� type_name� description� classmethodr r r r r r r s r )r �sos.cleaner.archivesr r r r r r �<module> s PK ,x�ZnHND� � generic.pynu �[��� # Copyright 2020 Red Hat, Inc. Jake Hunsaker <jhunsake@redhat.com> # This file is part of the sos project: https://github.com/sosreport/sos # # This copyrighted material is made available to anyone wishing to use, # modify, copy, or redistribute it subject to the terms and conditions of # version 2 of the GNU General Public License. # # See the LICENSE file in the source distribution for further information. import os import tarfile from sos.cleaner.archives import SoSObfuscationArchive class DataDirArchive(SoSObfuscationArchive): """A plain directory on the filesystem that is not directly associated with any known or supported collection utility """ type_name = 'data_dir' description = 'unassociated directory' @classmethod def check_is_type(cls, arc_path): return os.path.isdir(arc_path) def set_archive_root(self): return os.path.abspath(self.archive_path) class TarballArchive(SoSObfuscationArchive): """A generic tar archive that is not associated with any known or supported collection utility """ type_name = 'tarball' description = 'unassociated tarball' @classmethod def check_is_type(cls, arc_path): try: return tarfile.is_tarfile(arc_path) except Exception: return False def set_archive_root(self): if self.tarobj.firstmember.isdir(): return self.tarobj.firstmember.name return '' PK ,x�ZE �uO O insights.pynu �[��� # Copyright 2021 Red Hat, Inc. Jake Hunsaker <jhunsake@redhat.com> # This file is part of the sos project: https://github.com/sosreport/sos # # This copyrighted material is made available to anyone wishing to use, # modify, copy, or redistribute it subject to the terms and conditions of # version 2 of the GNU General Public License. # # See the LICENSE file in the source distribution for further information. import tarfile from sos.cleaner.archives import SoSObfuscationArchive class InsightsArchive(SoSObfuscationArchive): """This class represents archives generated by the insights-client utility for RHEL systems. """ type_name = 'insights' description = 'insights-client archive' @classmethod def check_is_type(cls, arc_path): try: return tarfile.is_tarfile(arc_path) and 'insights-' in arc_path except Exception: return False def get_archive_root(self): top = self.archive_path.split('/')[-1].split('.tar')[0] if self.tarobj.firstmember.name == '.': top = './' + top return top PK ,x�Z��07 7 sos.pynu �[��� # Copyright 2021 Red Hat, Inc. Jake Hunsaker <jhunsake@redhat.com> # This file is part of the sos project: https://github.com/sosreport/sos # # This copyrighted material is made available to anyone wishing to use, # modify, copy, or redistribute it subject to the terms and conditions of # version 2 of the GNU General Public License. # # See the LICENSE file in the source distribution for further information. import os import tarfile from sos.cleaner.archives import SoSObfuscationArchive class SoSReportArchive(SoSObfuscationArchive): """This is the class representing an sos report, or in other words the type the archive the SoS project natively generates """ type_name = 'report' description = 'sos report archive' @classmethod def check_is_type(cls, arc_path): try: return tarfile.is_tarfile(arc_path) and 'sosreport-' in arc_path except Exception: return False class SoSReportDirectory(SoSReportArchive): """This is the archive class representing a build directory, or in other words what `sos report --clean` will end up using for in-line obfuscation """ type_name = 'report_dir' description = 'sos report directory' @classmethod def check_is_type(cls, arc_path): if os.path.isdir(arc_path): return 'sos_logs' in os.listdir(arc_path) return False class SoSCollectorArchive(SoSObfuscationArchive): """Archive class representing the tarball created by ``sos collect``. It will not provide prep files on its own, however it will provide a list of SoSReportArchive's which will then be used to prep the parsers """ type_name = 'collect' description = 'sos collect tarball' is_nested = True @classmethod def check_is_type(cls, arc_path): try: return (tarfile.is_tarfile(arc_path) and 'sos-collect' in arc_path) except Exception: return False def get_nested_archives(self): self.extract(quiet=True) _path = self.extracted_path archives = [] for fname in os.listdir(_path): arc_name = os.path.join(_path, fname) if 'sosreport-' in fname and tarfile.is_tarfile(arc_name): archives.append(SoSReportArchive(arc_name, self.tmpdir)) return archives class SoSCollectorDirectory(SoSCollectorArchive): """The archive class representing the temp directory used by ``sos collect`` when ``--clean`` is used during runtime. """ type_name = 'collect_dir' description = 'sos collect directory' @classmethod def check_is_type(cls, arc_path): if os.path.isdir(arc_path): for fname in os.listdir(arc_path): if 'sos-collector-' in fname: return True return False # vim: set et ts=4 sw=4 : PK ,x�Zܭ �K? K? __init__.pynu �[��� # Copyright 2020 Red Hat, Inc. Jake Hunsaker <jhunsake@redhat.com> # This file is part of the sos project: https://github.com/sosreport/sos # # This copyrighted material is made available to anyone wishing to use, # modify, copy, or redistribute it subject to the terms and conditions of # version 2 of the GNU General Public License. # # See the LICENSE file in the source distribution for further information. import logging import os import shutil import stat import tarfile import re from concurrent.futures import ProcessPoolExecutor from sos.utilities import file_is_binary # python older than 3.8 will hit a pickling error when we go to spawn a new # process for extraction if this method is a part of the SoSObfuscationArchive # class. So, the simplest solution is to remove it from the class. def extract_archive(archive_path, tmpdir): with tarfile.open(archive_path) as archive: path = os.path.join(tmpdir, 'cleaner') # set extract filter since python 3.12 (see PEP-706 for more) # Because python 3.10 and 3.11 raises false alarms as exceptions # (see #3330 for examples), we can't use data filter but must # fully trust the archive (legacy behaviour) archive.extraction_filter = getattr(tarfile, 'fully_trusted_filter', (lambda member, path: member)) # Guard against "Arbitrary file write during tarfile extraction" # Checks the extracted files don't stray out of the target directory. for member in archive.getmembers(): member_path = os.path.join(path, member.name) abs_directory = os.path.abspath(path) abs_target = os.path.abspath(member_path) prefix = os.path.commonprefix([abs_directory, abs_target]) if prefix != abs_directory: raise Exception(f"Attempted path traversal in tarfle" f"{prefix} != {abs_directory}") archive.extract(member, path) return os.path.join(path, archive.name.split('/')[-1].split('.tar')[0]) class SoSObfuscationArchive(): """A representation of an extracted archive or an sos archive build directory which is used by SoSCleaner. Each archive that needs to be obfuscated is loaded into an instance of this class. All report-level operations should be contained within this class. """ file_sub_list = [] total_sub_count = 0 removed_file_count = 0 type_name = 'undetermined' description = 'undetermined' is_nested = False prep_files = {} def __init__(self, archive_path, tmpdir): self.archive_path = archive_path self.final_archive_path = self.archive_path self.tmpdir = tmpdir self.archive_name = self.archive_path.split('/')[-1].split('.tar')[0] self.ui_name = self.archive_name self.soslog = logging.getLogger('sos') self.ui_log = logging.getLogger('sos_ui') self.skip_list = self._load_skip_list() self.is_extracted = False self._load_self() self.archive_root = '' self.log_info( f"Loaded {self.archive_path} as type {self.description}" ) @classmethod def check_is_type(cls, arc_path): """Check if the archive is a well-known type we directly support""" raise NotImplementedError @property def is_sos(self): return 'sos' in self.__class__.__name__.lower() @property def is_insights(self): return 'insights' in self.type_name def _load_self(self): if self.is_tarfile: # pylint: disable=consider-using-with self.tarobj = tarfile.open(self.archive_path) def get_nested_archives(self): """Return a list of ObfuscationArchives that represent additional archives found within the target archive. For example, an archive from `sos collect` will return a list of ``SoSReportArchive`` objects. This should be overridden by individual types of ObfuscationArchive's """ return [] def get_archive_root(self): """Set the root path for the archive that should be prepended to any filenames given to methods in this class. """ if self.is_tarfile: toplevel = self.tarobj.firstmember if toplevel.isdir(): return toplevel.name return os.path.dirname(toplevel.name) or os.sep return os.path.abspath(self.archive_path) def report_msg(self, msg): """Helper to easily format ui messages on a per-report basis""" self.ui_log.info(f"{self.ui_name + ' :':<50} {msg}") def _fmt_log_msg(self, msg): return f"[cleaner:{self.archive_name}] {msg}" def log_debug(self, msg): self.soslog.debug(self._fmt_log_msg(msg)) def log_info(self, msg): self.soslog.info(self._fmt_log_msg(msg)) def _load_skip_list(self): """Provide a list of files and file regexes to skip obfuscation on Returns: list of files and file regexes """ return [ 'proc/kallsyms', 'sosreport-', 'sys/firmware', 'sys/fs', 'sys/kernel/debug', 'sys/module' ] @property def is_tarfile(self): try: return tarfile.is_tarfile(self.archive_path) except Exception: return False def remove_file(self, fname): """Remove a file from the archive. This is used when cleaner encounters a binary file, which we cannot reliably obfuscate. """ full_fname = self.get_file_path(fname) # don't call a blank remove() here if full_fname: self.log_info(f"Removing binary file '{fname}' from archive") os.remove(full_fname) self.removed_file_count += 1 def format_file_name(self, fname): """Based on the type of archive we're dealing with, do whatever that archive requires to a provided **relative** filepath to be able to access it within the archive """ if not self.is_extracted: if not self.archive_root: self.archive_root = self.get_archive_root() return os.path.join(self.archive_root, fname) return os.path.join(self.extracted_path, fname) def get_file_content(self, fname): """Return the content from the specified fname. Particularly useful for tarball-type archives so we can retrieve prep file contents prior to extracting the entire archive """ if self.is_extracted is False and self.is_tarfile: filename = self.format_file_name(fname) try: return self.tarobj.extractfile(filename).read().decode('utf-8') except KeyError: self.log_debug( f"Unable to retrieve {fname}: no such file in archive" ) return '' else: try: with open(self.format_file_name(fname), 'r', encoding='utf-8') as to_read: return to_read.read() except Exception as err: self.log_debug(f"Failed to get contents of {fname}: {err}") return '' def extract(self, quiet=False): if self.is_tarfile: if not quiet: self.report_msg("Extracting...") self.extracted_path = self.extract_self() self.is_extracted = True else: self.extracted_path = self.archive_path # if we're running as non-root (e.g. collector), then we can have a # situation where a particular path has insufficient permissions for # us to rewrite the contents and/or add it to the ending tarfile. # Unfortunately our only choice here is to change the permissions # that were preserved during report collection if os.getuid() != 0: self.log_debug('Verifying permissions of archive contents') for dirname, dirs, files in os.walk(self.extracted_path): try: for _dir in dirs: _dirname = os.path.join(dirname, _dir) _dir_perms = os.stat(_dirname).st_mode os.chmod(_dirname, _dir_perms | stat.S_IRWXU) for filename in files: fname = os.path.join(dirname, filename) # protect against symlink race conditions if not os.path.exists(fname) or os.path.islink(fname): continue if (not os.access(fname, os.R_OK) or not os.access(fname, os.W_OK)): self.log_debug( "Adding owner rw permissions to " f"{fname.split(self.archive_path)[-1]}" ) os.chmod(fname, stat.S_IRUSR | stat.S_IWUSR) except Exception as err: self.log_debug(f"Error while trying to set perms: {err}") self.log_debug(f"Extracted path is {self.extracted_path}") def rename_top_dir(self, new_name): """Rename the top-level directory to new_name, which should be an obfuscated string that scrubs the hostname from the top-level dir which would be named after the unobfuscated sos report """ _path = self.extracted_path.replace(self.archive_name, new_name) self.archive_name = new_name os.rename(self.extracted_path, _path) self.extracted_path = _path def get_compression(self): """Return the compression type used by the archive, if any. This is then used by SoSCleaner to generate a policy-derived compression command to repack the archive """ if self.is_tarfile: if self.archive_path.endswith('xz'): return 'xz' return 'gz' return None def build_tar_file(self, method): """Pack the extracted archive as a tarfile to then be re-compressed """ mode = 'w' tarpath = self.extracted_path + '-obfuscated.tar' compr_args = {} if method: mode += f":{method}" tarpath += f".{method}" if method == 'xz': compr_args = {'preset': 3} else: compr_args = {'compresslevel': 6} self.log_debug(f"Building tar file {tarpath}") with tarfile.open(tarpath, mode=mode, **compr_args) as tar: tar.add(self.extracted_path, arcname=os.path.split(self.archive_name)[1]) return tarpath def compress(self, method): """Execute the compression command, and set the appropriate final archive path for later reference by SoSCleaner on a per-archive basis """ try: self.final_archive_path = self.build_tar_file(method) except Exception as err: self.log_debug(f"Exception while re-compressing archive: {err}") raise self.log_debug(f"Compressed to {self.final_archive_path}") try: self.remove_extracted_path() except Exception as err: self.log_debug(f"Failed to remove extraction directory: {err}") self.report_msg('Failed to remove temporary extraction directory') def remove_extracted_path(self): """After the tarball has been re-compressed, remove the extracted path so that we don't take up that duplicate space any longer during execution """ try: self.log_debug(f"Removing {self.extracted_path}") shutil.rmtree(self.extracted_path) except OSError: os.chmod(self.extracted_path, stat.S_IWUSR) if os.path.isfile(self.extracted_path): os.remove(self.extracted_path) else: shutil.rmtree(self.extracted_path) def extract_self(self): """Extract an archive into our tmpdir so that we may inspect it or iterate through its contents for obfuscation """ with ProcessPoolExecutor(1) as _pool: _path_future = _pool.submit(extract_archive, self.archive_path, self.tmpdir) path = _path_future.result() return path def get_symlinks(self): """Iterator for a list of symlinks in the archive""" for dirname, dirs, files in os.walk(self.extracted_path): for _dir in dirs: _dirpath = os.path.join(dirname, _dir) if os.path.islink(_dirpath): yield _dirpath for filename in files: _fname = os.path.join(dirname, filename) if os.path.islink(_fname): yield _fname def get_file_list(self): """Iterator for a list of files in the archive, to allow clean to iterate over. Will not include symlinks, as those are handled separately """ for dirname, _, files in os.walk(self.extracted_path): for filename in files: _fname = os.path.join(dirname, filename.lstrip('/')) if not os.path.islink(_fname): yield _fname def get_directory_list(self): """Return a list of all directories within the archive""" dir_list = [] for dirname, _, _ in os.walk(self.extracted_path): dir_list.append(dirname) return dir_list def update_sub_count(self, fname, count): """Called when a file has finished being parsed and used to track total substitutions made and number of files that had changes made """ self.file_sub_list.append(fname) self.total_sub_count += count def get_file_path(self, fname): """Return the filepath of a specific file within the archive so that it may be selectively inspected if it exists """ _path = os.path.join(self.extracted_path, fname.lstrip('/')) return _path if os.path.exists(_path) else '' def should_skip_file(self, filename): """Checks the provided filename against a list of filepaths to not perform obfuscation on, as defined in self.skip_list Positional arguments: :param filename str: Filename relative to the extracted archive root """ if (not os.path.isfile(self.get_file_path(filename)) and not os.path.islink(self.get_file_path(filename))): return True for _skip in self.skip_list: if filename.startswith(_skip) or re.match(_skip, filename): return True return False def should_remove_file(self, fname): """Determine if the file should be removed or not, due to an inability to reliably obfuscate that file based on the filename. :param fname: Filename relative to the extracted archive root :type fname: ``str`` :returns: ``True`` if the file cannot be reliably obfuscated :rtype: ``bool`` """ obvious_removes = [ r'.*\.gz$', # TODO: support flat gz/xz extraction r'.*\.xz$', r'.*\.bzip2$', r'.*\.tar\..*', # TODO: support archive unpacking r'.*\.txz$', r'.*\.tgz$', r'.*\.bin$', r'.*\.journal$', r'.*\~$' ] # if the filename matches, it is obvious we can remove them without # doing the read test for _arc_reg in obvious_removes: if re.match(_arc_reg, fname): return True _full_path = self.get_file_path(fname) if os.path.isfile(_full_path): return file_is_binary(_full_path) # don't fail on dir-level symlinks return False # vim: set et ts=4 sw=4 : PK ,x�Z��2�7 7 $ __pycache__/__init__.cpython-310.pycnu �[��� PK ,x�ZMr�MA A # c7 __pycache__/generic.cpython-310.pycnu �[��� PK ,x�Z�p�� �= __pycache__/sos.cpython-310.pycnu �[��� PK ,x�Z� �X X $ FI __pycache__/insights.cpython-310.pycnu �[��� PK ,x�ZnHND� � �M generic.pynu �[��� PK ,x�ZE �uO O �S insights.pynu �[��� PK ,x�Z��07 7 lX sos.pynu �[��� PK ,x�Zܭ �K? K? �c __init__.pynu �[��� PK � _�
| ver. 1.4 |
Github
|
.
| PHP 8.2.28 | Generation time: 0.02 |
proxy
|
phpinfo
|
Settings