File: //lib/python3/dist-packages/apport/__pycache__/packaging_impl.cpython-38.pyc
U
��h� � @ s* d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl m Z ddl
Z
e
�dde� ddlZz4ddlZddlmZmZmZ eeeef eZeZW nH ek
r� ddlmZmZ ddl mZ dd l mZmZ ddlZY nX ddl Z dd
l m Z G d d � d e �Z!e!� Z"dS )
zyapport.PackageInfo class implementation for python-apt and dpkg.
This is used on Debian and derivatives such as Ubuntu.
� N)�closing�ignorezapt API not stable yet)�urlopen�quote�unquote)�URLError� HTTPError)r )r r )� PackageInfoc @ s� e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd d
� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd_d%d&�Zd'd(� Zd)d*� Zd+d,� Zd-d.� Zd/d0� Zd1d2� Zd`d4d5�Z e d6d7� �Z d8d9� Z d:d;� Z dad<d=�Z!d>d?� Z"d@dA� Z#dbdCdD�Z$dEdF� Z%e dGdH� �Z&dIdJ� Z'e dKdL� �Z(dMdN� Z)dOdP� Z*dQdR� Z+e dSdT� �Z,e dUdV� �Z-e dWdX� �Z.dYdZ� Z/d3Z0d[d\� Z1d3Z2d]d^� Z3d3S )c�__AptDpkgPackageInfoz�Concrete apport.PackageInfo class implementation for python-apt and
dpkg, as found on Debian and derivatives such as Ubuntu.c C sF d | _ d | _d | _d | _d | _d | _d | _d| _| jd | _d| _ d S )Nz https://api.launchpad.net/develz*/~%(user)s/+archive/%(distro)s/%(ppaname)sF)
�
_apt_cache�_sandbox_apt_cache�_sandbox_apt_cache_arch�
_contents_dir�_mirror�_virtual_mapping_obj�_contents_mapping_objZ_launchpad_base�_ppa_archive_url�_contents_update��self� r �7/usr/lib/python3/dist-packages/apport/packaging_impl.py�__init__- s z __AptDpkgPackageInfo.__init__c C s0 z| j rt�| j � W n tk
r* Y nX d S )N)r �shutil�rmtree�AttributeErrorr r r r �__del__9 s
z __AptDpkgPackageInfo.__del__c C sZ | j d k r| j S tj�|d�}tj�|�rNt|d��}t�|�| _ W 5 Q R X ni | _ | j S )N�virtual_mapping.pickle�rb)r �os�path�join�exists�open�pickle�load�r � configdir� mapping_file�fpr r r �_virtual_mapping@ s
z%__AptDpkgPackageInfo._virtual_mappingc C s@ t j�|d�}| jd k r<t|d��}t�| j|� W 5 Q R X d S )Nr �wb)r r r! r r# r$ �dumpr& r r r �_save_virtual_mappingM s
z*__AptDpkgPackageInfo._save_virtual_mappingc C s� | j r(| j d |kr(| j d |kr(| j S tj�|d||f �}tj�|�rdt�|�jdkrdt�|� tj�|�r�t|d��}t �
|�| _ W 5 Q R X n ||d�| _ | j S )N�release�arch� contents_mapping-%s-%s.pickler r )r. r/ ) r r r r! r" �stat�st_size�remover# r$ r% �r r' r. r/ r( r) r r r �_contents_mappingS s � �
�
z&__AptDpkgPackageInfo._contents_mappingc C sb t j�|d||f �}| jd k r^z(t|d��}t�| j|� W 5 Q R X W n tk
r\ Y nX d S )Nr0 r+ )r r r! r r# r$ r, � MemoryErrorr4 r r r �_save_contents_mappinge s
�
z+__AptDpkgPackageInfo._save_contents_mappingc C sV d| _ | jsPz tjj�� }tj|dd�| _W n" tk
rN tjdd�| _Y nX | jS )z(Return apt.Cache() (initialized lazily).N�/��rootdir)r r �apt�progress�baseZ
OpProgress�Cacher )r r< r r r �_cacheq s z__AptDpkgPackageInfo._cachec
C s� d| _ | jr|| jkr�| �|||||� tj�|�}tj|d�| _|| _z| j� |� W n2 tj
j k
r� } zt t
| ���W 5 d} ~ X Y nX | j�� n
| j�� | jS )z�Build apt sandbox and return apt.Cache(rootdir=) (initialized lazily).
Clear the package selection on subsequent calls.
Nr9 )r r r
�_build_apt_sandboxr r �abspathr; r> �update�cache�FetchFailedException� SystemError�strr# �clear)
r �aptroot� apt_sources�
fetchProgress� distro_name�release_codename�originsr/ r: �er r r �_sandbox_cache s
�
z#__AptDpkgPackageInfo._sandbox_cachec C s4 z| � � | W S tk
r. td| ��Y nX dS )zuReturn apt.Cache()[package] (initialized lazily).
Throw a ValueError if the package does not exist.
�package %s does not existN)r? �KeyError�
ValueError�r �packager r r �_apt_pkg� s z __AptDpkgPackageInfo._apt_pkgc C s& | � |�}|j}|s td| ��|jS )z*Return the installed version of a package.rP )rU � installedrR �version)r rT �pkg�instr r r � get_version� s
z __AptDpkgPackageInfo.get_versionc C s | � |�jjS )z1Return the latest available version of a package.)rU � candidaterW rS r r r �get_available_version� s z*__AptDpkgPackageInfo.get_available_versionc C sJ | � |�jj}|sg S dd� |j�dg �|j�dg � |j�dg � D �S )z/Return a list of packages a package depends on.c S s g | ]}|d j j�qS �r )Z
target_pkg�name)�.0�dr r r �
<listcomp>� s z9__AptDpkgPackageInfo.get_dependencies.<locals>.<listcomp>ZDependsZ
PreDependsZ
Recommends)rU Z_pkgZ current_verZ depends_list�get)r rT Zcur_verr r r �get_dependencies� s � ��z%__AptDpkgPackageInfo.get_dependenciesc C sD | � |�jr| � |�jjS | � |�jr4| � |�jjS td| ��dS )z-Return the source package name for a package.rP N)rU rV � source_namer[ rR rS r r r �
get_source� s
z __AptDpkgPackageInfo.get_sourcec C s8 | � |�j}|std��|jD ]}|jr |j S q dS )z�Return package origin.
Return the repository name from which a package was installed, or None
if it cannot be determined.
Throw ValueError if package is not installed.
zpackage is not installedN)rU rV rR rM �origin)r rT rX rf r r r �get_package_origin� s
z'__AptDpkgPackageInfo.get_package_originc C s� | � |�}|jr |jjdkr dS | �� d }|jrX|jjrX|jjD ]}|j|krB dS qBtdd� |jjD ��tdg�kr�tj �
d�r�dS dS ) z�Check if a package is a genuine distro package.
Return True for a native distro package, False if it comes from a
third-party source.
NFr Tc S s g | ]
}|j �qS r )rf )r_ �or r r ra � s z:__AptDpkgPackageInfo.is_distro_package.<locals>.<listcomp>� z /etc/system-image/channel.ini) rU rV rW �get_os_versionr[ rM rf �setr r r" )r rT rX rK rh r r r �is_distro_package� s
�z&__AptDpkgPackageInfo.is_distro_packagec
C s� | � |�}|jr |jjdkr dS g }t�d�D ]R}z8t|��&}|D ]}|�� }|rB|�|� qBW 5 Q R X W q. tk
r~ Y q.X q.|jr�|jj r�|jj D ]}|j
|kr� dS q�dS )z�Check if a package originated from a native location
Return True for a package which came from an origin which is listed in
native-origins.d, False if it comes from a third-party source.
NFz /etc/apport/native-origins.d/*T) rU rV rW �globr# �strip�append�IOErrorr[ rM rf )r rT rX Znative_origins�f�fd�linerh r r r �is_native_origin_package� s$
z-__AptDpkgPackageInfo.is_native_origin_packagec C s� t jj�dd� ddlm} |jdddd�}|jd }|j|� � d
d �} | j
|d �}
|j d
d�} | j |||
ddd�} | s~dS d}
| D ]D}|j
dkr�q�|js�|jdd�}
q�q�|j�|�r�|jdd�}
q�q�|
s�dS |
D ]}|d |d f S d S )Nz APT::Get::AllowUnauthenticated�Truer �� Launchpad�apport-retrace�
production�devel�rW �ubuntu���)Zname_or_version)Zarchtag�primary�r^ FT)Z binary_namerW Zdistro_arch_seriesZordered� exact_match)NNri �Deleted)Z include_meta�urlZsha1)r; �apt_pkg�configrk �launchpadlib.launchpadrw �login_anonymously�
distributionsZ getSeries�splitZgetDistroArchSeries�
getArchiveZgetPublishedBinaries�statusZarchitecture_specificZbinaryFileUrlsZdistro_arch_series_link�endswith)r � distro_idr. rT rW r/ rw � launchpadr| ZseriesZdasr~ ZbpphZbf_urlsZbpZbfr r r �get_lp_binary_package s< �
�
z*__AptDpkgPackageInfo.get_lp_binary_packageFc C s� z(t |�}|�� dkr&td|�� ��W n, ttfk
rT t�dt|� � Y dS X z |�� }W n( tk
r� t�dt|� � Y dS X t |t
�r�|� d�}|r�t �
|�d S t �
|�S dS )z�Open, read and parse the json of a url
Set entries to True when the json data returned by Launchpad
has a dictionary with an entries key which contains the data
desired.
� �%uzcannot connect to: %sNzfailure reading data at: %szutf-8�entries)r �getcoder r �apport�warningr �readrp �
isinstance�bytes�decode�json�loads)r r� r� �responseZcontentr r r � json_request+ s"
z!__AptDpkgPackageInfo.json_requestc
C s� ddl m} |jdddd�}|jd }|jdd �}|j||d
d �}|sJd S d } |D ] }
|
jd
krbqR|
�� } qpqR| sxd S g } | D ]} | �| � q�| S )Nr rv rx ry rz r{ r| r~ r T)rd rW r� ri r� ) r� rw r� r� r� ZgetPublishedSourcesr� ZsourceFileUrlsro )
r r� rT rW rw r� r| r~ ZpssZsfusZpsZ source_filesZsfur r r �get_lp_source_packageE s. �
�
z*__AptDpkgPackageInfo.get_lp_source_packagec C sL | � |�jr | � |�jjp dS | � |�jr<| � |�jjp:dS td| ��dS )z�Return the architecture of a package.
This might differ on multiarch architectures (e. g. an i386 Firefox
package on a x86_64 system)�unknownrP N)rU rV � architecturer[ rR rS r r r �get_architecture] s
z%__AptDpkgPackageInfo.get_architecturec C s, | � d|g�}|dkrdS dd� |�� D �S )z*Return list of files shipped by a package.z-LNc S s g | ]}|� d �s|�qS )Zdiverted)�
startswith)r_ rq r r r ra p s
z2__AptDpkgPackageInfo.get_files.<locals>.<listcomp>)�
_call_dpkg�
splitlines)r rT �listr r r � get_filesj s z __AptDpkgPackageInfo.get_filesc
C sh d|| � � f }tj�|�s$d| }z,t�|�}t�|j�s@t�t|j |j
�}W n tk
rh g Y S X d}d|| � � f }tj�|�s�d| }tj�|�s�g S t |d���}|D ]�}znd|kr�t �
d|� W q�|�� } | s�t �
d |� W q�t�d
| d �d � �d ��}t|j |j
�|k�r"W q�W n tk
�r: Y nX ||7 }q�W 5 Q R X |�r`| �|�S g S d
S )z/Return list of all modified files of a package.z /var/lib/dpkg/info/%s:%s.listz/var/lib/dpkg/info/%s.list� z /var/lib/dpkg/info/%s:%s.md5sumsz /var/lib/dpkg/info/%s.md5sumsr � z(%s contains NUL character, ignoring linez%%s contains empty line, ignoring liner8 r} �UTF-8N)�get_system_architecturer r r" r1 �S_ISREG�st_mode�OSError�max�st_mtime�st_ctimer# r� r� r� r� �encode�_check_files_md5)
r rT Zlistfile�sZmax_timeZsums�sumfilerr rs Zwordsr r r �get_modified_filesr sF
z'__AptDpkgPackageInfo.get_modified_filesc
C s t jdddd|gt jd�}|�� d �� }|jdkr8i S i }|�� D ]�}|sNqD|�� �� dd� \}}t j
� |�r�zLt |d ��}|�
� } W 5 Q R X t�� }
|
�| � |
�� } | |kr�| ||< W q� tk
r� } zd
t| � ||< W 5 d} ~ X Y q�X qDd ||< qD|S ) a? Return modified configuration files of a package.
Return a file name -> file contents map of all configuration files of
package. Please note that apport.hookutils.attach_conffiles() is the
official user-facing API for this, which will ask for confirmation and
allows filtering.
z
dpkg-queryz-Wz--showformat=${Conffiles}�--��stdoutr N� r z[inaccessible: %s]z [deleted])�
subprocess�Popen�PIPE� communicater� �
returncoder� rn r� r r r" r# r� �hashlibZmd5rB Z hexdigestrp rF )
r rT �dpkg�out�modifiedrs r Zdefault_md5sumrr �contents�mZcalculated_md5sumrN r r r �get_modified_conffiles� s6
��
$
z+__AptDpkgPackageInfo.get_modified_conffilesc C s| d}d}d}|sx|t |�k rxtjdddd|g|||| � tjtjtjd�}|�� d �d �}|jdkrn|}||7 }q |S )
zsCall fgrep for a pattern on given file list and return the first
matching file, or None if no file matches.N�d r Zfgrepz-lxm�1r� )�stdinr� �stderrr� )�lenr� r� r� r� r� r� )r �patternZ file_list�matchZ
slice_size�i�pr� r r r Z
__fgrep_files� s � �
z"__AptDpkgPackageInfo.__fgrep_filesNc C st |r| � ||||�S tjdd|gtjtjd�}|�� d �d�}|jdkrf|rf|�� d }|dkrf|S tj �
tj � |��d � � } g }
g } t
�
d�D ]P} tj �
tj � | ��d � � �d �d }
|
| ks�| |
kr�| �| � q�|
�| � q�| �|| �}|�s| �||
�}|�sH|�d
��rH|d d � }| �d
| | �}|�sH| �d
| |
�}|�rptj �
tj � |��d �d �d S d S )ap Return the package a file belongs to.
Return None if the file is not shipped by any package.
If uninstalled is True, this will also find files of uninstalled
packages; this is very expensive, though, and needs network access and
lots of CPU and I/O resources. In this case, map_cachedir can be set to
an existing directory which will be used to permanently store the
downloaded maps. If it is not set, a temporary directory will be used.
Also, release and arch can be set to a foreign release/architecture
instead of the one from the current system.
z dpkg-divertz--list�r� r� r r� r} zhardening-wrapperz/var/lib/dpkg/info/*.list�:z/usr� N�%s)�_search_contentsr� r� r� r� r� r� r� r r �splitext�basename�lowerrm ro � _AptDpkgPackageInfo__fgrep_filesr� )r �fileZ uninstalled� map_cachedirr. r/ r� r� rX �fnameZ all_listsZ likely_listsrq r� r� r r r �get_file_package� s< � & "z%__AptDpkgPackageInfo.get_file_packagec C sB t jddgt jd�}|�� d �� �� }|jdks6t�|s>t�|S )zcReturn the architecture of the system, in the notation used by the
particular distribution.r� z--print-architecturer� r �r� r� r� r� r� rn r� �AssertionError)�klassr� r/ r r r r� s
�z,__AptDpkgPackageInfo.get_system_architecturec C s> t jddgt jd�}|�� d �� �� }|jdks6t�d| S )z�Return a list of default library search paths.
The entries should be separated with a colon ':', like for
$LD_LIBRARY_PATH. This needs to take any multiarch directories into
account.
zdpkg-architecturez-qDEB_HOST_MULTIARCHr� r z /lib/%s:/libr� )r r� Zmultiarch_tripler r r �get_library_paths s
�z&__AptDpkgPackageInfo.get_library_pathsc C s< || _ z | jr t�| j� d| _W n tk
r6 Y nX dS )z�Explicitly set a distribution mirror URL for operations that need to
fetch distribution files/packages from the network.
By default, the mirror will be read from the system configuration
files.
N)r r r r r )r r� r r r �
set_mirror- s
z __AptDpkgPackageInfo.set_mirrorc C s& t j�� }|r:t�� }|�d| �� � |�� |j|d< |rRt j
dddg|d� dddd|g}|rx|d d
| 7 < �z t j
|||d �d k�r�|s�W d
S | � | � � ||�} | �r�d}
t
jj�d�dkr�t
jj�d�}
t
jj�dd� t
jj�� } t
j�| �} g }
| D ] }|
�t
jj| ||d�� �q| �� }|| jk�rBW d
S |
�rXt
jj�d|
� t�t j� |d��D ] }t j
ddd|gt j |d� �qlnW d
S W n t k
�r� Y d
S X d
}t�t j� ||d ��D ]}t j� |��r�|}�q�|�s�t d��zt j
dd|d� W n t k
�r Y nX |S )a: Download source package and unpack it into dir.
This also has to care about applying patches etc., so that dir will
eventually contain the actually compiled source. dir needs to exist and
should be empty.
If version is given, this particular version will be retrieved.
Otherwise this will fetch the latest available version.
If sandbox is given, it calls apt-get source in that sandbox, otherwise
it uses the system apt configuration.
If apt_update is True, it will call apt-get update before apt-get
source. This is mostly necessary for freshly created sandboxes.
Return the directory that contains the actual source root directory
(which might be a subdirectory of dir). Return None if the source is
not available.
zODir "%s";
Dir::State::Status "/var/lib/dpkg/status";
Debug::NoLocking "true";
Z
APT_CONFIGzapt-getz-qqrB )�envz --assume-yes�sourcer} �=)�cwdr� r Nri zAcquire::http::Proxy)�destdirz*.dscz dpkg-sourcez-sn�-x)r� r� z-*z.could not determine source tree root directoryz�(debian/rules patch || debian/rules apply-patches || debian/rules apply-dpatches || debian/rules unpack || debian/rules patch-stamp || debian/rules setup) >/dev/null 2>&1T)�shellr� )!r �environ�copy�tempfileZNamedTemporaryFile�writer� �flushr^ r� �callr� �get_distro_namer; r� r� �findrk r< r= �AcquireProgress�Acquirero � AcquireFile�runZRESULT_CONTINUErm r r! r� r� �isdirr� )r Z
srcpackage�dirrW ZsandboxZ
apt_updater� rq �argvZsf_urls�proxyrJ �fetcherZaf_queueZsf�resultZdsc�rootr` r r r �get_source_tree> s~
�
� � ��
�
z$__AptDpkgPackageInfo.get_source_treec C s dt �� d S )z�Return the actual Linux kernel package name.
This is used when the user reports a bug against the "linux" package.
z linux-image-r� )r �unamer r r r �get_kernel_package� s z'__AptDpkgPackageInfo.get_kernel_packagec C s g }g }|d � � d }|d }|d � � d }d| }| �� }||krZ|| jrZ||fS tjj�d�d } d|||f }
d |
} ttj �
| |
�d
�} t | �}
|
� � d kr�d S |
�
d
�}|s�q�| �|� q�| �� | �� t�ddtj �
| |
�g�}|dk�r|�|
� d�d � ||fS )z�Install kernel debug package
Ideally this would be just another package but the kernel is
special in various ways currently so we can not use the apt
method.
ZUname� Z ArchitectureZPackagezlinux-image-debug-%s�Dir::Cache::archivesz/partialz
%s_%s_%s.ddebz,http://ddebs.ubuntu.com/pool/main/l/linux/%s�wr� )ri Zlinuxi r� z-ir �_)r� r? Z isInstalledr; r� r� �find_dirr# r r r! r r� r� r� r� �closer� r� ro )r �reportrV ZoutdatedZkverr/ �verZ
debug_pkgname�cZ
target_dir�debr� r� �u�blockZretr r r �_install_debug_kernel� s4
z*__AptDpkgPackageInfo._install_debug_kernelTc = s�
|s | � � }|s d} | �� | _n�tj�||d�} || � � kr^tj�|||d�}
tj�|
�r^|
} z| �| �| �� W n4 t k
r� } zt
� dt |� � W 5 d}~X Y nX t
tj�||d���}|�� �� | _W 5 Q R X tj�| �s�t d| ��|�rVd}|| � � k�r |}nd}|�r*tj�|||d �}ntj�|d
|d �}tj�|��sbt�|� n d }t�� }tjj�d |� tjj�d
d� tjj�dd� tjj�dd� |�r�tjj�� }n tjj�� }|�s�| � || || � � | j| |�� nx| � || | � � | j| � tj tj� |�d�� z� �!|� W n4 tj"j#k
�rT } zt t |���W 5 d}~X Y nX � �
� tjj�$d�}d}tj�%� }tj�|d�}i }tj�|��r�t
|��8}|D ],}|�� }|�s��q�|�&� \}}|||< �q�W 5 Q R X t� } i } tj�'|�} g } | �rNg } |D �]8\}!}"z � |! }#W nB t(k
�r` d|!�)dd� }$||$d 7 }t
� |$� Y �qY nX |#j*j+D ]�}%� |%d j, j*j-}&|%d j,dd� |D �k�r��qj|%d j,|k�r�||%d j, }'| �.|'|&�d k�r�| �/|%d j,|'f� n| �/|%d j,|&f� n| �/|%d j,|&f� |%d j,d d� |D �k�rj|�/|%d j,df� �qj�q|�0| � |D �]�\}!}"z � |! }#W nB t(k
�r� d|!�)dd� }$||$d 7 }t
� |$� Y �qRY nX z|"�r�|#j1|" |#_*W nt t(k
�r6 | �2| � � ||!|"|�\}(})|(�r | �/tjj3| |(d |) |d �� |"| |!< n|d |!|"|#j*j-f 7 }Y nX |#j*}*| �4|!� |�rB| �5|�}+|*j6D ]}|+�7|t� ��4|!� �q^g },d!|*j8k�r�|,tj�9|*j8d! �7 },d"|*j8k�r�|,tj�9|*j8d" �7 },|,D �]x}-|-d d |*j:j,k�r�q�|-d }-� �;|-d ��r�z|+|-d }.W n t(k
�r* Y �q�Y nX |.D ]�}||*j:j,k�rF�q0tj�|d#| �}/t<�<|/�D ]4}0| �=|0�}"tj�>|"|-d$ |-d% ��rbt�?|0� �qbz
||= W n t(k
�r� Y nX �q0~.n|tj�|d#|-d �}/t<�<|/�D ]Z}0| �=|0�}"tj�>|"|-d$ |-d% ��r�t�?|0� z||-d = W n t(k
�r8 Y nX �q�q�|*j@d&k�rR|
�rRz�|!d' }1� |1 }2d}3|"�r�z|2j1|" |2_*d }3W nf t(k
�r� | �2| � � ||1|"|�\}(})|(�r�| �/tjj3| |(d |) |d �� |"| |1< d }3nt(�Y nX |3�s2z|2j1|*j- |2_*W n, t(k
�r0 |d(|!|"|2j*j-f 7 }Y nX | �4|1� W �qR t(k
� r |�A� |�B|*jC��r�� fd)d�|jDD �}4|"�r�|4D ]"}2� |2 j*j-|"k�r�|4�E|2� �q�ng }4|4� r�|4D ]�}|| k�r̐q�d}3|"� rTz � | j1|" � | _*d }3W n` t(k
� rR | �2| � � |||"|�\}(})|(� rN| �/tjj3| |(d |) |d �� |"| |< d }3Y nX |3� s�z� | j1|*j- � | _*W n t(k
� r� Y nX | �4|� �q��n`d}3|!d* }5zڈ |5 }6| �4|5� |"�
r:z|6j1|" |6_*d }3W n` t(k
�
r8 | �2| � � ||5|"|�\}(})|(�
r4| �/tjj3| |(d |) |d �� |"| |5< d }3Y nX |3�
s�z|6j1|*j- |6_*W n. t(k
�
r� |d+|!|*j-|6j*j-f 7 }Y nX W nx t(k
�
r� |"�
r�| �2| � � ||5|"|�\}(})|(�
r�| �/tjj3| |(d |) |d �� |"| |5< d }3|3�
s�|d,|! 7 }Y nX Y nX �qRtF|�}7| �G� D ]�}||7k� r�|7| dk� rj|�H|�� | j*j-k� rX| �E|� n� | �Idd� nZ|�H|�|7| k� r�� | �Idd� n4|�H|�� | j*j-k� r�� | �Idd� n
| �E|� n4|�H|�� | j*j-k� r� | �Idd� n
| �E|� � qtJ�J� }8z� jK| d-� W nB tj"j#k
� rX } z t
�Ld.t |�� tM�Nd%� W 5 d}~X Y nX |� rhtOd/� | jPD ]�}9tQ�Rd0d1|9jSg��T� }:|:�� �&� \}}|� r�||k� s�tj�U|9jS�|8k�
r|�H|�|k� r�n6|| k� r�| | |k� r�n tQ�Vd2d3|9jS|g� |||< tj�W|9jS��&d4d%�d };|;| k� rn| �E|;� � qntX|�Y� �}<|<�Z� t
|d5��>}|<D ]2}|�[|� |�[d6� |�[|| � |�[d� �
qZW 5 Q R X |�
r�t\�]|� | �
r�t^d7d6�| � ��|�
r�| �_|� |S )8a� Install packages into a sandbox (for apport-retrace).
In order to work without any special permissions and without touching
the running system, this should only download and unpack packages into
the given root directory, not install them into the system.
configdir points to a directory with by-release configuration files for
the packaging system; this is completely dependent on the backend
implementation, the only assumption is that this looks into
configdir/release/, so that you can use retracing for multiple
DistroReleases. As a special case, if configdir is None, it uses the
current system configuration, and "release" is ignored.
release is the value of the report's 'DistroRelease' field.
packages is a list of ('packagename', 'version') tuples. If the version
is None, it should install the most current available version.
If cache_dir is given, then the downloaded packages will be stored
there, to speed up subsequent retraces.
If permanent_rootdir is True, then the sandbox created from the
downloaded packages will be reused, to speed up subsequent retraces.
If architecture is given, the sandbox will be created with packages of
the given architecture (as specified in a report's "Architecture"
field). If not given it defaults to the host system's architecture.
If origins is given, the sandbox will be created with apt data sources
for foreign origins.
If install_deps is True, then the dependencies of packages will also
be installed.
Return a string with outdated packages, or an empty string if all
packages were installed.
If something is wrong with the environment (invalid configuration,
package servers down, etc.), this should raise a SystemError with a
meaningful error message.
�/etc/apt/sources.list� sources.listzcannot determine mirror: %sNZcodenamez%s does not existFri r; �systemTzAPT::ArchitecturezAcquire::LanguagesZnonez'Acquire::http::Proxy::api.launchpad.netZDIRECTz#Acquire::http::Proxy::launchpad.netr9 r� z packages.txtz#package %s does not exist, ignoring�%z%%�
r c S s g | ] }|d �qS r] r �r_ rX r r r ra ` s z9__AptDpkgPackageInfo.install_packages.<locals>.<listcomp>r} c S s g | ] }|d �qS r] r r r r r ra n s zsha1:%s)�hashr� z,%s version %s required, but %s is available
Z ConflictsZReplacesz%s_*.debr� r� �all�-dbgzAoutdated -dbg package for %s: package version %s -dbg version %s
c s2 g | ]*}|� d �r|� krd� | jjkr|�qS )r Z transitional)r� r[ Z description)r_ r� �rC r r ra � s
�z-dbgsymzKoutdated debug symbol package for %s: package version %s dbgsym version %s
z%no debug symbol package found for %s
)r� z+Package download error, try again later: %sz Extracting downloaded debs...�dpkg-debz--showr� r� r r� � z*apt fetcher did not fetch these packages: )`r� �get_distro_codename�current_release_codenamer r r! r" r� �$_get_primary_mirror_from_apt_sourcesrE r� r� rF r# r� rn r� �makedirsr� �mkdtempr; r� r� rk r< �textr� r= rO r� r@ r> rA rB rC rD r Z
SourceRecordsr� r� rQ �replacer[ Z dependenciesr^ rW �compare_versionsro �extendZversionsr� r� �addr* Zprovides�
setdefault�recordZ
parse_dependsrT Zis_virtual_packagerm � _deb_versionZ check_dep�unlinkr� Zrestart�lookuprd Zbinariesr3 �dictr� rb Z mark_install�timeZfetch_archives�error�sys�exit�print�itemsr� Z check_outputZdestfiler� �getctimeZ
check_callr� r� �keys�sortr� r r r� r- )=r r: r' r. Zpackages�verboseZ cache_dirZpermanent_rootdirr� rM Z install_dbgZ install_depsrI Zarch_apt_sourcesrN rq Z tmp_aptrootZ aptroot_archrH rJ Z
archivedirZobsoleteZ src_recordsZpkg_listZ pkg_versionsrs r� �vZ real_pkgsZlp_cacher� Z
acquire_queueZdepsrX r Z cache_pkgr� ZdepZ dep_pkg_versZ inst_versionZlp_urlZsha1sumr[ Zvirtual_mappingZ conflictsZconflictZ providersZdebsr Zdbg_pkgZdbgZ pkg_foundZdbgsZ
dbgsym_pkgZdbgsymZrequested_pkgsZ last_writtenr� r� �pkg_nameZpkgsr r r �install_packages� s� -
� $
� �
� �
� �
�
� �
� �
�
� �
$
�
z%__AptDpkgPackageInfo.install_packagesc C s t j�| �� �� |�S )z2Return known package names which match given glob.)rm Zfnmatch�filterr? r- )r Znameglobr r r �package_name_glob� s z&__AptDpkgPackageInfo.package_name_globc C sH t jdg| t jt jd�}|�t�d �d�}|jdkr<|S td��dS )zRCall dpkg with given arguments and return output, or return None on
error.r� r� r r� zpackage does not existN)r� r� r� r� �inputr� r� rR )r� �argsr� r� r r r r� � s �
z __AptDpkgPackageInfo._call_dpkgc C s� t j�|�rBtjdd|gtjtjdi d�}|�� d jddd�}nLt|�t ksVt
d ��tjddgtjtjtjdi d
�}|�|�d jddd�}|j dkr�g S g }|� � D ]$}|�
d �r�|�|�d d
�d � q�|S )z�Internal function for calling md5sum.
This is separate from get_modified_files so that it is automatically
testable.
z/usr/bin/md5sumz-cr8 )r� r� r� r� r r� r )�errorsz&md5sum list value must be a byte array)r� r� r� r� r� ZFAILEDr� r� )r r r" r� r� r� r� r� �typer� r� r� r� r� ro �rsplit)r r� r� r� Z
mismatchesrs r r r r� � s0 �
�
z%__AptDpkgPackageInfo._check_files_md5c
C s� t |���}|D ]p}|�� }t|�dkr|d dkr|d �d�rFd}nd}|| �d�sf|| �d�r|| W 5 Q R � S qtd | ��W 5 Q R X d
S ) z?Heuristically determine primary mirror from an apt sources.list� r r r� �[r� zhttp://zhttps://zEcannot determine default mirror: %s does not contain a valid deb lineN)r# r� r� r� rE )r� rI rq rs ZfieldsZ
mirror_idxr r r r � s
��z9__AptDpkgPackageInfo._get_primary_mirror_from_apt_sourcesc C s | j s| �d�| _ | j S )zReturn the distribution mirror URL.
If it has not been set yet, it will be read from the system
configuration.r
)r r r r r r � _get_mirror� s z __AptDpkgPackageInfo._get_mirrorc C s& t | d�r| jdk r| jS td��dS )z7Map a DistroRelease: field value to a release code namer NzBCannot map DistroRelease to a code name without install_packages())�hasattrr �NotImplementedError)r r. r r r �_distro_release_to_codename� s z0__AptDpkgPackageInfo._distro_release_to_codenamec
C s |r
|}n| j st�� | _ | j }|dkr0| �� }|dkrB| �� }n
| �|�}dD �]\}tj�|d|||f �}d}z t� |�} t
t � � | j �}
W n t
k
r� d}
Y nX |
dks�|
dk�r.d| �� |||f } |
�r�z ddlm} dd lm}
W n. tk
�r" ddlm} dd lm}
Y nX dd
lm} |
| �d }| |�}|�d |
| �d
� |�� }|�dd�}|�r�|�|d�}||�| j �k}nd}nd}|�r.d| _z t | �}W n( t k
�r� |dk�r҂ nY qPY nX t |d��(}|� d�}|�s��q
|� |� �q�W 5 Q R X |�!� tj�"|��s.t#�| �$|||�}|�rPt%|�d
k�rVd| _| jrPddl&}|� d| d���2}d}|D �] }|d 7 }|dk�r�|dk�r�|dk �r��q�|�'� d } | �'d�d dk�r6| �'d�d dk�r�q�| �'d�d dk�r| �'d�d
d k�r�q�|�'� d �'d �d �'d�d } n:| �'d�d d k�r�|�'� d �'d �d �'d�d } n�q�| |k�r�| || k�r��q�n| || < n| || < �q�W 5 Q R X qP| j�r�| �(|||� d| _t)|t*��r�|�+� }|d d k�r�|d d� }|�,� g} |�-d!��r(| �.|d"d� �,� � n�|�-d#��rL| �.|d"d� �,� � n�|�-d$��rp| �.|d"d� �,� � nj|�-d%��r�| �.|d"d� �,� � nF|�-d&��r�| �.|d"d� �,� � n"|�-d'��r�| �.|d"d� �,� � | D ]4}z|| �+� } | W S t/k
�r Y nX �q�dS )(z4Internal function for searching file in Contents.gz.N)z -proposedri z -securityz-updatesz%s%s-Contents-%s.gzFi�Q z %s/dists/%s%s/Contents-%s.gzr )�HTTPConnection)�urlparse)�datetimer� ZHEADr� z
last-modifiedz%a, %d %b %Y %H:%M:%S %ZTri r+ i@B r� r )ZtrustyZxenial�! � /s usr)� libs libexecs libx32� bin� sbin� shares gamess BrotherrH )s docs iconss mans texlives gocodes locales helpr} � ,)rE rF rG r8 zusr/lib/x86_64-linux-gnu/r� zusr/lib/i386-linux-gnu/zusr/lib/systemd/z
usr/lib/udev/zusr/bin/z usr/sbin/)0r r� r r� r r? r r r! r1 �intr& r� r� r< Zhttplibr@ rA � ImportErrorZ http.client� urllib.parserB ZrequestZ getresponseZ getheader�strptimeZ
fromtimestampr r rp r# r� r� r r" r� r5 r� �gzipr� r7 r� r� r� r� r� ro rQ ) r r� r� r. r/ r� Zpocket�maprB �stZager� r@ rA rB ZserverZconn�resZ modified_strr� �srcrq �dataZcontents_mappingrN r� Zline_numrs r rT �filesrX r r r r� � s�
�
�
� �""
z%__AptDpkgPackageInfo._search_contentsc
C s� |� d��r�|�d�dd� }d}t|�dkr<|�d� d}d}|t|�k �r t�d|d|� �}t�d||d� �}zPtttj j
|||d � ���*} | � � | � � d
kr�t
d | � � ��W 5 Q R X W nR tt
fk
�r |d7 }|t|�k�r|�r |�d� d}d}nd}Y q@Y nX �q q@|�r�|�r�d ||||f }
d
||||f } zFtt| ���,} | � � | � � d
k�r�t
d | � � ��W 5 Q R X d} W n tt
fk
�r� d} Y nX |
| d |
dd� d S dS )a� For an origin from a Launchpad PPA create sources.list content.
distro is the distribution for which content is being created e.g.
ubuntu.
release_codename is the codename of the release for which content is
being created e.g. trusty.
Return a string containing content suitable for writing to a sources.list
file, or None if the origin is not a Launchpad PPA.
�LP-PPA-�-r� NTr� �ppaF��user�distroZppanamer� r� z-deb http://ppa.launchpad.net/%s/%s/%s %s mainz5http://ppa.launchpad.net/%s/%s/%s/dists/%s/main/debugz main/debugri z
deb-srcr: r )r� r� r� ro rF r! r r r� � packagingr r� r� r r )
r� rf rZ rL Z
componentsZtry_ppa�indexrY �ppa_namer� Zppa_lineZ debug_urlZ add_debugr r r � create_ppa_source_from_origin� s^
��
�
�
z2__AptDpkgPackageInfo.create_ppa_source_from_originc
C sr t j�t j�|ddd��s�t �t j�|ddddd�� t �t j�|ddddd�� t �t j�|ddd�� t �t j�|d dd
�� t �t j�|d dd �� t j�|d dd �}t j�|�r�t�|� t j�|d
�r�t�|d
|� n
t �|� t |��8}t t j�|d dd�d��}|�
|� � � W 5 Q R X W 5 Q R X |�r�d} i }
|D �]|} | dk�rZ�qFd } t j�|d
��r�t j�|d
| d �} t j�| ��s�d| k�r�t j�|d
| � d�d �} t j�| ��s�d } nt j�| ��s�d } | �rt | ��}
|
� � } W 5 Q R X n| �
| ||�} | �r�t t j�|d dd | d �d��}|�
| � W 5 Q R X | �� D ]\}|�d��rh�qTd|k�rv�qT|�� d �d�d }|�� d �d�d }||f|
| < �qTnt�d | � �qFt j�t j�|�d �}t j�|��rt�|t j�|d d�� n&t j�d ��r*t�d t j�|d d�� t j�|d dd �}t j�|��rTt�|� t j�|d
��rxt�|d
|� n&t j�d ��r�t�d |� n
t �|� |�rn| �rn|
�� D ]�\} \}}tjjt|�|t|�d!� }tj�|�}|�s�q�z |d" }W n* tk
�r& t�d#| � Y �q�Y nX d$d%t j�|d&| �d'd(d)d*d+|g }t� |�d,k�r�t�d-| � �q�d S ).N�var�libr; Zlists�partialrC Zarchivesr� �etcz
apt.conf.dz
preferences.dzsources.list.dz.dr r� ri r� z.listzLP-PPArU �a�#zppa.launchpad.netr� r8 r: r� z-Could not find or create source config for %sz trusted.gpgz/etc/apt/trusted.gpgz
trusted.gpg.dz/etc/apt/trusted.gpg.drX �signing_key_fingerprintz/Error: can't find signing_key_fingerprint at %szapt-keyz --keyringz%s.gpgZadvz--quietz --keyserverzkeyserver.ubuntu.comz
--recv-keyr zUnable to import key for %s) r r r" r! r r r r� Zcopytreer# r� r� rn r^ r� r� r� r� r� �dirnamer� r+ r[ r r r� �
IndexErrorr� r� )r� Zapt_rootrI rK rL rM Zlist_drR �destZsource_list_contentZ origin_datarf Z origin_pathZsrc_extrs rY rW Z trusted_gpgZ trusted_dZppa_userr] Zppa_archive_urlZppa_infore r� r r r r@ � s�
"
�
��
�� � ��z'__AptDpkgPackageInfo._build_apt_sandboxc C sJ t jdd|dgt jd�}|�t�d �d��� }|jdks>t�|sFt�|S )z!Return the version of a .deb filer z-fZVersionr� r r� ) r� r� r� r� r5 r� rn r� r� )r� rX r� r� r r r r" 4 s
z!__AptDpkgPackageInfo._deb_versionc C s t j�||�S )zkCompare two package versions.
Return -1 for ver < ver2, 0 for ver1 == ver2, and 1 for ver1 > ver2.)r; r� Zversion_compare)r Zver1Zver2r r r r > s z%__AptDpkgPackageInfo.compare_versionsc C sJ | j dkrDtjddgtjd�}|�� d �d��� | _ |jdksDt�| j S )z(Get "lsb_release -sc", cache the result.N� lsb_releasez-scr� r r� ) �_distro_codenamer� r� r� r� r� rn r� r� )r ri r r r r G s
�z(__AptDpkgPackageInfo.get_distro_codenamec C s< | j dkr6| �� d �� | _ d| j kr6| j �dd�| _ | j S )zuGet osname from /etc/os-release, or if that doesn't exist,
'lsb_release -sir' output and cache the result.Nr r rV )� _distro_namerj r� r r r r r r� T s
z$__AptDpkgPackageInfo.get_distro_name)F)FNNN)NNF)FNFNNTF)4�__name__�
__module__� __qualname__�__doc__r r r* r- r5 r7 r? rO rU rZ r\ rc re rg rl rt r� r� r� r� r� r� r� r� r� � classmethodr� r� r� r� r� r r2 r4 r� r� r r< r? r� r^ r@ r" r rj r rk r� r r r r r
) s�
"
0( �
6
�
X' �
X
A
k
r
)#ro r� r rm r1 r( r� r r& r� r� �
contextlibr �warnings�filterwarnings�
FutureWarningr; ZcPickler$ Zurllibr r r rp r r rK Z urllib.errorZurllib.requestrL r� Zapport.packagingr r
�implr r r r �<module> sD @ D