File: //lib/python3/dist-packages/apport/__pycache__/report.cpython-38.pyc
U
��8dL � @ s� d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl
Z
ddlZddlZddlZddlZddlZddlmZ e
jdkr�dZddlmZ ddlmZ ddl m Z eef n d Zddl mZ ddl m Z e Zddl Z ddl!Z!ddl"Z!dd
l#m$Z% dd l&m'Z' ej(�)d d
�Z*de* Z+de* Z,dZ-dZ.dZ/dZ0ddddddddd d d g Z1d d � Z2d5d!d"�Z3d6d#d$�Z4d%d&� Z5d7d'd(�Z6d)d*� Z7d+d,� Z8d-d.� Z9d/d0� Z:d1d2� Z;G d3d4� d4e j<�Z=dS )8z;Representation of and data collection for a problem report.� N)�
ExpatError�3F)�URLError)�urlopen)�unquoteT)�impl)�kill_pkttyagentZAPPORT_DATA_DIRz/usr/share/apportz%s/package-hooks/z%s/general-hooks/z/optz~/.apport-ignore.xmlz/etc/apport/blacklist.dz/etc/apport/whitelist.dZshZbashZdashZcshZtcshzpython*zruby*Zphpzperl*zmono*Zawkc C sV zt �| � W n tk
r$ Y dS X t �| �D ] }||kr0|�|� t||� q0dS )z7Recursively add dependencies of package to depends_set.N)� packaging� get_version�
ValueErrorZget_dependencies�add�_transitive_dependencies)�packageZ depends_set�d� r �//usr/lib/python3/dist-packages/apport/report.pyr
9 s
r
c C s, t s|dk rtj| |d�S t�d|| f �S )zrUse readlink() to resolve link.
Return a string representing the path to which the symbolic link points.
N��dir_fd� /proc/%s/%s)�_python2�os�readlink)�path�pidr r r r �_read_proc_linkF s r c
C s� znt s(|dk r(tj| tjtjB |d�}n d|| f }t�|d��&}|�� �� jddd�W 5 Q R � W S Q R X W n6 t t
fk
r� } zdt |� W Y �S d}~X Y nX dS ) zXRead file content.
Return its content, or return a textual error if it failed.
Nr r �rb�UTF-8�replace��errors�Error: ) r r �open�O_RDONLY� O_CLOEXEC�io�read�strip�decode�OSError�IOError�str)r r r Z proc_file�fd�er r r �_read_proc_fileQ s .r- c
sx d}t r dS z0td� fdd�d��}|�� �� }W 5 Q R X W n6 ttfk
rr } zdt|� W Y �S d}~X Y nX |S ) z�Read /proc/pid/maps.
Since /proc/$pid/maps may become unreadable unless we are ptracing the
process, detect this, and attempt to attach/detach.
z%Error: unable to read /proc maps filezDError: python2 does not provide a secure way to read /proc maps file�mapsc s t j| |� d�S )Nr )r r! )r �mode�� proc_pid_fdr r �<lambda>n � z _read_maps.<locals>.<lambda>)Zopenerr N)r r! r% r& r( r) r* )r1 r. r+ r, r r0 r �
_read_mapsb s "r4 c C s� t j| t jt j|d�}z|j|dd�d }W nB t jk
rn |�� |�� \}}tdt| �|j |f ��Y nX |j dkr~|S |r�|j
ddd�}nd }td
t| �|j |f ��d S ) z�Run command and capture its output.
Try to execute given command (argv list) and return its stdout, or return
a textual error if it failed.
)�stdout�stderr�envi )�inputZtimeoutr z0Error: command %s timedout with exit code %i: %sr r r � z.Error: command %s failed with exit code %i: %sN) �
subprocess�Popen�PIPE�STDOUTZ communicateZTimeoutExpired�killr( r* �
returncoder' )�commandr8 r7 Zsp�outZerrsr r r �_command_outputu s0
� �
�rB c C sn t r|j�d�s$dS nd|jkr$dS |jD �]}|jtjjjkr*|j dkr*z|jd j
}W n t k
rr Y q*Y nX || kr� dS |� � |�
� r*|jd jtjjjkr*|jd j
}t r�|�d�}| | }t|tj�r�|�� }t s�|�d�}n t|t��r
t �s
|�d�}zt�|�}W n tk
�r2 Y q*Y nX |�|�s* dS q*t �r^|jd j
�d�S |jd j
S dS )zxCheck if given report matches the given bug pattern XML DOM node.
Return the bug URL on match, otherwise None.
�urlN�re�keyr r )r Z
attributesZhas_key�
childNodes�nodeType�xml�dom�NodeZ ELEMENT_NODEZnodeName� nodeValue�KeyError� normalizeZ
hasChildNodes� TEXT_NODE�encode�
isinstance�problem_reportZCompressedValueZ get_value�bytesrD �compile� Exception�search)�report�pattern�crE Zregexp�vZre_cr r r �_check_bug_pattern� sF
rZ c C sf z t r|�d�}tjj�|�}W n ttfk
r: Y d S X |�d�D ]}t | |�}|rF| S qFd S )Nr rW )
r rO rH rI �minidom� parseStringr �UnicodeEncodeError�getElementsByTagNamerZ )rV �patternsrI rW rC r r r �_check_bug_patterns� s
r` c C sJ | j D ]>}|jtjjjkr<|j�� dkr<|�� | � |� qt
|� qdS )z6Recursively remove whitespace from given XML DOM node.r9 N) rF rG rH rI rJ rN rK r& �unlinkZ removeChild�_dom_remove_space)ZnoderX r r r rb � s
rb c
C s
t j�|�sdS i }z�t|�� }tt|�� |d�|� W 5 Q R X z|d | |� W n@ tk
r� } z"t|�� d�r�|d | � n� W 5 d }~X Y nX W nn t
k
r� Y dS t k
�r t j� t j�
|��d �dd�}t�� | d | < t�d
|� t�� Y nX dS ) NF�execZadd_infoz
add_info()Tr �-�_Z
HookError_zhook %s crashed:)r r �existsr! rc rS r% � TypeErrorr* �
startswith�
StopIterationrT �splitext�basenamer � traceback�
format_exc�apport�error� print_exc)rV �ui�hookZsymbr+ r, Zhooknamer r r � _run_hook� s(
rs c C s� |rHt j�� }|�dd��t j�}|�t j�|dd�< t j�|�|d< nd}z tjd| g|d�� � �
� W S tj k
r� Y dS X dS )z-Return path of command, preferring extra_path�PATHr9 r NZwhich�r7 ) r �environ�copy�get�split�pathsep�joinr: Z check_outputr' r& ZCalledProcessError)r@ Z
extra_pathr7 �partsr r r �_which_extrapath� s
r} c @ s> e Zd ZdZdFdd�Zdd� Zdd � ZdGd
d �Zd d
� Zdd� Z dd� Z
dd� Z dd� Z e
dd� �Zddg fdd�Zdg dfdd�ZdHd d �ZdId d �Zd d!� ZdJd"d#�Zd$d%� Zd&d'� Zd(d)� Zd*d+� Zd,d-� Zd.d/� Zd0d1� Zd2d3� Z d4d5� Z d6d7� Z d8d9� Z d:d;� Z d<d=� Z!dKd>d?�Z"d@dA� Z#dBdC� Z$e
dLdDdE��Z%dS )M�Reportz�A problem report specific to apport (crash or bug).
This class wraps a standard ProblemReport and adds methods for collecting
standard debugging data.�CrashNc C s t j�| ||� d| _d| _dS )a, Initialize a fresh problem report.
date is the desired date/time string; if None (default), the current
local time is used.
If the report is attached to a process ID, this should be set in
self.pid, so that e. g. hooks can use it to collect additional data.
N)rQ �
ProblemReport�__init__r �_proc_maps_cache)�self�type�dater r r r� s zReport.__init__c C sp d}t �|�}|r$|dd�|� 7 }z2t �|�sTt �|�}|rL|d| 7 }n|d7 }W n tk
rj Y nX |S )z�Return a string suitable for appending to Package/Dependencies.
If package has only unmodified files, return the empty string. If not,
return ' [modified: ...]' with a list of modified files.
r9 z [modified: %s]� z
[origin: %s]z [origin: unknown])r Zget_modified_filesr{ Zis_distro_packageZget_package_originr )r� r �suffix�mod�originr r r �_customized_package_suffix s
z!Report._customized_package_suffixc C sH zt �|�}W n tk
r& d}Y nX d||p2d| �|�f | d< |S )a Add Package: field
Determine the version of the given package (uses "(not installed") for
uninstalled packages) and add Package: field to report.
This also checks for any modified files.
Return determined package version (None for uninstalled).
N�%s %s%sz(not installed)�Package)r r
r r� )r� r �versionr r r � add_package6 s
�
zReport.add_packagec
C s |s:d| kr"| d dkr"| d }nt j�| d �}|s:dS | �|�}|sPd| krxzt�|�| d< W n tk
rv Y nX |s�dS t�|�| d< tg �}t ||� d| d < t
|�D ]d}zt� |�}W n tk
r� Y q�Y nX | d r�| d d
7 < | d d ||| � |�f 7 < q�dS ) a Add packaging information.
If package is not given, the report must have ExecutablePath.
This adds:
- Package: package name and installed version
- SourcePackage: source package name (if possible to determine)
- PackageArchitecture: processor architecture this package was built
for
- Dependencies: package names and versions of all dependencies and
pre-dependencies; this also checks if the files are unmodified and
appends a list of all modified files
�ExecutablePath� ProblemType� KernelCrashr� N�
SourcePackage�PackageArchitecturer9 � Dependencies�
r� )
rn � fileutilsZfind_file_packager� r �
get_sourcer Zget_architecture�setr
�sortedr
r� )r� r r� Z dependenciesZdeprY r r r �add_package_infoI s<
�zReport.add_package_infoc C s� d|� d�|� d�|� dd�f | d< |� d�r�d}t�|t|� dd ���}|r�|�d
�r�|�d
�| d < |�d �r�|�d �| d
< dS )z�Add info about an installed Snap
This adds a Snap: field, containing name, version and channel.
It adds a SnapSource: field, if the snap has a Launchpad contact defined.
z
%s %s (%s)�namer� Zchannel�unknownZSnapZcontactzX^https?:\/\/.*launchpad\.net\/((?:[^\/]+\/\+source\/)?[^\/]+)(?:.*field\.tags?=([^&]+))?r9 � Z
SnapSource� ZSnapTagsN)rx rD rU r �group)r� Zsnap�p�mr r r �
add_snap_info~ s
�
zReport.add_snap_infoc C s` d| krdt j�� | d< d| krHt�� }d|d |d |d f | d< d| kr\t�� | d< d S )
a Add operating system information.
This adds:
- DistroRelease: NAME and VERSION from /etc/os-release, or
'lsb_release -sir' output
- Architecture: system architecture in distro specific notation
- Uname: uname -srm output
Z
DistroReleasez%s %s�Unamez%s %s %sr r� � � ArchitectureN)rn r Zget_os_versionr �uname�get_system_architecture)r� �ur r r � add_os_info� s zReport.add_os_infoc sP t �t�� �d � � fdd�t�� D �}|�� |rDd�|�| d< nd| d< dS )zoAdd information about the user.
This adds:
- UserGroups: system groups the user is in
r c s( g | ] \}}}}� |kr|d k r|�qS )i� r )�.0r� r� �gidZmemb��userr r �
<listcomp>� s
�z(Report.add_user_info.<locals>.<listcomp>r� Z
UserGroupszN/AN)�pwd�getpwuidr �geteuid�grpZgetgrall�sortr{ )r� �groupsr r� r �
add_user_info� s zReport.add_user_infoc sv d| kr dS t j�| d �� tt� fdd�t��s6dS d}| d �� D ]B}z|�dd�\}}W n tk
rv Y qFY nX |dkrF|} q�qF|s�dS | d �d
�}d d d
dg}t |�dk�r8|d �
d��r8|�
d��r0|d dk�r0t |�dk�r0| � |d �}|�r | d | d< || d< nd|d | d< dS |d= q�t |�dk�r�|d �
d��rzd| k�rzt j� | d |d �|d< t �
|d t j��r�| d | d< t j�|d �| d< d| k�r&|� k�r&|D ]^}t �
||d t j��r�||d } t j�t j�| ��|k�r | d | d< | | d< �q&�q�d| k�rrt j�| d �dk�rr| d | d< | �� }
|
�rj|
| d< nd| d< dS ) z�Check if process is a script.
Use ExecutablePath, ProcStatus and ProcCmdline to determine if
process is an interpreted script. If so, set InterpreterPath
accordingly.
r� Nc s t � � | �S )N)�fnmatch)�i�Z exebasenamer r r2 � r3 z+Report._check_interpreted.<locals>.<lambda>�
ProcStatus� r� zName:� ProcCmdline� z /usr/bin/z
/usr/sbin/z/bin/z/sbin/r� rd �pythonz-m� �InterpreterPathz)Cannot determine path of python module %s�UnreportableReason�.�ProcCwdr Ztwistdz&Cannot determine twistd client program)r r rk �any�filter� interpreters�
splitlinesry r �lenrh �_python_module_pathr{ �access�R_OK�realpath�_twistd_executable) r� r� �line�krY ZcmdargsZbindirsr r� Zargvexe�exer r� r �_check_interpreted� s^
(
zReport._check_interpretedc C s� | d � d�dd� }|r�|d � dd�}|d �d�sT|d �d �sT|d �d
�rrt|�dkrh|d S |d S n`t|d �dkr�|d d d kr�|d d d kr�|d dd� }d |ks�d
|ks�d|kr�|d S |�d� qdS )z5Determine the twistd client program from ProcCmdline.r� r� r� Nr �=r� z--filez--pythonz--sourcerd �f�y�s)ry rh r� �pop)r� �args�argZoptsr r r r� s *
0 zReport._twistd_executablec C s� |� dd��d�}tj}d}|r�|�d�}zt�||�\}}}W n tk
r\ d}Y q�Y nX |rj|�� |g}|s |d tj kr dg}q |r�|�
d�r�|dd� }|S ) z%Determine path of given Python module�/r� Nr r� r� z.pyc���) r ry �sysr r� �imp� find_module� ImportError�close�
PKG_DIRECTORY�endswith)�klass�moduleZpathlistr r� r+ Zdescr r r r� s$
zReport._python_module_pathc
C s� |s�|s| j pt�� }| j s&t|�| _ t|�}ts�z"t�d| tjtjB tj B �}W nT t
k
r� } z6|j t j t j
fkr�td��|j t jkr�td��n� W 5 d}~X Y nX ztd||�| d< W n t
k
r� Y nX | j|||d� td||�| d < td
||��d �| d < t|�| d
< d| k�r�ztd||�| d< W nZ t
k
�r� } z:|j t j t j
fk�rdtd��|j t jk�r|td��n� W 5 d}~X Y nX dD ]<}| d �d| ��r�| d td| �d� | d< �qҐq�tj�| d ��s�td| d ��| �� ttt�| d �j��| d< | d � dd�� dd�� d d�| d < z0t� � dk�rjtd||�}|dk�rj|| d < W n t t
fk
�r� Y nX | � ||�}|�r�|d | d < dS ) a� Add /proc/pid information.
If neither pid nor self.pid are given, it defaults to the process'
current pid and sets self.pid.
This adds the following fields:
- ExecutablePath: /proc/pid/exe contents; if the crashed process is
interpreted, this contains the script path instead
- InterpreterPath: /proc/pid/exe contents if the crashed process is
interpreted; otherwise this key does not exist
- ExecutableTimestamp: time stamp of ExecutablePath, for comparing at
report time
- ProcEnviron: A subset of the process' environment (only some standard
variables that do not disclose potentially sensitive information, plus
the ones mentioned in extraenv)
- ProcCmdline: /proc/pid/cmdline contents
- ProcStatus: /proc/pid/status contents
- ProcMaps: /proc/pid/maps contents
- ProcAttrCurrent: /proc/pid/attr/current contents, if not "unconfined"
- CurrentDesktop: Value of $XDG_CURRENT_DESKTOP, if present
- _LogindSession: logind cgroup path, if present (Used for filtering
out crashes that happened in a session that is not running any more)
�/proc/%sznot accessiblezinvalid processN�cwdr� )r r1 �extraenvZstatusr� Zcmdliner� r� �ProcMapsr� r� )ZrofsZrwfsZ squashmntZ
persistmntz/%s/z/%sz%s does not exist�ExecutableTimestamp�\z\\r� z\ r z attr/currentZ
unconfinedZProcAttrCurrentZ_LogindSession) r r �getpid�intr* r r! r" �O_PATH� O_DIRECTORYr( �errnoZEPERMZEACCESr �ENOENTr �add_proc_environr- �rstripr4 rh r� r rf r� �stat�st_mtimer �getuidr) �get_logind_session)r� r r1 r� r, r� �val�retr r r �
add_proc_info3 sf
"
$
zReport.add_proc_infoc C sB ddddddddd d
d d d
ddddg| }|sd|s:t �� }t|�}tsdt �d| t jt jB t jB �}d| d< td||�� dd�}|�
d�r�|| d< �n�|� d�D �]�}|� dd�d |kr�| d r�| d d7 < | d |7 < q�|�
d ��rv|� dd�d }d |k�sd |k�r@| d �r.| d d7 < | d d 7 < n4|d!k�r<| d �rd| d d7 < | d d"7 < q�|�
d#��r�| d �r�| d d7 < | d d$7 < q�|�
d%��r�| d �r�| d d7 < | d d&7 < q�|�
d'��r | d �r | d d7 < | d d(7 < q�|�
d)�r�|� dd�d | d*< q�d+S ),a� Add environment information.
If pid is not given, it defaults to the process' current pid.
This adds the following fields:
- ProcEnviron: A subset of the process' environment (only some standard
variables that do not disclose potentially sensitive information, plus
the ones mentioned in extraenv)
- CurrentDesktop: Value of $XDG_CURRENT_DESKTOP, if present
ZSHELLZTERMZLANGUAGEZLANG�LC_CTYPE�
LC_COLLATE�LC_TIME�
LC_NUMERIC� LC_MONETARY� LC_MESSAGESZLC_PAPERZLC_NAMEZ
LC_ADDRESSZ LC_TELEPHONEZLC_MEASUREMENTZLC_IDENTIFICATIONZLOCPATHr� r9 Z ProcEnvironrv r� �\nzError:r� r� r� r zPATH=z/homez/tmpzPATH=(custom, user)zG/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/gameszPATH=(custom, no user)zXDG_RUNTIME_DIR=zXDG_RUNTIME_DIR=<set>z LD_PRELOAD=zLD_PRELOAD=<set>zLD_LIBRARY_PATH=zLD_LIBRARY_PATH=<set>zXDG_CURRENT_DESKTOP=ZCurrentDesktopN) r r� r* r r! r" r� r� r- r rh ry )r� r r� r1 Z safe_varsr7 r� r� r r r r� � sn
��
zReport.add_proc_environc
C s d| kr dS d}d}z�t| d d�rNt�� \}}t �|| d � t �|� d}| d �� d }dd | |g}z tj |tj
tj
tj d
�}W n t k
r� Y W �\dS X |j
�d � |j
�d � |j
�d
� |j
�d� |j�� } |�� dk}|r�| | d< W 5 |�r
t �|� X |S )zWAdd information from kernel crash.
This needs a VmCore in the Report.
ZVmCoreNF�findTr� r� Zcrashz /usr/lib/debug/boot/vmlinux-%s)�stdinr5 r6 z bt -a -f
zps
zrunq
zquit
r �
Stacktrace)r ra �hasattr�tempfile�mkstemp�writer� ry r: r; r< r= r( r r5 r% �wait)
r� ZdebugdirZ unlink_corer� �corer+ Zkverr@ r� rA r r r �add_kernel_crash_info� sD
��
z Report.add_kernel_crash_infoc C s� d| ksd| krdS dddddd d
d �}| � ||�\}}|sRttjt�tj�d ��|d
ddg7 }g }|�� D ]"\}}|�|� |ddd|g7 }ql|�d� |ddg7 }t||d�j ddd�} d| ks�d| k�r>d| kr�d�
dd� | � � D ��}
n0d | k�rd�
d d� | � � D ��}
n | � � d }
d |
� � } | | d < t
| ��n,| �d�d �d!��rjttjt�tj�d"��t�d#tj�} | �| �}
|
�d � |
D ] }|�d$d%�� � | |�d �< �q�d&| k�r�d'| d& k�r�| d& | d(< | d&= d)| k�r| d) �d*��r| d) | d(< | d)= d(| k�rbt�d+| d( �}|�r\|�d,�| d(< | d( �d-��rb| d( d d.� | d(< n| d(= d/| k�r�| �� | �� }|�r�|| d0< dS )1a< Add information from gdb.
This requires that the report has a CoreDump and an
ExecutablePath. This adds the following fields:
- Registers: Output of gdb's 'info registers' command
- Disassembly: Output of gdb's 'x/16i $pc' command
- Stacktrace: Output of gdb's 'bt full' command
- ThreadStacktrace: Output of gdb's 'thread apply all bt full' command
- StacktraceTop: simplified stacktrace (topmost 5 functions) for inline
inclusion into bug reports and easier processing
- AssertionMessage: Value of __abort_msg, __glib_assert_msg, or
__nih_abort_msg if present
The optional rootdir can specify a root directory which has the
executable, libraries, and debug symbols. This does not require
chroot() or root privileges, it just instructs gdb to search for the
files there.
Raises a IOError if the core dump is invalid/truncated, or OSError if
calling gdb fails, or FileNotFoundError if gdb or the crashing
executable cannot be found.
�CoreDumpr� Nzinfo registersz x/16i $pczbt fullzthread apply all bt fullzprint __abort_msg->msgzprint __glib_assert_msgz print (char*) __nih_abort_msg)Z RegistersZ Disassemblyr ZThreadStacktrace�AssertionMessage�GLibAssertionMessage�NihAssertionMessagez gdb not found in retracing envz--batch�--exzset backtrace limit 2000zp -99Z separatorru r r r z%is truncated: expected core file sizez"is not a core dump: file truncated�warning:r� c S s g | ]}d |kr|�qS )r r �r� r� r r r r� ) s �z'Report.add_gdb_info.<locals>.<listcomp>�Warning:c S s g | ]}d |kr|�qS )r r r r r r r� , s �r zInvalid core dump: r� zNo such file or directory.z&executable file for coredump not foundz^\$\d+\s*=\s*-99$z
z
.
r z"ERROR:r
r �$z(^\$\d+\s+=\s+0x[0-9a-fA-F]+\s+"(.*)"\s*$r� r� ���r ZStacktraceAddressSignature)� gdb_command�FileNotFoundErrorr� r� r �strerror�items�appendrB r' r{ r� r& r) ry r� rD rS � MULTILINEr� r rh �matchr� �_gen_stacktrace_top�crash_signature_addresses)r� Zrootdir� gdb_sandboxZ gdb_reportsZgdb_cmdrv Z
value_keysr� �cmdrA �warnings�reasonZpart_rer| �partr� Zaddr_signaturer r r � add_gdb_info� s� ��
�
�
�
zReport.add_gdb_infoc C s~ t ddddddddg�}d gd
}d }d }d }d }t�d
�}t�d�}t�d�} | d �� D �]}
|�|
�} | s�|�|
�} | s�q\|r�|�r | �d�r�| �d��� d �d�d } nd} |r�| �d�s\| dkr�q\nd }| �d�s�| |k�rd}d }d gd
}| �d��r
d}| dkr\d}q\nd }| �d��p2| �d�}
|
�� d }|t|�k r\| �|�s\|
||< |d7 }q\d� |��
� | d< dS )z�Build field StacktraceTop as the top five functions of Stacktrace.
Signal handler invocations and related functions are skipped since they
are generally not useful for triaging and duplicate detection.
Zg_logvZg_logZ IA__g_logZ
IA__g_logvZg_assert_warningZIA__g_assert_warningZ
__GI_abortZ_XErrorr9 � r FzD^#(\d+)\s+(?:0x(?:\w+)\s+in\s+\*?(.*)|(<signal handler called>)\s*)$z0^#(\d+)\s+(?:(.*)|(<signal handler called>)\s*)$z,^(__.*_s?sse\d+(?:_\w+)?|__kernel_vsyscall)$r r� �(NZ_X)Zhandle_responseZ handle_errorZ XWindowEventr� Tr� r� �
StacktraceTop) r� rD rS r� r r� ry rh r� r{ r& )r� Zunwind_functionsZtoptraceZdepthZunwoundZ unwindingZunwinding_xerror�bt_fn_reZbt_fn_noaddr_reZignore_functions_rer� r� �fn�frame�functionr r r r ^ sX
�
zReport._gen_stacktrace_topc C s | � |||�}t� |S )a� Run hook script for collecting package specific data.
A hook script needs to be in _hook_dir/<Package>.py or in
_common_hook_dir/*.py and has to contain a function 'add_info(report,
ui)' that takes and modifies a Report, and gets an UserInterface
reference for interactivity.
return True if the hook requested to stop the report filing process,
False otherwise.
)�_add_hooks_infor )r� rq r �
srcpackager� r r r �add_hooks_info� s zReport.add_hooks_infoc
C s� |s| � d�}|r6|�� d }d|kr6d| | d< d S |sD| � d�}|rl|�� d }d|krld| | d< d S tg}d }tj�| � dd ��}|�t�r�|}nN|r�z4tj �
|�D ]"}|�t�r�tj� |�r�|} q�q�W n t k
r� Y nX |�r&t
|�t
t�k�r&|�tj�|d
d d �� tj�|�}q�t�td
�D ]}t| ||��r4 dS �q4|�r�|D ](} t| |tj�| |d ���rZ dS �qZ|�r�|D ](} t| |tj�| d| ���r� dS �q�dS )Nr� r r� zinvalid Package: %sr� r� zinvalid SourcePackage: %sr� r9 Zsharern z
package-hooksz/*.pyTz.pyz source_%s.pyF)rx ry � _hook_dirr r r� rh �_opt_dirrn r Z get_files�isfiler r� r r{ �dirname�glob�_common_hook_dirrs )
r� rq r r* Z hook_dirsZopt_pathZ exec_pathr� rr Zhook_dirr r r r) � sV
zReport._add_hooks_infoc C sl |sdS z&t |�}|�� jddd�}|�� W n ttfk
rH Y dS X d|krVdS t| |�}|rh|S dS )a Check bug patterns loaded from the specified url.
Return bug URL on match, or None otherwise.
The url must refer to a valid XML document with the following syntax:
root element := <patterns>
patterns := <pattern url="http://bug.url"> *
pattern := <re key="report_key">regular expression*</re> +
For example:
<?xml version="1.0"?>
<patterns>
<pattern url="http://bugtracker.net/bugs/1">
<re key="Foo">ba.*r</re>
</pattern>
<pattern url="http://bugtracker.net/bugs/2">
<re key="Package">^\S* 1-2$</re> <!-- test for a particular version -->
<re key="Foo">write_(hello|goodbye)</re>
</pattern>
</patterns>
Nr r r z<title>404 Not Found)r r% r' r� r) r r` )r� rC r� r_ r r r �search_bug_patterns� s
zReport.search_bug_patternsc
C s6 t �t�� �d }t�d|�}d}d}d}zbzDt�|tjtj B �}t�
|�}t � |j
�rnt�|d�}|�d�}W n ttfk
r� Y nX W 5 |dk r�|�� n|dk r�t�|� X |dkr�tj�� �ddd�}nLztjj�|�}W n8 tk
�r } ztdtt|�f ��W 5 d}~X Y nX |j� � t |j� |S ) z�Read ignore list XML file and return a DOM tree.
Return an empty DOM tree if file does not exist.
Raises ValueError if the file exists but is invalid XML.
r" �~r9 N�riP� rn z%s has invalid format: %s) r� r� r r� � _ignore_filer r� r! �
O_NOFOLLOWr" �fstatr� �S_ISREG�st_mode�fdopenr% r) r( rH rI ZgetDOMImplementationZcreateDocumentr[ r\ r r r* �documentElementrM rb ) r� �homedirZifpath�contentsr+ r� �strI r, r r r �_get_ignore_dom s4
&
zReport._get_ignore_domc
C s d| ks t �z�t�t�D ]p}zRttj�t|���6}|D ]*}|�� | d kr6 W 5 Q R � W W dS q6W 5 Q R X W q tk
r� Y qY qX qW n t k
r� Y nX z�t
� }t�t �D ]Z}z:ttj�t |��� }|D ]}|� |�� � q�W 5 Q R X W q� tk
�r Y q�Y q�X q�|�r*| d |k�r*W dS W n t k
�rB Y nX z | �
� }W n. ttfk
�r~ t�d� t�� Y dS X ztt�| d �j�}W n t k
�r� Y dS X zF|�d�D ]6}|�d�| d k�r�t|�d��|k�r� W dS �q�W n ttfk
�r Y nX dS )a\ Check if current report should not be presented.
Reports can be suppressed by per-user blacklisting in
~/.apport-ignore.xml (in the real UID's home) and
/etc/apport/blacklist.d/. For environments where you are only
interested in crashes of some programs, you can also create a whitelist
in /etc/apport/whitelist.d/, everything which does not match gets
ignored then.
This requires the ExecutablePath attribute. Throws a ValueError if the
file has an invalid format.
Privileges may need to be dropped before calling this.
r� TzCould not get ignore file:F�ignore�program�mtime)�AssertionErrorr �listdir�_blacklist_dirr! r r{ r& r) r( r� �_whitelist_dirr r? r rL rn ro rl rp r� r� r� r^ � getAttribute�float)r� r� r+ r� Z whitelistrI Z cur_mtimer@ r r r �
check_ignored> sV &
zReport.check_ignoredc
C s d| ks t �| �� }z ttt�| d �j��}W n: tk
rj } z |jtj krXW Y �
dS � W 5 d}~X Y nX |�
d�D ]&}|� d�| d krv|� d|� q�qv|�
d�}|� d| d � |� d|� |j�|� t�t�� �d }t�d|�}t|d��}|j|d d
d � W 5 Q R X |�� dS ) a~ Ignore future crashes of this executable.
Add a ignore list entry for this report to ~/.apport-ignore.xml, so
that future reports for this ExecutablePath are not presented to the
user any more.
Throws a ValueError if the file already exists and has an invalid
format.
Privileges may need to be dropped before calling this.
r� Nr@ rA rB r" r3 �wz r� )Z addindentZnewl)rC r? r* r� r r� r� r( r� r� r^ rG Z setAttributeZ
createElementr; Z appendChildr� r� r� r5 r r! Zwritexmlra )r� rI rB r, r@ r< Zignore_file_pathr+ r r r � mark_ignore� s*
zReport.mark_ignorec C sT | � d�sdS dd� | d �� D �}t|�dk r>|�d�dkS |�d�t|�d kS ) a Check whether StackTrace can be considered 'useful'.
The current heuristic is to consider it useless if it either is shorter
than three lines and has any unknown function, or for longer traces, a
minority of known functions.
r$ Fc S s g | ]}|� d ��qS )�??)rh )r� r� r r r r� � s z0Report.has_useful_stacktrace.<locals>.<listcomp>r� Tr g @)rx r� r� �count)r� Z
unknown_fnr r r �has_useful_stacktrace� s
z Report.has_useful_stacktracec C s< | � dd��� D ]&}|�d�d �� }|dkr| S qdS )z(Return topmost function in StacktraceTopr$ r9 r# r rL N)rx r� ry r& )r� r� �fnamer r r �stacktrace_top_function� s
z Report.stacktrace_top_functionc C sb | � d�dkr:d| kr:d| kr:dtj�| d �| d f S d| kr�d| kr�d| kr�ddd d
d d �}| �� }|rxd
| }nd}d}d| kr�d| kr�| d | d kr�| d dkr�d| d }dtj�| d �|� | � d�d| � d� �||f S d| k�rFd| k�rF| d �� }t|�dk �r dS t|�dk �rHdtj�| d �|d f S t�d�}t|�d }d }|dk�r�|� || �}|�r�|�
d�} |�
d �}�q�|d8 }�qbtj�| d �}
|d } | � d �d } t� d t� | � | �}|�r�|�
d�}
nd}
|d!k�r| | d k�rd"}n| }nd#| }d$|
| |f }|
�rB|d%|
7 }|S | � d&�d'k�r�d'| k�r�d(| d' }| � d)��r�|d*| d) �� d 7 }|S | � d&�d+k�r�d,| k�r�| d, }|�
d-��r�|� d.d �d }n|� d.d�d }|S | � d&�d+k�r^d/| k�r^d}d0| k�r$|d1| d0 d2 7 }|| d/ d3 7 }d4| k�rR|d5| d4 d6 7 }|d.7 }|S dS )7aZ Create an appropriate title for a crash database entry.
This contains the topmost function name from the stack trace and the
signal (for signal crashes) or the Python exception (for unhandled
Python exceptions).
Return None if the report is not a crash or a default title could not
be generated.
�Signal�6r� r
z%s assert failure: %sr$ �SIGILL�SIGABRT�SIGFPE�SIGSEGV�SIGPIPE)�4rR �8Z11Z13z in %s()r9 r� r� �allz [non-native %s package]z%s crashed with %s%s%szsignal � Tracebackr� Nr� z%s crashed with %sr z ^\s*File\s*"(\S+)".* in (.+)$r� r� r� �:z
^%s: (.+)$�<module>�__main__z%s()z%s crashed with %s in %sz: %sr� r� z$package %s failed to install/upgradeZ ErrorMessagez: �
KernelOops�OopsTextz$------------[ cut here ]------------r� �Failure� MachineType�[z] z failureZNonfreeKernelModulesz [non-free: �])rx r r rk rP r� r� rD rS r r� ry �escaperh )r� Z signal_namesr& Z
arch_mismatch�traceZtrace_rer� r( r� Z module_pathr � last_lineZ exception�message�context�titleZoopsr r r �standard_title� s� ����
, � �
� �
zReport.standard_titlec C s� g }| � dd�d | � dd� �� D ]Z}|s.q$|�� dd� \}}t�|�}|dk r$|dkr$|dk r$t�||�dk r$|�|� q$|S ) z=Return list of obsolete packages in Package and Dependencies.r� r9 r� r� Nr� �Noner )rx r� ry r Zget_available_versionZcompare_versionsr )r� Zobsoleter� �pkgZverZavailr r r �obsolete_packagesP s $
( zReport.obsolete_packagesc C s� d| kr| d dkrdS d| krp| d dkrpd}t �d�}| d �� D ]$}|�|�}|rF|d |�d
� 7 }qF|S | �d �d kr�d
| kr�| d d | d
}t �dd|�S d| k�r:d | k�r:d| d | d f }t �d�}| d �� }t|�dk r�dS |D ]:}|�|�}|�r.|d |�d
��p&|�d� 7 }q� dS q�|S d| k�r|| d �� }d}t|�d
k�r�t �d|d �}|�r�| d d |�d
� S dS nt|�dk �r�dS t �d�}|D ]t}|�|�}|�r�|�d�dk�r�|d |�d� 7 }n:|�d
�} tj �
| ��rtj � | �} |d| |�d�f 7 }�q�|d � d �d }
z|
d | d 7 }
W n t
k
�rf Y nX | d d |
| S | d d k�r�d | k�r�d!| d k�s�d"| d k�r�| d }| �d#��r�|d$| d# 7 }| �d%��r�|d$| d% 7 }|S d&| k�r�d'} g } | d& � d(�D ]�}|�d)��r\t �d*|�}
|
�r\|
�d
�}|�sRtd+| ��| �|� |�d,��r�| �|�}|�r�| �|� nP|�d-��r�d.} n>| �rd}|�r�|d d/k�r�| �|�}|�r�| �|� nd'} �q| �r�d �| �S dS )0a� Get a signature string for a crash.
This is suitable for identifying duplicates.
For signal crashes this the concatenation of ExecutablePath, Signal
number, and StacktraceTop function names, separated by a colon. If
StacktraceTop has unknown functions or the report lacks any of those
fields, return None. In this case, you can use
crash_signature_addresses() to get a less precise duplicate signature
based on addresses instead of symbol names.
For assertion failures, it is the concatenation of ExecutablePath
and assertion message, separated by colons.
For Python crashes, this concatenates the ExecutablePath, exception
name, and Traceback function names, again separated by a colon.
For suspend/resume failures, this concatenates whether it was a suspend
or resume failure with the hardware identifier and the BIOS version, if
it exists.
r� r� )r� r_ Nr r� Zkernelz^\s*\#\d+\s\[\w+\]\s(\w+)r\ r� rQ rR r
z0x[0-9a-f]{6,}ZADDRr$ z%s:%sz.^(?:([\w:~]+).*|(<signal handler called>)\s*)$r� r[ r9 z(\w+): r r� z)^\s+File "([^"]+).*line (\d+).*\sin (.*)$r] z:%s@%sr� z(%s)�_PythonExceptionQualifierr_ ra ZsuspendZresumerb z:%szdmi.bios.versionr` Fr� zBUG: unable to handlez ^BUG: unable to handle (.*) at z.could not parse expected problem type line: %szIP: z Call Trace:Tr� )rD rS r� r r� rx �subr� r r �islinkr� ry rL rh rU rC r � _extract_function_and_addressr{ )r� ZsigZregexr� r� r% �linesrf Zloc_rer� Zexc_nameZ
in_trace_bodyr| �parsedr r r r �crash_signature] s�
zReport.crash_signaturec C s> t �d|�}|r:|�d�}|s*td| ��|d dkr:|S d S )Nz \[.*\] (.*)$r� z,could not parse expected call trace line: %sr �?)rD rU r� rC )r� r� rt r r r r rr � s
z$Report._extract_function_and_addressc C s d| ksd| ksd| kr dS d| d kr,dS g }d}| d � � D ]t}|�d�r�|�� d }|�d �sfq@t|d
�}|d k rzq@| �|�}|r�|�|�d d
�� n|d7 }t|�dkr@ q�q@|dkr�t|�| dk r�dS |dkr�t|�dk s�|dkr�t|�dk r�dS d| d | d d �|�f S )a� Compute heuristic duplicate signature for a signal crash.
This should be used if crash_signature() fails, i. e. Stacktrace does
not have enough symbols.
This approach only uses addresses in the stack trace and does not rely
on symbol resolution. As we can't unwind these stack traces, we cannot
limit them to the top five frames and thus will end up with several or
many different signatures for a particular crash. But these can be
computed and synchronously checked with a crash database at the client
side, which avoids having to upload and process the full report. So on
the server-side crash database we will only have to deal with all the
equivalence classes (i. e. same crash producing a number of possible
signatures) instead of every single report.
Return None when signature cannot be determined.
r� r rQ NzErrno 13r �#r� Z0x� i r\ z..� r� r� � z%s:%s:%sr� ) r� rh ry r� �_address_to_offsetr r r� r{ )r� �stackZfailedr� �addr�offsetr r r r � s:
(�z Report.crash_signature_addressesc C s� g }t �� dkr�t�t �� �}t|d �dkrP|�t�dt� |d � �df� |�t�dt� |d � �df� |d �
d�D ]6}|� � }t|�dkr�|�t�d t� |� �d
f� q�t � � d }t|�dkr�|�t�dt� |� �d f� z
| d
= W n t
k
�r Y nX | D ]�}|�d��o*|dk}|�sFd|k�sF|dk�rt| | d��sZ�q|D ]V\}}t| | �tk�r�|�|| | jddd���d�| |< n|�|| | �| |< �q^�qdS )z�Remove user identifying strings from the report.
This particularly removes the user name, host name, and IPs
from attributes which contain data read from the environment, and
removes the ProcCwd attribute completely.
r r� z\b%s\bZusernamer" z/home/usernamer� �,z (\b|\s)%s\bz \1User Namer� �hostnamer� ZProc)Z ProcCpuinfor� r� ZProcInterruptsZ ProcModulesr )r[ �
PythonArgsZTitleZ
JournalErrors�isspacer r r N)r r� r� r� r� r� r rD rS re ry r& r� rL rh r r� rR rp r' rO ) r� Z replacementsr� r� r� r� Z
is_proc_fieldrW �replr r r � anonymize0 s4 ""
&zReport.anonymizec
C s d| ks t �| �d| d �}d}d| kr<| d t�� kr<d}|rPtj�|dd�nd}td |�}|sfd
S |g}d}|s�td |�} | r�| g}n tj �
d � |�r6d
}
|dd| dd| dd| dd||
||
f g7 }|�r*d|||
||
|f } d| } | | d||
f d�}|� dd||
f � |dd| g7 }|d | }|dd| g7 }d | k�rt | d d ��r�t
jd d �\}
}t�tj|� t�
|
| d � t�|
� njt | d d ��r�t
jd d �\}
}t�tj|� t�|
� t|d!��}| d �
|� W 5 Q R X n | d d }|dd"| g7 }||fS )#a" Build gdb command for this report.
This builds a gdb command for processing the given report, by setting
the file to the ExecutablePath/InterpreterPath, unpacking the core dump
and pointing "core-file" to it (if the report has a core dump), and
setting up the paths when calling gdb in a package sandbox.
When available, this calls "gdb-multiarch" instead of "gdb", for
processing crash reports from foreign architectures.
Return argv list for gdb and any environment variables.
r� r� Fr� TZusr�binNZgdb)r9 r9 z
gdb-multiarchzWARNING: Please install gdb-multiarch for processing reports from foreign architectures. Results with "gdb" will be very poor.
zx86_64-linux-gnur
z)set debug-file-directory %s/usr/lib/debugzset solib-absolute-prefix zadd-auto-load-safe-path z-set solib-search-path %s/lib/%s:%s/usr/lib/%sz)%s/lib:%s/lib/%s:%s/usr/lib/%s:%s/usr/libz%s/usrz%s/usr/lib/%s/gconv)ZLD_LIBRARY_PATH�
PYTHONHOMEZ
GCONV_PATHr z %s/lib/%s/ld-linux-x86-64.so.2z#set data-directory %s/usr/share/gdbr� z file "%s"r r� Z apport_core_)�prefixZ gzipvalue�wbz
core-file )rC rx r r� r r r{ r} r� r6 r �insertr r r �atexit�registerra r� r! )r� Zsandboxr �
executableZ same_archZgdb_sandbox_binZgdb_pathr@ rv ZmaZnative_multiarchZ ld_lib_pathZpyhomer+ r r� r r r r Z s�
���
�
�� ������
zReport.gdb_commandc C sB | � � | jD ].\}}}||kr||krd||| f S qdS )a^ Resolve a memory address to an ELF name and offset.
This can be used for building duplicate signatures from non-symbolic
stack traces. These often do not have enough symbols available to
resolve function names, but taking the raw addresses also is not
suitable due to ASLR. But the offsets within a library should be
constant between crashes (assuming the same version of all libraries).
This needs and uses the "ProcMaps" field to resolve addresses.
Return 'path+offset' when found, or None if address is not in any
mapped range.
z%s+%xN)�_build_proc_maps_cacher� )r� r} �start�endZelfr r r r{ � s
zReport._address_to_offsetc C s� | j r
dS d| kst�g | _ t�d�}t�d�}| d �� D ]h}|�� sJq<|�|�}|st|�|�rdq<|sttd| ��| j �t|� d�d�t|� d�d�|� d �f� q<dS )
z_Generate self._proc_maps_cache from ProcMaps field.
This only gets done once.
Nr� z-^([0-9a-fA-F]+)-([0-9a-fA-F]+).*\s{2,}(\S.*$)z ^([0-9a-fA-F]+)-([0-9a-fA-F]+)\sz cannot parse ProcMaps line: r� rx r� r� )
r� rC rD rS r� r& r r r� r� )r� ZfmtZ fmt_unknownr� r� r r r r� � s$
�z Report._build_proc_maps_cachec C s� t s |dk r tjdtj|d�}nd| }z�t�|��^}|D ]B}|�� }d|kr:|�d�r:d|kr:|�dd�d dd � } q�q:W 5 Q R � W dS W 5 Q R X t�d
| �j }W n t
t fk
r� Y dS X ||fS ) z�Get logind session path and start time.
Return (session_id, session_start_timestamp) if process is in a logind
session, or None otherwise.
NZcgroupr z/proc/%s/cgroupz
name=systemd:z.scopez /session-r� i����z/run/systemd/sessions/) r r r! r" r$ r& r� ry r� r� r) r( )r� r r1 Z cgroup_filer� r� Z
my_sessionZsession_start_timer r r r� � s zReport.get_logind_session)r N)N)N)NN)NN)N)NN)&�__name__�
__module__� __qualname__�__doc__r� r� r� r� r� r� r� r� r� � classmethodr� r� r� r r! r r+ r) r2 r? rI rK rN rP rk rn ru rr r r� r r{ r� r� r r r r r~ sL
5M
Z;
)
m>
;+-F.
>*
Y r~ )NN)NN)NN)>r� r: r �os.pathr rD r� r� r$ r� r0 rl r� r� r� r� r� Zxml.domrH Zxml.dom.minidomZxml.parsers.expatr r� r Z urllib.errorr Zurllib.requestr Z urllib.parser Zurllibr) rQ rn �apport.fileutilsZapport.packaging_implr r Zapport.hookutilsr rv rx Z _data_dirr, r1 r- r5 rE rF r� r
r r- r4 rB rZ r` rb rs r} r� r~ r r r r �<module> sX @@
�
/