perf-security: wrap paragraphs on 72 columns
Implemented formatting of paragraphs to be not wider than 72 columns. Signed-off-by: Alexey Budankov <alexey.budankov@linux.intel.com> Signed-off-by: Jonathan Corbet <corbet@lwn.net>hifive-unleashed-5.1
Alexey Budankov
Jonathan Corbet
parent
e152c7b7bf
commit
e85a198e30
|
|
@ -6,84 +6,94 @@ Perf Events and tool security
|
||||||
Overview
|
Overview
|
||||||
--------
|
--------
|
||||||
|
|
||||||
Usage of Performance Counters for Linux (perf_events) [1]_ , [2]_ , [3]_ can
|
Usage of Performance Counters for Linux (perf_events) [1]_ , [2]_ , [3]_
|
||||||
impose a considerable risk of leaking sensitive data accessed by monitored
|
can impose a considerable risk of leaking sensitive data accessed by
|
||||||
processes. The data leakage is possible both in scenarios of direct usage of
|
monitored processes. The data leakage is possible both in scenarios of
|
||||||
perf_events system call API [2]_ and over data files generated by Perf tool user
|
direct usage of perf_events system call API [2]_ and over data files
|
||||||
mode utility (Perf) [3]_ , [4]_ . The risk depends on the nature of data that
|
generated by Perf tool user mode utility (Perf) [3]_ , [4]_ . The risk
|
||||||
perf_events performance monitoring units (PMU) [2]_ and Perf collect and expose
|
depends on the nature of data that perf_events performance monitoring
|
||||||
for performance analysis. Collected system and performance data may be split into
|
units (PMU) [2]_ and Perf collect and expose for performance analysis.
|
||||||
several categories:
|
Collected system and performance data may be split into several
|
||||||
|
categories:
|
||||||
|
|
||||||
1. System hardware and software configuration data, for example: a CPU model and
|
1. System hardware and software configuration data, for example: a CPU
|
||||||
its cache configuration, an amount of available memory and its topology, used
|
model and its cache configuration, an amount of available memory and
|
||||||
kernel and Perf versions, performance monitoring setup including experiment
|
its topology, used kernel and Perf versions, performance monitoring
|
||||||
time, events configuration, Perf command line parameters, etc.
|
setup including experiment time, events configuration, Perf command
|
||||||
|
line parameters, etc.
|
||||||
|
|
||||||
2. User and kernel module paths and their load addresses with sizes, process and
|
2. User and kernel module paths and their load addresses with sizes,
|
||||||
thread names with their PIDs and TIDs, timestamps for captured hardware and
|
process and thread names with their PIDs and TIDs, timestamps for
|
||||||
software events.
|
captured hardware and software events.
|
||||||
|
|
||||||
3. Content of kernel software counters (e.g., for context switches, page faults,
|
3. Content of kernel software counters (e.g., for context switches, page
|
||||||
CPU migrations), architectural hardware performance counters (PMC) [8]_ and
|
faults, CPU migrations), architectural hardware performance counters
|
||||||
machine specific registers (MSR) [9]_ that provide execution metrics for
|
(PMC) [8]_ and machine specific registers (MSR) [9]_ that provide
|
||||||
various monitored parts of the system (e.g., memory controller (IMC), interconnect
|
execution metrics for various monitored parts of the system (e.g.,
|
||||||
(QPI/UPI) or peripheral (PCIe) uncore counters) without direct attribution to any
|
memory controller (IMC), interconnect (QPI/UPI) or peripheral (PCIe)
|
||||||
execution context state.
|
uncore counters) without direct attribution to any execution context
|
||||||
|
state.
|
||||||
|
|
||||||
4. Content of architectural execution context registers (e.g., RIP, RSP, RBP on
|
4. Content of architectural execution context registers (e.g., RIP, RSP,
|
||||||
x86_64), process user and kernel space memory addresses and data, content of
|
RBP on x86_64), process user and kernel space memory addresses and
|
||||||
various architectural MSRs that capture data from this category.
|
data, content of various architectural MSRs that capture data from
|
||||||
|
this category.
|
||||||
|
|
||||||
Data that belong to the fourth category can potentially contain sensitive process
|
Data that belong to the fourth category can potentially contain
|
||||||
data. If PMUs in some monitoring modes capture values of execution context registers
|
sensitive process data. If PMUs in some monitoring modes capture values
|
||||||
or data from process memory then access to such monitoring capabilities requires
|
of execution context registers or data from process memory then access
|
||||||
to be ordered and secured properly. So, perf_events/Perf performance monitoring
|
to such monitoring capabilities requires to be ordered and secured
|
||||||
is the subject for security access control management [5]_ .
|
properly. So, perf_events/Perf performance monitoring is the subject for
|
||||||
|
security access control management [5]_ .
|
||||||
|
|
||||||
perf_events/Perf access control
|
perf_events/Perf access control
|
||||||
-------------------------------
|
-------------------------------
|
||||||
|
|
||||||
To perform security checks, the Linux implementation splits processes into two
|
To perform security checks, the Linux implementation splits processes
|
||||||
categories [6]_ : a) privileged processes (whose effective user ID is 0, referred
|
into two categories [6]_ : a) privileged processes (whose effective user
|
||||||
to as superuser or root), and b) unprivileged processes (whose effective UID is
|
ID is 0, referred to as superuser or root), and b) unprivileged
|
||||||
nonzero). Privileged processes bypass all kernel security permission checks so
|
processes (whose effective UID is nonzero). Privileged processes bypass
|
||||||
perf_events performance monitoring is fully available to privileged processes
|
all kernel security permission checks so perf_events performance
|
||||||
without access, scope and resource restrictions.
|
monitoring is fully available to privileged processes without access,
|
||||||
|
scope and resource restrictions.
|
||||||
|
|
||||||
Unprivileged processes are subject to a full security permission check based on
|
Unprivileged processes are subject to a full security permission check
|
||||||
the process's credentials [5]_ (usually: effective UID, effective GID, and
|
based on the process's credentials [5]_ (usually: effective UID,
|
||||||
supplementary group list).
|
effective GID, and supplementary group list).
|
||||||
|
|
||||||
Linux divides the privileges traditionally associated with superuser into
|
Linux divides the privileges traditionally associated with superuser
|
||||||
distinct units, known as capabilities [6]_ , which can be independently enabled
|
into distinct units, known as capabilities [6]_ , which can be
|
||||||
and disabled on per-thread basis for processes and files of unprivileged users.
|
independently enabled and disabled on per-thread basis for processes and
|
||||||
|
files of unprivileged users.
|
||||||
|
|
||||||
Unprivileged processes with enabled CAP_SYS_ADMIN capability are treated as
|
Unprivileged processes with enabled CAP_SYS_ADMIN capability are treated
|
||||||
privileged processes with respect to perf_events performance monitoring and
|
as privileged processes with respect to perf_events performance
|
||||||
bypass *scope* permissions checks in the kernel.
|
monitoring and bypass *scope* permissions checks in the kernel.
|
||||||
|
|
||||||
Unprivileged processes using perf_events system call API is also subject for
|
Unprivileged processes using perf_events system call API is also subject
|
||||||
PTRACE_MODE_READ_REALCREDS ptrace access mode check [7]_ , whose outcome
|
for PTRACE_MODE_READ_REALCREDS ptrace access mode check [7]_ , whose
|
||||||
determines whether monitoring is permitted. So unprivileged processes provided
|
outcome determines whether monitoring is permitted. So unprivileged
|
||||||
with CAP_SYS_PTRACE capability are effectively permitted to pass the check.
|
processes provided with CAP_SYS_PTRACE capability are effectively
|
||||||
|
permitted to pass the check.
|
||||||
|
|
||||||
Other capabilities being granted to unprivileged processes can effectively
|
Other capabilities being granted to unprivileged processes can
|
||||||
enable capturing of additional data required for later performance analysis of
|
effectively enable capturing of additional data required for later
|
||||||
monitored processes or a system. For example, CAP_SYSLOG capability permits
|
performance analysis of monitored processes or a system. For example,
|
||||||
reading kernel space memory addresses from /proc/kallsyms file.
|
CAP_SYSLOG capability permits reading kernel space memory addresses from
|
||||||
|
/proc/kallsyms file.
|
||||||
|
|
||||||
perf_events/Perf privileged users
|
perf_events/Perf privileged users
|
||||||
---------------------------------
|
---------------------------------
|
||||||
|
|
||||||
Mechanisms of capabilities, privileged capability-dumb files [6]_ and file system
|
Mechanisms of capabilities, privileged capability-dumb files [6]_ and
|
||||||
ACLs [10]_ can be used to create a dedicated group of perf_events/Perf privileged
|
file system ACLs [10]_ can be used to create a dedicated group of
|
||||||
users who are permitted to execute performance monitoring without scope limits.
|
perf_events/Perf privileged users who are permitted to execute
|
||||||
The following steps can be taken to create such a group of privileged Perf users.
|
performance monitoring without scope limits. The following steps can be
|
||||||
|
taken to create such a group of privileged Perf users.
|
||||||
|
|
||||||
1. Create perf_users group of privileged Perf users, assign perf_users group to
|
1. Create perf_users group of privileged Perf users, assign perf_users
|
||||||
Perf tool executable and limit access to the executable for other users in the
|
group to Perf tool executable and limit access to the executable for
|
||||||
system who are not in the perf_users group:
|
other users in the system who are not in the perf_users group:
|
||||||
|
|
||||||
::
|
::
|
||||||
|
|
||||||
|
|
@ -97,8 +107,9 @@ The following steps can be taken to create such a group of privileged Perf users
|
||||||
# ls -alhF
|
# ls -alhF
|
||||||
-rwxr-x--- 2 root perf_users 11M Oct 19 15:12 perf
|
-rwxr-x--- 2 root perf_users 11M Oct 19 15:12 perf
|
||||||
|
|
||||||
2. Assign the required capabilities to the Perf tool executable file and enable
|
2. Assign the required capabilities to the Perf tool executable file and
|
||||||
members of perf_users group with performance monitoring privileges [6]_ :
|
enable members of perf_users group with performance monitoring
|
||||||
|
privileges [6]_ :
|
||||||
|
|
||||||
::
|
::
|
||||||
|
|
||||||
|
|
@ -108,49 +119,52 @@ The following steps can be taken to create such a group of privileged Perf users
|
||||||
# getcap perf
|
# getcap perf
|
||||||
perf = cap_sys_ptrace,cap_sys_admin,cap_syslog+ep
|
perf = cap_sys_ptrace,cap_sys_admin,cap_syslog+ep
|
||||||
|
|
||||||
As a result, members of perf_users group are capable of conducting performance
|
As a result, members of perf_users group are capable of conducting
|
||||||
monitoring by using functionality of the configured Perf tool executable that,
|
performance monitoring by using functionality of the configured Perf
|
||||||
when executes, passes perf_events subsystem scope checks.
|
tool executable that, when executes, passes perf_events subsystem scope
|
||||||
|
checks.
|
||||||
|
|
||||||
This specific access control management is only available to superuser or root
|
This specific access control management is only available to superuser
|
||||||
running processes with CAP_SETPCAP, CAP_SETFCAP [6]_ capabilities.
|
or root running processes with CAP_SETPCAP, CAP_SETFCAP [6]_
|
||||||
|
capabilities.
|
||||||
|
|
||||||
perf_events/Perf unprivileged users
|
perf_events/Perf unprivileged users
|
||||||
-----------------------------------
|
-----------------------------------
|
||||||
|
|
||||||
perf_events/Perf *scope* and *access* control for unprivileged processes is
|
perf_events/Perf *scope* and *access* control for unprivileged processes
|
||||||
governed by perf_event_paranoid [2]_ setting:
|
is governed by perf_event_paranoid [2]_ setting:
|
||||||
|
|
||||||
-1:
|
-1:
|
||||||
Impose no *scope* and *access* restrictions on using perf_events performance
|
Impose no *scope* and *access* restrictions on using perf_events
|
||||||
monitoring. Per-user per-cpu perf_event_mlock_kb [2]_ locking limit is
|
performance monitoring. Per-user per-cpu perf_event_mlock_kb [2]_
|
||||||
ignored when allocating memory buffers for storing performance data.
|
locking limit is ignored when allocating memory buffers for storing
|
||||||
This is the least secure mode since allowed monitored *scope* is
|
performance data. This is the least secure mode since allowed
|
||||||
maximized and no perf_events specific limits are imposed on *resources*
|
monitored *scope* is maximized and no perf_events specific limits
|
||||||
allocated for performance monitoring.
|
are imposed on *resources* allocated for performance monitoring.
|
||||||
|
|
||||||
>=0:
|
>=0:
|
||||||
*scope* includes per-process and system wide performance monitoring
|
*scope* includes per-process and system wide performance monitoring
|
||||||
but excludes raw tracepoints and ftrace function tracepoints monitoring.
|
but excludes raw tracepoints and ftrace function tracepoints
|
||||||
CPU and system events happened when executing either in user or
|
monitoring. CPU and system events happened when executing either in
|
||||||
in kernel space can be monitored and captured for later analysis.
|
user or in kernel space can be monitored and captured for later
|
||||||
Per-user per-cpu perf_event_mlock_kb locking limit is imposed but
|
analysis. Per-user per-cpu perf_event_mlock_kb locking limit is
|
||||||
ignored for unprivileged processes with CAP_IPC_LOCK [6]_ capability.
|
imposed but ignored for unprivileged processes with CAP_IPC_LOCK
|
||||||
|
[6]_ capability.
|
||||||
|
|
||||||
>=1:
|
>=1:
|
||||||
*scope* includes per-process performance monitoring only and excludes
|
*scope* includes per-process performance monitoring only and
|
||||||
system wide performance monitoring. CPU and system events happened when
|
excludes system wide performance monitoring. CPU and system events
|
||||||
executing either in user or in kernel space can be monitored and
|
happened when executing either in user or in kernel space can be
|
||||||
captured for later analysis. Per-user per-cpu perf_event_mlock_kb
|
monitored and captured for later analysis. Per-user per-cpu
|
||||||
locking limit is imposed but ignored for unprivileged processes with
|
perf_event_mlock_kb locking limit is imposed but ignored for
|
||||||
CAP_IPC_LOCK capability.
|
unprivileged processes with CAP_IPC_LOCK capability.
|
||||||
|
|
||||||
>=2:
|
>=2:
|
||||||
*scope* includes per-process performance monitoring only. CPU and system
|
*scope* includes per-process performance monitoring only. CPU and
|
||||||
events happened when executing in user space only can be monitored and
|
system events happened when executing in user space only can be
|
||||||
captured for later analysis. Per-user per-cpu perf_event_mlock_kb
|
monitored and captured for later analysis. Per-user per-cpu
|
||||||
locking limit is imposed but ignored for unprivileged processes with
|
perf_event_mlock_kb locking limit is imposed but ignored for
|
||||||
CAP_IPC_LOCK capability.
|
unprivileged processes with CAP_IPC_LOCK capability.
|
||||||
|
|
||||||
perf_events/Perf resource control
|
perf_events/Perf resource control
|
||||||
---------------------------------
|
---------------------------------
|
||||||
|
|
@ -158,39 +172,45 @@ perf_events/Perf resource control
|
||||||
Open file descriptors
|
Open file descriptors
|
||||||
+++++++++++++++++++++
|
+++++++++++++++++++++
|
||||||
|
|
||||||
The perf_events system call API [2]_ allocates file descriptors for every configured
|
The perf_events system call API [2]_ allocates file descriptors for
|
||||||
PMU event. Open file descriptors are a per-process accountable resource governed
|
every configured PMU event. Open file descriptors are a per-process
|
||||||
by the RLIMIT_NOFILE [11]_ limit (ulimit -n), which is usually derived from the login
|
accountable resource governed by the RLIMIT_NOFILE [11]_ limit
|
||||||
shell process. When configuring Perf collection for a long list of events on a
|
(ulimit -n), which is usually derived from the login shell process. When
|
||||||
large server system, this limit can be easily hit preventing required monitoring
|
configuring Perf collection for a long list of events on a large server
|
||||||
configuration. RLIMIT_NOFILE limit can be increased on per-user basis modifying
|
system, this limit can be easily hit preventing required monitoring
|
||||||
content of the limits.conf file [12]_ . Ordinarily, a Perf sampling session
|
configuration. RLIMIT_NOFILE limit can be increased on per-user basis
|
||||||
(perf record) requires an amount of open perf_event file descriptors that is not
|
modifying content of the limits.conf file [12]_ . Ordinarily, a Perf
|
||||||
less than the number of monitored events multiplied by the number of monitored CPUs.
|
sampling session (perf record) requires an amount of open perf_event
|
||||||
|
file descriptors that is not less than the number of monitored events
|
||||||
|
multiplied by the number of monitored CPUs.
|
||||||
|
|
||||||
Memory allocation
|
Memory allocation
|
||||||
+++++++++++++++++
|
+++++++++++++++++
|
||||||
|
|
||||||
The amount of memory available to user processes for capturing performance monitoring
|
The amount of memory available to user processes for capturing
|
||||||
data is governed by the perf_event_mlock_kb [2]_ setting. This perf_event specific
|
performance monitoring data is governed by the perf_event_mlock_kb [2]_
|
||||||
resource setting defines overall per-cpu limits of memory allowed for mapping
|
setting. This perf_event specific resource setting defines overall
|
||||||
by the user processes to execute performance monitoring. The setting essentially
|
per-cpu limits of memory allowed for mapping by the user processes to
|
||||||
extends the RLIMIT_MEMLOCK [11]_ limit, but only for memory regions mapped specifically
|
execute performance monitoring. The setting essentially extends the
|
||||||
for capturing monitored performance events and related data.
|
RLIMIT_MEMLOCK [11]_ limit, but only for memory regions mapped
|
||||||
|
specifically for capturing monitored performance events and related data.
|
||||||
|
|
||||||
For example, if a machine has eight cores and perf_event_mlock_kb limit is set
|
For example, if a machine has eight cores and perf_event_mlock_kb limit
|
||||||
to 516 KiB, then a user process is provided with 516 KiB * 8 = 4128 KiB of memory
|
is set to 516 KiB, then a user process is provided with 516 KiB * 8 =
|
||||||
above the RLIMIT_MEMLOCK limit (ulimit -l) for perf_event mmap buffers. In particular,
|
4128 KiB of memory above the RLIMIT_MEMLOCK limit (ulimit -l) for
|
||||||
this means that, if the user wants to start two or more performance monitoring
|
perf_event mmap buffers. In particular, this means that, if the user
|
||||||
processes, the user is required to manually distribute the available 4128 KiB between the
|
wants to start two or more performance monitoring processes, the user is
|
||||||
monitoring processes, for example, using the --mmap-pages Perf record mode option.
|
required to manually distribute the available 4128 KiB between the
|
||||||
Otherwise, the first started performance monitoring process allocates all available
|
monitoring processes, for example, using the --mmap-pages Perf record
|
||||||
4128 KiB and the other processes will fail to proceed due to the lack of memory.
|
mode option. Otherwise, the first started performance monitoring process
|
||||||
|
allocates all available 4128 KiB and the other processes will fail to
|
||||||
|
proceed due to the lack of memory.
|
||||||
|
|
||||||
RLIMIT_MEMLOCK and perf_event_mlock_kb resource constraints are ignored for
|
RLIMIT_MEMLOCK and perf_event_mlock_kb resource constraints are ignored
|
||||||
processes with the CAP_IPC_LOCK capability. Thus, perf_events/Perf privileged users
|
for processes with the CAP_IPC_LOCK capability. Thus, perf_events/Perf
|
||||||
can be provided with memory above the constraints for perf_events/Perf performance
|
privileged users can be provided with memory above the constraints for
|
||||||
monitoring purpose by providing the Perf executable with CAP_IPC_LOCK capability.
|
perf_events/Perf performance monitoring purpose by providing the Perf
|
||||||
|
executable with CAP_IPC_LOCK capability.
|
||||||
|
|
||||||
Bibliography
|
Bibliography
|
||||||
------------
|
------------
|
||||||
|
|
|
||||||
Loading…
Reference in New Issue