diff options
| author |  Andrii Nakryiko <andrii@kernel.org>
| 2024-03-08 16:47:39 -0800 |
|---|---|---|
| committer |  Alexei Starovoitov <ast@kernel.org>
| 2024-03-11 16:41:25 -0700 |
| commit | 66c8473135c62f478301a0e5b3012f203562dfa6 (patch) | |
| tree | 38552c4bba5b6de12904aa40539c2d14950c17a8 /kernel/events | |
| parent | bpf: hardcode BPF_PROG_PACK_SIZE to 2MB * num_possible_nodes() (diff) | |
| download | linux-66c8473135c62f478301a0e5b3012f203562dfa6.tar.gz linux-66c8473135c62f478301a0e5b3012f203562dfa6.tar.bz2 linux-66c8473135c62f478301a0e5b3012f203562dfa6.zip | |
bpf: move sleepable flag from bpf_prog_aux to bpf_prog
prog->aux->sleepable is checked very frequently as part of (some) BPF
program run hot paths. So this extra aux indirection seems wasteful and
on busy systems might cause unnecessary memory cache misses.
Let's move sleepable flag into prog itself to eliminate unnecessary
pointer dereference.
Signed-off-by: Andrii Nakryiko <andrii@kernel.org>
Acked-by: Jiri Olsa <jolsa@kernel.org>
Message-ID: <20240309004739.2961431-1-andrii@kernel.org>
Signed-off-by: Alexei Starovoitov <ast@kernel.org>
Diffstat (limited to 'kernel/events')
| -rw-r--r-- | kernel/events/core.c | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/kernel/events/core.c b/kernel/events/core.c index 5ecfa57e3b97..724e6d7e128f 100644 --- a/kernel/events/core.c +++ b/kernel/events/core.c @@ -10553,7 +10553,7 @@ int perf_event_set_bpf_prog(struct perf_event *event, struct bpf_prog *prog, (is_syscall_tp && prog->type != BPF_PROG_TYPE_TRACEPOINT)) return -EINVAL; - if (prog->type == BPF_PROG_TYPE_KPROBE && prog->aux->sleepable && !is_uprobe) + if (prog->type == BPF_PROG_TYPE_KPROBE && prog->sleepable && !is_uprobe) /* only uprobe programs are allowed to be sleepable */ return -EINVAL; |