Roman Gushchin 8f1c9f19c5
bpf: introduce per-cpu cgroup local storage ...
This commit introduced per-cpu cgroup local storage.
Per-cpu cgroup local storage is very similar to simple cgroup storage
(let's call it shared), except all the data is per-cpu.
The main goal of per-cpu variant is to implement super fast
counters (e.g. packet counters), which don't require neither
lookups, neither atomic operations.
>From userspace's point of view, accessing a per-cpu cgroup storage
is similar to other per-cpu map types (e.g. per-cpu hashmaps and
arrays).
Writing to a per-cpu cgroup storage is not atomic, but is performed
by copying longs, so some minimal atomicity is here, exactly
as with other per-cpu maps.
Signed-off-by: Roman Gushchin <guro@fb.com >
Cc: Daniel Borkmann <daniel@iogearbox.net >
Cc: Alexei Starovoitov <ast@kernel.org >
Acked-by: Song Liu <songliubraving@fb.com >
Signed-off-by: Daniel Borkmann <daniel@iogearbox.net >
2025-12-21 17:55:55 +01:00
2021-02-20 19:20:44 +00:00
2020-08-21 11:01:49 +02:00
2020-08-11 20:25:36 +08:00
2020-08-21 11:01:49 +02:00
2016-08-22 22:43:35 +02:00
2019-09-21 07:14:01 +02:00
2017-01-27 11:28:43 -08:00
2020-07-10 11:45:18 +08:00
2021-04-26 16:09:53 +08:00
2017-10-23 22:55:36 -07:00
2017-05-26 15:05:08 +05:30
2017-11-02 09:49:13 +01:00
2025-12-21 17:49:07 +01:00
2021-04-26 16:09:53 +08:00
2016-11-13 12:35:13 -05:00
2022-12-08 11:15:39 +01:00
2016-10-11 15:06:31 -07:00
2016-10-11 15:06:31 -07:00
2016-08-09 07:54:43 +02:00
2018-05-02 17:19:36 +05:30
2020-08-21 11:01:49 +02:00
2018-05-27 23:22:16 -07:00
2025-12-21 17:51:05 +01:00
2016-09-02 10:46:44 -07:00
2025-12-21 17:55:55 +01:00
2016-11-13 00:57:53 -05:00
2016-09-29 19:05:06 -05:00
2025-12-21 17:51:29 +01:00
2020-08-21 11:01:49 +02:00
2016-10-03 18:52:14 +02:00
2016-12-07 10:45:57 +01:00
2022-11-25 17:35:35 +01:00
2018-03-01 01:47:23 +00:00
2019-08-06 18:29:38 +02:00
2021-01-09 13:35:49 +01:00
2020-04-24 18:27:47 +08:00
2020-09-09 11:45:07 +08:00
2016-07-20 23:49:49 -04:00
2019-01-23 18:58:17 -08:00
2016-07-20 12:37:39 -07:00
2016-08-05 09:00:54 -04:00
2017-10-27 16:39:16 -07:00
2021-01-09 13:35:49 +01:00
2018-03-22 09:17:38 +01:00
2016-10-03 09:11:14 -07:00
2019-01-30 02:07:54 +00:00
2017-10-06 09:52:27 +09:00
2017-04-11 16:49:21 -07:00
2020-05-13 13:43:10 -07:00
2019-07-26 21:29:11 +08:00
2018-06-26 03:53:29 +00:00
2018-02-28 14:42:44 -08:00
2017-03-13 15:31:05 -07:00
2016-11-01 13:52:41 -06:00
2016-08-18 23:18:42 -07:00
2019-02-22 15:16:01 -08:00
2025-12-21 17:51:44 +01:00
2016-07-25 10:55:39 -07:00
2020-05-27 16:41:53 +02:00
2017-01-19 13:32:06 -08:00
2017-01-19 13:32:06 -08:00
2017-01-19 13:32:03 -08:00
2016-09-25 23:34:19 +02:00
2016-12-06 10:43:32 -05:00
2025-12-21 17:51:39 +01:00
2016-09-21 00:23:01 -04:00
2022-05-09 16:57:36 +03:00
2018-11-14 22:35:56 +00:00
2016-11-03 12:43:03 -07:00
2018-01-10 19:42:37 -07:00
2018-05-04 16:09:13 +05:30
2017-05-03 08:36:36 -07:00
2018-03-15 11:36:45 -07:00
2016-08-22 16:25:15 -07:00
2020-09-09 11:45:07 +08:00
2017-12-18 15:21:35 -08:00
2021-01-09 13:35:49 +01:00
2020-06-20 10:24:14 +02:00
2020-06-03 08:16:33 +02:00
2019-02-20 10:18:35 +01:00
2021-01-09 13:35:49 +01:00
2016-07-11 10:49:52 -03:00
2020-08-11 09:26:34 +02:00
2025-12-21 17:46:02 +01:00
2019-01-23 14:42:04 -08:00
2017-03-23 13:55:19 -07:00
2016-09-09 11:16:36 -03:00
2016-08-23 16:28:04 -03:00
2017-02-14 11:30:45 -08:00
2016-08-12 16:57:20 -07:00
2018-05-08 21:42:04 +00:00
2021-01-09 13:35:49 +01:00
2020-09-12 11:47:36 +02:00
2017-03-23 13:52:08 -07:00
2016-11-03 12:43:03 -07:00
2025-01-06 05:23:10 +02:00
2016-11-11 17:02:27 -08:00
2018-03-22 16:11:53 -07:00
2018-02-01 00:03:13 -08:00
2018-02-01 00:03:13 -08:00
2016-11-01 20:02:26 -06:00
2017-03-23 13:55:19 -07:00
2018-05-22 20:34:11 -07:00
2018-05-22 20:34:11 -07:00
2017-02-23 08:41:47 -07:00
2016-08-15 11:07:21 -07:00
2016-11-01 20:02:26 -06:00
2021-03-01 15:00:57 +00:00
2022-01-05 12:31:25 +01:00
2016-09-26 15:20:37 -04:00
2016-08-02 19:35:21 -04:00
2019-07-21 09:06:04 +02:00
2024-12-14 15:31:30 -05:00
2016-09-22 19:59:41 -05:00
2016-09-08 17:10:27 -07:00
2017-03-22 12:43:34 +01:00
2021-12-29 06:56:04 +00:00
2025-12-21 17:55:54 +01:00
2025-12-21 17:49:07 +01:00
2017-03-22 17:37:14 -06:00
2016-09-27 21:52:00 -04:00
2016-09-27 21:52:00 -04:00
2020-08-21 11:01:49 +02:00
2019-07-02 15:35:29 +08:00
2018-04-20 08:21:04 +02:00
2018-02-14 20:40:01 +05:30
2018-05-24 08:48:09 -05:00
2017-03-13 18:08:32 -07:00
2018-02-20 15:34:48 +05:30
2018-05-09 12:26:32 +05:30
2017-03-13 18:08:32 -07:00
2020-08-21 11:01:49 +02:00
2018-05-24 08:48:18 -05:00
2022-06-25 11:45:02 +02:00
2017-11-21 09:23:28 +01:00
2016-08-02 19:35:31 -04:00
2017-03-22 12:26:21 -06:00
2017-10-30 23:23:51 +05:30
2017-01-27 13:55:58 -08:00
2019-09-03 13:44:48 -07:00
2016-08-08 12:51:58 -07:00
2018-05-22 16:58:01 +02:00
2017-07-12 10:12:23 -07:00
2017-07-12 10:12:23 -07:00
2016-09-01 16:17:11 -07:00
2021-09-22 11:43:06 +02:00
2016-07-12 13:42:10 -03:00
2017-03-13 18:08:32 -07:00
2019-06-17 19:53:32 +02:00
2017-03-29 16:54:34 -07:00
2017-08-13 08:35:44 -07:00
2018-03-19 14:33:58 +05:30
2023-01-07 12:07:28 +01:00
2016-09-20 18:12:38 +05:30
2018-03-19 14:33:58 +05:30
2021-03-01 15:00:57 +00:00
2019-03-22 14:08:39 -07:00
2017-11-13 16:30:25 +09:00
2018-02-21 15:40:42 +00:00
2017-11-01 01:19:42 -07:00
2019-06-11 12:22:34 +02:00
2016-08-26 21:38:41 -07:00
2016-07-26 14:26:42 -07:00
2021-05-22 10:40:24 +02:00
2018-04-30 02:04:19 -07:00
2016-09-19 14:34:41 -03:00
2016-08-02 16:53:54 +03:00
2022-11-09 19:21:14 +02:00
2016-08-01 21:44:52 +03:00
2016-08-02 02:57:29 +03:00
2016-08-09 13:42:38 +03:00
2018-05-02 17:19:36 +05:30
2018-12-27 17:18:27 -08:00
8f1c9f19c5