pull-request: bpf-next 2020-10-12

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

The following pull-request contains BPF updates for your *net-next* tree.

We've added 62 non-merge commits during the last 10 day(s) which contain
a total of 73 files changed, 4339 insertions(+), 772 deletions(-).

The main changes are:

1) The BPF verifier improvements to track register allocation pattern, from Alexei and Yonghong.

2) libbpf relocation support for different size load/store, from Andrii.

3) bpf_redirect_peer() helper and support for inner map array with different max_entries, from Daniel.

4) BPF support for per-cpu variables, form Hao.

5) sockmap improvements, from John.

Please consider pulling these changes from:

  git://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next.git

Thanks a lot!

Also thanks to reporters, reviewers and testers of commits in this pull-request:

Alexei Starovoitov, Andrii Nakryiko, Christoph Hellwig, David Ahern, 
John Fastabend, Martin KaFai Lau, Petar Penkov, Samanta Navarro, 
Stanislav Fomichev, Yonghong Song

----------------------------------------------------------------

The following changes since commit 360f89874635b08057757376b8cc4faa221862e2:

  lib8390: Use netif_msg_init to initialize msg_enable bits (2020-10-01 19:08:46 -0700)

are available in the Git repository at:

  git://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next.git 

for you to fetch changes up to 376dcfe3a4e5a5475a84e6b5f926066a8614f887:

  Merge branch 'bpf, sockmap: allow verdict only sk_skb progs' (2020-10-11 18:09:45 -0700)

----------------------------------------------------------------
Alexei Starovoitov (13):
      Merge branch 'Do not limit cb_flags when creating child sk'
      Merge branch 'bpf: BTF support for ksyms'
      Merge branch 'Add skb_adjust_room() for SK_SKB'
      Merge branch 'Fix pining maps after reuse map fd'
      Merge branch 'libbpf: auto-resize relocatable LOAD/STORE instructions'
      bpf: Propagate scalar ranges through register assignments.
      selftests/bpf: Add profiler test
      selftests/bpf: Asm tests for the verifier regalloc tracking.
      Merge branch 'Follow-up BPF helper improvements'
      Merge branch 'samples: bpf: Refactor XDP programs with libbpf'
      bpf: Migrate from patchwork.ozlabs.org to patchwork.kernel.org.
      Merge branch 'sockmap/sk_skb program memory acct fixes'
      Merge branch 'bpf, sockmap: allow verdict only sk_skb progs'

Andrii Nakryiko (5):
      bpf, doc: Update Andrii's email in MAINTAINERS
      libbpf: Skip CO-RE relocations for not loaded BPF programs
      libbpf: Support safe subset of load/store instruction resizing with CO-RE
      libbpf: Allow specifying both ELF and raw BTF for CO-RE BTF override
      selftests/bpf: Validate libbpf's auto-sizing of LD/ST/STX instructions

Björn Töpel (1):
      xsk: Remove internal DMA headers

Ciara Loftus (3):
      samples: bpf: Split xdpsock stats into new struct
      samples: bpf: Count syscalls in xdpsock
      samples: bpf: Driver interrupt statistics in xdpsock

Daniel Borkmann (7):
      Merge branch 'bpf-llvm-reg-alloc-patterns'
      bpf: Improve bpf_redirect_neigh helper description
      bpf: Add redirect_peer helper
      bpf: Allow for map-in-map with dynamic inner array map entries
      bpf, selftests: Add test for different array inner map size
      bpf, selftests: Make redirect_neigh test more extensible
      bpf, selftests: Add redirect_peer selftest

Daniel T. Lee (3):
      samples: bpf: Refactor xdp_monitor with libbpf
      samples: bpf: Replace attach_tracepoint() to attach() in xdp_redirect_cpu
      samples: bpf: Refactor XDP kern program maps with BTF-defined map

Gustavo A. R. Silva (1):
      bpf, verifier: Use fallthrough pseudo-keyword

Hangbin Liu (3):
      libbpf: Close map fd if init map slots failed
      libbpf: Check if pin_path was set even map fd exist
      selftest/bpf: Test pinning map with reused map fd

Hao Luo (7):
      bpf: Introduce pseudo_btf_id
      bpf/libbpf: BTF support for typed ksyms
      selftests/bpf: Ksyms_btf to test typed ksyms
      bpf: Introduce bpf_per_cpu_ptr()
      bpf: Introducte bpf_this_cpu_ptr()
      bpf/selftests: Test for bpf_per_cpu_ptr() and bpf_this_cpu_ptr()
      selftests/bpf: Fix test_verifier after introducing resolve_pseudo_ldimm64

Jakub Wilk (1):
      bpf: Fix typo in uapi/linux/bpf.h

John Fastabend (12):
      bpf, sockmap: Add skb_adjust_room to pop bytes off ingress payload
      bpf, sockmap: Update selftests to use skb_adjust_room
      bpf, sockmap: Skb verdict SK_PASS to self already checked rmem limits
      bpf, sockmap: On receive programs try to fast track SK_PASS ingress
      bpf, sockmap: Remove skb_set_owner_w wmem will be taken later from sendpage
      bpf, sockmap: Remove dropped data on errors in redirect case
      bpf, sockmap: Remove skb_orphan and let normal skb_kfree do cleanup
      bpf, sockmap: Add memory accounting so skbs on ingress lists are visible
      bpf, sockmap: Check skb_verdict and skb_parser programs explicitly
      bpf, sockmap: Allow skipping sk_skb parser program
      bpf, selftests: Add option to test_sockmap to omit adding parser program
      bpf, selftests: Add three new sockmap tests for verdict only programs

Luigi Rizzo (1):
      bpf, libbpf: Use valid btf in bpf_program__set_attach_target

Magnus Karlsson (2):
      libbpf: Fix compatibility problem in xsk_socket__create
      xsk: Introduce padding between ring pointers

Martin KaFai Lau (2):
      bpf: tcp: Do not limit cb_flags when creating child sk from listen sk
      bpf: selftest: Ensure the child sk inherited all bpf_sock_ops_cb_flags

Nikita V. Shirokov (1):
      bpf: Add tcp_notsent_lowat bpf setsockopt

Randy Dunlap (1):
      kernel/bpf/verifier: Fix build when NET is not enabled

Song Liu (1):
      bpf: Use raw_spin_trylock() for pcpu_freelist_push/pop in NMI

Stanislav Fomichev (3):
      selftests/bpf: Initialize duration in xdp_noinline.c
      selftests/bpf: Properly initialize linfo in sockmap_basic
      bpf: Deref map in BPF_PROG_BIND_MAP when it's already used

Toke Høiland-Jørgensen (1):
      bpf: Always return target ifindex in bpf_fib_lookup

Yonghong Song (4):
      samples/bpf: Change Makefile to cope with latest llvm
      samples/bpf: Fix a compilation error with fallthrough marking
      bpf: Fix build failure for kernel/trace/bpf_trace.c with CONFIG_NET=n
      bpf: Track spill/fill of bounded scalars.

 Documentation/bpf/bpf_devel_QA.rst                 |   4 +-
 MAINTAINERS                                        |   2 +-
 drivers/net/veth.c                                 |   9 +
 include/linux/bpf.h                                |   8 +-
 include/linux/bpf_verifier.h                       |   7 +
 include/linux/btf.h                                |  26 +
 include/linux/netdevice.h                          |   4 +
 include/linux/skmsg.h                              |   2 +
 include/net/tcp.h                                  |  33 -
 include/uapi/linux/bpf.h                           | 101 ++-
 kernel/bpf/arraymap.c                              |  17 +-
 kernel/bpf/btf.c                                   |  25 -
 kernel/bpf/hashtab.c                               |   6 +-
 kernel/bpf/helpers.c                               |  32 +
 kernel/bpf/percpu_freelist.c                       | 101 ++-
 kernel/bpf/percpu_freelist.h                       |   1 +
 kernel/bpf/syscall.c                               |   4 +-
 kernel/bpf/verifier.c                              | 270 +++++-
 kernel/trace/bpf_trace.c                           |   6 +
 net/core/dev.c                                     |  15 +-
 net/core/filter.c                                  | 107 ++-
 net/core/skmsg.c                                   | 161 +++-
 net/core/sock_map.c                                |  37 +-
 net/ipv4/tcp_minisocks.c                           |   1 -
 net/xdp/xsk_buff_pool.c                            |   3 -
 net/xdp/xsk_queue.h                                |   4 +
 net/xdp/xskmap.c                                   |   2 +-
 samples/bpf/Makefile                               |  15 +-
 samples/bpf/hbm.c                                  |   3 +-
 samples/bpf/xdp_monitor_kern.c                     |  60 +-
 samples/bpf/xdp_monitor_user.c                     | 159 +++-
 samples/bpf/xdp_redirect_cpu_user.c                | 153 ++--
 samples/bpf/xdp_sample_pkts_kern.c                 |  14 +-
 samples/bpf/xdp_sample_pkts_user.c                 |   1 -
 samples/bpf/xdpsock_user.c                         | 354 ++++++--
 tools/include/uapi/linux/bpf.h                     | 101 ++-
 tools/lib/bpf/libbpf.c                             | 348 ++++++--
 tools/lib/bpf/xsk.c                                |   7 +-
 tools/testing/selftests/bpf/README.rst             |  38 +
 tools/testing/selftests/bpf/prog_tests/align.c     |  16 +-
 .../selftests/bpf/prog_tests/btf_map_in_map.c      |  39 +-
 .../selftests/bpf/prog_tests/core_autosize.c       | 225 +++++
 tools/testing/selftests/bpf/prog_tests/ksyms.c     |  38 +-
 tools/testing/selftests/bpf/prog_tests/ksyms_btf.c |  88 ++
 tools/testing/selftests/bpf/prog_tests/pinning.c   |  49 +-
 .../selftests/bpf/prog_tests/sockmap_basic.c       |   2 +-
 .../selftests/bpf/prog_tests/tcp_hdr_options.c     |  12 +
 .../selftests/bpf/prog_tests/test_profiler.c       |  72 ++
 .../selftests/bpf/prog_tests/xdp_noinline.c        |   2 +-
 tools/testing/selftests/bpf/progs/connect4_prog.c  |  19 +
 tools/testing/selftests/bpf/progs/profiler.h       | 177 ++++
 tools/testing/selftests/bpf/progs/profiler.inc.h   | 969 +++++++++++++++++++++
 tools/testing/selftests/bpf/progs/profiler1.c      |   6 +
 tools/testing/selftests/bpf/progs/profiler2.c      |   6 +
 tools/testing/selftests/bpf/progs/profiler3.c      |   6 +
 .../selftests/bpf/progs/test_btf_map_in_map.c      |  43 +
 .../selftests/bpf/progs/test_core_autosize.c       | 172 ++++
 tools/testing/selftests/bpf/progs/test_ksyms_btf.c |  55 ++
 .../bpf/progs/test_misc_tcp_hdr_options.c          |   4 +-
 .../selftests/bpf/progs/test_sockmap_kern.h        |  34 +-
 tools/testing/selftests/bpf/progs/test_tc_neigh.c  |  40 +-
 tools/testing/selftests/bpf/progs/test_tc_peer.c   |  45 +
 .../selftests/bpf/progs/test_tcp_hdr_options.c     |   7 +-
 tools/testing/selftests/bpf/test_sockmap.c         |  81 +-
 tools/testing/selftests/bpf/test_tc_neigh.sh       | 168 ----
 tools/testing/selftests/bpf/test_tc_redirect.sh    | 204 +++++
 tools/testing/selftests/bpf/test_tcp_hdr_options.h |   5 +-
 tools/testing/selftests/bpf/trace_helpers.c        |  27 +
 tools/testing/selftests/bpf/trace_helpers.h        |   4 +
 tools/testing/selftests/bpf/verifier/basic.c       |   2 +-
 .../selftests/bpf/verifier/direct_packet_access.c  |   2 +-
 tools/testing/selftests/bpf/verifier/ld_imm64.c    |   8 -
 tools/testing/selftests/bpf/verifier/regalloc.c    | 243 ++++++
 73 files changed, 4339 insertions(+), 772 deletions(-)
 create mode 100644 tools/testing/selftests/bpf/prog_tests/core_autosize.c
 create mode 100644 tools/testing/selftests/bpf/prog_tests/ksyms_btf.c
 create mode 100644 tools/testing/selftests/bpf/prog_tests/test_profiler.c
 create mode 100644 tools/testing/selftests/bpf/progs/profiler.h
 create mode 100644 tools/testing/selftests/bpf/progs/profiler.inc.h
 create mode 100644 tools/testing/selftests/bpf/progs/profiler1.c
 create mode 100644 tools/testing/selftests/bpf/progs/profiler2.c
 create mode 100644 tools/testing/selftests/bpf/progs/profiler3.c
 create mode 100644 tools/testing/selftests/bpf/progs/test_core_autosize.c
 create mode 100644 tools/testing/selftests/bpf/progs/test_ksyms_btf.c
 create mode 100644 tools/testing/selftests/bpf/progs/test_tc_peer.c
 delete mode 100755 tools/testing/selftests/bpf/test_tc_neigh.sh
 create mode 100755 tools/testing/selftests/bpf/test_tc_redirect.sh
 create mode 100644 tools/testing/selftests/bpf/verifier/regalloc.c



[Index of Archives]     [Linux Samsung SoC]     [Linux Rockchip SoC]     [Linux Actions SoC]     [Linux for Synopsys ARC Processors]     [Linux NFS]     [Linux NILFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]


  Powered by Linux