skb_warn_bad_offload issue appeared with updated kernel in 3.6
Initially I’ve installed 3.6.2 and everything worked nicely.
A few days ago I’ve updated the system and I believe kernel was updated
too.
How I’m experiencing the issue described upstream here:
https://bugzilla.kernel.org/show\_bug.cgi?id=82471
Also someone posted that combination of libvirt and kernel versions
might cause issues here:
https://community.sophos.com/products/unified-threat-management/f/general-discussion/22390/skb\_warn\_bad\_offload-kernel-error-on-packet-routing/60592\#60592
My machine has Intel N3150 CPU, a few bridges and a single pfSense VM under KVM (Virtio is used for VM NIC model).
localhost:~# cat /etc/network/interfaces
auto lo
iface lo inet loopback
auto wan
iface wan inet manual
bridge-ports eth0
auto lan
iface lan inet static
bridge-ports eth1 eth2
address 192.168.1.99
netmask 255.255.255.0
gateway 192.168.1.1
dns-nameservers 192.168.1.1
eth0 is onboard Realtek NIC, eth1 is PCIe Intel NIC and eth2 is USB 100M NIC.
localhost:~# brctl show
bridge name bridge id STP enabled interfaces
lan 8000.101350a45170 no eth1
eth2
vnet1
virbr0 8000.5254006a8142 yes virbr0-nic
wan 8000.d8cb8a98900a no eth0
vnet0
localhost:~# ifconfig
eth0 Link encap:Ethernet HWaddr D8:CB:8A:98:90:0A
inet6 addr: fe80::dacb:8aff:fe98:900a/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1319419746 errors:0 dropped:0 overruns:0 frame:0
TX packets:723152217 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:219622006658 (204.5 GiB) TX bytes:459670552469 (428.1 GiB)
eth1 Link encap:Ethernet HWaddr 68:05:CA:1A:E5:0A
inet6 addr: fe80::6a05:caff:fe1a:e50a/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:715628856 errors:0 dropped:722 overruns:0 frame:0
TX packets:251581787 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:461566162524 (429.8 GiB) TX bytes:35308978007 (32.8 GiB)
Interrupt:17 Memory:812c0000-812e0000
eth2 Link encap:Ethernet HWaddr 10:13:50:A4:51:70
inet6 addr: fe80::1213:50ff:fea4:5170/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:7473271 errors:451 dropped:81 overruns:82 frame:535
TX packets:12329368 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:898153576 (856.5 MiB) TX bytes:16881513930 (15.7 GiB)
lan Link encap:Ethernet HWaddr 10:13:50:A4:51:70
inet addr:192.168.1.99 Bcast:0.0.0.0 Mask:255.255.255.0
inet6 addr: fe80::1213:50ff:fea4:5170/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:192463 errors:0 dropped:0 overruns:0 frame:0
TX packets:245387 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:12664908 (12.0 MiB) TX bytes:112788129 (107.5 MiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:522338 errors:0 dropped:0 overruns:0 frame:0
TX packets:522338 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1
RX bytes:112828275 (107.6 MiB) TX bytes:112828275 (107.6 MiB)
virbr0 Link encap:Ethernet HWaddr 52:54:00:6A:81:42
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
vnet0 Link encap:Ethernet HWaddr FE:54:00:91:B2:5B
inet6 addr: fe80::fc54:ff:fe91:b25b/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:146299176 errors:0 dropped:0 overruns:0 frame:0
TX packets:245276535 errors:0 dropped:287854 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:87790811235 (81.7 GiB) TX bytes:42019124859 (39.1 GiB)
vnet1 Link encap:Ethernet HWaddr FE:54:00:95:2F:87
inet6 addr: fe80::fc54:ff:fe95:2f87/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:52656609 errors:0 dropped:0 overruns:0 frame:0
TX packets:146241964 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:11121395680 (10.3 GiB) TX bytes:87791886133 (81.7 GiB)
wan Link encap:Ethernet HWaddr D8:CB:8A:98:90:0A
inet6 addr: fe80::dacb:8aff:fe98:900a/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1046405659 errors:0 dropped:41794 overruns:0 frame:0
TX packets:61 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:153923145298 (143.3 GiB) TX bytes:4358 (4.2 KiB)
The error I’m getting on this machine is like following:
[144134.674460] ------------[ cut here ]------------
[144134.685515] WARNING: CPU: 2 PID: 3340 at /home/buildozer/aports/main/linux-hardened/src/linux-4.9/net/core/dev.c:2461 skb_warn_bad_offload+0x113/0x140
[144134.696712] e1000e: caps=(0x0000003000214ba9, 0x0000000000000000) len=8766 data_len=8700 gso_size=1448 gso_type=5 ip_summed=0
[144134.707966] Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables bridge stp llc ipv6 nls_utf8 nls_cp437 vfat fat vhost_net vhost tun macvtap macvlan af_packet mousedev joydev hid_generic usbhid dm9601 usbnet psmouse serio_raw pcspkr shpchp i915 drm_kms_helper fb_sys_fops syscopyarea sysfillrect iTCO_wdt sysimgblt iTCO_vendor_support drm intel_gtt agpgart i2c_algo_bit lpc_ich mfd_core mei_txe mei i2c_i801 i2c_smbus e1000e ptp pps_core r8169 mii input_leds crct10dif_pclmul ghash_clmulni_intel kvm_intel kvm irqbypass aesni_intel glue_helper aes_x86_64 lrw gf128mul
[144134.720680] ablk_helper cryptd coretemp hwmon intel_cstate wmi fan battery fjes video evdev thermal button tpm_tis tpm_tis_core tpm pinctrl_cherryview rfkill_gpio hci_uart btintel btqca btbcm bluetooth rfkill i2c_hid hid i2c_designware_platform i2c_designware_core snd_intel_sst_acpi snd_intel_sst_core snd_soc_sst_mfld_platform snd_soc_sst_match pwm_lpss_platform pwm_lpss sdhci_acpi sdhci mmc_core snd_soc_rt5670 snd_soc_core snd_pcm snd_timer snd_compress snd soundcore snd_soc_rl6231 regmap_i2c i2c_core fbcon font bitblit fbcon_rotate fbcon_ccw fbcon_ud fbcon_cw softcursor tileblit efivarfs crc32_pclmul crc32c_intel ahci libahci libata xhci_pci xhci_hcd loop ext4 crc16 jbd2 mbcache usb_storage sd_mod scsi_mod
[144134.758823] CPU: 2 PID: 3340 Comm: vhost-3337 Tainted: G D W 4.9.32-0-hardened #1-Alpine
[144134.771771] Hardware name: MSI MS-7890/N3150I ECO (MS-7890), BIOS 1.30 02/09/2017
[144134.784687] ffffc90000013918 ffffffff813034ae ffffffff81119d37 e32d85405d8a3d8d
[144134.797677] ffffc90000013968 ffffffff8198ce06 ffffc90000013958 ffffffff8107b854
[144134.810642] 0000099d000139d8 ffff880079d8c000 ffff880070570500 00000000000005a8
[144134.823597] Call Trace:
[144134.836541] <IRQ>
[144134.836578] [<ffffffff813034ae>] dump_stack+0xaf/0x111
[144134.849578] [<ffffffff81119d37>] ? print_modules+0xd2/0x109
[144134.862586] [<ffffffff8107b854>] __warn+0x129/0x17c
[144134.875564] [<ffffffff8107b909>] warn_slowpath_fmt+0x62/0x9c
[144134.888564] [<ffffffff8157a479>] skb_warn_bad_offload+0x113/0x140
[144134.901581] [<ffffffff81581640>] __skb_gso_segment+0x3f/0x150
[144134.914592] [<ffffffff81581aa5>] validate_xmit_skb+0xcf/0x302
[144134.927599] [<ffffffff81581d10>] validate_xmit_skb_list+0x38/0x7d
[144134.940596] [<ffffffff815b56e8>] sch_direct_xmit+0x5a/0x20f
[144134.953505] [<ffffffff81582354>] __dev_queue_xmit+0x36d/0x71a
[144134.966250] [<ffffffffa019a4fb>] ? xhci_queue_bulk_tx+0x1a1/0x888 [xhci_hcd]
[144134.978633] [<ffffffff81582719>] dev_queue_xmit+0x18/0x38
[144134.990594] [<ffffffffa1134e16>] br_dev_queue_push_xmit+0x124/0x1b4 [bridge]
[144135.002210] [<ffffffffa1134f55>] br_forward_finish+0xaf/0xea [bridge]
[144135.013366] [<ffffffff815c959f>] ? nf_iterate+0x4f/0xac
[144135.024421] [<ffffffff815c9646>] ? nf_hook_slow+0x4a/0x101
[144135.035472] [<ffffffffa1135163>] __br_forward+0x1d3/0x293 [bridge]
[144135.046508] [<ffffffffa1134ea6>] ? br_dev_queue_push_xmit+0x1b4/0x1b4 [bridge]
[144135.057553] [<ffffffffa113538a>] br_forward+0xe5/0xef [bridge]
[144135.068549] [<ffffffffa11374b1>] br_handle_frame_finish+0x55c/0x618 [bridge]
[144135.079593] [<ffffffffa1137a07>] br_handle_frame+0x366/0x3cb [bridge]
[144135.090571] [<ffffffff810394a9>] ? sched_clock+0x16/0x36
[144135.101488] [<ffffffff810394a9>] ? sched_clock+0x16/0x36
[144135.112400] [<ffffffffa11376a1>] ? br_handle_local_finish+0x70/0x70 [bridge]
[144135.123329] [<ffffffff8157ca34>] __netif_receive_skb_core+0x4d0/0xc1e
[144135.134261] [<ffffffff8157a253>] ? __dev_kfree_skb_any+0x24/0x70
[144135.145196] [<ffffffffa0a86f33>] ? e1000_clean_tx_irq+0x1ae/0x2b4 [e1000e]
[144135.156166] [<ffffffff8157e093>] __netif_receive_skb+0x20/0x8c
[144135.167163] [<ffffffff8157fa03>] process_backlog+0xc5/0x1b5
[144135.178101] [<ffffffff8157f70f>] net_rx_action+0x186/0x3b5
[144135.189103] [<ffffffff81081b5e>] __do_softirq+0x109/0x27e
[144135.200051] [<ffffffff8166f0c9>] do_softirq_own_stack+0x29/0x40
[144135.211048] <EOI>
[144135.211081] [<ffffffff81081e0f>] do_softirq+0x9b/0xa5
[144135.222104] [<ffffffff8157db80>] netif_rx_ni+0x37/0x5a
[144135.233108] [<ffffffffa0fd121c>] tun_get_user+0x75a/0x9a0 [tun]
[144135.244145] [<ffffffffa0fd14b8>] tun_sendmsg+0x56/0x88 [tun]
[144135.255125] [<ffffffffa1006669>] handle_tx+0x49c/0x5f7 [vhost_net]
[144135.266131] [<ffffffffa100681e>] handle_tx_kick+0x1d/0x3d [vhost_net]
[144135.277125] [<ffffffffa0fe94e9>] vhost_worker+0x14a/0x174 [vhost]
[144135.288111] [<ffffffffa0fe939f>] ? vhost_flush_work+0x3a/0x3a [vhost]
[144135.299119] [<ffffffff810a3016>] kthread+0x161/0x173
[144135.310055] [<ffffffff810a2eb5>] ? kthread_park+0xa4/0xa4
[144135.321006] [<ffffffff8166dadb>] ret_from_fork+0x5b/0x70
[144135.332059] ---[ end trace 28648d4214ba69e1 ]---
Prior to update I didn’t experience such issue.
(from redmine: issue id 7785, created on 2017-09-04)