pktgen sending using CPU2. We use clone_skb=1
2 * Six-Core AMD Opteron(tm) Processor 2439 SE 2.8 GHz
igb driver. Intel 82576 chipset

grep node /proc/net/pktgen/eth1 
     node: 0

1190240pps 571Mb/sec (571315200bps) errors: 0
1189554pps 570Mb/sec (570985920bps) errors: 0
1183513pps 568Mb/sec (568086240bps) errors: 0
1176291pps 564Mb/sec (564619680bps) errors: 0
1189563pps 570Mb/sec (570990240bps) errors: 0

grep node /proc/net/pktgen/eth1 
     node: 1

1014790pps 487Mb/sec (487099200bps) errors: 0
1014760pps 487Mb/sec (487084800bps) errors: 0
1018884pps 489Mb/sec (489064320bps) errors: 0
1013121pps 486Mb/sec (486298080bps) errors: 0
1016137pps 487Mb/sec (487745760bps) errors: 0

So we win ~18% by going to corrcect node.


We see CPU assignment's per node in /sys

ls -ltr  /sys/devices/system/node/node0/cpu*
-r--r--r--    1 root     root         4096 2006-07-10 07:35 /sys/devices/system/node/node0/cpumap
-r--r--r--    1 root     root         4096 2006-07-10 07:35 /sys/devices/system/node/node0/cpulist
lrwxrwxrwx    1 root     root            0 2006-07-10 07:35 /sys/devices/system/node/node0/cpu5 -> ../../cpu/cpu5/
lrwxrwxrwx    1 root     root            0 2006-07-10 07:35 /sys/devices/system/node/node0/cpu4 -> ../../cpu/cpu4/
lrwxrwxrwx    1 root     root            0 2006-07-10 07:35 /sys/devices/system/node/node0/cpu3 -> ../../cpu/cpu3/
lrwxrwxrwx    1 root     root            0 2006-07-10 07:35 /sys/devices/system/node/node0/cpu2 -> ../../cpu/cpu2/
lrwxrwxrwx    1 root     root            0 2006-07-10 07:35 /sys/devices/system/node/node0/cpu1 -> ../../cpu/cpu1/
lrwxrwxrwx    1 root     root            0 2006-07-10 07:35 /sys/devices/system/node/node0/cpu0 -> ../../cpu/cpu0/

labb:/# ls -ltr  /sys/devices/system/node/node1/cpu*
-r--r--r--    1 root     root         4096 2006-07-10 07:52 /sys/devices/system/node/node1/cpumap
-r--r--r--    1 root     root         4096 2006-07-10 07:52 /sys/devices/system/node/node1/cpulist
lrwxrwxrwx    1 root     root            0 2006-07-10 07:52 /sys/devices/system/node/node1/cpu9 -> ../../cpu/cpu9/
lrwxrwxrwx    1 root     root            0 2006-07-10 07:52 /sys/devices/system/node/node1/cpu8 -> ../../cpu/cpu8/
lrwxrwxrwx    1 root     root            0 2006-07-10 07:52 /sys/devices/system/node/node1/cpu7 -> ../../cpu/cpu7/
lrwxrwxrwx    1 root     root            0 2006-07-10 07:52 /sys/devices/system/node/node1/cpu6 -> ../../cpu/cpu6/
lrwxrwxrwx    1 root     root            0 2006-07-10 07:52 /sys/devices/system/node/node1/cpu11 -> ../../cpu/cpu11/
lrwxrwxrwx    1 root     root            0 2006-07-10 07:52 /sys/devices/system/node/node1/cpu10 -> ../../cpu/cpu10/