On Fri, 2011-04-08 at 16:07 +0200, Peter Zijlstra wrote: > > As you said perf has a lot of overhead due to data that it saves per > > event. > > Someday you should actually read the perf code before you say something. I have looked at the code although not as much recently, but I do plan on looking at it again in much more detail. But you are correct that I did not make this comment on the code itself, but on looking at the data: I ran: # perf record -a -e sched:sched_switch sleep 10 # mv perf.data perf.data.10 # perf record -a -e sched:sched_switch sleep 20 # mv perf.data perf.data.20 # ls -l perf.data.* -rw-------. 1 root root 4480655 2011-04-08 12:36 perf.data.10 -rw-------. 1 root root 5532431 2011-04-08 12:37 perf.data.20 # perf script -i perf.data.10 | wc -l 9909 # perf script -i perf.data.20 | wc -l 18675 Then I did some deltas to figure out he size per event: 5532431-4480655 = 1051776 18675-9909 = 8766 1051776/8766 = 119 Which shows that the sched switch event takes up 119 bytes per event. Then I looked at what ftrace does: # trace-cmd record -e sched_switch -o trace.dat.10 sleep 10 # trace-cmd record -e sched_switch -o trace.dat.20 sleep 20 # trace-cmd report trace.dat.10 | wc -l 38856 # trace-cmd report trace.dat.20 | wc -l 77124 # ls -l trace.dat.* -rw-r--r--. 1 root root 5832704 2011-04-08 12:41 trace.dat.10 -rw-r--r--. 1 root root 8790016 2011-04-08 12:41 trace.dat.20 8790016-5832704 = 2957312 77124-38856 = 38268 2957312/38268 = 77 As you stated, I need to look more into the perf code (which I plan on doing), but it seems that perf adds 42 bytes more per event. Perhaps this is something we can fix. I'd love to make both perf and ftrace be able to limit its header. There's no reason to record the pid for every event if we don't need to. As well as the preempt count and interrupt status. But these are legacy from the latency tracer code from -rt. I think there's a lot of work that we can do make tracing in perf more compatible with the tracing features of ftrace. I did say the ugly word "roadmap" but perhaps it's just direction that we need. I feel we are all a bunch of cooks with their own taste, and we don't all like the spices used by each other. -- Steve _______________________________________________ Containers mailing list Containers@xxxxxxxxxxxxxxxxxxxxxxxxxx https://lists.linux-foundation.org/mailman/listinfo/containers