Skip to content

Добавить возможность сбора и парсинга perf метрик с помощью stress-ng #404

Description

@Artanias

stress-ng обладает флагом perf, который позволяет собирать дополнительные метрики по стрессорам:

       --perf measure processor and system activity using perf events. Linux only and caveat emptor, according to perf_event_open(2): "Always double-check your results! Various  gen‐
              eralized  events  have  had  wrong  values.".   Note that with Linux 4.7 one needs to have CAP_SYS_ADMIN capabilities for this option to work, or adjust  /proc/sys/ker‐
              nel/perf_event_paranoid to below 2 to use this without CAP_SYS_ADMIN.

Пример вывода для стессоров cpu и sock (скорее всего нужны root права для сбора статистик):

stress-ng: info:  [208659] setting to a 15 secs run per stressor
stress-ng: info:  [208659] dispatching hogs: 16 cpu, 16 sock
stress-ng: info:  [208659] cpu:
stress-ng: info:  [208659]            451,011,912,224 CPU Cycles                    25.912 B/sec
stress-ng: info:  [208659]            658,659,687,712 Instructions                  37.841 B/sec (1.460 instr. per cycle)
stress-ng: info:  [208659]             76,135,510,752 Branch Instructions            4.374 B/sec
stress-ng: info:  [208659]                749,708,592 Branch Misses                 43.072 M/sec ( 0.985%)
stress-ng: info:  [208659]             25,238,354,416 Stalled Cycles Frontend        1.450 B/sec
stress-ng: info:  [208659]            348,245,151,680 Total Cycles                  20.007 B/sec
stress-ng: info:  [208659]             14,450,660,544 Cache References               0.830 B/sec
stress-ng: info:  [208659]                151,690,144 Cache Misses                   8.715 M/sec ( 1.050%)
stress-ng: info:  [208659]            107,334,619,440 Cache L1D Read                 6.167 B/sec
stress-ng: info:  [208659]              8,948,136,944 Cache L1D Read Miss            0.514 B/sec ( 8.337%)
stress-ng: info:  [208659]              6,677,665,760 Cache L1D Prefetch             0.384 B/sec
stress-ng: info:  [208659]              2,160,504,688 Cache L1I Read                 0.124 B/sec
stress-ng: info:  [208659]                  3,556,064 Cache L1I Read Miss            0.204 M/sec
stress-ng: info:  [208659]              2,274,844,768 Cache DTLB Read                0.131 B/sec
stress-ng: info:  [208659]                  5,379,632 Cache DTLB Read Miss           0.309 M/sec ( 0.236%)
stress-ng: info:  [208659]                    570,784 Cache ITLB Read               32.793 K/sec
stress-ng: info:  [208659]                    928,992 Cache ITLB Read Miss          53.373 K/sec (162.757%)
stress-ng: info:  [208659]             71,604,748,928 Cache BPU Read                 4.114 B/sec
stress-ng: info:  [208659]                655,992,224 Cache BPU Read Miss           37.688 M/sec ( 0.916%)
stress-ng: info:  [208659]             93,444,858,736 CPU Clock                      5.369 B/sec
stress-ng: info:  [208659]             94,102,567,472 Task Clock                     5.406 B/sec
stress-ng: info:  [208659]                      7,488 Page Faults Total            430.201 /sec 
stress-ng: info:  [208659]                      7,488 Page Faults Minor            430.201 /sec 
stress-ng: info:  [208659]                          0 Page Faults Major              0.000 /sec 
stress-ng: info:  [208659]                     45,552 Context Switches               2.617 K/sec
stress-ng: info:  [208659]                     14,432 Cgroup Switches              829.148 /sec 
stress-ng: info:  [208659]                        672 CPU Migrations                38.608 /sec 
stress-ng: info:  [208659]                          0 Alignment Faults               0.000 /sec 
stress-ng: info:  [208659]                          0 Emulation Faults               0.000 /sec 
stress-ng: info:  [208659]                     14,432 Cgroup Switches              829.148 /sec 
stress-ng: info:  [208659]                      7,488 Page Faults User             430.201 /sec 
stress-ng: info:  [208659]                          0 Page Faults Kernel             0.000 /sec 
stress-ng: info:  [208659]                      3,040 System Call Enter            174.654 /sec 
stress-ng: info:  [208659]                      3,024 System Call Exit             173.735 /sec 
stress-ng: info:  [208659]                        688 TLB Flushes                   39.527 /sec 
stress-ng: info:  [208659]                          0 Software I/O TLB Bounces       0.000 /sec 
stress-ng: info:  [208659]                        144 Kmalloc                        8.273 /sec 
stress-ng: info:  [208659]                      1,744 Kfree                        100.196 /sec 
stress-ng: info:  [208659]                      3,760 Kmem Cache Alloc             216.020 /sec 
stress-ng: info:  [208659]                      9,232 Kmem Cache Free              530.397 /sec 
stress-ng: info:  [208659]                      7,104 MM Page Alloc                408.139 /sec 
stress-ng: info:  [208659]                      3,056 MM Page Free                 175.574 /sec 
stress-ng: info:  [208659]                          0 MMAP lock start                0.000 /sec 
stress-ng: info:  [208659]                          0 MMAP lock release              0.000 /sec 
stress-ng: info:  [208659]                          0 MMAP lock acquire              0.000 /sec 
stress-ng: info:  [208659]                    336,736 RCU Utilization               19.346 K/sec
stress-ng: info:  [208659]                          0 RCU Stall Warning              0.000 /sec 
stress-ng: info:  [208659]                      1,056 Sched Migrate Task            60.669 /sec 
stress-ng: info:  [208659]                          0 Sched Move NUMA                0.000 /sec 
stress-ng: info:  [208659]                      8,080 Sched Wakeup                 464.213 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Exec                0.000 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Exit                0.000 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Fork                0.000 /sec 
stress-ng: info:  [208659]                         64 Sched Proc Free                3.677 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Hang                0.000 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Wait                0.000 /sec 
stress-ng: info:  [208659]                     45,552 Sched Switch                   2.617 K/sec
stress-ng: info:  [208659]                          0 Sched Wait Task                0.000 /sec 
stress-ng: info:  [208659]                          0 New Task                       0.000 /sec 
stress-ng: info:  [208659]                          0 Context User Enter             0.000 /sec 
stress-ng: info:  [208659]                          0 Context User Exit              0.000 /sec 
stress-ng: info:  [208659]                         16 Signal Generate                0.919 /sec 
stress-ng: info:  [208659]                         16 Signal Deliver                 0.919 /sec 
stress-ng: info:  [208659]                      1,408 IRQ Entry                     80.893 /sec 
stress-ng: info:  [208659]                      1,408 IRQ Exit                      80.893 /sec 
stress-ng: info:  [208659]                     36,288 Soft IRQ Entry                 2.085 K/sec
stress-ng: info:  [208659]                     36,288 Soft IRQ Exit                  2.085 K/sec
stress-ng: info:  [208659]                         48 Tasklet Entry                  2.758 /sec 
stress-ng: info:  [208659]                         48 Tasklet Exit                   2.758 /sec 
stress-ng: info:  [208659]                         48 NMI handler                    2.758 /sec 
stress-ng: info:  [208659]                        864 IPI Send CPU                  49.639 /sec 
stress-ng: info:  [208659]                          0 x86 Platform IPI Entry         0.000 /sec 
stress-ng: info:  [208659]                        512 Call Function Entry           29.415 /sec 
stress-ng: info:  [208659]                          0 IRQ Work Entry                 0.000 /sec 
stress-ng: info:  [208659]                    128,976 Local Timer Entry              7.410 K/sec
stress-ng: info:  [208659]                     14,624 Reschedule Entry             840.179 /sec 
stress-ng: info:  [208659]                          0 Thermal APIC Entry             0.000 /sec 
stress-ng: info:  [208659]                          0 Block BIO Complete             0.000 /sec 
stress-ng: info:  [208659]                          0 IOMAP Read Page                0.000 /sec 
stress-ng: info:  [208659]                          0 IO uring complete              0.000 /sec 
stress-ng: info:  [208659]                          0 Writeback Dirty Inode          0.000 /sec 
stress-ng: info:  [208659]                          0 Writeback Dirty Folio          0.000 /sec 
stress-ng: info:  [208659]                          0 Migrate MM Pages               0.000 /sec 
stress-ng: info:  [208659]                        528 SKB Consume                   30.335 /sec 
stress-ng: info:  [208659]                        928 SKB Kfree                     53.316 /sec 
stress-ng: info:  [208659]                         32 Lock Contention Begin          1.838 /sec 
stress-ng: info:  [208659]                         32 Lock Contention End            1.838 /sec 
stress-ng: info:  [208659]                          0 Maple Tree Read                0.000 /sec 
stress-ng: info:  [208659]                          0 Maple Tree Write               0.000 /sec 
stress-ng: info:  [208659]                          0 Qdisc Enqueue                  0.000 /sec 
stress-ng: info:  [208659]                          0 Qdisc Dequeue                  0.000 /sec 
stress-ng: info:  [208659]                  1,563,888 MSR read                      89.849 K/sec
stress-ng: info:  [208659]                  2,233,584 MSR write                      0.128 M/sec
stress-ng: info:  [208659]                          0 IOMMU IO Page Fault            0.000 /sec 
stress-ng: info:  [208659]                          0 IOMMU Map                      0.000 /sec 
stress-ng: info:  [208659]                         64 IOMMU Unmap                    3.677 /sec 
stress-ng: info:  [208659]                          0 Filemap Page-Cache Add         0.000 /sec 
stress-ng: info:  [208659]                          0 Filemap Page-Cache Del         0.000 /sec 
stress-ng: info:  [208659]                          0 OOM Compact Retry              0.000 /sec 
stress-ng: info:  [208659]                          0 OOM Wake Reaper                0.000 /sec 
stress-ng: info:  [208659]                         16 OOM Score Adjust Update        0.919 /sec 
stress-ng: info:  [208659]                          0 Thermal Zone Trip              0.000 /sec 
stress-ng: info:  [208659] sock:
stress-ng: info:  [208659]            613,851,257,616 CPU Cycles                    35.267 B/sec
stress-ng: info:  [208659]            390,628,115,344 Instructions                  22.442 B/sec (0.636 instr. per cycle)
stress-ng: info:  [208659]             74,590,369,904 Branch Instructions            4.285 B/sec
stress-ng: info:  [208659]              8,682,837,632 Branch Misses                  0.499 B/sec (11.641%)
stress-ng: info:  [208659]            269,966,195,472 Stalled Cycles Frontend       15.510 B/sec
stress-ng: info:  [208659]            474,207,429,664 Total Cycles                  27.244 B/sec
stress-ng: info:  [208659]             37,944,279,872 Cache References               2.180 B/sec
stress-ng: info:  [208659]              1,631,887,552 Cache Misses                  93.755 M/sec ( 4.301%)
stress-ng: info:  [208659]            188,009,586,096 Cache L1D Read                10.802 B/sec
stress-ng: info:  [208659]             20,286,454,800 Cache L1D Read Miss            1.165 B/sec (10.790%)
stress-ng: info:  [208659]              5,290,863,696 Cache L1D Prefetch             0.304 B/sec
stress-ng: info:  [208659]            102,980,695,232 Cache L1I Read                 5.916 B/sec
stress-ng: info:  [208659]                202,967,520 Cache L1I Read Miss           11.661 M/sec
stress-ng: info:  [208659]              1,427,227,504 Cache DTLB Read               81.997 M/sec
stress-ng: info:  [208659]                 36,294,288 Cache DTLB Read Miss           2.085 M/sec ( 2.543%)
stress-ng: info:  [208659]                  3,509,024 Cache ITLB Read                0.202 M/sec
stress-ng: info:  [208659]                150,275,088 Cache ITLB Read Miss           8.634 M/sec (4282.532%)
stress-ng: info:  [208659]             74,858,759,584 Cache BPU Read                 4.301 B/sec
stress-ng: info:  [208659]              8,714,853,120 Cache BPU Read Miss            0.501 B/sec (11.642%)
stress-ng: info:  [208659]            128,720,099,072 CPU Clock                      7.395 B/sec
stress-ng: info:  [208659]            129,976,732,512 Task Clock                     7.467 B/sec
stress-ng: info:  [208659]                      1,024 Page Faults Total             58.831 /sec 
stress-ng: info:  [208659]                      1,008 Page Faults Minor             57.912 /sec 
stress-ng: info:  [208659]                          0 Page Faults Major              0.000 /sec 
stress-ng: info:  [208659]                    500,288 Context Switches              28.743 K/sec
stress-ng: info:  [208659]                     12,864 Cgroup Switches              739.063 /sec 
stress-ng: info:  [208659]                      1,840 CPU Migrations               105.712 /sec 
stress-ng: info:  [208659]                          0 Alignment Faults               0.000 /sec 
stress-ng: info:  [208659]                          0 Emulation Faults               0.000 /sec 
stress-ng: info:  [208659]                     12,864 Cgroup Switches              739.063 /sec 
stress-ng: info:  [208659]                        896 Page Faults User              51.477 /sec 
stress-ng: info:  [208659]                        128 Page Faults Kernel             7.354 /sec 
stress-ng: info:  [208659]                 78,987,632 System Call Enter              4.538 M/sec
stress-ng: info:  [208659]                 78,987,632 System Call Exit               4.538 M/sec
stress-ng: info:  [208659]                    424,752 TLB Flushes                   24.403 K/sec
stress-ng: info:  [208659]                          0 Software I/O TLB Bounces       0.000 /sec 
stress-ng: info:  [208659]                      2,416 Kmalloc                      138.804 /sec 
stress-ng: info:  [208659]                      4,416 Kfree                        253.708 /sec 
stress-ng: info:  [208659]                 21,471,120 Kmem Cache Alloc               1.234 M/sec
stress-ng: info:  [208659]                 20,702,688 Kmem Cache Free                1.189 M/sec
stress-ng: info:  [208659]                  6,516,656 MM Page Alloc                  0.374 M/sec
stress-ng: info:  [208659]                  6,532,816 MM Page Free                   0.375 M/sec
stress-ng: info:  [208659]                        288 MMAP lock start               16.546 /sec 
stress-ng: info:  [208659]                        288 MMAP lock release             16.546 /sec 
stress-ng: info:  [208659]                        320 MMAP lock acquire             18.385 /sec 
stress-ng: info:  [208659]                  1,293,632 RCU Utilization               74.322 K/sec
stress-ng: info:  [208659]                          0 RCU Stall Warning              0.000 /sec 
stress-ng: info:  [208659]                      1,856 Sched Migrate Task           106.631 /sec 
stress-ng: info:  [208659]                          0 Sched Move NUMA                0.000 /sec 
stress-ng: info:  [208659]                    315,872 Sched Wakeup                  18.147 K/sec
stress-ng: info:  [208659]                          0 Sched Proc Exec                0.000 /sec 
stress-ng: info:  [208659]                         16 Sched Proc Exit                0.919 /sec 
stress-ng: info:  [208659]                         16 Sched Proc Fork                0.919 /sec 
stress-ng: info:  [208659]                         32 Sched Proc Free                1.838 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Hang                0.000 /sec 
stress-ng: info:  [208659]                         16 Sched Proc Wait                0.919 /sec 
stress-ng: info:  [208659]                    500,288 Sched Switch                  28.743 K/sec
stress-ng: info:  [208659]                          0 Sched Wait Task                0.000 /sec 
stress-ng: info:  [208659]                         16 New Task                       0.919 /sec 
stress-ng: info:  [208659]                          0 Context User Enter             0.000 /sec 
stress-ng: info:  [208659]                          0 Context User Exit              0.000 /sec 
stress-ng: info:  [208659]                         48 Signal Generate                2.758 /sec 
stress-ng: info:  [208659]                         48 Signal Deliver                 2.758 /sec 
stress-ng: info:  [208659]                          0 IRQ Entry                      0.000 /sec 
stress-ng: info:  [208659]                          0 IRQ Exit                       0.000 /sec 
stress-ng: info:  [208659]                  3,295,440 Soft IRQ Entry                 0.189 M/sec
stress-ng: info:  [208659]                  3,295,440 Soft IRQ Exit                  0.189 M/sec
stress-ng: info:  [208659]                          0 Tasklet Entry                  0.000 /sec 
stress-ng: info:  [208659]                          0 Tasklet Exit                   0.000 /sec 
stress-ng: info:  [208659]                         48 NMI handler                    2.758 /sec 
stress-ng: info:  [208659]                     28,544 IPI Send CPU                   1.640 K/sec
stress-ng: info:  [208659]                          0 x86 Platform IPI Entry         0.000 /sec 
stress-ng: info:  [208659]                        448 Call Function Entry           25.739 /sec 
stress-ng: info:  [208659]                          0 IRQ Work Entry                 0.000 /sec 
stress-ng: info:  [208659]                    135,792 Local Timer Entry              7.802 K/sec
stress-ng: info:  [208659]                      4,720 Reschedule Entry             271.174 /sec 
stress-ng: info:  [208659]                          0 Thermal APIC Entry             0.000 /sec 
stress-ng: info:  [208659]                          0 Block BIO Complete             0.000 /sec 
stress-ng: info:  [208659]                          0 IOMAP Read Page                0.000 /sec 
stress-ng: info:  [208659]                          0 IO uring complete              0.000 /sec 
stress-ng: info:  [208659]                          0 Writeback Dirty Inode          0.000 /sec 
stress-ng: info:  [208659]                          0 Writeback Dirty Folio          0.000 /sec 
stress-ng: info:  [208659]                          0 Migrate MM Pages               0.000 /sec 
stress-ng: info:  [208659]                  1,750,352 SKB Consume                    0.101 M/sec
stress-ng: info:  [208659]                        320 SKB Kfree                     18.385 /sec 
stress-ng: info:  [208659]                      1,360 Lock Contention Begin         78.135 /sec 
stress-ng: info:  [208659]                      1,328 Lock Contention End           76.296 /sec 
stress-ng: info:  [208659]                        160 Maple Tree Read                9.192 /sec 
stress-ng: info:  [208659]                      2,912 Maple Tree Write             167.300 /sec 
stress-ng: info:  [208659]                          0 Qdisc Enqueue                  0.000 /sec 
stress-ng: info:  [208659]                          0 Qdisc Dequeue                  0.000 /sec 
stress-ng: info:  [208659]                  7,051,328 MSR read                       0.405 M/sec
stress-ng: info:  [208659]                  4,604,496 MSR write                      0.265 M/sec
stress-ng: info:  [208659]                          0 IOMMU IO Page Fault            0.000 /sec 
stress-ng: info:  [208659]                          0 IOMMU Map                      0.000 /sec 
stress-ng: info:  [208659]                          0 IOMMU Unmap                    0.000 /sec 
stress-ng: info:  [208659]                          0 Filemap Page-Cache Add         0.000 /sec 
stress-ng: info:  [208659]                          0 Filemap Page-Cache Del         0.000 /sec 
stress-ng: info:  [208659]                          0 OOM Compact Retry              0.000 /sec 
stress-ng: info:  [208659]                          0 OOM Wake Reaper                0.000 /sec 
stress-ng: info:  [208659]                         16 OOM Score Adjust Update        0.919 /sec 
stress-ng: info:  [208659]                          0 Thermal Zone Trip              0.000 /sec 
stress-ng: info:  [208659] skipped: 0
stress-ng: info:  [208659] passed: 32: cpu (16) sock (16)
stress-ng: info:  [208659] failed: 0
stress-ng: info:  [208659] metrics untrustworthy: 0
stress-ng: info:  [208659] successful run completed in 17.41 secs

Требуется расширить обёртку над stress-ng возможностью передать флаг perf и парсером данных метрик, чтобы их также собирать в БД.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Fields

    No fields configured for Task.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions