Code

Add per-task metrics#56320

Code

Merged

kpamnany merged 56 commits intoJuliaLang:masterJuliaLang/julia:masterfrom RelationalAI:npr-pv-cpu-task-timerRelationalAI/julia:npr-pv-cpu-task-timerCopy head branch name to clipboardDec 6, 2024

+529-26

Commits

Commits on Dec 4, 2024

• basic task cpu time tracking

  

  vilterp

  authored and

  kpamnany

  committed
  85b89f4

  Copy full SHA for 85b89f4

• initialize to zero

  

  vilterp

  authored and

  kpamnany

  committed
  dad31b0

  Copy full SHA for dad31b0

• make new task field visible from Julia

  

  vilterp

  authored and

  kpamnany

  committed
  3802448

  Copy full SHA for 3802448

• add start time

  

  vilterp

  authored and

  kpamnany

  committed
  bbe8b29

  Copy full SHA for bbe8b29

• fix typo

  

  vilterp

  authored and

  kpamnany

  committed
  480b916

  Copy full SHA for 480b916

• add test

  

  vilterp

  authored and

  kpamnany

  committed
  be8c1a2

  Copy full SHA for be8c1a2

• add a wait

  

  vilterp

  authored and

  kpamnany

  committed
  ad8c184

  Copy full SHA for ad8c184

• import LinearAlgebra for peakflops

  

  vilterp

  authored and

  kpamnany

  committed
  e37004a

  Copy full SHA for e37004a

• update last scheduled on task finish as well

  

  vilterp

  authored and

  kpamnany

  committed
  6e4fd27

  Copy full SHA for 6e4fd27

• no need to update last scheduled in finish

  

  vilterp

  authored and

  kpamnany

  committed
  8721245

  Copy full SHA for 8721245

• add test

  

  vilterp

  authored and

  kpamnany

  committed
  a2c98fa

  Copy full SHA for a2c98fa

• fix test

  

  vilterp

  authored and

  kpamnany

  committed
  c5562d7

  Copy full SHA for c5562d7

• Add per-task wall-time

  

  nickrobinson251

  authored and

  kpamnany

  committed
  9685032

  Copy full SHA for 9685032

• Test individual task cpu_time less than wall_time

  

  nickrobinson251

  authored and

  kpamnany

  committed
  fa4f0e8

  Copy full SHA for fa4f0e8

• More tests

  

  nickrobinson251

  authored and

  kpamnany

  committed
  89f8239

  Copy full SHA for 89f8239

• Move task timings mostly to julia

  

  nickrobinson251

  authored and

  kpamnany

  committed
  6b0855e

  Copy full SHA for 6b0855e

• Record cpu time on entrance to wait/yield

  

  nickrobinson251

  authored and

  kpamnany

  committed
  5e7e385

  Copy full SHA for 5e7e385

• Rename 'scheduled_at' -> '[en/de]queued_at'

  

  nickrobinson251

  authored and

  kpamnany

  committed
  182c1a5

  Copy full SHA for 182c1a5

• Ability to enable/disable task timings globally

  

  nickrobinson251

  authored and

  kpamnany

  committed
  b60f3c4

  Copy full SHA for b60f3c4

• fixup whitespace

  

  nickrobinson251

  authored and

  kpamnany

  committed
  7e871e2

  Copy full SHA for 7e871e2

• Enable task timing in test

  

  nickrobinson251

  authored and

  kpamnany

  committed
  523d936

  Copy full SHA for 523d936

• Enable task timing for root task

  

  nickrobinson251

  authored and

  kpamnany

  committed
  2c7aa36

  Copy full SHA for 2c7aa36

• Prevent task_timing(false) decrementing below zero

  

  nickrobinson251

  authored and

  kpamnany

  committed
  70c56b5

  Copy full SHA for 70c56b5

• Change task-timing flag to require yes/no arg

  

  nickrobinson251

  authored and

  kpamnany

  committed
  1b60b9f

  Copy full SHA for 1b60b9f

• Rename timings->metrics, dequeued->started_running

  

  nickrobinson251

  authored and

  kpamnany

  committed
  81cd488

  Copy full SHA for 81cd488

• Update task-state-transition comments

  

  nickrobinson251

  authored and

  kpamnany

  committed
  a42d524

  Copy full SHA for a42d524

• Remove unused debug function

  

  nickrobinson251

  authored and

  kpamnany

  committed
  9b35821

  Copy full SHA for 9b35821

• Add NEWS

  

  nickrobinson251

  authored and

  kpamnany

  committed
  8fcc685

  Copy full SHA for 8fcc685

• Add fallback recording of cpu time in wait()

  

  nickrobinson251

  authored and

  kpamnany

  committed
  6e248ef

  Copy full SHA for 6e248ef

• Instrument async io

  

  nickrobinson251

  authored and

  kpamnany

  committed
  8b0d493

  Copy full SHA for 8b0d493

• Record task cpu time in wait()

  

  nickrobinson251

  authored and

  kpamnany

  committed
  81edb59

  Copy full SHA for 81edb59

• fixup! Record task cpu time in wait()

  

  nickrobinson251

  authored and

  kpamnany

  committed
  0863ab0

  Copy full SHA for 0863ab0

• fixup! Change task-timing flag to require yes/no arg

  

  nickrobinson251

  authored and

  kpamnany

  committed
  ea1a6f4

  Copy full SHA for ea1a6f4

• Make task metrics flag const and counters atomic

  

  nickrobinson251

  authored and

  kpamnany

  committed
  a6724d3

  Copy full SHA for a6724d3

• Mark the new APIs experimental

  

  nickrobinson251

  authored and

  kpamnany

  committed
  e9e1e65

  Copy full SHA for e9e1e65

• Return task metrics as Int or nothing if disabled

  

  nickrobinson251

  authored and

  kpamnany

  committed
  6c57fd7

  Copy full SHA for 6c57fd7

• Test metrics updating as expected

  

  nickrobinson251

  authored and

  kpamnany

  committed
  7167d87

  Copy full SHA for 7167d87

• fixup! Make task metrics flag const and counters atomic

  

  nickrobinson251

  authored and

  kpamnany

  committed
  6bdb7a8

  Copy full SHA for 6bdb7a8

• More tests

  

  nickrobinson251

  authored and

  kpamnany

  committed
  dae7627

  Copy full SHA for dae7627

• Update test/core.jl

  

  nickrobinson251

  authored and

  kpamnany

  committed
  f5b55f2

  Copy full SHA for f5b55f2

• Introduce current_task_*_time_ns for non-racy continuous metrics

  Show description for 2532e24
  

  nickrobinson251

  authored and

  kpamnany

  committed
  2532e24

  Copy full SHA for 2532e24

• Consolidate names again

  

  nickrobinson251

  authored and

  kpamnany

  committed
  3be2365

  Copy full SHA for 3be2365

• Update CPU time on finish before setting task done

  

  nickrobinson251

  authored and

  kpamnany

  committed
  f8a0185

  Copy full SHA for f8a0185

• Remove TODO comment

  

  nickrobinson251

  authored and

  kpamnany

  committed
  8475671

  Copy full SHA for 8475671

• Add new functions to docs

  

  nickrobinson251

  authored and

  kpamnany

  committed
  bdfff79

  Copy full SHA for bdfff79

• fixup! Add new functions to docs

  

  nickrobinson251

  authored and

  kpamnany

  committed
  51ca0cb

  Copy full SHA for 51ca0cb

• Return UInt64 instead of Int

  kpamnany

  committed
  6bf9aa9

  Copy full SHA for 6bf9aa9

• Always return a UInt64 type (even when returning 0)

  kpamnany

  committed
  8fbe1ff

  Copy full SHA for 8fbe1ff

• Convert task timestamps to UInt32 delta-times since system boot.

  

  NHDaly

  authored and

  kpamnany

  committed
  4be17af

  Copy full SHA for 4be17af

• Update base/task.jl

  Show description for 8d1cde7
  

  2 peopleauthored and

  kpamnany

  committed
  8d1cde7

  Copy full SHA for 8d1cde7

• Revert "Convert task timestamps to UInt32 delta-times since system boot."

  Show description for f817369
  

  NHDaly

  authored and

  kpamnany

  committed
  f817369

  Copy full SHA for f817369

• Try adding alignas(8) to force correct alignment and work around GCC bug

  

  NHDaly

  authored and

  kpamnany

  committed
  36f85f3

  Copy full SHA for 36f85f3

• Revert "Try adding alignas(8) to force correct alignment and work around GCC bug"

  Show description for 6871b73
  kpamnany

  committed
  6871b73

  Copy full SHA for 6871b73

• Reorder task structure and add padding

  Show description for 788f46f
  kpamnany

  committed
  788f46f

  Copy full SHA for 788f46f

• More changes of task_cpu_time_ns to task_running_time_ns

  kpamnany

  committed
  e02c830

  Copy full SHA for e02c830

• Move calls to record_running_time!

  Show description for 18ee519
  kpamnany

  committed
  18ee519

  Copy full SHA for 18ee519