287 Commits

Author SHA1 Message Date
Ingo Oppermann
1d7fd960d5
Merge branch 'dev' into vod 2023-04-28 18:10:24 +02:00
Ingo Oppermann
74110dae54
Fix possible infinite loop with HLS session rewriter 2023-04-28 17:38:36 +02:00
Ingo Oppermann
f6d1cbbec2
WIP: release CPU throttling stepwise 2023-04-28 16:46:59 +02:00
Ingo Oppermann
74f98e8c7e
Define system CPU resources in percent 0-100, acquiring resources check with available system resources 2023-04-28 10:27:33 +02:00
Ingo Oppermann
7527f7833b
Add resource manager 2023-04-27 17:02:20 +02:00
Ingo Oppermann
b723f4e5fd
Propagate number of logical CPUs in resource usage 2023-04-27 10:58:41 +02:00
Ingo Oppermann
c9bdaae7f7
Call onExit if cmd.Start() fails 2023-04-26 22:17:08 +02:00
Ingo Oppermann
5e2060f785
WIP: add resource manager 2023-04-26 22:05:46 +02:00
Ingo Oppermann
1e35d29371
Fix tests 2023-04-26 16:12:41 +02:00
Ingo Oppermann
d59158de03
Allow hard and soft limiting a process
A hard limit will kill the process as soon as either CPU or memory
consumption are above a defined limit for a certain amount of time.

A soft limit will throttle the CPU usage if above a defined limit and
kill the process if memory consumption is above a defined limit. The
soft limit can be enabled/disabled on demand.

The default is hard limit.
2023-04-26 16:01:50 +02:00
Ingo Oppermann
d73d915e89
Update changelog 2023-04-26 10:17:19 +02:00
Ingo Oppermann
0c497f4ea5
Merge branch 'dev' into vod 2023-04-26 10:08:18 +02:00
Ingo Oppermann
e45f80ed42
Fix tests 2023-04-26 09:50:09 +02:00
Ingo Oppermann
a2dab2682f
Fix not propagating process limits 2023-04-26 09:49:28 +02:00
Ingo Oppermann
2f9a997a8d
Add test for process limits 2023-04-25 21:59:22 +02:00
Ingo Oppermann
9b17ab2b29
Add global limits in config, fix not using process limits 2023-04-25 21:49:55 +02:00
Ingo Oppermann
74f582e4b4
Remove debug output 2023-04-25 16:25:21 +02:00
Ingo Oppermann
b70382c40b
Expose resource usage in process state 2023-04-25 16:20:59 +02:00
Ingo Oppermann
e849d325bd
Merge branch 'dev' of github.com:datarhei/core into dev 2023-04-25 15:57:28 +02:00
Ingo Oppermann
9b6354ab94
Revert commit b58cc8a7ee9fab3fd407fcdf477a52b8a3496062 2023-04-25 15:57:17 +02:00
Ingo Oppermann
3a1825cf61
Expose resource usage in report history 2023-04-25 15:55:32 +02:00
Jan Stabenow
bea10cb114
Mod bumps FFmpeg to v5.1.3 2023-04-25 13:56:21 +02:00
Ingo Oppermann
3e7e5d5c9c
Merge branch 'dev' into vod 2023-04-24 16:14:32 +02:00
Ingo Oppermann
b58cc8a7ee
Fix race condition 2023-04-24 16:09:01 +02:00
Ingo Oppermann
061542645c
Fix test 2023-04-24 12:28:42 +02:00
Ingo Oppermann
c1bbb4065c
Merge branch 'dev' into vod 2023-04-24 12:16:52 +02:00
Ingo Oppermann
b3696f492d
Update changelog 2023-04-24 12:10:40 +02:00
Ingo Oppermann
317d6eb4d9
Add updated_at field in process infos 2023-04-24 12:05:01 +02:00
Ingo Oppermann
6ddd58a124
Preserve process log history when updating a process 2023-04-24 11:59:09 +02:00
Ingo Oppermann
2b1459c5e8
Fix test 2023-04-17 15:24:39 +02:00
Ingo Oppermann
78686c81f4
Fix keeping matches in the report history 2023-04-17 15:03:25 +02:00
Ingo Oppermann
76abf5474f
Fix compilation error 2023-04-13 15:43:59 +02:00
Ingo Oppermann
5d9db55032
Merge branch 'dev' into vod 2023-04-13 15:23:09 +02:00
Ingo Oppermann
d807becc8a
Add support for input framerate data from jsonstats patch 2023-04-13 15:22:33 +02:00
Ingo Oppermann
a1682b7aa4
Fix parsing S3 storage definition from environment variable 2023-04-13 12:19:20 +02:00
Ingo Oppermann
8326160b28
Add option to set GOMAXPROCS automatically
Use the debug.auto_max_procs config value or the CORE_DEBUG_AUTO_MAX_PROCS
environment variable. Set it to "true" to enable this feature.
2023-04-11 17:12:01 +02:00
Ingo Oppermann
8c3fd4dc17
Merge branch 'dev' into vod 2023-04-11 16:39:30 +02:00
Ingo Oppermann
aef1b7c9a2
Fix #10 2023-04-11 15:04:31 +02:00
Ingo Oppermann
0e73a0fdf3
Clarify metric descriptions 2023-04-11 14:52:27 +02:00
Ingo Oppermann
0bd68d6dc3
Fix debug.force_gc behaviour 2023-04-11 11:08:11 +02:00
Ingo Oppermann
b96672e308
Forward keyframe and extradata_bytes counter to API 2023-04-11 08:59:24 +02:00
Ingo Oppermann
507b4f4b9a
Merge branch 'dev' into vod 2023-04-11 08:29:39 +02:00
Ingo Oppermann
2c5f32fb26
Remove bytes.Buffer pool for memfs in order to be less a memory hog 2023-04-06 21:43:18 +02:00
Ingo Oppermann
d2e5720fa2
Fix limiting part sizes for S3 upload 2023-04-06 12:06:50 +02:00
Ingo Oppermann
98c561554d
Fix S3 storage parsing from environment variable 2023-04-05 14:43:45 +02:00
Ingo Oppermann
51cbb8e74e
Fix assembling return value for filtered report history 2023-04-05 13:58:41 +02:00
Ingo Oppermann
7372b3210d
Fix test 2023-04-05 12:21:19 +02:00
Ingo Oppermann
ec4607aec8
Fix process report selection 2023-04-05 12:01:21 +02:00
Ingo Oppermann
508d82d579
Fix high memory consumption when copying files to S3 2023-04-05 10:30:17 +02:00
Ingo Oppermann
7e9e6fce8d
Add number of keyframes and extradata size to process progress data 2023-04-04 20:44:57 +02:00