rtkit and pipewire - RTKit error: org.freedesktop.DBus.Error.AccessDenied

With the default configs, pipewire and wireplumber fails to use rtkit to set nice -11

[W][00243.776790] mod.rtkit    | [  module-rtkit.c:  205 translate_error()] RTKit error: org.freedesktop.DBus.Error.AccessDenied
[W][00243.776993] mod.rtkit    | [  module-rtkit.c:  465 set_nice()] could not set nice-level to -11: Permission denied
[W][00243.876874] mod.rtkit    | [  module-rtkit.c:  205 translate_error()] RTKit error: org.freedesktop.DBus.Error.AccessDenied
[W][00243.877008] mod.rtkit    | [  module-rtkit.c:  625 impl_acquire_rt()] could not make thread realtime: Permission denied
[W][00243.895522] mod.rtkit    | [  module-rtkit.c:  205 translate_error()] RTKit error: org.freedesktop.DBus.Error.AccessDenied
[W][00243.895684] mod.rtkit    | [  module-rtkit.c:  465 set_nice()] could not set nice-level to -11: Permission denied
M 09:43:41.326985          mod.rtkit ../src/modules/module-rtkit.c:205:translate_error: RTKit error: org.freedesktop.DBus.Error.AccessDenied
M 09:43:41.327286          mod.rtkit ../src/modules/module-rtkit.c:465:set_nice: could not set nice-level to -11: Permission denied

related: https://gitlab.freedesktop.org/pipewire/pipewire/-/issues/1069