I don't believe this is possible. Like you mentioned, a more granular RBAC may be needed. It may be a good idea to post it on our Ideas section of the forums. There is one asking about granular RBAC around instance actions, it is a different topic but RBAC is being asked for other features: