Because invites do not have RoomMembers because we don't have an m.room.member event for them, just a user ID, and we want to detect conf users at invite time.
Removed Modulator stuff.