Yes, you can restrict some users from viewing all the categories by creating a new policy for them. In the new policy, enable the required categories and associate the policy with the preferred users. Once this is done, the users associated with the policy will be able to access only the categories that are enabled in that policy.
To configure this:
Once you have created a policy, you can assign the policy to the required users.