Ye it's possible. Create a Joomla Group with a ACL, Add users to this new group. Create a event with this ACL
Other thind, It will be, add user to this event and only this user can see the event. But, I think, it isn't necesary because the admin have added those users to new Joomla group.