Private comments are only visible to Administrators and Service Agent Users. Notifications for private comments are only sent to the 'current' incident assignee.
In the comment thread, comments that are "Private" will be denoted by an orange "Private" label, as seen below.
Public comments are visible to any User that has access to the ticket in question. Notifications for public comments are sent according to how your notification settings (Setup > Notifications) are set.