Can I keep some public forms open while using SSO for internal forms?

Yes. By default, authentication is not required when you create a new form. You configure authentication settings on a per-form basis, so you can have both public forms and authenticated forms in the same organization.