Hi pierreh,
Yes, anyone with access to your public key can use the use that key technically (if you don't set up CORS), but that's why we allow you to set allowed origins on your public keys.
You can create a new public key here and set the allowed origin to only your webapp: