Yes, that is possible.
On desktop, go to "Event Settings" in the left-side menu → "Moderation" ("Settings"→ "Moderation" on mobile). You will find the option "Disable Guests Download." Simply toggle the button to enable it.
This will hide the download button on the album page, preventing guests from downloading photos and videos.
Note: This feature is available only with the Pro Plan.