Honestly the cleanest no-hassle method for public accounts is just using a story viewer website. You do not need an account, you just drop in the username and it pulls whatever stories are live.
Sites like StorySaver or InstaNavigation work fine for this. They are not sketchy if you stick to the well-known ones. Just do not download anything they try to push on you. 