I added my “Contextual Feed Widget” plugin to the WordPress Plugin Directory. Now you can easily add it to your own website.
Contextual Feed Widget (and I’m open to suggestions for a better name) will display a list of feed links that are appropriate for the page that’s currently open. For example, you’ll see a link to a category feed when viewing a category. I developed it for johnridesa.bike, and you can see it active on almost every page here (including this page).
It’s a simple plugin and I doubt anyone will have much of a problem using it. If you do have any issues or feature suggestions, you can browse the code or submit an issue on the GitHub repository, which is where I do most of my development.