Need a dynamic robots.txt file, but the only component available doesn’t fit the box when it comes to multilanguage webstie?
Would using the builder an option? If so, any hint from where I could start looking on how to write file?
Have found some examples for a sitemap, but non necessarily sure it applies.
Any hint is welcome.
robots.txt is a simple text-file, so you can use just robots.txt.erb template and do whatever you need to. Just out of curiosity – what exactly dynamic do you need to do in this file? Are you sure this is not a sitemap thing?
That’s a very good point @komor72.
I was so focused on thinking how to get this stuff done with the extensions and settings available in the config.rb that I didn’t think to the most easy solution.
robots.txt is fast and simple, here’s the detail article of Create a robots.txt file, hopes that help.