tekeous@usenet.lol to Lemmy Shitpost@lemmy.world · 5 months agorobots.txt is a suggestionusenet.lolimagemessage-square25fedilinkarrow-up1621arrow-down13
arrow-up1618arrow-down1imagerobots.txt is a suggestionusenet.loltekeous@usenet.lol to Lemmy Shitpost@lemmy.world · 5 months agomessage-square25fedilink
minus-squareunalivejoy@lemm.eelinkfedilinkEnglisharrow-up5·5 months agoPeople really should be providing a sitemap.xml file
People really should be providing a sitemap.xml file