Add robots.txt and sitemap.xml

[lpsinger]

See remix-run/remix#2912 (reply in thread)

Test Plan

Checklist

• Tests updated
• Docs updated

Screenshots

[lpsinger]

I'm not sure what's going wrong when I run npm run dev:

$ npm run dev

> predev
> npm run build:icons --silent


> dev
> remix dev -c "node ./server/dev-server.js" --manual


 💿  remix dev

 info  building...
 info  built (8.4s)
6:30:10 PM [tsx] rerunning
Debugger listening on ws://127.0.0.1:9229/8911dd2a-b040-4bac-ac18-7207cb0b3a3c
For help, see: https://nodejs.org/en/docs/inspector
TypeError: Cannot read properties of undefined (reading 'startsWith')
TypeError: Cannot read properties of undefined (reading 'startsWith')
    at file:///Users/lpsinger/src/epic-stack/tests/mocks/github.ts:1:2646

[kentcdodds]

Thanks for this! I can fix the issue you're having. But I'm concerned about something else.

Also, we probably should add some documentation.

[kentcdodds]

Thanks a bunch! This is very useful!