Skip to content

Commit

Permalink
Update document/4-Web_Application_Security_Testing/12-API_Testing/01-…
Browse files Browse the repository at this point in the history 
…API_Reconnaissance.md

Co-authored-by: Rick M <[email protected]>
  • Loading branch information
@garthoid @kingthorin
garthoid and kingthorin authored Jul 23, 2024
1 parent fa3f9e3 commit e699cfe
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion ...ment/4-Web_Application_Security_Testing/12-API_Testing/01-API_Reconnaissance.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ If documentation is not readily apparent, then you can actively search the targe

### Robots.txt

The `robots.txt` file is a text file that site owners create to instruct web crawlers (such as search engine bots) on how to crawl and index their site. It is part of the Robots Exclusion Protocol (REP), which regulates how bots interact with sites.
`robots.txt` is a text file that site owners create to instruct web crawlers (such as search engine bots) on how to crawl and index their site. It is part of the Robots Exclusion Protocol (REP), which regulates how bots interact with sites.

This file may provide additional clues to path structure or API endpoints.

Expand Down

0 comments on commit e699cfe

Please sign in to comment.