Skip to content

Commit

Permalink
Merge pull request #72 from jrdnbradford/fix-ci-and-badges
Browse files Browse the repository at this point in the history
Remove old CI configs and fix badges
  • Loading branch information
pedrobtz authored Aug 24, 2024
2 parents dd5bf96 + 6de2118 commit 665ba8b
Show file tree
Hide file tree
Showing 5 changed files with 47 additions and 92 deletions.
28 changes: 0 additions & 28 deletions .travis.yml

This file was deleted.

18 changes: 8 additions & 10 deletions README.Rmd
Original file line number Diff line number Diff line change
Expand Up @@ -47,17 +47,15 @@ length.cpp <- length(grep("(^\\s*$)|(^\\s*#)|(^\\s*//)", lines.cpp, value = T

*lines of R code:* `r length.R`, *lines of test code:* `r length.tests`

[![Project Status: Active – The project has reached a stable, usable state and is being actively developed.](https://www.repostatus.org/badges/latest/active.svg)](https://www.repostatus.org/)
[![](https://badges.ropensci.org/25_status.svg)](https://github.com/ropensci/software-review/issues/25)
<a href="https://travis-ci.org/ropensci/robotstxt"><img src="https://api.travis-ci.org/ropensci/robotstxt.svg?branch=master"><a/>
<a href="https://cran.r-project.org/package=robotstxt"><img src="http://www.r-pkg.org/badges/version/robotstxt"></a>
[![cran checks](https://cranchecks.info/badges/summary/reshape)](https://cran.r-project.org/web/checks/check_results_reshape.html)
<a href="https://codecov.io/gh/ropensci/robotstxt"><img src="https://codecov.io/gh/ropensci/robotstxt/branch/master/graph/badge.svg" alt="Codecov" /></a>
<img src="http://cranlogs.r-pkg.org/badges/grand-total/robotstxt">
<img src="http://cranlogs.r-pkg.org/badges/robotstxt">



<!-- badges: start -->
[![R-CMD-check](https://github.com/ropensci/robotstxt/actions/workflows/R-CMD-check.yaml/badge.svg)](https://github.com/ropensci/robotstxt/actions/workflows/R-CMD-check.yaml)
[![Peer Reviewed](https://badges.ropensci.org/25_status.svg)](https://github.com/ropensci/software-review/issues/25)
[![Monthly Downloads](https://cranlogs.r-pkg.org/badges/robotstxt)](https://cran.r-project.org/web/packages/robotstxt/index.html)
[![Total Downloads](https://cranlogs.r-pkg.org/badges/grand-total/robotstxt)](https://cran.r-project.org/web/packages/robotstxt/index.html)
[![Cran Checks](https://badges.cranchecks.info/summary/robotstxt.svg)](https://cran.r-project.org/web/checks/check_results_robotstxt.html)
[![Lifecycle: Stable](https://img.shields.io/badge/lifecycle-stable-brightgreen.svg)](https://lifecycle.r-lib.org/articles/stages.html#stable)
<!-- badges: end -->


**Development version**
Expand Down
61 changes: 39 additions & 22 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,27 +1,32 @@

## A ‘robots.txt’ Parser and ‘Webbot’/‘Spider’/‘Crawler’ Permissions Checker
## A ‘robots.txt’ Parser and ‘Webbot’/‘Spider’/‘Crawler’

Permissions Checker

[![ropensci\_footer](https://raw.githubusercontent.com/ropensci/robotstxt/master/logo/github_footer.png)](https://ropensci.org)

**Status**

*lines of R code:* 1007, *lines of test code:* 1758

[![Project Status: Active – The project has reached a stable, usable
state and is being actively
developed.](https://www.repostatus.org/badges/latest/active.svg)](https://www.repostatus.org/)
[![](https://badges.ropensci.org/25_status.svg)](https://github.com/ropensci/software-review/issues/25)
<a href="https://travis-ci.org/ropensci/robotstxt"><img src="https://api.travis-ci.org/ropensci/robotstxt.svg?branch=master"><a/>
<a href="https://cran.r-project.org/package=robotstxt"><img src="http://www.r-pkg.org/badges/version/robotstxt"></a>
[![cran
checks](https://cranchecks.info/badges/summary/reshape)](https://cran.r-project.org/web/checks/check_results_reshape.html)
<a href="https://codecov.io/gh/ropensci/robotstxt"><img src="https://codecov.io/gh/ropensci/robotstxt/branch/master/graph/badge.svg" alt="Codecov" /></a>
<img src="http://cranlogs.r-pkg.org/badges/grand-total/robotstxt">
<img src="http://cranlogs.r-pkg.org/badges/robotstxt">
<!-- badges: start -->

[![R-CMD-check](https://github.com/ropensci/robotstxt/actions/workflows/R-CMD-check.yaml/badge.svg)](https://github.com/ropensci/robotstxt/actions/workflows/R-CMD-check.yaml)
[![Peer
Reviewed](https://badges.ropensci.org/25_status.svg)](https://github.com/ropensci/software-review/issues/25)
[![Monthly
Downloads](https://cranlogs.r-pkg.org/badges/robotstxt)](https://cran.r-project.org/web/packages/robotstxt/index.html)
[![Total
Downloads](https://cranlogs.r-pkg.org/badges/grand-total/robotstxt)](https://cran.r-project.org/web/packages/robotstxt/index.html)
[![Cran
Checks](https://badges.cranchecks.info/summary/robotstxt.svg)](https://cran.r-project.org/web/checks/check_results_robotstxt.html)
[![Lifecycle:
Stable](https://img.shields.io/badge/lifecycle-stable-brightgreen.svg)](https://lifecycle.r-lib.org/articles/stages.html#stable)
<!-- badges: end -->

**Development version**

0.7.13 - 2020-08-19 / 20:39:24
0.7.13 - 2024-08-19 / 23:13:05

**Description**

Expand Down Expand Up @@ -122,6 +127,9 @@ paths_allowed(
)
## wikipedia.org
## [1] TRUE FALSE
```

``` r

paths_allowed(
paths = c(
Expand Down Expand Up @@ -504,6 +512,9 @@ rt <-

as.character(rt)
## [1] "# just do it - punk\n"
```

``` r

cat(rt)
## # just do it - punk
Expand All @@ -514,7 +525,7 @@ The last HTTP request is stored in an object
``` r
rt_last_http$request
## Response [https://petermeissner.de/robots.txt]
## Date: 2020-09-03 19:05
## Date: 2024-08-19 23:48
## Status: 200
## Content-Type: text/plain
## Size: 20 B
Expand Down Expand Up @@ -556,7 +567,7 @@ was going on in the client-server exchange.
``` r
attr(rt, "request")
## Response [https://petermeissner.de/robots.txt]
## Date: 2020-09-03 19:05
## Date: 2024-08-19 23:48
## Status: 200
## Content-Type: text/plain
## Size: 20 B
Expand Down Expand Up @@ -588,12 +599,15 @@ rt_req$request
## GET http://petermeissner.de/robots.txt
## Output: write_memory
## Options:
## * useragent: libcurl/7.64.1 r-curl/4.3 httr/1.4.1
## * useragent: libcurl/7.81.0 r-curl/5.2.1 httr/1.4.7
## * ssl_verifypeer: 1
## * httpget: TRUE
## Headers:
## * Accept: application/json, text/xml, application/xml, */*
## * user-agent: R version 3.6.3 (2020-02-29)
## * user-agent: R version 4.4.1 (2024-06-14)
```

``` r

# response headers
rt_req$all_headers
Expand All @@ -609,7 +623,7 @@ rt_req$all_headers
## [1] "nginx/1.10.3 (Ubuntu)"
##
## $date
## [1] "Thu, 03 Sep 2020 19:05:45 GMT"
## [1] "Mon, 19 Aug 2024 23:48:37 GMT"
##
## $`content-type`
## [1] "text/html"
Expand Down Expand Up @@ -639,7 +653,7 @@ rt_req$all_headers
## [1] "nginx/1.10.3 (Ubuntu)"
##
## $date
## [1] "Thu, 03 Sep 2020 19:05:45 GMT"
## [1] "Mon, 19 Aug 2024 23:48:38 GMT"
##
## $`content-type`
## [1] "text/plain"
Expand All @@ -648,13 +662,13 @@ rt_req$all_headers
## [1] "20"
##
## $`last-modified`
## [1] "Thu, 03 Sep 2020 15:33:01 GMT"
## [1] "Wed, 07 Dec 2022 13:34:14 GMT"
##
## $connection
## [1] "keep-alive"
##
## $etag
## [1] "\"5f510cad-14\""
## [1] "\"63909656-14\""
##
## $`accept-ranges`
## [1] "bytes"
Expand Down Expand Up @@ -698,7 +712,7 @@ as.list(rt)
##
## $request
## Response [https://petermeissner.de/robots.txt]
## Date: 2020-09-03 19:05
## Date: 2024-08-19 23:48
## Status: 200
## Content-Type: text/plain
## Size: 20 B
Expand All @@ -716,6 +730,9 @@ the robots.txt file.
paths_allowed("petermeissner.de/I_want_to_scrape_this_now", force = TRUE, verbose = TRUE)
## petermeissner.de rt_robotstxt_http_getter: force http get
## [1] TRUE
```

``` r
paths_allowed("petermeissner.de/I_want_to_scrape_this_now",verbose = TRUE)
## petermeissner.de rt_robotstxt_http_getter: cached http get
## [1] TRUE
Expand Down
31 changes: 0 additions & 31 deletions _old_.travis.yml

This file was deleted.

1 change: 0 additions & 1 deletion codecov.yml

This file was deleted.

0 comments on commit 665ba8b

Please sign in to comment.