Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rapid roads dataset is not loading #1584

Open
bos opened this issue Oct 12, 2024 · 20 comments
Open

Rapid roads dataset is not loading #1584

bos opened this issue Oct 12, 2024 · 20 comments
Assignees
Labels
data-roads Issue or request related to a road data source feature-internal Issue or request related to our internal services or data teams

Comments

@bos
Copy link

bos commented Oct 12, 2024

Description

Inferred roads are not showing up in my client. I assume this is due to a server outage, but I have no idea how to figure this out, or what the best way to report is.

Screenshots

No response

Version

2.4.0

What browser are you seeing the problem on? What version are you running?

No response

The OS you're using

No response

Steps to reproduce

Visit Rapid.
No purple road bits.

The browser URL at the time you encountered the bug

https://rapideditor.org/edit#map=17.00/39.20809/-114.77681&background=EsriWorldImagery&datasets=fbRoads,msBuildings&disable_features=indoor,power

The auto-detected useragent string for your browser (leave blank if you're manually filling this form out)

No response

@Bonkles
Copy link
Contributor

Bonkles commented Oct 15, 2024

Hey @bos! I can't personally repro this, as I've tried it on a couple of different OS/browser combos and all seems well.

I checked into the specific area you linked here (thanks for supplying the URL) and checked the back-end calls that we're making to obtain roads- they all succeeded, but all came up empty.

So, it would seem that the case is there's simply no data around here- but have you seen this other places as well? Specifically, have you seen it in some places before where now you're not getting any road shapes at all?

@Bonkles
Copy link
Contributor

Bonkles commented Oct 15, 2024

If you have time, can you go here and let me know if you get some buildings?

https://rapideditor.org/edit#map=17.60/44.51266/-99.99054&background=Bing&datasets=fbRoads,msBuildings&disable_features=boundaries

Here's what I see at this location:
image

@Scott169
Copy link

Scott169 commented Oct 16, 2024

I met the same problem today. Here's an example area, the residential roads should be inferred:

image

By the way, when uploading the changeset, "mapwithai" and "maxar" tags are not automatically added as usual:

image

Version

2.4.0

What browser are you seeing the problem on? What version are you running?

Firefox ESR 128.3.1

The OS you're using

Windows 10

@Bonkles
Copy link
Contributor

Bonkles commented Oct 16, 2024

@Scott169 can you provide a URL of where you took that screenshot? That will better let me figure out if this is a server issue or not.

If you're not able to load the Rapid roads/building features, then you won't get the 'mapwithai' and 'maxar' tags on your changeset- those won't be added until you have added at least one road/building.

@pieleric
Copy link

@Bonkles, I am facing the same issue too: no road shown, anywhere in the world. The buildings show up fine (including the location you've suggested in comment #1584 (comment) ).

One area I know that used to show roads is this one:
https://rapideditor.org/rapid#map=16.43/33.20938/107.54420&background=EsriWorldImagery&datasets=fbRoads,msBuildings

Now it looks like:
image

@Bonkles
Copy link
Contributor

Bonkles commented Oct 16, 2024

I see, This is interesting then and more subtle than I had originally thought. So the service is displaying some features (buildings) and not others (roads), yet the roads requests are returning as 'successful' but empty. Generally when we see outages such as this, it's because the service has completely stopped working. I'll dig into this.

@KataJing
Copy link

Also met the same issue from about one week ago. Cannot see any roads including above hyperlinks.
Seems something happen in source. I am also a mapwithai of JOSM user. The similar issue occurred, it showed server cannot connect.

@Bonkles
Copy link
Contributor

Bonkles commented Oct 17, 2024

Can confirm that one of our internal DBs has been impacted, causing the loss of our ability to serve roads. I'm working on repairing the infra, but no ETA yet on how long this will take.

Thank you all for the bug reports!

@bhousel bhousel assigned bhousel and Bonkles and unassigned bhousel Oct 17, 2024
@bhousel bhousel added data-roads Issue or request related to a road data source feature-internal Issue or request related to our internal services or data teams labels Oct 17, 2024
@bhousel bhousel changed the title Rapid servers may be down, don't know how to verify Rapid roads dataset is not loading Oct 18, 2024
@jjiglesiasg
Copy link

Seems that this issue is more complex that originally thought. Not pushing, just good vibes so yo can deal with this somehow nightmare.

@Bonkles
Copy link
Contributor

Bonkles commented Oct 24, 2024

Yep, this one is proving tricky. Plus, one of the folks that can help us resolve the issue has been out sick for several days. Really unlucky timing, but still working on it.

@bos
Copy link
Author

bos commented Nov 4, 2024

How's restoring the db coming along?

@Bonkles
Copy link
Contributor

Bonkles commented Nov 4, 2024

Not well, unfortunately. We have all the piece-parts we need to get the data flowing again, but there are a lot of gotchas to 'standing an existing DB scrape back up' vs. 'starting one from scratch'. We're just doing tons of waiting for assistance from internal infra groups, as we're a bit of an outlier case (in that we ship our data to a public endpoint).

Super frustrating and I wish it were going faster, but I'm still on this pushing on this as hard as I can each day.

@bos
Copy link
Author

bos commented Nov 4, 2024

Thanks Ben, appreciate the persistence.

@Bonkles
Copy link
Contributor

Bonkles commented Nov 7, 2024

Update- we've had a couple nice breakthroughs with the data pipeline and the roads data is once again landing in a database from which we can serve. Next step is to migrate all the code references from the old, defunct database to this new one, test the changes in staging, and then roll out to production. Could be a few more days, but I'm on much firmer ground as to how to proceed from here.

Thanks all for your patience!

@bos
Copy link
Author

bos commented Nov 8, 2024

That's great news! Mapping in the old school way, without these features, is certainly fun and calming, but it's soooo sloooow in comparison.

@bos
Copy link
Author

bos commented Nov 8, 2024

I just now am seeing inferred roads show up!

@Bonkles
Copy link
Contributor

Bonkles commented Nov 8, 2024

Woohoo, I was hoping they'd start flowing by end-of-day, then I would make a triumphant post letting y'all know. So I guess this is that post. :-)

@Scott169
Copy link

Scott169 commented Nov 8, 2024

I saw the inferred roads. Confirmed that this issue is solved. Thanks a lot for your work.

@jjiglesiasg
Copy link

Looks like inferred roads are back. Reporting from #Bolivia. Congrats guys nice job to restore all these data.

Best Regards

@jjiglesiasg
Copy link

That's great news! Mapping in the old school way, without these features, is certainly fun and calming, but it's soooo sloooow in comparison.

True, but even without the inferred data, I feel that Rapid is like an ID on steroids, in particular in Power User mode

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data-roads Issue or request related to a road data source feature-internal Issue or request related to our internal services or data teams
Projects
None yet
Development

No branches or pull requests

7 participants