Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiple runs of osrm-partition lead to OOM kills #4214

Closed
oxidase opened this issue Jun 29, 2017 · 6 comments
Closed

Multiple runs of osrm-partition lead to OOM kills #4214

oxidase opened this issue Jun 29, 2017 · 6 comments

Comments

@oxidase
Copy link
Contributor

oxidase commented Jun 29, 2017

With the current master running osrm-partition on the already partitioned graph leads to incorrect behavior:

Rerunning osrm-extract solves the issue.

@TheMarex Could it be a regression after #4089 or it is expected and osrm-extract run is required before osrm-partition?

@TheMarex
Copy link
Member

Seems like a regression. We probably don't renumber one of the input files of osrm-partition that references the NBG ids we re-write.

@miccolis
Copy link
Contributor

miccolis commented Oct 2, 2017

I'm pretty sure this was resolved. @oxidase please re-open if there is anything still to do here.

@miccolis miccolis closed this as completed Oct 2, 2017
@oxidase
Copy link
Contributor Author

oxidase commented Oct 2, 2017

@miccolis it is still an issue. To reproduce

./osrm-extract -p ../profiles/car.lua bayern-latest.osm.pbf && \
./osrm-partition bayern-latest.osrm && \
./osrm-partition bayern-latest.osrm && \
./osrm-customize bayern-latest.osrm && \
./osrm-routed bayern-latest.osrm

...
[error] [exception] std::bad_alloc
[error] Please provide more memory or consider using a larger swapfile

@oxidase oxidase reopened this Oct 2, 2017
@deniskoronchik
Copy link
Contributor

deniskoronchik commented Oct 9, 2017

@oxidase in current master i got:

./osrm-extract -p ../profiles/car.lua bayern-latest.osm.pbf
./osrm-partition bayern-latest.osrm 
./osrm-partition bayern-latest.osrm 
./osrm-customize bayern-latest.osrm
[info] Loaded edge based graph: 10356818 edges, 2795182 nodes
[info] Loading partition data took 28.0876 seconds
Segmentation fault (core dumped)

Compiled in Debug mode.

update: Crashed there https://github.com/Project-OSRM/osrm-backend/blob/master/include/customizer/cell_customizer.hpp#L85

@oxidase
Copy link
Contributor Author

oxidase commented Oct 9, 2017

@deniskoronchik it is expected, there is an issue with the second renumbering in osrm-partition

@deniskoronchik deniskoronchik mentioned this issue Oct 12, 2017
2 tasks
TheMarex pushed a commit that referenced this issue Oct 12, 2017
oxidase added a commit that referenced this issue Oct 12, 2017
@oxidase
Copy link
Contributor Author

oxidase commented Oct 13, 2017

Fixed via #4602

@oxidase oxidase closed this as completed Oct 13, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants