-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
cannot generate PLOS ALM Report for large article collections #150
Comments
Strange. I'd be happy to look at this over the weekend, if you can get me (@jenniferlin15) a step by step reproduction and (@mfenner) the actual exception from the logs. |
Thanks, @jure! To replicate:
I've replicated this when I add any 2000 articles or 1000 articles into the basket and click on Preview List. This also occurs if I'm logged in and I directly click on View Report through the options once I hover over my user name (blue bar with the article count display). No matter what articles I add (age, publication, etc.), I always encounter this error when adding large numbers into the report. |
Thanks for the description, @jenniferlin15. @mfenner, could you provide a backtrace for this error, when time allows? |
Hi, @jure. Martin sent log file via email (github won't upload). Here's the copy paste... pardon the mess. Easier to refer to the log file attached in his message. ActionController::RoutingError (No route matches [POST] "/search/trackback"): I, [2015-04-10T08:28:54.606826 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 08:28:54 -0700 I, [2015-04-10T08:34:10.999594 #29968] INFO -- : Started GET "/add-articles?current_page=433" for 144.76.185.173 at 2015-04-10 08:34:10 -0700 I, [2015-04-10T09:14:50.343612 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:14:50 -0700 I, [2015-04-10T09:14:50.424914 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:14:50 -0700 I, [2015-04-10T09:14:51.489530 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:14:51 -0700 I, [2015-04-10T09:14:52.369095 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:14:52 -0700 I, [2015-04-10T09:14:53.240071 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:14:53 -0700 I, [2015-04-10T09:14:54.153066 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:14:54 -0700 I, [2015-04-10T09:15:11.205706 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:15:11 -0700 I, [2015-04-10T09:18:47.064688 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:47 -0700 I, [2015-04-10T09:18:47.520213 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:47 -0700 I, [2015-04-10T09:18:48.406285 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:48 -0700 I, [2015-04-10T09:18:49.281375 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:49 -0700 I, [2015-04-10T09:18:51.673600 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:51 -0700 I, [2015-04-10T09:18:52.461602 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:52 -0700 I, [2015-04-10T09:18:53.463844 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:53 -0700 I, [2015-04-10T09:18:54.585010 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:54 -0700 I, [2015-04-10T09:18:55.455330 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:55 -0700 I, [2015-04-10T09:18:58.094848 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:58 -0700 I, [2015-04-10T09:18:58.984204 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:58 -0700 I, [2015-04-10T09:18:59.826679 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:18:59 -0700 I, [2015-04-10T09:19:00.707770 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:19:00 -0700 I, [2015-04-10T09:19:01.570598 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:19:01 -0700 I, [2015-04-10T09:19:02.135243 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:19:02 -0700 I, [2015-04-10T09:19:06.564340 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:19:06 -0700 I, [2015-04-10T09:19:09.256812 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:19:09 -0700 I, [2015-04-10T09:19:10.953006 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:19:10 -0700 I, [2015-04-10T09:19:12.113912 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:19:12 -0700 I, [2015-04-10T09:19:15.874275 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:19:15 -0700 I, [2015-04-10T09:21:57.964222 #29968] INFO -- : Started GET "/add-articles?current_page=1959&sort=alm_scopusCiteCount+desc" for 148.251.124.42 at 2015-04-10 09:21:57 -0700 F, [2015-04-10T09:30:41.535399 #29968] FATAL -- : F, [2015-04-10T09:52:08.523691 #29968] FATAL -- : I, [2015-04-10T09:52:08.882522 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:52:08 -0700 I, [2015-04-10T09:52:12.364489 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:52:12 -0700 F, [2015-04-10T09:53:04.140071 #29968] FATAL -- : I, [2015-04-10T09:53:07.865358 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 09:53:07 -0700 F, [2015-04-10T09:53:16.637930 #29968] FATAL -- : F, [2015-04-10T10:10:05.390897 #29968] FATAL -- : F, [2015-04-10T10:27:59.507714 #29968] FATAL -- : F, [2015-04-10T10:30:20.550156 #29968] FATAL -- : I, [2015-04-10T10:30:21.414330 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:21 -0700 I, [2015-04-10T10:30:22.271145 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:22 -0700 I, [2015-04-10T10:30:23.143086 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:23 -0700 I, [2015-04-10T10:30:23.991293 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:23 -0700 I, [2015-04-10T10:30:24.840381 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:24 -0700 I, [2015-04-10T10:30:25.715160 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:25 -0700 I, [2015-04-10T10:30:26.560002 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:26 -0700 I, [2015-04-10T10:30:27.541273 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:27 -0700 I, [2015-04-10T10:30:28.553338 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:28 -0700 I, [2015-04-10T10:30:29.470142 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:29 -0700 I, [2015-04-10T10:30:30.322774 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:30 -0700 I, [2015-04-10T10:30:31.247311 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:31 -0700 I, [2015-04-10T10:30:32.119205 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:32 -0700 I, [2015-04-10T10:30:32.973740 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:32 -0700 I, [2015-04-10T10:30:34.088478 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:34 -0700 I, [2015-04-10T10:30:34.949891 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:34 -0700 I, [2015-04-10T10:30:35.919978 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:35 -0700 I, [2015-04-10T10:30:37.235741 #29968] INFO -- : Started POST "/search/trackback/" for 91.200.12.39 at 2015-04-10 10:30:37 -0700 I, [2015-04-10T10:35:22.872539 #29968] INFO -- : Started GET "/add-articles?current_page=5346" for 5.9.17.118 at 2015-04-10 10:35:22 -0700 I, [2015-04-10T10:35:36.747778 #29968] INFO -- : Started GET "/add-articles?current_page=5346" for 144.76.201.69 at 2015-04-10 10:35:36 -0700 |
I've not forgotten about this, but I've been swamped with other work. I promise to look at this tomorrow evening! |
OK I've tried to replicate this in my own development environment, which is running the same code as production, and I was unable to. I got to the preview page just fine, following your instructions @jenniferlin15: Which makes this a tad more difficult to debug. I'm now going through your backtraces. |
Update: After digging into this from production logs, it looks like the production memcache servers are not working and the requests timing out:
If there is no caching layer, a lot of the code will behave unexpectedly. It shouldn't throw errors but obviously there are new edge cases then that are untested. The caching layer needs to exist and work. @mfenner said he'll look into what's wrong with the memcache servers and we'll take it from there. |
While I can create reports with a few articles (~20), the system throws an error when generating reports with large numbers of articles. It has failed at 1000 articles and higher. I have not tested the threshold.
The error message is as follows: We're sorry, but something went wrong. I get it upon clicking View Report after articles are added to the basket.
I have ruled out possibly missing data from recent articles by trying to create a 1k article report made up of very old publications. It also failed.
Please investigate and fix.
The text was updated successfully, but these errors were encountered: