5xxes

[alinaboghiu]

Current issues

1. 504 in the frontend facia app

• Reflected in 5xx es in the main/original DCR rendering app
• Not sure when they started but we thing they significantly increased around 17th January - when we started sending traffic to the new article rendering app

2. 502s in the new article rendering stack

• Since we started sending traffic to this new stack

3. 5xx on the ELB for the DCR main/original rendering app

• Started on the 11th January
• We think most of these are 504? At least at the moment

Next steps

1. Focus on fixing 504s first as these are causing the most noise (we think)
2. Try reducing the number of instances that render fronts (from 27 to 18)
3. Continue to break up the app and spin up another stack for facia
4. Try running facia rendering app on different sized instances