Firefox WebDriver crashes with httplib.BadStatusLine #2524

royragsdale · 2016-07-26T17:13:31Z

Meta -

OS: Linux (Debian Jessie)
Selenium Version: 2.53.6 (python bindings)
Browser: Firefox
Browser Version: 47.0.1

Expected Behavior -

Selenium will successfully navigate to a page (http://taobao.com). When manually navigated in the browser this completes sucessfully.

Actual Behavior -

The webdriver and browser crash with httplib.BadStatusLine.

Steps to reproduce -

from selenium import webdriver                                                  

driver = webdriver.Firefox()                                                    
driver.get("http://taobao.com")                                                 
driver.close()

Traceback (most recent call last):
  File "test_firefox.py", line 4, in <module>
    driver.get("http://taobao.com")
  File "python2.7/site-packages/selenium/webdriver/remote/webdriver.py", line 248, in get
    self.execute(Command.GET, {'url': url})
  File "python2.7/site-packages/selenium/webdriver/remote/webdriver.py", line 234, in execute
    response = self.command_executor.execute(driver_command, params)
  File "python2.7/site-packages/selenium/webdriver/remote/remote_connection.py", line 401, in execute
    return self._request(command_info[0], url, body=data)
  File "/python2.7/site-packages/selenium/webdriver/remote/remote_connection.py", line 433, in _request
    resp = self._conn.getresponse()
  File "/usr/lib/python2.7/httplib.py", line 1073, in getresponse
    response.begin()
  File "/usr/lib/python2.7/httplib.py", line 415, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python2.7/httplib.py", line 379, in _read_status
    raise BadStatusLine(line)
httplib.BadStatusLine: ''

The text was updated successfully, but these errors were encountered:

sri85 · 2016-07-26T18:00:32Z

This issue is also reproducible on MAC with firefox version 47.0 and selenium version 2.52

HelioGuilherme66 · 2016-07-26T18:47:41Z

Can't reproduce in my system:

$ cat taobao.py
from selenium import webdriver
driver = webdriver.Firefox()
driver.get("http://taobao.com")
driver.close()
$ python taobao.py
$ date
Ter Jul 26 19:36:01 WEST 2016 # This current time == GMT+1
$ python --version
Python 2.7.10
$ uname -a
Linux new-host 4.4.14-200.fc22.x86_64 #1 SMP Fri Jun 24 21:19:33 UTC
2016 x86_64 x86_64 x86_64 GNU/Linux
$ firefox --version
Mozilla Firefox 45.1.0 # This is latest Firefox ESR
$ pip list
(...)
selenium (2.53.2)
(...)

On Tue, Jul 26, 2016 at 7:00 PM, Sripathi Pai [email protected]
wrote:

This issue is also reproducible on MAC with firefox version 47.0 and
selenium version 2.52

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#2524 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/ACu9xkPqWU6_tuLa5cjfIGD8QO3XnCZgks5qZktIgaJpZM4JVYMY
.

royragsdale · 2016-07-26T19:21:00Z

Additional version information, for what it's worth:

$ python --version
Python 2.7.9
$ uname -a
Linux localhost 3.14.0 #1 SMP PREEMPT Wed Jul 6 18:18:53 PDT 2016 x86_64 GNU/Linux
$ firefox --version
Mozilla Firefox 47.0.1
$ pip list |grep selenium
selenium (2.53.6)

I'll try with the firefox-esr and see if that works then report back.

royragsdale · 2016-07-26T19:29:28Z

Unfortunately, @HelioGuilherme66 even when using the ESR release (45.2.0) I still have this error.

test_firefox.py is the same code I referenced above

$ firefox --version
Mozilla Firefox 45.2.0
$ python test_firefox.py 
Traceback (most recent call last):
  File "test_firefox.py", line 4, in <module>
    driver.get("http://taobao.com")
  File "/usr/local/lib/python2.7/dist-packages/selenium/webdriver/remote/webdriver.py", line 248, in get
    self.execute(Command.GET, {'url': url})
  File "/usr/local/lib/python2.7/dist-packages/selenium/webdriver/remote/webdriver.py", line 234, in execute
    response = self.command_executor.execute(driver_command, params)
  File "/usr/local/lib/python2.7/dist-packages/selenium/webdriver/remote/remote_connection.py", line 401, in execute
    return self._request(command_info[0], url, body=data)
  File "/usr/local/lib/python2.7/dist-packages/selenium/webdriver/remote/remote_connection.py", line 433, in _request
    resp = self._conn.getresponse()
  File "/usr/lib/python2.7/httplib.py", line 1073, in getresponse
    response.begin()
  File "/usr/lib/python2.7/httplib.py", line 415, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python2.7/httplib.py", line 379, in _read_status
    raise BadStatusLine(line)
httplib.BadStatusLine: ''

Also tried with selenium==2.53.2 to further match your configuration and it still crashed.

HelioGuilherme66 · 2016-07-26T21:50:01Z

Looks like the problem is with httplib.py.
I have upgraded selenium to 2.53.6 and still runs OK. Differences in Python
2.7.9 vs 2.7.10?

File "/usr/local/lib/python2.7/dist-packages/selenium/webdriver/remote/remote_connection.py",
line 433, in _request

resp = self._conn.getresponse()
File "/usr/lib/python2.7/httplib.py", line 1073, in getresponse
response.begin()
File "/usr/lib/python2.7/httplib.py", line 415, in begin
version, status, reason = self._read_status()
File "/usr/lib/python2.7/httplib.py", line 379, in _read_status
raise BadStatusLine(line)
httplib.BadStatusLine: ''

royragsdale · 2016-07-27T01:39:33Z

I've tried across a number of other configuration and in some cases it works fine, but I'm having difficulty pinning down what is broken on this one system (only major difference I haven't isolated is the kernel version). I would be happy to continue trying to help trouble shoot this bug if anyone has any other ideas, otherwise feel free to close this since it is inconsistently reproducible.

To summarize

The original system still fails (even with 2.7.10), tested the following configurations:
Debian Jessie
Linux localhost 3.14.0 #1 SMP PREEMPT Wed Jul 6 18:18:53 PDT 2016 x86_64 GNU/Linux
Mozilla Firefox 47.0.1 + (python 2.7.9 or 2.7.10)
Mozilla Firefox 45.2.0 + python 2.7.9

On a fresh testing VM everything seems to work without issue (including python 2.7.9)
Debian Stretch
Linux vagrant 4.6.0-1-amd64 #1 SMP Debian 4.6.4-1 (2016-07-18) x86_64 GNU/Linux
Mozilla Firefox 45.2.0 + (python 2.7.9, 2.7.10, 2.7.12)

On another system everything also seems to work without issue (python 2.7.9)
Debian Jessie
Linux tower 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt25-2 (2016-04-08) x86_64 GNU/Linux
Mozilla Firefox 45.2.0 + python 2.7.9

Ekkstein · 2016-08-01T13:53:00Z

I was just about to post that I got the same problem on my mac running Firefox 47 and Selenium 2.53.6. While checking the Firefox version (graphically) I updated to Firefox 47.0.1. Now, I don't know if it really had anything to do with it, but suddenly it works. No clue!

generalconsensus · 2016-08-01T22:32:19Z

![Firefox 47 is failing]

https://www.evernote.com/l/AFMig-jiNV5IHoDd52bcfKe-2XqOYzrSuFoB/image.png

AutomatedTester · 2016-08-08T10:44:21Z

If the browser is crashing, and by crashing I mean it is no longer open (the true meaning of a crash), then there is a bigger problem than Selenium just not doing things. Can you see if you can replicate this with Selenium 3.0 beta?

HardenDev · 2016-08-18T09:42:55Z

I've also encountered the issue with selenium 2.53.6 / Firefox 47.0.1/Python 2.7.6, do you guys have anything that can fix this or something workaround about this?

makeapp007 · 2016-09-06T10:39:53Z

@HardenDev I had the same environment and met the same bug as yours. I solved this bug through updating firefox to 48.0. It worked perfectly on selenium 2.53.6 / Firefox 48.0 /Python 2.7.6.

zqy16 · 2016-11-11T09:17:54Z

@royragsdale I also have the same issue with python 2.7.11/Chrome 54.0.2840.87 m/selenium 3.0.1,do you have something to solve?thanks a lot.

royragsdale · 2016-11-14T12:48:31Z

@zqy16 unfortunately I never did pin down a good solution.

macdonjo · 2016-11-28T20:18:18Z

I can reproduce it on my server, but not on my Mac. Instead using PhantomJS as the driver, instead of Firefox.

Mac: OSX El Capitan 10.11.6
Server: CentOS 7.2.1511
Both have PhantomJS version: 2.1.1
Python Mac: Python 2.7.11
Python Server: 2.7.5
Both have Selenium version: 2.53.0

zqy16 · 2016-12-02T04:02:12Z

@royragsdale ,i use Chrome 52.0.2743.82 m (64-bit),and the problem solved.

andrewgtp · 2017-01-06T21:20:35Z

I had the same error on OSX 10.10, Chrome 55, Selenium 3.0.2. I grabbed the latest chromedriver 2.27 and its working now: https://chromedriver.storage.googleapis.com/index.html?path=2.27

macdonjo · 2017-01-07T04:34:31Z

@andrewgtp @zqy16 please stop suggesting Chrome as a bug patch to Firefox.

cgoldberg · 2017-02-02T13:48:15Z

@alexbegun that sounds like a completely different issue... not sure why you hijacked this thread

lagin · 2017-04-03T19:20:23Z

Can not reproduce it.
Windows 10
Python 2.7/3.4
Selenium 3.3.1
Firefox 52.0.2
geckodriver 0.15.0

bofinbabu · 2017-04-04T09:37:39Z

Guys look at this: https://code.google.com/archive/p/httplib2/issues/250

cgoldberg · 2017-04-04T13:23:38Z

@bofinbabu
fwiw, selenium doesn't use the http2 package.

webjunkie01 · 2017-05-31T21:05:44Z

I also experienced the same issue and found out that my server was running out of memory.

lmtierney · 2017-12-06T02:42:55Z

Closing as this cannot be reproduced on newer versions. Please open a new issue with a reproducible test scenario of the issue is experienced again.

zvolsky · 2018-07-19T09:56:59Z

Need newer versions? CentOS (in VirtualBox on Debian/buster), Py 2.7.5, Selenium 3.13.0, GeckoDriver 0.21.0, Mozilla Firefox 61.0.1

zvolsky · 2018-07-19T10:51:44Z

https://stackoverflow.com/questions/1767934/why-am-i-getting-this-error-in-python-httplib
exception httplib.BadStatusLine: Raised if a server responds with a HTTP status code that we don’t understand.
In my case I try driver.get() to python.org:
http://python.org and https://www.python.org both work well,
http://www.python.org and https://python.org both fail with BadStatusLine.

alirezastack · 2018-07-24T12:06:03Z

It seems that problem happens when my server has low memory. On my MAC everything seems working great by the same code happens to fail on a server with 1GB of RAM and 1 CPU Core.

Linux: Debian 9 -> 4.9.0-7-amd64 #1 SMP Debian 4.9.110-1 (2018-07-05) x86_64 GNU/Linux
Selenium: 3.13.0
Geckodriver: 0.21.0
Firefox-ESR: 60.0

Does any one else have the sample problem when their server specification is low?

lukeis added D-firefox C-py labels Sep 8, 2016

lmtierney closed this as completed Dec 6, 2017

lock bot locked and limited conversation to collaborators Aug 15, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Firefox WebDriver crashes with httplib.BadStatusLine #2524

Firefox WebDriver crashes with httplib.BadStatusLine #2524

royragsdale commented Jul 26, 2016

sri85 commented Jul 26, 2016

HelioGuilherme66 commented Jul 26, 2016

royragsdale commented Jul 26, 2016

royragsdale commented Jul 26, 2016 •

edited

Loading

HelioGuilherme66 commented Jul 26, 2016

royragsdale commented Jul 27, 2016

Ekkstein commented Aug 1, 2016

generalconsensus commented Aug 1, 2016 •

edited

Loading

AutomatedTester commented Aug 8, 2016

HardenDev commented Aug 18, 2016 •

edited

Loading

makeapp007 commented Sep 6, 2016

zqy16 commented Nov 11, 2016

royragsdale commented Nov 14, 2016

macdonjo commented Nov 28, 2016 •

edited

Loading

zqy16 commented Dec 2, 2016

andrewgtp commented Jan 6, 2017

macdonjo commented Jan 7, 2017

cgoldberg commented Feb 2, 2017

lagin commented Apr 3, 2017

bofinbabu commented Apr 4, 2017

cgoldberg commented Apr 4, 2017

webjunkie01 commented May 31, 2017

lmtierney commented Dec 6, 2017

zvolsky commented Jul 19, 2018

zvolsky commented Jul 19, 2018

alirezastack commented Jul 24, 2018

Firefox WebDriver crashes with httplib.BadStatusLine #2524

Firefox WebDriver crashes with httplib.BadStatusLine #2524

Comments

royragsdale commented Jul 26, 2016

Meta -

Expected Behavior -

Actual Behavior -

Steps to reproduce -

sri85 commented Jul 26, 2016

HelioGuilherme66 commented Jul 26, 2016

royragsdale commented Jul 26, 2016

royragsdale commented Jul 26, 2016 • edited Loading

HelioGuilherme66 commented Jul 26, 2016

royragsdale commented Jul 27, 2016

Ekkstein commented Aug 1, 2016

generalconsensus commented Aug 1, 2016 • edited Loading

AutomatedTester commented Aug 8, 2016

HardenDev commented Aug 18, 2016 • edited Loading

makeapp007 commented Sep 6, 2016

zqy16 commented Nov 11, 2016

royragsdale commented Nov 14, 2016

macdonjo commented Nov 28, 2016 • edited Loading

zqy16 commented Dec 2, 2016

andrewgtp commented Jan 6, 2017

macdonjo commented Jan 7, 2017

cgoldberg commented Feb 2, 2017

lagin commented Apr 3, 2017

bofinbabu commented Apr 4, 2017

cgoldberg commented Apr 4, 2017

webjunkie01 commented May 31, 2017

lmtierney commented Dec 6, 2017

zvolsky commented Jul 19, 2018

zvolsky commented Jul 19, 2018

alirezastack commented Jul 24, 2018

royragsdale commented Jul 26, 2016 •

edited

Loading

generalconsensus commented Aug 1, 2016 •

edited

Loading

HardenDev commented Aug 18, 2016 •

edited

Loading

macdonjo commented Nov 28, 2016 •

edited

Loading