How to get Chrome headless to download files? #108
Comments
|
I am facing the same issue, were you been able to solve it? |
|
Same issue. |
|
Any progress on this? I'm having the same issue. |
|
I have this working, but I did it without the "--headless" mode. I was previously under the impression that the only way to make Chimp test Chrome in a docker container was the use the headless mode. I was wrong. Just remove the headless and everything works fine, even when in a docker container or running on a machine without a monitor. |
|
@rsshilli did you ever get an error message like this
when you run not headless chrome in docker-container? |
|
@rsshilli |
|
You have to pass in the full path to the file, right? It looks like from the error message that you just passed in the filename itself ( |
|
I am also facing this problem. Anyone able to make it work? Thanks |
|
No, I never tried that, TBH. On Thu, Jul 19, 2018 at 9:34 AM, wuthiago [email protected] wrote:
-- CherryCircle Software, Inc. |
|
Hi, |
|
No, I gave up and used xvfb. Headless chrome had all kinds of problems for On Thu, Jul 19, 2018 at 10:52 AM, komalanandpandey <[email protected]
|
|
Here's a solution that work for me : Setting the driver options: Downloading a file: IMPORTANT : You have to call time.sleep(x) to let some time for the download to finish, if the driver close before the end of file download, solution won't work |
|
Can you tell me, please? how exactly to update the driver options? to enable the download option in the headless browser? I use Ubuntu 16.04 LTS |
|
How we can implement above solution in c# script coz i need to download pdf and validate in chrome headless browser mode.. Please guide me on this.. Thanks in advance, |
|
To add more noise to the conversation. Using the chromeHeadless driver is unable to download a file. However, everything is fine using Chrome (Version 71.0.3578.98) or by that means Firefox. The parameters that I am using to invoke chromeHeadless are (in GebConfig) are May this be caused by a bug in the chromeHeadless driver implementation? As the previous users have indicated, any help will be very welcomed |
|
For our C# environment we use the packages: {
var options = new ChromeOptions();
options.AddArguments("headless", "disable-gpu");
var driver = new ChromeDriver(chromedriverPath, options);
var param = new Dictionary<string, object>();
param.Add("behavior", "allow");
param.Add("downloadPath", $"C:\\Users\\{Environment.UserName}\\Downloads\\");
driver.ExecuteChromeCommand("Page.setDownloadBehavior", param);
}We also had the same problem of Excel files not being downloaded after being clicked. Once the behavior parameter was allowed for the Page.setDownloadBehavior command it just worked immediately. |
|
Is any available workaround to overcome this issue with Java/Javascript? |
|
For those who are struggling with this feature in python: I've found a great headless chrome driver builder made by @shawnbutton and it's available in his repo [PythonHeadlessChrome]. |
|
Can any one help me with JavaScript and am surfing the internet for last 2 days but not getting any solution. Am using WebdriverIO tool and below is my configuration chromeOptions: { |
|
facing the same issue with webdriverio : chrome options: |
|
I get browser.sendCommand is not a function. |
|
Finally i could able to download using webdriverIO. const unirest = require('unirest'); let session = browser.session(); unirest My Config file: browserName: 'chrome', |
|
none of these make it work, but this is the combination for WebdriverIO (JS) that worked out. and: Hope this help a lonely soul :). |
|
for anyone who is experiencing this for wdiov5: devtools (wdio.conf) and after that before I start download I run |
|
Ditto on using Xvfb with non-headless Chrome / Chromium-browser. We banged our heads against the wall for weeks trying to get --headless to work with downloads. Here is specifically what we did:
Now any chromium-browser processes started by chromedriver will inherit DISPLAY and will use the Xvfb virtual display. |
@pcamen |
|
We are using this on a Linode VPS but I don't see why it wouldn't work on any headless VPS. As for an automatic crawler, I assume you are talking about something you built yourself that uses Chrome, yes? We are using this with a system we built to do some integrations with an enterprise MRP software package that has a web interface that won't work with simpler scraping solutions, and has some of its data presented as downloadable report files. Works great for us this way. |
Did you actually try this? I tried this and did not get it to work. |
|
I managed to get this working with protractor tests. Followed similar approach to above: ( The only difference for me was that PS: If you do the above then you don't seem to need any special |
Hi Kristian, And technically yes, I've added a few lines to it to better suit my needs. #!/usr/bin/python3.6
# -*- coding: utf-8 -*-
# env
from pathlib import Path as plib
import sys
# web modules
from selenium.webdriver import Chrome
from selenium.webdriver.chrome import webdriver as chrome_webdriver
class WdriverBuilder(object):
def get_wdriver(self, dir_path, download_location=None, headless=False):
#
wdriver = self._get_chrome_wdriver(dir_path, download_location, headless)
# wdriver.set_window_size(1400, 700)
#
return wdriver
def _get_chrome_wdriver(self, dir_path, download_location, headless):
chrome_options = chrome_webdriver.Options()
if download_location:
prefs = {'download.default_directory': download_location,
'download.prompt_for_download': False,
'download.directory_upgrade': True,
'safebrowsing.enabled': False,
'safebrowsing.disable_download_protection': True}
chrome_options.add_experimental_option('prefs', prefs)
if headless:
chrome_options.add_argument("--headless")
dir_path = plib(dir_path)
wdriver_path = str(dir_path / 'chromedriver')
if sys.platform.startswith("win"):
wdriver_path += ".exe"
wdriver = Chrome(executable_path=wdriver_path, chrome_options=chrome_options)
if headless:
self.enable_download_in_headless_chrome(wdriver, download_location)
return wdriver
def enable_download_in_headless_chrome(self, wdriver, download_dir):
"""
there is currently a "feature" in chrome where
headless does not allow file download: https://bugs.chromium.org/p/chromium/issues/detail?id=696481
This method is a hacky work-around until the official chromewdriver support for this.
Requires chrome version 62.0.3196.0 or above.
"""
# add missing support for chrome "send_command" to selenium webwdriver
wdriver.command_executor._commands["send_command"] = ("POST", '/session/$sessionId/chromium/send_command')
#
params = {'cmd': 'Page.setDownloadBehavior', 'params': {'behavior': 'allow', 'downloadPath': download_dir}}
command_result = wdriver.execute("send_command", params)
print("\nresponse from browser:")
for key in command_result:
print("result:" + key + ":" + str(command_result[key])) |
|
Hey Lucas,
Thanks so much for getting back to me ill give this a try.
Thanks!
[image: TUA_Logo (1).png]
Kristian Berg
Credit Analyst, tua Financial Technologies Ltd <https://www.tua.ca/>.
<http://www.tua.ca/>
587-885-0447 <(587)%20885-0447>
[image: Facebook.png] <http://www.facebook.com/tuaFinancial>[image:
Instagram.png] <http://www.instagram.com/tuaFinancial>
…On Thu, Jul 18, 2019 at 8:21 AM Lucas Vasconcellos Czepaniki < ***@***.***> wrote:
@KristianTua <https://github.com/KristianTua>
Did you actually try this? I tried this and did not get it to work.
Hi Kristian,
Sorry for the long delay!
And technically yes, I've added a few lines to it to better suit my needs.
Here's my version, so you can test it:
#!/usr/bin/python3.6# -*- coding: utf-8 -*-# envfrom pathlib import Path as plibimport sys# web modulesfrom selenium.webdriver import Chromefrom selenium.webdriver.chrome import webdriver as chrome_webdriver
class WdriverBuilder(object):
def get_wdriver(self, dir_path, download_location=None, headless=False):
#
wdriver = self._get_chrome_wdriver(dir_path, download_location, headless)
# wdriver.set_window_size(1400, 700)
#
return wdriver
def _get_chrome_wdriver(self, dir_path, download_location, headless):
chrome_options = chrome_webdriver.Options()
if download_location:
prefs = {'download.default_directory': download_location,
'download.prompt_for_download': False,
'download.directory_upgrade': True,
'safebrowsing.enabled': False,
'safebrowsing.disable_download_protection': True}
chrome_options.add_experimental_option('prefs', prefs)
if headless:
chrome_options.add_argument("--headless")
dir_path = plib(dir_path)
wdriver_path = str(dir_path / 'chromedriver')
if sys.platform.startswith("win"):
wdriver_path += ".exe"
wdriver = Chrome(executable_path=wdriver_path, chrome_options=chrome_options)
if headless:
self.enable_download_in_headless_chrome(wdriver, download_location)
return wdriver
def enable_download_in_headless_chrome(self, wdriver, download_dir):
""" there is currently a "feature" in chrome where headless does not allow file download: https://bugs.chromium.org/p/chromium/issues/detail?id=696481 This method is a hacky work-around until the official chromewdriver support for this. Requires chrome version 62.0.3196.0 or above. """
# add missing support for chrome "send_command" to selenium webwdriver
wdriver.command_executor._commands["send_command"] = ("POST", '/session/$sessionId/chromium/send_command')
#
params = {'cmd': 'Page.setDownloadBehavior', 'params': {'behavior': 'allow', 'downloadPath': download_dir}}
command_result = wdriver.execute("send_command", params)
print("\nresponse from browser:")
for key in command_result:
print("result:" + key + ":" + str(command_result[key]))
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#108?email_source=notifications&email_token=ALT2I2F6NZNJ4YR7SHUHHEDQAB36VA5CNFSM4FLGQCN2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD2IUKPA#issuecomment-512836924>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/ALT2I2BXDZMRNOI7F27UWFLQAB36VANCNFSM4FLGQCNQ>
.
|
|
@KristianTua Let me know if you need any help getting it to work. |
|
`System.setProperty("webdriver.chrome.driver", path); // For Custom Download Folder ChromeDriverService driverService = ChromeDriverService.createDefaultService(); Map<String, Object> commandParams = new HashMap<>(); ObjectMapper objectMapper = new ObjectMapper(); try { } Do you see something wrong with this JAVA code? Headless file download doesn't work for me. |
I could not get your code to work on Linux |
I could not get this to work on mac, chrome version 75 and chromedriver version 75 |
Can you share the stack trace or any log you might have of the issue? If memory serves me right, I also had an issue with v75 and since then I'm using 74. Here's the official link for this version's download: |
I'm not really versed in Java, but I tried testing your code anyways. |
|
Its just chromedriver part of code I pasted. Will try to create an independent example. |
Works! |
|
How do I get this working in Behat with Mink? |
|
Literally, just like @jdmwood2 said. I made it work on Webdriver.IO V5 with chrome headless by simply adding the following code to the I did not add absolutely no prefs. |
|
@mvgiacomello Can you tell me which chrome and selenium versions you are using. I have not been able to get it working with "selenium-standalone": "^6.17.0" |
|
TL;DR upgrading to chromedriver 79.0.0 on OSX allowed this to work for me. I was banging my head against this on OSX using the javascript selenium-webdriver and chromedriver 78.0.0 and couldn't get it to work. I found this bug about headless chromedriver not working on OSX https://bugs.chromium.org/p/chromium/issues/detail?id=979847, which was marked recently as "no longer reproducible". So I upgraded to chromedriver 79.0.0 and it started working for me. My chromeOptions: |
driver.execute_cdp_cmd("Page.setDownloadBehavior", {'behavior': 'deny', 'downloadPath': ""}) |
after wasting so much time this worked. thanks 👍 |
|
For anyone using Chrome Devtools protocol with WebdriverIO, this is the solution that actually works with headless Chrome/Chromium with WebdriverIo v6. |
|
Hello Guys, I had same problem (Windows 10) in python. You can try to change your download_path variable
Did not work and I changed it to:
Changing backslashes worked for me. |
|
@lhorvath87 THANK YOU for that - I am not even using Chimpy but was troubleshooting why headless chrome wasn't downloading for me using another tool and found your answer- it was all about the download path and the slashes. I changed that and it began working. |
and others
Wednesday Feb 07, 2018 at 06:16 GMT
Originally opened as xolvio/chimp#679
How do I download files using Chrome headless? I see that:
I'm having a hard time piecing together how I get this working from my Chimp world.
Versions:
I've tried a number of things playing with the configuration, trying things like this below, but nothing works:
My mechanism for downloading a file is to click on the download link and then use
fsto wait for the file on the file system, which never shows up :(. This worked fine before adding --headlessThe text was updated successfully, but these errors were encountered: