ESP8266HTTPClient error -1 #6180

Loucotolo · 2019-06-04T15:45:52Z

Basic Infos

This issue complies with the issue POLICY doc.
I have read the documentation at readthedocs and the issue is not addressed there.
I have tested that the issue is present in current master branch (aka latest git).
I have searched the issue tracker for a similar issue.
If there is a stack dump, I have decoded it.
I have filled out all fields below.

Platform

Hardware: [ESP8266EX]
Core Version: [2.5.2]
Development Env: [Arduino IDE]
Operating System: [Windows]

Settings in IDE

Module: [Generic ESP8266 Module]
Flash Mode: [DOUT (COMPATIBLE)]
Flash Size: [1MB]
lwip Variant: [v2 Lower Memory]
Reset Method: [ck]
Flash Frequency: [40Mhz]
CPU Frequency: [80Mhz]
Upload Using: [SERIAL]
Upload Speed: [115200]
Espressif FW: [nono-sdk 2.2.1]

Problem Description

Hello, I have the following problem:
I am using a esp8266, via an httpclient to connect to a server, but after some time (random), it returns me the following error:
httpCode: -1 (Connection Refused). With wireshark I noticed that it [TCP PORT numbers reused] 57490-> 8000 [SYN].

I would like to know what I am doing wrong in my code to receive this error.

[Sketch]

#include <Arduino.h>
#include <ESP8266WiFi.h> /// fix http://blog.flynnmetrics.com/uncategorized/esp8266-exception-3/
#include <ESP8266HTTPClient.h>
//#include <WiFiClient.h>
#include <ESPAsyncWebServer.h>
#include <ArduinoJson.h>
#include <ESP8266httpUpdate.h>
#include <Hash.h>
#include <FS.h>
#include <user_interface.h> //Biblioteca necessaria para acessar os Timer`s.

#include "OneButton.h" // https://github.com/mathertel/OneButton
#include <EEPROM.h>
#include <WiFiUdp.h>


bool connect2WiFI()
{


  WiFi.setAutoReconnect( true );

#if (ADEBUG == 1 )
  Serial.printf("Wifi State changed to %s\n", WlStatusToStr(WiFi.status()));
#endif

  
  WiFi.persistent(false);   // Solve possible wifi init errors (re-add at 6.2.1.16 #4044, #4083)
  WiFi.disconnect(true);    // Delete SDK wifi config
  delay(200);
  WiFi.mode(WIFI_STA);      // Disable AP mode
  WiFi.setSleepMode(WIFI_MODEM_SLEEP);  // Disable sleep (Esp8288/Arduino core and sdk default)
  
  WiFi.begin("DEMO", "DEMO");


  uint32_t AwifiTimeout = 20000;
  uint32_t maxTime = millis() + AwifiTimeout;


  while ((WiFi.status()  != WL_CONNECTED) && (millis() < maxTime)) {
    yield();
  }


  if (WiFi.status()  != WL_CONNECTED)
  {

    return false;
  }


  Serial.println(WiFi.localIP());         // Send the IP address of the ESP8266 to the computer



  return true;

}


bool test()
{

more_send_data:

  int txlen = 0;


  

  WiFiClient client;

  HTTPClient http;

  http.setTimeout(500); // 500ms
  String md_ip = "192.168.0.31";
  String md_port = "8000";
  String path = "http://" + md_ip + ":" + md_port + "/index.php";

  const char * headerkeys[] = {"Set-Cookie", "Cookie"} ;
  size_t headerkeyssize = sizeof(headerkeys) / sizeof(char*);

  http.begin(client, path);    //Specify request destination
  //  http.begin(path);
  http.addHeader("Content-Type", "application/json");  //Specify content-type header


  http.collectHeaders(headerkeys, headerkeyssize);

  int httpCode = http.POST("Hello");  //Send the request
  String payload = http.getString();                                        //Get the response payload




  if (httpCode > 0)
  {

    if (httpCode == HTTP_CODE_OK || httpCode == HTTP_CODE_MOVED_PERMANENTLY) {




      http.end();  //Close connection



      return true;







    } // end  payload != ""

    client.stop();
    http.end();  //Close connection


    return true;
  }






  Serial.print("httpCode:");
  Serial.println(httpCode, DEC );
  



  
  http.end();  //Close connection
  return false;
}


void setup() {
  // put your setup code here, to run once:

  WiFi.mode(WIFI_STA);


  EEPROM.begin(512);


  Serial.begin(115200);
connect2WiFI();
}



void loop() {
  // put your main code here, to run repeatedly:


  test();


  delay(500);
}

Debug Messages

16:33:26.338 -> 192.168.0.192
16:33:34.254 -> pm open,type:2 0
16:33:37.970 -> httpCode:-1

wireshark report :
https://mega.nz/#!jJ4wRIyQ!6ayDTjoxEgaxO82yBo-0I4PwqH33TpPVC9XijBe2EXg

The text was updated successfully, but these errors were encountered:

devyte · 2019-06-06T17:48:09Z

Please don't post links to external sources, especially to files uploaded, because there is no assurance the files will live in the future. Instead, reduce the log by filtering out unrelevant things (if you haven't already done so) and post the log directly here with markup.

jpboucher · 2019-06-14T15:09:43Z

You are probably running out of sockets after a while. Try calling http.setReuse(true) before you call http.begin

d-a-v · 2019-06-17T22:14:40Z

Same sketch is running flawlessly here.
I think your server is busy for more than 0.5 seconds and the esp times out as you asked it to.

Failing request starts:

17:33:37.439458 IP 192.168.0.192.49882 > 192.168.0.31.8000: Flags [S], seq 6630, win 2144, options [mss 536,nop,nop,sackOK], length 0
17:33:37.439571 IP 192.168.0.31.8000 > 192.168.0.192.49882: Flags [S.], seq 1154906697, ack 6631, win 65392, options [mss 1460,nop,nop,sackOK], length 0

lots of https at the same time:

17:33:37.623692 IP 149.11.65.227.https > 192.168.0.31.49821: Flags [P.], seq 22745748:22745784, ack 1, win 34, length 36
17:33:37.623693 IP 149.11.65.227.https > 192.168.0.31.49821: Flags [P.], seq 22745784:22746194, ack 1, win 34, length 410
17:33:37.623694 IP 149.11.65.227.https > 192.168.0.31.49821: Flags [P.], seq 22746194:22746230, ack 1, win 34, length 36
... (lots)
17:33:37.868468 IP 192.168.0.31.49821 > 149.11.65.227.https: Flags [.], ack 22752711, win 1024, length 0
17:33:37.916391 IP 149.11.65.227.https > 192.168.0.31.49821: Flags [P.], seq 22752711:22753078, ack 1, win 34, length 367
17:33:37.916445 IP 192.168.0.31.49821 > 149.11.65.227.https: Flags [.], ack 22753078, win 1023, length 0

esp times out:

17:33:37.944117 IP 192.168.0.192.49882 > 192.168.0.31.8000: Flags [R.], seq 1, ack 3140060599, win 24584, length 0

next requests are honored:

...
17:33:38.446020 IP 192.168.0.192.50004 > 192.168.0.31.8000: Flags [S], seq 6642, win 2144, options [mss 536,nop,nop,sackOK], length 0
17:33:38.446099 IP 192.168.0.31.8000 > 192.168.0.192.50004: Flags [S.], seq 1775072509, ack 6643, win 65392, options [mss 1460,nop,nop,sackOK], length 0
17:33:38.448943 IP 192.168.0.192.50004 > 192.168.0.31.8000: Flags [.], ack 1, win 2144, length 0
17:33:38.454408 IP 192.168.0.192.50004 > 192.168.0.31.8000: Flags [P.], seq 1:206, ack 1, win 2144, length 205
17:33:38.454408 IP 192.168.0.192.50004 > 192.168.0.31.8000: Flags [P.], seq 206:211, ack 1, win 2144, length 5
17:33:38.454437 IP 192.168.0.31.8000 > 192.168.0.192.50004: Flags [.], ack 211, win 65182, length 0
17:33:38.455149 IP 192.168.0.31.8000 > 192.168.0.192.50004: Flags [P.], seq 1:231, ack 211, win 65182, length 230
17:33:38.455223 IP 192.168.0.31.8000 > 192.168.0.192.50004: Flags [F.], seq 231, ack 211, win 65182, length 0
17:33:38.469175 IP 192.168.0.192.50004 > 192.168.0.31.8000: Flags [R.], seq 211, ack 232, win 24584, length 0
...

Be nicer with your server, increase ESP timeout.

TD-er · 2019-06-18T12:00:15Z

@jpboucher

You are probably running out of sockets after a while. Try calling http.setReuse(true) before you call http.begin

I've looked into the code and it seems it does keep the connection open.
What's the default for max. open connections?
What will happen if that maximum is hit?

jpboucher · 2019-06-18T12:21:02Z

@jpboucher

You are probably running out of sockets after a while. Try calling http.setReuse(true) before you call http.begin

I've looked into the code and it seems it does keep the connection open.
What's the default for max. open connections?
What will happen if that maximum is hit?

The default is 5. It can be increased up to 15 using espconn_tcp_set_max_con() from the ESP SDK.
If the maximum is hit, you will not be able to create a new socket and the connection will fail. The request will return HTTPC_ERROR_CONNECTION_REFUSED (-1)

d-a-v · 2019-06-18T12:29:18Z

I've looked into the code and it seems it does keep the connection open.

It doesn't. Variable scope implies the destructor is called and the connection closed at every loop (on test() ending, because WiFiClient and HTTPClient are declared in there).

The default is 5. It can be increased up to 15 using espconn_tcp_set_max_con() from the ESP SDK.

We don't depend on that. It's for espconn API. Your only limitation is RAM.

jpboucher · 2019-06-18T12:55:43Z

My bad. Since everything is indeed cleared at every loop I would also suspect that the server is too slow.

TD-er · 2019-06-18T14:45:10Z

It doesn't. Variable scope implies the destructor is called and the connection closed at every loop (on test() ending, because WiFiClient and HTTPClient are declared in there).

I meant the code of HTTPClient.
So as long as the client object does exist, it will keep the connection open so it seems. (with _reuse set)

devyte · 2020-02-02T03:15:35Z

This was reported for 2.5.2. There have been several critical stability fixes merged since then. Please retest with 2.6.3 or latest git.

earlephilhower · 2020-05-26T17:53:57Z

Closing as last update was Jun 18, there have been many HTTPClient updates, and there's been no response to @devyte's request for a confirmation this is still an issue in 2.7+ for ~4 months. If it does still show up in latest master, please open a new bug with MCVE/etc. so we can look at it.

beicnet · 2020-06-12T18:34:35Z

@earlephilhower , @devyte The issue with -1 still persists, went today from 2.3.0 to 2.7.1, but it's got worse, now I have delay, freezing issues too.

This function is called every 10 seconds:

void checkForUpdates()
{
  if (WiFi.status() == WL_CONNECTED) {
    String fwVerURL = "";
    fwVerURL.concat("http://");
    fwVerURL.concat("xxxxxx.ddns.net");
    fwVerURL.concat(":");
    fwVerURL.concat("80");
    fwVerURL.concat("/xxx/version.asp");
   
    HTTPClient updHttp;
    updHttp.setReuse(true);
    updHttp.begin(fwVerURL);

    int httpCode = updHttp.GET();

    Serial.println("HTTP Respose Code: " + String(httpCode));

    if (httpCode == 200) {
      String newFwTmpVersion = updHttp.getString();
      // ===> Here I got 3 second whole ESP freezing <===
      Serial.println("HTTP Update Version: " + newFwTmpVersion);
    } else {
      Serial.println("Error HTTP Update!");
    }
    updHttp.end();
  }
}

earlephilhower · 2020-06-12T18:47:01Z

@beicnet, Can you please open a new issue with MCVE (and public file maybe on your GH acct or something so we can run it in our own environments) and also enable full debugging to get more useful logs? This is a closed issue from a long time ago, so it won't get attention otherwise.

beicnet · 2020-06-12T19:08:17Z

Hey @earlephilhower thank you for your fast response! ;)

MCVE? Huh, there are 12 library included in my project, and also there are a lot of modules attached to the WeMos D1 mini board.

Can you tell me which one is the full debug in Tools > Debug level?

I'm still using Arduino 1.8.2 with 2.3.0 and everything was fine except that HTTP random response -1, and -2 code (as we speak I got -11 too).

earlephilhower · 2020-06-12T19:22:06Z

If you're using 2.3.0 then first move to 2.7.1 before trying anything else. 2.3.0 is ancient.

For debug, just select the longest one (2nd from last in the menu, it's got about 12 things listed.

If it still has issues w/the latest version, then you'll have to strip it down to a simple example. If it's just the http stuff, you should be able to reproduce the failure with just a loop() that calls your update stuff. If you can't strip things down, again there's not much we can do, but you can use https://esp8266.com forums for more help.

beicnet · 2020-06-12T20:11:09Z

Yes, @earlephilhower I moved directly to 2.7.1.

Could not use 2nd from last in the menu, because I got BSSL error at compiling and I used 3th from the last in the menu.

I managed to strip down the whole code, and it's just the http stuff in the loop.

Stripped code and Debug information follows:

extern "C" {
#include "user_interface.h"
}

#include "ESP8266WiFi.h"
#include "ESP8266HTTPClient.h"

const char* ssid     = "xxxxxx";
const char* password = "xxxxxx";

const char* devhostname = "DEVICE-002";
uint8_t Mac[] = {0xBE, 0x1C, 0x00, 0x00, 0x01, 0x01};

//  Custom Delay of 1s in Loop procedure (Non-blocking)
int upd_ready_period = 10000;
unsigned long upd_ready_time_now = 0;

void setup()
{
  delay(10);

  Serial.begin(9600);

  while (!Serial)
  {
    delay(10);
  }

  Serial.println("Booting up...");

  //  Fix for "Can't reconnect to the router"
  WiFi.persistent(false);
  WiFi.mode(WIFI_OFF);
  WiFi.softAPdisconnect(true);
  WiFi.mode(WIFI_STA);
  //  =======================================

  //  Set Wifi MAC, Hostanme, Ssid and Passowrd
  wifi_set_macaddr(STATION_IF, &Mac[0]);
  WiFi.hostname(devhostname);
  WiFi.begin(ssid, password);
  Serial.print(F("Connecting to "));
  Serial.print(ssid); Serial.println(F(" ..."));

  int i = 0;

  while (WiFi.status() != WL_CONNECTED) {
    delay(1000);
    Serial.print(++i);
    Serial.print(' ');
  }

  Serial.println("");
  Serial.println(F("Connected!"));
  Serial.println("SSID: " + String(WiFi.SSID()));
  Serial.println("RSSI: " + String(WiFi.RSSI()));
  Serial.println("Channel: " + String(wifi_get_channel()));
  Serial.println("IP Address: " + Ip2Str(WiFi.localIP()));
  Serial.println("MAC Address: " + Mac2Str(WiFi.macAddress(Mac)));
}

void loop()
{
  if (millis() > upd_ready_time_now + upd_ready_period)
  {
    upd_ready_time_now = millis();
    checkForUpdates();
  }
}

void checkForUpdates()
{
  if (WiFi.status() == WL_CONNECTED) {
    String fwVerURL = "";
    fwVerURL.concat("http://");
    fwVerURL.concat("xxxxxx.ddns.net");
    fwVerURL.concat(":");
    fwVerURL.concat("80");
    fwVerURL.concat("/xxxxxx/version.asp");

    HTTPClient updHttp;
    updHttp.setReuse(true);
    updHttp.begin(fwVerURL);

    int httpCode = updHttp.GET();

    Serial.println("HTTP Respose Code: " + String(httpCode));

    if (httpCode == 200) {
      String newFwTmpVersion = updHttp.getString();
      Serial.println("HTTP Update Version: " + newFwTmpVersion);
    } else {
      Serial.println("Error HTTP Update!");
    }
    updHttp.end();
  }
}

String Ip2Str(IPAddress ip)
{
  String s = "";
  for (int i = 0; i < 4; i++)
    s += i  ? "." + String(ip[i]) : String(ip[i]);
  return s;
}

String Mac2Str(byte ar[])
{
  String s = "";
  for (byte i = 0; i < 6; ++i) {
    char buf[3];
    sprintf(buf, "%02X", ar[i]);
    s += buf;
    if (i < 5) s += ':';
  }
  return s;
}

Debug information:

:ref 1
:wr 196 0
:wrc 196 196 0
:ack 196
:rn 249
:rch 249, 3
:rcl pb=0x3ffefbf4 sz=252
:c 1, 249, 252
HTTP Respose Code: 200
:c0 1, 3
HTTP Update Version: 3.6
:close
:ur 1
:dsrcv 0
:del
:ref 1
:wr 196 0
:wrc 196 196 0
:ack 196
:rn 249
:rch 249, 3
:rcl pb=0x3ffeff6c sz=252
:c 1, 249, 252
HTTP Respose Code: 200
:c0 1, 3
HTTP Update Version: 3.6
:close
:ur 1
:dsrcv 0
:del
:ref 1
:wr 196 0
:wrc 196 196 0
:ack 196
:rn 249
:rch 249, 3
:rcl pb=0x3ffeff6c sz=252
:c 1, 249, 252
HTTP Respose Code: 200
:c0 1, 3
HTTP Update Version: 3.6
:close
:ur 1
:dsrcv 0
:del
:ref 1
:wr 196 0
:wrc 196 196 0
:ack 196
:rn 249
:rch 249, 3
:rcl pb=0x3ffeff6c sz=252
:c 1, 249, 252
HTTP Respose Code: 200
:c0 1, 3
HTTP Update Version: 3.6
:close

earlephilhower · 2020-06-12T20:15:00Z

Looks like it's fine, no -1 response shown. You should look to capture a -1 code...

beicnet · 2020-06-12T20:19:21Z

@earlephilhower There is a 3 second total freeze between the ARROW shown:

HTTP Respose Code: 200
:c0 1, 3 <=== here 3 second freeze in every loop
HTTP Update Version: 3.6

earlephilhower · 2020-06-12T20:27:14Z

That's not an error. You'd need to go over the server it's connecting to and what it's transmitting (wireshark). As a guess I would say that the HTTP server is doing something funky here and not identifying the content size properly so the client waits a couple seconds until timeout and return of the string. Wireshark on the network to capture both sides of the transaction is your best bet to debugging this. That said, it seems like this is really something you're going to have to go to esp8266.com or https://gitter.im/esp8266/Arduino to track down since it's not really a core thing so far.

beicnet · 2020-06-12T21:14:35Z

Ok, just installed Wireshark, any suggestion for the filter and what should I look for? (first time with Wireshark) @earlephilhower

TD-er · 2020-06-13T08:51:24Z

Ok, just installed Wireshark, any suggestion for the filter and what should I look for? (first time with Wireshark) @earlephilhower

Just one thing to test first before experimenting with filter.
Make sure you actually see the traffic of your node.
So one filter to use at least is filter on the MAC of your ESP in src and dst direction.
And just to be sure, maybe also add the same filter for your AP MAC of the ESP. (if it is enabled, as you're calling WiFi.softAPdisconnect(true);)

beicnet · 2020-06-13T10:01:57Z

Hey @TD-er I managed to filter traffic for 8008 port, the Source device (client) is 192.168.0.25 and the destination device (server) is 192.168.0.132

TD-er · 2020-06-13T11:25:17Z

The reason I mentioned it was that it is also possible the network packets do not reach the host you're running Wireshark on.
A typical switch only forwards data to the ports that have the destination MAC address connected.
So if you try to grab traffic between host A and B while running Wireshark on host C, then you may need to use some tricks to see that traffic also (e.g. port mirroring available in some switches)

But if you can see the packets using Wireshark, then you know you can trust the setup and start filtering.

beicnet · 2020-06-13T12:07:28Z

I don't know @TD-er , I'm new to Wireshark, no time to learn it, but what can I say, I went back to core 2.3.0 and it's working without any issues for now again.

What I noticed so far are those time latency and freezing with 2.7.1:

Core 2.7.1
30.005311 (Request - Start)
30.020311 (Respond - End)

Core 2.3.0
7272.479139  (Request - Start)
7272.494111 (Respond - End)

Used the same stripped sketch posted above.

TD-er · 2020-06-13T12:32:42Z

Just one thought.
Core 2.3.0 didn't have chunked transfers, while 2.4.0 and newer have.
As you can see in the Wireshark screenshot, you highlighted a packet with content length 0.
That's signalling the end of a chunked transfer.

I can imagine that trying to get the resulting string may wait until the transfer is considered complete.
If there is a bug (or a missed packet) in the code here that does not consider the chunked transfer to be complete, then you may run into a timeout.

Maybe it would help to also include the millis() in the log strings, so we can see where it is taking so long.
Maybe also try to run a delay(0); before getting the string?

d-a-v · 2020-06-13T14:08:58Z

@beicnet why didn't you open a new issue ?

It's not 3 second but 5 second according to wireshark log (which is the default timeout in http client).
@beicneit your http request does seem to produce any other answer than the 200/OK and esp is waiting for one during 5 seconds before giving up.
What is the output of this command curl -D - http://your-url ?

beicnet · 2020-06-13T15:13:23Z

Sorry about that @d-a-v , I'm totally lost because of my job.

Requested CURL output:

curl -D - http://192.168.0.132:8008/inovi/update/version.asp

HTTP/1.0 200 OK
Server: Quick 'n Easy Web Server
Content-Type: text/plain
Cache-Control: no-Cache
Pragma: no-cache
Expires: Fri, 12 Jun 2020 17:05:51 GMT
Set-Cookie: SESSIONID=00002633; path=/;version=1
Date: Sat, 13 Jun 2020 15:05:51 GMT

3.6

ASP page source follows:

<%@ Language=VBScript %>
<%
 Option Explicit
 
 Response.Buffer=True
 Response.ContentType="text/plain" 
 Response.CacheControl = "no-Cache"
 Response.AddHeader "Pragma" , "no-cache"
 Response.ExpiresAbsolute = Now() -1

 Call Response.Write("3.6")
 
 Response.Flush
 Response.Clear
 Response.End
%>

and it's happening randomly using core 2.3.0

HTTP Respose Code: 200
HTTP Update Version: 3.6
HTTP Respose Code: 200
HTTP Update Version: 3.6
HTTP Respose Code: -2
Error HTTP Update!
HTTP Respose Code: -1
Error HTTP Update!
HTTP Respose Code: 200
HTTP Update Version: 3.6
HTTP Respose Code: 200
HTTP Update Version: 3.6
HTTP Respose Code: 200
HTTP Update Version: 3.6
HTTP Respose Code: 200
HTTP Update Version: 3.6
HTTP Respose Code: 200
HTTP Update Version: 3.6
HTTP Respose Code: 200
HTTP Update Version: 3.6
HTTP Respose Code: 200
HTTP Update Version: 3.6
HTTP Respose Code: 200
HTTP Update Version: 3.6
HTTP Respose Code: 200
HTTP Update Version: 3.6
HTTP Respose Code: 200
HTTP Update Version: 3.6

Using latest core 2.7.1, it's freezes the whole sketch.

d-a-v · 2020-06-13T15:28:07Z

From what I can see it's not a chunked answer so you must have a Content-Length in your header

beicnet · 2020-06-13T16:40:41Z

Edited the source ASP page @d-a-v

curl -D - http://192.168.0.132:8008/inovi/update/version.asp

HTTP/1.0 200 OK
Server: Quick 'n Easy Web Server
Content-Type: text/plain
Cache-Control: no-Cache
Pragma: no-cache
Content-Length: 3
Expires: Fri, 12 Jun 2020 18:17:45 GMT
Set-Cookie: SESSIONID=00003261; path=/;version=1
Date: Sat, 13 Jun 2020 16:17:45 GMT

3.7

Result:

HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: -2
Error HTTP Update!
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: -2
Error HTTP Update!
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: -2
Error HTTP Update!
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: -2
Error HTTP Update!

earlephilhower · 2020-06-13T17:10:32Z

The -2 error == HTTPC_ERROR_SEND_HEADER_FAILED.

It means the client write of the headers did not write the full amount of headers to the server. See HTTPClient::sendHeader.... _client->write(<data>) != <data>

So, if Wifi goes down and isn't reconnected, that's one possibility. If the server sends a TCP disconnect (maybe it's rate-limiting or maybe it's slow), that's another possibility. If the WiFi signal isn't strong enough and the TCP ACK is lost, that's another option.

@d-a-v, can client->write fragment and only write a lesser portion of the data? If so, then the code here needs to be reworked to attempt multiple writes as long as the written bytes != 0...

Arduino/libraries/ESP8266HTTPClient/src/ESP8266HTTPClient.cpp

Line 1315 in 89d0c78

    
           return (_client->write((const uint8_t *) header.c_str(), header.length()) == header.length());

beicnet · 2020-06-13T17:20:19Z

@earlephilhower , @d-a-v I have some weird guessing here, is it possible that in the WeMos D1 mini devices the AT firmwares are not the same? Because I bought 150pcs of them what I currently testing, but I have one device running with the same code and it's rarely giving me response error code (maybe 1 time from 10000 loops) against these new one (like 15 times from 50 loops)?!

Is it possible or?

I don't know nothing anymore, struggling with this like more than 10 days...

HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: -2
Error HTTP Update!
HTTP Respose Code: -1
Error HTTP Update!
HTTP Respose Code: -1
Error HTTP Update!
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: -2
Error HTTP Update!
HTTP Respose Code: -2
Error HTTP Update!
HTTP Respose Code: -1
Error HTTP Update!
HTTP Respose Code: -1
Error HTTP Update!
HTTP Respose Code: -1
Error HTTP Update!
HTTP Respose Code: -1
Error HTTP Update!
HTTP Respose Code: -1
Error HTTP Update!
HTTP Respose Code: -1
Error HTTP Update!
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: 200
HTTP Update Version: 3.7
HTTP Respose Code: 200
HTTP Update Version: 3.7

TD-er · 2020-06-13T17:38:40Z

Try to set upd_ready_period to 10000 + millis() when you successfully connect to wifi.
Or whatever value, as long as it includes millis() plus at least one second.

This way you know for sure it cannot be impacted by some modules needing more time to connect.

beicnet · 2020-06-13T17:48:20Z

Regarding my device RSSI is -76 @earlephilhower

@TD-er Did it as per your suggestion, but I got the same result right from the beginning:

int upd_ready_period = 10000 + millis();

Results:

HTTP Response Code: 200
HTTP Update Version: 3.7
HTTP Response Code: 200
HTTP Update Version: 3.7
HTTP Response Code: -2
Error HTTP Update!
HTTP Response Code: -1
Error HTTP Update!
HTTP Response Code: 200
HTTP Update Version: 3.7

d-a-v · 2020-06-13T17:52:16Z

@beicnet there is no different hardware.
Can you enable the debug options ?
Did you try to proceed to a flash full-erase ?

@earlephilhower ClientContext::write(,,len) is supposed to wait for the whole len to be sent because it's a blocking function unless a fatal error occurs.

Maybe we should add the result in the debug messages ?

 size_t ret = _client->write((const uint8_t*)header.c_str(), header.length();
 DEBUGV(..., header.length(), ret);
 return ret == header.length());

beicnet · 2020-06-13T18:05:29Z

@d-a-v

Yes > Can you enable the debug options ?
Yes > Did you try to proceed to a flash full-erase ?

and let's wait a little bit for the output to populate a few cycle of loop...

beicnet · 2020-06-13T20:12:36Z

:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
HTTP Response Code: -1
Error HTTP Update!
:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
HTTP Response Code: -1
Error HTTP Update!
:ref 1
:wr 193 0
:wrc 193 193 0
:ack 193
:rn 268
:rch 268, 3
:rcl pb=0x3fff045c sz=271
:c 1, 268, 271
HTTP Response Code: 200
:c0 1, 3
HTTP Update Version: 3.7
:close
:ur 1
:dsrcv 0
:del
:ref 1
:wr 193 0
:wrc 193 193 0
:ack 193
:rn 268
:rch 268, 3
:rcl pb=0x3fff053c sz=271
:c 1, 268, 271
HTTP Response Code: 200
:c0 1, 3
HTTP Update Version: 3.7
:close
:ur 1
:dsrcv 0
:del
:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
HTTP Response Code: -1
Error HTTP Update!
:ref 1
:wr 193 0
:wrc 193 193 0
:ack 193
:rn 268
:rch 268, 3
:rcl pb=0x3fff04dc sz=271
:c 1, 268, 271
HTTP Response Code: 200
:c0 1, 3
HTTP Update Version: 3.7
:close
:ur 1
:dsrcv 0
:del
:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
HTTP Response Code: -1
Error HTTP Update!
:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
HTTP Response Code: -1
Error HTTP Update!
:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
HTTP Response Code: -1
Error HTTP Update!
:ref 1
:wr 193 0
:wrc 193 193 0
:ack 193
:rn 268
:rch 268, 3
:rcl pb=0x3fff045c sz=271
:c 1, 268, 271
HTTP Response Code: 200
:c0 1, 3
HTTP Update Version: 3.7
:close
:ur 1
:dsrcv 0
:del
:ref 1
:wr 193 0
:wrc 193 193 0
:wustmo
:close
HTTP Response Code: -11
Error HTTP Update!
:ur 1
:dsrcv 0
:del
:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
HTTP Response Code: -1
Error HTTP Update!
:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
HTTP Response Code: -1
Error HTTP Update!
:ref 1
:wr 193 0
:wrc 193 193 0
:wustmo
:close
HTTP Response Code: -11
Error HTTP Update!
:ur 1
:dsrcv 0
:del
:ref 1
:wr 193 0
:wrc 193 193 0
:wustmo
:close
HTTP Response Code: -11
Error HTTP Update!
:ur 1
:dsrcv 0
:del
:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
HTTP Response Code: -1
Error HTTP Update!
:ref 1
:wr 193 0
:wrc 193 193 0
:ack 193
:rn 268
:rch 268, 3
:rcl pb=0x3fff08b4 sz=271
:c 1, 268, 271
HTTP Response Code: 200
:c0 1, 3
HTTP Update Version: 3.7
:close
:ur 1
:dsrcv 0
:del
:ref 1

beicnet · 2020-06-16T09:44:44Z

@earlephilhower @d-a-v Any news?!

d-a-v · 2020-06-16T13:52:57Z

:ctmo means Connect Timeout.

It seems that your webserver is not responding to incoming connections sometimes.
Reported error is -1 "connection refused".

Also, error -11 = http read timeout following :wustmo is a slow tcp peer (your server).

void loop()
{
  if (millis() > upd_ready_time_now + upd_ready_period)
  {
    upd_ready_time_now = millis();
    checkForUpdates();
  }
}

What are the values ?
Can you print millis() before and after checkForUpdates() ?
Are you shaking your VB server too often ?
If you were using arduino IDE, I'd also ask for the HTTPClient debug mode, and tagging each debug lines with time.

Did you try to use HTTPCLient::setTimeout() ?

beicnet · 2020-06-16T19:18:51Z

@d-a-v Could it be the 10s request time period? (there will be 150 devices with same request).
Now I set the request period to be 25s, and now both prototype devices are working 24h without any errors shown.

What values?
Is HTTPCLient::setTimeout() non blocking?

But I have another theory here...

d-a-v · 2020-06-16T20:38:10Z

Is HTTPCLient::setTimeout() non blocking?

HTTPClient is blocking during at most the timeout.

But I have another theory here...

My theory:

  // if (millis() > upd_ready_time_now + upd_ready_period)    <= wrong test
  if ((millis() - upd_ready_time_now > upd_ready_period)
  {
    upd_ready_time_now = millis(); // or upd_ready_time_now+=upd_ready_period
    checkForUpdates();
  }

beicnet · 2020-06-16T20:56:12Z

@d-a-v Nah, I think the NFC module is jamming the ESP module...

d-a-v · 2020-06-16T21:01:20Z

My theory is still good, try to change your if.
And your theory is interesting, keep us informed.
Is you chip shielded like an esp-12 ?

beicnet · 2020-06-16T22:14:32Z

Yes, @d-a-v I changed the suggested "if", but it's the same.

HTTP Response Code: -1
Error HTTP Update!
HTTP Response Code: 200
HTTP Update Version: 3.8
HTTP Response Code: 200
HTTP Update Version: 3.8
HTTP Response Code: 200
HTTP Update Version: 3.8
HTTP Response Code: 200
HTTP Update Version: 3.8
HTTP Response Code: 200
HTTP Update Version: 3.8
HTTP Response Code: -1
Error HTTP Update!
HTTP Response Code: -2
Error HTTP Update!
HTTP Response Code: 200
HTTP Update Version: 3.8
HTTP Response Code: 200
HTTP Update Version: 3.8

If I comment out the rfid function from the loop then there is no issues whatsoever.

Yes, the chip is shielded!

beicnet · 2020-06-21T17:10:15Z

@TD-er Can you please verify for me something?

TD-er · 2020-06-21T18:26:53Z

@beicnet What do you want me to verify?

beicnet · 2020-06-21T18:28:23Z

@TD-er Do you have a PN532 module by your side?

TD-er · 2020-06-21T19:20:38Z

Not sure, have to dig in the drawer(s) of sensors.

beicnet · 2020-06-21T19:42:17Z

@TD-er I think there is an incompatibility in Adafruits PN532 and HTTPClient library, but I'm not quite sure, because there is no other person to confirm it, that's why I asked you for the module and to test it in SPI mode.

I can give you the MCVE to test it if you would willing to do it for me.

You need WeMos D1 mini, PN532 module and a 6-pin Dupont cable.

earlephilhower · 2020-06-21T20:40:48Z

I've gone over this and what I get as the end result is that with a specific NFC sensor placed next to the 8266 is enabled, WiFi has issues which are reflected in HTTPClient returning (correctly) failure occasionally. I'm not seeing any core issue here, more of a RF or power supply one.

Given that, this is not the right place for a HW discussion like this, so I suggest moving to https://esp8266.com or https://gitter.im/esp8266/Arduino . Closing.

beicnet · 2020-06-21T20:45:47Z

@earlephilhower If you put the NFC reader to 10cm dupont cable, you got the same results.
Did you test it or? How did you come to that conclusion?

beicnet · 2020-06-26T17:17:51Z

@earlephilhower @d-a-v I also tried across 20cm Dupont cable and the results are the same.

So, I don't think it's a hardware nor power supply issue.

I think it's library incompatibility (some sort of timing) issue.

You can read my full description on the forum.

d-a-v · 2020-06-26T17:53:27Z

To summarize: when library is not used, httpclient works.
When library is used, httpclient sometimes does not work.
When it does not work, it is unrelated to the sensor library: httpclient request is asking for some version.
Relevant code is

    HTTPClient updHttp;
    updHttp.setReuse(true);
    updHttp.begin(fwVerURL);

    int httpCode = updHttp.GET();

    Serial.println("HTTP Respose Code: " + String(httpCode));

    if (httpCode == 200) {
      String newFwTmpVersion = updHttp.getString();
      Serial.println("HTTP Update Version: " + newFwTmpVersion);
    } else {
      Serial.println("Error HTTP Update!");
    }
    updHttp.end();

Can you enable terminal timestamp and show an error with all debug options enabled ?
Better, also with these prints (so we know when things happen)
even better, with the wireshark log matching timestamp (netdump, netdumpv2 would have been useful here)

Serial.print("t1");
    HTTPClient updHttp;
    updHttp.setReuse(true);
    updHttp.begin(fwVerURL);
Serial.print("t2");

    int httpCode = updHttp.GET();
Serial.print("t3");

    Serial.println("HTTP Respose Code: " + String(httpCode));

    if (httpCode == 200) {
      String newFwTmpVersion = updHttp.getString();
      Serial.println("HTTP Update Version: " + newFwTmpVersion);
    } else {
      Serial.println("Error HTTP Update!");
    }
    updHttp.end();

beicnet · 2020-06-26T18:37:32Z

@d-a-v Thank you for replying, your summation is 99% correct.

with Function Enabled:

t1t2:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
t3HTTP Response Code: -1
Error HTTP Update!
t1t2:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
t3HTTP Response Code: -1
Error HTTP Update!
t1t2:ref 1
:ctmo
:abort
:ur 1
:dsrcv 0
:del
t3HTTP Response Code: -1
Error HTTP Update!

with Function Disabled:

t1t2:ref 1
:wr 185 0
:wrc 185 185 0
:ack 185
:rn 378
t3HTTP Response Code: 200
:c0 1, 378
HTTP Update Version: 3.9
:close
:ur 1
:dsrcv 0
:del
t1t2:ref 1
:wr 185 0
:wrc 185 185 0
:ack 185
:rn 378
t3HTTP Response Code: 200
:c0 1, 378
HTTP Update Version: 3.9
:close
:ur 1
:dsrcv 0
:del
t1t2:ref 1
:wr 185 0
:wrc 185 185 0
:ack 185
:rn 378
t3HTTP Response Code: 200
:c0 1, 378
HTTP Update Version: 3.9
:close
:ur 1
:dsrcv 0
:del

Also I tried to implement the ArduinoHttpClient.h library from another source, but got almost the same results.

d-a-v · 2020-06-26T21:06:06Z

With console timestamps + wireshark, or with one of the two netdumps, as described above, we will be able to check if packets are arriving onto the esp during the http timeout.

beicnet · 2020-06-26T22:08:46Z

@d-a-v I accidentally found out the solution,...

I put my hand onto PN532 module and it's started to give correct reading/requests.
If I removed my hand from it then I got bad reading/requests again.

And it's no matter how long cable you will put on the PN532 module (10cm or 20cm) or distance you put the module from ESP device.

Even after I taped Copper foil on the back of the PN532 module wouldn't do nothing.

@earlephilhower was almost right about one thing, but it was not the RF signal interference, it was the EMI impulses so hard that it was killing the whole ESP device.

So, I made an ESD cage for the PN532 module from Aluminium and Copper adhesive tape over Plexiglas stand.

Sorry for bother you, now we know a little bit more about red PN532 module and how can be used properly.

earlephilhower · 2020-06-27T03:17:30Z

Thanks for the follow up, @beicnet ! You may want to post something about this on the Adafruit library github so they can put it in their readme.md.

beicnet · 2020-06-27T11:39:36Z

@earlephilhower I already did that before 6 days ago, nobody replayed (nor interested), so I closed the issue yesterday on the Adafruits GIT page.

Anyway I got immediate response and better support here! 🥇 😉

devyte added the waiting for feedback Waiting on additional info. If it's not received, the issue may be closed. label Feb 2, 2020

earlephilhower closed this as completed May 26, 2020

earlephilhower reopened this Jun 13, 2020

earlephilhower closed this as completed Jun 21, 2020

ESP8266HTTPClient error -1 #6180

ESP8266HTTPClient error -1 #6180

Comments

Loucotolo commented Jun 4, 2019 • edited by d-a-v Loading

Basic Infos

Platform

Settings in IDE

Problem Description

[Sketch]

Debug Messages

devyte commented Jun 6, 2019

jpboucher commented Jun 14, 2019 • edited Loading

d-a-v commented Jun 17, 2019 • edited Loading

TD-er commented Jun 18, 2019

jpboucher commented Jun 18, 2019

d-a-v commented Jun 18, 2019

jpboucher commented Jun 18, 2019

TD-er commented Jun 18, 2019

devyte commented Feb 2, 2020

earlephilhower commented May 26, 2020

beicnet commented Jun 12, 2020 • edited Loading

earlephilhower commented Jun 12, 2020

beicnet commented Jun 12, 2020

earlephilhower commented Jun 12, 2020

beicnet commented Jun 12, 2020

earlephilhower commented Jun 12, 2020

beicnet commented Jun 12, 2020

earlephilhower commented Jun 12, 2020

beicnet commented Jun 12, 2020

TD-er commented Jun 13, 2020

beicnet commented Jun 13, 2020

TD-er commented Jun 13, 2020

beicnet commented Jun 13, 2020

TD-er commented Jun 13, 2020

d-a-v commented Jun 13, 2020

beicnet commented Jun 13, 2020 • edited Loading

d-a-v commented Jun 13, 2020

beicnet commented Jun 13, 2020 • edited Loading

earlephilhower commented Jun 13, 2020

beicnet commented Jun 13, 2020 • edited Loading

TD-er commented Jun 13, 2020

beicnet commented Jun 13, 2020 • edited Loading

d-a-v commented Jun 13, 2020 • edited Loading

beicnet commented Jun 13, 2020 • edited Loading

beicnet commented Jun 13, 2020 • edited Loading

beicnet commented Jun 16, 2020

d-a-v commented Jun 16, 2020 • edited Loading

beicnet commented Jun 16, 2020

d-a-v commented Jun 16, 2020

beicnet commented Jun 16, 2020

d-a-v commented Jun 16, 2020

beicnet commented Jun 16, 2020 • edited Loading

beicnet commented Jun 21, 2020

TD-er commented Jun 21, 2020

beicnet commented Jun 21, 2020

TD-er commented Jun 21, 2020

beicnet commented Jun 21, 2020 • edited Loading

earlephilhower commented Jun 21, 2020

beicnet commented Jun 21, 2020 • edited Loading

beicnet commented Jun 26, 2020 • edited Loading

d-a-v commented Jun 26, 2020

beicnet commented Jun 26, 2020 • edited Loading

d-a-v commented Jun 26, 2020 • edited Loading

beicnet commented Jun 26, 2020

earlephilhower commented Jun 27, 2020

beicnet commented Jun 27, 2020

Loucotolo commented Jun 4, 2019 •

edited by d-a-v

Loading

jpboucher commented Jun 14, 2019 •

edited

Loading

d-a-v commented Jun 17, 2019 •

edited

Loading

beicnet commented Jun 12, 2020 •

edited

Loading

beicnet commented Jun 13, 2020 •

edited

Loading

beicnet commented Jun 13, 2020 •

edited

Loading

beicnet commented Jun 13, 2020 •

edited

Loading

beicnet commented Jun 13, 2020 •

edited

Loading

d-a-v commented Jun 13, 2020 •

edited

Loading

beicnet commented Jun 13, 2020 •

edited

Loading

beicnet commented Jun 13, 2020 •

edited

Loading

d-a-v commented Jun 16, 2020 •

edited

Loading

beicnet commented Jun 16, 2020 •

edited

Loading

beicnet commented Jun 21, 2020 •

edited

Loading

beicnet commented Jun 21, 2020 •

edited

Loading

beicnet commented Jun 26, 2020 •

edited

Loading

beicnet commented Jun 26, 2020 •

edited

Loading

d-a-v commented Jun 26, 2020 •

edited

Loading