The basic process to get started with NodeMCU consists of the following three steps.
- Build the firmware with the modules you need
- Flash the firmware to the chip
- Upload code to the device.
You will typically do steps 1 and 2 only once, but then repeat step 3 as you develop your application. If your application outgrows the limited on-chip RAM then you can use the Lua Flash Store (LFS) to move your Lua code into flash memory, freeing a lot more RAM for variable data. This is why it is a good idea to enable LFS for step 1 if you are developing a larger application. As documented below there is a different approach to uploading Lua code.
!!! caution There's more than one way to skin a cat. For each of the tasks you have a number of choices with regards to tooling. The colored boxes represent an opinionated path to start your journey - the quickest way to success so to speak. Feel free to follow the links above to get more detailed information.
Task \ OS | Windows | macOS | Linux |
---|---|---|---|
Build firmware | cloud builder | cloud builder | cloud builder |
Docker | Docker | Docker | |
native | |||
Flash firmware | NodeMCU PyFlasher | NodeMCU PyFlasher | |
esptool.py | esptool.py | esptool.py | |
Upload code | ESPlorer (Java) | ESPlorer (Java) | ESPlorer (Java) |
NodeMCU-Tool (Node.js) | NodeMCU-Tool (Node.js) | NodeMCU-Tool (Node.js) | |
LFS tasks below | |||
Build LFS enabled firmware |
cloud builder | cloud builder | cloud builder |
Docker | Docker | Docker | |
native | |||
Build luac.cross | not needed if you use Terry's webservice or Docker to later compile LFS image | not needed if you use Terry's webservice or Docker to later compile LFS image | not needed if you use Terry's webservice or Docker to later compile LFS image |
native | native | native | |
Compile Lua into LFS image |
webservice | webservice | webservice |
Docker | Docker | Docker | |
native | native | native | |
Upload LFS image | generic | generic | generic |
How to read this
Use case: you're just starting with NodeMCU and your OS of choice is Windows (and you are not using LFS), then the blue boxes in the 'Windows' column are your guideline. You:
- build the firmware on the cloud builder
- download and run the NodeMCU PyFlasher to transfer the firmware to the device
- download and run ESPlorer, which requires Java, to transfer Lua files from your system to the device
Missing tools?
Our intention is to introduce you to programming in Lua on the ESP8266 as quickly as possible, so we have kept the number of tools mentioned here to a minimum; frightanic.com: Tools and IDEs discusses other tools and options.
!!! caution The below chapters are not meant to be followed one-by-one. Pick a task from the matrix above and it will take you to the relevant chapter.
The cloud builder at https://nodemcu-build.com allows to pick NodeMCU branch, modules and a few other configuration options (e.g. SSL yes/no). After the build is completed you will receive an email with two links to download your custom firmware:
- one for NodeMCU with floating support
- one for NodeMCU without floating support i.e. an integer-only binary
We recommend using the floating point build, even though the integer variant uses less RAM for storing variables, as there is little runtime difference between the two variants. Furthermore, the floating point variant handles non-integer values properly and this greatly simplifies numeric calculations.
For everything else the cloud builder GUI is self-explanatory. Hence, no need for further explanations here.
- Expand the "LFS options" panel
- Select an LFS size, 64KB is likely going to be large enough
- Select other options and build
Note that this service is not maintained by the NodeMCU team. It's run by a NodeMCU team member as an individual, though.
Self-contained NodeMCU flasher with GUI based on Python, esptool.py (see below) and wxPython. A runnable .exe is available for Windows and a .dmg for macOS.
No installation required on Windows and macOS! Instructions how to run it on other platforms are available on the project site.
- Install drivers for USB-to-serial. Which driver you need depends on the ESP8266 module or USB-to-serial converter you use.
- Connect USB cable to device and computer.
- Download then start PyFlasher
- Select serial port, browse for firmware binary and set the flash options.
Note that this tool is not an official NodeMCU offering. It's maintained by a NodeMCU team member as an individual, though.
esptool.py was started as a ESP8266 community effort but has since been adopted by Espressif. It's their officially recommended way to flash firmware to ESPxxx chips.
- Install drivers for USB-to-serial. Which driver you need depends on the ESP8266 module or USB-to-serial converter you use.
- Install either Python 2.7 or Python >=3.4 on your system if it's not available yet.
- Connect USB cable to device and computer.
$ pip install esptool
(also installs pySerial)$ esptool.py --port <serial-port-of-ESP8266> --baud <baud-rate> write_flash -fm <flash-mode> 0x00000 <nodemcu-firmware>.bin
flash-mode
is qio
for most ESP8266 ESP-01/07 (512 kByte modules) and dio
for most ESP32 and ESP8266 ESP-12 (>=4 MByte modules). ESP8285 requires dout
.
The default baud rate is 115200. Most hardware configurations should work with 230400 dependent on OS, driver, and module. NodeMCU and WeMos modules are usually ok with 921600.
More details available on esptool.py GitHub repo.
TBD https://github.com/4refr0nt/ESPlorer
Arguably NodeMCU-Tool, which requires Node.js, is the better code upload & execution tool than ESPlorer. Also, in contrast to the former it is very well maintained. However, we also understand that Windows users in general prefer GUI over command line.
The list of features is quite long but essentially NodeMCU-Tool offers:
- upload (Lua) files from your host system to the device
- manage the device file system (delete, up-/download, etc.)
- run files on NodeMCU and display the output over UART/serial
Quick start:
- Install Node.js and NPM if not available yet
- Install NodeMCU-Tool globally
$ npm install nodemcu-tool -g
- Verify installation by runnin
$ nodemcu-tool --version
- Upload a Lua file
$ nodemcu-tool upload --port=/dev/ttyUSB0 helloworld.lua
- Run it
$ nodemcu-tool run helloworld.lua
Note that you may need to use the sudo
prefix to install the tool at step 2, and also possibly add the –unsafe-perm
flag after the install command.
The Docker NodeMCU build image is the easiest method to build NodeMCU related components locally on your preferred platform.
Offering:
- build NodeMCU firmware based on locally cloned sources and configuration
- cross-compile Lua files into LFS image locally
Detailed instructions available in the image's README. As for available config options check the documentation and study the comments in app/include/user_config.h
.
- In
app/include/user_config.h
edit the line#define LUA_FLASH_STORE 0x0
and adjust the size to that needed. Note that this must be a multiple of 4Kb. - Build as you would otherwise build with this image (i.e. see its README)
Note that this Docker image is not an official NodeMCU offering. It's maintained by a NodeMCU team member as an individual, though.
A local copy of luac.cross
is only needed if you want to compile the Lua files into an LFS image yourself and you are not using Docker.
Windows users can compile a local copy of the luac.cross
executable for use on a development PC. To this you need:
- To download the current NodeMCU sources (this dev ZIP file or master ZIP file) and unpack into a local folder, say
C:\nodemcu-firmware
; choose the master / dev versions to match the firmware version that you want to use. If you want an Integer buld then edit theapp/includes/user_config.h
file to select this. - Choose a preferred toolchain to build your
luac.cross
executable. You have a number of options here:- If you are a Windows 10 user with the Windows Subsystem for Linux (WSL) already installed, then this is a Linux environment so you can follow the Linux build instructions below.
- A less resource intensive option which works on all Windows OS variants is to use Cygwin or MinGW, which are varaint ports of the GNU Compiler Collection to Windows and which can both compile to native Windows executables. In the case of Cygwin, install Cygwin (selecting the Cygwin core + gcc-core + gnu make in the install menu). In the case of MinGW you again only need a very basic C build environment so install the MINGW; you only need the core GCC and mingw32-make. Both both these create a Cmd prompt which paths in the relevant GCC toolchain. Switch to the
app/lua/luac_cross
and run make to build the compiler in the NodeMCU firmware root directory. You do this by rningmake
in Cygwin andmingw32-make -f mingw32-Makefile.mak
in MinGW. - If you can C development experience on the PC and a version of the MS Visual Studio on your PC then you can also simply build the image using the supplied MS project file.
- Once you have a built
luac.cross
executable, then you can use this to compile Lua code into an LFS image. You might wish to move this out of the nodemcu-firmware hierarchy, since this folder hierarchy is no longer required and can be trashed.
- Ensure that you have a "build essential" GCC toolchain installed.
- Download the current NodeMCU sources (this dev ZIP file or master ZIP file) and unpack into a local folder; choose the master / dev versions to match the firmware version that you want to use. If you want an Integer buld then edit the
app/includes/user_config.h
file to select this. - Change directory to the
app/lua/luac_cross
sub-folder - Run
make
to build the executable. - Once you have a built
luac.cross
executable, then you can use this to compile Lua code into an LFS image. You might wish to move this out of the nodemcu-firmware hierarchy, since this folder hierarchy is no longer required and can be trashed.
As for Linux
The easiest approach is to maintain all the Lua files for your project in a single directory on your host. (These files will be compiled by luac.cross
to build the LFS image in next step.)
For example to run the Telnet and FTP servers from LFS, put the following files in your project directory:
- lua_examples/lfs/_init.lua. LFS helper routines and functions.
- lua_examples/lfs/dummy_strings.lua. Moving common strings into LFS.
- lua_examples/telnet/telnet.lua. A simple telnet server.
- lua_modules/ftp/ftpserver.lua. A simple FTP server.
You should always include the first two modules, but the remaining files would normally be replaced by your own project files. Also remember that these are examples and that you are entirely free to modify or to replace them for your own application needs.
https://blog.ellisons.org.uk/article/nodemcu/a-lua-cross-compile-web-service/
Note: read up on selecting Lua files first
Upload a ZIP file with all your Lua files ready for LFS. The webservice will cross-compile them into a .img
ready to be uploaded to the device. It supports LFS images for both floating point and integer firmware variants.
Further details available on the service site.
Note that this service is not maintained by the NodeMCU team. It's run by a NodeMCU team member as an individual, though.
Note: read up on selecting Lua files first
The same Docker image you used to build the NodeMCU firmware can be used to compile Lua files into an LFS image.
$ cd <your-nodemcu-firmware-folder>
$ docker run --rm -ti -v
pwd:/opt/nodemcu-firmware -v {PathToLuaSourceFolder}:/opt/lua marcelstoer/nodemcu-build lfs-image
Note: read up on selecting Lua files first
For Windows you will do this from within the WSL / Cygwin command window, both of which use the bash
shell.
$ cd <project-dir>
$ luac.cross -o lfs.img -f *.lua
You will need to adjust the img
and lua
paths according to their location, and ensure that luac.cross
is in your $PATH
search list. For example if you are using WSL and your project files are in D:\myproject
then the Lua path would be /mnt/d/myproject/*.lua
(For cygwin replace mnt
by cygwin
). This will create the lfs.img
file if there are no Lua compile errors (again specify an explicit directory path if needed).
You might also want to add a simple one-line script file to your ~/bin
directory to wrap this command up.
The compiled LFS image file (e.g. lfs.img
) is uploaded as a regular file to the device file system (SPIFFS). You do this just like with Lua files with e.g. ESPlorer or NodeMCU-Tool. There is also a new example, HTTP_OTA.lua, in lua_examples
that can retrieve images from a standard web service.
Once the LFS image file is on SPIFFS, you can execute the node.flashreload() command and the loader will then load it into flash and immediately restart the ESP module with the new LFS loaded, if the image file is valid. However, the call will return with an error if the file is found to be invalid, so your reflash code should include logic to handle such an error return.
init.lua
is the file that is first executed by the NodeMCU firmware. Usually it setups the WiFi connection and executes the main Lua application. Assuming that you have included the _init
file discussed above, then executing this will add a simple API for LFS module access:
- Individual functions can be executed directly, e.g.
LFS.myfunc(a,b)
- LFS is now in the require path, so
require 'myModule'
works as expected.
Do a protected call of this _init
code: pcall(node.flashindex("_init"))
and check the error status. See Programming Techniques and Approachs in the LFS whitepaper for a more detailed description.
Below is a brief overview of building and running the simplest LFS-based system possible.
To use LFS, start with a version of NodeMCU with LUA_FLASH_STORE
set in app/include/user_config.h
, and load it on the ESP8266 in the usual way (whatever that is for your set up).
Then build an LFS file system. This can be done in several ways, as discussed above; one of the easiest is to use luac.cross -f -o lfs.img *lua
on the host machine. The file lua_examples/lfs/_init.lua should definitely be included in the image, since it's the easiest way of registering the LFS modules. The lfs.img
file can then be downloaded to the ESP8266 just like any other file.
The next step is to tell the ESP8266 that the LFS file system exists. This is done with eg. node.flashreload("lfs.img"), which will trigger a reset, followed by node.flashindex("_init")() to register the modules; logging into the esp8266 and running the following commands gives an overview of the command sequence, given a main.lua file consisting of the line print("LFS main() module")
>
> node.flashreload("lfs.img")
-- flashreload() triggers a reset here.
> print(LFS)
nil
> node.flashindex("_init")()
-- LFS is now initialised.
> print(LFS)
table: 3fff06e0
-- List the modules in the LFS.
> print(LFS._list)
table: 3fff0728
> for k,v in pairs(LFS._list) do print(k,v) end
1 dummy_strings
2 _init
3 main
-- Call the LFS main() module.
> LFS.main()
LFS main() module
>
Note that no error correction has been used, since the commands are intended to be entered at a terminal, and errors will become obvious.
Then you should set up the ESP8266 boot process to check for the existence of an LFS image and run whichever module is required. Once the LFS module table has been registered by running lua_examples/lfs/_init.lua , running an LFS module is simple a matter of eg: LFS.main()
.
node.flashreload() need only be rerun if the LFS image is updated; after it has loaded the LFS image into flash memory the original file (in SPIFFS) is no longer used, and can be deleted.
Once LFS is known to work, then modules such as lua_examples/lfs/dummy_strings.lua can usefully be added, together of course with effective error checking.