Suggestions about the Wiki Websites

[MatthewJeffson]

Welcome to our product documentation platform! We value user feedback and contributions, so we couldn’t be more grateful that you can help us improving the documentation.

Hence, if you find obvious errors in the product documentation, or you have additional ideas and insights about using products, please contribute to us.

As you may guess already, once you comment at the bottom of the wiki, a new discussion will arise here in the GitHub 'Discussions' channel. We want this function alive, as presenting the questions and solutions regarding the product you are looking at.

Nonetheless, we hope you find it helpful with the help of others. We will clean it up on a monthly basis.

[SoothingMist]

Am developing proofs-of-concept in precision irrigation (https://github.com/SoothingMist). Have successfully used Seeed sensors in LoRa remote monitoring. Want now to demonstrate Arduino Mega 2560 and sending complex data structures via LoRa. The sensor in question is an RGB camera. To date, I have been unable to find a combination of Mega, LoRa, and camera that is workable. Incombatibilities prevent the combinations tried to date. Does Seeed offer a camera/lora "kit" that is compatible with the Arduino Mega 2560?

[MatthewJeffson]

Hi, it indeed is an interesting idea. If you want to build it with us together, you can refer to here for getting more help!
Regards!

[mneuhaus]

I really love your little Seeed Modules, i'd love to use them for some projects, but sadly i'm currently running around it in circles because somehow i'm either to stupid or there are some problems deeper down i can't figure out.

i'd love to use these Modules, especially the esp32c3 and esp32s3 with [ESPHome)(https://esphome.io/) and i saw, that you have a small example for the C3 Variant in the Wiki, sadly both of these boards seem to be quite unreliable running ESPHome, either they don't boot at all, go into bootloops, don't connect to Wifi, etc.

I also had quite some problems to actually get logs out of these little boards through the usb connection because of the serial chip used, with the arduino platform i mostly got really low level bootloader logs that did not really help, the jtag/cdc was kinda only available with the esp-idf platform which on the other hand doesn't support the webserver yet.

Could you please create a working example with working wifi/bluetooth & webserver for the s3 and c3 boards, that would be so awesome and also open these budget friendly little boards to so many possibilites.

Thank you!

[MatthewJeffson]

Thank you for your interest in our products! Our development is progressing according to plan. :D

[mneuhaus]

Hey, i'm not really sure what you want to convey with that message, are there documentations/examples in development right now for esphome?

[MatthewJeffson]

We are developing various application examples based on our boards, take esphome as examples:
1. Using "24GHz mmWave Human Static Presence Module Lite" and "XIAO ESP32C3" to build a Home Assistant with human presence detection.
2. Using all kinds of Grove modules and "ODYSSEY board" and "XIAO ESP32C3" to connect Grove modules to Seeed Studio XIAO ESP32C3 so that users can display sensor data or control the devices using Home Assistant
We are developing all kinds of applications, according to our plan, including but not limited to the esphome.
Hope this can make it clearer. :D

[jims1234]

I just received a few XAIO ESP32 C3 devices and a " Grove Beginner Kit for Arduino" and am very excited to learn more using them. But, frankly was taken back by the fact that the sensor kit is seems entirely dependent on use of your Arduino UNO clone board to interface them thru it ( while I want to wire C3 modules directly to each sensor module instead.) And, so far the only ESP23 C3 compatible demo code seems to be wrapped around a very complex ( to me) Home Assistant iOT Network app that I don't need or want right now..

In spite of that.. I am very encouraged by what I see here in this Wiki including some detail on some of the sensor modules and their pin-outs, data sheet and sample code so I hope I can make progress in figuring hot how to use these very cool little modules like the XIAO ESP32 C3 directly with sensors.

[MatthewJeffson]

Hi, we will try to make our wiki as better as possible and provide more detailed content so you can use it more conveniently and clearly.
If you have good ideas, you are welcome to submit(pull request) them to us.

[MatthewJeffson]

Welcome to our product documentation platform! We value user feedback and contributions, so we couldn’t be more grateful that you can help us improving the documentation.

Hence, if you find obvious errors in the product documentation, or you have additional ideas and insights about using products, please contribute to us.

If you need technical support, you can email it to [email protected].

If you want to discuss the product, I recommend the Seeed Studio Forum and Seeed Studio Discord Channel

The "Discussion channel" in Github here is a relatively new addition and may not receive much attention.

Nonetheless, we hope you find it helpful with the help of others. We will clean it up on a monthly basis.

[Parkre01]

I got my MPU5060 accelerometer working (thru I2C) but now, I cannot for the life of me figure out how to get the MQTT protocol working. Any directions or tuturials would be extremely helpful.

[johnpiker]

Why I am not able to start the recording wen i plug the ESP32 S3 to the power plug

[faizannazir]

Nrf52 library mentioned in documentation is not available in arduino ide library manager and zip file link is not provided in ddocumentation

[Yjppj]

The echo cancellation effect of Respeaker Mic v2 is very poor

[jamesdinsmore]

I found a code error on the Grove Light Sensor Wiki for the Arduino code:
It reads:
#include <Grove_LED_Bar.h>

Grove_LED_Bar bar(3, 2, 0); // Clock pin, Data pin, Orientation
it should be:
#include <Grove_LED_Bar.h>
Grove_LED_Bar bar(3, 2, 0, LED_BAR_10); // Clock pin, Data pin, Orientation

Without the LED_BAR_10 it will not work.

James

[djairjr]

I adapted Marcelo Rovai's code using the Seeed Xiao ESP32-S3 Sense and the Round Display to display bounding boxes on the display while detecting objects using Edge Impulse Arduino Library.

In my case, I noticed that the bounding boxes were appearing very small on the TFT display. After much investigation, I understood that, although the camera was set to a frame size of 240x240, somehow the coordinates on the display did not reflect this and gave the impression of being set to the camera's maximum resolution of 1600x1200. That's why I had to make the compensation, multiplying the width by 6 (6,667....) and the height by 5.

Here is my code:

/* Adding TFT Support Libraries */
#include <Arduino.h>
#include <TFT_eSPI.h>
#include <SPI.h>

/* Adding Edge Impulse Inferencing Library */
#include <Add_Your_inferencing_here.h> // Remember to change this line!
#include "edge-impulse-sdk/dsp/image/image.hpp"

/* Adding ESP32S3 Sense Camera Support */
#include "esp_camera.h"

#define CAMERA_MODEL_XIAO_ESP32S3 // Has PSRAM

#define PWDN_GPIO_NUM     -1
#define RESET_GPIO_NUM    -1
#define XCLK_GPIO_NUM     10
#define SIOD_GPIO_NUM     40
#define SIOC_GPIO_NUM     39
#define Y9_GPIO_NUM       48
#define Y8_GPIO_NUM       11
#define Y7_GPIO_NUM       12
#define Y6_GPIO_NUM       14
#define Y5_GPIO_NUM       16
#define Y4_GPIO_NUM       18
#define Y3_GPIO_NUM       17
#define Y2_GPIO_NUM       15
#define VSYNC_GPIO_NUM    38
#define HREF_GPIO_NUM     47
#define PCLK_GPIO_NUM     13

#define TOUCH_INT D7

/* Original EDGE IMPULSE example parameters 
*  Change Camera Capture to display same size as TFT 
*/
#define EI_CAMERA_RAW_FRAME_BUFFER_COLS           240
#define EI_CAMERA_RAW_FRAME_BUFFER_ROWS           240
#define EI_CAMERA_FRAME_BYTE_SIZE                 3

/* Private variables */
static bool debug_nn = false; // Set this to true to see e.g. features generated from the raw signal
static bool is_initialised = false;
uint8_t *snapshot_buf; //points to the output of the capture

/* Camera Config Parameters */
static camera_config_t camera_config = {
  .pin_pwdn = PWDN_GPIO_NUM,
  .pin_reset = RESET_GPIO_NUM,
  .pin_xclk = XCLK_GPIO_NUM,
  .pin_sscb_sda = SIOD_GPIO_NUM,
  .pin_sscb_scl = SIOC_GPIO_NUM,

  .pin_d7 = Y9_GPIO_NUM,
  .pin_d6 = Y8_GPIO_NUM,
  .pin_d5 = Y7_GPIO_NUM,
  .pin_d4 = Y6_GPIO_NUM,
  .pin_d3 = Y5_GPIO_NUM,
  .pin_d2 = Y4_GPIO_NUM,
  .pin_d1 = Y3_GPIO_NUM,
  .pin_d0 = Y2_GPIO_NUM,
  .pin_vsync = VSYNC_GPIO_NUM,
  .pin_href = HREF_GPIO_NUM,
  .pin_pclk = PCLK_GPIO_NUM,

  //XCLK 20MHz or 10MHz for OV2640 double FPS (Experimental)
  .xclk_freq_hz = 10000000,
  .ledc_timer = LEDC_TIMER_0,
  .ledc_channel = LEDC_CHANNEL_0,

  /* This config pixel format needed to be the same in function ei_camera_capture ()
                                                        HERE 
     bool converted = fmt2rgb888(fb->buf, fb->len, PIXFORMAT_RGB565, snapshot_buf);

  */
  .pixel_format = PIXFORMAT_RGB565,     //YUV422,GRAYSCALE,RGB565,JPEG
  .frame_size = FRAMESIZE_240X240,      //QQVGA-UXGA Do not use sizes above QVGA when not JPEG

  .jpeg_quality = 12, //0-63 lower number means higher quality
  .fb_count = 2,       //if more than one, i2s runs in continuous mode. Use only with JPEG
  .fb_location = CAMERA_FB_IN_PSRAM, // Frame Buffer in PSRAM - YES!
  .grab_mode = CAMERA_GRAB_WHEN_EMPTY,
};

/* Function definitions ------------------------------------------------------- */
bool ei_camera_init(void);
void ei_camera_deinit(void);
bool ei_camera_capture(uint32_t img_width, uint32_t img_height, uint8_t *out_buf) ;

/* Create TFT_SPI object */
TFT_eSPI tft = TFT_eSPI();

/* Bounding Boxes Coordinates need to be uint32_t in TFTeSPI Library */
uint32_t x;
uint32_t y;
uint32_t w;
uint32_t h;

/**
  @brief      Arduino setup function
*/
void setup()
{
  // put your setup code here, to run once:
  Serial.begin(115200);
  //comment out the below line to start inference immediately after upload
  // while (!Serial);

  /* Init TFT */
  tft.init();
  tft.setRotation(3); // This is needed too. In order to get correct positions for bounding boxes
  tft.fillScreen(TFT_WHITE);

  if (ei_camera_init() == false) {
    ei_printf("Failed to initialize Camera!\r\n");
  }
  else {
    ei_printf("Camera initialized\r\n");
  }

  ei_printf("\nStarting continious inference in 2 seconds...\n");
  ei_sleep(2000);
}

/**
  @brief      Get data and run inferencing

  @param[in]  debug  Get debug info if true
*/
void loop()
{

  // instead of wait_ms, we'll wait on the signal, this allows threads to cancel us...
  if (ei_sleep(5) != EI_IMPULSE_OK) {
    return;
  }

  snapshot_buf = (uint8_t*)malloc(EI_CAMERA_RAW_FRAME_BUFFER_COLS * EI_CAMERA_RAW_FRAME_BUFFER_ROWS * EI_CAMERA_FRAME_BYTE_SIZE);

  // check if allocation was successful
  if (snapshot_buf == nullptr) {
    ei_printf("ERR: Failed to allocate snapshot buffer!\n");
    return;
  }

  /* The signal that will be inferred is this one */
  ei::signal_t signal;
  signal.total_length = EI_CLASSIFIER_INPUT_WIDTH * EI_CLASSIFIER_INPUT_HEIGHT;
  signal.get_data = &ei_camera_get_data;

  /*  Makes the call to the ei_camera_capture function, 
   *  which captures the image to the framebuffer, 
   *  converts the image to the correct format and resizes it. 
  */
  if (ei_camera_capture((size_t)EI_CLASSIFIER_INPUT_WIDTH, (size_t)EI_CLASSIFIER_INPUT_HEIGHT, snapshot_buf) == false) {
    ei_printf("Failed to capture image\r\n");
    free(snapshot_buf);
    return;
  }

  // Run the classifier
  ei_impulse_result_t result = { 0 };

  EI_IMPULSE_ERROR err = run_classifier(&signal, &result, debug_nn);
  if (err != EI_IMPULSE_OK) {
    ei_printf("ERR: Failed to run classifier (%d)\n", err);
    return;
  }

  // Print the predictions to Serial Debug
  ei_printf("TFT Example -  Predictions (DSP: %d ms., Classification: %d ms., Anomaly: %d ms.): \n",
            result.timing.dsp, result.timing.classification, result.timing.anomaly);

#if EI_CLASSIFIER_OBJECT_DETECTION == 1
  bool bb_found = result.bounding_boxes[0].value > 0;

  for (size_t ix = 0; ix < result.bounding_boxes_count; ix++) {
    auto bb = result.bounding_boxes[ix];
    if (bb.value == 0) {
      continue;
    }
    /* 
      commenting this line, just to compare dimensions above
      ei_printf("   %s (%f) [ x: %u, y: %u, width: %u, height: %u ]\n", bb.label, bb.value, bb.x, bb.y, bb.width, bb.height);
    
    */
    
    /* Create Coordinates and Size for Bounding Boxes */
    x = bb.x;
    y = bb.y;
    w = bb.width * 6; // Do compensations. The camera resize the frame to 240x240 but this does not reflect in 
    h = bb.height * 5; // TFT display coordinates. So you need to multiple this values...

    /* Checking Sizes */ 
    ei_printf("BB Coord [ x: %u, y: %u, width: %u, height: %u ]\n",  bb.x, bb.y, bb.width, bb.height);
    ei_printf("TFT Coord [ x: %u, y: %u, width: %u, height: %u ]\n",  x, y, w, h);

    /* Draw Bounding Boxes in Display */
    tft.drawRect (x, y, w, h, TFT_GREEN);
    
  }
  if (!bb_found) {
    ei_printf("TFT Example -     No objects found\n");
   
  }
#else
  for (size_t ix = 0; ix < EI_CLASSIFIER_LABEL_COUNT; ix++) {
    ei_printf("    %s: %.5f\n", result.classification[ix].label,
              result.classification[ix].value);
  }
#endif

#if EI_CLASSIFIER_HAS_ANOMALY == 1
  ei_printf("TFT Example -     anomaly score: %.3f\n", result.anomaly);
#endif


  free(snapshot_buf);

}

/**
   @brief   Setup image sensor & start streaming

   @retval  false if initialisation failed
*/
bool ei_camera_init(void) {

  if (is_initialised) return true;

#if defined(CAMERA_MODEL_ESP_EYE)
  pinMode(13, INPUT_PULLUP);
  pinMode(14, INPUT_PULLUP);
#endif

  //initialize the camera
  esp_err_t err = esp_camera_init(&camera_config);
  if (err != ESP_OK) {
    Serial.printf("Camera init failed with error 0x%x\n", err);
    return false;
  }

  sensor_t * s = esp_camera_sensor_get();
  // This is needed too. In order to get correct positions for bounding boxes
  s->set_vflip(s, 1);
  s->set_hmirror(s, 1);

  is_initialised = true;
  return true;
}

/**
   @brief      Stop streaming of sensor data
*/
void ei_camera_deinit(void) {

  //deinitialize the camera
  esp_err_t err = esp_camera_deinit();

  if (err != ESP_OK)
  {
    ei_printf("Camera deinit failed\n");
    return;
  }

  is_initialised = false;
  return;
}


/**
   @brief      Capture, rescale and crop image

   @param[in]  img_width     width of output image
   @param[in]  img_height    height of output image
   @param[in]  out_buf       pointer to store output image, NULL may be used
                             if ei_camera_frame_buffer is to be used for capture and resize/cropping.

   @retval     false if not initialised, image captured, rescaled or cropped failed

*/
bool ei_camera_capture(uint32_t img_width, uint32_t img_height, uint8_t *out_buf) {
  bool do_resize = false;

  if (!is_initialised) {
    ei_printf("ERR: Camera is not initialized\r\n");
    return false;
  }

  camera_fb_t *fb = esp_camera_fb_get();

  if (!fb) {
    ei_printf("Camera capture failed\n");
    return false;
  }
/*  Write camera captured framebuffer into TFT Display */
  tft.startWrite();
  tft.setAddrWindow(0, 0, EI_CAMERA_RAW_FRAME_BUFFER_COLS, EI_CAMERA_RAW_FRAME_BUFFER_ROWS);
  tft.pushColors(fb->buf, fb->len);
  tft.endWrite();

/*  Pay attention to this PIXFORMAT_RGB565 parameter in camera config. Need to be equal or convertion will fail  */
  bool converted = fmt2rgb888(fb->buf, fb->len, PIXFORMAT_RGB565, snapshot_buf);

  esp_camera_fb_return(fb);

  if (!converted) {
    ei_printf("Conversion failed\n");
    return false;
  }

  if ((img_width != EI_CAMERA_RAW_FRAME_BUFFER_COLS)
      || (img_height != EI_CAMERA_RAW_FRAME_BUFFER_ROWS)) {
    do_resize = true;
  }

  if (do_resize) {
    ei::image::processing::crop_and_interpolate_rgb888(
      out_buf,
      EI_CAMERA_RAW_FRAME_BUFFER_COLS,
      EI_CAMERA_RAW_FRAME_BUFFER_ROWS,
      out_buf,
      img_width,
      img_height);
  }

  return true;
}

static int ei_camera_get_data(size_t offset, size_t length, float *out_ptr)
{
  // we already have a RGB888 buffer, so recalculate offset into pixel index
  size_t pixel_ix = offset * 3;
  size_t pixels_left = length;
  size_t out_ptr_ix = 0;

  while (pixels_left != 0) {
    out_ptr[out_ptr_ix] = (snapshot_buf[pixel_ix] << 16) + (snapshot_buf[pixel_ix + 1] << 8) + snapshot_buf[pixel_ix + 2];

    // go to the next pixel
    out_ptr_ix++;
    pixel_ix += 3;
    pixels_left--;
  }
  // and done!
  return 0;
}

#if !defined(EI_CLASSIFIER_SENSOR) || EI_CLASSIFIER_SENSOR != EI_CLASSIFIER_SENSOR_CAMERA
#error "Invalid model for current sensor"
#endif

[MatthewJeffson]

Wow! @djairjr Djair, this looks really interesting!

[qrstu]

Hello you missed for XIAO ESP32C6 in Wiki that the external antenna gets aktive.
GPIO 3 has to be OUTPUT LOW --> Missing in Wiki
GPIO 14 has to be OUTPUT HIGH
See --> https://forum.seeedstudio.com/t/xiao-esp32c6-switching-between-builtin-and-external-antenna/276374
https://wiki.seeedstudio.com/xiao_esp32c6_getting_started/

[acostach]

Hi @MatthewJeffson , I see the provisioning methods have changed for the J4012 and J3010. These are devices that we support in balenaOS on L4T 35.4.1 and 35.5.0, and we'd like to update to Jetpack 6. Would it be possible to share:

1. The patch on top of standard L4T 36.3 BSP for J4012 and J3010, similar to how it was provided for Jetpack 5 (i.e : "Step 4: Open the file "tegra234-mb2-bct-scr-p3767-0000.dts" and add the following lines under tfc section")

2. The method that should be used for generating UEFI Update capsules in L4T 36.3, so we can provide updates. If you give us the diffs at step 1) we should be able to generate the capsules using standard Jetpack + the Seeed changes.

Thanks!

[MatthewJeffson]

Wow! Thank you @acostach for your kindly offer! We have actually launched the Jetpack Flash for the J401 Carrier Board, i.e.
reComputer J3010, reComputer J3011, reComputer J4011, reComputer J4012 are all supporting Jetpack 6.0 now:D
Best Regards,
Matthew

reComputer J3010 reComputer J3011 reComputer J4011 reComputer J4012

[acostach]

Hi @MatthewJeffson and thanks for the links. I've seen that you launched Jetpack flash but what I would actually need is the patches Seeed applies for J3010 and J4012 on top of the standard Nvidia BSP for Jetpack 6.

We need the diffs or patches, so we can integrate these two devices on Jetpack 6 too, and build UEFI capsule updates to OTA transition from Jetpack 5 to Jetpack 6 for the customers who are already using the J3010 and J4012 in their balena fleets.

Perhaps you could help me by sharing these patches?

Thank you

[acostach]

Just for clarity, the patches we'd need are the same as the ones you already provide for Jetpack 5 at https://wiki.seeedstudio.com/reComputer_J4012_Flash_Jetpack/ -> click on JP5.1.2 -> Steps 1 -> 6, i.e:

Here we will use NVIDIA L4T 35.4.1 to install Jetpack 5.1.2 on the reComputer

Step 1: [Download](https://developer.nvidia.com/embedded/jetson-linux-r3541) the NVIDIA drivers on the host PC. The required drivers are shown below:

Step 2: Extract Jetson_Linux_R35.4.1_aarch64 and Tegra_Linux_Sample-Root-Filesystem_R35.4.1_aarch64 by navigating to the folder containing these files, apply the changes and install the necessary prerequisites

tar xf Jetson_Linux_R35.4.1_aarch64
sudo tar xpf Tegra_Linux_Sample-Root-Filesystem_R35.4.1_aarch64 -C Linux_for_Tegra/rootfs/
cd Linux_for_Tegra/
sudo ./apply_binaries.sh
sudo ./tools/l4t_flash_prerequisites.sh

Now we need to apply a patch from NVIDIA which is needed for JP5.1.2 and explained [here](https://docs.nvidia.com/jetson/archives/r35.4.1/ReleaseNotes/Jetson_Linux_Release_Notes_r35.4.1.pdf) in section 4.2.3 of the official NVIDIA JetPack Release Notes.

Step 3: Navigate to the following directory

cd Linux_for_Tegra/bootloader/t186ref/BCT

Step 4: Open the file "tegra234-mb2-bct-scr-p3767-0000.dts" and add the following lines under tfc section

tfc {
    reg@322 { /* GPIO_M_SCR_00_0 */
    exclusion-info = <2>;
    value = <0x38008080>;
    };

Also, if it's only the reg@322 that needs to be applied on Jetpack 6 too, please let me know.

[Teodor-Ciobanu]

Hi there, great stuff!
I wander if this, or perhaps there is other project which would record a few seconds and based on the recording to trigger if matched found. I mean not voice but some other sound like whistle, claps, multiple knocks...

[techbel]

Hi, I adapted a micropython library for grove I2C motor driver TB6612FNG on ESP32. I especially wanted stepper motor control.
My first project on Github. The main work is done, tested with Thonny IDE and wroom ESP32. I will add examples for basic use.
https://github.com/techbel/ESP32_TB6612FNG