Skip to main content

Connect Grove Vision AI V2 to the SenseCAP Mate APP

SenseCAP Mate APP is a powerful APP for data visualization and remote device management.

  • Save time: provides a scan-and-play experience to enable users to complete the whole configuration in 4 steps
  • Works for people with less or no technical background to get started with sensor data easily
  • Acquire and view data on clean user interfaces
  • Set time intervals: improve the battery efficiency
  • Set threshold values: focus on the data you need to take action for
  • Send alarms if data is out of the safe range

This tutorial will guide you on how to access Grove Vision AI V2 and XIAO ESP32C3 to SenseCAP Mate APP.

Getting Started

Before the tutorial content of this article begins, you may need to have the following hardware ready.

Materials Required

Seeed Studio XIAO ESP32C3Grove Vision AI V2OV5647-62 FOV Camera Module
for Raspberry Pi 3B+4B

You then need to connect the XIAO and Grove Vision AI V2 via the row of pins (or use the expansion board and Grove interface).

Software Preparation

Connect the XIAO ESP32C3 to your computer using a suitable USB-C cable. Ensure the device drivers are installed correctly.

Open the SenseCraft Model Assistant Tool in your web browser. This might be a service provided by the manufacturer or a third-party tool designed for flashing ESP devices.

Then select XIAO ESP32S3 and click Connect.

caution

Note that although the XIAO ESP32S3 is selected here, we are still using the XIAO ESP32C3!

Click the button below to download the firmware file and click the Add File button on the web page to flash the XIAO_C3_as_AT_module.bin firmware for the 0x0 address.

Finally, click the Flash button and wait for the programme to be uploaded successfully before disconnecting the XIAO ESP32C3 from the computer.

Register for a SenseCAP account and software preparation

Step 1. Register for a SenseCAP account

If you are using SenseCAP for the first time, then you may need to register an account on the SenseCAP website.

After registering, please log in to the SenseCAP website.

Step 2. Download the SenseCAP Mate APP to your mobile phone.

If you want to check your device's messages anytime, anywhere, you may want to consider installing the SenseCAP Mate APP, a mobile device that uses SenseCAP. By clicking the button below, you can choose to install the SenseCAP Mate APP in a way that suits you.

Device Configuration in SenseCAP

Step 3. Add Device

Let's go back to the web side and start by adding a Grove Vision AI V2.

In the catalogue bar on the left side of the page, select Development Kit and click the Create Development Kit button in the middle.

Please name your device and select the device as Grove - Vision AI V2 and click on the Confirm button.

After creating a new device, please click the Connect button on the right side of the device, and a series of pop-ups will be displayed to connect the required devices.

Please keep these credentials information, we will use them later in the network configuration.

SenseCraft AI model preparation and MQTT configuration

Step 4. Connect the Grove Vision AI V2 to the SenseCraft AI Model Assistant

Let's continue the steps above by clicking on the Deploy button in the middle of the page, at which point we will jump directly to the SenseCraft AI model deployment page.

Step 5. Upload a suitable model

First select Grove - Vision AI V2 in the catalogue bar on the left, then select the model you want to use.

Once you are on the model page, you can read a detailed description of this model or deploy the model on the page. Click the Deploy Model button on the top right corner of the page to enter the deployment page of the model.

Connect the Grove Vision AI V2 with the XIAO ESP32C3 and camera installed to the computer via the USB-C cable.

tip

The cable should connect the Grove Vision AI V2 to the computer, not the XIAO.

Then click the Connect button below.

In the new window, click Confirm and select the port number where the device is located. Wait for 1~2 minutes for the model to be uploaded.

If the model flash is successful, you can see the live screen in the Preview and should also be able to see information about the model.

tip

If there is no screen displayed in Preview or there is no information in the model information, there may be a problem with the model and you need to reselect the model or upload it again.

Step 6. Configuring the network for Grove Vision AI V2 & XIAO

Open the Model Assistant's configuration page.

Please turn on the MQTT button and enter the following information that you need to fill in the page.

  • SSID & Password: The name and password of the network you want XIAO to connect to. XIAO only supports 2.4G WiFi, 5G network is not available.

Please fill in the network configuration according to the device information of the Grove Vision AI V2 that we have added by SenseCAP in Step 3.

Then click the Save button below. After saving, it does not mean that Grove Vision AI V2 has been written correctly, please go back to Process in the left menu bar and check if the IP address of the device has appeared and if the status of the MQTT connection is correct.

caution

When IP Address is displayed, it means there is no problem with WIFI, and Service status must be the text in the figure to represent normal, note that if WIFI is not normal, MQTT is definitely not normal; when you just switch over, it may show unconnected, and you need to wait for about 10s or so, you don't need to refresh to see the status, and it will show the newest status after the change of the status automatically.

When finished, click the Stop button to stop reasoning, and click Disconnect to disconnect the serial port.

PaaS Side and SenseCAP Mate APP Observations

Step 7. View the results on the Mate APP

Now we can open our mobile and enter our account number and password to log in. The mobile will sync the PaaS device information.

caution

Please select the correct site for which you are registered.

After logging in, select your newly created device.

Once you enter the device, you can observe the screen and results.

Troubleshooting

Q1: Network Issue

If you keep observing IP addresses jumping in and out of display on the Process page, then the network may be unstable. You may want to consider changing networks or replacing the antenna with a stronger one.

Q2: Why can't I see the screen in Mate APP?

Only one of the live previews in SSCMA and the preview results in SenseCAP PaaS can be active at the same time. So keep in mind that you need to turn off the real-time screen display of inference on the Process page in SenseCraft AI.

Tech Support & Product Discussion

Thank you for choosing our products! We are here to provide you with different support to ensure that your experience with our products is as smooth as possible. We offer several communication channels to cater to different preferences and needs.

Loading Comments...