Flashing AI Models on the SenseCAP Watcher

Overview

Special thanks to XiaoZhi AI Chatbot for their open-source contributions that made this project possible.

This guide focuses on how to flash the SenseCAP Watcher with the Visual Recognition Triggered Conversation firmware and how to replace or update the AI model on the device. It is intended as a hands-on instructional guide for these operations.

For a full introduction to Watcher features, applications, and use cases, please refer to : SenseCAP Watcher - AI Assistant that actively interacts with the world

Prerequisites

Required Hardware

• SenseCAP Watcher device
• USB Type-C data cable
• Windows PC

note

If you are flashing the Visual Activation Firmware, and your Watcher device model is not -EN, you will also need to manually flash the authentication file for normal usage (only required once).
For detailed instructions, please refer to Watcher Agent Firmware Flashing Guide.

Firmware Flashing Process

SenseCraft AI

• Prerequisites

  • SenseCraft AI Platform

• Step 1. Open our platform and Select SenseCAP Watcher in Workspace

  

• Step 2. Connect to our Platform by serial port

  • Click Connect
  

  • Select correct serial port (ending with “A”)

    

  • Click Connect

    

• Step 3. Check and Update the Device Version

  • Click Update

    

  • Select correct serial port (ending with "B")

    
    

  • Click 'Connect'

    

  • Select the version you want to flash and Click Confirm

    

  • Waiting update and reboot process

    

Flash Download Tool

• Prerequisites

  • Visual Trigger Firmware v2.0.4: Download Link

  • Flash Download Tool (3.9.6 or later)

• Step 1. Connect to the device(Type-C port on the bottom of the device) and Open your Flash Download Tool

  

• Step 2. Configure Firmware Settings

  

• Step 3. Select COM Port and Flash Settings

  
  • If flashing doesn’t start after clicking START, click STOP and confirm you have selected the COM port ending with “B”.
    

• Step 4. Erase and Flash

  • Click the ERASE button to clear the existing firmware
  • Wait for the erase process to complete
  • Click the START button to begin flashing
  • You should see progress information in the log window
  • If no progress appears or failed, try the other COM port

• Step 5. Verify Success

  • The flashing process is complete when you see the success message in the log window.

    

• Step 6. Restart the Device

  • Locate the reset hole on your Watcher device
  • Use a pin to gently press the reset button
  • The device will restart with the new firmware
  

Command Line

• Prerequisites

  • Visual Trigger Firmware v2.0.4: Download Link

  • esptool.py

• Step 1. Extract the downloaded firmware package and use the esptool.py to perform the flash

  esptool.py -p /dev/ttyACM0 -b 2000000 write_flash 0 merged-binary.bin

  (Note: Adjust the port /dev/ttyACM0 according to your system, e.g., COM3 on Windows)

• Step 2. Restart the Device

  • Locate the reset hole on your Watcher device
  • Use a pin to gently press the reset button
  • The device will restart with the new firmware
  

Compile from Source (For Developers)

• Prerequisites

  • ESP-IDF v5.5.1

  • Open-Source Repository (Xiaozhi AI Collaboration)

• Step 1. Open ESP-IDF CMD and Navigate to the project folder

  cd xiaozhi-esp32

• Step 2. Set the target chip

  idf.py set-target esp32s3

• Step 3. Open the configuration menu

  idf.py menuconfig

• Step 4. Set Board Type as SenseCAP Watcher

  • Select the Xiaozhi Assistant

    

  • Select Board Type

    

  • Select SenseCAP Watcher

    

• Step 5. Configure Additional Settings According to Your Needs(Optional)

  • Default display language and AEC (Automatic Echo Cancellation / voice interruption handling)

    

  • Wake words and triggers

    
    

  • Other optional parameters specific to your application

  • After completing your configuration, save and exit the menu

• Step 7. Build and flash the firmware

  idf.py build flash

note

Firmware version above v2.0.3 requires saying “Turn on the inference switch” to Xiaozhi to enable visual detection.

AI Model Flashing Process

Prerequisites

• SenseCraft AI Platform

Step 1. Open our platform and Select SenseCAP Watcher in Workspace

Step 2. Connect to our Platform by serial port

• Click Connect

• Select correct serial port (ending with “A”)

  

• Click Connect

  

Step 3. View existing model and Change a new model

• View Model name and Model version

  

• Click Select Model... and Click the model you want to flash

  

• Click Confirm

  

Step 4. Adjust the Threshold and Preview the effect

• Also, you can adjust the threshold by talking to the agent

Troubleshooting

Common Issues

1. No COM Port Detected

   • Ensure you're using the bottom Type-C port
   • Try a different USB cable
   • Check if USB drivers are installed properly

2. Flashing Fails

   • When flashing Himax, select the COM port ending with “A”.
   • When flashing ESP32-S3, select the COM port ending with “B”.

3. Device Not Responding

   • Use a pin to gently press the reset button
   • Try erasing before flashing

4. Device does not wake up with visual detection

   • Check if there are relevant log messages in the serial output.
   • Firmware version v2.0.3 requires saying “Turn on inference switch” to Xiaozhi to enable this function.

5. Serial shows visual recognition logs but device still cannot wake up

   • Go to the SenseCraft AI Platform and flash the Person model to the AI chip.

FAQ

Q: Can I flash other AI models to Himax?

A: Currently, only Face and Person models are supported. Flashing other models is not yet supported and will be available in a future update.

Technical Support