SenseCAP Watcher - The Physical AI Agent for Smarter Spaces

Description

SenseCAP Watcher - The Physical AI Agent for Smarter Spaces

SenseCAP Watcher is built on ESP32S3, incorporating a Himax WiseEye2 HX6538 AI chip with Arm Cortex-M55 & Ethos-U55, excelling in image and vector data processing. Equipped with a camera, microphone, speaker, SenseCAP Watcher can see, hear, talk. Plus, with LLM-enabled SenseCraft suite, SenseCAP Watcher understands your commands, perceives its surroundings, and triggers actions accordingly.

 

Feature 1: Simply Speak Your Command

Simply speak to Watcher, tell it what to watch, and it will notify you when the specified event occurs.

 

You can easily send commands by Push to Talk or from SenseCraft App.

Feature 2: Understand What it Sees

Running on-device AI models, SenseCAP Watcher can detect different things: people, apples, pets, etc. However, the most outstanding feature of Watcher is its integration with LLMs.

By leveraging LLMs, Watcher can capture precise events you specified, it means going beyond simple target detections, it thoroughly analyzes behaviors and status. Like "dog + playing ball, 0 people + in the room," or "The People + with DHL outfit arrived " etc. Watcher truly understands the scene under its watch!

 

Constantly calling LLMs like ChatGPT incurs a high cost. Hence, we use the architecture of on-device AI + LLMs. The on-device AI model on Watcher detects the target, which is then analyzed by LLM to generate accurate and actionable insights.

With the task "tell me if the dog is tearing up paper" when the on-device model detects dogs, this keyframe is sent to LLM for further analysis - is it tearing up paper? LLMs won't be triggered by people, cats, squirrel or others. This tremendously reduces LLMs' cost.

 

Feature 3: Respond via Voice

After detecting the specified event, Watcher can interact with the targets via voice. For example, you can set it this way:

  • Specified event: someone takes up the pink keyboard;
  • Specified two reactions: 1) one via voice reply, saying 'Good choice! This is our latest version, inspired by the Pink Royal Typewriter'; 2) the other via a text message to salespersons: 'Someone is interested in the latest keyboard! please go to the shelf ASAP'.

Putting Watcher in different scenarios allows for versatile responses. When seeing a dog tearing up tissues, say “Stop, Cooper!”, when seeing a person smoking in non-smoking areas, say "No smoking!"

Feature 4: Upgrade Your Systems with Just a Simple Plug-in

Once the target event is detected, it can trigger different actions, for example, push messages on SenseCraft App or LED flashes on Watcher. Of course, we understand you want to go beyond the functionalities on the App/ device. No problem at all! There are infinite possibilities for you to explore!

Add Watcher to Home Assistant

 

Connected to IoT platform like Home Assistant, your Watcher acts as a behavior sensor, activating tailored actions in various contexts. For example, when it detects people, Watcher analyzes the situation and automatically triggers actions: lights on for reading and lights off for sleeping.

When someone sleeping + dim the light

More than a vision sensor, Watcher is extendable with other sensors to enable multi-modal sensing. On Watcher's back, the I2C is reserved to accommodate 100+ Grove sensors. This flexibility allows Watcher to integrate a wide range of data sources for thorough analysis and appropriate actions. You will be able to build applications like detect room temperature and adjust the AC accordingly - turn it to 22°C when you're in suits, or 26°C in shorts.

Add Watcher to your Node-RED flow

Just 3 blocks away, you can stream the detected results from your Watcher to any place on the internet via Node-RED, as easy as making a snap!

Add Watcher to your Arduino | ESP32 and other hardware systems

Wanna add an AI agent to popular MCUs and SBCs such as Arduino/ ESP32/ Raspberry Pi? Simply connect it to Watcher via UART or HTTP or USB, and you can explore the new frontier of intelligence.

Feature 5: Give Your Watcher Unique Emotions

SenseCAP Watcher adapts to your commands with unique "modes." It is LISTENING to your instructions, then shifts to WATCHING mode to safeguard your designated space, etc. But the fun doesn't stop here! You can upload your own designs of emotions to give your Watcher a unique personality. Get a PNG file ready and upload it to Watcher within seconds! It is your call!

Watcher's default emojis are inspired by C-3PO, paying tribute to one of our greatest helpers!

 

You can easily upload yours in .PNG format.

 

You can even custom design a unique UI (User Interface) for your SenseCAP Watcher. Our current UI is powered by Squareline.

Feature 6: Open Source and On-premise Deployment.

As an AI device, it is fundamental to respect privacy. And we embrace and implement two primary strategies in this nifty device.

  1. SenseCAP Watcher is open source, giving you full access to thoroughly understand how it works.
  2. It supports on-premise deployment. The backbone of SenseCAP Watcher is SenseCraft software suite, which is used to configure Watcher, interpret your commands, and access LLMs. Hence, everything is stored and running privately, ensuring that your models and data are not streamed to any public LLMs or public clouds. SenseCraft can run on Windows/ MacOS / Linux. Since SenseCraft contains LLMs, certain performance criteria are required for the computer, as follows.

You can deploy SenseCraft on your spare computers. However, if you aim for applications requiring commercial-grade reliability and low-power consumption, the combination of SenseCAP Watchter + NVIDIA® Jetson AGX Orin™ is perfect for you!

Compared to consumer-grade graphics cards (e.g. RTX 4090) for AI tasks, NVIDIA® Jetson AGX Orin™ stands out with key advantages:

  1. Industrial-grade reliability: Designed for industrial and commercial applications, Jetson AGX series boasts a longer MTBF (Mean Time Between Failures). Engineered for 24/7 operation, it offers superior reliability for round-the-clock applications compared to consumer graphics cards.
  2. Compact and low power: With embedded and edge computing applications in mind, Jetson AGX series are designed in a smaller form factor and consume 3+ times less power, compared to consumer graphics cards. Suitable for constrained spaces, Jetson AGX series generates less heat and helps reduce overall operating costs. This is crucial for embedded systems.

Subscription? You Decide!

SenseCraft AI Services are tailored to your needs.

Start with Basic, completely FREE for low-frequency: 15min/request for image analysis, 200 chats/month with LLMs.

Need more? Just $6.90 for Pro, pay only for what you consume, NO commitment to recurring subscription fees! Plus, each NEW device includes a FREE $6.90 Pro package! Top up as needed.

Want to avoid fees altogether? Choose On-Premise. Just deploy and use with no additional costs!

For more information please refer to Price Description page.


Specification

MCU

ESP32-S3 @240MHz 8MB PSRAM

Built-in AI Processor

Himax HX6538 (Cortex M55 + Ethos-U55)

Camera

OV5647 120° FOV

Fixed Focal 3 meters

Wi-Fi

IEEE 802.11b/g/n-compliant

2.4GHz Band

Wireless Range: Up to 100 meters (open space test)

Bluetooth LE

Bluetooth 5

Antenna

Built-in Wi-Fi and BLE antenna

Display

Touchscreen with 1.45-inch, 412×412 resolution

Microphone

Single microphone

Speaker

1W speaker output

Wheel

Supports scrolling up&down and button

LED

1xRGB light for indication

microSD Card Slot

Supports up to 32GB FAT32 microSD card

Flash

32MB Flash for ESP32-S3

16MB Flash for Himax HX6538

Extension Interface

1xGrove IIC interface

2x4 Female header(1xIIC, 2xGPIO, 2xGND, 1x3.3V_OUT, 1x5V_IN)

USB-C

1x USB-C on the back(power supply only)

1x USB-C on the bottom(power supply and programming)

Reset Button

1xRST button in the bottom hole

Power Supply

5V DC power

Battery

3.7V 400mAh Li-ion battery as backup power

Operating Temperature

0 ~ 45°C

Dimensions

69 x 65 x 20 mm

Mounting Bracket

Supports wall, desktop and bracket installation

1 x Universal wheel and base plate with adhesive

1 x 1/4" Female adapter set


Hardware Overview

Support Various Mounting Methods

It can be placed on a desktop or mounted on walls as a smart expansion. Or it can also be transformed into the head of a robot.

Application

 

Fun fact: Here at Seeed, Watcher has the nickname "Nobody," symbolizing a robot with No Body. This conveys a powerful message: Give Watcher a body! Watcher can be a cool head for your robot!

 

Others used it as:

Customization - Shortest Path to Build AI Hardware

The next gadget should be AI-powered. Hardware with built-in AI connected to LLMs is the trend!

With SenseCAP Watcher, we've developed a revolutionary framework that brings powerful LLMs to the very edge of the physical world. This framework speeds up AI hardware prototyping. With our customization services, you can bring your AI hardware to life faster than ever before!



SenseCAP Watcher - The Physical AI Agent for Smarter Spaces

Product form
Free pickup in our shop(s)

SKU: 113991275

$139.00 $119.00 Excl. GST

$119.00
Product available in stock.

    • We ship from our stock in AU (Perth), pickup by prior booking
    • We Offer Quantity Discounts for Large Orders 10+ qty (Request Quote)
    • We accept Purchase Orders & Net 30-day Payment for Eligible Accounts

    Description

    SenseCAP Watcher - The Physical AI Agent for Smarter Spaces

    SenseCAP Watcher is built on ESP32S3, incorporating a Himax WiseEye2 HX6538 AI chip with Arm Cortex-M55 & Ethos-U55, excelling in image and vector data processing. Equipped with a camera, microphone, speaker, SenseCAP Watcher can see, hear, talk. Plus, with LLM-enabled SenseCraft suite, SenseCAP Watcher understands your commands, perceives its surroundings, and triggers actions accordingly.

     

    Feature 1: Simply Speak Your Command

    Simply speak to Watcher, tell it what to watch, and it will notify you when the specified event occurs.

     

    You can easily send commands by Push to Talk or from SenseCraft App.

    Feature 2: Understand What it Sees

    Running on-device AI models, SenseCAP Watcher can detect different things: people, apples, pets, etc. However, the most outstanding feature of Watcher is its integration with LLMs.

    By leveraging LLMs, Watcher can capture precise events you specified, it means going beyond simple target detections, it thoroughly analyzes behaviors and status. Like "dog + playing ball, 0 people + in the room," or "The People + with DHL outfit arrived " etc. Watcher truly understands the scene under its watch!

     

    Constantly calling LLMs like ChatGPT incurs a high cost. Hence, we use the architecture of on-device AI + LLMs. The on-device AI model on Watcher detects the target, which is then analyzed by LLM to generate accurate and actionable insights.

    With the task "tell me if the dog is tearing up paper" when the on-device model detects dogs, this keyframe is sent to LLM for further analysis - is it tearing up paper? LLMs won't be triggered by people, cats, squirrel or others. This tremendously reduces LLMs' cost.

     

    Feature 3: Respond via Voice

    After detecting the specified event, Watcher can interact with the targets via voice. For example, you can set it this way:

    • Specified event: someone takes up the pink keyboard;
    • Specified two reactions: 1) one via voice reply, saying 'Good choice! This is our latest version, inspired by the Pink Royal Typewriter'; 2) the other via a text message to salespersons: 'Someone is interested in the latest keyboard! please go to the shelf ASAP'.

    Putting Watcher in different scenarios allows for versatile responses. When seeing a dog tearing up tissues, say “Stop, Cooper!”, when seeing a person smoking in non-smoking areas, say "No smoking!"

    Feature 4: Upgrade Your Systems with Just a Simple Plug-in

    Once the target event is detected, it can trigger different actions, for example, push messages on SenseCraft App or LED flashes on Watcher. Of course, we understand you want to go beyond the functionalities on the App/ device. No problem at all! There are infinite possibilities for you to explore!

    Add Watcher to Home Assistant

     

    Connected to IoT platform like Home Assistant, your Watcher acts as a behavior sensor, activating tailored actions in various contexts. For example, when it detects people, Watcher analyzes the situation and automatically triggers actions: lights on for reading and lights off for sleeping.

    When someone sleeping + dim the light

    More than a vision sensor, Watcher is extendable with other sensors to enable multi-modal sensing. On Watcher's back, the I2C is reserved to accommodate 100+ Grove sensors. This flexibility allows Watcher to integrate a wide range of data sources for thorough analysis and appropriate actions. You will be able to build applications like detect room temperature and adjust the AC accordingly - turn it to 22°C when you're in suits, or 26°C in shorts.

    Add Watcher to your Node-RED flow

    Just 3 blocks away, you can stream the detected results from your Watcher to any place on the internet via Node-RED, as easy as making a snap!

    Add Watcher to your Arduino | ESP32 and other hardware systems

    Wanna add an AI agent to popular MCUs and SBCs such as Arduino/ ESP32/ Raspberry Pi? Simply connect it to Watcher via UART or HTTP or USB, and you can explore the new frontier of intelligence.

    Feature 5: Give Your Watcher Unique Emotions

    SenseCAP Watcher adapts to your commands with unique "modes." It is LISTENING to your instructions, then shifts to WATCHING mode to safeguard your designated space, etc. But the fun doesn't stop here! You can upload your own designs of emotions to give your Watcher a unique personality. Get a PNG file ready and upload it to Watcher within seconds! It is your call!

    Watcher's default emojis are inspired by C-3PO, paying tribute to one of our greatest helpers!

     

    You can easily upload yours in .PNG format.

     

    You can even custom design a unique UI (User Interface) for your SenseCAP Watcher. Our current UI is powered by Squareline.

    Feature 6: Open Source and On-premise Deployment.

    As an AI device, it is fundamental to respect privacy. And we embrace and implement two primary strategies in this nifty device.

    1. SenseCAP Watcher is open source, giving you full access to thoroughly understand how it works.
    2. It supports on-premise deployment. The backbone of SenseCAP Watcher is SenseCraft software suite, which is used to configure Watcher, interpret your commands, and access LLMs. Hence, everything is stored and running privately, ensuring that your models and data are not streamed to any public LLMs or public clouds. SenseCraft can run on Windows/ MacOS / Linux. Since SenseCraft contains LLMs, certain performance criteria are required for the computer, as follows.

    You can deploy SenseCraft on your spare computers. However, if you aim for applications requiring commercial-grade reliability and low-power consumption, the combination of SenseCAP Watchter + NVIDIA® Jetson AGX Orin™ is perfect for you!

    Compared to consumer-grade graphics cards (e.g. RTX 4090) for AI tasks, NVIDIA® Jetson AGX Orin™ stands out with key advantages:

    1. Industrial-grade reliability: Designed for industrial and commercial applications, Jetson AGX series boasts a longer MTBF (Mean Time Between Failures). Engineered for 24/7 operation, it offers superior reliability for round-the-clock applications compared to consumer graphics cards.
    2. Compact and low power: With embedded and edge computing applications in mind, Jetson AGX series are designed in a smaller form factor and consume 3+ times less power, compared to consumer graphics cards. Suitable for constrained spaces, Jetson AGX series generates less heat and helps reduce overall operating costs. This is crucial for embedded systems.

    Subscription? You Decide!

    SenseCraft AI Services are tailored to your needs.

    Start with Basic, completely FREE for low-frequency: 15min/request for image analysis, 200 chats/month with LLMs.

    Need more? Just $6.90 for Pro, pay only for what you consume, NO commitment to recurring subscription fees! Plus, each NEW device includes a FREE $6.90 Pro package! Top up as needed.

    Want to avoid fees altogether? Choose On-Premise. Just deploy and use with no additional costs!

    For more information please refer to Price Description page.


    Specification

    MCU

    ESP32-S3 @240MHz 8MB PSRAM

    Built-in AI Processor

    Himax HX6538 (Cortex M55 + Ethos-U55)

    Camera

    OV5647 120° FOV

    Fixed Focal 3 meters

    Wi-Fi

    IEEE 802.11b/g/n-compliant

    2.4GHz Band

    Wireless Range: Up to 100 meters (open space test)

    Bluetooth LE

    Bluetooth 5

    Antenna

    Built-in Wi-Fi and BLE antenna

    Display

    Touchscreen with 1.45-inch, 412×412 resolution

    Microphone

    Single microphone

    Speaker

    1W speaker output

    Wheel

    Supports scrolling up&down and button

    LED

    1xRGB light for indication

    microSD Card Slot

    Supports up to 32GB FAT32 microSD card

    Flash

    32MB Flash for ESP32-S3

    16MB Flash for Himax HX6538

    Extension Interface

    1xGrove IIC interface

    2x4 Female header(1xIIC, 2xGPIO, 2xGND, 1x3.3V_OUT, 1x5V_IN)

    USB-C

    1x USB-C on the back(power supply only)

    1x USB-C on the bottom(power supply and programming)

    Reset Button

    1xRST button in the bottom hole

    Power Supply

    5V DC power

    Battery

    3.7V 400mAh Li-ion battery as backup power

    Operating Temperature

    0 ~ 45°C

    Dimensions

    69 x 65 x 20 mm

    Mounting Bracket

    Supports wall, desktop and bracket installation

    1 x Universal wheel and base plate with adhesive

    1 x 1/4" Female adapter set


    Hardware Overview

    Support Various Mounting Methods

    It can be placed on a desktop or mounted on walls as a smart expansion. Or it can also be transformed into the head of a robot.

    Application

     

    Fun fact: Here at Seeed, Watcher has the nickname "Nobody," symbolizing a robot with No Body. This conveys a powerful message: Give Watcher a body! Watcher can be a cool head for your robot!

     

    Others used it as:

    Customization - Shortest Path to Build AI Hardware

    The next gadget should be AI-powered. Hardware with built-in AI connected to LLMs is the trend!

    With SenseCAP Watcher, we've developed a revolutionary framework that brings powerful LLMs to the very edge of the physical world. This framework speeds up AI hardware prototyping. With our customization services, you can bring your AI hardware to life faster than ever before!



    Recently viewed products

    Login

    Forgot your password?

    Don't have an account yet?
    Create account