mirror of
https://github.com/harvard-edge/cs249r_book.git
synced 2026-04-30 01:29:07 -05:00
Lab links using @sec-... cross-references were not resolving in markdown links, causing 404 errors. Replaced with relative file paths. Also clarified the distinction between XIAO ESP32S3 Sense (Vision/Sound) and XIAOML Kit (Vision/Sound/Motion via expansion board IMU) throughout the kits documentation for consistency.
223 lines
15 KiB
Plaintext
223 lines
15 KiB
Plaintext
# Hardware Platforms {.unnumbered}
|
||
|
||
This chapter provides detailed technical specifications for the four hardware platforms used in these laboratories. Each platform represents a different point along the spectrum of embedded computing capabilities, from ultra-low-power microcontrollers to full-featured edge computers.
|
||
|
||
These platforms were selected because they illustrate distinct engineering trade-offs in power consumption, computational capability, and development complexity. All are widely used in commercial applications, ensuring that skills developed here transfer directly to professional embedded systems work.
|
||
|
||
## Featured Platform {#sec-hardware-kits-featured-platform-73d8}
|
||
|
||
{fig-align="center"}
|
||
|
||
The [XIAOML Kit](https://www.seeedstudio.com/blog/2025/08/05/introducing-the-xiaoml-kit-your-tinyml-journey-starts-here/) is the most recent addition to our educational hardware platforms (released on July 31st, 2025). It offers a comprehensive TinyML development environment for learning about ML systems, featuring integrated wireless connectivity, a camera, multiple sensors, and extensive documentation. This compact board exemplifies how contemporary embedded systems can efficiently provide advanced machine learning capabilities within a cost-effective framework.
|
||
|
||
## Platform Overview {#sec-hardware-kits-hardware-platform-overview-9f77}
|
||
|
||
Our curriculum features four carefully selected platforms that span the full spectrum of embedded computing capabilities. Each platform shown in @tbl-platform-selection has been chosen to illustrate specific engineering trade-offs and learning objectives.
|
||
|
||
+---------------------+----------------------------+----------+-------------------+----------------------------+
|
||
| **Platform** | **Primary Learning Focus** | **Cost** | **Power Profile** | **Best For** |
|
||
+:====================+:===========================+=========:+:==================+:===========================+
|
||
| **XIAOML Kit** | IoT & Wireless ML | ~$40 | Low Power | Cost-sensitive deployments |
|
||
+---------------------+----------------------------+----------+-------------------+----------------------------+
|
||
| **Arduino Nicla** | Ultra-low Power Design | ~$95 | Ultra-low | Battery-powered devices |
|
||
+---------------------+----------------------------+----------+-------------------+----------------------------+
|
||
| **Grove Vision AI** | Hardware Acceleration | ~$25 | Medium | Industrial applications |
|
||
+---------------------+----------------------------+----------+-------------------+----------------------------+
|
||
| **Raspberry Pi** | Full ML Frameworks | $60-145 | High | Advanced edge computing |
|
||
+---------------------+----------------------------+----------+-------------------+----------------------------+
|
||
|
||
: Platform selection strategy table. {#tbl-platform-selection}
|
||
|
||
## Platform Comparison {#sec-hardware-kits-platform-comparison-2ad7}
|
||
|
||
@tbl-platform-comparison provides a comprehensive technical comparison of all four platforms.
|
||
|
||
+-----------------------+----------------+------------------+-------------------+------------------------+
|
||
| **Characteristic** | **XIAOML Kit** | **Raspberry Pi** | **Arduino Nicla** | **Grove Vision AI V2** |
|
||
+:======================+:===============+:=================+:==================+:=======================+
|
||
| **Cost Range (USD)** | ~$40 | $60-145 | ~$95 | ~$25 |
|
||
+-----------------------+----------------+------------------+-------------------+------------------------+
|
||
| **Power Consumption** | Low | High | Ultra-low | Medium |
|
||
+-----------------------+----------------+------------------+-------------------+------------------------+
|
||
| **Processing Power** | Medium | Very High | Low | High (NPU) |
|
||
+-----------------------+----------------+------------------+-------------------+------------------------+
|
||
| **Memory Capacity** | 8MB | 1-16GB | 2MB | 16MB |
|
||
+-----------------------+----------------+------------------+-------------------+------------------------+
|
||
| **Primary Use Case** | IoT networks | Edge computing | Battery devices | Industrial AI |
|
||
+-----------------------+----------------+------------------+-------------------+------------------------+
|
||
| **ML Framework** | TF Lite | TensorFlow, | TensorFlow Lite | SenseCraft AI |
|
||
| | | PyTorch | | |
|
||
+-----------------------+----------------+------------------+-------------------+------------------------+
|
||
| **Development Env.** | Arduino/ | Python/Linux | Arduino IDE | Visual/Code |
|
||
| | PlatformIO | | | |
|
||
+-----------------------+----------------+------------------+-------------------+------------------------+
|
||
|
||
: Platform comparison matrix. {#tbl-platform-comparison}
|
||
|
||
## Platform Selection Guidelines {#sec-hardware-kits-platform-selection-guidelines-325e}
|
||
|
||
Selecting the appropriate platform depends on specific learning objectives and project requirements. @tbl-platform-capabilities provides a systematic mapping to guide these decisions.
|
||
|
||
+------------------------------------+----------------+------------+-------------------+------------------------+
|
||
| **Learning Objective/Application** | **XIAOML Kit** | **Ras Pi** | **Arduino Nicla** | **Grove Vision AI V2** |
|
||
+:===================================+:===============+:===========+:==================+:=======================+
|
||
| **Embedded Systems Basics** | ✓ | Limited | ✓ | ✓ |
|
||
+------------------------------------+----------------+------------+-------------------+------------------------+
|
||
| **Wireless Connectivity** | ✓ | ✓ | | ✓ |
|
||
+------------------------------------+----------------+------------+-------------------+------------------------+
|
||
| **Ultra-Low Power Design** | | | ✓ | |
|
||
+------------------------------------+----------------+------------+-------------------+------------------------+
|
||
| **Full ML Frameworks** | | ✓ | | |
|
||
+------------------------------------+----------------+------------+-------------------+------------------------+
|
||
| **Hardware Acceleration** | | | | ✓ |
|
||
+------------------------------------+----------------+------------+-------------------+------------------------+
|
||
| **Real-time Vision** | Limited | ✓ | ✓ | ✓ |
|
||
+------------------------------------+----------------+------------+-------------------+------------------------+
|
||
| **Edge-Cloud Integration** | ✓ | ✓ | | ✓ |
|
||
+------------------------------------+----------------+------------+-------------------+------------------------+
|
||
| **Production Deployment** | ✓ | | ✓ | ✓ |
|
||
+------------------------------------+----------------+------------+-------------------+------------------------+
|
||
|
||
: Platform capabilities matrix. {#tbl-platform-capabilities}
|
||
|
||
## Hardware Platform Specifications {#sec-hardware-kits-hardware-platform-specifications-01ae}
|
||
|
||
This section provides detailed technical specifications for each platform, including processor architecture, memory hierarchy, sensor capabilities, and development toolchain requirements.
|
||
|
||
### XIAOML Kit (Seeed Studio) {#sec-hardware-kits-xiaoml-kit-seeed-studio-572a}
|
||
|
||
::: {.callout-tip title="Best For: IoT & Wireless ML"}
|
||
The XIAOML Kit excels at wireless connectivity and cost-sensitive deployments. It's perfect for learning IoT sensor networks, remote monitoring systems, and wireless ML inference where you need reliable connectivity in a compact, affordable package.
|
||
:::
|
||
|
||
The XIAOML Kit bundles the XIAO ESP32S3 Sense board with an expansion board, providing a complete TinyML development environment. The XIAO ESP32S3 Sense alone provides camera and microphone capabilities (vision and sound), while the kit's expansion board adds a 6-axis IMU for motion classification. The name "XIAO" (小) translates to "tiny" in Chinese, reflecting the board's 21×17.5mm form factor.
|
||
|
||
{width=400}
|
||
|
||
**Processor Architecture:**
|
||
ESP32-S3 dual-core Xtensa LX7 running at 240MHz
|
||
|
||
**Memory Hierarchy:**
|
||
8MB PSRAM and 8MB Flash storage
|
||
|
||
**Connectivity:**
|
||
WiFi 802.11 b/g/n and Bluetooth 5.0
|
||
|
||
**Included Sensors:**
|
||
|
||
- *XIAO ESP32S3 Sense:* OV2640 camera sensor, digital microphone
|
||
- *Expansion Board:* 6-axis inertial measurement unit (IMU), 0.42" OLED display
|
||
|
||
**Power Characteristics:**
|
||
3.3V operation with multiple low-power modes
|
||
|
||
**Development Environment:**
|
||
Arduino IDE and PlatformIO support with extensive library ecosystem. Supports C/C++ programming with Arduino-style abstractions and direct ESP-IDF for advanced users.
|
||
|
||
**Application Focus:**
|
||
IoT sensor networks, remote monitoring systems, wireless ML inference, cost-sensitive deployments
|
||
|
||
### Arduino Nicla Vision {#sec-hardware-kits-arduino-nicla-vision-4fc9}
|
||
|
||
::: {.callout-tip title="Best For: Ultra-Low Power Design"}
|
||
The Arduino Nicla Vision is optimized for battery-powered devices and always-on sensing applications. It's ideal for learning ultra-low power design, image classification systems, and object detection applications where battery life is measured in months, not hours.
|
||
:::
|
||
|
||
The Nicla Vision exemplifies professional-grade embedded vision systems built around the STM32H7 microcontroller. This platform demonstrates how specialized hardware design enables sophisticated ML inference within severe resource constraints.
|
||
|
||
{width=400}
|
||
|
||
**Processor Architecture:**
|
||
STM32H747 dual-core ARM Cortex-M7/M4 running at 480MHz
|
||
|
||
**Memory Hierarchy:**
|
||
2MB integrated RAM and 16MB Flash storage
|
||
|
||
**Integrated Sensors:**
|
||
GC2145 camera sensor, MP34DT05 digital microphone, 6-axis IMU
|
||
|
||
**Power Characteristics:**
|
||
3.3V operation optimized for battery-powered deployment
|
||
|
||
**Development Environment:**
|
||
Arduino IDE and OpenMV IDE support with specialized computer vision libraries. MicroPython support for rapid prototyping alongside C/C++ for production deployments.
|
||
|
||
**Application Focus:**
|
||
Battery-powered devices, image classification systems, object detection applications, always-on sensing
|
||
|
||
### Grove Vision AI V2 {#sec-hardware-kits-grove-vision-ai-v2-5525}
|
||
|
||
::: {.callout-tip title="Best For: Hardware Acceleration"}
|
||
The Grove Vision AI V2 features dedicated neural processing hardware for orders-of-magnitude performance improvements. It's perfect for learning industrial inspection systems, real-time video analytics, and advanced object detection where you need NPU-accelerated inference capabilities.
|
||
:::
|
||
|
||
The Grove Vision AI V2 incorporates dedicated neural processing hardware (NPU) to demonstrate hardware-accelerated ML inference. This platform illustrates how specialized AI processors achieve orders-of-magnitude performance improvements over software-only implementations.
|
||
|
||
{width=400}
|
||
|
||
**Processor Architecture:**
|
||
ARM Cortex-M55 with integrated Ethos-U55 NPU
|
||
|
||
**Memory Hierarchy:**
|
||
16MB external memory for model and data storage
|
||
|
||
**Neural Processing Unit:**
|
||
Dedicated hardware accelerator for ML inference
|
||
|
||
**Camera Interface:**
|
||
Standard CSI connector supporting various camera modules
|
||
|
||
**Audio Input:**
|
||
Onboard digital microphone
|
||
|
||
**Development Environment:**
|
||
SenseCraft AI visual programming platform for no-code development, with Arduino IDE support for custom applications. Supports both graphical programming and traditional C/C++ development workflows.
|
||
|
||
**Application Focus:**
|
||
Industrial inspection systems, real-time video analytics, advanced object detection, NPU-accelerated inference
|
||
|
||
### Raspberry Pi (Models 4/5 and Zero 2W) {#sec-hardware-kits-raspberry-pi-models-45-zero-2w-f209}
|
||
|
||
::: {.callout-tip title="Best For: Full ML Frameworks"}
|
||
The Raspberry Pi bridges embedded systems and traditional computing, providing a complete Linux environment for advanced ML applications. It's ideal for learning edge AI gateways, advanced computer vision systems, language model deployment, and multi-modal AI applications where you need full computing capabilities.
|
||
:::
|
||
|
||
The Raspberry Pi family bridges embedded systems and traditional computing, providing a full Linux environment while maintaining educational accessibility. This platform demonstrates how increased computational resources enable sophisticated ML applications.
|
||
|
||
{width=400}
|
||
|
||
**Processor Architecture:**
|
||
ARM Cortex-A76 (Pi 5) or Cortex-A53 (Zero 2W)
|
||
|
||
**Memory Hierarchy:**
|
||
1-16GB DDR4 RAM depending on model
|
||
|
||
**Storage:**
|
||
MicroSD card primary storage with USB 3.0 expansion
|
||
|
||
**Connectivity:**
|
||
Gigabit Ethernet, WiFi, Bluetooth, multiple USB ports
|
||
|
||
**Camera Interface:**
|
||
Dedicated CSI connector plus USB camera support
|
||
|
||
**Operating System:**
|
||
Debian-based Raspberry Pi OS (full Linux distribution)
|
||
|
||
**Development Environment:**
|
||
Full Linux development environment with native Python, C/C++, and JavaScript support. Package managers (apt, pip) provide access to extensive ML libraries including TensorFlow, PyTorch, and OpenCV.
|
||
|
||
**Application Focus:**
|
||
Edge AI gateways, advanced computer vision systems, language model deployment, multi-modal AI applications
|
||
|
||
## Getting Started {#sec-hardware-kits-getting-started-b984}
|
||
|
||
To get started with the hardware kits used in this course, you can purchase them directly from the following official sources:
|
||
|
||
* [Seeed Studio – XIAOML Kit](https://www.seeedstudio.com/The-XIAOML-Kit.html) and [Grove Vision AI V2 Module](https://wiki.seeedstudio.com/grove_vision_ai_v2/)
|
||
* [Arduino Store – Nicla Vision](https://store.arduino.cc/products/nicla-vision)
|
||
* [Raspberry Pi Foundation – Boards and Kits](https://www.raspberrypi.com/products/)
|
||
* [DigiKey](https://www.digikey.com/), [Mouser](https://www.mouser.com/), [SparkFun](https://www.sparkfun.com/) — Alternative distributors for a variety of components and kits
|
||
|
||
Check each site for educational discounts, bundles, and regional availability. Most kits are available as starter packages that include the board and basic accessories.
|