Arduino

Arduino App Lab 0.11: Phone IMU Streaming and Pose Bricks

Boards that pair a Linux-class processor with a real-time microcontroller keep showing up on workbenches, and the Arduino UNO Q is the clearest example: a Qualcomm Dragonwing chip runs Python while an STM32 handles timing-critical pins. Arduino App Lab 0.11 is the newest update to the IDE that programs both halves, covered in the Hackster report.

What changed in 0.11

The headline feature is “Apps Releases,” bundles you export from inside the IDE so a finished project can run on another board, including third-party hardware in the Works with Arduino program. A new pose estimation Brick tracks a 17-point body skeleton at up to 10 frames per second, but it needs the stronger VENTUNO Q, not the UNO Q. The LLM Brick can now import compatible models from Hugging Face, and a sidebar adds a chatbot for coding help. A Terrestrial Positioning Service Brick estimates location from Wi-Fi, BLE and cellular scans.

The part worth trying first

Phone sensor streaming is the gotcha-free entry point. App Lab already let you use a phone camera as input; 0.11 adds a WebSocket remote peripheral that sends microphone audio and IMU readings from the phone. That means a tilt-controlled robot or a clap counter needs no extra wiring, no I2C pull-up resistors, and no breadboard. The Python side reads the stream, and the STM32 side can drive a servo on a PWM pin in C/C++ based on the values it receives. The app itself is free and its source is on GitHub under GPL 3.

What to try next

Start with a UNO Q and the phone IMU: map tilt of 0 to 90 degrees to a servo angle on pin 9, then export it as an Apps Release and run it on a second board. Classroom teams can split the work, one student on the Python library side and one on the microcontroller code, which mirrors how thesis projects with a vision part and a motor part are usually divided. Check board pricing and stock at circuit.rocks, and download App Lab from the Arduino site linked in the source article.

Frequently Asked Questions

Which boards does Arduino App Lab 0.11 support?

It targets the Arduino UNO Q and VENTUNO Q, and its Apps Releases bundles also run on compatible third-party boards in the Works with Arduino program.

Does the pose estimation Brick work on the UNO Q?

No. The 17-point skeleton model runs at up to 10 frames per second but needs the more powerful VENTUNO Q processor.

What will I learn if I build this?

You practice splitting a project between a Python app on the Linux side and real-time C/C++ on the STM32, reading streamed sensor data over WebSocket, and packaging a project for reuse, skills that fit capstone and robotics work.

This article was inspired by reporting from Hackster.io. Find the parts and modules to build it at Circuitrocks.

// written by Ann Arandia

Ann Arandia covers community projects and maker events for the Circuitrocks blog. She writes about local workshops, kid-friendly electronics, and the Philippine maker scene — the people, the meet-ups, the projects that come out of them.