Show HN: Control your Roku with only your hand gestures

21 points by bb-dev 8 days ago

HandiRokuRemote is a Python application that lets you control your Roku device with nothing but hand gestures! Using Mediapipe's Hand Landmark Detector, it tracks your hand, identifies gestures, and sends commands to your Roku via its External Control Protocol.

Here's a gif demo: https://github.com/BBelk/HandiRokuRemote/blob/main/images/re...

Features:

•Real-time hand tracking: Gestures like "thumbs up" increase volume or pointing for navigation.

•Cross-device support: Works with any Roku device on the same local network.

•Easy setup: Plug in a camera, and you’re ready to go.

Check out the code on Github: https://github.com/BBelk/HandiRokuRemote

Or download the .exe and try it out! PC only for now: https://github.com/BBelk/HandiRokuRemote/releases/tag/v1

Let me know what you think!

yjftsjthsd-h 4 days ago

Specifically, looks like Windows PC only for now? Although github says 100% Python so unless you've used something Windows specific probably easy to port to Linux (which includes Raspberry Pi and the like) or macOS.

> This project's Roku specific code could be modified or further extended to work with specific Smart TVs or any TV that supports HDMI-CEC (Consumer Electronics Control).

Other good options would be trying to directly integrate with an infrared transmitter or support MQTT which would make it easy to use some of the existing options there (or to connect with things like Home Assistant, if you're into that). That has the advantage of being fairly generic so the same code in this program can drive a bunch of different things on the user side.

bb-dev 4 days ago

I should have clarified, the build of the project is for windows only, I used pyinstaller to package it up and I'm not sure how well it would play with Linux.
Thanks for mentioning MQTT, I hadn't heard of it and it seems pretty cool!