Study Table Organizing Robotic Arm — computer vision robotic system
← RETURN TO BASE
UC DENVER ROBOTICS × CV Mar 2023 — May 2023

Study Table Organizing Robotic Arm

Merging computer vision and robotics to automate the organization of pens and pencils on study tables using TensorFlow-powered object detection and precision servo control.

PythonTensorFlowComputer VisionRoboticsServo MotorsSerial CommunicationOpenCVHD Webcam
Institution UC Denver
Period Mar–May 2023
Domain Robotics + CV
Framework TensorFlow

About the Project

> cat robotic_arm_brief.txt DECRYPTING...

This project merges computer vision and robotics to automate a surprisingly common task — keeping a study table organized. The robotic arm autonomously detects pens and pencils scattered on a desk, picks them up, and places them neatly in a holder.

Using an HD webcam for image capture, a TensorFlow-trained model for object detection, and custom algorithms for coordinate determination and servo motor control, the system achieves end-to-end automation from detection to placement.

Built as an academic project at the University of Colorado Denver, it demonstrates practical applications of ML-powered robotics in everyday environments.

Implementation

01

Image Capture

HD webcam captures high-resolution images of the study table surface in real-time.

02

Object Detection

TensorFlow model trained to accurately recognize and classify pens and pencils from the captured frames.

03

Coordinate Mapping

Custom algorithm determines precise object coordinates in 3D space relative to the robotic arm base.

04

Servo Control

Python serial communication drives precise servo motor movements for arm positioning.

05

Object Grasping

Robotic claw activates to grip the detected pen with controlled force.

06

Placement

Algorithm determines pen holder location and the arm places objects with precision.

Project Action & Explanation

PROJECT_DEMO_01 ● LIVE
Robotic Arm Action Demo
SYSTEM_EXPLANATION_02 ● LIVE
Project Technical Explanation

My Contributions

Led design of robotic arm control algorithm
Developed coordination algorithms for object coordinates in 3D space
Contributed to Python programming for image processing and arm control
Designed a user-friendly interface for seamless interaction

Challenges Overcome

Single pen placement limitation — optimizing for sequential multi-object handling
4DoF robotic arm constraints — compensating for limited degrees of freedom
Webcam coverage limitations — maximizing detection area with constrained field of view

Acknowledgment

> cat acknowledgment.txt DECRYPTING...

This system was designed and developed as an academic project at the University of Colorado Denver under the supervision of Professor Dr. Mazen Alborno. I extend my gratitude for his invaluable technical guidance, mentorship, and for supporting access to the robotic arm hardware essential for completing this project.

← RETURN TO PROJECTS