Team 15
Team Members |
Faculty Advisor |
Chad Rivera |
Jonathan Shihao Ji Sponsor Movia Robotics |
sponsored by
Robot Control through Rhythmic Audio Detection and Reciprocal Movement for Human Robotic Engagement
Real-time rhythmic audio detection and tempo analysis paired with a robot movement controller using the Kebbi robot system to synchronize movements with music or rhythmic sounds. The goal is to create the impression that the Kebbi is naturally moving and responding to rhythmic sounds in its environment. The project consists of four modules: Audio Input and Preprocessing, Tempo Estimation, Onset Timing Determination, and Motor Control. The system analyzes microphone input to suppress filler audio and detect rhythmic patterns. The processed audio is then analyzed to estimate the tempo, measured in Beats Per Minute (BPM). Using the estimation, the program predicts the future onset beat timings to communicate with the information to the motor control module. The motor controller then triggers robot movements at the appropriate times, so that the robot's actions align with the real-time audio.