This idea of video and sound synthesis came from previous Hackathon project, where we developed music groove box from financial data.

To build a complete working prototype, I teamed up with colleagues and submitted it to Hackathon competition at JetBrains.

This time the main goal was to generate music and video effects based on movement detection and tracking using Faster R-CNN.

Ross Girshick et al

Tech Stack

  • Faster R-CNN
  • node.js
  • YouTube API

Result

Teammates

  • A.Kireev
  • A.Kotenko
  • V.Sotnikov

Back to Portfolio