YouTube™ motion tracking

Some examples from this Video source

The logo was designed by a 3 year old girl.

YouTube™ motion tracking is a Chrome AI extension for animating motion in videos.

Pose estimation is done with TensorFlow.js
Particle animation is done with Proton

This project is a Google Chrome browser extension. That's why you need this browser to try it out.

You can install the extension from the Chrome Web Store:
Link YouTube™ motion tracking

To see some animations watch this

Features

A new button is available in the player.

The new button opens the animation selection menu.

How it works.

The Chrome extension becomes active, when you watch a YouTube video.

The extension use MoveNet as model.
Visual representation of the keypoints:

Image from tensorflow.js pose-detection model
We use these keypoints to place animations on top of the YouTube™ video.

Installation

Download this repository

git clone https://github.com/deep2universe/YouTube-Motion-Tracking.git

Development

I use PARCEL as build tool and install it globally with

# install PARCEL
npm install -g parcel

Build local

# install dependencies
npm install

# build dist folder
npm run build:parcel

Open Chrome extensions

Open this URL

chrome://extensions

Enable developer mode

In the upper right corner you have to activate the developer mode.

Load extension

Load the build dist Folder from this repository.

Check Chrome settings

Go to this URL

chrome://settings/accessibility

In the System settings make sure to enable this:

Usage

Open YouTube

Watch a video and have fun.

Uninstall

Just go to the chrome://extensions page and disable or delete the extension.

License

Apache License 2.0

YouTube™ is a trademark of Google Inc.
Use of this trademark is subject to Google Permissions.