PyTorch

Screenshot of the piano onset and velocity detection demo.

Real-Time Piano Onset and Velocity Detection

Paper and real-time demo from the IAMúsica project

MAR 8, 2023
categories: PUBLICATIONS
tags: AUDIO, COMPUTER VISION, GUI, KEYBOARD, LIVE ELECTRONICS, MACHINE LEARNING, MUSIC, PIANO, PYTORCH, TRANSCRIPTION

Schematic of the sound event detection demo. Dog barking to microphone and being detected.

Deep Learning for Real-Time Sound Event Detection on CPU 🎶 ⚠️ 🌊 💬 🐶

Demonstration powered by PyTorch and Tkinter

NOV 4, 2021
categories: UTILITIES
tags: AUDIO, GUI, LIVE ELECTRONICS, MACHINE LEARNING, PYTORCH, SIGNAL PROCESSING, TKINTER, VIDEO

Screenshot from the transcription tool.

Speech-to-text Editor Powered by Python and Qt

Featuring Silero DL models and an asynchronous interactive plugin mechanism

SEP 27, 2021
categories: UTILITIES
tags: ANNOTATION, AUDIO, GUI, MACHINE LEARNING, PYTORCH, QT, SIGNAL PROCESSING, SPEECH-TO-TEXT

An image with 4 people, and the face segmentation on top.

Robust Face Segmentation

Mixing human keypoint estimation from PyTorch and face segmentation from Caffe

NOV 28, 2020
categories: UTILITIES
tags: C++, CAFFE, COMPUTER VISION, DOCKER, MACHINE LEARNING, PYTORCH

Image of mars and the corresponding HSV histogram.

Project Highlights

30-second YouTube video showcasing some of my past work

JUL 12, 2020
categories: CREATIONS, PERSONAL, UTILITIES
tags: ARDUINO, BLENDER, COMPUTER VISION, INSTALLATION, LIVE ELECTRONICS, MACHINE LEARNING, PUREDATA, PYTORCH, RASPBERRY PI, SIGNAL PROCESSING, VIDEO

An image from the COCO datset with multiple people, and the corresponding keypoint predictions.

Distribution-Aware Heatmap Decoder for Human Pose Estimation

PyTorch implementation

JUN 8, 2020
categories: UTILITIES
tags: COMPUTER VISION, MACHINE LEARNING, PYTORCH, SIGNAL PROCESSING

Histogram of the neural network parameters evolving through training.

Real-Time Multiperson Human Pose Estimation

Triple distilled

MAY 18, 2020
categories: EXPLORATIONS
tags: COMPUTER VISION, MACHINE LEARNING, PYTORCH

MNIST digits sampled from a regular VAE (left) and a conditioned VAE (right), where zeros and ones are in opposed corners.

Intuition on Conditional VAEs

Putting explicit knowledge into the latent VAE space

MAY 7, 2020
categories: EXPLORATIONS
tags: COMPUTER VISION, MACHINE LEARNING, PROOF, PYTORCH, VAE