signal processing

Excerpt from our BJP 2023 paper.

Mood Regulation Through Dance

Paper published at the British Journal of Psychology (2023)

OCT 7, 2023
categories: PUBLICATIONS
tags: COMPUTER VISION, DANCE, EMOTION, MOTION CAPTURE, SIGNAL PROCESSING, VIDEO

An image from the COCO datset with multiple people, and the corresponding keypoint predictions.

Compressed Sensing

Intuitions with minimal working example in Python

NOV 13, 2022
categories: EXPLORATIONS
tags: COMPRESSED SENSING, COMPUTER VISION, CONVEX OPTIMIZATION, INTERPRETABILITY, LINEAR PROGRAMMING, SIGNAL PROCESSING, SPARSITY

An image is blurred out via a convolution, and then recovered via Wiener deconvolution. Notice the horizontal artifacts in the recovery, likely due to mismatching assumptions.

Understanding Wiener Deconvolution

Direct derivation, interpretation of assumptions, characterization of error bounds and code with examples

DEC 28, 2021
categories: PROOFS
tags: ALGEBRA, CALCULUS, COMPUTER VISION, CONVEX OPTIMIZATION, INTERPRETABILITY, PROOF, SIGNAL PROCESSING, SPARSITY

Schematic of the sound event detection demo. Dog barking to microphone and being detected.

Deep Learning for Real-Time Sound Event Detection on CPU 🎶 ⚠️ 🌊 💬 🐶

Demonstration powered by PyTorch and Tkinter

NOV 4, 2021
categories: UTILITIES
tags: AUDIO, GUI, LIVE ELECTRONICS, MACHINE LEARNING, PYTORCH, SIGNAL PROCESSING, TKINTER, VIDEO

Screenshot from the transcription tool.

Speech-to-text Editor Powered by Python and Qt

Featuring Silero DL models and an asynchronous interactive plugin mechanism

SEP 27, 2021
categories: UTILITIES
tags: ANNOTATION, AUDIO, GUI, MACHINE LEARNING, PYTORCH, QT, SIGNAL PROCESSING, SPEECH-TO-TEXT

Comparison between 3-element matching pursuit and the analogous 3-element OMP.

The Orthogonal Matching Pursuit Update Step

Auxiliary derivation and explanation

SEP 10, 2021
categories: PROOFS
tags: ALGEBRA, COMPRESSED SENSING, MATCHING PURSUIT, PROOF, SIGNAL PROCESSING, SPARSITY

Excerpt from our IAEA 2021 poster.

Something in the Way You Move: The Kinematics of Emotion and Beauty

Poster presented at the XXVI Congress of the International Association of Empirical Aesthetics (2021)

SEP 3, 2021
categories: PUBLICATIONS
tags: BLENDER, COMPUTER VISION, DANCE, MOTION CAPTURE, PROBABILITY, SIGNAL PROCESSING, VIDEO

Image of mars and the corresponding HSV histogram.

Project Highlights

30-second YouTube video showcasing some of my past work

JUL 12, 2020
categories: CREATIONS, PERSONAL, UTILITIES
tags: ARDUINO, BLENDER, COMPUTER VISION, INSTALLATION, LIVE ELECTRONICS, MACHINE LEARNING, PUREDATA, PYTORCH, RASPBERRY PI, SIGNAL PROCESSING, VIDEO

An image from the COCO datset with multiple people, and the corresponding keypoint predictions.

Distribution-Aware Heatmap Decoder for Human Pose Estimation

PyTorch implementation

JUN 8, 2020
categories: UTILITIES
tags: COMPUTER VISION, MACHINE LEARNING, PYTORCH, SIGNAL PROCESSING

Blender 3D rendering of a human skeleton.

MVNX Blender Add-on

Integrating the XSENS motion capture systems for research

MAY 8, 2020
categories: UTILITIES
tags: BLENDER, COMPUTER VISION, DANCE, MOTION CAPTURE, SIGNAL PROCESSING, VIDEO

The CUBE at the Kunst Universität Graz. We are rehearsing in a room with many loudspeakers.

Making sound with sound

MAY 7, 2020
categories: EXPLORATIONS
tags: C++, ECOSYSTEMIC SOUND, INSTALLATION, LIVE ELECTRONICS, MATCHING PURSUIT, PIANO, SIGNAL PROCESSING, SUPERCOLLIDER, TALKING PIANO