Doitto

Official music video of MiNERVA's Doiito. Created by Rongmistry Studios.

Workflow: Unreal Engine Virtual Production Workflow (revised workflow for independent/ low budget studios).

Tools used: Unreal Engine, Adobe After Effects, Premier Pro, Photoshop, Blender.

Master Thesis

Key elements: 4D Reconstruction, Silhouette extraction in dynamic scene Sfs (Shape from silhouette), Visual Hull, MaskRCNN, Dense Conditional Random Field (CRF), Bounding volume, Marching cube, SLAM, ARCore.

Thesis PDF can be found here.

AI based data driven character animation

1. Detectron2 to estimate 2D pose.
2. VideoPose3D to estimate 3D pose using the output data from previous step.
3. Feed exported 3D pose data in Unity app (runtime).

Musicality

Musicality is the concept that refers to a person’s ability to perceive and reproduce music. Due to its complexity, it can be best defined by different aspects of music like pitch, harmony, etc. Scientists believe that musicality is not an inherent trait possessed only by musicians but something anyone can nurture and train in themselves. In this paper we present a new game, named Musicality, that aims at measuring and improving the musicality of any person with some interest in music. Our application offers users a fun, quick, interactive way to accomplish this goal at their own pace. Specifically, our game focuses on three of the most basic aspects of musicality: instrument recognition, tempo and tone. For each aspect we created different mini-games in order to make training a varied and attractive activity.

Conference paper published. Check it here.

SatVis

Information visualization of artificial sttelites around the Earth using D3.

Unity2D Game