A downloadable tool

This tool allows for importing, viewing and manipulating 3D models with the help of voice recognition. The objects are taken from the Google Poly 3D portal (no longer available).

This project was developed as part of a mentorship sponsored by Learn IT, Girl! It is the fourth edition and my mentor was Manuel Krebber from Hamburg, Germany.

I developed the project using Unity3D, SteamVR and the Google Poly and Wit.AI APIs for the model search and the voice recognition.

This was both a fun and challenging project which helped me to learn many new things about Unity3D and C# programming.

How it works:

The left hand trigger is the recording button, which is held pressed for the duration of the voice command. The sky turns red and a gentle vibration on the left hand controller indicates that the recording is in progress. 

In the screenshots we can see the search command "search for a house" and the "cube matrix" command triggered. The first one searches and imports the first model found on Google Poly that has the Tag house on it. 

The second command "Cube matrix", multiplies the model in a cube grid, the default is 3x3 for 9 objects, but the user can say another square number.

The right hand trigger shoots projectiles that allow to push the objects around. 

Future Developments:

Add more voice commands for scaling the objects and organizing them in other shapes besides the grid.

Add more controller functions such as pushing several objects at once with a wind shot, or pulling them towards the user with a hook.


Leave a comment

Log in with itch.io to leave a comment.