Teething Toys

https://youtu.be/JQYQx5wINXM

https://scsonic.github.io/nasa2021/

Little Hand Viewer is Pure web-based, 3D-Model Viewer with handpose estimation.

How To Use

1. Prepare a Computer and a webcam. (Recommend: laptop with camera with google chrome browser)
2. Open the GitHub demo link, accept the camera prompt, we need camera to track your hands.
3. Waiting for the tensorflow.js and 3d-model prepared. (maybe wait more than 30 seconds)
4. Raise your hand, keep your hand in camera, recommended distance for camera-to-hand is 50~80cm
5. try to Move/Rotate you hand
6. Press Next/Prev to load 3D-models.
7. Hold your index-finger to trigger the animation (STL file has no animation)

Basic Function

You can interact with 3D-Model by single hand:

• Rotate -Animation Preview
• Move -Animation Preview
• Index Finger Trigger -Animation Preview

hold your Index-finger to trigger the animation with model

Note: Pure STL file has no animations

Project Source

Github: https://github.com/scsonic/nasa2021

If you have problems about three.js, tensorflow.js, javascript or html/css or run demo error, feel free to contact at Issue Page https://github.com/scsonic/nasa2021/issues , we will fix to bugs and publish new update at TEAM BOARD and GITHUB.

Issue

Loading Timeout: find a strong network, loading tensorflow.js and 3d-models need more than 20 MB.

Laptop Overheating: close chrome and take a rest or reboot

Lagging: Sorry, Handpose estimation need lot of Computing power

Others: go to GitHub issue page, copy the error message(open debug/console in your browser), I will help how to run this demo.

Nasa 3D Models

https://nasa3d.arc.nasa.gov/models

Nasa Lunar tool

https://www.nasa.gov/specials/apollo50th/pdf/A16_PressKit.pdf

What did you learn? 

handpose/tensorflow.js,

Three.js/A-Frame

What inspired your team to choose this challenge? 

We went to make a pure web-based project, with out hardware. so we can share the demo to the world.

What was your approach to developing this project?

By Tensorflow.js and three.js.

Now you can control 3d model by single hand;

Thanks Google Tensorflow

3D Model and Animations: https://sketchfab.com/

Tensorflow JS and handpose https://github.com/tensorflow/tfjs-models/tree/master/handpose

Three JS https://threejs.org/

Nasa 3D Models https://nasa3d.arc.nasa.gov/models

3D Model Editor 123d https://www.autodesk.com/solutions/123d-apps

#camera #tensorflow #model

This project has been submitted for consideration during the Judging process.