Sep 16, 2019

An animation of the scanned model spinning

This week I scanned my whole body with itSeez3D app and Occipital’s Structure Sensor for capturing color and structure information. The app did a decent job for well capturing overall information including my height (a little taller) and body shape; and details from the words on my t-shirt to acne on my face.

Full body model

My partner held the iPad and scanned me for 3 times while the first trail was a total failure and we didn’t keep it. The second scan (left two models above) went fine with some flaws occurred: for example, the texture of the top of the head didn’t match the mesh well. I’ll elaborate it below. For the third scan I tried to smile while the final facial expression turned out weird.

Things Work Well #

Full body model

The model looks not bad especially when people know it’s created by a tiny accessible scanner attached to an iPad. The color is accurate, the ratio and dimension preserved correctly, and the texture and shape were captured well.

Things Don’t Work Well #

Internal surfaces #

Picture shows inner surfaces details

Although during the scan you could feel that you did scan both outer and “internal” surfaces - that are not facing the outside, through the gaps. For example, inner thigh and inner arm. However, these parts were still not captured well and in the picture above both texture and mesh of inner arm are broken.

Edges #

The head top details

Edge means both the edge parts of the body - head, hands, feet, etc., and the edges of the mesh. And the software is not good at meshing both. For head, although we’ve put the iPad as high as possible, the texture still looks twisted and squeezed. What’s more, it will fill all the holes by capping them with a flat surface, including the gap between my t-shirt sleeves and my arm, and the bottom of the shoes.

Structure details #

The ear details

The detailed structures are also not very well preserved. My ears, figures and hair are either simplified with a lot of details lost, or merged together.

Conclusion #

The Structure Sensor scan works well with color, meshing and texture details since it’s also helped by the iPad camera; however, is not very good at internal surfaces (faces that are noting facing outside), edges, and structure details (figures, hair, etc.) The app will re-mesh the scanned model and tends to close every opening to create a closed body.

Questions #

  1. When we talk about Avatar ownership, what are we talking about: Appearance, Identity, or Money?
    Avatar is capable to reflect our appearance, execute our identity, and monetize celebrities' fame. But what do people actually care about when they “fight for” non-statutory rights (in most places) of their digital representatives? Is it appearance? An app recently caught a lot of attention in China, not only because with it people can easily replace actors' faces with their own and act in as many movies as they want (like deep fake), but also because of it’s domineering user agreement - that most of people wouldn’t ever read. The original version of the agreement (that had been rewritten) granted the company the complete right of usage of image data users uploaded. However, after the thing had arisen the attention of the whole society, many people still use it and post “their” works to social media, before the company took any action. Is it Identity? Or is it Money?
  2. Should family members be eligible to make decisions of the after-demise usage of our Avatars when -
    The Avatar is a 3D scanned model that can be programmed to do things?
    The Avatar is so real that could pass “visual Turing test”?
    The Avatar is formed with real biological information including our figure print and medical history?
    The Avatar has memory of our past behaviors?

Avatars & Ethics/Ownership

  1. Athletes & Video Games: Balancing Publicity Rights and the First Amendment
  2. College Football Video Games Are Done. Here’s Why.
  3. Hollywood’s Post-Biological Future: Where Actors Can Perform After Death
  4. ‘Rogue One: A Star Wars Story’ — A New Hope (For Deceased Actors)
  5. Avatar Acts: Why Online Realities Need Regulation

Some media on this page is blurred due to privacy concerns.
Models scanned by Keru Wang.