logo

Face Cap

Face Cap is IOS 12 compatible.
Users with any of the new iPhone X models please report your experience.

Mailing List Sign-up:


Face Cap:

Face cap is a facial motion capture solution exclusively for the iPhone X.

Using the front 3D camera it records and exports the users facial expressions to be used in games, animation or vfx.

Features:

  1. Records head position & rotation data.
  2. Records 50 different facial expressions (as blendshape parameters).
  3. Eye tracking.
  4. User configurable recording duration up to 10 minutes.
  5. Records microphone input in sync.
  6. Exports a generic mesh, blendshapes and animation as Ascii-fbx.
  7. Native IOS sharing interface (email or dropbox your recordings).

Requirements:

  1. An Iphone X. Currently the iPhone X is the only IOS device with a 3D camera.

Completed Updates:

  1. Ios 12 compatible.
  2. In app filtering/smoothing of captured data.
  3. Optional recording of the front camera video feed for reference (Currently black & white with separate audio file).
  4. Hierarchy of exported Fbx updated for better compatibility.
  5. Locking the face in place.
  6. Video Tutorial 1: A closer look at the exported data.
  7. Video Tutorial 2: Transferring the captured data.

Scheduled Updates:

  1. Front camera video feed recording in RGB (now it's the Y channel from YUV).
  2. Improved handling of IOS camera/mic permissions.
  3. Improved handling of export file naming.
  4. Looking into ml solutions to bring FaceCap to other (Desktop) platforms.

Importing has been tested with these applications:

  1. Autodesk Maya.
  2. Lightwave 3D.
  3. Cinema 4D (OK!).
  4. Houdini. View import settings.
  5. Blender. First convert from ascii fbx to binary fbx using Autodesk fbx converter.

Best practices:

  1. For best results place the iPhone X down or hold it still during recording.
  2. Don't move too close or too far from the 3D camera it's range is limited.
  3. Don't look too far up, down or sideways.
  4. For longer recordings (3 minutes+) the exported files might get too big to transfer via email. Consider using dropbox or another sharing solution if you plan to record longer sessions.
  5. Please use the app in a well lit room for best results.
  6. Don't obscure the face, put long hair up in a pony tail, don't put hands or other objects between the face and the 3D camera.
  7. Post process your recording by filtering out noise/jitter/glitches.

Recording quality reference video:

A closer look at the exported data video:

Transferring the captured data to different characters video:

Please rate and review Face Cap on the App store.

Files:

  1. Example recording in fbx: Dropbox Google Drive
  2. Face cap press release graphics package.

Support this project by donating Nano:

xrb_3c9qg98oknd5iui9s9a3hpprcq5bkwf1jorihetzb7ujo4tm8ac5k6cqh463

Nano address.

Support this project by donating Bitcoin:

1MLK296Cim3wsv2Y8dr3spSEjonxrpTCqM

Bitcoin address.

IOS link