SignToTalk

SignToTalk

Perception service

 Checking…
SignToTalk

Sign perception that stays with the person.

SignToTalk is the accessibility stack for signed communication: on-device perception, a stable motion contract, and a path to recognition, translation, speech, and signed expression — for Neo and every client that needs it.

Open live console Open avatar About the product

The full vision

Signing is rich human motion. Products fail when they treat it as a video upload problem or a single-language demo. SignToTalk separates the layers so each can improve without breaking privacy or clients.

  1. Perceive Camera → body, both hands, fingers, head, face → language-neutral UniversalMotionFrame. Frames never leave the device for tracking.
  2. Understand Recognize signs and sequences into structured meaning on top of the motion contract — not instead of it.
  3. Translate & deliver Bridge signed and spoken / written language; deliver text, speech, APIs, and embeds into platforms people already use.
  4. Express Reverse path: language and articulator commands drive a signing avatar — hands, fingers, head, face, torso.

Read the full product story — mission, roadmap layers, and how Cloudberry Solutions builds it.

What you can use now

  1. Live perception console On-device MediaPipe tracking with motion JSON for clients.
  2. Embed for platforms Iframe + postMessage. Grant camera on the iframe. Do not proxy video here.
  3. Articulator avatar Closed English commands for the same body parts signers use.

Integrate from Neo

Embed the compact tracker. Grant camera on the iframe. Listen for postMessage. Do not proxy the webcam through this server. 

<iframe
  src="https://signtotalk.neolang.de/embed"
  allow="camera"
  title="Sign to Talk"
></iframe>

window.addEventListener("message", (event) => {
  if (event.data?.source === "signtotalk" && event.data.type === "frame") {
    // event.data.frame is UniversalMotionFrame
  }
});

Service endpoints

URL Purpose
/ This service page
/about Product vision and company
/console Live perception console
/avatar Articulator avatar commands
/embed Compact iframe for clients
/health Liveness JSON
/contract.json Motion-frame contract

Later: POST /v0/sequences with universal-motion-sequence/v0. Never POST video.

This host never