Development Blog

This is the development blog for the HelVision Threat Detection System. See the About page for an overview of the project.
  • Mimetics as a Learning Basis - Part 2

    Wrapping up the exploration of mimetics in learning from Part 1, the causal model is updated to employ the following continuous data processing pipeline: Low-level processing/perception Consume video stream, convert to 2D keypoints, then 3D skeletal, view-invariant form Learning Infer with existing signatures/sequences and score results Cluster and store new...

  • Mimetics as a Learning Basis - Part 1

    A rudimentary model of the human mind could be characterized by the following components: Consciousness - to have subjective experience and thought Self-awareness - to be aware of oneself as a separate individual, especially to be aware of one’s own thoughts Sentience - the ability to feel perceptions or emotions...

  • Body Motion Classification

    Given a 3D skeletal model of the subject (as provided by systems such as VideoPose3D), we can infer some body language via simple inspection over time. These cases include: Subject looking at viewer Subject staring at viewer Subject adopted a bladed pose Subject’s hands at-the-ready Subject approaching, etc Other body...

  • 2D-Pose-Estimation to 3D-Person Modeling

    To better analyze a subject’s body language while looking for pre-assaultive cues, a translation of 2D body keypoints from video input to 3D body keypoints in an internal 3-dimensional space was explored. The approach taken was to create a 3D person model, with typical bone lengths and joint ranges-of-motion, then...

  • Additional Bladed Stance Detection Approaches

    Pre-assaultive behavior cues are often communicated with body language such as a bladed stance. Legs and Feet: Primarily, what we are looking for here is stance. As often happens subconsciously, people will tend to blade themselves towards a perceived threat. Blading refers to a combat style stance, where the dominant...