Description
SERUM is an Artificial Intelligence Multi-Agent System (AIMAS) which is a multi-layered technology system that incorporates and applies scientific research into human psychology to enable the detection and analysis of human behaviour and emotions. The system utilizes a variety of sensors and algorithms to detect and analyse physical traits that are known, and scientifically proven, psychological indicators.
Over many years the scientific community at large have been studying the physical manifestations of psychological activities. Through this research, a long list of physical traits has been identified that are indicative of certain emotional scenarios. These include both visual and vocal cues such as: facial expressions and tics, hand movements, body posture, speech patterns, oral pitch alterations, flushing & blushing and perspiration etc’. SERUM brings this wealth of research together and applies it in systematic reviews of video content.
Read MoreSome of the previously referenced research that has been incorporated into the development of SERUM includes the following:
- “The Complete Idiot’s Guide to Reading Body Language” by Susan Constantine,
- “How to Analyze People” by Brandon Cooper,
- “Fundamentals of Machine Learning for Predictive Data” by John D. Kelleher, Brian Mac Namee, and Aoife D’Arcy,
- “Artificial General Intelligence” by Tom Everitt, Ben Goertzel, and Alexy Potapov,
- “Theory of Mind, How Children Understand Others” Thoughts and Feelings” by Martin J Doherty,
- “Machine Learning, A Probabilistic Perspective” by Kevin P. Murphy,
- “How to Create a Mind, the Secret Human Thought Revealed” by Ray Kurzweil.
The hardest part was turning these words into physically actionable and recognisable elements that AI could detect.
Below are some of the physical and vocal traits that have been incorporated into the recognition and analysis systems of SERUM:
Visual Display of Emotions
- Confidence
- Squared Shoulders
- Uncrossed legs, arms, and hands
- Open Body language
- Direct Eye Contact (with camera)
- Deception
- Angle away when speaking directly to camera
- Fidgeting hand to face, / neck gestures
- Excessive eye contact (with camera)
- Crossed arms/or legs
- Anger
- Clenched fists
- Brows Furrowed
- Lips pulled tight and stretched horizontally
- Clenched facial features
- Direct Piercing eye contact
- Nervousness/Anxiety
- Rapid Eye-blinking
- Cracking Vocal/Voice
- Rapid breathing Mouth
- Fidgeting
- Self Doubt
- Bottom Lip Bite
- Eye’s positioning in-line with body language/face positioning of hunched
- Shoulder movements (in-line) shrugging
- Critical
- Dominant eyebrow raised (left/right hand determined)
- Concealed smile with lips positioned together
- stretched (lip tracking)
- Body Language
- Bored
- Guarded
- Dominant
- Insecure
- Thoughtful
- Comfortable
Tracking Behaviour Clues
- Breaking Gaze to right
- Crossing Arms
- Crossing legs
- Legs crossed right
- Clearing vocal/throat
- Deep Breath (vocal)
- Fidgety
- Direct Eye Contact
- Immediate Response
- Grooming behaviour
- Illustrators
- Laugh
- Repeating the Question and stating it’s a good question
- Scratch Neck
- Shift in Seat
- Strong Denial (contorted face tracking) + Vocal
- Hands in lap
- Immediate Yes/No
Deception Tracking
- Word System (Deception->Mixed<-Honesty)
- How its said
- rapid (stress)
- increased vocal volume (stress)
- Higher Pitch
- Tracking Vocal (anxiety)
- Pauses (thoughtful/deflection)
- Hesitation -speech pattern tracking (calculation, thoughtful, concern + facial tracking)
- Uh, um, ah – delaying
- Repeating words (stalling/deflect/delay)
- Unfinished words (uncertain, unconvinced)
- Broken speech (scrambling for words)
- Inflection
- Pace
- lowered Voice
- Mumbling (incoherent)
- Buying time
- Monotone
- Laughing
Facial Market (landmark) tracking
- Lips
- Eyes
- Nose
- Ears
- Retina
- Cheeks
- Sweat Areas
Body Language (landmark) tracking
- Posture
- Movement
- Shape
- Arms (movements)
- Hands (movements)
- Feet (movements)
- Shoulders (movements)
Performing multiple tasks simultaneously such as: face detection, facial recognition, age and gender detection, emotion (visual and vocal) detection, hand and body posture tracking, body and hand speed tracking, lip and cheek position tracking, and retina tracking SERUM rapidly creates a personalised baseline for individuals featured in videos and then continues to analyse their actions and emotions as the videos progresses. With additional speech analysis processing the content and context, SERUM draws together its findings and generates its results.
The use of both physical and vocal analysis allows SERUM to determine a myriad of physically apparent psychological traits including:
- Agitation
- Anxiety
- Arrogance
- Boredom
- Comfortable
- Confidence
- Deception
- Deceptive Traits
- Defiance
- Depression
- Fear
- Insecurity
- Protectiveness
- Strong deception
- Thinking
Once finished the analysed videos are published with graphic illustrations of the findings. This takes the form of dynamic tracking graphics which indicate the various elements IE: body tracking, lip and eye movements, pupil dilation/direction, flushing and blushing etc. It also indicates its analysed results pertaining to the featured person or persons inherent emotions with a simple three-word system – deception, mixed, honesty. Though the system can identify the above listed elements, it only indicates with the three simple words within the video itself. This is done for clarity and watchability. For a much more detailed breakdown, it is necessary to access the written report that is generated at the same time as the analysed video.
Detecting deception and honesty can be valuable in many arenas however it is most useful in politics, business, defence, security, and finance. Detecting deception within these fields can be crucial for holding individuals with dishonest intent accountable to governing authorities, oversight committees, investigative panels and relevant stakeholders.
To be more specific, here are a couple of more in-depth potential use cases:
FINANCE
Company representatives often give speeches and get involved in Q&A sessions regarding their company’s historical, recent and future activities. SERUM can be used to read between the lines and detect potential risks or fraudulent behaviour. By analysing various cues such as speech patterns, body language, and facial expressions, the system can identify potential red flags and alert investors or regulators. For example, if a CEO displays signs of nervousness or avoidance when discussing financial reports, the system can flag it as a potential warning sign for investors.
Use this tool (youtube/Twitter videos) or Commercial -> API -> [Truth] Serum for this tool via API.
MILITARY
Intelligence gathering for states is another potential application of SERUM. By analysing various behaviours, emotions, and physiological responses, the system can provide insights into the intentions and motives of foreign leaders or groups. For example, if a foreign leader displays signs of anger or aggression in a public speech, the system can alert intelligence agencies about the potential risks or threats posed by that leader or group.
Serum can also be used during interrogation and debriefing processes and remove the need for less humane or brutal physical practices which are carried out in some corners of the world
See: State -> Militarisation -> [Truth] Serum for this tool.
IMMIGRATION/BORDER CONTROL
Interviews take place at border crossings all day, every day, all around the world and it is of paramount importance that only those without ill intentions pass the checks. Utilising SERUM to analyse recorded interviews could provide insight as to whether any specific individual is declaring their true intentions for travelling into another country. Claiming to be coming on holiday but intending to carry out negative actions against the country being visited (terrorism). Or, individuals claiming asylum but not actually fleeing from danger in their home country etc’.
Overall, SERUM can be a valuable tool for accountability, risk management, and intelligence gathering in various fields. However, it’s important to note that the system’s accuracy and effectiveness depend on several factors, such as the quality of the data, the sophistication of the algorithms, and the expertise of the analysts. Moreover, the system raises several ethical and privacy concerns, such as the potential misuse of personal data and the risk of false positives or wrongful accusations. Therefore, it’s crucial to implement appropriate safeguards and regulations to ensure the system is used ethically and responsibly and for there to always be a human element when discussing the findings or potential actions resulting from analytical findings of SERUM.
See: Commercial -> API -> [Truth] Serum for this tool.
[Truth] Serum FAQ