• bitcoinBitcoin(BTC)$63,076.000.52%
  • ethereumEthereum(ETH)$1,778.130.85%
  • tetherTether(USDT)$1.000.00%
  • binancecoinBNB(BNB)$586.081.06%
  • usd-coinUSDC(USDC)$1.000.00%
  • rippleXRP(XRP)$0.97-0.10%
  • solanaSolana(SOL)$73.680.69%
  • tronTRON(TRX)$0.3096990.19%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.032.07%
  • HyperliquidHyperliquid(HYPE)$67.633.22%
  • zcashZcash(ZEC)$920.87-0.28%
  • moneroMonero(XMR)$490.77-0.87%
  • dogecoinDogecoin(DOGE)$0.0586440.17%
  • leo-tokenLEO Token(LEO)$9.30-0.21%
  • USDSUSDS(USDS)$1.000.00%
  • whitebitWhiteBIT Coin(WBT)$61.100.55%
  • chainlinkChainlink(LINK)$9.010.24%
  • cardanoCardano(ADA)$0.1523301.20%
  • Ethena USDeEthena USDe(USDE)$1.000.04%
  • stellarStellar(XLM)$0.134167-3.27%
  • daiDai(DAI)$1.000.00%
  • nearNEAR Protocol(NEAR)$3.272.32%
  • bitcoin-cashBitcoin Cash(BCH)$205.30-0.51%
  • litecoinLitecoin(LTC)$43.38-0.42%
  • CantonCanton(CC)$0.081752-0.39%
  • avalanche-2Avalanche(AVAX)$7.000.92%
  • RainRain(RAIN)$0.004373-3.32%
  • uniswapUniswap(UNI)$4.94-3.27%
  • tether-goldTether Gold(XAUT)$3,671.22-1.82%
  • suiSui(SUI)$0.710.54%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.021.10%
  • USD1USD1(USD1)$1.000.01%
  • Ripple USDRipple USD(RLUSD)$1.00-0.01%
  • Global DollarGlobal Dollar(USDG)$1.000.00%
  • hedera-hashgraphHedera(HBAR)$0.055193-1.66%
  • paypal-usdPayPal USD(PYUSD)$1.000.01%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.15-0.07%
  • BittensorBittensor(TAO)$193.181.26%
  • shiba-inuShiba Inu(SHIB)$0.0000041.41%
  • quant-networkQuant(QNT)$149.91-0.85%
  • crypto-com-chainCronos(CRO)$0.041390-3.07%
  • Circle USYCCircle USYC(USYC)$1.140.01%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.120.15%
  • MemeCoreMemeCore(M)$0.86-2.72%
  • okbOKB(OKB)$87.431.52%
  • Falcon USDFalcon USD(USDF)$1.000.02%
  • pax-goldPAX Gold(PAXG)$3,669.17-1.88%
  • United StablesUnited Stables(U)$1.000.03%
  • aaveAave(AAVE)$104.46-3.12%
  • pepePepe(PEPE)$0.0000042.67%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Automated Deception Detection: Tokyo University Researchers Utilize Facial Expressions and Pulse Rates to Unmask Deception through Machine Learning

August 2, 2023
in AI & Technology
Reading Time: 5 mins read
A A
Automated Deception Detection: Tokyo University Researchers Utilize Facial Expressions and Pulse Rates to Unmask Deception through Machine Learning
ShareShareShareShareShare

In the digital era, automated deception detection systems have become vital across various fields. The demand for accurate detection is evident in commerce, medicine, education, law enforcement, and national security. Human interviewers’ limitations pose risks of false accusations and ineffective detection. To address these challenges, Tokyo University of Science researchers propose a machine-learning approach that combines facial expressions and pulse rate data for comprehensive deception detection. The goal is to develop a fair and reliable system that can assist in interviews with crime victims, suspects, and individuals with mental health issues. The researchers emphasize the importance of precise suspect classification to avoid misidentifications and to uphold ethical and legal considerations; they suggest a human-in-the-loop approach. This innovative method ensures ethical compliance while enabling widespread applications in crucial decision-making processes.

In related work, previous studies have explored deception detection using various methods. One study developed a “deception analysis and reasoning engine,” employing multi-modal information from videos to detect deception with an AUC of approximately 87%. Another study focused on identifying differences in valences and arousal between truthful and deceptive speakers, achieving an AUC of 91% using emotional, visual, audio, and verbal features. AUC is a commonly used metric in binary classification tasks like deception detection. Additionally, a machine learning approach was used to detect deception based on non-verbal behavior (NVB), achieving an accuracy of approximately 80% by identifying cues such as facial micro-movements, changes in gaze, and blink rates. However, limitations were observed in some of these studies due to unnatural role-playing approaches for data collection.

In contrast to traditional methods, this innovative study introduces a natural approach where subjects freely improvise deceptive behaviors to enhance deception detection accuracy. The proposed method employs machine learning, specifically the Random Forest (RF) technique, to create a deception detection model that integrates facial expressions and pulse rate data. Data were collected from four male graduate students discussing random images while making deceptive statements. Facial expressions were recorded using a web camera, and pulse rates were measured using a smartwatch during the interviews.  

The process involves standard machine learning steps, including data collection, labeling, feature extraction, preprocessing, and classification. Subjects were shown various images and encouraged to express their thoughts, including deceptive statements. The resulting dataset was labeled based on the subjects’ intentions, specifically focusing on intentional deception rather than errors or false memory. Facial landmarks from recorded videos were extracted using the OpenFace library, and various facial features, such as eyebrow tilt, eye aspect ratio, mouth area, blink rate, gaze, head tilt, and pulse rate, were derived from these landmarks. Preprocessing involved removing missing values, filtering outliers, and applying undersampling to balance positive and negative cases.

https://link.springer.com/article/10.1007/s10015-023-00869-9

The Random Forest (RF) was trained and evaluated using 10-fold cross-validation, with performance metrics like accuracy, precision, recall, and F1 score used to assess its effectiveness. Remarkably, experiments conducted with actual remote job interviews demonstrated similar performance to cross-validation results, confirming the method’s real-world applicability. The analysis of feature importance highlighted specific facial features, pulse rate, and gaze and head movements as significant indicators of deception across different subjects. For example, changes in the mouth area, silence, and blinking indicated deceptive behavior in some cases, while others showed notable variations in pulse rate and gaze direction during deception. 

Overall, this research provides a practical and promising approach to detecting deceptive statements in remote interviews using machine learning and facial feature analysis, offering valuable insights for real-world applications. The proposed method, which eliminates human bias, demonstrated promising accuracy and F1 scores between 0.75 and 0.88 for different subjects. Common features related to facial expressions and pulse rate during deception were observed among subjects. However, further studies are needed to handle multi-class classification and include psychological assessments for a more comprehensive analysis. Despite the limitations in dataset size, this research offers a foundation for interviewers interested in utilizing automatic deception detection systems while emphasizing the importance of ethical considerations and legal compliance in their application.


Check out the Paper and Blog Article. All Credit For This Research Goes To the Researchers on This Project. Also, don’t forget to join our 27k+ ML SubReddit, 40k+ Facebook Community, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more.


YOU MAY ALSO LIKE

Huang to Brief Congress on Affair After Nvidia Ouster

Nvidia Boosts Forecast, Quashes Huang’s Return

Madhur Garg is a consulting intern at MarktechPost. He is currently pursuing his B.Tech in Civil and Environmental Engineering from the Indian Institute of Technology (IIT), Patna. He shares a strong passion for Machine Learning and enjoys exploring the latest advancements in technologies and their practical applications. With a keen interest in artificial intelligence and its diverse applications, Madhur is determined to contribute to the field of Data Science and leverage its potential impact in various industries.


🔥 Use SQL to predict the future (Sponsored)

Credit: Source link

ShareTweetSendSharePin

Related Posts

Huang to Brief Congress on Affair After Nvidia Ouster
AI & Technology

Huang to Brief Congress on Affair After Nvidia Ouster

November 19, 2026
Nvidia Boosts Forecast, Quashes Huang’s Return
AI & Technology

Nvidia Boosts Forecast, Quashes Huang’s Return

November 19, 2026
Nvidia Earnings Impress, But Succession Risk Lingers
AI & Technology

Nvidia Earnings Impress, But Succession Risk Lingers

November 19, 2026
LangChain Launches LangSmith Tool Gateway to Govern Agent Tool Calls – Unite.AI
AI & Technology

LangChain Launches LangSmith Tool Gateway to Govern Agent Tool Calls – Unite.AI

November 19, 2026
Next Post
Rockport Shoe Business Sold to New Balance, Changing Up Footwear Market

Rockport Shoe Business Sold to New Balance, Changing Up Footwear Market

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Why Apple’s HomeView Relies So Heavily On Your iPhone

Why Apple’s HomeView Relies So Heavily On Your iPhone

November 13, 2026
Mississippi Dem. Senate candidate: Trump promised ‘America First,’ but delivered ‘Mississippi last’

Mississippi Dem. Senate candidate: Trump promised ‘America First,’ but delivered ‘Mississippi last’

November 13, 2026
Comey’s lawyers attempt to get new criminal charges thrown out

Comey’s lawyers attempt to get new criminal charges thrown out

November 13, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!