Wondering whether software can read your mood? What is emotion recognition AI? It infers feelings from biometric data like faces or voices, and the EU AI Act restricts it at work and school.
This guide sits within our coverage of emerging technologies, and it looks at one of the most contested uses of AI: software that tries to read feelings.
| Item | Value |
|---|---|
| Provision restricting emotion inference at work and school | Article 5(1)(f) of the AI Act |
| Legal definition of an emotion recognition system | Article 3(39) of the AI Act |
| Settings where the ban applies | Workplace and education institutions |
| Status of such systems outside those settings | High-risk, under Annex III, paragraph 1, subparagraph c |
| Purposes excluded from the ban | Medical and safety purposes |
| Commission guidelines on prohibited practices | Reported by CMS on 10 Feb 2025 |
The legal references come from the Future of Privacy Forum’s March 2026 analysis and a CMS legal update. Rules and their interpretation can change, so check the sources before you rely on them.
What emotion recognition AI actually does
The EU AI Act gives a formal definition in Article 3(39): an AI system for the purpose of identifying or inferring emotions or intentions of natural persons on the basis of their biometric data, as the Future of Privacy Forum sets out. In plain terms, emotion recognition AI takes signals from a person’s body and guesses what that person feels.
The same analysis splits that definition into three elements:
- The system must be used for identifying or inferring.
- The target is the emotions or intentions of natural persons.
- The inference must rest on biometric data of those persons.
Which feelings count? Recital 18 of the AI Act gives a non-exhaustive list: happiness, sadness, anger, surprise, disgust, embarrassment, excitement, shame, contempt, satisfaction and amusement.
This is a different job from working out who someone is. For that task, read how does facial recognition work.
What does not count as emotion recognition
The word “guess” matters here, because several things that look similar are left outside the legal definition. According to the FPF analysis, these are the main ones:
- Physical states such as pain or fatigue are not included. Systems that detect fatigue in professional pilots or drivers to prevent accidents are explicitly excluded.
- Readily apparent expressions, such as a frown or a smile, or the movement of hands, arms or head, are not covered when they are only detected.
- Voice characteristics, such as a raised voice or whispering, are likewise not included unless they are used for identifying or inferring emotions.
- Written text: the Commission’s Guidelines clarify that inferring emotions from text does not fall within the scope of the prohibition.
The line is about the inference. Spotting that someone is smiling is detection, while concluding that they are satisfied is emotion recognition.
Why does the EU restrict it at work and school?
The main reason is the power imbalance in these settings. The FPF analysis says workers and students are in particularly vulnerable positions, so a tool that watches their feelings could lead to unfavourable treatment of individuals or whole groups.
The AI Act also questions the technology itself. Recital 44 points to a lack of scientific basis, limited reliability, a lack of specificity and limited generalisability, which may lead to discriminatory outcomes. For background on the examples these systems learn from, see what is training data.
Put together, the aim is to protect people from potentially invasive emotional surveillance, in the words of the same analysis.
Where the ban applies and where it does not
As of the FPF’s March 2026 analysis, not all emotion recognition AI is prohibited. Article 5(1)(f) bars AI systems from inferring the emotions of a person in the workplace and education institutions based on biometric data, with exceptions for medical and safety purposes. You can read the source in full at the FPF blog.
The ban applies only when every condition is met at once:
- The system is placed on the market, put into service for this specific purpose, or used.
- It is used specifically to infer emotions.
- It operates in the workplace or in education and training institutions.
- It is not intended for medical or safety reasons.
Emotion recognition systems used elsewhere do not fall under the ban. They qualify as high-risk under Annex III, paragraph 1, subparagraph c of the AI Act.
The Commission’s guidelines on prohibited practices, as the CMS legal update lists them, treat emotion recognition in workplaces and schools under Article 5(1)(f). They also address untargeted scraping to develop facial recognition databases under Article 5(1)(e).
Gray areas that remain unclear
The FPF analysis admits that parts of the ban are hard to pin down. These are the open points it names:
- Secondary features. It is unclear whether a tool whose main aim is something else, such as transcribing meetings or monitoring students during a test, is covered when it also infers emotions.
- Intentions. The definition in Article 3(39) includes intentions, but the ban seems to leave their inference out.
- Mood. The distinction between mood and emotion is not made, so it is unclear whether mood detection falls within the prohibition.
- Look-alike signals. Pain or fatigue can produce expressions that are mistaken for emotions.
If a product claims to read feelings, three questions help: what exactly does it infer, from which biometric data, and in which setting is it used? The answers decide which rule, if any, applies.
Frequently asked questions
Is all emotion recognition banned in the EU?
Show answer
No. As of the FPF’s March 2026 analysis, the ban covers inferring emotions in the workplace and education institutions. Systems used elsewhere are classed as high-risk.
Does detecting a smile count as emotion recognition?
Show answer
Not by itself. Detecting readily apparent expressions such as a frown or a smile is not included unless the detection is used to identify or infer emotions.
Is fatigue detection for drivers covered?
Show answer
No. Physical states such as pain or fatigue are outside the definition, and systems that detect fatigue in pilots or drivers to prevent accidents are explicitly excluded.
Does the ban cover emotions read from written text?
Show answer
The Commission’s Guidelines clarify that inferring emotions from written text does not fall within the scope of the prohibition, according to the FPF analysis.
