AI Safety & Regulation

The hiring algorithm that discriminated

In 2018, Amazon discovered their AI-powered hiring tool was systematically downranking resumes from women. The model had been trained on 10 years of hiring data — a decade where the tech industry was overwhelmingly male. So the AI learned that male candidates were "better" and penalized resumes that mentioned women's colleges or included the word "women's."

Amazon scrapped the tool. But it took years to discover the bias — and no law required them to check.

Today, the EU AI Act makes that kind of unchecked AI deployment illegal. By August 2026, companies deploying high-risk AI systems in the EU (including hiring, lending, and law enforcement AI) must prove they've assessed and mitigated bias, or face fines of up to 3% of global annual revenue (up to 7% for deploying outright prohibited AI systems).

Why AI safety matters

AI systems can cause harm in ways traditional software can't:

The EU AI Act — what you need to know

The EU AI Act is the world's first comprehensive AI law. It was adopted in 2024, with enforcement phased in through 2027.

The risk-based approach

Key deadlines

Article 4: AI Literacy (already in effect)

The most broadly applicable provision: every organization deploying AI must ensure staff have "sufficient AI literacy" to use AI systems competently and understand their limitations.

This means: if your employees use ChatGPT, Copilot, or any AI tool, you need to document that they've been trained on how to use it responsibly.

AI safety beyond regulation

Bias and fairness

AI models inherit biases from their training data. If historical data reflects discrimination, the model will discriminate. Key areas:

• Hiring AI — Can discriminate by gender, race, age, disability
• Lending AI — Can redline neighborhoods or demographics
• Healthcare AI — Can perform worse for underrepresented groups
• Criminal justice AI — Can amplify existing racial disparities

What responsible organizations do: Test models across demographics, audit for disparate impact, maintain human oversight for consequential decisions.

Transparency and explainability

When an AI denies your loan or flags your content, you should be able to understand why. "The model said so" isn't acceptable for decisions that affect people's lives.

Human oversight

The principle that humans should remain in control of AI decisions — especially high-stakes ones. This means:

• Human review before final decisions in hiring, lending, healthcare
• Kill switches for autonomous systems
• Clear escalation paths when AI output seems wrong

What this means for you

If you use AI at work

• Understand your company's AI policy
• Never use AI for consequential decisions without human review
• Document how AI is used in your workflows (for compliance)
• Get AI literacy training (it may already be required)

If you build AI products

• Conduct risk assessments before deployment
• Test for bias across demographics
• Build in transparency — explain how your AI makes decisions
• Design human oversight into high-stakes workflows
• Document everything — the EU AI Act requires extensive documentation

If you lead a team or organization

• Assess which AI systems you use and their risk levels
• Ensure Article 4 compliance — train staff on AI literacy
• Appoint someone responsible for AI governance
• Start compliance work now — August 2026 is coming fast

Key takeaways

• AI safety covers bias, hallucination, privacy, manipulation, and autonomous harm
• The EU AI Act is law — Article 4 (AI literacy) is already in effect; high-risk rules enforce August 2026
• AI systems are classified by risk: unacceptable (banned), high, limited, minimal
• Fines reach 3% of global revenue for high-risk AI violations, and up to 7% for prohibited AI — this isn't optional
• The Act applies to anyone whose AI affects EU residents, regardless of company location
• Start now: train staff, assess AI risk levels, document usage, ensure human oversight