Computer Vision over Homomorphically Encrypted Data
CVPR 2025 Tutorial
June 12, 2025
Michigan State University
Progress In Artificial Intelligence
Speech Processing
Image Analysis
Natural Language Processing
Physical Sciences
Key Drivers
Data, Compute, Algorithms
Widespread deployment in the real-world, especially as cloud
services.
State of Affairs
(report from the academic-world)
Attacks on Face Recognition Systems
Attacks on Face Recognition Systems: Template Inversion
Template inversion attack on High resolution image
From Template inversion attack to Replay and Presentation attack
Template inversion attack enables
Presentation attack
Presentation attack via digital replay and printed photograph
Presentation attack via printed photograph
Presentation attack via digital replay
Attacks on Augmented Reality Systems
Privacy Leakage in Augmented Reality
- Pittaluga et. al., "Revealing Scenes by Inverting Structure from Motion Reconstructions", CVPR 2019
Attacks on Large Language Models
Attacks on Text Embeddings
Attacks on Language Models
Attacks on User Prompts
State of Affairs
(report from the real-world)
Healthcare Data Breaches of 500+ Records (2009-2024)
Real world AI systems are very effective, but
suffer from privacy and security vulnerabilities.
Privacy Requirements in AI
...consent should be given for all purposes...
Tutorial Agenda
Computer Vision + Encryption
What are we trying to protect in AI?
- $x$: images, audio, video, text
- $f$: parameters, functional form
Data Privacy
- Protect user privacy.
- Prevent unauthorized access.
- Gain user's trust.
- Comply with regulations like GDPR.
Standard Encryption: Data is Encrypted Only During
Communication
Privacy of user data is not guaranteed.
Is there an encryption scheme that satisfies our security desiderata?
Fully Homomorphic Encryption
What is Fully Homomorphic Encryption?
Run programs on encrypted data without ever decrypting it.
FHE can—in theory—handle universal computation.
Conway's Game of Life
Microprocessor Simulation
What is this tutorial about?
“Encrypted Computer Vision. Everything. Everywhere. Always Secure.”
Hands-On Demo
Pytorch
Microsoft SEAL - C++