
Story
-
The Picture This “smart” frame shows police photographs of homeless people by Carl Durheim (1810-1890)
-
By looking at a picture, you trigger a face detection algorithm to analyse both, you and the homeless person
-
The algorithm detects gender, age and mood of the person on the portrait (not always right)
-
You, as a spectator, become part of the system / algorithm judging the homeless person
-
The person on the picture is at the mercy of the spectator, once again
How it works
-
Picture frame has a camera doing face detection for presence detection
-
Pictures have been pre-processed using a cloud service
-
Detection is still rather slow (should run faster on the Raspi 2)
-
Here's a little video https://www.flickr.com/photos/tamberg/16053255113/
Questions (not) answered
-
Who were those people? Why were they homeless? What was their crime?
-
How would we treat them? How will they / we be treated tomorrow? (by algorithms)
Data
Team
-
@ram00n
-
@tamberg
-
and you
Ideas/Iterations
-
Download the pictures to the Raspi and display one of them (warmup)
-
Slideshow and turning the images 90° to adapt to the screensize
-
Play around with potentiometer and Arduino to bring an analog input onto the Raspi (which only has digital I/O)
-
Connect everything and adapt the slideshow speed with the potentiometer
-
Display the name (extracted from the filename) below the picture
next steps, more ideas:
-
Use the Raspi Cam to detect a visitor in front of the frame and stop the slideshow
-
Use the Raspi Cam to take a picture of the face of the visitor
-
Detect faces in the camera picture
-
Detect faces in the images [DONE, manually, using online service]
-
…merge visitor and picture faces
Material
-
7inch TFT https://www.adafruit.com/products/947
-
Picture frame http://www.thingiverse.com/thing:702589
Software
-
http://www.raspberrypi.org/downloads/ - Raspbian
-
http://www.pygame.org - A game framework, allows easy display of images
-
https://bitbucket.org/tamberg/makeopendata/src/tip/2015/PictureThis - Scraper and Display
Links
-
http://www.raspberrypi.org/facial-recognition-opencv-on-the-camera-board/ - OpenCV on Raspi-Cam
-
https://speakerdeck.com/player/083e55006e4a013063711231381528f7 - Slide 106 for face replacement
Not used this time, but might be useful
-
https://thinkrpi.wordpress.com/2013/05/22/opencv-and-camera-board-csi/ - old Raspian versions did not have the latest OpenCV installed. Nice howto for that
-
https://realpython.com/blog/python/face-recognition-with-python/ - OpenCV, nice but not used
-
http://docs.opencv.org - not used directly, only via SimpleCV
-
http://makezine.com/projects/pi-face-treasure-box/ - maybe a nice weekend project
-
http://www.aliexpress.com/item/FreeShipping-Banana-Pro-Pi-7-inch-LVDS-LCD-Module-7-Touch-Screen-F-Raspberry-Pi-Car/32246029570.html - 7inch TFT mit LVDS Flex Connector
Manifestazione
1st Swiss Open Cultural Data Hackathon
Data
Luogo
Bern