Authors: Thomas P. Keenan
I can assure you that Mark Zuckerberg did
not
create the fundamental concept behind a face book. I know this because I am holding a dusty “1970 Freshman Directory” from Columbia University. Long before Mr. Zuckerberg was even imagined, college students were already judging each other and ridiculing awkward high school grad photos, in dorms and dining halls across the country.
One of the Columbia College men would trade a copy of our all-male book with a student from the all-female Barnard College just across Broadway, and we would engage in the same late-night “hot-or-not” discussions that Zuckerberg automated. However, things posted on Facebook now travel instantaneously around the world, which vastly increases the potential impact on our lives.
In 2010, Facebook introduced a new feature to automatically tag people in photos through facial recognition. This “tag suggestion” feature was turned on by default, a situation that did not sit well with data protection authorities, especially in Europe. The people there seem to be a lot keener on privacy protection than many other nationalities: images from the 1940s of punch cards with meticulously-typed Jewish names are etched into the public's consciousness. Remember that the vast majority of Facebook users provide their real names and photos, bowing to the company's Terms of Service.
When data protection commissioners in both Ireland and Hamburg objected to automated facial recognition, Facebook removed tag suggestions from customers in those countries.
92
In fact, they even removed the feature for users in the U.S. for a while, though it has been brought back in substantially the same form.
93
The company is coy about the exact number of photos that are in its database, but did say in an SEC filing that “on average, more than 250 million photos per day were uploaded to Facebook in the three months ended December 31, 2011.”
94
So, Facebook gets to build the world's largest, self-validated photo database on the planet, a project which has mind-boggling value for everyone from marketers to dictators to law enforcement agencies.
Not content to rely on careless, lazy humans to properly tag photos with names, Facebook's Artificial Intelligence Group in Menlo Park, CA has been hard at work on “DeepFace: Closing the Gap to Human-Level Performance in Face Verification.” In a 2014 academic paper they reported that their method “reaches an accuracy of 97.25% on the Labeled Faces in the Wild (LFW) dataset.”
95
LFW, maintained at the University of Massachusetts, is a popular collection of more than 13,000 faces with names attached that is often used for testing facial recognition technology.
96
This amazing performance rivals that of humans, who, we are told, are only about one quarter of a percent better (97.53%) than the algorithm. The scientists accomplished this by training a neural network “on an identity labeled database of four million facial images and by applying 3D rotations to align images.”
The announcement of DeepFace was greeted with headlines such as “Just as Creepy as It Sounds”
97
and “Facebook's Freaky DeepFace Program Knows Your Friends Better Than You Do.”
98
The technology is still on the drawing board but it is hard to imagine it will not move into mainstream use quickly, perhaps even built in to your next smartphone.
The
Onion News Network
has a tongue-in-cheek video report claiming that Facebook is actually a “massive online surveillance program run by the CIA.” It goes on to say that “Facebook has replaced almost every other CIA information gathering program since it was launched in 2004.” The report praises “CIA Agent Mark Zuckerberg, who runs the day to day Facebook operation for the agency.” It jokes that Facebook's Calendar feature even shows where you will be in advance so “now if they want to pick you up for questioning, all they have to do is see which events you've RSVPd âYes' to.”
99
In the same vein, a conspiracy theory video on YouTube called “Does what happens in the Facebook stay in the Facebook?” tracks some of the early backers and funders of Facebook, highlighting their defense and intelligence community connections.
100
I once put the question “Did the CIA create the Facebook” to someone senior enough in that agency to have a well-informed opinion. “No, we did not,” he said, but then he added that they use it every day as an excellent source of intelligence, and if it had not been launched by Zuckerberg, the CIA might well have created something like it.
MIT professor and author Sherry Turkle explains why we have such a burning desire to share our lives with the online world, including total strangers, in her book
Alone Together
. Turkle tells us that interacting with machines “may offer the illusion of companionship without the demands of friendship.”
101
Although she is writing about robots, the point applies to Facebook as well. Although your ultimate goal may be to communicate with other human beings, when you add something to your Facebook you are in fact dealing with a technological entity.
Blogger Maggie Clayman expands on that idea, suggesting that “perhaps people share pictures of them[selves] with their children because they feel a need to prove that they spend enough time with their children. Perhaps people post pictures of new purchases or great meals because they want to prove that their lives are really good.”
102
Photos of our favorite meals and recent purchases have marketers licking their chops. Analysis of that data, combined with images in our postings, can easily reveal other things that we might want to buy. To illustrate how this might work, consider a photo of loved ones that I posted, and tagged, on Facebook.
In the very near future, some computer will probably analyze this snapshot and come back with: “Hmm, (tag: Keri) that poor dog's (tag: Joey) leash is looking rather tatteredâwe just happen to have a sale on them, running through today only. And those boots you seem to like, we've got them too. By the way, that ski resort you seem to enjoy still has space available over the Christmas holidaysâif you book now. Click here. Oh, and are you interested in the paranormal? (tag: UFO) We have books on that.”
There are some entertaining countermeasures that can be deployed to befuddle the bots trying to analyze your images. I often tag delicious items on my dinner plate with the names of people I know, and Facebook plays along, at least for now. However, soon it will probably ask “don't you mean Market East Coast Oysters on the Half Shell?” and offer to have more sent to me via an online food delivery company.
Even though most computer users understand at least some of the implications of posting and tagging photos, they seem to have decided, either consciously or implicitly, to go along with the game. Privacy experts disparagingly called folks like this “sheeple.” They are also the ones who give up their email addresses for a free magazine subscription or answer a detailed online survey, hoping to win a $500 gift card. They make a Faustian bargain with online companies, allowing total access to their lives in exchange for services that appear to be completely free.
With improving technology, once even a single good photo of you is tagged with your real name on Facebook, your privacy is a goner. You will be identifiable and trackableâunless you are prepared for a face transplant, or at least to radically modify your appearance.
Realface Glamoflage shirts were designed to do exactly that. Artist Simone C. Niquille has created multi-face designs to distract and confuse facial recognition software. Her shirts have a number of faces, including that of Michael Jackson and Barack Obama, and, for now at least, seem to confuse the face bots.
An even more radical approach to dodging facial recognition cameras has been suggested by artist and researcher Zach Blas, with an idea he calls Facial Weaponization. He helps people create masks with weirdly-morphed versions of their actual face, hoping to bedevil the recognition software.
Figure 6. Zach Blas: Facial Weaponization Suite:
Fag
Face MaskâOctober 20, 2012
, Los Angeles, CA. Courtesy of Christopher O'Leary.
Wearing masks in public can get you in trouble with the law in some places, but surely they cannot ban outlandish hair styles and creative makeup. Artist Adam Harvey has been experimenting with eye-catching patterns that put the facial recognition programs off your digital scent. He got his inspiration from Dazzle, a camouflage paint used on battleships in World War I.
103
In the same spirit, photographer Petr Prokop has created Face Dazzler, a smartphones app that distorts your face in photos. He claims they become immune to facial recognition programs, but are still recognizable to your friends and family.
104
There are over 70 synonyms for “friend” in
Roget's Thesaurus
â“acquaintance, neighbor, well-wisher, advocate”âbut none of them is “a person or entity you don't really know but who seems to share your prejudices so you clicked yes on their friend request.” All technologies, and especially social media ones, expropriate familiar words and create their own creepy vocabularies. What is a poke? A news feed? A timeline? A like? Surely not the same as in the real world.
In a fascinating experiment, Dean Terry and Bradley Griffith at the University of Texas, Dallas created the concept of a Facebook enemy. Using their EnemyGraph application, users can declare their undying hatred of a politician, musician, or habit like smoking and see how many others chose the same enemy. Justin Bieber makes the list twice because he has multiple incarnations on Facebook.
For a while, whimsical entries such as “truck balls” and “bunnies” made the “Top Enemies” list, but as the EnemyGraph app attracted more users, the true enemies of the people rose to the top. Facebook normally bans applications that could disrupt the monetization of their ever-growing network of connected human beings. So if anyone tries to launch an “unfriend everybody” functionality it is quickly shot down by the company.
Yet Facebook tolerated EnemyGraph, perhaps because someone there understood that it was unwrapping a whole new category of information. Users could now be grouped by their mutual dislike of Bieber or bunnies or Microsoft, so targeted ads for things like bunny eradication powder might be both possible and probable.
Terry noted on his website that “people are also connected and motivated by things they dislike. Alliances are created, conversations are generated, friendships are stressed, stretched, and/or enhanced.”
105
While not ignoring the commercial possibilities of the data he is generating, he says it is really just a fun social experiment and critique of the philosophy of Facebook: “So, Facebook runs queries to find affinities. EnemyGraph runs what we call dissonance queries. So if you have said you like, say,
Portlandia
(a TV show) on your profile page, and in our app one of your friends has declared them an âenemy,' we will post this âdissonance report' in the app. In other words we point out a difference you have with a friend and offer it up for conversation, as opposed to a similarity. Relationships always include differences, and often these differences are a critical part of the fabric of a friendship.” He goes on to suggest that in the “country club atmosphere” of Facebook these differences are ignored because dissonance is not part of their “social philosophy.”
Some are even suggesting that the digital trail you leave simply by “Liking” things on Facebook can paint a fairly accurate profile of you. The website
www.youarewhatyoulike.com
tells you about yourself based on your Facebook likes. I dug into the logic of the program using a specially constructed new Facebook profile to see which likes it used to form its opinion. It reported two of the ten Likes on the profile, and they were both travel sites. It told me pleasant things like I am “warm and trusting” and “liberal and artistic.”
The algorithm behind this comes from a research project at the University of Cambridge. For marketers, this kind of application is real gold. You can be sure if this level of analytics is available to all of us, for free, what they have is a lot more powerful.
While this application is fun and basically harmless, you may not want your current or a potential employer poking around on your Facebook profile, Twitter feed, personal blog, or photo albums. In 2013, BuzzFeed and CNN collaborated on an article called “ten people who learned social media can get you fired.”
106
Examples included “The Bitter Barista” who blogged what he really thought about his customers. Former California Pizza Kitchen server “Timothy ÂDeLaGhetto” tweeted as @Traphik about how little he liked the Âuniform he was required to wear. He no longer has to wear it since he no longer works for the company.