Google’s true origin partly lies in CIA and NSA research grants for mass surveillance — Quartz


  • Google’s true origin partly lies in CIA and NSA research grants for mass surveillance — Quartz

    Le titre est un peu « clickbait », mais les infos sont intéressantes, quoique parfois elliptiques.

    C’est écrit par : Jeff Nesbit, Former director of legislative and public affairs, National Science Foundation
    Quelqu’un qui doit savoir de quoi il cause.

    In the mid 1990s, the intelligence community in America began to realize that they had an opportunity. The supercomputing community was just beginning to migrate from university settings into the private sector, led by investments from a place that would come to be known as Silicon Valley.

    The intelligence community wanted to shape Silicon Valley’s efforts at their inception so they would be useful for homeland security purposes. A digital revolution was underway: one that would transform the world of data gathering and how we make sense of massive amounts of information. The intelligence community wanted to shape Silicon Valley’s supercomputing efforts at their inception so they would be useful for both military and homeland security purposes. Could this supercomputing network, which would become capable of storing terabytes of information, make intelligent sense of the digital trail that human beings leave behind?

    Intelligence-gathering may have been their world, but the Central Intelligence Agency (CIA) and the National Security Agency (NSA) had come to realize that their future was likely to be profoundly shaped outside the government. It was at a time when military and intelligence budgets within the Clinton administration were in jeopardy, and the private sector had vast resources at their disposal. If the intelligence community wanted to conduct mass surveillance for national security purposes, it would require cooperation between the government and the emerging supercomputing companies.

    Silicon Valley was no different. By the mid 1990s, the intelligence community was seeding funding to the most promising supercomputing efforts across academia, guiding the creation of efforts to make massive amounts of information useful for both the private sector as well as the intelligence community.

    They funded these computer scientists through an unclassified, highly compartmentalized program that was managed for the CIA and the NSA by large military and intelligence contractors. It was called the Massive Digital Data Systems (MDDS) project.
    The Massive Digital Data Systems (MDDS) project

    MDDS was introduced to several dozen leading computer scientists at Stanford, CalTech, MIT, Carnegie Mellon, Harvard, and others in a white paper that described what the CIA, NSA, DARPA, and other agencies hoped to achieve. The research would largely be funded and managed by unclassified science agencies like NSF, which would allow the architecture to be scaled up in the private sector if it managed to achieve what the intelligence community hoped for.

    “Not only are activities becoming more complex, but changing demands require that the IC [Intelligence Community] process different types as well as larger volumes of data,” the intelligence community said in its 1993 MDDS white paper. “Consequently, the IC is taking a proactive role in stimulating research in the efficient management of massive databases and ensuring that IC requirements can be incorporated or adapted into commercial products. Because the challenges are not unique to any one agency, the Community Management Staff (CMS) has commissioned a Massive Digital Data Systems [MDDS] Working Group to address the needs and to identify and evaluate possible solutions.”

    In 1995, one of the first and most promising MDDS grants went to a computer-science research team at Stanford University with a decade-long history of working with NSF and DARPA grants. The primary objective of this grant was “query optimization of very complex queries that are described using the ‘query flocks’ approach.” A second grant—the DARPA-NSF grant most closely associated with Google’s origin—was part of a coordinated effort to build a massive digital library using the internet as its backbone. Both grants funded research by two graduate students who were making rapid advances in web-page ranking, as well as tracking (and making sense of) user queries: future Google cofounders Sergey Brin and Larry Page.

    The research by Brin and Page under these grants became the heart of Google: people using search functions to find precisely what they wanted inside a very large data set. The intelligence community, however, saw a slightly different benefit in their research: Could the network be organized so efficiently that individual users could be uniquely identified and tracked?

    The grants allowed Brin and Page to do their work and contributed to their breakthroughs in web-page ranking and tracking user queries. Brin didn’t work for the intelligence community—or for anyone else. Google had not yet been incorporated. He was just a Stanford researcher taking advantage of the grant provided by the NSA and CIA through the unclassified MDDS program.
    Left out of Google’s story

    The MDDS research effort has never been part of Google’s origin story, even though the principal investigator for the MDDS grant specifically named Google as directly resulting from their research: “Its core technology, which allows it to find pages far more accurately than other search engines, was partially supported by this grant,” he wrote. In a published research paper that includes some of Brin’s pivotal work, the authors also reference the NSF grant that was created by the MDDS program.

    Instead, every Google creation story only mentions just one federal grant: the NSF/DARPA “digital libraries” grant, which was designed to allow Stanford researchers to search the entire World Wide Web stored on the university’s servers at the time. “The development of the Google algorithms was carried on a variety of computers, mainly provided by the NSF-DARPA-NASA-funded Digital Library project at Stanford,” Stanford’s Infolab says of its origin, for example. NSF likewise only references the digital libraries grant, not the MDDS grant as well, in its own history of Google’s origin. In the famous research paper, “The Anatomy of a Large-Scale Hypertextual Web Search Engine,” which describes the creation of Google, Brin and Page thanked the NSF and DARPA for its digital library grant to Stanford. But the grant from the intelligence community’s MDDS program—specifically designed for the breakthrough that Google was built upon—has faded into obscurity.

    Google has said in the past that it was not funded or created by the CIA. For instance, when stories circulated in 2006 that Google had received funding from the intelligence community for years to assist in counter-terrorism efforts, the company told Wired magazine founder John Battelle, “The statements related to Google are completely untrue.”

    Did the CIA directly fund the work of Brin and Page, and therefore create Google? No. But were Brin and Page researching precisely what the NSA, the CIA, and the intelligence community hoped for, assisted by their grants? Absolutely.

    In this way, the collaboration between the intelligence community and big, commercial science and tech companies has been wildly successful. When national security agencies need to identify and track people and groups, they know where to turn – and do so frequently. That was the goal in the beginning. It has succeeded perhaps more than anyone could have imagined at the time.


    Two decades ago, the US intelligence community worked closely with Silicon Valley in an effort to track citizens in cyberspace. And Google is at the heart of that origin story. Some of the research that led to Google’s ambitious creation was funded and coordinated by a research group established by the intelligence community to find ways to track individuals and groups online.

  • Google’s true origin partly lies in CIA and NSA research grants for mass surveillance, by Jeff Nesbit — Quartz

    Did the CIA directly fund the work of Brin and Page, and therefore create Google? No. But were Brin and Page researching precisely what the NSA, the CIA, and the intelligence community hoped for, assisted by their grants? Absolutely.

    The CIA and NSA funded an unclassified, compartmentalized program designed from its inception to spur something that looks almost exactly like Google.

    To understand this significance, you have to consider what the intelligence community was trying to achieve as it seeded grants to the best computer-science minds in academia

    #surveillance #google #CIA #origin_stories #recherche

    • Au début de Google, il y avait d’autres moteurs de recherche (altavista par exemple) presque aussi bons, et ce n’est pas le petit avantage qu’avait Google qui permet d’expliquer son succès à plates coutures...

      En revanche, si la CIA a créé et financé Google, cela explique les moyens gigantesque mis à sa disposition pour acquérir les #Big_Data avec lesquelles elle a acquis ses compétences (pensez par exemple aux photos de chaque maison de chaque rue de chaque ville de chaque pays de toute la planète !), son pouvoir et, en retour, sa fortune, avec au passage la mise au ban de tous ses concurrents.

      Je m’en doutais un peu, mais ce genre d’article permet de remonter le scénario. Aujourd’hui encore, Google travaille donc de concert avec la CIA, comme en témoigne le passage d’Eric Schmidt, ancien PDG de Google et actuel président d’Alphabet, comme conseiller officiel pour le Pentagone...

      En même temps, c’est aussi l’armée américaine qui a inventé internet, ce n’est pas si étonnant qu’ils veuillent que ça leur soit utile. A nous de le savoir et d’en tenir compte...

    • C’est un peu plus fin, quand même, quand c’est apparu, ils se sont basés sur des recherches (scientifiques) qui aboutissaient à une manière bien différente de trier la pertinence des résultats par rapport aux concurrents. Donc quand on allait dessus, dans pas mal de cas « ça marchait mieux ». C’est quand même un facteur important d’adoption (et qui a abouti à la base utilisateur permettant le big data). Mais ils ont misé sur le bon cheval…

    • Ca marchait un peu mieux, certes, mais en général on était habitués à ce que lors de la version suivante, le concurrent rattrapait son retard, ce qui permettait de ne pas changer ses habitudes, alors que là ils ont fait le vide autour d’eux en quelques mois à peine... Mais bon, je ne veux pas paraître parano...

    • Une #guerre_culturelle comme la CIA sait les mener depuis longtemps.
      Google a su forcer la main des optimistes béats de la technologie alors que les leaders d’opinion comme certain·es intellectuel·les inconscient·es tenaient un discours enchanteur sur la praticité informatique de cette firme (et des autres). Je ne sais comment l’amollissement de leur esprit, très certainement complexé de leur méconnaissance technique (mais oui, donnons le pouvoir aux enfants pour avoir des dictateurs tout neufs), les a rendu aussi incapables de voir que Google allait devenir un operating system au même titre qu’Apple ou Windows, mais avec une hégémonie particulièrement revendiquée de #BigBrother.
      Pour ma part j’approfondirai un jour ma pensée du fait que mettre un pied dans Google est comparable à accepter de mourir.
      POur la petite histoire je viens d’acheter un lave-linge avec la *%#@ robotisé de Google en cadeau, un truc qui se vend soit-disant à 60 euros et qui est entrain d’entrer par la petite porte de la gratuité (également via les opérateurs téléphonqiues) dans tous les foyers … je ne sais pas encore comment je vais noyer cette merde, si vous voulez la décortiquer, je vous l’envoie.

    • C’est un effet cumulé, je me souviens qu’altavista c’etait assez performant pour la recherche d’image mais moins pour d’autres type de contenus et que google avait l’avantage d’être sobre, simple et de combiné plusieurs moteurs de recherche en un.
      J’essaye de mon coté de passé sur Qwant depuis deux ou trois semaines mais presque systématiquement je trouve pas ce qui m’interesse et je doit doublé ma recherche sur gogol qui trouve ce que je veux :’(

    • Depuis quelques temps, quand j’utilise #searx, les résultats sont moins bons, voire nuls et remplacés par la réponse suivante :

      Erreur ! Les moteurs ne peuvent récupérer de résultats.
      google (unexpected crash : CAPTCHA required)
      Veuillez réessayer ultérieurement, ou utiliser une instance différente de searx.

      Est-ce que vous comprenez le problème, et qu’est-ce que c’est une « instance différente de searx » ?

      Merci !