DARPA Wants to Help You Search the Web Better

GIl C via Shutterstock

AA Font size + Print

DARPA has kicked off a project to fine tune web searches by topical domain rather than subject. By Bob Brewin

The Defense Advanced Research Projects Agency has kicked off a project to fine tune Web searches by topical domain rather than general subjects, allowing it to “maintain technological superiority in the area of content indexing and Web search on the Internet.”

DARPA plans to use the system initially to counter human trafficking, which is enabled by websites, forums and chat rooms.

DARPA said its “Memex” (a combination of the words memory and index) project will, among other things, search “deep Web” content missed by commercial search engines and “will address the inherent shortcomings of centralized search by developing technology for domain-specific indexing of Web content and domain-specific search capabilities.”

Memex will develop technology to enable discovery, organization, and presentation of domain-relevant content. DARPA envisions the new system providing fast, flexible and efficient access to domain-specific content as well as search interfaces that offer valuable insight into a domain that previously remained unexplored.

DARPA wants researchers to develop advanced and highly automated Web-crawler software to penetrate sites and resources that have erected crawler defenses to aid domain-specific indexing and a domain specific search engine.

The research agency said the Memex system can help  counter human trafficking, which, “especially for the commercial sex trade, is a line of business with significant Web presence to attract customers and is relevant to many types of military, law enforcement, and intelligence investigations.”

Human trafficking forums, chats, advertisements, job postings and hidden services “continue to enable a growing industry of modern slavery,” DARPA said. “An index curated for the counter trafficking domain, including labor and sex trafficking, along with configurable interfaces for search and analysis will enable a new opportunity for military, law enforcement, legal, and intelligence actions to be taken against trafficking enterprises.”

The Memex project takes its name and inspiration from a 1945 article in The Atlantic titled As We May Think, in which Dr. Vannevar Bush, head of the White House Office of Scientific Research and Development, envisioned an analog computer to supplement human memory, the Memex, which would store and automatically cross-reference all of the user’s books, records and other information.

DARPA expects the Memex research project will run three years with proposals due April 8.

Close [ x ] More from DefenseOne
 
 

Thank you for subscribing to newsletters from DefenseOne.com.
We think these reports might interest you:

  • Software-Defined Networking

    So many demands are being placed on federal information technology networks, which must handle vast amounts of data, accommodate voice and video, and cope with a multitude of highly connected devices while keeping government information secure from cyber threats. This issue brief discusses the state of SDN in the federal government and the path forward.

    Download
  • Military Readiness: Ensuring Readiness with Analytic Insight

    To determine military readiness, decision makers in defense organizations must develop an understanding of complex inter-relationships among readiness variables. For example, how will an anticipated change in a readiness input really impact readiness at the unit level and, equally important, how will it impact readiness outside of the unit? Learn how to form a more sophisticated and accurate understanding of readiness and make decisions in a timely and cost-effective manner.

    Download
  • Cyber Risk Report: Cybercrime Trends from 2016

    In our first half 2016 cyber trends report, SurfWatch Labs threat intelligence analysts noted one key theme – the interconnected nature of cybercrime – and the second half of the year saw organizations continuing to struggle with that reality. The number of potential cyber threats, the pool of already compromised information, and the ease of finding increasingly sophisticated cybercriminal tools continued to snowball throughout the year.

    Download
  • A New Security Architecture for Federal Networks

    Federal government networks are under constant attack, and the number of those attacks is increasing. This issue brief discusses today's threats and a new model for the future.

    Download
  • Information Operations: Retaking the High Ground

    Today's threats are fluent in rapidly evolving areas of the Internet, especially social media. Learn how military organizations can secure an advantage in this developing arena.

    Download

When you download a report, your information may be shared with the underwriters of that document.