DARPA Wants to Help You Search the Web Better

GIl C via Shutterstock

AA Font size + Print

DARPA has kicked off a project to fine tune web searches by topical domain rather than subject. By Bob Brewin

The Defense Advanced Research Projects Agency has kicked off a project to fine tune Web searches by topical domain rather than general subjects, allowing it to “maintain technological superiority in the area of content indexing and Web search on the Internet.”

DARPA plans to use the system initially to counter human trafficking, which is enabled by websites, forums and chat rooms.

DARPA said its “Memex” (a combination of the words memory and index) project will, among other things, search “deep Web” content missed by commercial search engines and “will address the inherent shortcomings of centralized search by developing technology for domain-specific indexing of Web content and domain-specific search capabilities.”

Memex will develop technology to enable discovery, organization, and presentation of domain-relevant content. DARPA envisions the new system providing fast, flexible and efficient access to domain-specific content as well as search interfaces that offer valuable insight into a domain that previously remained unexplored.

DARPA wants researchers to develop advanced and highly automated Web-crawler software to penetrate sites and resources that have erected crawler defenses to aid domain-specific indexing and a domain specific search engine.

The research agency said the Memex system can help  counter human trafficking, which, “especially for the commercial sex trade, is a line of business with significant Web presence to attract customers and is relevant to many types of military, law enforcement, and intelligence investigations.”

Human trafficking forums, chats, advertisements, job postings and hidden services “continue to enable a growing industry of modern slavery,” DARPA said. “An index curated for the counter trafficking domain, including labor and sex trafficking, along with configurable interfaces for search and analysis will enable a new opportunity for military, law enforcement, legal, and intelligence actions to be taken against trafficking enterprises.”

The Memex project takes its name and inspiration from a 1945 article in The Atlantic titled As We May Think, in which Dr. Vannevar Bush, head of the White House Office of Scientific Research and Development, envisioned an analog computer to supplement human memory, the Memex, which would store and automatically cross-reference all of the user’s books, records and other information.

DARPA expects the Memex research project will run three years with proposals due April 8.

Close [ x ] More from DefenseOne
 
 

Thank you for subscribing to newsletters from DefenseOne.com.
We think these reports might interest you:

  • Ongoing Efforts in Veterans Health Care Modernization

    This report discusses the current state of veterans health care

    Download
  • Modernizing IT for Mission Success

    Surveying Federal and Defense Leaders on Priorities and Challenges at the Tactical Edge

    Download
  • Top 5 Findings: Security of Internet of Things To Be Mission-Critical

    As federal agencies increasingly leverage these capabilities, government security stakeholders now must manage and secure a growing number of devices, including those being used remotely at the “edge” of networks in a variety of locations. With such security concerns in mind, Government Business Council undertook an indepth research study of federal government leaders in January 2017. Here are five of the key takeaways below which, taken together, paint a portrait of a government that is increasingly cognizant and concerned for the future security of IoT.

    Download
  • Coordinating Incident Response on Posts, Camps and Stations

    Effective incident response on posts, camps, and stations is an increasingly complex challenge. An effective response calls for seamless conversations between multiple stakeholders on the base and beyond its borders with civilian law enforcement and emergency services personnel. This whitepaper discusses what a modern dispatch solution looks like -- one that brings together diverse channels and media, simplifies the dispatch environment and addresses technical integration challenges to ensure next generation safety and response on Department of Defense posts, camps and stations.

    Download
  • Forecasting Cloud's Future

    Conversations with Federal, State, and Local Technology Leaders on Cloud-Driven Digital Transformation

    Download

When you download a report, your information may be shared with the underwriters of that document.