Pro-Russian activists leaving the office of the regional prosecutor in Donetsk, Ukraine

Pro-Russian activists leaving the office of the regional prosecutor in Donetsk, Ukraine Efrem Lukatsky/AP

How the Internet Could Have Predicted the Invasion of Ukraine

Software programs and publicly available satellite imagery can help you monitor the crisis in Ukraine like a government spy. By Patrick Tucker

In the buildup to the annexation of Crimea, Russian forces surprised many in Washington by maintaining strict radio silence. The United States was caught off guard in its inability to intercept Russian military communications, suggesting a failure of official intelligence, but also a new opportunity for public intelligence.

Using data, images and capabilities openly available on the Internet, the public could have stayed ahead of policymakers and better foreseen the current tensions before massive troop buildup on the Ukraine border.

Here’s how:

STEP 1: Have a Machine Read a Lot of News

Getting news from the around the world is key to understanding the global security environment. Knowing this, Franklin Roosevelt in 1941 established an office called the Foreign Broadcast Information Service, or FBIS, to be run out of the CIA. The office’s mandate was simple: translate the news from around the world for U.S. policymakers.

Today, the idea of paying CIA employees to sit around and pore over publicly available foreign newspapers and radio broadcasts seems quaint in an age when millions of news and opinion feeds are constantly competing for attention in a 24-hour, global news cycle.

The challenge has evolved from finding and translating news data to figuring out which potential news sources might be useful for telegraphing the next steps in evolving geopolitical events like the Russian standoff with Ukraine.

Georgetown University data scientist Kalev Leetaru has developed a tool to do just that. The Global Database of Events, Language, and Tone, or GDELT, does to the entire Internet what the FBIS used to do for a small handful of foreign news sources.

GDELT is a free service that’s geared toward non-technical users. It crawls news reports from around the world and, through learning algorithms, analyzes the tone in those news items. “Today anyone can click a few buttons and get a map back of what's happening around the world, updated to the latest 24 hours,” Leetaru told Defense One.

Leetaru’s methodology has proven remarkably prescient. In 2011, he used a database of millions of publicly available records, robotically analyzed for tone along 1,500 dimensions, to accurately pinpoint the location of Osama bin Laden within a 200-kilometer radius of where bin Laden was eventually found in Pakistan. His work has proven most effective in predicting events of social or civil uprising such as the Arab Spring.

“In the case of the Russian invasion of Ukraine, GDELT showed deep unrest in Crimea even before President Yanukovych fled the country, illustrating that it was deeply enmeshed in the protests and unrest in Kiev and elsewhere,” Leetaru said. “Unknown armed men started showing up in Crimea around Feb. 28 ... By the 7th there were already rallies.” All of these events are documented in a handful of news articles that appeared at the time, available through the GDELT database, but the coverage received little attention outside the area.

Leetaru is careful to point out that newspaper data is not perfectly predictive. What it provides is “a good geographic overview of what's happening [to] demonstrate scope and breadth of the unrest.” Used in conjunction with other services, it can offer important clues to what may happen next.

A company called Recorded Future offers a similar service. Founded in 2010 with money from Google, private venture capital firms and In-Q-Tel, the funding arm of the CIA, it’s a web intelligence platform that scans the Internet for articles about specific events and then robotically analyzes the articles on the basis of what they say about a given situation and the future.

They claim that they can provide analysis to forecast civil unrest on the city level with up to 85 percent accuracy one week out prior to events. At a lower level of certainly, they say can forecast future violence down to the city block. As more civil unrest occurs, the patterns around civil unrest become more obvious, Recorded Future founder Chris Ahlberg told Defense One. “Events that are repetitive in nature are easier to predict,” he said.

That means that as the situation in Ukraine carries on, propelled most recently by the takeover of government buildings by pro-Russian groups in the eastern towns of Sloviansk and Druzhkovka, and more people start creating more data around what they’re seeing through news articles and social media posts, clarity will improve.

Ahlberg believes that Moscow was doing its own predictive analysis years ago, analysis that helped shape the situation as it stands today. “Putin knew that Ukraine was getting unstable five years ago,” Ahlberg said. “He knew he couldn’t lose Crimea so he was gearing up his military.” Ahlberg is closely watching the situation playing out in the Moldovan region of Transnistria, an area that has received some significant media attention lately but that Recorded Future first began covering on March 19. “We were seeing separatist language coming out of Transnistria that was the same as what was coming out of Crimea,” he said.

Once you know the areas of interest, the next step is to get a visual understanding of facts on the ground.

STEP 2. Search for Stealth Indicators in High-Resolution Satellite Imagery

NATO released several high-resolution photos last week claiming that the Ukrainian border is now hosting “35,000 to 40,000 [Russian] troops… equipped with infantry fighting vehicles, tanks, combat aircraft, logistics, and artillery.” The Russian government says the photos were taken during an August 2013 military exercise and insist they have no plans to invade Ukraine.

Visual signs of an impending action can show up long before soldiers start massing in formation. DigitalGlobe, the company that provided NATO with the satellite imagery from Ukraine, sells high-resolution satellite pictures directly to the public (though at a lower resolution than it sells to the U.S. government, because of currently existing law). That means that the average citizen can know almost as much about the facts on the ground as anyone in the government.

DigitalGlobe has five high-resolution earth monitoring satellites and will launch its sixth in August. The WorldView 3 can take photos of an area as small as 30 centimeters from 380 miles up as it moves around the globe from pole to pole at 7 miles per second.

“For the image analyst following events in Crimea, there are many things they would look for in the imagery beyond the massing of troops and equipment,” said Kurt Schwoppe of ESRI, a firm that provides geographic information services to the government and the private sector.

Schwoppe outlined several features, beyond troops and military equipment, that might indicate an invasion:

  • Road blocks and other barriers to mobility.
  • Fencing and sentry posts erected around key buildings, communications facilities, etc.
  • Unusual aircraft activity, especially helicopters parked near facilities other than airports.
  • Changes in basic traffic patterns. “Are there a lot less cars on the road or people in the street markets?” Schwoppe said.
  • Unusual activities around key infrastructure locations like water and power facilities, transmission lines, etc.
  • Seemingly abandoned workplaces with no smoke rising from factory smokestacks, barren parking lots, working docs and rail yards.
  • Air defense capabilities. “This is what tipped the Americans off during the Cuban missile crisis,” Schwoppe said. “Even today, though the Iranians put all their uranium enrichment sites underground, they surrounded them with air defense capabilities, radars and missile launchers.”

Public use of high-resolution satellite imagery to predict geopolitical events is not unprecedented. Between January and April of 2011, Harvard University’s Satellite Sentinel Project used publicly available satellite data to predict that the Sudanese Armed Forces (SAF) would be busting into the area of Abyei, located on the border of North and South Sudan, within the coming months.

The tip-off in that case wasn’t the movement of troops or tanks, but the construction of wide and less floodable roads to transport heavy oil extraction equipment. There was no oil near where the SAF was operating. “These roads indicated the intent to deploy armored units and other heavy vehicles south towards Abyei during the rainy season,” Satellite Sentinel Project researchers said in their report.

They conducted their analysis between January and April of 2011. The invasion took place on May 19.

You don’t have to be a Harvard researcher to use satellite data to forecast invasions. What you do need is patience.

“To be effective, you need a baseline for normal,” Schwoppe said. “Typically most imagery intel groups build up expertise, awareness of their areas of interest over time. Some guys work the same area for years. They actually build up ‘shoeboxes’ of images taken over many years that cover key sites. That way when a change occurs, it stands out like a sore thumb. Sometimes the changes are obvious, but often they must link the change to other sources. It becomes a game of connect the dots (or images) to really figure out what is going on.”

It’s an expensive game to play. DigitalGlobe has the largest archive of satellite imagery in the world, 4 .5 billion kilometers of the earth’s surface, which is 30 times the land mass of the earth. Archived imagery is important to establish a baseline, but newer images are key to understanding how a situation is developing -- and they’re pricey.

For instance, let’s say you wanted the most recent high-resolution satellite imagery for 400 kilometers around the areas of Kharkiv, Luhansk and Donetsk, places in Ukraine where pro-Russian groups recently seized government buildings. The price on average from DigitalGlobe for those areas would be $5,200 (and can be higher). The Satellite Imaging Corporation has a minimum order size of 100 square kilometers for a price of $4,000.  To get those numbers down, you need a better sense of where to look. That’s where services like the GDELT database and Recorded Future prove their value.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.