NASA's PhoneSat, a cubesat that was recently launched at the Wallops Flight Facility in Virginia

NASA's PhoneSat, a cubesat that was recently launched at the Wallops Flight Facility in Virginia Dominic Hart/AP

Meet Silicon Valley’s New Spy Satellites

The Pentagon is using new technology that provides real-time, better-than-Google imagery of the earth. By Robinson Meyer

Imagine an energy company which manages a pipeline through Canada’s taiga. The company’s charged with maintaining that pipeline, with making sure it isn’t leaking and hasn’t been compromised. So, every day, the company pays a local to get in a plane and fly over the otherwise inert, massive metal tube, looking for objects, organic or otherwise, that shouldn’t be there.

Or that’s what they’ve done for many years. Five years from now, that pilot might be out of a job. Tiny satellites, whizzing over head in low Earth orbit, could photograph every meter of the pipeline. It won’t seem like anyone’s nearby, but, should a truck or stain appear on the ice, a system administrator in Houston would get a text message warning of a problem.

Humans began photographing their home planet from space in a scientifically useful way about a half-century ago. Now the images are ubiquitous: On a web search, in a phone app, on the news, we see the browns and blues that denote pictures taken from the sky. They have rollicked around the culture, spawning both the techno-hippie Whole Earth Catalog and the $3 billion military contractor Digital Globe.

The first picture of Earth taken from space, above, was photographed by a V-2 missile 65 miles in the air on October 24, 1946. Below, a recent image of farms taken by one of Planet Labs’s doves in Washington.

The first picture of Earth taken from space, above, was photographed by a V-2 missile 65 miles in the air on October 24, 1946. Below, a recent image of farms taken by one of Planet Labs’s doves in Washington.

“Google Earth whetted consumers’s appetites for pictures of Earth from space,” Scott Larsen told me. But the pictures in our browsers, he said, have now become old and out of date.

“[Imagery from] five years ago is great, but how about from last year, last month, last week, yesterday?’”

Larsen leads Urthecast. It’s one of a cadre of startups—three are now out of stealth mode—tossing cameras out of the atmosphere and trying to turn them into a business. Each of the three is choosing different methods, different kinds of devices, and different orbits. Each is selling something a little different. They are Urthecast, Planet Labs, and Skybox.

Urthecast, for instance, plans to install two cameras—one still and one video—on the International Space Station, then beam video down using the Russian Space Agency’s antennae. Planet Labs, another, hopes to send 28 satellites, each about the size of a garden gnome, into low orbit. It will immediately control the largest private Earth-observing fleet of satellites ever created. SkyBox, finally, only hopes to operate two satellites in the next year—but its business plan seems most promising, and borrows the most from the modern startup playbook.

The capital and efficiency engines of Silicon Valley, having transformed markets and interactions both public and private on Earth, now look skyward.

Silicon Valley is making what, in any other decade, we’d call spy satellites.

(Related: America Needs to Lead Globally on GEOINT)

Orbiting Cameras, Operated by Behemoths

Four government entities and two companies contributed imagery to this Google Maps image. (Google)

Like the geography they depict, it can be easy to feel like the pictures in Google Earth have always been there, like they don’t have a history or a source.

In fact, a set of accreted structures dictate what and how satellite imagery reaches American consumers. Some of these limits are governmental: The U.S. government restricts the resolution of imagery that can be sold to the public, for example. Today, if the side of one pixel of Earth imagery is more than 50 centimeters long, it can’t be sold in America. (Though regulators may soon loosen those limits.)

The marketplace limits buyers still further, though. If you go looking for medium-resolution imagery, you’ll find it a hard task. If you want a picture of your house—or your pipeline—who do you buy it from?

You have a few options. You might download it for free from weather satellites, like those in NASA’s MODIS program. MODIS imagery is quite low-quality, though: It will give you good (sometimes beautiful) photos of the clouds over your home state.

MODIS imagery of the northeast United States after last week’s snowstorm (NASA)

Other options are prohibitively expensive. The pan-European consortium that owns the airplane-manufacturer Airbus also operates a satellite company called Astrium, which sells imagery commercially. The German company Blackbridge and the Israeli ImageSat do the same. A few governments—Taiwan, India, South Korea—will sell imagery from their spy satellites to you.

There’s also data from some other U.S. government-run projects, like the long-running Landsat program. That imagery’s free, and sometimes recent—but it’s not very high-resolution. Really, there’s only one American company that will sell you imagery in the medium- to high-range: Digital Globe.

Digital Globe is a public corporation, worth about $3 billion and based in Colorado. Most of its business flows from the Department of Defense: Last fiscal year, a full 60 percent of its revenue came from just one contract with the National Geointelligence Agency. It also supplies a substantial amount of imagery to Google Earth.

Digital Globe specializes, in other words, not just in big institutional buyers, but in the biggest of the big. It makes sense: In the modern Earth observing business, most of the players are enormous. Even in the list I just gave, most of the institutions either maintain a standing army or manufacture warplanes.

(Related: Why the Military Needs Commercial Satellite Technology)

Like a Floating Geyser of Free Money

The wrecked Italian cruise vessel Costa Concordia, as captured by Digital Globe’s WorldView-2 satellite

The wrecked Italian cruise vessel Costa Concordia, as captured by Digital Globe’s WorldView-2 satellite

And it makes economic sense, too, for these satellites operators to be behemoth. Not only is operating a satellite expensive, but sending it to space is maybe moreso. You can’t buy rocket fuel from a gas station.

Let’s say you want to compete with one of these leviathans. You have a few options to make it cheaper. Here’s one: Find a satellite that one of those huge institutions regularly services. Strap your cameras on to it. Get one of those institutions to pay for it all.

Replace “satellite” with “International Space Station,” and you have Urthecast.

The Russian section of the International Space Station (NASA)

Of all the satellite startups, Urthecast’s business is probably the easiest to understand. Soon after the publication of this article, perhaps in a matter of days, astronauts will venture outside the International Space Station (ISS). They will bolt two cameras, each about the size of a two-liter soda bottle, on to the Russian part of the structure. They’ll connect some wires, presumably, push some buttons, and then the two devices will start sending both still and moving imagery below, to the same planet that they watch.

It’s a lovely idea. It is also ludicrously inexpensive.

Four years ago, Scott Larsen, now Urthecast’s CEO, was working at Merchant Bank in Vancouver, when—after a series of introductions—an inquiry from the Russian space agency (the RKA) “came across [his] desk.”

“They were interested in seeing what was possible,” he said, in putting a camera or two on the ISS. They encouraged him to run a feasibility study for half a million dollars, then stopped corresponding. That was, until:

“In the fall of 2010, they called up and said, hey: If you wanna do it, we wanna do it,” said Larsen.

What was that “it”? An incredible deal. If Urthecast paid to build 2 cameras, the RKA would handle not only getting the devices to space but also the cost of their installation and their downlink. Downlinking data from satellites is incredibly costly, often a major limiting expense for Earth-observation companies. For Urthecast, it would be free.

Or nearly free: Once installed, the RKA would keep all the imagery Urthecast’s cameras capture of Russia. Urthecast can sell the imagery of anywhere else on Earth.

The Soyuz rocket bearing Urthecast’s cameras launching on November 25 (Urthecast)

Urthecast, in other words, has a monopoly of sorts, on high-quality pictures and video from the ISS. The Russian space agency has created a giant geyser of free money, in low-Earth orbit, for the benefit of a private company.

Urthecast incorporated in Canada on Christmas 2010. It went public before it put anything in space, in June of this year, raising about $9.3 million U.S. dollars. It’s now a publicly-traded company worth about $120 million.

The ISS is an unusual satellite to strap a camera to—it flies an orbit lower and more elliptical than other Earth observing satellites.

“I tend to think we’ll get pictures no one’s ever seen before,” said Larsen. Once that imagery is online, he told me, “everyone will come to the website at least once.”

Because of that—and because of the company’s virtual monopoly—Larsen said the company anticipated all manner of monetization strategies: ads on the website, broadcast deals, and a full range of content partnerships

“We are a media company,” he said, “there’s no doubt about it. We’ve done something no one’s done before.”

If they do do it. At the end of December, cosmonauts attempted to install Urthecast’s cameras onto the ISS. It didn’t work—the cameras failed to relay signal to the ground. Now the devices are back inside the station, being examined for problems.

If they get the cameras working, Urthecast will find buyers. TV news agencies, entertainment companies, app developers are in talks with Urthecast: According to Larsen, the company’s already signed an agreement with the United Nations.

A Flock of Doves

Planet Labs already has two nanosatellites in orbit—one captured this image of forests near Gales Creek, Oregon in April. (Planet Labs)

Befriending the RKA and bolting something to the world’s most famous space-laboratory is one path to profitability. Planet Labs, based in San Fransisco, is trying another. In January, it hopes to send 28 micro-satellites in space—the largest constellation of private Earth-observing satellites, ever. (The incredibly awesome collective noun for a group of satellites is a constellation .)

Planet Labs can send that many into space because the satellites are designed for extensibility. 10 by 10 by 30 centimenters, Planet Labs’s “doves” are derived from Cubesat technology—the set of tools and standards developed at Stanford in the early 2000s that let universities affordably fly small, low-orbit satellites.

More than 100 have been put in orbit since the idea’s inception. When high schoolers in Virginia built a satellite and launched it, as happened last month,they did it with Cubesats.

One of Planet Labs's doves rests, above. Another, below, deploys its solar panels. (Planet Labs)

One of Planet Labs's doves rests, above. Another, below, deploys its solar panels. (Planet Labs)

So Planet Labs’s doves are cheap. They’re so cheap, in fact, that Planet Labs can anticipate some portion of them never working.

“People say, if you never miss a flight, you’re spending too much time in the airport,” the company’s CEO, William Marshall, told me. “Well, if you never lose a satellite, you’re not pushing the envelope.”

Businesses in space have historically erred very conservative, and for good reason. Every machine, every orbiting device, cost hundreds of millions of dollars; every major technology investment was a bet-the-company adventure.

Marshall told me that 20 percent of the doves can fail in orbit—can never work at all—without the company losing a meaningful amount of imaging capacity. There’s a theory of programming— worse is better —that holds that cheap, simple software can be faster and easier to use than the expensive, complicated fare. Planet Labs applies this to space.

Planet Labs’s complete constellation—“flock”—of 28 doves (Planet Labs)

It’s an application with huge potential benefits. With its horde of doves, Planet Labs can image the entire planet much more frequently than is now possible. It can refresh its satellites much more frequently: It can almost always just throw more satellites up there, to the point of diminishing returns.

It also has downsides. The imagery Planet Labs’s doves capture will never be great—current imagery technology and the size of Cubesats doesn’t create pictures below a resolution of one meter. Urthecast’s video camera will be better.

But Planet Labs might be able to succeed on other fronts: Marshall has broad, humanitarian ambitions for his company’s data. He said that, often, subsistence farmers in the developing world could use imagery of their farms, but currently can’t afford it. The usual non-military buyers for Earth imagery are banks and large financial firms.

Farmland and a national highway in western Poland (Planet Labs)

Marshall thinks Planet Labs can sell to both financial firms and farmers because the two have different needs, because they need different kinds of imagery at different times. As imagery ages, he said, its price might decrease.

He also that Planet Labs might also be able to lend its imagery to humanitarian causes, such as the crowdsourced mapping that helped victims of Typhoon Haiyan.

But is that a viable business? Maybe.

Pixels or Intel?

There are two ways to sell satellite imagery. The first is to sell the pictures themselves: The actual pixels that depict oceans, mountains, and cities. When a satellite company sells its imagery to Google Earth, this is what it’s doing.

“Here is money.” “Thanks! Here are pixels.” (Or, that’s how the transaction occurs in theory.)

Shizuoka Prefecture in Japan, as photographed by the second of Planet Labs’s doves. Note Shizuoka stadium in the lower left, in the city of Kakegawa. (Planet Labs)

But there’s another way to make money off satellite imagery. A company could take pictures and analyze them for certain objects or trends, then sell the information it gathers.

For instance (and this is something of a canonical example in imagery analytics): With good-enough satellite imagery, you could photograph every Wal-Mart parking lot in America on Black Friday, then analyze the images in total to detect the number of cars. Take that car-count, guess at the typical income bracket associated with each lot, throw in some other variables and voila: You have a good sense of how much money the retail behemoth made on one of the most important shopping days of the year.

There are other applications. Over the course of season, a keen firm could take a picture of every cornfield in the midwest and estimate how much corn the U.S. produces in total, then trade futures against that knowledge.

It’s a great business, this selling intelligence on the global supply chain to the people betting about it. It’s also, for now, a somewhat theoretical one. Interpreting images with algorithms, especially at the specificity needed, remains incredibly difficult. Facebook bought a facial recognition company earlier this year for an undisclosed price in part so it could apply its algorithms to recognizing all sorts of photos that look nothing like faces. That’s how treasured the algorithmic-image detection technology is.

(Think: With really good algorithms, your spambots could defeat any image-based CAPTCHA.)

The first of Skybox’s satellites captures Perth, Australia—and parking lots full of cars!—in early December. (Skybox Imaging)

The first of Skybox’s satellites captures Perth, Australia—and parking lots full of cars!—in early December. (Skybox Imaging)

And without algorithms to read imagery, the costs of image interpretation stay stubbornly high. Meanwhile, other applications—the kind requiring looking simultaneously at millions of pixels—remain impossible. So if you want to analyze images at any scale, you might be able to do it with an army of interpreters. Might.

When I asked Marshall about whether Planet Labs would sell pixels or intel, he demurred.

“We’re certainly entertaining both,” he said—maybe selling “raw imagery, and analytics on top of it.” He called the company in “the early stage of defining our products.”

Perhaps it will. But maybe the dichotomy is a red herring. You don’t need to actually analyze images successfully in order to build a business around the possibility of doing it.

Cloud Computing, Except for Literal Clouds

The coastline of Somalia, as captured by Skybox’s first satellite (Skybox)

Enter Skybox. Based in Mountain View, California, it put its first satellite in space in November. But when I talked to Dan Berkenstock, one of its co-founders, he didn’t mention satellites at first.

“There’s never been a good sandbox in this industry,” Berkenstock told me, referring to imagery analytics.

What did he mean? Something like this: In the past half decade, companies have sprung up around Amazon’s hosted cloud services. Amazon operates massive web servers, tools so adaptable you can build a company around them without having to actually pay to operate a data center. Amazon lets its customers pay for what they need, or can use, and no more.

It’s a successful business, and a lucrative one: In 2012, Amazon Web Services made $2.1 billion.

Skybox wants to make something like Amazon’s cloud products, but for the Earth. To do that, Berkenstock told me, it has combined historic data from US government satellites, aerial photography, and weather centers. It’s created a recent history of the Earth in data. It will then augment that record with data and imagery from its own satellites.

Infrared imagery, from SkySat-1, of a gold mine in Western Turkey. Infrared imagery helps experts deduce the health of plants—what “should” be green in the image above appears red. (Skybox)

Eventually, companies will be able to run their own algorithms in the massive Skybox database (which I’ll resist calling Skynet). They can build applications and programs within and with it, using its historic records. They can, crucially, test their image-detecting algorithms within a massive sandbox.

“Combining weather data with satellite imagery with other things,” Berkenstock told me. “That’s really the future of our industry.”

Perhaps it is. Regardless, it’s savvy. “Earth-data-as-service” lets Skybox sell the potential of analytics without actually… having to do a lot of analytics.

It also lets them slowly build up a fleet. Skybox has constructed its satellites—each about the size of a dorm room fridge—out of parts you’d find in a hardware store. It uses cheap and available supplies, in other words, rather than costly space-tested materials preferred by military contractors. It runs its mission control in a Google Chrome app that uses the web development kit Bootstrap.

Skybox’s first satellite, SkySat-1 is already functioning and in the air. It’s sending down pictures— and video —now.

Skybox seems, to me, to most apply the lessons of the past decade of web technologies to space. But it also operates the most expensive satellites.

Pictures Aren’t Knowledge

The marketplace coming into view already bends across many variables. Urthecast seems safe: As long as its technology works, people will always want pictures from the ISS. The company is camped securely, empty water bottles i hand, next to its floating free-money geyser.

Planet Labs seems unsure of its business strategy, at least in public, but its satellites are so inexpensive that it can always chuck more at its problems. And SkyBox walks a middle path, armed with a brilliant business idea and a couple satellites neither costly nor cheap.

Whatever happens, these three companies are likely to create a market beneath the current leviathans and not supplant them.

“There will always be a market for Digital Globe,” Larsen told me. “There are still gonna be people who want that.”

But for many customers, he said, “good enough is good enough. It doesn’t need to be calibrated to 45 cm. It doesn’t need to be as accurate as what they’re getting.”

Who will buy this new, good enough imagery? Why would they buy it? When I talked to Skybox’s founder, Dan Berkenstock, he said many companies wanted satellite imagery to answer one question:

“‘Is my stuff okay?’ That’s the central question satellite companies can answer. All these things around the world that are supposed to be happening or not supposed to be happening that affect me—are they?”

So perhaps many people will buy the picture or intel, and all three of these companies will flourish. Or perhaps one will absorb the others, or a popping technology bubble cut off funding to all three. Business plans don’t anticipate history—but sometimes they gesture at it. Very soon, it’s likely that it will be substantially easier to buy recent, high-resolution imagery of the Earth’s surface. Large companies will have access to the same global quasi-omniscience as the world’s powerful governments. If successful, these startups will consolidate power.

Nanosatellites, like those used by Planet Labs, over the Earth (NASA)

Cheap satellites will also grant humanity pictures of the world it has made and is making—a world wracked by people. Every satellite CEO I talked to mentioned being able to track melting glaciers, changing rivers, or dying forests. Satellite technology has proven useful in humanitarian crises; some research indicates it can detect a genocide in progress.

How do we—as citizens, as consumers, as possible customers—handle that, the tension between the power of new knowledge and the power of consolidated knowledge? Over the next few years, we, and our governments, will find out.

At the end of our call, Larsen spoke to me about Urthecast’s aim.

“When you talk to astronauts, they all say going to space changes them,” he said. This was especially true of repeat astronauts—“people who go up twice—go up once, then go back 4 to 5 years later, and see how things have changed.”

They all spoke, he said, of wonder.

“When people are continually reminded how small Earth is, how we’re all living together, people come back with a sense of planet stewardship.”

Planet stewardship: a beautiful idea, something the future hungers for, and something these startups may or may not provide.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.