Back to news

August 21, 2019 | International, C4ISR

4 big problems the intelligence community faces moving to a new data system

By: Nathan Strout

The Defense Intelligence Agency wants to move quickly in developing the Machine-assisted Analytic Rapid-repository System, but the massive project, which will transform how the intelligence community uses data, faces some hard problems.

The Defense Intelligence Agency is responsible for informing war fighters and policy makers on the military capabilities of foreign nations.

Currently, the agency relies on the Modernized Integrated Database to house foundational military intelligence, but the 20-year old database wasn't built for the 21st century data landscape. The DIA wants to replace MIDB with MARS, a comprehensive, adaptable, scalable and rigorous data environment. With more data that is better labeled and organized, MARS will allow analysts to use applications to sort and process that data to make connections they couldn't otherwise.

Last year, the DIA issued a broad agency announcement to solicit industry feedback from MARS. They've spent the year going over that information and are now preparing to actually build it.

“2019 was about learning,” said Terry Busch, chief of DIA's integrated analysis and methodologies division. “This was the year of prepping to get started. In 2020 we get started ... We're going to move from designing to building very very quickly."

Irving Townsend, also of the DIA, added that the agency was working to make some components of MARS available to the United States' closest allies in 2020 so leaders in those countries can begin looking at how they can use that data. In summer 2020, the MARS application programming interface will be released to the public, Busch said.

But even as the DIA gears up to begin building MARS, the agency has four big problems left to solve.

Resolving data inconsistency

Perhaps the most pressing problem with creating a unified resource such as MARS is ensuring that the data fed into the system has been labeled and handled in a uniform way. That's easier said than done. According to Busch, there are 1,300 different data standards in the Department of Defense.

“I work a lot with (the National Geospatial-Intelligence Agency) and DIA because we have a very similar path for our data,” said Busch. “The NGA has done some wonderful work with some of their data standardization and modeling (...) because NGA's been in the data making business for a long time.”

Making the data collected by the various agencies and services interoperable is essential for the MARS enterprise.

Data storage

The amount of data collected by the intelligence community that MARS needs to encompass is staggering. Hosting images and videos, like those collected by the National Reconnaissance Office, for instance, takes up a lot of space.

Because of this, MARS will not actually host all of the data itself. Instead, MARS will refer to intelligence hosted by other agencies. Instead, MARS needs to be able to index that intelligence. Theoretically, users will be able to click a link to access that data hosted on other servers.

The DIA will have to figure out how this solution for MARS to operate effectively.

The black box problem

In developing a massive dataset of intelligence, the DIA wants all intelligence to be explainable, meaning that analysts need to be able to see how the intelligence was arrived at. In other words, can analysts and systems show their work?

“It's really, really important to understand that we're not going to accept a black box,” said Townsend. “Our analysts are not going to accept that.”

This is a problem for intelligence agencies and contractors who don't want to reveal their methods or proprietary information. Townsend noted that companies are going to have to figure out how to explain their intelligence without giving away that information.

Legacy systems

Another problem with moving to MARS? Many legacy systems will not be able to move to the MARS framework.

While MARS will incorporate all of the MIDB data, some legacy systems will not be able to use the new system and will instead remain reliant on MIDB.

“The transition is difficult. Many of our war fighters are impinged by legacy technology,” said Busch. “There is not turning MIDB off. Not for the foreseeable future.”

Busch noted that while Congress may not like funding both programs simultaneously, it is necessary until those legacy systems can be replaced or upgraded.

The DIA will discuss these problems at a MARS industry day Sept. 10, where they are expected to explain what the agency wants from industry.

https://www.c4isrnet.com/intel-geoint/2019/08/19/4-big-problems-the-intelligence-community-faces-moving-to-a-new-data-system/

On the same subject

  • DARPA Wants to Find Botnets Before They Attack

    September 12, 2018 | International, C4ISR

    DARPA Wants to Find Botnets Before They Attack

    By Jack Corrigan The defense agency awarded a contract to develop a tool that scours the internet for dormant online armies. The military's research branch is investing in systems that automatically locate and dismantle botnets before hackers use them to cripple websites, companies or even entire countries. The Defense Advanced Research Projects Agency on Aug. 30 awarded a $1.2 million contract to cybersecurity firm Packet Forensics to develop novel ways to locate and identify these hidden online armies. The award comes as part of the agency's Harnessing Autonomy for Countering Cyber-adversary Systems program, a DARPA spokesperson told Nextgov. To build botnets, hackers infect internet-connected devices with malware that allows them to execute orders from a remote server. Because the virus sits dormant most of the time, the owners of infected devices rarely know their computer, smartphone or toaster has been compromised. Through the HACCS program, DARPA aims to build a system that can automatically pinpoint botnet-infected devices and disable their malware without their owners ever knowing. Launched in 2017, the program is investing in three main technologies: systems that uncover and fingerprint botnets across the internet, tools that upload software to infected devices through known security gaps, and software that disables botnet malware once it's uploaded. Packet Forensics' technology falls under that first category, the DARPA spokesperson said. Eventually DARPA plans to integrate each of those technologies into a single system that can spot, raid and neutralize botnet-infected devices without any human involvement. Because the tool would only target botnet malware, people could continue using the devices just as they had before, the agency said in the program announcement. During phase one of the three-part project, Packet Forensics will build a technology capable of scanning some five percent of global IP addresses and detecting botnets with 80 percent accuracy. By the end of the program, DARPA anticipates the system to analyze 80 percent of the global internet and correctly spot botnets 95 percent of the time. The effort is scheduled to last to four years, with the first phase running 16 months. Later phases include additional funding. https://www.nextgov.com/cybersecurity/2018/09/darpa-wants-find-botnets-they-attack/151182/

  • Boeing gets $2.56 billion contract from US Air Force for E-7A Wedgetail aircraft

    August 10, 2024 | International, Aerospace

    Boeing gets $2.56 billion contract from US Air Force for E-7A Wedgetail aircraft

    Aug 9 (Reuters) - Boeing (BA.N), opens new tab said on Friday it had been awarded a $2.56 billion contract from the United States Air Force for two rapid prototype E-7A AEW&C Wedgetail aircraft. The contract includes lifecycle development, training and support for the U.S. E-7A fleet, the company said in a statement. https://www.reuters.com/business/aerospace-defense/boeing-gets-256-billion-contract-us-air-force-e-7a-wedgetail-aircraft-2024-08-09/

  • Lockheed Martin ralentit la production du F-35

    May 22, 2020 | International, Aerospace

    Lockheed Martin ralentit la production du F-35

    OLIVIER GOSSET 20 mai 2020 10:48 Le constructeur américain a annoncé un ralentissement temporaire de la production de son avion de combat en raison des retards dans la fourniture de pièces par les sous-traitants. Les calendriers de livraison seront adaptés. Lockheed Martin a annoncé mercredi un ralentissement temporaire de la production de son avion de combat F-35, en raison des retards dans la fourniture de pièces par les sous-traitants à cause de la pandémie de coronavirus. Le géant américain de la défense et le syndicat des machinistes IAM (International Association of Machinists and Aerospace Workers) ont convenu d'un horaire de travail temporaire adapté pour les employés de la chaîne de production de F-35 à l'usine de Fort Worth. Le nouvel horaire, qui débutera le 23 mai, divise chaque équipe en trois groupes. Par rotation, chaque groupe travaillera pendant deux semaines et bénéficiera ensuite d'une semaine de congé. "Cet horaire alternatif permet à Lockheed Martin de doter la chaîne de production en personnel afin de répondre à un flux de travail plus lent suite aux retards des fournisseurs. En outre, il permet d'avoir un rythme de travail qui conserve l'expertise de la main-d'œuvre qualifiée et offre la possibilité d'ajuster le travail pour mieux soutenir la production", a indiqué le constructeur. Quid pour la Belgique? Les calendriers de livraison aux États-Unis et aux forces armées alliées achetant le F-35 "seront ajustés en conséquence", mais Lockheed prévoit un retour aux niveaux de production d'avant la crise du Covid-19 "d'ici la fin de l'été ou le début de l'automne", a commenté à l'agence Bloomberg Gregory Ulmer, directeur du programme F-35. Lockheed s'était engagé à livrer 141 F-35 aux États-Unis et à ses alliés d'ici la fin de l'année, contre 134 l'an dernier. Entre 18 et 24 avions pourraient ne pas être assemblés par rapport à cet objectif, selon Gregory Ulmer. Le constructeur n'a pas précisé quels pays pourraient être concernés par ce ralentissement temporaire de la production. La Belgique a commandé 34 appareils au groupe aéronautique américain. Selon le calendrier prévu, les huit premiers seront livrés en 2023 et 2024, mais resteront aux États-Unis pour servir à la formation des pilotes et des techniciens. Les quatre suivants sont attendus à Florennes l'année suivante. Trump sème le trouble La semaine dernière, le Président américain Donald Trump a semé le trouble parmi les partenaires du programme F-35 et les clients de Lockheed Martin en menaçant de rapatrier sur le territoire des USA les éléments fabriqués à l'étranger. Donald Trump a en effet estimé que la chaîne d'approvisionnement internationale de l'avion de Lockheed Martin posait problème en cas d'arrêt éventuel de la production dans des pays étrangers. https://www.lecho.be/entreprises/defense-aeronautique/lockheed-martin-ralentit-la-production-du-f-35/10228284.html

All news