21 août 2019 | International, C4ISR

4 big problems the intelligence community faces moving to a new data system

By: Nathan Strout

The Defense Intelligence Agency wants to move quickly in developing the Machine-assisted Analytic Rapid-repository System, but the massive project, which will transform how the intelligence community uses data, faces some hard problems.

The Defense Intelligence Agency is responsible for informing war fighters and policy makers on the military capabilities of foreign nations.

Currently, the agency relies on the Modernized Integrated Database to house foundational military intelligence, but the 20-year old database wasn't built for the 21st century data landscape. The DIA wants to replace MIDB with MARS, a comprehensive, adaptable, scalable and rigorous data environment. With more data that is better labeled and organized, MARS will allow analysts to use applications to sort and process that data to make connections they couldn't otherwise.

Last year, the DIA issued a broad agency announcement to solicit industry feedback from MARS. They've spent the year going over that information and are now preparing to actually build it.

“2019 was about learning,” said Terry Busch, chief of DIA's integrated analysis and methodologies division. “This was the year of prepping to get started. In 2020 we get started ... We're going to move from designing to building very very quickly."

Irving Townsend, also of the DIA, added that the agency was working to make some components of MARS available to the United States' closest allies in 2020 so leaders in those countries can begin looking at how they can use that data. In summer 2020, the MARS application programming interface will be released to the public, Busch said.

But even as the DIA gears up to begin building MARS, the agency has four big problems left to solve.

Resolving data inconsistency

Perhaps the most pressing problem with creating a unified resource such as MARS is ensuring that the data fed into the system has been labeled and handled in a uniform way. That's easier said than done. According to Busch, there are 1,300 different data standards in the Department of Defense.

“I work a lot with (the National Geospatial-Intelligence Agency) and DIA because we have a very similar path for our data,” said Busch. “The NGA has done some wonderful work with some of their data standardization and modeling (...) because NGA's been in the data making business for a long time.”

Making the data collected by the various agencies and services interoperable is essential for the MARS enterprise.

Data storage

The amount of data collected by the intelligence community that MARS needs to encompass is staggering. Hosting images and videos, like those collected by the National Reconnaissance Office, for instance, takes up a lot of space.

Because of this, MARS will not actually host all of the data itself. Instead, MARS will refer to intelligence hosted by other agencies. Instead, MARS needs to be able to index that intelligence. Theoretically, users will be able to click a link to access that data hosted on other servers.

The DIA will have to figure out how this solution for MARS to operate effectively.

The black box problem

In developing a massive dataset of intelligence, the DIA wants all intelligence to be explainable, meaning that analysts need to be able to see how the intelligence was arrived at. In other words, can analysts and systems show their work?

“It's really, really important to understand that we're not going to accept a black box,” said Townsend. “Our analysts are not going to accept that.”

This is a problem for intelligence agencies and contractors who don't want to reveal their methods or proprietary information. Townsend noted that companies are going to have to figure out how to explain their intelligence without giving away that information.

Legacy systems

Another problem with moving to MARS? Many legacy systems will not be able to move to the MARS framework.

While MARS will incorporate all of the MIDB data, some legacy systems will not be able to use the new system and will instead remain reliant on MIDB.

“The transition is difficult. Many of our war fighters are impinged by legacy technology,” said Busch. “There is not turning MIDB off. Not for the foreseeable future.”

Busch noted that while Congress may not like funding both programs simultaneously, it is necessary until those legacy systems can be replaced or upgraded.

The DIA will discuss these problems at a MARS industry day Sept. 10, where they are expected to explain what the agency wants from industry.

https://www.c4isrnet.com/intel-geoint/2019/08/19/4-big-problems-the-intelligence-community-faces-moving-to-a-new-data-system/

Sur le même sujet

  • Pakistan’s private industry clashes with government over regulations

    11 juin 2020 | International, Aérospatial, Naval, Terrestre, C4ISR, Sécurité

    Pakistan’s private industry clashes with government over regulations

    By: Usman Ansari ISLAMABAD — The Pakistani government's restrictions on the defense industry are stifling potential and must go, according to the president of the trade body Pakistan Aerospace Council. PAeC is a collective of aerospace, defense and high-tech electronics enterprises that aims to internationally raise the profile of Pakistani industry. Its leader, Haroon Qureshi, heads the defense engineering and electronics company East West Infiniti. In a June 3 post on the PAeC website, Qureshi said Pakistan's private, high-tech manufacturers have the potential to help establish a more ambitious local aviation industry by acting as suppliers to and manufacturers of components and systems used by Western counterparts. However, this is hampered by government restrictions that demand permission prior to even design work. Without these restrictions, Qureshi believes the private sector could “leap-frog, especially with electronics of the future.” Citing the success of private space companies in the United States, Qureshi said if the Pakistani government frees the high-tech private sector to “innovate and do what the private industry thinks is feasible and viable,” those businesses would not use public funds and probably generate income for the government through taxes. In response to PAeC's comments, the Ministry of Defence Production told Defense News the government recognizes and actively promotes the importance of “indigenization and cooperation between the private sector and the defense-related industry.” However, it denied there are stifling constraints on the private sector, saying the market meets both domestic and export demand, but because of “international obligations/treaties, especially the measures taken to counter terrorism, certain limitations have to be observed.” Nevertheless, the ministry added, “measures are under deliberation to further facilitate the private sector in forthcoming defense production policy,” including the creation of a unit for so-called one-window operations — an approach meant to shorten the lengthy bureaucratic process. It also cited recent supplier and vendors exhibitions as well as a defense production seminar to promote cooperation among private businesses. The government is also preparing a “Defence Offset Policy" to encourage the private sector to absorb the “latest defense and dual-purpose technologies,” the ministry said. But author, analyst and former Australian defense attache to Islamabad Brian Cloughley said Qureshi's concern has existed for years, and the government's regulations are driven by security fears. “Whenever private industry wants to get involved in any aspect of defense production, the security people and bureaucrats in the defense system roll out objections, based mainly on the possibility of leakage of technical information and thus jeopardy of ‘national security,' ” he said. “It's been a real headache, and I continue to be surprised that the private sector has continued its efforts for so long.” Despite the government's efforts, Shehzad Ahmed Mir, managing director of the private defense company Bow Systems, remains unconvinced. “While MoDP lives in a self-pleasing, make-believe cocoon devoid of market realities, similar companies created much later in the West are literally thriving financially and technologically today simply because their respective governments gave them subsidies, export incentives, financial support, etc., compared to our government that drowns their ambitions in [no objection certificates], taxation whirlpools, bureaucratic hurdles, etc.,” he said. “So by the time — and if at all — MoDP comes out with any good news for the private sector, there won't be anyone credible around to jubilate on it.” https://www.defensenews.com/global/asia-pacific/2020/06/10/pakistans-private-industry-clashes-with-government-over-regulations/

  • UK: Shipbuilding firms chosen for Fleet Solid Support competition

    7 décembre 2018 | International, Naval

    UK: Shipbuilding firms chosen for Fleet Solid Support competition

    Four shipbuilding firms and a British consortium have been selected to compete for the Fleet Solid Support ships contract A syndicate of British firms, along with four international shipbuilding companies, have been selected to compete for the Fleet Solid Support ships contract, Defence Minister Stuart Andrew has announced. The crucial vessels, which will deliver ammunition, food and supplies to UK forces across the globe, will work alongside the Royal Navy's fleet of warships and will be an important part of the UK Maritime Task Group. The British consortium is made up of leading manufacturing and engineering companies Babcock, BAE Systems, Cammell Laird and Rolls-Royce. They join Italian firm Fincantieri, Spanish company Navantia, Japan Marine United Corporation, and Daewoo Shipbuilding and Marine Engineering of South Korea as the five successful firms who have been invited to submit a tender for the competition. Defence Minister Stuart Andrew said: The widespread interest in this competition shows that our Royal Navy and Royal Fleet Auxiliary remain among the most prestigious in the world. These support ships will be vital for supporting our formidable Queen Elizabeth Class carriers and will ensure our warships can deploy in a range of challenging environments and across huge distances, wherever they are in the world. The five companies, which were selected from eight interested firms, will now develop bids before a final decision is made regarding the winning bidder in 2020. The Fleet Solid Support ships, up to three of which will be procured through international competition as they are not warships, will be fitted with specialist and classified equipment at a British shipyard before entering service with the Royal Fleet Auxiliary from 2026. Shipyards across the United Kingdom will be able to bid for this work in 2022. As part of the Royal Fleet Auxiliary, the vessels will be civilian-manned and carry self-defence weapons only. https://www.gov.uk/government/news/shipbuilding-firms-chosen-for-fleet-solid-support-competition

  • SideWinder APT Strikes Middle East and Africa With Stealthy Multi-Stage Attack

    17 octobre 2024 | International, C4ISR, Sécurité

    SideWinder APT Strikes Middle East and Africa With Stealthy Multi-Stage Attack

    SideWinder APT launches stealthy multi-stage attacks, deploying StealerBot malware against critical entities in the Middle East and Africa.

Toutes les nouvelles