Engine for recognition and fusion (nginr^®) is a big data analytics and fusion platform enabling actionable intelligence for decision support and automation. The feature rich and high performance platform can be configured to meet domain and application specific needs. It is a perfect fit when you are building solutions to generate actionable intelligence from real-time streams of Big Data. Move beyond analytics from single homogenous datasets and instead make sense of multiple streams of heterogenous datasets with our augmented data analytics platform. Our actionable intelligence approach means that the analytics are prepared for human decision making as well as consumption by machines for automation purposes.

The platform has been designed to meet the demanding applications with requirements such as real-time continuous intelligence, security and strong authentication, data integrity and accountability. Bring Your Own Data or use our data access services to discover, source, prepare and integrate the open data sets needed. With access to big data in place the platform will process the data using artificial intelligence and machine learning techniques. We have a diverse set of our own proprietary components with ready trained models for machine learning from a variety of data types such as text, images, audio and video. Integration of the 3rd party models is supported and as well as time series and measurements from sensors such as location, pressure, temperature. Any concept identified and their interrelations are organized and recorded in a Blocknetwork. The Blocknetwork technology is developed and patented by Dataunitor AS. The architecture of the platform is distributed, modular and component based making it scalable by design. The multiple instances of the same module, typically thousands of them, may be active simultaneously. The components make heavy use of hardware acceleration (GPU) processing techniques.

nginr^® can be provided under a Platform as a Service (PaaS) software subscription model. The PaaS service is running on a highly optimized operating system in our own datacenter. Get in touch to discuss your needs and any special requirements such as on-premises deployment and access to source code.

All-domain Information Fusion, Assessment and Coordination System

All-domain (land, air, maritime, space and cyberspace) information fusion, assessment and coordination system made up of various components including the following:

• Engine for recognition and fusion (nginr^®) is the core of the system. It is based on blocknetwork, which is our technology patented in many European, Eurasian countries and the US. In nginr^®, anything that needs to be monitored is called an interest. Units, people, locations, equipment and incidents can become interests. A blockchain is created and maintained for each interest. The incoming intelligence, surveillance reconnaissance (ISR) and status report data files are processed to detect interests in them, and a block is created for each data file. A block is the list of interests in a data file, and if a block is related to more than one interest, it implies an interaction, and that block is owned by multiple blockchains. The system detects patterns and scenarios, recognizes incidents, and employs communications enabled services to follow the procedures and contingency plans. It is an all-domain ISR processing and fusion technology, which can also validate the accuracy of the fused information.
• All-domain common operational picture (COP) is a situational awareness system on which the statuses of interests are visualized in five dimensions (i.e., three spatial dimensions, time and interactions). COP can depict the blockchains of interests, hence not only the information about the latest status of interests but also their past data and interactions with other interests are depicted on a map.
• Multidomain assessment subsystem (MAS) is to analyze and assess if the decisive conditions to meet objectives are created. Decisive conditions are defined as scenarios made up of interactions of interests and the order of interactions. MAS autonomously decides if those decisive conditions are created based on the realization of scenarios.
• Multidomain rhythm subsystem (MRS) is to create a rhythm of activities required to manage and coordinate various all-domain processes. MRS is used as the collaborative process to coordinate and exchange the information products as the inputs and outputs of the activities of various processes.
• hymots^® symbiotic hybrid multi-domain operations, tactics and strategy simulation system is a simulation tool that can work symbiotic to nginr^®. It generates forecasts to predict the future incidents and potential outcomes of the contemporary setting based on geostrategic trends. It is connected to nginr^® bi-directionally which means it provides the forecasts to nginr^® and adapts the forecasts to the real setting as it changes in nginr^®.

nginr^® engine for recognition and fusion

nginr^® is the implementation of our patented technology called blocknetwork, which is a network of blockchains. The blockchain technology is accepted by many researchers as the breakthrough after the Internet. The Internet provides an efficient and universal way for people and machines to communicate. The blockchain technology complements the Internet with a simple but powerful trust mechanism. Trust on the accuracy of the original content and the preservation of the content integrity are critical requirements for many applications, and therefore, a blockchain can improve the processes that needs absolute trust in communications. A blockchain is a data structure and a set of algorithms for the decentralized validation of the information in the data structure.

The blocknetwork scheme is a distributed scheme to gather information and fuse them into a knowledgebase. It is a network of blockchains. A blocknetwork behaves the same as a blockchain when there is only one chain in the network. Blocknetwork is designed to fuse information retrieved from big data, to create a NoSQL knowledgebase, and to store and manage the knowledgebase. This process has the following stages:

• Process data and retrieve information: The information is retrieved from high variety of data, such as text, imageries, videos and signature data, when they are flowing in very large quantities.
• Analyze and fuse information into a NoSQL knowledgebase: A block is created for each data file. The body of the block is the list of interests in the data file. Then the block is linked to the blockchains of every interest in the block.
• Manage knowledgebase: The data files can be further processed later, which may relieve new information or necessitate correcting the previously retrieved information.
• Disseminate/share information/knowledge: The knowledge can be gained on surfing over the blocknetwork. For example, the blocknetwork can answer the queries, such as how an incident happened or what the relations among the interests are. Moreover, the system sends notifications following the rules defined by the system administrators, i.e., the conditions to trigger a notification and the receivers of the notification.

Common Operational Picture (COP)

Live and/or batch data collected by millions of sensors, such as, the payloads of unmanned aerial vehicles, still or video cameras, surveillance cameras, radars, thermal cameras, manual entry terminals, data terminals for text data in various formats, can be linked to nginr^®, which can process flowing data when they are incoming, and retrieve information, such as the location and time of interests (e.g., units, persons, vehicles, locations, objects, incidents and communications) autonomously, and establish temporal, spatial and relational facts about them in a knowledgebase.

nginr^® uses state of art deep machine learning techniques for image and video analytics, as well as natural language processing to recognize and identify vehicles, people, locations and incidents. In addition to that, our novel artificial intelligence techniques recognize and identify the military units, their formations and postures.

COP can illustrate operational picture on a map or by using standard graphical representations. Although collected data can be as big as hundreds of petabytes even exabytes, the users can query the knowledge retrieved from the data very effectively. COP is an autonomous measurement, signature, open source, human, network intelligence (MASINT, SIGINT, OSINT, HUMINT, DNINT) fusion system for big data.

It depicts a common all-domain (land, air, maritime, space and cyber) operational picture with five dimensions (i.e., three spatial dimensions, time and interactions among the interests). The users can see graphically and query the whereabouts, status and interactions of interests. They can observe and learn the mobility and action patterns of interests on a graphical interface. For this, COP does not need human in the loop. By using artificial intelligence, it can associate and correlate the incoming raw data with units, persons, vessels, incidents, objects and even scenarios autonomously, and can engage with the scenarios as defined in a rule base, so called the engagement matrix.

COP can be used as a network analysis tool. It can detect and analyze networks of interactions. Therefore, COP can analyze threat networks, such as, criminal or terrorist networks. Raw data from sensors such as pictures, videos, e-mails, social media interactions are processed by nginr^®, and the information exchange (e.g., e-mails, social media communications) and interaction (e.g., being in the same picture/video, involving in the same incident, such as an accident, a demonstration, a homicide) networks are constructed. Connectivity degree, degree of separation, closeness, eigenvector (i.e., centrality) of the interests can be investigated in network analysis. COP can run in one of the following modes for this:

Realtime mode: nginr^® has interfaces to get connected to the real life sensors, such as, camera, Internet of Thing (IoT) devices.
Simulation mode: nginr^® can be connected to hybrid multidomain operations, tactics and strategy simulation system (hymots^®) for simulation purposes.
Symbiotic mode: Symbiotic mode is the mix of real time and simulation modes. Simulation is used for making predictions about the future, which is corrected as the real time data are received and processed.

COP can also manage the sharing of the knowledgebase with the other organizations and allies.

Multi-domain Assessment Subsystem (MAS)

MAS analyzes and assesses whether the decisive conditions for the operational objectives are fulfilled, and the strategic objectives are met. The decisive conditions are created when the tasks related to them are completed and the scenarios defined for them are realized. As the decisive conditions are created, the operational and strategic objectives are met. MAS autonomously analyzes the blocknetwork to assess and provides the headquarters with visual aids to steer the strategic engagements and operations ultimately towards the political objectives.

Multi-domain Rhythm Subsystem (MRS)

MRS supports and connects the battlerhythm of multiple levels in a command hierarchy from strategic to tactical. It provides information products which are inputs to all-domain processes, such as operations planning, battlespace management, assessment, coordination, fires, targeting, personnel recovery. Information is tailored to the abstraction level that suits best to the supported process and echelon. It is also a collaborative working environment to synthesize and share knowledge among the functional areas and echelons.

Hybrid Multi-domain Operations Tactics and Strategy Simulation System (hymots^®)

Hybrid Multi-domain Operations Tactics and Strategy Simulation System(hymots^®) has a module for geostrategic critical analysis called (hymots^®g), which is an extensive form Bayesian geostrategic game with imperfect information.

The main output of hymots^®g is a world map on which all the state and none state actors are visualized. For the actors, values for 11 geostrategic metrics (political, diplomacy, information, military, economic, financial, intelligence, infrastructure, social, law enforcement and technology), 41 geostrategic parameters and various variables are visualized. The world map is colored according to the selected instrument or parameter values. In addition to that, as the conditions for the defined scenarios are met, warnings with various color codes appear in the screen. The users can query on those warnings.

hymots^®g is used for analyzing and assessing the consequences of the detected scenarios (i.e., incidents or crises) in short and medium term. When used together with nginr^®, hymots^®g also provides analysts with an insight into the relations of an incident with the other incidents, actors and locations and also compare them with the learned patterns. Each incident and actor have an associated blockchain in nginr^®. When actors interact with each other or incidents, they share blocks with the blockchains dedicated to the interacted incidents and actors. These blockchains and their relations can be visualized on the nginr^® COP which has five dimensions (three geographical dimensions, time and interactions).

Analysts can let hymots^®g to select the strategies and geostrategic trends for the actors in geostrategic games, and they can interact with the game any time before or during simulation to change the selected strategies or to enter new strategies for a selected actor. Strategies have conditions to be fulfilled for being applicable. For example, a strategy may have an exclusive relation with a set of other strategies or may be required to be run together with a set of strategies. Strategies may also have constraints related to geostrategic metrics, parameters or variable values.

hymots^®g is for supporting strategic level processes including strategic foresight development, crises detection and warning, situation appreciation, response option development. It imitates a volatile, complex and ambiguous setting with limitless uncertainties for short and medium term (5-10 years) geostrategic foresight generation. A reasonable database preparation effort suffices to prepare it for complex simulation tasks. The system can reach up to 300/1 simulation speed within a global scenario. When it is symbiotic with nginr^®, in other words with the reality, a digital twin of the real World is created to detect the crises patterns through simulation and incident pattern recognition.

For further information about the hybrid multi-domain operations tactical and strategic simulation for geostrategic analysis (hymots^®g), please visit www.hymots.info