Bidoop Layer Components

Bidoop Layer is a layer of components Big Data for Hadoop, which enables us to analyze several information sources and to accelerate the development of new analytical models or the creation of operational processes, providing value to large volumes of data even in real time. Bidoop Layer’s architecture is divided into six main modularized components that, all together, form a robust and innovative product.

See Bidoop Layer's architecture

  • Define analytical models and business rules

    Workflow Engine

    Define analytical models and business rules

    Tool to define analytical models and business rules easily using previously developed algorithms designed by technical staff. The differential advantage of this exclusive component of Bidoop Layer is its functionality, since it is not necessary to have any previous technological knowledege about Hadoop to know how to use it.

    Advantages of Workflow Engine:

    • Allows you to define and implement processes and rules that generate valuable information.
    • Bring modularity and intelligent analytical capacity to the system (using mainly Mahout and R components).
    • These rules can be launched at a ETL level, processing level or at an information export level.
    • Allows the use of  HIVE, Pig, R, Mahout technologies of the Hadoop ecosystem.
    • It has an interface that makes a faster definition of new processes and rules.
    • Allows to give a lot of flexibility to Big Data platform both in terms of process and in terms of export and sharing with other systems.
    • Allows to take care of the predictive part and the BI in the following phases with all guarantees.
  • Events detection and alarms creation

    Real time Event Engine

    Events detection and alarms creation

    It offers the possibility to monitor continuous information flows and to detect events in real time. It identifies correlactions in data from several sources of information, causing alarms or predeterminated actions, almost in real time. The analysis of historical information and data analysis are combined. The Workflow Engine can do a preventive filter of information and categorize the processed events.

    Using the system of event detection which is the one responsible for monitoring and detecting event sequences and events according to a rule, it can analyze and detect them in real time to storage  them later in the HBase memory. These rules can be created and implemented always without independence of the tasks or system loads.

    Bidoop is totally  scalable, so information peaks don´t change the results.

  • Management layer oriented to security

    Users and Accesses Manager

    Management layer oriented to the security

    Management layer oriented to improve the security of the applicated solution, increasing the control over the users access to the system. The tool enables different accesses and fuctions depending on the typology of each user. It allows the connection with different legacy systems using LDAP, Active Directory or Kerberos.

    One of purposes of Pragsis is to offer applications 100% secures, that is why we have an expert team of engineers who revise each one of the versions we have. The main characteristic is that only certain users can access to some parts they have been asigned. Definying this parts in the most concrete way with our users system. Most of the companies have in their teams a user indentification system such as LDAP, Active Directory or Kerberos. Bidoop can work with this systems easily. In this way, it is integrated into its networks and the access control doesn´t modify its security politics.

    We also offer a solution designated for the management of the computer security. As the companies keep growing, their needs and business models influence in their human resources and their activities. It is necessary to have a strict control on their ations and accesses without losing tho company flexibility. For this reason, it is necessary to have an effective system to manage users, such as Active Directory, LDAP and Kerberos. Bidoop is currently able to integrate itself with these three systems. In this way, if we have several servers which provide these services, they are unified and analyzed using our Bidoop tools.

    For example, the access of a user simultaneously in two different locations will be detected and the required event will be processed in real time.

  • Include monitoring and maintenance components

    Bidoop Manager

    Include monitoring and maintenance components

    Include components which make possible an easier instalation, monitoring and maintenance of Bidoop Layer and Hadoop.

    • It incorporates an interface wich allows you to check the system status and diagnose problems, showing data such as the percentaje of space used in the cluster, the load balancing or the node distribution.
    • It also incorporates the visual interface of the WorkFlow Engine, the Event Engine and the User Manager. It offers the possibility to define new information sources to use them in the system, types of operations and transformations to be done with the input data, or the analytical process that are going to be implemented with the Workflow Engine and the Event Engine.
    • Bidoop Manager facilitates the realization of different implementations within a same cluster Hadoop, making possible that different business applications work at the same time with the Big Data architecture previously defined.
  • Reports and dashboards

    Dashboards

    Reports and dashboards

    Bidoop incorporates a visualization layer oriented to the end-users of the application. With this tool, a user without technical knowledge about Hadoop will be able to access to reports and dashboards with information from analytical or operational processes performed with the Workflow or the Events Engine.

  • Visualization of interactive data analytics

    Visualization Tools

    Visualization of interactive data analytics

    Bidoop Layer has open source tools to visualize and analyze data, giving the user a higher personalization in the information visualization.

    For this purpose, we use applications such as:

    • R
    • Pentaho
    • Open Street Map
    • D3