Our platform is based on IoT, using different technologies that make it fault-tolerant, accurate, resilient, and extensible.
It is built on a combination of technologies such as lambda proxy, Apache Kafka, Cassandra, in-memory databases, and streaming event processing frameworks within the Cloud landing zone ecosystem, ensuring its resiliency and 24/7 availability. Along with these core big data tools and platforms, supporting technologies are utilized for end-to-end delivery of drilling data, making our cloud platform unique in its reliability and innovation.
Data Collection
Data from rigs is collected using rig sensors and transported to the cloud infrastructure through the internet. A lambda proxy serves as the entry point to our cloud ecosystem. This will forward the collected data to clustered Apache Kafka instances used as real-time streaming data pipelines.
Data Storage
After data is at the Kafka clusters layer, it is retrieved in a FIFO manner using a java application and stored in a NoSql Cassandra database.
Data Visualization
From the Apache Kafka clusters, a different java application ingests the data as it comes in from remote rigs and pushes it to all connected client applications in real-time using the flux technology. Json format is used for serializing and transmitting data over a network.
Data Transport
The transport mechanism is based on the availability of the internet using a human readable interchange json for its lightweight format.