Basic Data Ingestion and Real Time Processing in GCP

Say you need to deploy sensor devices (e.g. Air quality measurement devices) across different cities globally.

The data to be collected from these devices should be ingested, processed and analyzed on real time basis.

The basic pipeline starts with Pub Sub.

Ingest using Pub Sub, Dump into DataFlow for pre processing and then from DataFlow, store in BigQuery, where it can be analyzed.

Need a hands-on Data Architect, AI, ML or GCP Consultant?

Need help with your data journey?  Start the conversation today.  


Posted

in

by

Tags: