Say you have an Online Transactional Database (OLTP). Daily transaction data is extracted, transformed and loaded from this OLTP system to Teradata Database (OLAP) during nightly batch.
As the customer base grows, nightly ETL loads are taking longer and longer. Business users are not able to view the latest report the next morning.
What solution should be implemented to have minimal impact on day to day operations?
Ideally the next step should be to implement Hadoop DataLake and offload data from the slow OLAP system to Hadoop. Connect a BI Tool to Hadoop via Impala/Hive connectors.
Need a hands-on Data Architect, AI, ML or GCP Consultant?
Need help with your data journey? Start the conversation today.