Questions to ask as a DE while choosing storage
Mar 8, 2023
There are many storage solutions like S3 which is object storage and gives us query capabilities, Kafka has the ability to simultaneously ingest and store ..
Read Questions to ask as a Data Engineer whenever a new data source comes
Mar 7, 2023
Source: Fundamentals of Data Engineering . There are many things to consider when assessing source systems, including how the system handles ingestion, state, and data generation. The following is a starting set of evaluation questions of source systems that data engineers must consider
Read
Some Oozie Examples
Apr 14, 2021
We have used Hortonworks Sandbox Platform to execute the examples. Oozie Web UI is disabled by default. We need to enable it manually. Steps to Enable the Oozie Web UI.Executing Few examples in Oozie.
Read
6 Dimensions of Data Quality
Oct 9, 2020
Accuracy,Completeness,Consistency,Timeliness,Validity & Uniqueness
ReadCategories