Bookmarks tagged data-pipeline

"Using controlled vocabularies for column names is a low-tech, low-friction approach to building a shared understanding of how each field in a data set is intended to work. In this post, I’ll introduce the concept with an example and demonstrate how controlled vocabularies can offer lightweight solutions to rote data validation, discoverability, and wrangling.“

"Extracting data from a MySQL database and loading into Google BigQuery using Google Cloud Functions"

"So you need to perform simple Extract Transform Load (ETL) from different databases to a data warehouse to perform some data aggregation…"