Data science has attracted a lot of buzz for almost the last decade. The ability to gain insights from data has driven much of the high-tech companies like Facebook, Netflix, and Google’s success. However, it is not the only piece of the data puzzle. Quietly, in the background, behind all the models, metrics, and dashboards, another type of data professional has worked to ensure data scientists have the data they need.
Data engineers work in the background managing data pipelines and data storage systems to ensure that the rest of the company can get their dashboards, metrics, and models. They use a variety of tools like SQL databases, Hadoop and Python and are proficient in data modeling and automation.
What You'll Learn
- The goal of a data engineer and the skills and tools they use on a daily basis
- Insights to the other options data professionals have besides data scientists
SeattleDataGuy - Ben is a Seattle based Data Scientist & Engineer working in San Francisco, California. He has extensive experience designing ETL pipelines, databases, websites, and other software products for startups and pre-established corporations.