Vaco has an opportunity in Houston, TX for a Data Engineer (Azure/Python required). Our client is expanding their advanced predictive/decision analytics team. This team has an opening for an experienced data engineer that will have "ownership" of all data coming into and out of the growing number of predictive analytics modeling algorithms.
This position is the primary technical resource for setting up and maintaining the data pipelines between multiple source systems and the Azure data lake. The position will also design and develop programming routines to "pre-process" data to support the team's data scientists and their modeling algorithms. Finally, the position will design and maintain data pipelines that will feed the analytics results back to the sources systems and to an advance reporting data warehouse.
This new position offers the opportunity to gain advanced knowledge and experience with next-generation predictive analytics/AI/machine learning systems using the latest Azure technologies as well as other advanced, cloud-based technologies.
This position requires a solid understanding of how to move data back and forth between traditional source systems and cloud-based data repositories (e.g., data lakes). This requires good experience foundation traditional ETL processes and experience using Azure Data Factory. Knowledge of other data related Azure data/analytics technologies (e.g., Azure SQL Warehouse, Data Lake, Data Bricks) would be very beneficial, but not required.
This position also requires programming experience with Python to support the processing and manipulation of data prior to being passed to the modeling algorithms developed by the data scientists.