Data Engineer - Cockeysville, MD
Veritas Partners has an immediate opening for a Data Engineer to join our team! This role is a mix of software development and analytics so either of the following backgrounds is acceptable: a software developer with experience in data interpretation and desire to focus on the analytics space or a business analyst with experience in software development, especially focused on process automation.
This is an exciting opportunity to work on new initiatives, while simultaneously analyzing and processing data from recently acquired data sets!
· Familiar with the modern cloud data platforms (Azure preferred but AWS is ok). In particular, experience in some of the following is preferred:
o Azure Data Lake (Analytics and Storage), Data Warehouse / Synapse Analytics / Amazon Redshift, Data Factory, Logic Apps, Data Bricks
o Other preferred technologies include: Advanced T-SQL (SQL Server), REST API concepts, PowerShell, SSIS, Power BI
· Experience in database design, architecture and warehousing
· Experience creating ETL/ELT processes to move data between internal and external sources using APIs, ETL.
· Fundamental understanding of Data Lakes, Data Catalogs, Hardware and Network Topology
· Experience using data reporting and visualization tools (e.g. Cognos, SSRS, Qlik, Data Studio, Power BI, Tableau, etc.)
Knowledgeable about a variety of job-related concepts listed below will help you be successful in this role and are some of the main duties of the position:
· Algorithmic concepts from at least one information-centric discipline (e.g. statistics, machine learning, information processing, natural language processing, etc.)
· Gathering data requirements from stakeholders
· Evaluating data collection for accuracy
· Data Governance concepts
· Mindful of practices, procedures and legal guidelines that govern PII and other sensitive data
· Ability to tackle complex problems with creative solutions when the path may not be clear.