Summary
What you’ll impact
Our company is searching for a Sr. Data Engineer to join our Data Analytics team in Dallas, TX! The successful candidate will work with our teams to develop and maintain data pipelines in Azure utilizing Databricks, Python and SQL.
Responsibilities
What you'll do
- Facilitate technical design of complex data sourcing, transformation and aggregation logic, ensuring business analytics requirements are met
- Work with leadership to prioritize business and information needs
- Engage with product and app development teams to gather requirements, and create technical requirements
- Utilize and implement data engineering best practices and coding strategies
- Be responsible for data ingress into storage
Requirements
What you’ll bring
- Bachelor’s Degree Computer Science, Information Management, or related field required; Masters preferred
- 8+ years in data engineering including prior experience in data transformation
- Databricks experience building data pipelines using the medallion architecture, bronze to gold
- Advanced skills in Spark and structured streaming, SQL, Python
- Technical expertise regarding data models, database design/development, data mining and other segmentation techniques
- Experience with data conversion, interface and report development
- Experience working with IOT and/or geospatial data in a cloud environment (Azure)
- Adept at queries, report writing and presenting findings
- Prior experience coding utilizing repositories and multiple coding environments
- Must possess effective communication skills, both verbal and written
- Strong organizational, time management and multi-tasking skills
- Process improvement and automation a plus
- Databricks Data Engineering Associate or Professional Certification > 2023