Job Description
Key Responsibilities:
Design, develop, and implement scalable data pipelines using Azure Data Factory (ADF) to automate data integration and transformation processes.
Utilize Azure Databricks for advanced data processing and analytics, leveraging Spark to handle large datasets efficiently.
Ensure the reliability, availability, and performance of data platforms and services.
Implement data quality and validation processes to ensure data accuracy and integrity.
Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
Collaborate with IT and business teams to integrate data solutions with existing systems and applications.
Optimize data processing workflows for performance and cost-efficiency.
Troubleshoot and resolve data pipeline issues in a timely manner.
Maintain comprehensive documentation of data architectures, processes, and best practices.
Stay updated with the latest industry trends and Azure technologies to continuously improve data engineering practices.
Must Have :
Proven experience as a Data Engineer with a focus on Azure Data Factory and Databricks.
Strong proficiency in SQL and experience with data modeling and ETL processes.
Solid understanding of Azure ecosystem (e.g., Azure Storage, Azure SQL Database, Azure Synapse Analytics).
Familiarity with other Azure services like Azure Functions, Logic Apps, and Azure DevOps.
Experience with programming languages such as Python or Scala.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.
Good to have:
Azure certifications such as Microsoft Certified: Azure Data Engineer Associate.
Job Tags
Similar Jobs
Liberty First Credit Union
...benefits and associate programs are some of the most competitive and low-cost to associates amongst Nebraska employers. Position Mortgage Loan Officer General Summary Serve the credit union membership by providing and promoting prudent borrowing activities...
Comcast
Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across...
Pearson Education Services
...About Pearson Pearson is the worlds leading learning company, committed to helping learners make measurable progress in their lives through education. Within our Early Career Pathways group, we are building innovative solutions that connect learning to employability...
ASB Freight Co.
...Area: PA to OH, KY, VA, NY, CT, MA, and ME ~3 months class A tractor trailer experience required! Compensation:~$1400-$1600 average... ...-operated logistics company built on reliability, safety, and driver-focused values. We're committed to creating a supportive...
NoeCee Global Inc.
...Join Our Team as an Entry-Level Marketing Associate!No Experience? No Problem. Were Looking for Ambitious, Driven Individuals to Grow with Us! Position Overview:As anEntry-Level Marketing Associate, youll have the opportunity to learn and grow in various aspects of...