Data Engineer

IDR is seeking a Data Engineer to join one of our top clients for an opportunity in Malvern, PA. This role involves designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions within the financial services industry. The position offers a chance to work with cutting-edge technologies and contribute to high-impact data projects.

Position Overview for the Data Engineer

• Develops and maintains large-scale data pipelines and workflows using Python, SQL, PySpark, and Databricks.
• Implements cloud-based data solutions utilizing AWS services.
• Designs data models aligned with Medallion Architecture (Bronze/Silver/Gold) and Data Warehousing best practices.
• Collaborates with cross-functional teams to ensure data quality and accessibility.
• Contributes to the development and visualization of dashboards through Databricks.

Requirements for the Data Engineer

• Expert knowledge of Python, SQL, PySpark, Databricks, Delta Lake, Apache Spark, Databricks Dashboards, Git, GitHub, CI/CD Pipelines, Data Modeling, Dimensional Modeling, Data Warehousing, Medallion Architecture (Bronze/Silver/Gold).
• Proven experience designing and implementing scalable data pipelines and ETL workflows.
• Strong background working with AWS cloud services.
• Excellent understanding of data modeling and architecture principles.
• At least 3 years of professional data engineering experience, with specific focus in Databricks projects.

What's in it for you?

• Competitive compensation package
• Full Benefits; Medical, Vision, Dental, and more!
• Opportunity to get in with an industry leading organization.

Why IDR?

• 25+ Years of Proven Industry Experience in 4 major markets
• Employee Stock Ownership Program
• Dedicated Engagement Manager who is committed to you and your success.
• Medical, Dental, Vision, and Life Insurance
• ClearlyRated's Best of Staffing® Client and Talent Award winner 12 years in a row.

#LI-HYBRID

$53-$56/hrAll qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. IDR is subject to certain governmental recordkeeping and reporting requirements for the administration of civil rights laws and regulations. In order to comply with these laws, we invite employees to voluntarily self-identify their race or ethnicity, gender, and veteran status (if applicable). Submission of this information is voluntary and refusal to provide it will not subject you to any adverse treatment. The information obtained will be kept confidential and may only be used in accordance with the provisions of applicable laws, executive orders, and regulations, including those that require the information to be summarized and reported to the federal government for civil rights enforcement. You may access this form here.

Skills

Amazon Web Services (AWS), Apache Spark, Best Practices, Cloud Computing, Continuous Deployment/Delivery, Continuous Integration, Cross-Functional, Data Management, Data Modeling, Data Quality, Data Warehousing, Database Extract Transform and Load (ETL), Dimensional Modeling, Engineering, Financial Services, Git, GitHub, Leading Edge Technology, Life Insurance, Python Programming/Scripting Language, Reporting Dashboards, SQL (Structured Query Language), Vision Plan

undefined

IDR