Sr. Consultant - Data Engineering (India)

We are seeking a skilled and team-oriented Sr. Data/Python Engineer with experience in the development of production Python -based applications (Such as Django, Flask, FastAPI on AWS) to support our data platform initiatives and application development. This role will initially focus on building and optimizing Streamlit application development frameworks, CI/CD Pipelines, ensuring code reliability through automated testing with Pytest, and enabling team members to deliver updates via CI/CD pipelines. Once the deployment framework is implemented, the Sr Engineer will own and drive data transformation pipelines in dbt and implement a data quality framework.<\/span>

<\/p><\/div>

Roles & Responsibilities :<\/b>

<\/h4>

• Lead application testing and productionalization of applications built on top of Snowflake - This includes implementation and execution of unit testing and integration testing - <\/span>Automated test suites include use of Pytest and Streamlit App Tests<\/span> to ensure code quality, data accuracy, and system reliability.<\/span>

<\/p><\/li>

• Development and Integration of <\/span>CI/CD pipelines<\/span> (e.g., GitHub Actions, Azure DevOps, or GitLab CI) for consistent deployments across dev, staging, and production environments.<\/span>

<\/p><\/li>

• Development and testing of AWS -based pipelines - AWS Glue, Airflow (MWAA), S3<\/span>

<\/p><\/li>

• Design, develop, and optimize <\/span>data models and transformation pipelines<\/span> in Snowflake using SQL and Python.<\/span>

<\/p><\/li>

• Build <\/span>Streamlit -based applications<\/span> to enable internal stakeholders to explore and interact with data and models.<\/span>

<\/p><\/li>

• Collaborate with team members and application developers to align requirements and ensure secure, scalable solutions.<\/span>

<\/p><\/li>

• Monitor data pipelines and application performance, optimizing for speed, cost, and user experience.<\/span>

<\/p><\/li>

• Create end -user technical documentation and contribute to knowledge sharing across engineering and analytics teams.<\/span>

<\/p><\/li>

• Work in CST hours and collaborate with onshore and offshore teams.<\/span>

<\/p><\/li><\/ul>

<\/div><\/span>

Requirements<\/h3>

Qualifications & Skills :<\/span>

<\/h4><\/div>

• 5+ years of experience in <\/span>Data Engineering or Python based application development on AWS (Flask, Django, FastAPI, Streamlit)<\/span> - Experience building data data -intensive applications on python as well as data pipelines on AWS in a must.<\/span>

<\/p><\/li>

• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field (or equivalent experience).<\/span>​<\/span>

<\/p><\/li>

• Proficient in <\/span>SQL<\/span> and <\/span>Python<\/span> for data manipulation and automation tasks.<\/span>

<\/p><\/li>

• Experience with developing and productionalizing applications built on Python based Frameworks such as FastAPI, Django, Flask<\/span>

<\/p><\/li>

• Experience with application frameworks such as <\/span>Streamlit, Angular, React etc<\/span> for rapid data app deployment.<\/span>

<\/p><\/li>

• Solid understanding of <\/span>software testing principles<\/span> and experience using <\/span>Pytest<\/span> or similar Python frameworks.<\/span>

<\/p><\/li>

• Experience configuring and maintaining <\/span>CI/CD pipelines<\/span> for automated testing and deployment.<\/span>

<\/p><\/li>

• Familiarity with version control systems such as <\/span>Gitlab<\/span>.<\/span>

<\/p><\/li>

• Knowledge of data governance, security best practices, and role -based access control (RBAC) in Snowflake.<\/span>

<\/p><\/li><\/ul>

Preferred Qualifications:<\/span>

<\/h4>

• Experience with <\/span>dbt<\/span> (data build tool) for transformation modeling.<\/span>

<\/span><\/li>

• Knowledge of <\/span>Snowflake’s advanced features<\/span> (e.g., masking policies, external functions, Snowpark).<\/span>

<\/span><\/li>

• Exposure to <\/span>cloud platforms<\/span> (e.g., AWS, Azure, GCP)<\/span>

<\/span><\/li>

• Strong communication and documentation skills<\/span>

<\/span><\/li><\/ul>

Signs You May Be a Great Fit <\/span> <\/span>

<\/h4>

• Impact: <\/span> Play a pivotal role in shaping a rapidly growing venture studio. <\/span> <\/span>

<\/li>

• Culture: <\/span> Thrive in a collaborative, innovative environment that values creativity and ownership. <\/span> <\/span>

<\/li>

• Growth: <\/span> Access professional development opportunities and mentorship. <\/span> <\/span>

<\/li>

• Benefits: <\/span> Competitive salary, health/wellness packages, and flexible work options. <\/span> <\/span>

<\/li><\/ul><\/div>

<\/div><\/span>