Job Description
- The Data Solutions Architect is a senior technical role and will play a crucial role in designing, implementing, and managing robust data architectures, data infrastructure, data pipelines, and solutions that meet the evolving needs of our organization. This role involves working closely with stakeholders across various teams to understand their data requirements and ensure that our data infrastructure supports business goals effectively
- REQUIRED EDUCATION AND EXPERIENCE:
- Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field
- 9+ years of experience in data engineering, data architecture, or related fields
- 5+ years demonstrating a high degree of proficiency in designing and developing complex, high-quality big data engineering solutions in Azure cloud – Data Factory and Databricks
- 5+ years of extensive experience with data modeling, ETL/ELT processes, and data integration
- 5+ years of experience in working with cloud data engineering and integration solutions
- 3+ years in a senior technical role designing data and analytics solution architectures, detailed workflows, best practices, and governance guidelines and advising on necessary technologies
- Hands-on experience designing and developing Enterprise data and analytical solutions including ETL (e.g., DataStage, Informatica), DWH (Exadata, Teradata), BI, Hadoop (Hive, Impala, Presto) or modern cloud services (e.g., Databricks, Snowflake, Redshift)
- Strong proficiency in SQL, Python and Spark framework
- Experience with data pipeline orchestration tools like Apache Airflow or similar
- Proven experience in designing and implementing data solutions using Azure services like Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure SQL Database
- Strong preference for demonstrated experience leveraging modern OSS and cloud-native technology stack for doing data science and modern analytics (e.g., Databricks)
- Understanding of data modeling a plus (dimensional, snowflake, Data Vault)
- Experience in processing insights from semi-structured and unstructured data
- Experience in Agile development methodology, with specific Solution Architect (or similar) experience preferred
- Ability to phase the delivery of analytical solutions such that it can meet immediate needs, while building towards the long-term strategic solution
- Understanding of holistic enterprise architecture and interplay of analytical components with enterprise foundational components (data architecture/governance, security, etc.)
- Strong communication skills with ability to communicate complex technical concepts in a digestible way
- Skilled at developing and exercising cross-functional influence, aligning business and technical teams around a common architecture vision
- Ability to effortlessly switch gears from summary view for leadership to hands-on discussion with practitioners
- Assertive, with the confidence to be voice of authority – not afraid to do what is best for team
- High-energy and passionate outlook to the role and can influence those around her/him
- Ability to build a sense of trust and rapport that creates a comfortable and effective workplace
- PREFERRED EXPERIENCE:
- Familiarity with DevOps practices and implementation
- Experience with implementation of data security and privacy practices
- Experience with Azure services such as Azure App Services, Azure Kubernetes Service (AKS), Azure DevOps, and Azure SQL Database
- Familiarity with SAP BW, SAP data and SAP Data Intelligence
- Familiarity with Qlik data model concepts
- Experience with data streaming technologies
Job Responsibilities
- Design, develop, and maintain scalable data pipelines that ingest, process, and transform data from various sources into structured formats for analysis and reporting
- Lead the design and implementation of data architectures, including data warehouses, data lakes, and cloud-based solutions, ensuring they are scalable, secure, and aligned with business requirements
- Establish data quality standards and governance practices, ensuring data accuracy, consistency, and compliance with regulatory requirements
- Share governance responsibility to ensure alignment to enterprise guidelines for security, auditability, data governance, metadata management, etc
- Monitor, troubleshoot, and optimize the performance of data systems, including database tuning, query optimization, and pipeline efficiency
- Utilize big data technologies to handle high-velocity and high-volume data processing tasks
- Work closely with data scientists, analysts, and other stakeholders to gather data requirements, translate them into technical solutions, and ensure data availability for business needs.
- Provide guidance and mentorship to junior engineers and peers, fostering a collaborative environment and promoting best practices in data engineering
- Maintain comprehensive documentation of data architectures, pipelines, and processes to ensure knowledge sharing and operational continuity
- Ensure that all cloud data solutions meet security, compliance, and governance requirements, implementing best practices for data encryption, access control, and monitoring
- Stay current with emerging data engineering trends and technologies, proposing and implementing innovative solutions that improve data processing and analysis capabilities
Location
Bangalore Rural, Karnataka, India