Must-Have Skills and Experience
- Bachelor’s degree in Technology or related field
- 7+ years of experience in data engineering
- Strong experience designing complex ETL processes and architectures
- Hands-on experience with Informatica (IICS, Informatica PowerCenter)
- Ability to design, develop, test, debug, and migrate Informatica code
- Experience working with Snowflake as a data warehouse
- Strong understanding of Data Warehousing concepts and best practices
- Proficiency in SQL for data querying and transformation
- Proficiency in Python and related libraries for data processing
- Experience building cloud-based data solutions (AWS preferred; Azure or GCP acceptable)
- Ability to develop test cases including test data preparation for:
- Data completeness
- Data transformations
- Data quality
- Performance and scalability
- Strong analytical and problem-solving skills
Nice-to-Have Skills (Plusses)
- Experience with streaming and event-driven architectures (Kafka, Spark Streaming, Pulsar, etc.)
- Experience working with cloud SDKs and programmatic service integration
- Exposure to DevOps practices including Infrastructure as Code (IaC) and CI/CD pipelines
- Working knowledge of Agile development methodologies
Day-to-Day Responsibilities
- Design and develop scalable ETL solutions and data pipelines using Informatica tools
- Analyze existing ETL processes and recommend improvements to optimize performance and scalability
- Develop, test, debug, and deploy Informatica code across environments
- Work with Snowflake for data storage, transformation, and optimization
- Create and execute test cases to validate data completeness, accuracy, and transformation logic
- Perform data validation and ensure adherence to data quality standards
- Collaborate with cross-functional teams to gather requirements and implement data solutions
- Build and maintain cloud-based data architectures and workflows
- Monitor data pipelines and troubleshoot data processing issues
- Support performance tuning and scalability improvements for large data workloads
- Contribute to Agile ceremonies and follow sprint-based delivery processes