An Operations Engineer specializing in AWS Cloud services—including IICS (Informatica Intelligent Cloud Services), Snowflake, AWS Glue, and Apache Airflow—plays a pivotal role in managing and optimizing cloud-based data workflows. This role combines expertise in cloud technologies, data integration, and production support within a shift-based work environment.
Key Responsibilities:
- AWS Cloud Infrastructure Management: Oversee and maintain AWS services such as EC2, S3, RDS, Glue, and Athena to ensure optimal performance and reliability.
- Data Integration and ETL Processes: Design, implement, and manage ETL pipelines using AWS Glue and IICS to extract, transform, and load data into data lakes or warehouses, ensuring data quality and consistency.
- Workflow Orchestration: Utilize Apache Airflow for scheduling and automating complex data workflows, enhancing operational efficiency and reliability.
- Production Support: Provide ongoing support for production systems, including monitoring, troubleshooting, and resolving issues related to data processing and system performance.
- Shift-Based Operations: Participate in a rotational shift model to provide 24/7 support, including night shifts and occasional weekend work, ensuring continuous system availability and performance.
- Debugging and Troubleshooting: Employ strong analytical skills to identify and resolve technical issues across AWS services and data workflows, minimizing downtime and maintaining system integrity.
Required Skills and Qualifications:
- Technical Expertise: Proficiency in AWS services (EC2, S3, RDS, Glue, Athena), data integration tools like IICS and Snowflake, and workflow orchestration with Apache Airflow.
- Programming Skills: Experience with programming and scripting languages such as Python, Java, or Scala for developing and troubleshooting data workflows.
- Production Support Experience: Demonstrated ability to manage and support production environments, including incident response and system optimization.
- Shift Work Availability: Willingness to work in a shift-based schedule, including night shifts, to provide continuous support and maintenance.
- Problem-Solving Abilities: Strong debugging and troubleshooting skills, with a methodical approach to diagnosing and resolving complex technical issues.
This role is ideal for professionals seeking to leverage their expertise in AWS cloud technologies and data integration within a dynamic and supportive environment.
