Location: Coimbatore / WFH
Key Responsibilities:
Develop, Document and Execute analytics solutions with ETL/ELT architecture using Talend
ETL and Participate in extensive design, development, testing, and performance tuning of ETL processes within SSIS to support the collection of data from SAP, Oracle, SQL Server and other legacy data bases and flat files for the purpose of storing in Redshift Data Warehouse
Use Talend standard components to extract data and create custom components as needed
Develop, document, and execute SQL/stored procedures/server scripts as needed to support ETL source and target mapping
Analyze business requirements to formulate ETL solution
Development of ETL source and target mapping design/specifications and other artifacts based on the business requirements and ETL standards and architecture
Create detailed performance test plan and strategy (includes load testing and stress testing) in conjunction with developers and help execute performance test plans
Develops and enhance solutions to efficiently reuse existing components.
Recommends necessary changes in the existing solution landscape to keep up with business growth, revenue generation, and cost savings
Develop real-time and batch data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark, Kinesis, Java, NoSQL DBs, AWS EMR.
Develop data & analytics solutions leveraging on AWS Data management technology stack S3, Kinesis, EMR, Redshift, Glue, Athena, Lambda and data/analytics tools and big data tools Spark, Python, Hive, HDFS, JASON etc.
Develop Custom Data pipeline (Cloud and locally hosted).
Provide support for the deployed ETL applications identifying data problems and guiding issue resolution with other developers and source data providers.
Communicate the architecture to designers, developers and contractors in a way that is directly actionable, clear and unambiguous
Enhance Software Development Lifecycle (SDLC) documentation to align with agile methodologies and deliver high-quality reporting solutions quickly and continuously
Qualifications:
5+ years of demonstrable experience on Business Intelligence applications in various phases of IT projects such as analysis, design, deployment, coding and testing using Talend
ETL on OLAP and OLTP environments for Financial, Manufacturing and Healthcare clients
Experience using Talend Integration Suite, Talend Open Studio for Big Data 6.2 and Talend
Big Data Enterprise Studio and using standard and custom components
Experience with Talend API components
Experience in extracting data from multiple operational sources including RDBMS tables, flat files and legacy systems for loading staging area, Data warehouse, Data Marts using SCD and CDC
Experience developing data & analytics solutions leveraging on AWS Data management technology stack S3, Kinesis, EMR, Redshift, Glue, Athena, Lambda, Cloud Watch and data/analytics tools
Experience on Big data development using Spark, Python, Hive, HDFS, JASON etc.
Extensive experience with ETL methodology, procedures, development and testing
Significant experience in development, maintenance, and enhancements of ETL Mappings, Workflows, and processes
Strong SQL programming background
Familiar with AWS ecosystem including S3 and Redshift databases.