Senior Manager Data Engineering Walmart Global Tech | Sumit | Frisco, Texas, United States
•Managing and leading large cross functional Software Engineers team, building scalable, highly-available, enterprise-grade data flows for People domain and accountable for the highest levels of service performance for the data flows and Design Extract, Transform and Load ( ETL) Architecture of large data warehousing system to extract/transformation or data conversion from source systems to target applications using Agile SDLC •Prepare Roadmap and Goals across teams to meet Business objectives and publish accomplishments, Leading and inspiring teams while effectively prioritizing work and maintaining a strong customer focus to create business value while putting processes in-place to ensure successful outcomes. •Partner with product stakeholders to scope requirements, negotiate timelines, deliver viable technology solutions and finding ways to deliver incremental value while solving tactical problems strategically. •Developing, optimizing, delivering Enterprise level data pipelines, data lake frameworks and analytical solutions using private and public Cloud of Google, AWS and using Python, Java, Scala, Pyspark, Apache SPARK, Big Data, Kubernetes, Kafka, IBM Messaging Queue, Informatica ETL, Abinitio, Alteryx, Control-M,Autosys, Jules/ Jenkins (CI/CD pipelines to support Devops Model), SVN, Erwin, Unix Scripts, distributed storage like AWS S3, Cloudera Hadoop. •Designing and Developing Data Consumption patterns, Designing Data Models using Erwin to load data into the AWS S3, AWS Redshift, AWS Athena, AWS Presto, Exadata, DB2, IBM MQ, Apache Kafka, Oracle Databse, SQL Server, MySQL, PostgreSQL,XML/XSD, Mainframe, Cassandra, Sybase, Teradata, Greenplum, Hive, Hadoop and building using other AWS public cloud offerings such as Amazon S3 data lake, Redshift, EC2, Auto Scaling Group, Glue ETL, Kinesis,Snowflake,,SQS/SNS,Cloud watch, Service Catalog, Terraform and IAM Roles/Policies for fine grain access control and developing Enterprising reporting solutions using Tableau, Cognos. •Application development with focus on Infrastructure, High Availability, Resiliency disaster recovery procedures, Performance and Audit and responsible for Tech refresh planning and implementation of End of Life ( EOL) and End of Services ( EOS) products & define SLA/SLO of datasets. •Forecasting compute and storage infrastructure capacity and product deliver effort estimation to plan annual budget. •Providing technical training, coaching & supervising large and small teams, mentoring data engineers to achieve business results, strong stakeholder management ability.
