I am working as Data Engineer at PayPay Corporation and managing entire data lake and data warehouse ingestion pipeline from variety of source databases to datalake (Apache Hudi) in S3 using Apache Spark + Scala.
I was working as a backend developer and leading a team at Info Edge (India) Limited, currently working on Spring Boot java framework for developing various micro-services using sharded databases architecture of MySql as well as in MongoDB for backend application. Our micro-services are deployed on dockerized containers with Kubernetes. Thus I have a thorough knowledge of Docker and Kubernetes deployment process including Jenkins pipeline for automation. I am also working on changing the PHP backend monolithic codebase to java micro-services. We are building India's leading platform which is being used by millions of users daily. Naukri is ranked as the number one job portal in India and Arabian countries.
FOR FUN - Solving the questionnaires on Stackoverflow various group like Mathematics, Ubuntu, Data Science, Cross Validation.