Adarsh K

About Adarsh K

I am a highly motivated IT professional with over 10 years of experience in the software industry, specializing in Data Engineering. I possess a strong background in designing, building, and maintaining ETL jobs and data pipelines, integrating data from diverse sources such as Kafka, S3, SFTP servers, and various data stores like HBase, Hive, DynamoDB, and Athena.With hands-on experience across the Hadoop ecosystem, I have worked extensively with Big Data technologies including HDFS, MapReduce, YARN, Apache Cassandra, HBase, Hive, Oozie, Impala, Pig, Zookeeper, Flume, Kafka, and Spark. I also migrated an on-premises application to AWS, utilizing services like EC2, S3, and EMR for processing and storage, and have hands-on experience with Amazon RDS, Auto Scaling, CloudWatch, and Redshift, among other AWS services.I have a deep understanding of data manipulation using Python, leveraging libraries such as NumPy, SciPy, and Pandas for data analysis and numerical computations. My work with Spark, using both Python and Scala, includes performing advanced analytical applications on top of Hadoop, as well as integrating with SQL/Oracle/Snowflake databases. I am proficient in data mining, data preprocessing, machine learning, and analyzing large datasets using Python, T-SQL, Power BI, and Tableau.My expertise extends to Enterprise Data Warehousing systems, Dimensional Modeling (Facts, Dimensions, Star and Snowflake Schemas), and OLAP Cubes, as well as executing OLAP operations like slicing, dicing, roll-up, and drill-down. I have extensive experience using tools like Excel, Minitab, Python, R, Tableau, and Qlik Sense to generate visualizations such as density charts, tree maps, choropleth maps, and animations.I am proficient in ETL tools and packages, applying control flow and data flow tasks with various transformations like Conditional Split, Data Conversion, and Lookup. My extensive knowledge of AWS includes services like Glue, Athena, Kinesis, Redshift, DynamoDB, CloudFormation, CodePipeline, and IAM, and I have developed Spark applications for both batch and stream processing using PySpark, Scala, and Java.I am a quick learner, known for my sharp analytical thinking, logical approach, and enthusiasm for tackling new challenges in technology, business domains, and processes.

Experience

1. Senior Big Data Engineer

   Qualcomm

   Jan 2023 — Present · San Diego, CA, US