Siddarth Needugunde
Data Analytics Engineer @ Paramount | Data Analysis | 3X Databricks certified | 2X AWS certified | 1X Azure certified
- Role
- Data Analytics Engineer at Paramount
- Location
- Chicago, IL, US
- LinkedIn followers
- 500 followers
About Siddarth Needugunde
Data & AI Engineer | Data Analysis | Gen AI & ML Enthusiast | Big Data | Cloud…
Experience
Data Analytics Engineer
Jul 2023 — Present · US
Utilized Spark RDD, DataFrame API, Dataset API, Spark SQL, and Spark Streaming to develop scalable data processing solutions.• Built a centralized Data Lake on AWS using S3, EMR, Redshift, and Glue to manage media metadata, viewership metrics, and audience insights.• Developed Spark applications in Python to process data from relational databases and streaming sources.• Optimized PySpark scripts for efficient processing of media asset data and analytics.• Leveraged Python libraries like NumPy, SciPy, and Pandas for data manipulation and analysis.• Configured Apache Airflow DAGs to orchestrate data workflows between S3 and Snowflake.• Created Lambda functions for schema structuring, data validation, and ingestion into PostgreSQL.• Designed ETL pipelines in AWS Glue to process data from S3 and load it into Redshift.• Built scalable Spark applications in Databricks using Spark SQL for actionable data insights.• Configured Snowpipe to enable real-time data ingestion from S3 into Snowflake.• Implemented Snowflake Schema and Star Schema with Type II SCDs for Data Mart maintenance.• Monitored AWS resources using CloudWatch, CloudTrail, and SNS with automated performance alerts.• Developed Python scripts with Boto3 for ETL operations in AWS services like S3.• Modeled and managed column families in DynamoDB for efficient data retrieval.• Processed partitioned data using Spark SQL and Parquet for enhanced performance.• Built data pipelines to load consumer response data into S3, supporting Tableau dashboards.• Designed Tableau dashboards to deliver insights on key performance indicators.• Used PowerShell and CI/CD tools like Jenkins for end-to-end automation.
Education
University of Central Missouri
Master of Science - MS
2023 — 2024
VNR Vignanajyothi Institute of Engineering & Technology
Bachelor of Technology - BTech
2017 — 2021
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.