Chandra Nikhita T.
Data Engineer | Building Scalable Data Pipelines & AI-Driven Analytics As a Data Engineer, I specialize in designing, building, and optimizing scalable ETL pipelines, real-time data processing systems.
- Role
- Data Engineer at Spotify
- Location
- Dallas, TX, US
- LinkedIn followers
- 500 followers
About Chandra Nikhita T.
I’m a Data and Software Engineer with 4+ years of experience building scalable data…
Experience
Data Engineer
Jun 2024 — Present · Dallas, TX, US
Developed a real-time ingestion pipeline using AWS Kinesis Data Streams and Kafka, processing over feedback events daily for low-latency streaming and seamless transformation into structured datasets for downstream processing.• Created dynamic ETL pipelines using PySpark and optimized SQL window functions, recursive queries, and CTEs to handle complex aggregations for time-series transformations, reducing processing time for large-scale transactional data.• Implemented batch data processing on Apache Hadoop clusters, utilizing HDFS and Hive for storage and querying, and applied Python multiprocessing for parallel processing, achieving a 30% reduction in execution time.• Integrated OpenAI\'s GPT-4 for summarizing customer feedback and contextual text classification, improving sentiment analysis accuracy and providing actionable insights for decision-makers.• Built a secure, scalable data storage and retrieval system using AWS S3, AWS Glue, Athena, and Redshift Spectrum, optimizing schema structures and reducing query latency through data partitioning techniques.• Developed optimized dashboards by leveraging Advanced SQL techniques such as materialized views, partitioned tables, and pivot queries, improving data availability and reducing query execution time for analytics stakeholders
Education
SRK Institute of Technology, Enikepadu, Vijayawada-521108(CC-X4)
Bachelor's degree
University of North Texas
Master's degree
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.