Thanishq K.

Experience

1. Data Engineer

   Homesite Insurance

   Mar 2024 — Present · Boston, MA, US

   Designed and implemented data pipelines using Apache Beam for financial analytics.• Configured Scala-based SBT tools for high-performance data processing.• Managed AWS Redshift to optimize query performance and storage efficiency.• Set up AWS Data Pipeline for automated data movement and transformation.• Leveraged AWS EMR for improved data processing speeds and scalability.• Developed ETL processes with AWS Glue for simplified data integration.• Utilized Apache Spark for large-scale data processing and faster analytics.• Employed Kubernetes for scalable and reliable deployment of containerized applications.• Managed data storage and retrieval with DynamoDB for enhanced performance.• Integrated TensorFlow to deploy advanced machine learning models for predictive analytics.• Configured AWS Lake Formation for secure management of data lakes and improved searchability.• Implemented CI/CD practices using GIT for enhanced development efficiency.• Used Agile methodologies for adaptable management of data engineering projects.• Employed SQL for database management, data manipulation, and reporting.• Orchestrated data migrations and transformations with AWS Data Pipeline.• Enhanced data security and governance with AWS Lake Formation.• Developed scalable data ingestion solutions with Apache Kafka for real-time data streaming.• Automated data workflows with Apache Airflow for improved scheduling and management.• Utilized Python for scripting data processing tasks and enhancing automation.• Managed version control and source code with GIT for consistency and collaboration.• Leveraged Scala for backend data processing scripts to improve performance.• Implemented data analytics and processing workflows with AWS Glue to reduce complexity.• Applied agile project management techniques for improved project tracking and outcomes.

Education

• KL University

  B.Tech