Sailesh Edara

Data Engineer at Bank United @BankUnited

Miami, FL, US

I spearheaded a team of data engineers, providing mentorship and technical leadership to ensure successful project deliveries. My expertise lies in both AWS and GCP environments, where I\'ve worked extensively on data formats like JSON, ORC, and Parquet, utilizing PySpark for efficient processing on HDFS. I configured real-time data ingestion from Kafka and oversaw Spark job progress, ensuring effective logging and monitoring. In AWS, I deployed machine learning models using TensorFlow Serving and Kubernetes, and orchestrated Docker containers within Kubernetes clusters for high availability and scalability. Additionally, I utilized various AWS services such as EMR, S3, Glue, Lambda, and Snowflake for data processing and storage needs. Proficient in leveraging CloverDX for orchestrating complex ETL workflows, with expertise in designing and implementing solutions to integrate diverse data sources efficiently. Skilled in crafting data transformations, mappings, and workflows within CloverDX Designer to streamline data processing tasks.On the GCP side, I leveraged tools like BigQuery, Dataflow, and Data Proc for efficient data processing. I also designed and maintained complex data workflows using Apache Airflow and optimized data transformation processes with dbt. Furthermore, I implemented comprehensive error-handling routines, automated job scheduling procedures, and designed scalable data architectures for optimal performance. My experience spans across designing migration plans, ensuring smooth transitions, and implementing reconciliation frameworks for data consistency. Overall, my hands-on experience in both AWS and GCP environments, coupled with expertise in various data engineering tools and technologies, qualifies me to tackle diverse data challenges effectively.