Sohel Syed

About Sohel Syed

Data Engineer with 7+ years of experience specializing in designing, developing, and maintaining data solutions. Expertise in cloud-based environments, big data technologies, and software development. Proven track record of delivering high-quality products and services in fast-paced, data-driven organizations. Skilled in collaborating with cross-functional teams to drive innovation and solve complex problems with a strong background in lending industries, specifically home lending. Hands-on experience in migrating data from Hadoop to Google Cloud Platform (GCP) and BigQuery. Accomplished data engineer with extensive experience in designing, developing, and maintaining data pipelines for Adobe CDP, leveraging advanced technologies such as Snowflake for efficient data storage and analysis. Extensive experience in designing both Front end & Backend applications using Java, J2EE Web frameworks, JSP, JSTL, HTML, CSS, Angular 2 and Angular4, AJAX, JavaScript, jQuery, Bootstrap. Extensive experience in various Java/J2EE technologies including Core Java, J2EE, Servlets, JSP, JDBC, Struts, spring and hibernate. Extensive Experience working with spring, Struts, JSF and O/R mapping Hibernate frameworks. Advance knowledge of NoSQL, SQL Queries using Hibernate framework with Spring ORM in interaction with the Relational Database Management System (RDBMS). Worked with Apache Solr to implement indexing and wrote Custom SOLR query segments to optimize the search. Developed a knowledge object using Python and R to calculate the life expectancy of pancreatic cancer patients. Expertise in working with Apache Solr for indexing and load balanced querying to search for specific data in larger datasets. Worked on Ad-hoc queries, Indexing, Replication, Load balancing, and Aggregation in MongoDB. Processed the Web server logs by developing multi-hop flume agents by using Avro Sink, loaded into MongoDB for further analysis, extracted files from MongoDB through Flume, and processed. Expertise on MongoDB NoSQL data modeling, tuning, and disaster recovery backup used it for distributed storage and processing using CRUD. Used OOZIE Operational Services for batch processing and scheduling workflows dynamically. Used Zookeeper to coordinate the servers in clusters and to maintain the data consistency. Used Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API. Good experience in CI/CD pipeline management through Jenkins. Automation of manual tasks using Shell scripting.

Experience

1. Adobe Cdp Data Engineer

   CVS Health

   Aug 2023 — Present · Chicago, IL, US

   Designed, developed, and maintained data pipelines for Adobe CDP, ensuring efficient data flow. Leveraged Snowflake as a central data warehousing solution for Adobe CDP, ensuring efficient storage and retrieval of customer data. Collaborate with cross-functional teams to understand data requirements and implement solutions. Designed and developed data pipelines within Snowflake to streamline the flow of data from various sources into Adobe CDP, facilitating seamless integration and analysis. Utilized Adobe CDP tools to integrate, transform, and clean data for analytical purposes. Proficient in Adobe CDP and associated tools for customer data management. Strong knowledge of data engineering concepts, ETL processes, and data modeling. Collaborated with stakeholders to understand Snowflake data requirements and implement tailored solutions to meet business needs effectively. Implemented and adhere to data governance policies to ensure data quality and compliance. Conducted thorough testing of data pipelines to guarantee accuracy and reliability. Utilized Snowflake\'s advanced features for data integration, transformation, and cleansing to prepare high-quality data for analytical purposes within Adobe CDP. Participated in regular reviews and retrospectives to identify areas for process improvement.Environment:Tools: Adobe Real-Time CDP, Adobe Journey Optimizer, Adobe Audience Manager, Snowflake.Concepts: XDM Schemas, Unified Customer Profile, Real-time Data Ingestion, Customer Segmentation, Cross-Channel Orchestration, Data Governance, Integration with Adobe Experience Cloud

Education

• Trine University

  Master's degree, Business Analytics

• Osmania University

  Bachelor's degree, Computer Science