Rama Krishna
Data Integration Expert: Orchestrating Seamless Data Flow with ETL/ELT and Big Data Technologies
- Role
- Data Engineer at UPS
- Location
- North Brunswick, NJ, US
- LinkedIn followers
- 500 followers
Experience
Data Engineer
Feb 2022 — Present · GA, US
Throughout my career, I have gained expertise in data integration using traditional ETL/ELT tools and Big Data technologies. I review requirements, create mappings for data loading into Oracle Data Mart and Enterprise Data Warehouse systems, and ensure high-quality data through analysis, profiling, and testing. I focus on reusability by creating reusable transformations and mapplets, streamlining development processes.I design efficient ETL processes using AWS Lake Formation and Amazon S3 to handle large volumes of structured and unstructured data. Security measures and access controls are implemented using AWS IAM and KMS. I also have experience in developing machine learning models with Amazon SageMaker.Leveraging Databricks and Azure Data Factory, I manage extensive data sets, perform ETL operations with JDBC connectors, and automate tasks using Python, Shell scripting, and XML. I develop multithreaded applications in Python, PHP, and C++ for circuit parameter visualization and performance monitoring.Integration with data analytics tools is another area of expertise. I integrate Snowflake with Tableau, Power BI, and Looker, implementing security features and optimizing query performance with virtual warehouses, automatic scaling, and multi-cluster architecture. Advanced techniques like Partitioning, Dynamic Partitions, and Buckets in HIVE are applied.In the Hadoop ecosystem, I develop scripts and batch jobs, proficient in MapReduce, Hive, Sqoop, and other components. I facilitate seamless data movement between HDFS and RDBMS using SQOOP and proactively monitor system health and logs.I align with industry practices and deliver value, utilizing tools such as ETL Informatica, Oracle, Teradata, Azure, Python, Pyspark, Hadoop, Hive, Linux, Sqoop, and SQL. My proficiency and contributions make me a valuable asset in successful data integration projects.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.