Jyoti
Sr. Data Engineer seeking contract roles actively.
- Role
- Sr Data Engineer at BlackRock
- Location
- Fremont, CA, US
- LinkedIn followers
- 500 followers
About Jyoti
IT professional with experience in Analysis, Design, Development, Management, data…
Experience
Sr Data Engineer
Jul 2021 — Present · New York, NY, US
Involved in development of Python based Web Services using REST for sending and getting data from the external interface in the JSON format and perform analysis using Django, PostgreSQL. Primary focus is on ETL, data migration, Python, and AWS.• Worked with several R packages including knit, dplyr, Spark, R, Causal Infer, Space-Time. Used various techniques using R data structures to get the data in right format to be analyzed which is later used by other internal applications to calculate the thresholds.• Championed in building and maintaining multi-zone AWS cloud infrastructure utilizing Chef with AWS Cloud Formation and Jenkins for continuous integration. Engineered a Full-Service Catalog System which has a full workflow using Elastic search, Log stash, Kibana, Kinesis, and Cloud Watch. • Responsible for PostgreSQL Installation, Configuration, Migration, Upgrades and Patches. Also involved in Application monitoring in integration with AWS Lambda and Cloud Watch.• Involved in debugging the applications monitored on JIRA using agile methodology. Develop ETL Process using SPARK, SCALA, HIVE and HBASE. modeling guidelines and Data Warehouse Strategy. Involved in Smoke Testing, Functional testing and Regression cycles for the entire application.• Used the Snowflake Connector to perform standard Snowflake operations such as user login, database and table creation, warehouse creation, data insertion/loading, and querying. Utilized Kubernetes and Docker for the runtime environment of the CI/CD system to build, test and Octopus Deploy.• Worked on AWS services (S3, EC2) and deployment services (Lambda) and RDS, Dynamo DB (NoSQL), Beanstalk, SQS and Jenkins CI/CD. Modify PostgreSQL database functions for better performance and structure and developed procedure to create Postgres instance on AWS EC2 server.
Education
University Institute of Technology, RGPV
Bachelor's degree
Campbellsville University
Master's degree
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.