Sunny S.

Interacting with business people and coming up with solutions to solve business needs with the help of data which helped achieving company quarterly OKRs.

• Took responsibility and ownership for maintaining Data Pipelines (DBT) and implementing best practices for testing and writing SQL in DBT.
• Maintaining a CI pipeline in GitHub Actions to have quick feedback for data model source contributors. The pipeline runs the code quality, the written models, and data testing which ensures the data team standards, running code, and data accuracy.
• Keep a tab on existing technical debt, issues in GitHub, and stale Pull Requests, and work on a plan to knock out each of those as deemed necessary.
• Importing AWS infrastructure into Terraform (IAC) and syncing the resources in all development, staging, and production. While Importing, the unnecessary resources were removed which helped the company to save the cost.
• Support Web and API team, Platform Engineers, by creating or testing Snowpipes for ingesting organizational data in the Warehouse(Snowflake).
• Ingested various sources of data in the warehouse and prepared the data by modeling in DBT(which makes the data ready for Analytics) which valued the organization to become a self-service BI which helps to progress through phases of Data to AI Maturity Model.
• Analyze query cost in Snowflake and identified cost reduction opportunities.
• Researched best practices for optimization in performance and implemented optimization of Snowflake queries(fetching billions of rows) by implementing cluster keys which helped boost the query performance.
• Assisted migration of data pipelines existing in Xplenty to Prefect orchestration due to the lower return value compared to the cost spent. The goal of the pipelines was to fetch data from clients' REST APIs and ingest them to the organization's API endpoint and built with Python and Pandas library

• Assisted Senior Data Engineer on to build the infrastructure for the data pipeline.
• Implementation of Selenium and Python to make automated and scheduled Data Pipelines using Prefect:
  - Extract data from the Dashboard
  - Transform data according to business need
  - Load the data in S3 Bucket, and further load it into Snowflake using Fivetran.
• Researched how to automate the process of data extraction from Dashboards using Selenium and Python.
• Cohere to the development process followed by the company.
• Participate in SCRUM events like planning/feature discussion, daily stand-ups, demos, and retrospectives
• Learned ways of Data Modeling and contribute to projects using DBT.
• Learned about Data Modeling and the importance of Data Modeling for business needs.

• Learned Laravel and implemented it to make dynamic websites for clients by understanding the business requirements.
• Learned MVC
• Created static website using HTML, CSS, Javascript and PHP
• Involved in a StartUp company as Backend Developer