●Engineered an ETL pipeline to automate data extraction from S3 and load it into Athena via AWS Glue, seamlessly integrating with Tableau for reporting.
● Leveraged PySpark within AWS Glue for complex data transformations, optimizing data workflows by 40%.
● Automated manual data loads using Python Lambda functions and adapted stored procedures, reducing manual intervention and saving 9 hours per sprint (15 days).
● Developed and deployed AWS Lambda functions to retrieve API data, transform it into the required format, and load it into Redshift, ensuring a 30% reduction in data processing time.
● Developed, tested, and deployed codes maintaining versions, to build the CI/CD practices for client's requirements using Jenkins, REDSHIFT, Git, AWS and JIRA both in development and production environments.
● Worked on staging, transforming, and loading 25 GB of structured and semi-structured data from heterogeneous sources into the Redshift data warehouse
● Developed a web application, “VerifyIt”, to check the authenticity of tweets using the BERT model and detect super-spreaders through influence scores.
● Built an interactive user interface with React components and integrated it with the model using Flask hosted in Google Colab.
● The model was implemented in Python, leveraging libraries such as NumPy, Pandas, and NLP, making it highly relevant in the current online scenario
Advanced algorithms, web mapping, technologies for e-commerce, privacy security, and data science and also worked on group projects like fake news detection
C programming, Data Structures, JAVA, Data analytics, Object-Oriented Programming, operating systems, computer networks, Compiler Design, Linux Programming
