Caroline Soares

Consultant Software Engineer – Itau Unibanco

Nov 2020 – Jul 2024

Backend engineer working on the development and maintenance of a Data Platform, building end-to-end services and supporting data engineering teams through scalable backend solutions and platform tooling.

Responsibilities

Developed backend services and proof-of-concept solutions using generative AI, leveraging models for text, image, and data generation.

• Designed and developed Python-based microservices on AWS (Lambda, DynamoDB, API Gateway, Glue) supporting internal data platform services.
• Built and maintained end-to-end backend solutions, from architecture design and implementation to testing and production deployment.
• Developed services for ETL orchestration, improving response structures, logging visibility, and operational monitoring using CloudWatch.
• Contributed to the development of Data Mesh and CDP platform services, enabling automated table creation and schema validation using DynamoDB, JSON schemas, and Athena.
• Implemented observability improvements, including enhanced logging, monitoring, and debugging using CloudWatch and Splunk.
• Modeled and implemented database schemas and data structures using DynamoDB and Aurora to support platform services.
• Created and maintained technical documentation for platform architecture, APIs, microservices, and databases, publishing structured documentation using Markdown, HTML, and GitHub Pages.
• Implemented Infrastructure as Code using Terraform and CloudFormation, supporting DevOps workflows and CI/CD automation.
• Provided technical support for platform users, troubleshooting issues, debugging production systems, and contributing to knowledge base documentation.
• Participated in code reviews, unit and integration testing, and shared best practices with other engineers in an Agile development environment.

Junior Software Engineer – Itau Unibanco

Aug 2017 – Nov 2020

Data Engineer responsible for developing and maintaining data ingestion pipelines for the company’s Data Lake, supporting analytics, business intelligence, and internal product teams in one of the largest financial institutions in Brazil.

Responsibilities

• Developed and maintained data ingestion pipelines integrating multiple data sources into the enterprise Data Lake.
• Processed and integrated data from mainframe systems, distributed Windows and Unix environments, and other enterprise systems using Sqoop and internal ingestion tools.
• Implemented data ingestion and transformation processes, ensuring reliable data availability for analytics and business applications.
• Troubleshot and resolved issues in ingestion workflows, improving reliability and stability of data pipelines.
• Developed enhancements to internal data ingestion software using C, Shell Script, SQL Server, and MySQL.
• Created and maintained metadata and technical documentation for ingestion processes and production deployments.
• Collaborated with cross-functional teams across the organization to deliver data solutions supporting business initiatives.
• Worked in an Agile environment, using Jira and Confluence for project management and documentation.
• Supported onboarding and knowledge sharing with new team members.