Data Engineer · São Paulo, Brazil
Daniel
Alves de
Camargo
Building scalable data pipelines, AI-ready data layers, and intelligent integrations. Currently at Skyone, turning raw data into Gold.
About
Data Engineer focused on AI-ready infrastructure.
Junior Data Engineer at Skyone Solutions. I specialize in building ETL pipelines and Data LakeHouse architectures using Python, PySpark, SQL, Databricks, and Azure. Beyond traditional data engineering, I integrate AI agents and LLM APIs into data workflows to drive automation and intelligence. With a strong background in Linux server management and infrastructure, I build efficient, scalable data layers that bridge the gap between raw data and production-ready AI models.
Currently studying for the Databricks Data Engineer Associate certification and pursuing a degree in Systems Analysis & Development at FATEC-SP (2023–2027).
Experience
Junior Data Engineer
- Develop and maintain scalable data pipelines targeting Gold-layer consumption by AI models and agents
- Implement contextual search skills and direct LLM integration into the Data Warehouse (MCP)
- Build REST APIs with FastAPI and Python to serve AI models and automation solutions
- Automate data flow integrations using Python, SQL, DuckDB, and JSONata
Data Engineering Intern
- Built data ingestion pipelines into a Data LakeHouse with Parquet validation and export
- Modeled and manipulated data in DuckDB, JSON, Parquet, and CSV formats for AI Agent Gold layers
- Created automated flows in Skyone Studio using REST/SOAP APIs
- Automated data transformations with JSONata; gathered business requirements and rules
E-commerce Assistant
- Automated financial reports in Excel VBA, reducing preparation time by 40%
- Created optimization scripts and macros, increasing team productivity by 30%
Skills
Tech stack
Projects
Selected work
CoinGecko → PostgreSQL Pipeline
ETL pipeline ingesting live cryptocurrency market data from the CoinGecko API into a PostgreSQL database. Automated scheduling, data validation, and structured storage for analysis.
SmartLift.AI
Mobile app combining real-time video analysis, AI-powered workout coaching, and social features. A personal side project exploring applied AI in fitness.
Low Code Podcast
Guest on the Low Code podcast by Skyone. We talked about data engineering, low-code platforms, and where AI fits into all of it.