Data and analytics engineer based in Southern California 🏖🍊
Email / LinkedIn / GitHub / Twitter / Mastodon / Blog
Analytics Engineer @ Palmetto Solar, LLC (June 2021 - Dec 2022)
Solar energy marketplace serving the full 360 degrees solar industry from supply sourcing to fulfillment and installation.
- Designed the enterprise data warehouse data model including entity relationship diagrams and buss matrix
- Created the enterprise logical data model and bus matrix representing Palmetto’s core data warehouse
- Developed over 200 dbt models (SQL) that transform, conform, normalize, and synthesize data from relational and semi-structured sources into reporting-ready tables
- Mentored junior analysts and analytics engineers in SQL design patterns, test driven development, and inferential thinking through regular coaching sessions, code reviews, and pair programming
- Designed automated CI/CD workflows that enforce code best practices, test validity and pipeline integrity and reduced pre-release builds from 18 minutes (and growing) to 2-5 minutes
- Optimized the enterprise ETL ingestion processes in Fivetran, Stitch, and Static IO, reducing monthly replication row usage by 75%
- Led the transition of all team infrastructure into Terraform managed resources, including Snowflake, Airflow, and cloud compute infrastructure in GCP
- Co-authored palm-cli, an open source CLI tool, and accompanying plugin palm-dbt in Python, and used them to automate and standardize aspects of the data pipeline and analytics development workflows
- Technologies used: dbt, Python, Snowflake, Google Cloud Platform, Looker/LookML, Terraform, Docker, Airflow, Fivetran, Stitch, REST API.
Data Engineer @ Viasat (Oct 2019 - June 2021)
Satellite internet provider.
- Developed Fact and Type II Slowly Changing Dimension models from behavioral event stream data from each of Viasat’s user-facing products in dbt and Redshift.
- Reduced compute time and resource usage of business metrics by 80% by migrating manually-run legacy data modeling scripts to dbt models run on a Kubernetes cluster with Luigi orchestration.
- Created Kafka stream consumer and producer applications for enrichment and processing of event streams data.
- Technologies used: Python, Spark, Kafka, dbt, Snowplow, Amplitude, Grafana, Ansible, Amazon Redshift, AWS.
Program Manager @ UC Berkeley Data Sciences Division (June 2017 - Oct 2019)
The academic division for all things data, computing, and multi-disciplinary collaboration.
Data Scholars Program:
- Organized the curriculum, scheduling, staffing, and participant recruitment for the Data Scholars program,
with emphasis in each on increasing equity of access to resources and rates of success in the field of Data
Science among students from under-represented and under-served groups.
Data Science Major/Minor: - Orchestrated the development of the new Data Science Major and Minor programs including prerequisite and completion requirements, interdepartmental policies and procedures, and inception of the student advising program.
- Acted as the first Academic Advisor, providing course selection recommendations and overseeing the completion of
requirements for 200+ students in the first year of the program.
This section only accounts for work done while pursuing my undergraduate degree.
Student Teaching Assistant @ UC Berkeley EECS Department (Aug 2016 - May 2017)
Foundations of Data Science Course
- Acted as Head Tutor, overseeing course tutors' group assignments, training, and materials development projects.
- Instructed ~25 students weekly in the foundations of programming and statistical analysis.
Software Engineering Intern @ US Department of Defense (Summers 2015, 2016)
- Summer 2015: Developed a machine learning model (SVM) to predict the locations of dropped pronouns in informal Portuguese text.
- Summer 2016: Contributed several core components of mission-critical software applications, focusing on scalability and performance.
Student Software Engineer @ Neurobehavioral Systems, Inc (Aug 2015 - May 2016)
- Developed a program that transformed structured XML data into formatted, hyperlinked, and indexed user documentation
for the company's proprietary programming language.
-
Coalesce 2022 Analytics Engineering Conference (Oct 19, 2022)
🎥 Testing: Our Assertions vs. Reality -
JupyterCon 2018 Conference for advancing the Jupyter ecosystem. (Aug 22, 2018)
🎥 JupyterHub for integrated learning modules
💖 Check out my site for more information.
Data Modeling for the Modern Warehouse Course
CoRise - (Completed Dec 2022)
Bachelor of Arts in Computer Science
University of California, Berkeley - Berkeley, CAlifornia, USA (2013 - 2017)
🇺🇸 English: Native
🇵🇹 Portuguese: Proficient