👋 Hey there friend!!! My name is David Dansby. Sometimes I go by DataDavd or datadavd online (a relic from data engineering days). I am a self-taught software engineer at Atlassian. I have a strong passion for distributed systems, microservices, secure data processing systems, Go, Python, and rare single-origin coffees. When time allows you can find me tinkering with one of my split mechanical keyboards. Recently, I've been getting into home automation.
💪 I’m currently working remotely at Atlassian as a Software Engineer on our Jira Align product (mostly working on the C#/.NET backend sprinkled with some frontend work in React). Previously, I worked on the Bitbucket Cloud Data Privacy and Security team as a software engineer using Go and Python with a focus on all things security and data protection. And before that, I was a data engineer on the Data Analytics and Engineering team at Atlassian that owned the core data pipelines (we typically ingested 500GB+ of data each day into our pipelines; and processed even more!!!).
💻 Outside of work I'm constantly learning and improving my skills. I like doing LeetCode, improving my knowledge of various software system designs, reading software-related books, and improving my Go knowledge.
📚 Outside of software engineering and tech, I'm learning French, snowboard with my brother and friends, and love traveling with my wife.
- v0.2.0: Add the ability for users to set what hash algorithms they want to use for digest calculation. Pull Request #292
- v0.5.2: Trivial nit change to add shothand vars to two common witness run options. Pull Request #441
- v0.48.0: Fixed bug to correctly return error when users navigate to routes downstream from
BaseURL. Pull Request #2382. - v0.54.0: Added in-app lakeFS documentation links on the Setup, Create a Repository (Modal), Branches, and Auth/Admin pages of lakeFS UI. Pull Request #2506.
- v0.62.0: Remove unused functions in tx.go. Pull Request #3128.
- v0.63.0: Fix 'Create a Repo' minimum character limit wording. Pull Request #3155.
- v0.9.21: Added Diff-Stat functionality. Pull Request #145.
- v0.9.24: Created RepositoryRefsOptions type and ListRefs method. Pull Request #155.
- v0.9.30: Update GetDiffStat functionality to filter response fields. Pull Request #171.
- Pull Request #156: This PR simplifies TagOptions and BranchOptions types into a single RefOptions type (since git tags and branches are both refs) and adds DeleteBranch and DeleteTag functionality.
- v0.23.2: Update GCP icons using the official, updated GCP icons. (see Issue #554).
- Go
- Python
- Javascript
- Backend software engineering
- Web Development and REST APIs (Django, React, Go's net/http, etc.)
- concurrent programming (goroutines, channel, select, asyncio, concurrent.futures, etc.)
- React
- batch and stream data processing (Apache Spark and Presto)
- OOP
- TTD
- Docker and Docker Compose
- Bitbucket Pipelines
- GitHub Actions
- Splunk
- SignalFX
- Sentry
- Opsgenie
- Statuspage
- statsd
- SonarQube
- AWS: SQS, Lambda, S3, EMR, EC2, SNS, aws-sdk-go, boto3, etc.
- LocalStack
- SparkSQL
- HiveSQL
- Presto
- PostgreSQL
- writing complex SQL queries, mostly SparkSQL
- building and maintaining big data pipelines AND platforms
- swimming in data lakes
- organizing data warehouses
- distributed data processing
- backend data services and APIs
- lakeFS
- Databricks
- Apache Spark
- Apache Airflow
- PyData packages
- Apache Flink (wish to use more)
- Apache Pulsar (wish to use much more; Pulsar > Kafka)
- Jira Software
- Confluence
- Jira Service Management
- Trello
- Halp
- Slack
