block_1_session_2_big_picture.qmd

---
title: "Hacking for Science"
subtitle: "Block 1, Session 2: The Big Picture"
author: "Matt Bannert ([@whatsgoodio](https://twitter.com/whatsgoodio))"
format: 
    revealjs:
        logo: img/h4sci-logo.png
chalkboard: true
footer: "Hacking for Science by Dr. Matthias Bannert is licensed under [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/?ref=chooser-v1)"
---


## {.center}


<div>
<a href="https://aws.amazon.com/"><img src="logos/aws.png" width = "80px"></a>
<a href="https://azure.microsoft.com/en-us/"><img src="logos/azure.png" width = "80px"></a> <a href="https://d3js.org"><img src="logos/d3.png" width = "80px"></a><a href="https://docker.com"><img src="logos/docker.png" width = "80px"></a> <img src="logos/git.png" width = "80px"> <img src="logos/github.png" width = "80px"> <img src="logos/hadoop.png" width = "80px"><a href="https://highcharts.com"><img src="logos/highcharts.png" width = "80px"></a> <img src="logos/julia.png" width = "80px"> <img src="logos/matlab.png" width = "80px"> <img src="logos/mongodb.png" width = "80px"> <img src="logos/pandas.png" width = "80px"> <img src="logos/postgresql.png" width = "80px"> <img src="logos/python.png" width = "80px"> <img src="logos/rstats.png" width = "80px"> <img src="logos/rstudio.png" width = "80px"></div>



## How to Compose the Right Toolbox? {.center}

[![](img/picktools.jpg)](https://rse-book.github.io/stack-developer-toolkit.html "Choose Your Tools"){fig-align="center"}



## {.center}

Book Chapter: [Stack - A Developer's Toolkit](https://rse-book.github.io/stack-developer-toolkit.html)




## Editors and IDEs 

<style>
.small{
font-size:.5em;
}
.smaller{
font-size:.7em;
}

</style>

![](img/wizardry.jpg){fig-align="center" height="400"}


::: {.small} 
People: "Oh, you're such a wizard." 
Me: "No, just a carpenter." 

**IDEs**: [VS Code](https://code.visualstudio.com/blogs/2017/11/15/live-share),
R Studio, pyCharm  **Text Editors**: Atom, [Sublime](https://www.sublimetext.com/), Notepad++, Text Wrangler
:::


## Programming Languages:<br> Compiled vs. Interpreted {.center}


## Version Control

:::: {.columns}

::: {.column width="40%"}

Git is NOT GitHub

Git is NOT GitHub

Git is NOT GitHub

Git is NOT GitHub

Git is NOT GitHub

:::

::: {.column width="60%" .smaller}

**Version Control Systems**

- **git**
- SVN
- CVS
- mercurial

**Git Platforms (git + web GUI + PM tools)**

- GitHub
- GitLab
- Bitbucket

[gitea](https://gitea.io/en-us/) is a self-hosted service (run a platform on your own server).

:::


::::


## Data Management


:::: {.columns .smaller}

::: {.column width="60%"}

**Relational Database<br> Management Systems (RDBMS)**

- Oracle
- Microsoft SQL Server
- PostgreSQL
- MySQL 
- SQLite
- ...

:::

::: {.column width="40%" }

**Non-Relational Databases**

- MongoDB
- Redis
- Redshift
- ...


:::


::::


## Infrastructure:<br> On Premise, SaaS, Cloud {.center}


## Automation

:::: {.columns .smaller}

::: {.column width="40%"}

**Process Automation**

- Cronjobs
- Apache Airflow

**Release Automation**

- Gitlab CI
- GitHub Actions
- Drone

**Infrastructure Automation**

- Terraform
- Ansible
- Helm



:::

::: {.column width="60%" }

![](img/colored_factory.jpg)

:::


::::


## Communication, Community & Resources {.smaller}

- [community groups](https://benubah.github.io/r-community-explorer/index.html): RLadies, WhyR, MiR, Forwards, AfricaR, the carpentries, local R user groups
- mailing lists
- Slack (RSE, Zurich R User Group), Discord, matrix
- Documentation, Content Aggregators, e.g., [CTV](https://cran.r-project.org/web/views/), [Python Graph Gallery](https://python-graph-gallery.com/)
- [big book of R](https://www.bigbookofr.com/)
- [Stackoverflow.com](https://stackoverflow.com/questions/15376075/cluster-analysis-in-r-determine-the-optimal-number-of-clusters/36729465#36729465)


## Publishing {.center}



## {.center}

> "Premature optimization is the root of all evil."

-- Donald Knuth