-
Notifications
You must be signed in to change notification settings - Fork 19
/
Copy pathdev.txt
127 lines (100 loc) · 4.29 KB
/
dev.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
--- OLD
# emr info on master node
cat /mnt/var/lib/info/job-flow.json | jq
* sla, percentile
* add in linux: monit, nohup, screen, mc, vim keyboard shortcuts
* command vs event api - use paste tense to name event
* Avro **Avro** is a data serialization system
* Parquet **Parquet** is a columnar storage format that can efficiently store nested data
* Flume
* Sqoop
* Pig
* Hive
* Presto
* Crunch
* HBase
* Flink
* Ganglia **Ganglia** is a monitoring system for Hadoop
* Zeppelin
* Knox
* elastic-search
* kong
* etcd
* linux containers LXD
---
# keytool
https://www.digitalocean.com/community/tutorials/java-keytool-essentials-working-with-java-keystores#viewing-keystore-entries
https://www.digitalocean.com/community/tutorials/openssl-essentials-working-with-ssl-certificates-private-keys-and-csrs
# api
https://hackernoon.com/restful-api-designing-guidelines-the-best-practices-60e1d954e7c9
https://github.com/WhiteHouse/api-standards
https://geemus.gitbooks.io/http-api-design/content/en/
# spark-in-action
curl -O https://raw.githubusercontent.com/spark-in-action/first-edition/master/spark-in-action-box.json
vagrant box add spark-in-action-box.json
vagrant init manning/spark-in-action
vagrant up
vagrant halt
vagrant destroy
vagrant box remove manning/spark-in-action
# hadoop
https://dwbi.org/etl/bigdata/183-setup-hadoop-cluster
https://www.linode.com/docs/databases/hadoop/how-to-install-and-set-up-hadoop-cluster
https://www.linode.com/docs/databases/hadoop/install-configure-run-spark-on-top-of-hadoop-yarn-cluster
# vagrant images
https://github.com/martinprobson/vagrant-hadoop-hive-spark
# back pressure
https://mechanical-sympathy.blogspot.com/2012/05/apply-back-pressure-when-overloaded.html
# IAC infrastructure-as-code
https://blog.gruntwork.io/why-we-use-terraform-and-not-chef-puppet-ansible-saltstack-or-cloudformation-7989dad2865c
# makefile
https://diamantidis.github.io/tips/2020/07/01/list-makefile-targets
`make -pRrq`, that is a very useful command to debug your makefiles, especially in a big project. The option `-p` prints the make data-base, -R and -r removes the implicit rules and variables, and -q indicates only asking make a question about current state, avoid executing anything
# copy cd-dvd
https://unix.stackexchange.com/questions/224277/is-it-better-to-use-cat-dd-pv-or-another-procedure-to-copy-a-cd-dvd/224314#224314
# Serving up zero-knowledge proofs
https://blog.trailofbits.com/2021/02/19/serving-up-zero-knowledge-proofs
# windows
https://arstechnica.com/gadgets/2021/01/dosbox-pure-for-retroarch-aims-to-simplify-classic-ms-dos-gaming
# discord exporter
https://github.com/Tyrrrz/DiscordChatExporter
# build your own amazing illustrations
https://iradesign.io
# service mesh
https://linkerd.io
---
# torrent
https://en.m.wikibooks.org/wiki/The_World_of_Peer-to-Peer_(P2P)/Networks_and_Protocols/BitTorrent
https://github.com/arvidn/libtorrent
https://github.com/johang/btfs
https://blog.libtorrent.org/2020/09/bittorrent-v2
# Kademlia: A Design Specification
http://xlattice.sourceforge.net/components/protocol/kademlia/specs.html
https://github.com/smmr-software/mabel
# testing
https://github.com/nakabonne/ali
https://playwright.dev
# tracing
https://opentracing.io/specification
https://blog.techlanika.com/distributed-tracing-the-why-what-and-how-ab9ca9e40081
# aws dynamodb
https://github.com/aws-samples/amazon-dynamodb-labs
http://rh-web-bucket.s3.amazonaws.com/index.html
https://aws.amazon.com/blogs/database/how-to-determine-if-amazon-dynamodb-is-appropriate-for-your-needs-and-then-plan-your-migration
https://aws.amazon.com/blogs/database/amazon-dynamodb-auto-scaling-performance-and-cost-optimization-at-any-scale
https://tech.nextroll.com/blog/dev/2019/02/05/dynamodb-managed-autoscaling.html
# aws batch
https://towardsdatascience.com/get-your-own-data-building-a-scalable-web-scraper-with-aws-654feb9fdad7
# crypto/mininig
https://monokh.com/posts/bitcoin-from-scratch-part-1
https://github.com/smartcontracts/eth2-book
https://cardano.org
https://nano.org
https://www.chia.net
https://www.anchorage.com
# lambda
https://www.serverless.com
https://www.openfaas.com
https://dev.to/kumo/we-tested-the-best-serverless-monitoring-solutions-so-you-dont-have-to-121m
https://jvns.ca/blog/2021/01/23/firecracker--start-a-vm-in-less-than-a-second
https://www.talhoffman.com/2021/07/18/firecracker-internals