Full Code of jhuangtw/xg2xg for AI

master a3551517e8b1 cached
5 files
35.3 KB
9.8k tokens
1 requests
Download .txt
Repository: jhuangtw/xg2xg
Branch: master
Commit: a3551517e8b1
Files: 5
Total size: 35.3 KB

Directory structure:
gitextract_lbxykc9g/

├── APIs.md
├── DATA_INFRA.md
├── EM.md
├── ENG_PRACTICES.md
└── README.md

================================================
FILE CONTENTS
================================================

================================================
FILE: APIs.md
================================================
| internal | external |
| -------- | -------- |
| image charts | https://www.image-charts.com/ |


================================================
FILE: DATA_INFRA.md
================================================
### Reading
- [Machine Learning: The High Interest Credit Card of Technical Debt](https://ai.google/research/pubs/pub43146)
- [The Care & Feeding of Data Scientists](https://oreilly-ds-report.s3.amazonaws.com/Care_and_Feeding_of_Data_Scientists.pdf)
- [Designing Data-Intensive Applications](https://www.amazon.com/Designing-Data-Intensive-Applications-Reliable-Maintainable/dp/1449373321)
- [Storytelling with Data: A Data Visualization Guide for Business Professionals](https://www.amazon.com/Storytelling-Data-Visualization-Business-Professionals/dp/1119002257)

### Distributed Frameworks
- spark
- https://github.com/ray-project/ray
- https://dask.org/

### Warehouse
- redshift
- snowflake
- bigquery
- vertica

### Data Lake
- databricks delta
- https://github.com/apache/iceberg
- https://github.com/apache/hudi
- https://www.dremio.com/

### Change data capture / streaming
- https://www.attunity.com/
- https://streamsets.com/
- https://github.com/debezium/debezium

### data versioning
- https://projectnessie.org/

### OLAP
- https://pinot.apache.org/
- https://kylin.apache.org/

### Streaming
- kafka
- flink
- beam

### real-time/document-search
- elasticsearch
- rockset

### Notebooks / exploration
- jupyter
- https://zeppelin.apache.org/
- https://github.com/ironmussa/Optimus
- https://colab.research.google.com/
- https://www.saturncloud.io/
- https://rmarkdown.rstudio.com/
- https://www.querybook.org/
- https://deepnote.com/
- https://cnvrg.io/
- dominodatalab

### Labeling
- https://www.snorkel.org/
- https://www.figure-eight.com/
- https://scale.ai
- https://www.labelbox.com

### Notebook management
- https://github.com/nteract/papermill

### Orchestration
- airflow
- luigi
- oozie
- https://github.com/dagster-io/dagster
- https://github.com/PrefectHQ/prefect
- https://www.getdbt.com/product/

### Dataflow/transformation managers
- streamset
- nifi

### unstructured/semi-structured data prep
- https://www.trifacta.com/

### Solutions
- snowplow
- https://www.prefect.io/
- https://www.ascend.io/
- https://www.datmo.com/
- TFX-OSS

### data quality monitoring
- https://www.anomalo.com/
- https://github.com/awslabs/deequ

### anomaly detection as a service
- https://www.anodot.com/

### event data
- segment
- Rudderstack
- Metarouter
- snowplow

### A/B testing
- https://www.optimizely.com/
- https://www.abtasty.com/
- https://github.com/YahooArchive/mendel

### Behavioral analytics
- https://www.fullstory.com/
- https://www.hotjar.com/

### Feature flagging
- https://launchdarkly.com/
- https://www.split.io/
- https://github.com/checkr/flagr

### Authorization
- https://www.osohq.com/
### Catalogue / metadata
- https://github.com/airbnb/knowledge-repo
- https://github.com/lyft/amundsen
- https://eng.uber.com/databook/
- https://medium.com/netflix-techblog/metacat-making-big-data-discoverable-and-meaningful-at-netflix-56fb36a53520
- https://cloud.google.com/data-catalog/
- https://github.com/linkedin/datahub
- [airbnb: democratizing data](https://medium.com/airbnb-engineering/democratizing-data-at-airbnb-852d76c51770), [airbnb: scaling knowledge](https://medium.com/airbnb-engineering/scaling-knowledge-at-airbnb-875d73eff091)

### BI
- [superset](https://superset.incubator.apache.org/)
- looker
- periscope

### etl / ingestion-as-a-service
- fivetran
- singer.io
- talend
- https://github.com/airbytehq/airbyte
- https://github.com/linkedin/brooklin

### reverse-etl: piping data around for salesOps/marketingOps/CRM etc
- https://tray.io/
- https://www.snaplogic.com/
- https://www.polytomic.com/
- https://www.getcensus.com/

### Sales analytics
- https://www.chorus.ai/
- https://www.gong.io/

### timeseries forecasting
- https://github.com/linkedin/greykite

### Neat utils
- query CSVs w/ SQL: [cq](https://github.com/jolmg/cq)
- jq

### Generating fake data
- https://github.com/lk-geimfari/mimesis

### privacy / compliance
- https://www.datagrail.io/
- immuta
- privacera
- ethyca
- osano


================================================
FILE: EM.md
================================================
## Engineering Management

### People

#### understanding self/team
- [Myers-Briggs](https://en.wikipedia.org/wiki/Myers%E2%80%93Briggs_Type_Indicator)
- https://www.jocrf.org/
- [StrengthsFinder](https://www.amazon.com/StrengthsFinder-2-0-Tom-Rath/dp/159562015X)
- DISC assessment
- [Adjective Check List](https://en.wikipedia.org/wiki/Adjective_Check_List)
- [Enneagram](https://www.integrative9.com/)
- [Standout](https://www.tmbc.com/standout-2-0-assessment/)

- [the muppet theory](https://www.theatlantic.com/culture/archive/2012/06/muppet-theory-explains-humanity/327133/)
- [Neil on Software](https://neilonsoftware.com/highly-effective-software-developers/)

#### career convo
- https://www.radicalcandor.com/blog/problem-career-conversations/
- https://firstround.com/review/three-powerful-conversations-managers-must-have-to-develop-their-people/
- https://www.cultureamp.com/blog/letting-go-of-our-best-employees/
- https://hbr.org/amp/2013/06/tours-of-duty-the-new-employer-employee-compact
- ikigai
- https://staffeng.com/
- https://www.amazon.jobs/en/landing_pages/pe-community-tenets
- https://www.progression.fyi/

#### team health
- https://www.atlassian.com/team-playbook/health-monitor

#### code health
- https://github.com/boyter/scc

#### retention
- stay interview

#### communication
- [how to say no](https://www.starterstory.com/how-to-say-no)

#### on-demand mentors/coaching
- (technical) https://www.codementor.io/
- (EM-specific) https://www.platohq.com/
- https://www.workbravely.com/
- https://www.betterup.com/
- (exec) https://athenaalliance.com/

#### hiring
- https://stripe.com/guides/atlas/scaling-eng
- [[CloserIQ] Sales Interview Grading Template : Sample](https://docs.google.com/document/d/1iPw2p90HbEciKpt84JSVwefFnYtkN_W3X9SVV6FtvCg/edit)
- [Google’s sample structured interview grading rubric](https://docs.google.com/spreadsheets/d/17U5XuQgM1v52niQU-LBrk2j4qaQhcnziuUBCYTA2fMo/pubhtml)
- https://medium.engineering/engineering-interviews-grading-rubric-8b409bec021f
- https://hbr.org/2016/02/a-scorecard-for-making-better-hiring-decisions

##### hiring distributed teams / contract eng
- https://remotive.io/remote-companies
- https://terminal.io/
- https://pilot.co/
- https://arc.dev/
- https://worca.io/
- https://turing.com/
- https://www.letsdeel.com/
- https://www.boundlesshq.com/
- https://meet.jobs/
- https://github.com/lukasz-madon/awesome-remote-job
- https://www.10xmanagement.com/
- https://www.facetdev.com/
- https://www.toptal.com/
- https://x-team.com/
- https://symphony.is/

##### hiring/assessment/interviewing-as-a-service
- https://karat.com/
- https://hired.com/
- https://interviewing.io/
- https://codesignal.com/
- https://www.qualified.io/

##### sourcing
- https://www.traitly.com/
- https://www.dover.io/

##### hiring from referrals
- https://www.teamable.com/

##### d&i
- https://gaingels.com/
- https://www.devcolor.org/
- http://www.code2040.org/
- https://www.colorstack.org/
- https://www.womenwhocode.com/
- https://www.nextplaycommunity.com/
- https://techqueria.org/
- https://girlgeek.io/
- https://www.diversifytech.co/
- https://afrotech.com/
- https://www.devinclusiongiveaways.com/
- https://iamremarkable.withgoogle.com/

##### recruiting
- https://www.bincsearch.com/
- security focused: https://coderedpartners.com/

##### executive recruiting
- https://rivierapartners.com/
- https://www.daversapartners.com/

##### layoff lists
- https://layoffs.fyi/
- https://www.layoffs.tech/
- https://www.onesoftlanding.com/
- https://candor.co/layoff-list/

##### leveling
- https://dropbox.github.io/dbx-career-framework/overview.html
- https://staffeng.com/
- https://levels.fyi/


### Process

#### 1:1s
- https://medium.com/@mrabkin/the-art-of-the-awkward-1-1-f4e1dcbd1c5c
- https://medium.com/@mrabkin/awkward-1-1s-the-art-of-getting-honest-feedback-2843078b2880

#### 1:1/checkin facilitation/nudge engines
- https://www.range.co/
- https://knowyourteam.com/
- https://www.readymetrics.com/
- https://humu.com/

#### meetings / facilitation
- http://www.debonogroup.com/six_thinking_hats.php
- [gCal speedy meetings setting](https://www.bettercloud.com/monitor/the-academy/efficient-effective-meetings-google-calendar/)
- https://www.nytimes.com/2015/02/08/opinion/sunday/sheryl-sandberg-and-adam-grant-on-women-doing-office-housework.html
- https://courses.lumenlearning.com/introductiontocommunication/chapter/groups-roles/

#### frameworks
- situational leadership (kenblanchard)
- https://firstround.com/review/Keith-Rabois-on-the-role-of-a-COO-how-to-hire-and-why-transparency-matters/

#### decision making
- https://firstround.com/review/how-this-head-of-engineering-boosted-transparency-at-instagram/
- https://www.atlassian.com/team-playbook/plays/daci
- https://en.wikipedia.org/wiki/Time_management#The_Eisenhower_Method


### Resources

#### Books
- first 90 days
- managing humans
- high output management
- hard thing about hard things
- measure what matters (aka the okr book)
- sapien
- an elegant puzzle
- The Five Dysfunctions of a Team: A Leadership Fable
- the Advantage
- the phoenix project
- radical candor
- Peopleware
- What Got You Here Won't Get You There
- An Elegant Puzzle: Systems of Engineering Management
- High Growth Handbook
- The Manager's Path
- Dare to Lead
- The Messy Middle
- https://medium.com/range/leadership-reading-list-951c5ccb4370
- Fierce Conversations
- [The Culture Map](https://www.amazon.com/Culture-Map-Breaking-Invisible-Boundaries/dp/1610392507)

#### Reading
- http://randsinrepose.com/
- https://lethain.com
- https://medium.com/the-year-of-the-looking-glass
- https://rework.withgoogle.com/
- https://rework.withgoogle.com/guides/managers-identify-what-makes-a-great-manager/steps/learn-about-googles-manager-research/
- https://rework.withgoogle.com/print/guides/5721312655835136/
- High Output Management [TLDR](https://medium.com/@iantien/top-takeaways-from-andy-grove-s-high-output-management-2e0ecfb1ea63) and [Forward by Horowitz](https://a16z.com/2015/11/13/high-output-management/)
- [RACI](http://firstround.com/review/how-this-head-of-engineering-boosted-transparency-at-instagram/) and [this](https://en.wikipedia.org/wiki/Responsibility_assignment_matrix)
- [Manager READMEs](https://hackernoon.com/12-manager-readmes-from-silicon-valleys-top-tech-companies-26588a660afe)
- https://www.manager-tools.com/
- [6 Must Reads for Managers Giving Feedback](http://firstround.com/review/our-6-must-reads-for-managers-to-give-feedback-that-helps-people-grow/)
- [Failed #SquadGoals - Spotify doesn’t use “the Spotify model” and neither should you.](https://www.jeremiahlee.com/posts/failed-squad-goals/)


================================================
FILE: ENG_PRACTICES.md
================================================
also https://github.com/google/eng-practices

### Misc Resources

email lists
- https://maleallies.com/
- https://hello.cultureamp.com/subscribe-to-the-people-geekly
- https://andrewchen.co/


#### secops, privacy
- https://www.hackerone.com/blog/security-vendors-startups-lob-cant-live-without
- https://12factor.net/
- https://cheatsheetseries.owasp.org/index.html
- https://sudo.pagerduty.com/
- [vendor sec assessment](https://blogs.dropbox.com/tech/2019/03/towards-better-vendor-security-assessments/)
- https://haveibeenpwned.com/
- https://developer.github.com/partnerships/token-scanning/
- compliance vendors:
  - coalfire, a-lign, armanino, ncc group
- pentest vendors:
  - https://www.includesecurity.com/
  - https://cobalt.io/
  - https://cure53.de/
- https://application.security/
- https://snyk.io/
- https://doppler.com/
- https://github.com/rawdigits/go-flashpaper
- https://darknetdiaries.com/

#### compliance
- https://github.com/pivotal/LicenseFinder
- https://github.com/AlDanial/cloc

#### devops
- [google SRE book](https://landing.google.com/sre/book/index.html)
- getting infra-as-code off the ground (terraform): https://gruntwork.io/
- https://github.com/etsy/DebriefingFacilitationGuide
- https://how.complexsystems.fail/

#### refactoring
- https://refactoring.guru/

#### code quality / style
- https://prettier.io/
- https://github.com/google/code-prettify

#### doing code review
- https://google.github.io/eng-practices/review/reviewer/

#### development process
- https://trunkbaseddevelopment.com/

#### papers
- https://blog.acolyer.org/

#### fraud/spam related services:
- https://pro.whitepages.com/ (vet employer/identity)
- https://www.lexisnexis.com/en-us/gateway.page (vet employer/identity)
- https://risk.lexisnexis.com/products/threatmetrix
- https://emailage.com/ (vet e-mail legitimacy)

industry-collaborative risk-data-exchange project:
- https://www.zerofox.com/ (commercial company)
- https://developers.facebook.com/products/threat-exchange (by fb)
- arkose labs, perimeterX, Shape, Cequence

### Employment Law Compliance
- https://www.lawroom.com/
- https://www.lifetheatre.com/training-topics/

#### when all else fails, call:
- https://layeraleph.com/ (mikeyd@)

#### design/marketing/uiux
- https://fuzzco.com/
- http://omstudio.co/

#### well being
- https://www.workonwellbeing.com/

#### advisor/founder agreement
- https://fi.co/fast

### other random stuff
- https://asciinema.org


================================================
FILE: README.md
================================================
A handy lookup table of similar technology and services to help ex-googlers survive the *real* world :)
pull-requests are very welcomed. __Please do not list any confidential projects!__

For a working example of (some) of these technologies integrated together, see:
https://github.com/google/startup-os

See also: [System Design Primer](https://github.com/donnemartin/system-design-primer), [The Hadoop Ecosystem Table](https://hadoopecosystemtable.github.io/), [Map AWS services to GCP products](https://cloud.google.com/free/docs/map-aws-google-cloud-platform), [Database of Databases](https://dbdb.io/), [Google Open Source Glossary](https://opensource.google/docs/glossary/)

## Technology

### Core Technology

| Google Internal | Google External                          | Open Source / Real-World                 |
| --------------- | ---------------------------------------- | ---------------------------------------- |
| MapReduce       |                                          | [Apache Hadoop](https://github.com/apache/hadoop), [Spark](https://github.com/apache/spark) |
| [Flume](https://research.google/pubs/flumejava-easy-efficient-data-parallel-pipelines/)   | [DataFlow](https://cloud.google.com/dataflow)  | [Apache Beam](https://beam.apache.org/) |
| Protocol Buffer | [Protobuf](https://github.com/google/protobuf), [FlatBuffers](https://google.github.io/flatbuffers/) | [Cap'n Proto](https://capnproto.org/), [Thrift](https://github.com/apache/thrift), [Avro](https://github.com/apache/avro), [Amazon Ion](https://amzn.github.io/ion-docs/), [CBOR](https://cbor.io/), [kryo](https://github.com/EsotericSoftware/kryo) |
| Stubby          | [gRPC](https://github.com/grpc/grpc)     | [Thrift](https://github.com/apache/thrift), [Bolt](https://boltprotocol.org/) |
| Chubby          |                                          | [Apache Zookeeper](https://github.com/apache/zookeeper), [etcd](https://github.com/coreos/etcd), [HashiCorp Consul](https://github.com/hashicorp/consul) |
| Goops / PubSub  | [Cloud Pub/Sub](https://cloud.google.com/pubsub)     | [Apache Kafka](https://github.com/apache/kafka), [Apache Pulsar](https://github.com/apache/incubator-pulsar), [Facebook LogDevice](https://github.com/facebookincubator/LogDevice) |
| `//base`        |                                          | [abseil](https://github.com/abseil) |

### Infrastructure

| Google Internal      | Google External                          | Open Source / Real-World                 |
| -------------------- | ---------------------------------------- | ---------------------------------------- |
| Borg                 | [Kubernetes](https://kubernetes.io/)     | [Apache Mesos](https://github.com/apache/mesos), [Apache Aurora](https://aurora.apache.org/), [HashiCorp Nomad](https://github.com/hashicorp/nomad) |
| GSLB | [Cloud Load Balancing](https://cloud.google.com/load-balancing) - Internal | AWS ELB,  [Istio](https://istio.io/), [linkerd](https://linkerd.io/)
| OnePlatform          | [API Gateway](https://cloud.google.com/api-gateway) | [Swagger](https://swagger.io/) |
| GFE, Maglev, uberproxy | [Cloud Load Balancing](https://cloud.google.com/load-balancing) - HTTPS / External | [envoy](https://www.envoyproxy.io/), AWS ALB, [HAProxy](https://www.haproxy.org/), [nginx](https://www.nginx.com/), [F5](https://f5.com/products/big-ip) |
| uberproxy (sso proxy) | [Identity-Aware Proxy](https://cloud.google.com/iap) | [buzzfeed-sso](https://github.com/buzzfeed/sso), [Pomerium](https://pomerium.io/), [Envoy Gateway](https://gateway.envoyproxy.io/docs/tasks/security/oidc/) |
| Zanzibar             | [Zanzibar Research Paper](https://research.google/pubs/pub48190/) | [SpiceDB](https://github.com/authzed/spicedb)/[authzed](https://authzed.com/), [Ory Keto](https://www.ory.sh/keto/docs/), [topaz](https://github.com/aserto-dev/topaz), [Opal](https://opal.dev/), [(iam)Keycloak](https://www.keycloak.org/), [Warrant](https://github.com/warrant-dev/warrant), [OpenFGA](https://openfga.dev/) |
| data center hardware | [open compute](https://www.opencompute.org/) |                                          |
| Jupiter, Starblaze   |                                          |                                             |
| B4, Stargate, TE     |                                          |                                             |
| USPS, Andromeda      |                                          |                                             |
| ESDN                 |                                          | [Faucet](https://github.com/faucetsdn/faucet)
| [broccoli man](https://www.youtube.com/watch?v=3t6L-FlfeaI)  | ||


### Storage

| Google Internal                          | Google External                          | Open Source / Real-World                 |
| ---------------------------------------- | ---------------------------------------- | ---------------------------------------- |
| GFS/Colossus                             |                                          | [HDFS](https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html), [Ceph](https://ceph.com), [GlusterFS](https://www.gluster.org), [MooseFS](https://moosefs.com/products/#moosefs) |
| Bigtable                                 | [Cloud Bigtable](https://cloud.google.com/bigtable) | [PrestoDB](https://prestodb.io/), [Cassandra](https://github.com/apache/cassandra), [HBase](https://github.com/apache/hbase), [Accumulo](https://github.com/apache/accumulo), [DynamoDB](https://aws.amazon.com/dynamodb), [ScyllaDB](https://www.scylladb.com/) |
| [Spanner](https://research.google.com/archive/spanner.html) | [Cloud Spanner](https://cloud.google.com/spanner/) | [Vitess](https://vitess.io), [CockroachDB](https://github.com/cockroachdb/cockroach), [TiDB](https://github.com/pingcap/tidb) |
| ColumnIO / [Capacitor](https://cloud.google.com/blog/products/bigquery/inside-capacitor-bigquerys-next-generation-columnar-storage-format) | [BigQuery storage](https://cloud.google.com/bigquery/docs/storage_overview) | [Apache Parquet](https://parquet.apache.org), [ORC](https://orc.apache.org/docs/), [Apache Iceberg](https://iceberg.apache.org/) |
| sstable                                  | [levelDB](https://github.com/google/leveldb) | [RocksDB](https://rocksdb.org), [pebble](https://github.com/cockroachdb/pebble)      |
| zippy                                    | [Snappy](https://github.com/google/snappy) | [lz4](https://github.com/lz4/lz4)        |
| RecordIO                                 | [Riegeli](https://github.com/google/riegeli), [TFRecords](https://github.com/tensorflow/docs/blob/r1.10/site/en/api_guides/python/python_io.md#tfrecords-format-details), & in [OR-Tools](https://github.com/google/or-tools/blob/stable/ortools/base/recordio.h), [szl](https://github.com/google/szl/blob/master/src/utilities/recordio.cc) | [stuffed-record-stream](https://github.com/backtrace-labs/stuffed-record-stream) |


### Services
| Google Internal                          | Google External                          | Open Source                              | SaaS                                     |
| ---------------------------------------- | ---------------------------------------- | ---------------------------------------- | ---------------------------------------- |
| Dremel                                   | [BigQuery](https://cloud.google.com/bigquery/) | [Apache Drill](https://github.com/apache/drill), [Presto](https://prestodb.io), Spark(sort-of), | [AWS Athena](https://aws.amazon.com/athena/), [Redshift Spectrum](https://aws.amazon.com/redshift/spectrum/), [Snowflake](https://www.snowflake.com) |
| Dremel UI                                |                                          | [Redash](https://github.com/getredash/redash), [Metabase](https://github.com/metabase/metabase), [Apache Superset](https://github.com/apache/incubator-superset) |                                          |
| Search (Mustang, Alexandria)             |                                          | [Elasticsearch](https://github.com/elastic/elasticsearch), [OpenSearch](https://opensearch.org/), Solr, Lucene              | [algolia](https://www.algolia.com/)      |
| pubsub                                   | [pubsub](https://cloud.google.com/pubsub/docs/overview) | [NATS.io](https://nats.io), [RabbitMQ](https://github.com/rabbitmq), [PubNub](https://www.pubnub.com/) | AWS SQS/SNS, [AWS AppSync](https://aws.amazon.com/appsync) |
| [MillWheel](https://ai.google/research/pubs/pub41378) | [Cloud Dataflow](https://cloud.google.com/dataflow/) | [Apache Flink](https://flink.apache.org/), beam |                |
| Colab | [Colaboratory](https://colab.research.google.com/) | [Jupyter](https://jupyter.org) | [Observable](https://observablehq.com/) |
| PLX | [Google Data Studio](https://datastudio.google.com/) | | [Mode](https://mode.com) |
| Monarch | [paper](https://research.google/pubs/pub50652/) | | |
| Napa | [paper](https://research.google/pubs/pub50617/) | | |
| MakerSuite| [MakerSuite](https://makersuite.google.com) | | |


### DevOps
| Google Internal                 | Google External                          | Real-World                               |
| ------------------------------- | ---------------------------------------- | ---------------------------------------- |
| Assimilator                     |                                          | [Dominator](https://github.com/Cloud-Foundations/Dominator) |
| Blaze                           | [Bazel](https://bazel.build)             | [Buck](https://buckbuild.com/), [Pants](https://www.pantsbuild.org/), [please.build](https://please.build/), [Blade](https://github.com/chen3feng/blade-build), [recc](https://gitlab.com/bloomberg/recc), [EngFlow](https://www.engflow.com/), [BuildBuddy](https://www.buildbuddy.io/), [flare.build](https://flare.build) |
| Oncall                          |                                          | [PagerDuty](https://pagerduty.com), [OpsGenie](https://www.opsgenie.com/), [VictorOps](https://victorops.com/) |
| varz/borgmon/monarch            | [Cloud Monitoring](https://cloud.google.com/monitoring) | [Datadog](https://www.datadoghq.com/), [Prometheus](https://prometheus.io), [M3](https://m3db.io/), [librato](https://www.librato.com), [newrelic](https://newrelic.com), skylight, scout, [Scotty](https://github.com/Cloud-Foundations/scotty)/[tricorder](https://github.com/Cloud-Foundations/tricorder), [netdata](https://github.com/netdata/netdata), [bosun](https://bosun.org/), also [this](https://vimeo.com/173610242) and [this](https://prometheus.io/docs/introduction/comparison/) |
| Viceroy                         | Cloud Monitoring                         | [Grafana](https://grafana.com/) |
| Exception/Error Tracking (thirdeye)   |                                          | Sentry.io, Raygun.io, [Rollbar](https://rollbar.com), Honeybadger, Airbrake, OverOps, [ELK stack](https://www.elastic.co/what-is/elk-stack) |
| styleguides                     | [google styleguides](https://github.com/google/styleguide) | [PEP-8](https://www.python.org/dev/peps/pep-0008/), [HoundCI auto-style-reviewer](https://houndci.com/) |
| Sponge                          |                                          | [EngFlow](https://www.engflow.com/) |
| Blaze/Forge/TAP/BuildCop        | [Cloud Build](https://cloud.google.com/cloud-build/) | [buildkite](https://buildkite.com/), [CircleCI](https://circleci.com), [Drone](https://drone.io/), [EngFlow](https://www.engflow.com/), [github](https://github.blog/2019-08-08-github-actions-now-supports-ci-cd/), [gitlabCI](https://about.gitlab.com/product/continuous-integration/), [jenkins](https://jenkins.io/), [travis](https://travis-ci.org/) |
| Forge/ObjFS                     |                                          | [EngFlow](https://www.engflow.com/), [flare.build](https://flare.build) |
| Sandman(test env)/Guitar        |                                          |                   |
| Sisyphus / Rapid                |                                          | [Spinnaker](https://www.spinnaker.io/), [lambdaCD](https://www.lambda.cd), screwdriver.cd, [CodeShip](https://codeship.com), [shipit-engine](https://github.com/Shopify/shipit-engine), [GoCD](https://www.gocd.org), [AWS CodeDeploy](https://aws.amazon.com/codedeploy/), [Capistrano](https://www.capistranorb.com), [Fabric](https://www.fabfile.org), [ConcourseCI](https://concourse.ci/), [samson](https://github.com/zendesk/samson) |
| MPM                             |                                          | [Docker](https://www.docker.com/), [OCI](https://opencontainers.org/) |
| borgcfg / gcl, [Prodspec + Annealing](https://www.usenix.org/publications/loginonline/prodspec-and-annealing-intent-based-actuation-google-production)            | [Jsonnet](https://jsonnet.org/), [Cue](https://cuelang.org/) | [AWS Cloudformation](https://aws.amazon.com/cloudformation/), Puppet, Chef, Salt, Ansible, [Terraform](https://www.terraform.io), [kubecfg](https://github.com/kubecfg/kubecfg), [pulumi](https://github.com/pulumi/pulumi), [Nix](https://nix.dev/), [Pkl](https://pkl-lang.org/) |
| logging, analog                 | [StackDriver](https://cloud.google.com/stackdriver/) | [logstash](https://github.com/elastic/logstash), [fluentd](https://github.com/fluent/fluentd), [PaperTrail](https://www.papertrail.com/), [cernan](https://github.com/postmates/cernan), [loki](https://grafana.com/oss/loki/) |
| CodeSearch, Grimoire            | [Zoekt](https://github.com/google/zoekt) [kythe](https://github.com/kythe/kythe) [Code Search](https://developers.google.com/code-search/user/getting-started) (for Google open source code only, with separate UI for Android and Chromium. Go CLI [source](https://github.com/google/codesearch).) | [Sourcegraph](https://sourcegraph.com), [OpenGrok](https://github.com/OpenGrok/OpenGrok/), [livegrep](https://github.com/livegrep/livegrep) |
| Critique, Gerrit, Mondrian etc. | [Gerrit](https://www.gerritcodereview.com/) | [Reviewable](https://reviewable.io) , [Phabricator](https://www.phacility.com/phabricator/)     |
| cider                           |                                          | [Eclipse Che](https://www.eclipse.org/che/), [Cloud9](https://c9.io/), [gitpod.io](https://gitpod.io), [Coder](https://coder.com/), [Code-Server (VSCode in a Tab)](https://github.com/cdr/code-server), [DevZero](https://www.devzero.io/) |
| buganizer                       | [Google Issue Tracker](https://issuetracker.google.com/) | [JIRA](https://www.atlassian.com/software/jira), [bugzilla](https://www.bugzilla.org/), github issues, [Linear](https://linear.app/) |
| Bugjuggler                      |                                          | [SnoozeThis](https://www.snoozethis.com/) |
| ToTT                            | [Google Test Blog](https://testing.googleblog.com/) | [Increment](https://increment.com/) |
| Copybara / MOE                  | [Copybara](https://github.com/google/copybara), [MOE](https://github.com/google/MOE)  |                                          |
| workflow/dependency management | | [Luigi](https://github.com/spotify/luigi), [Airflow](https://github.com/apache/airflow), [digdag](https://github.com/treasure-data/digdag), [Pachyderm](https://github.com/pachyderm/pachyderm), [Dask](https://github.com/dask/dask) |
| ErrorProne                      | [ErrorProne](https://errorprone.info/)   | [SpotBugs](https://spotbugs.github.io/), [FindBugs](https://findbugs.sourceforge.net/) |
| [Dapper](https://ai.google/research/pubs/pub36356) | [stackdriver trace](https://cloud.google.com/trace/) | [zipkin](https://github.com/openzipkin/zipkin), [OpenTelemetry](https://opentelemetry.io/), [jaeger](https://www.jaegertracing.io/), [LightStep](https://lightstep.com), [Honeycomb](https://www.honeycomb.io/trace/) |
| C++ Tips of the Week            | [Abseil C++ Tips of the Week](https://abseil.io/tips/) |  |
| [DiRT](https://cloud.google.com/blog/products/management-tools/shrinking-the-time-to-mitigate-production-incidents) | | [ChaosMonkey](https://github.com/Netflix/chaosmonkey), [aws fis](https://aws.amazon.com/fis/) |
| [Rosie](https://cacm.acm.org/magazines/2016/7/204032-why-google-stores-billions-of-lines-of-code-in-a-single-repository/fulltext) | | [microplane](https://github.com/Clever/microplane), [silver-platter](https://github.com/jelmer/silver-platter) |
| API Improvements Proposals | [AIP](https://google.aip.dev/) | |
| g4 {fix, submit} | | [Trunk.io](https://trunk.io), [Graphite](https://graphite.dev/) |
| probers | | [cloudprober](https://github.com/cloudprober/cloudprober) |
| GWP | [paper](https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/36575.pdf) | [Parca](https://www.parca.dev), [Polar Signals](https://www.polarsignals.com) |

### Security
| Google Internal                  | Google External | Open Source                              |
| -------------------------------- | --------------- | ---------------------------------------- |
| prodaccess/LOAS                  |                 | [Keymaster](https://github.com/Cloud-Foundations/keymaster) |
| prod secrets/identity management |                 | [chamber](https://github.com/segmentio/chamber), [knox](https://github.com/pinterest/knox), [SPIFFE](https://spiffe.io/) |

## IT / Operations / Misc
| Google Internal                          | Real-World                               |
| ---------------------------------------- | ---------------------------------------- |
| software engineering at google [1](https://arxiv.org/ftp/arxiv/papers/1702/1702.01715.pdf), [2](https://abseil.io/resources/swe-book) | [Software Engineering at Google: Lessons Learned from Programming Over Time](https://www.amazon.com/Software-Engineering-Google-Lessons-Programming/dp/1492082791) |
| [SRE @ google](https://sre.google/sre-book/table-of-contents/) | |
| valentine                                | [Vault](https://www.vaultproject.io/), [1Password](https://support.1password.com/create-share-vaults/), [Lastpass](https://lastpass.com), [pass](https://www.passwordstore.org/), [keeper](https://www.keepersecurity.com/) |
| OWNERS files in repo                     | [github CODEOWNERS](https://github.com/blog/2392-introducing-code-owners) |
| snippets                                 | [Khan/snippets](https://github.com/Khan/snippets) |
| SnipIt                                   | [recordit](https://recordit.co/), [CloudApp](https://www.getcloudapp.com/), [dropbox screenshots](https://help.dropbox.com/installs-integrations/photos/screenshots), [Snippyly](https://snippyly.com/) |
| gpaste                                   | [pastee](https://paste.ee/), [pastebin](https://pastebin.com/) |
| stuff (SaaS IT management)               | [productiv](https://productiv.com/), [intello](https://www.intello.io/), [zylo](https://zylo.com/) |
| stuff (Device Management)                | [jamf](https://www.jamf.com/) |
| device security monitoring               | [Red Canary](https://redcanary.com/) |
| beyondcorp | [beyondcorp](https://www.beyondcorp.com/) |
| [go/ links](https://medium.com/@golinks/the-full-history-of-go-links-and-the-golink-system-cbc6d2c8bb3)                                | [golinks](https://www.golinks.io/), [go](https://github.com/kellegous/go), [Goat](https://goatcodes.com/), [trotto](https://github.com/trotto/go-links), [go-shorten](https://github.com/thomasdesr/go-shorten) |
| google3 philosophy                       | [innersource](https://resources.github.com/whitepapers/introduction-to-innersource/), [monorepo](https://cacm.acm.org/magazines/2016/7/204032-why-google-stores-billions-of-lines-of-code-in-a-single-repository/fulltext), [YouTube talk](https://www.youtube.com/watch?v=W71BTkUbdqE) |
| doing code review                        | [code review](https://google.github.io/eng-practices/review/reviewer/) |
| safely sharing 1-time secrets            | [sendsecure.ly](https://sendsecure.ly), [croc](https://github.com/schollz/croc), [onetimesecret](https://github.com/onetimesecret/onetimesecret), [privatebin](https://privatebin.info/) |
| messaging                                | [mattermost](https://github.com/mattermost/mattermost-server), [Slack](https://slack.com), gchat |
| tech talks | [TechTalks @ Google](https://www.youtube.com/user/GoogleTechTalks/videos) |
| g3doc | [writethedocs](https://www.writethedocs.org/), [docs-as-code](https://idratherbewriting.com/learnapidoc/pubapis_docs_as_code.html) |
| GUTS | [spoke](https://www.atspoke.com/), [freshservice](https://freshservice.com/) |
| MOMA | [glean](https://www.glean.com/) |

## PeopleOps / Culture
| Google Internal                          | Real-World                               |
| ---------------------------------------- | ---------------------------------------- |
| [OKR](https://en.wikipedia.org/wiki/OKR) | [CultureAmp OKR](https://www.cultureamp.com/okr-solution-b), [Lattice Goals](https://lattice.com/goals), [Ally](https://www.ally.io/), [workboard](https://www.workboard.com/) |
| HRIS/ERP                                 | [Namely](https://namely.com), [BambooHR](https://www.bamboohr.com/), [Workday](https://workday.com), [Paylocity](https://www.paylocity.com/) |
| [peer bonus](https://www.forbes.com/sites/jurgenappelo/2015/07/08/the-peer-to-peer-bonus-system/#33c47ef84329)   | [bonus.ly](https://bonus.ly/) |
| kudos  | [heytaco](https://www.heytaco.chat/), [slack ++ bot](https://github.com/tdmalone/working-plusplus/) |
| perks | [fond](https://fond.co) |
| talks | [Talks @ Google](https://www.youtube.com/c/talksatgoogle/videos) |
| dory | [slido](https://www.sli.do/), [dory(app)](https://dory.app/) |
| edge, people ops training                | [LifeLabs](https://www.lifelabslearning.com/)  |
| googlegeist                              | [Culture Amp](https://www.cultureamp.com/), [humu](https://www.humu.com/), [tinypulse](https://www.tinypulse.com/), [peakon](https://peakon.com/) |
| Meng                                     | [Search Inside Yourself](https://www.amazon.com/Search-Inside-Yourself-Unexpected-Achieving/dp/0062116932) |
| Lazlo                                    | [Work Rules](https://www.amazon.com/Work-Rules-Insights-Inside-Transform/dp/1455554790/) |
| Claire Stapleton                         | [Tech Support - existential advice for the modern tech worker](https://techsupport.substack.com/) |
| books about google | [How Google Works](https://www.amazon.com/How-Google-Works-Eric-Schmidt/dp/1455582328), [In The Plex](https://www.amazon.com/Plex-Google-Thinks-Works-Shapes/dp/1416596585), [Software Engineering at Google](https://www.amazon.com/Software-Engineering-Google-Lessons-Programming/dp/1492082791) |


also check out [xoogler.co](https://xoogler.co/), which organizes events, slack channels etc

*disclaimer: I'm not affiliated with any of the technologies/products mentioned above.*

*disclaimer: I left Google a number of years ago so some of the naming might be dated.*
Download .txt
gitextract_lbxykc9g/

├── APIs.md
├── DATA_INFRA.md
├── EM.md
├── ENG_PRACTICES.md
└── README.md
Condensed preview — 5 files, each showing path, character count, and a content snippet. Download the .json file or copy for the full structured content (37K chars).
[
  {
    "path": "APIs.md",
    "chars": 97,
    "preview": "| internal | external |\n| -------- | -------- |\n| image charts | https://www.image-charts.com/ |\n"
  },
  {
    "path": "DATA_INFRA.md",
    "chars": 3956,
    "preview": "### Reading\n- [Machine Learning: The High Interest Credit Card of Technical Debt](https://ai.google/research/pubs/pub431"
  },
  {
    "path": "EM.md",
    "chars": 6660,
    "preview": "## Engineering Management\n\n### People\n\n#### understanding self/team\n- [Myers-Briggs](https://en.wikipedia.org/wiki/Myers"
  },
  {
    "path": "ENG_PRACTICES.md",
    "chars": 2445,
    "preview": "also https://github.com/google/eng-practices\n\n### Misc Resources\n\nemail lists\n- https://maleallies.com/\n- https://hello."
  },
  {
    "path": "README.md",
    "chars": 23012,
    "preview": "A handy lookup table of similar technology and services to help ex-googlers survive the *real* world :)\npull-requests ar"
  }
]

About this extraction

This page contains the full source code of the jhuangtw/xg2xg GitHub repository, extracted and formatted as plain text for AI agents and large language models (LLMs). The extraction includes 5 files (35.3 KB), approximately 9.8k tokens. Use this with OpenClaw, Claude, ChatGPT, Cursor, Windsurf, or any other AI tool that accepts text input. You can copy the full output to your clipboard or download it as a .txt file.

Extracted by GitExtract — free GitHub repo to text converter for AI. Built by Nikandr Surkov.

Copied to clipboard!