Full Code of sderosiaux/every-single-day-i-tldr for AI

Repository: sderosiaux/every-single-day-i-tldr
Branch: master
Commit: 3d74e08a238c
Files: 1
Total size: 722.8 KB

Directory structure:
gitextract_udn19b8a/

└── README.md

================================================
FILE CONTENTS
================================================

================================================
FILE: README.md
================================================
# _Almost_ every single day I TLDR!
This repo is my personal archive of articles, blog posts, and videos I found interesting. Think of it as a massive shared bookmarks list—like a daily newsletter, but without the newsletter.
ߒ᠔ip: Use Ctrl+F to search for topics you care about.
I'm the co-founder and CTO of [conduktor.io](conduktor.io), a real-time AI Data Governance platform built around Kafka. In 2025, I’m focused on AI, Data, Kafka, and all things tech.
ߚࠈappy reading!
# 18-01-2026
- https://blog.yakkomajuri.com/blog/raising-money-fucked-me-up Raising money fucked me up
# 17-01-2026
- https://cursor.com/blog/scaling-agents Scaling long\-running autonomous coding
# 16-01-2026
- https://simplescraper.io/blog/how-to-mcp How to MCP \- The Complete Guide to Understanding Model Context Protocol and Building Remote Servers
- https://playground.ai.cloudflare.com/ Workers AI LLM Playground
# 07-01-2026
- https://newsletter.pragmaticengineer.com/p/when-ai-writes-almost-all-code-what?publication_id=458709&post_id=183694080&isFreemail=true&r=hc7kn&triedRedirect=true When AI writes almost all code, what happens to software engineering?
- https://huggingface.co/learn/cookbook/en/dspy_gepa Prompt Optimization for Language Models with DSPy GEPA
# 05-01-2026
- https://www.profgalloway.com/2026-predictions/ 2026 Predictions | No Mercy / No Malice
# 22-12-2025
- https://marginlab.ai/blog/swe-bench-deep-dive/ SWE\-Bench: The $500B Benchmark
- https://simonwillison.net/2025/Dec/18/code-proven-to-work/ Your job is to deliver code you have proven to work
- https://www.aiforswes.com/p/you-dont-need-to-spend-100mo-on-claude \[Revised\] You Don’t Need to Spend $100/mo on Claude Code: Your Guide to Local Coding Models
- https://dataengineeringcentral.substack.com/p/building-a-ducklake-open-source-style Building a DuckLake \.\.\. Open Source Style\.
# 14-12-2025
- https://newsletter.pragmaticengineer.com/p/evals A pragmatic guide to LLM evals for devs
- https://www.youtube.com/watch?v=z1ISq9Ty4Cg Why humans are AI's biggest bottleneck \(and what's coming in 2026\)
# 13-12-2025
- https://newsletter.pragmaticengineer.com/p/mcp-deepdive Building MCP servers in the real world
# 08-12-2025
- https://martinalderson.com/posts/has-the-cost-of-software-just-dropped-90-percent/ 100%
# 06-12-2025
- https://medium.com/@kakamber07/how-i-made-postgres-fly-on-2-cores-and-4gb-ram-1-2-billion-rows-in-0-7-seconds-1a0e01c49571 Make Postgres Fly: 1\.2B Rows on 2 Cores & 4GB RAM
# 01-12-2025
- https://www.instantdb.com/essays/agents_building_counterstrike Codex, Opus, Gemini try to build Counter Strike
# 30-11-2025
- https://www.404media.co/grokipedia-is-the-antithesis-of-everything-that-makes-wikipedia-good-useful-and-human/ Grokipedia Is the Antithesis of Everything That Makes Wikipedia Good, Useful, and Human
- https://www.humanlayer.dev/blog/writing-a-good-claude-md Writing a good CLAUDE\.md
- https://blog.yakkomajuri.com/blog/local-rag So you wanna build a local RAG?
# 29-11-2025
- https://taranis.ie/datacenters-in-space-are-a-terrible-horrible-no-good-idea/ Datacenters in space are a terrible, horrible, no good idea\.
# 27-11-2025
- https://www.youtube.com/watch?v=qImgGtnNbx0 He saved OpenAI, invented the “Like” button, and built Google Maps: Bret Taylor \(Sierra\)
- https://www.gartner.com/document-reader/document/7077298 How to Select the Right Data Hub Strategy
- https://www.youtube.com/watch?v=Kr3Sh2PKA8Y Google DeepMind CEO Demis Hassabis on AI, Creativity, and a Golden Age of Science
- https://www.youtube.com/watch?v=GT0jtVjRy2E How we restructured Airtable's entire org for AI
# 26-11-2025
- https://www.abzglobal.net/web-development-blog/ilya-sutskever-yann-lecun-and-the-end-of-just-add-gpus Ilya Sutskever, Yann LeCun and the End of “Just Add GPUs”
# 25-11-2025
- https://www.anthropic.com/engineering/advanced-tool-use Introducing advanced tool use on the Claude Developer Platform \\ Anthropic
- https://www.promptarmor.com/resources/google-antigravity-exfiltrates-data Google Antigravity Exfiltrates Data
# 23-11-2025
- https://jack-vanlightly.com/blog/2025/11/5/how-would-you-like-your-iceberg-sir-stream-or-batch-ordered How Would You Like Your Iceberg Sir? Stream or Batch Ordered?
# 22-11-2025
- https://blog.modelcontextprotocol.io/posts/2025-11-21-mcp-apps/ MCP Apps: Extending servers with interactive user interfaces
# 19-11-2025
- https://www.dataengineeringweekly.com/p/the-dark-data-tax-how-hoarding-is The Dark Data Tax: How Hoarding is Poisoning Your AI
# 18-11-2025
- https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai The State of AI: Global Survey 2025 | McKinsey
# 16-11-2025
- https://djnn.sh/posts/anthropic-s-paper-smells-like-bullshit/ anthropic's paper smells like bullshit
- https://startupsandcode.substack.com/p/the-gpu-depreciation-lie The GPU Depreciation Lie
# 08-11-2025
- https://bravenewgeek.com/everything-you-know-about-latency-is-wrong/ Everything You Know About Latency Is Wrong – Brave New Geek
> Everything You Know About Latency Is Wrong Okay, maybe not everything you know about latency is wrong\. But now that I have your attention, we can talk about why the tools and methodologies you use to measure and reason about latency are likely horribly flawed\. In fact, they’re not just flawed, they’
# 04-11-2025
- https://aws.amazon.com/about-aws/whats-new/2025/10/amazon-kinesis-data-streams-fis-actions-api-errors/ Amazon Kinesis Data Streams announces new Fault Injection Service \(FIS\) actions for API errors
- https://alex-jacobs.com/posts/the-case-against-pgvector/ The Case Against pgvector
# 03-11-2025
- https://blog.sshh.io/p/how-i-use-every-claude-code-feature How I Use Every Claude Code Feature
- https://medium.com/fresha-data-engineering/from-json-to-avro-in-the-cdc-pipeline-ff24ac9c9abc From JSON to AVRO in the CDC pipeline
- https://bigdata.2minutestreaming.com/p/event-streaming-is-topping-out Event Streaming is Topping Out
# 02-11-2025
- https://wyounas.github.io/aws/concurrency/2025/10/30/reproducing-the-aws-outage-race-condition-with-model-checker/ Reproducing the AWS Outage Race Condition with a Model Checker
- https://www.morling.dev/blog/you-dont-need-kafka-just-use-postgres-considered-harmful/ "You Don't Need Kafka, Just Use Postgres" Considered Harmful
# 27-10-2025
- https://flink.apache.org/2025/10/15/apache-flink-agents-0.1.0-release-announcement/ Apache Flink has a new exciting sub\-projects: Agents 0\.1\.0, for even\-driven AI agents\!
- https://github.com/johannschopplich/toon Token\-Optimized Object Notation, JSON for LLMs at half the token cost
- https://github.com/cisco-ai-defense/mcp-scanner Scan MCP Servers for vulnerabilities
- https://www.onehouse.ai/blog/kafka-connect-vs-flink-vs-spark-choosing-the-right-ingestion-framework Apache Kafka \(Kafka Connect\) vs\. Apache Flink vs\. Apache Spark: Choosing the Right Ingestion Framework
# 21-10-2025
- https://thenewstack.io/apache-kafka-4-1-the-3-big-things-developers-need-to-know/ Apache Kafka 4\.1: The 3 Big Things Developers Need To Know
# 19-10-2025
- https://www.youtube.com/watch?v=HUkBz-cdB-k Terence Tao: Hardest Problems in Mathematics, Physics & the Future of AI | Lex Fridman Podcast \#472
- https://github.com/henryhawke/ReasonSuite MCP for using logical razors and types of reasoning\. An expansion of sequential reasoning mcp\.
- https://mariozechner.at/posts/2025-08-15-mcp-vs-cli/ MCP vs CLI: Benchmarking Tools for Coding Agents
> just make a good CLI\. It's simpler and more portable\. Plus, the output of your CLI can be further filtered and massaged just by piping it into another CLI tool, which can increase token efficiency at the cost of additional instructions\. That's not possible with MCPs\.
# 18-10-2025
- https://www.wheresyoured.at/openai400bn/ OpenAI Needs $400 Billion In The Next 12 Months
# 17-10-2025
- https://jack-vanlightly.com/blog/2025/10/15/why-im-not-a-fan-of-zero-copy-apache-kafka-apache-iceberg Why I’m not a fan of zero\-copy Apache Kafka\-Apache Iceberg
- https://www.dataengineeringweekly.com/p/revisiting-medallion-architecture-760 Revisiting Medallion Architecture: Data Vault in Silver, Dimensional Modeling in Gold
- https://medium.com/fresha-data-engineering/the-good-the-bad-and-the-automq-5aa7a8748e71 The Good, The Bad and The AutoMQ\. Slack’s KIP\-1176, Aiven’s Diskless 2\.0
- https://simonwillison.net/2025/Oct/16/claude-skills/ Claude Skills are awesome, maybe a bigger deal than MCP
# 16-10-2025
- https://www.youtube.com/watch?v=dthbi4lzO58 AI Could Wipe Out the Working Class | Sen\. Bernie Sanders
# 02-10-2025
- https://assets.anthropic.com/m/12f214efcc2f457a/original/Claude-Sonnet-4-5-System-Card.pdf Claude Sonnet 4\.5 System Card
# 28-09-2025
- https://blog.dataengineerthings.org/the-case-for-hybrid-cache-for-object-stores-4b1f02ec6c9a The Case for Hybrid Cache for Object Stores
- https://newsletter.pragmaticengineer.com/p/how-claude-code-is-built How Claude Code is built
- https://www.infoq.com/podcasts/ai-ml-data-engineering-trends-2025 AI, ML, and Data Engineering InfoQ Trends Report 2025 \- InfoQ
> Transcript Introductions \[00:30\] Srini Penchikala: Hello everyone\. Welcome to the 2025 AI and ML Trends Report podcast\. Greetings from the InfoQ, AI/ML and data engineering team\. Today we also have a special guest for this year's trends report discussion\. This podcast is part of our annual report to
# 26-09-2025
- https://blog.cloudflare.com/cloudflare-data-platform/ Announcing the Cloudflare Data Platform: ingest, store, and query your data directly on Cloudflare
# 23-09-2025
- https://github.com/MagicBeansAI/magictunnel Smart MCP Proxy \- One intelligent tool that discovers the right tool for any request\.
# 16-09-2025
- https://andrewchen.substack.com/p/ai-will-change-how-we-build-startups AI will change how we build startups \-\- but how?
# 09-09-2025
- https://dataengineeringcentral.substack.com/p/medallion-architecture-truth-or-fiction Medallion Architecture\. Truth or Fiction?
# 07-09-2025
- https://www.reddit.com/r/ClaudeAI/comments/1lkfz1h/how_i_use_claude_code/ How I use Claude Code : r/ClaudeAI
# 06-09-2025
- https://www.pagerduty.com/eng/august-28-kafka-outages-what-happened-and-how-were-improving/ August 28 Kafka Outages – What Happened and How We’re Improving
# 31-08-2025
- https://arxiv.org/pdf/2410.06351 Moving Faster and Reducing Risk: Using LLMs in Release Deployment
- https://grafana.com/blog/2025/08/22/how-to-monitor-your-homelab-with-beyla-ebpf-and-opentelemetry/ How to monitor with Beyla, eBPF, and OpenTelemetry
- https://steipete.me/posts/2025/optimal-ai-development-workflow My Current AI Dev Workflow \- Very similar to mine, love it\!
# 30-08-2025
- https://levelup.gitconnected.com/what-i-learned-from-anthropic-teams-claude-code-practice-d3ddfa1d051e How Anthropic raised their level using Claude Code themselves
- https://archive.is/HowHM Andrew Ng: Product Management Is Now the Bottleneck in Startups
> the real bottleneck in AI startups isn't coding — it's product management
- https://github.com/apple/container apple/container: A tool for creating and running Linux containers using lightweight virtual machines on a Mac\. It is written in Swift, and optimized for Apple silicon\.
# 29-08-2025
- https://www.datadoghq.com/blog/engineering/rust-timeseries-engine/#throttling-under-heavy-load?utm_source=tldrdata Evolving our real\-time timeseries storage again: Built in Rust for performance at scale
- https://www.seangoedecke.com/the-simplest-thing-that-could-possibly-work/ Do the simplest thing that could possibly work
- https://blog.dataengineerthings.org/why-we-didnt-rewrite-debezium-in-rust-66c35ae9dce8 Why We Didn’t Rewrite Debezium in Rust
> we chose to build on top of the Debezium Embedded Engine and perform deep customizations\.
- https://www.datadoghq.com/blog/cloud-cost-management-saved-millions/ How we saved $1\.5 million per year with Cloud Cost Management | Datadog
> Solution was to minimize non\-current versions in S3 buckets
# 24-08-2025
- https://github.com/SudhenduP/kafka-mcp-integration Simple example of an MCP server with Kafka
- https://medium.com/@joe.njenga/use-claude-code-hooks-newest-feature-to-fully-automate-your-workflow-341b9400cfbe How I’m Using Claude Code Hooks To Fully Automate My Workflow
# 23-08-2025
- https://research.kudelskisecurity.com/2025/08/19/how-we-exploited-coderabbit-from-a-simple-pr-to-rce-and-write-access-on-1m-repositories/ How We Exploited CodeRabbit: From a Simple PR to RCE and Write Access on 1M Repositories
- https://rmoff.net/2025/08/18/kafka-to-iceberg-exploring-the-options/ Kafka to Iceberg \- Exploring the Options
- https://medium.com/@oscarpulido55/iceberg-ahead-navigating-the-three-flavors-of-iceberg-on-bigquery-e004eec18d5c Navigating the Three Flavors of Iceberg on BigQuery
- https://www.chkk.io/ Chkk Upgrade Copilot for Open Source
> Agentic Upgrades for Open Source Software
- https://developers.redhat.com/articles/2025/08/21/hidden-pitfalls-kafka-tiered-storage#key_configurations The hidden pitfalls of Kafka tiered storage
# 12-08-2025
- https://www.maginative.com/article/google-announces-new-ai-agents-for-data-analysis-science/ Google Announces New AI Agents for Data Analysis & Science
- https://seattledataguy.substack.com/p/the-inconvenient-truths-of-self-service The Inconvenient Truths of Self\-Service Analytics
# 07-08-2025
- https://cyata.ai/blog/cracking-the-vault-how-we-found-zero-day-flaws-in-authentication-identity-and-authorization-in-hashicorp-vault/ Cracking the Vault: how we found zero\-day flaws in authentication, identity, and authorization in HashiCorp Vault
# 06-08-2025
- https://sderosiaux.github.io/vc-story/ It's Not 2021 Anymore | The Real Story of VC\-Backed Startups
# 03-08-2025
- https://kashw1n.com/blog/nodejs-2025/ Modern Node\.js Patterns for 2025
- https://blog.puzzmo.com/posts/2025/07/30/six-weeks-of-claude-code/ 6 Weeks of Claude Code
# 29-07-2025
- https://medium.com/@community_md101/what-is-a-data-marketplace-and-why-your-organisation-needs-it-today-60f06c12be53 What is a Data Marketplace
- https://engineering.fb.com/2025/07/23/security/policy-zones-meta-purpose-limitation-batch-processing-systems/ Policy Zones: How Meta enforces purpose limitation at scale in batch processing systems \- Engineering at Meta
> The restrictions on downstream data must be equal to or more restrictive than those of the upstream source from which the data originates
# 27-07-2025
- https://intelligence.org/the-problem/ The Problem
> Mitigating the risk of extinction from AI should be a global priority alongside other societal\-scale risks such as pandemics and nuclear war\.
- https://dynomight.net/wanting The AI safety problem is "wanting"
# 20-07-2025
- https://www.youtube.com/watch?v=WWoyWNhx2XU Anthropic co\-founder: AGI predictions, leaving OpenAI, what keeps him up at night
- https://isovalent.com/blog/post/cilium-netkit-a-new-container-networking-paradigm-for-the-ai-era/ Cilium netkit: The Final Frontier in Container Networking Performance
- https://www.youtube.com/watch?v=5QcCeSsNRks François Chollet: How We Get To AGI
- https://medium.com/@lucascarrasquillaparra/chat-with-your-documents-tool-rag-vector-dbs-cosine-sim-claude-api-implementation-2312cf14c67a RAG \(vector DBs \+ cosine sim\.\) & Claude API implementation
- https://github.com/qdhenry/Claude-Command-Suite/tree/main commands for Claude Code that provide structured workflows for software development tasks including code review, feature creation, security auditing, and architectural analysis\.
- https://sootyempiric.blogspot.com/2025/07/comparisons-between-life-in-uk-and-usa.html Comparisons Between Life in the UK and the USA
# 19-07-2025
- https://x.com/alexwei_/status/1946477742855532918 I’m excited to share that our latest @OpenAI experimental reasoning LLM has achieved a longstanding grand challenge in AI: gold medal-level performance on the world’s most prestigious math competition—the International Math Olympiad (IMO)
- https://nigeltao.github.io/blog/2020/jsonptr.html Jsonptr: Using Wuffs’ Memory-Safe, Zero-Allocation JSON Decoder
> hermetic
# 18-07-2025
- https://newsletter.pragmaticengineer.com/p/the-pulse-140 The Pulse #140: Does Cursor make developers less effective?
- https://sankalp.bearblog.dev/my-claude-code-experience-after-2-weeks-of-usage/ My Experience With Claude Code After 2 Weeks of Adventures
# 14-07-2025
- https://thenewstack.io/ebpf-has-a-bright-future-in-infrastructure-development/ eBPF Has a Bright Future in Infrastructure Development
# 13-07-2025
- https://aeon.co/essays/consciousness-is-not-a-thing-but-a-process-of-inference Consciousness is not a thing, but a process of inference
> an agent or a self: something that engages in proactive, purposeful inference about its own future, based on a thick model of time.
- https://substack.gauravvohra.com/p/search-is-dead-long-live-llms-winning-in-the-era-of-llms-ai-overviews-and-geo SEO Is Dead. Long Live GEO
# 07-07-2025
- https://www.youtube.com/watch?v=5QcCeSsNRks François Chollet: How We Get To AGI
- https://seattledataguy.substack.com/p/speed-without-understanding-one-of Speed Without Understanding - One of the Biggest Risks in Data Engineering
- https://www.infoq.com/news/2025/06/linkedin-northguard-xinfra LinkedIn Announces Northguard and Xinfra: Scaling beyond Kafka for Log Storage and Pub/Sub
- https://github.com/bjaggi/acl-to-cc-rbac-utility Tool to migrate MSK stuff (topics, schemas, acls etc.) to Confluent Cloud
# 06-07-2025
- https://sderosiaux.medium.com/you-dont-need-a-data-owner-until-you-do-363ff250aa4b You Don’t Need a Data Owner. Until You Do.
- https://blog.zomato.com/apache-flink-journey-zomato-from-inception-to-innovation Apache Flink Journey @Zomato: From Inception to Innovation
- https://debezium.io/blog/2025/06/13/openlineage-integration/ Native data lineage in Debezium with OpenLineage
> Data lineage is the process of tracking the flow and transformations of data from its origin to its final destination.
# 05-07-2025
- https://www.mckinsey.com/capabilities/quantumblack/our-insights/seizing-the-agentic-ai-advantage GenAI paradox: exploring AI use cases | McKinsey
> Data accessibility and quality gaps. These gaps tend to exist for both structured and unstructured data, with unstructured material remaining largely ungoverned in most organizations.
- https://www.mckinsey.com/capabilities/people-and-organizational-performance/our-insights/the-future-of-work-is-agentic Building and managing an agentic AI workforce | McKinsey
# 04-07-2025
- https://juhache.substack.com/p/boring-semantic-layer-mcp Boring Semantic Layer + MCP = 🔥
# 03-07-2025
- https://gradientflow.substack.com/p/how-to-future-proof-your-ai-governance How to future-proof your AI governance strategy
- https://newsletter.pragmaticengineer.com/p/the-10x-overlemployed-engineer The 10x “overlemployed” engineer 
# 01-07-2025
- https://github.com/nimtable/nimtable nimtable/nimtable: The Control Plane for Apache Iceberg.
- https://clickhouse.com/blog/why-openai-uses-clickhouse-for-petabyte-scale-observability Why OpenAI chose ClickHouse for petabyte-scale observability
# 30-06-2025
- https://wangjunfei.com/2025/02/10/Announcing-Stonemq-A-high-performance-and-efficient-message-queue-developed-in-Rust/ Stonemq: A high-performance and efficient message queue developed in Rust
# 29-06-2025
- https://medium.com/@elisowski/databricks-vs-microsoft-fabric-which-one-is-best-for-your-data-needs-6154310084cc Databricks vs Microsoft Fabric
# 22-06-2025
- https://www.youtube.com/watch?v=LCEmiRjPEtQ (46) Andrej Karpathy: Software Is Changing (Again)
# 21-06-2025
- https://medium.com/@hugolu87/everything-from-the-databricks-2025-summit-8c257aa44dee Everything from the Databricks 2025 summit
- https://sanjmo.medium.com/the-era-of-passive-data-management-is-over-what-cdos-must-do-now-to-drive-ai-driven-9d2ea531806b The Era of Passive Data Management is Over; What CDOs Must Do (Now) to Drive AI-driven Transformation
# 12-06-2025
- https://www.reddit.com/r/apachekafka/comments/1l9p6z0/costeffective_logging_at_scale_sharechats_journey/ Cost-Effective Logging at Scale: ShareChat’s Journey to WarpStream : r/apachekafka
- https://medium.com/@richardhightower/is-rag-dead-anthropic-says-no-290acc7bd808 Is Contextual Retrieval the new RAG?
# 11-06-2025
- https://zuplo.com/docs/handlers/mcp-server From OpenAPI to MCP in 2sec
# 09-06-2025
- https://www.ibm.com/downloads/documents/gb-en/12f5a71117cdc329 Agentic AI in Financial Services - Opportunities, Risks, and Responsible Implementation
# 04-06-2025
- https://medium.com/@elisowski/mcp-explained-the-new-standard-connecting-ai-to-everything-79c5a1c98288 MCP Explained: The New Standard Connecting AI to Everything
# 01-06-2025
- https://longform.asmartbear.com/more-or-less/ More for more / More for less / Less for less strategies
# 29-05-2025
- https://www.streamingdata.tech/p/current-london-2025 Current London 2025 - by Yaroslav Tkachenko
# 26-05-2025
- https://www.youtube.com/watch?v=2-yrkW-nhlU Claude Sonnet Called the FBI (virtually) Over a $2 Vending Machine
- https://lp.eptura.com/rs/267-JUP-120/images/2025%20Workplace%20Index_TL-EPT-2222-EN%201.pdf?version=0 2025 Workplace Index - Return To Office & AI stuff
- https://www.youtube.com/watch?v=vtIzMaLkCaM The Craft of Writing Effectively - we write to *change* readers' ideas/world
# 25-05-2025
- https://github.com/JorianWoltjer/mcp-cli mcp-cli: CLI to interact with and list Model Context Protocol (MCP) servers in SSE (Server-Sent Events) transport mode
- https://blog.jaisal.dev/articles/mcp MCP: May Cause Pwnage - MANY Backdoors in Disguise
- https://seanfalconer.medium.com/how-kafka-flink-databricks-and-neon-power-the-modern-stack-for-ai-agents-6c7e4599567f How Kafka, Flink, Databricks, and Neon Power the Modern Data Stack for AI Agents
- https://ainativedev.io/news/text-diffusion Is Text Diffusion for Code a Game Changer? dLLM
- https://blog.det.life/data-engineering-now-with-30-more-bullshit-b9de5f81f8c2 Data Engineering: Now with 30% More Bullshit
# 24-05-2025
- https://www.infoq.com/articles/rethinking-medallion-architecture/ The End of the Bronze Age: Rethinking the Medallion Architecture
- https://medium.com/snowflake/how-to-clean-and-enrich-data-before-it-lands-in-snowflake-5bc937486b82 How to Clean and Enrich Data Before It Lands in Snowflake
# 23-05-2025
- https://moderndata101.substack.com/p/the-role-of-the-data-architect The Role of the Data Architect in AI Enablement
- https://www.anthropic.com/news/claude-4 Introducing Claude 4 \ Anthropic
# 16-05-2025
- https://www.infoq.com/articles/practical-design-patterns-modern-ai-systems/ Beyond the Gang of Four: Practical Design Patterns for Modern AI Systems
# 15-05-2025
- https://batteryventures.substack.com/p/ai-is-growing-our-appetite-for-saas AI Is Growing Our Appetite for SaaS, Not Destroying It
# 10-05-2025
- https://scet.berkeley.edu/the-next-next-big-thing-agentic-ais-opportunities-and-risks/ The Next “Next Big Thing”: Agentic AI’s Opportunities and Risks
- https://www.promptfiddle.com/ Prompt Fiddle using BAML #promptengineering
# 07-05-2025
- https://www.microsoft.com/en-us/microsoft-cloud/blog/2025/05/07/empowering-multi-agent-apps-with-the-open-agent2agent-a2a-protocol/ Empowering multi-agent apps with the open Agent2Agent (A2A) protocol
# 06-05-2025
- https://current.confluent.io/post-conference-videos-2025/re-engineering-kafka-consumers-for-india-scale-dream11s-journey-to-processing-millions-of-message-bng25 Re-engineering Kafka Consumers for 'India Scale': Dream11’s Journey to Processing Millions of Message
- https://www.datadoghq.com/blog/engineering/streaming-platform-kafka-custom-abstractions/ Achieving relentless Kafka reliability at scale with the Streaming Platform
# 05-05-2025
- https://www.khoslaventures.com/the-opportunity-for-ai-in-healthcare-is-here-now/ The Opportunity for AI in Healthcare is here now
- https://www.docker.com/blog/build-to-prod-mcp-servers-with-docker/ How to build and deliver an MCP server for production
- https://github.com/cloudflare/mcp-server-cloudflare mcp-server-cloudflare
- https://longform.asmartbear.com/purgatory/ Product Purgatory: When they love it but still don’t buy
# 04-05-2025
- https://www.anthropic.com/news/integrations Claude can now connect to your world \ Anthropic
- https://medium.com/data-science-collective/agentic-ai-comparing-new-open-source-frameworks-21ec676732df Agentic AI: Comparing New Open-Source Frameworks
- https://blog.metamirror.io/zero-copy-a-modern-data-fantasy-a28b535b6bfa “Zero-Copy” a modern data fantasy
# 30-04-2025
- https://github.com/mcp-ecosystem/mcp-gateway mcp-ecosystem/mcp-gateway: MCP Gateway - A lightweight gateway service that transforms APIs into MCP servers
# 29-04-2025
- https://www.decodable.co/blog/agentic-ai-will-make-things-worse-before-it-makes-them-better Agentic AI Will Make Things Worse Before It Makes Them Better
- https://drive.google.com/file/d/10zJPuXAzEBIdnwSH14IQmt9KwQPyxMRV/view NEXT 25 DEVLT-202 - [Rubens de Almeida Zimbres] [Next25 - Lightning Talk]
# 26-04-2025
- https://ai.meta.com/blog/llama-4-multimodal-intelligence/ The Llama 4 herd: The beginning of a new era of natively multimodal AI innovation
- https://blog.owulveryck.info/2025/04/22/mcps-3-us-making-a-tool-useful-usable-and-used-by-and-for-an-llm.html MCP's 3 U's: Making a Tool Useful, Usable, and Used by and for an LLM #ontology
- https://codemia.io/blog/path/Apache-Kafka-40-Deep-Dive-Breaking-Changes-Migration-and-Performance Apache Kafka 4.0 Deep Dive: Breaking Changes, Migration, and Performance
- https://www.infoq.com/news/2025/04/azure-mcp-server-public-preview/ Azure MCP Server
- https://medium.com/google-cloud/architecting-a-multi-agent-system-with-google-a2a-and-adk-4ced4502c86a Architecting a Multi-Agent System with Google A2A and ADK
# 25-04-2025
- https://hiddenlayer.com/innovation-hub/novel-universal-bypass-for-all-major-llms/ Novel Universal Bypass for All Major LLMs
# 24-04-2025
- https://topicpartition.io/blog/kip-1150-diskless-topics-in-apache-kafka KIP-1150 in Apache Kafka is a big deal (Diskless Topics)
- https://www.youtube.com/watch?v=99HVEF7r2N4 Building Data Systems in 2025: S3 as Primary Storage: Cost, Latency, Caching Strategies
- https://a16z.com/a-deep-dive-into-mcp-and-the-future-of-ai-tooling/ A Deep Dive Into MCP and the Future of AI Tooling | Andreessen Horowitz
- https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai The State of AI: Global survey | McKinsey
- https://seanfalconer.medium.com/the-ai-silo-problem-how-data-streaming-can-unify-enterprise-ai-agents-0a138cf6398c The AI Silo Problem: How Data Streaming Can Unify Enterprise AI Agents
# 23-04-2025
- https://menlovc.com/perspective/the-modern-ai-stack-design-principles-for-the-future-of-enterprise-ai-architectures/ The Modern AI Stack: Design Principles for the Future of Enterprise AI Architectures - Menlo Ventures
# 21-04-2025
- https://moderndata101.substack.com/p/introducing-lakehouse-20-what-changes Lakehouse 2.0, decentralization
# 13-04-2025
- https://seanfalconer.medium.com/how-to-build-a-multi-agent-orchestrator-using-flink-and-kafka-4ee079351161 How to Build a Multi-Agent Orchestrator Using Flink and Kafka
# 07-04-2025
- https://www.datadoghq.com/blog/focus-and-datadog/ Simplify Multi-Cloud Cost Management With FOCUS and Datadog
# 04-04-2025
- https://gradientflow.substack.com/p/autonomous-ai-agents-are-changing Autonomous AI Agents Are Changing Knowledge Work—Fast
# 31-03-2025
- https://www.responsive.dev/blog/performance-optimization-kafka-streams-101 Kafka Streams 101: Optimizing your apps for maximum performance
- https://speakerdeck.com/angioia/building-your-enterprise-knowledge-graph-one-data-product-at-a-time Building your Enterprise Knowledge Graph one data product at a time
# 27-03-2025
- https://vutr.substack.com/p/bufstream-stream-kafka-messages-to Bufstream: Stream Kafka Messages to Iceberg Tables in Minutes
# 24-03-2025
- https://www.allthingsdistributed.com/2025/03/in-s3-simplicity-is-table-stakes.html In S3 simplicity is table stakes
# 23-03-2025
- https://medium.com/@danthelion/we-need-to-talk-about-byoc-b58c506aec4d We Need To Talk About BYOC.
- https://quesma.com/blog-detail/aiops-observability Lessons from the pre-LLM AI in Observability: Anomaly Detection and AIOps vs. P99
- https://www.infoq.com/articles/secure-ai-powered-early-detection-system/ Secure AI-Powered Early Detection System for Medical Data Analysis & Diagnosis
- https://medium.com/quantumblack/solving-data-quality-for-gen-ai-applications-11cbec4cbe72 Solving data quality for gen AI applications and unstructured documents
- https://levelup.gitconnected.com/chain-of-draft-cod-is-the-new-king-of-prompting-techniques-d9dc17f12051 Chain-of-Draft (CoD): TLDR: think step by step, 5 words minimum for each step
- https://www.gartner.com/doc/reprints?id=1-2HKZSYYT&ct=240516&st=sb Trending Questions About Generative AI (Gartner)
- https://medium.com/everyday-ai/craziest-mcp-servers-you-must-try-f23526a165f5 (not-so) Craziest MCP Servers You Must Try
# 22-03-2025
- https://a16z.com/a-deep-dive-into-mcp-and-the-future-of-ai-tooling/ A Deep Dive Into MCP and the Future of AI Tooling
- https://medium.com/@andrew_schofield/early-access-release-of-queues-for-kafka-in-apache-kafka-4-0-0ae2f3f69ac9 Early access release of Queues for Kafka in Apache Kafka 4.0
# 21-03-2025
- https://redpanda-data.medium.com/apache-iceberg-topics-stream-directly-into-your-data-lake-0250a8dfdd76 Apache Iceberg Topics: Stream directly into your data lake
# 20-03-2025
- https://seanfalconer.medium.com/the-future-of-ai-agents-is-event-driven-9e25124060d6 The Future of AI Agents is Event-Driven
- https://lazypro.medium.com/evolution-of-rag-baseline-rag-graphrag-and-kag-93b6f221bde6 Evolution of RAG: RAG, GraphRAG, and KAG
- https://medium.com/@getindatatechteam/the-evolution-of-real-time-data-streaming-in-business-7b4d24fe1af3 The Evolution of Real-Time Data Streaming in Business
# 15-03-2025
- https://seattledataguy.substack.com/p/5-hard-earned-lessons-in-building 5 Hard-Earned Lessons in Building a Successful Data Career: Embracing Mistakes and Driving Impact
# 12-03-2025
- https://buf.build/blog/bufstream-multi-region Multi-region, active-active Bufstream at 100 GiB/s
# 08-03-2025
- https://www.reddit.com/r/apachekafka/comments/1j5mszx/kafka_dr_strategy_handling_producer_failover_with/ Kafka DR Strategy - Handling Producer Failover with Conduktor
- https://www.blef.fr/data-news-week-25-10/ Data News — AI, dbt, SQLMesh, data teams
# 06-03-2025
- https://www.infoq.com/presentations/firewall-java-ebpf/ Building a Lightning Fast Firewall with Java & eBPF
- https://www.nationalsecurity.ai/ Superintelligence Strategy
- https://vutr.substack.com/p/how-is-databricks-spark-different How is Databricks' Spark different from Open-Source Spark?
# 03-03-2025
- https://www.infoq.com/presentations/zero-trust-devsecops/ A Zero Trust Future for Applications: Practical Implementation and Pitfalls
# 02-03-2025
- https://morganperry.substack.com/p/devtools-brew-71-early-revenue-illusion Early Revenue Illusion & Building Companies That Last. — As founder, this article is clearly spot-on!
# 01-03-2025
- https://www.databricks.com/blog/improving-retrieval-and-rag-embedding-model-finetuning Improving Retrieval and RAG with Embedding Model Finetuning
# 22-02-2025
- https://grafana.com/blog/2025/02/20/the-next-generation-of-grafana-mimir-inside-mimirs-redesigned-architecture-for-increased-reliability/ The next generation of Grafana Mimir: Inside Mimir's redesigned architecture for increased reliability
# 18-02-2025
- https://thedatasource.substack.com/p/engineering-byoc-enterprise-startups Engineering BYOC: Enterprise Startups Share Their Playbooks
# 16-02-2025
- https://www.anthropic.com/news/the-anthropic-economic-index Introducing the Anthropic Economic Index
- https://www.hotds.dev/p/humans-of-the-data-sphere-issue-8 Humans of the Data Sphere Issue #8
- https://www.stream.security/post/toxic-combination-real-time-agents-on-top-static-cspm Toxic Combination: The Pitfalls of layering real-time agents on top of Static CSPM
- https://kai-waehner.medium.com/real-time-model-inference-with-apache-kafka-and-flink-for-predictive-ai-and-genai-bf9459f66c13 Real-Time Model Inference with Apache Kafka and Flink for Predictive AI and GenAI
# 12-02-2025
- https://www.warpstream.com/blog/kafka-transactions-explained-twice Kafka Transactions Explained
- https://www.infoq.com/articles/building-trust-ai/ Building Trust in AI: Security and Risks in Highly Regulated Industries
# 11-02-2025
- https://defragzone.substack.com/p/techs-dumbest-mistake-why-firing (9) Tech's Dumbest Mistake: Why Firing Programmers for AI Will Destroy Everything
# 10-02-2025
- https://medium.com/codex/google-just-annihilated-deepseek-and-openai-with-their-new-flash-2-0-model-f5ac84b4bb60 Gemini Flash 2.0 is the new pop
- https://blog.cloudflare.com/cloudflare-incident-on-february-6-2025/ Cloudflare incident on February 6, 2025
# 05-02-2025
- https://www.datadoghq.com/blog/data-jobs-monitoring/ Troubleshoot and Optimize Data Processing Workloads With Data Jobs Monitoring
- https://medium.com/@msakhatsky/modern-data-architectures-explained-a9a4e0c8d8ed Modern Data Architectures Explained
# 04-02-2025
- https://www.nextdata.com/our-pov/the-data-mesh-challenge-how-to-close-the-gap-between-inception-and-operation-at-scale The data mesh challenge: closing the gap between strategy and operation at scale (high level generic stuff)
- https://journalofbigdata.springeropen.com/articles/10.1186/s40537-021-00468-0 Big data quality framework: a holistic approach to continuous quality management
- https://jack-vanlightly.com/blog/2025/2/3/why-snowflake-wants-streaming Why Snowflake wants streaming — Jack Vanlightly
- https://www.linkedin.com/pulse/more-freedom-means-problems-cost-decentralization-st%C3%A9phane-derosiaux-15bxe/ More Freedom means More Problems (the cost of decentralization) #me
- https://futurism.com/deepseek-failed-every-security-test DeepSeek Failed Every Single Security Test, Researchers Found
# 03-02-2025
- https://youtubetranscriptoptimizer.com/blog/05_the_short_case_for_nvda The Short Case for Nvidia Stock [very long article] #ai
# 02-02-2025
- https://restate.dev/blog/every-system-is-a-log-avoiding-coordination-in-distributed-applications/ Every System is a Log: Avoiding coordination in distributed applications Restate
# 01-02-2025
- https://www.linkedin.com/pulse/subtle-art-cost-comparisons-tristan-stevens-tqtue/ The subtle art of cost comparisons #kafka #redpanda #warpstream
# 30-01-2025
- https://www.datadoghq.com/blog/engineering/husky-storage-compaction/ Husky: Efficient Compaction at Datadog Scale | Datadog
- https://newsletter.pragmaticengineer.com/p/the-pulse-122-deepseek-rocks-the The Pulse #122: DeepSeek rocks the tech industry
- https://blog.det.life/stream-processing-systems-in-2025-risingwave-flink-spark-streaming-and-whats-ahead-6e24927f7d8b Stream Processing Systems in 2025: RisingWave, Flink, Spark Streaming, and What’s Ahead
# 21-01-2025
- https://seanfalconer.medium.com/event-driven-ai-building-a-research-assistant-with-kafka-and-flink-e95db47eb3f3 Event-Driven AI: Building a Research Assistant with Kafka and Flink
- https://startree.ai/resources/disaggregating-observability-with-kafka-startree-grafana Disaggregated Observability Stack with Kafka, StarTree, & Grafana
# 20-01-2025
- https://www.lesswrong.com/posts/njAZwT8nkHnjipJku/alignment-faking-in-large-language-models Alignment Faking in Large Language Models
# 19-01-2025
- https://dataengineeringcentral.substack.com/p/data-quality-with-databricks-labs Data Quality with Databricks Labs new DQX tool
- https://blog.det.life/aws-s3-tables-what-it-means-for-apache-iceberg-and-the-data-ecosystem-4a1f6b978b22 AWS S3 Tables: What it Means for Apache Iceberg and the Data Ecosystem
- https://blog.stackademic.com/linux-creator-reveals-the-future-of-programming-with-ai-91455af6747e AI will change the way we code, but it will be a gradual evolution, not a sudden revolution.
- https://mill-build.org/blog/6-garbage-collector-perf.html Understanding JVM Garbage Collector Performance
# 18-01-2025
- https://www.latent.space/p/o1-skill-issue o1 isn’t a chat model: it needs your goal, some eventual warnings, and a massive context dump to do its job properly. Like a junior person.
# 15-01-2025
- https://materializedview.io/p/infrastructure-vendors-are-in-a-tough Infrastructure Vendors Are in a Tough Spot, Confluent, Warpstream, Kafka
# 13-01-2025
- https://sanjmo.medium.com/2025-enterprise-data-ai-trends-agents-platforms-and-moonshots-0010c8b4d1f3 2025 Enterprise Data & AI Trends: Agents, Platforms, and Moonshots
# 12-01-2025
- https://lukaspetersson.com/blog/2025/bitter-vertical/ AI founders will learn The Bitter Lesson
- https://medium.com/@yingjunwu/data-engineers-why-you-really-need-to-learn-ai-61e408fa38df Data Engineers: Why You Really Need to Learn AI
- https://www.dataengineeringweekly.com/p/the-future-of-data-lakehouses-a-fireside The Future of Data Lakehouses: A Fireside Chat with Vinoth Chandar - Founder CEO Onehouse & PMC Chair of Apache Hudi
- https://matduggan.com/stop-trying-to-schedule-a-call-with-me/ Stop Trying To Schedule A Call With Me
# 11-01-2025
- https://www.youtube.com/watch?v=w9WE1aOPjHc François Chollet / Machine Learning Street Talk #podcast
- https://qlikdork.com/2024/12/visualizing-dimensional-relationships/ Visualizing Dimensional Relationships: Sankey and Decomposition Tree #dataviz
- https://iconsolutions.com/blog/i-got-opentelemetry-to-work-but-why-was-it-so-complicated/ I got OpenTelemetry to work. But why was it so complicated? #otel
# 09-01-2025
- https://unzip.dev/0x01f-ai-and-startup-moats/ AI and Startup Moats
# 06-01-2025
- https://blog.practicalengineering.management/the-changing-engineering-landscape-and-how-to-stay-ahead-of-it-1bcdf9d63f6a The Changing Engineering Landscape and How to Stay Ahead of It
# 05-01-2025
- https://zohaib.me/using-llms-and-cursor-for-finishing-projects-productivity/ Using LLMs and Cursor to become a finisher
# 03-01-2025
- https://minimaxir.com/2025/01/write-better-code/ Can LLMs write better code if you keep asking them to “write better code”?
# 02-01-2025
- https://www.cs.cmu.edu/~pavlo/blog/2025/01/2024-databases-retrospective.html Databases in 2024: A Year in Review
- https://simonwillison.net/2024/Dec/31/llms-in-2024/ Things we learned about LLMs in 2024
# 01-01-2025
- https://www.infoq.com/news/2024/12/cloudflare-2024-review-report/ Cloudflare 2024 Year in Review: Strong Growth for GitHub Copilot and Go Surpasses Node.js
# 31-12-2024
- https://aipapersacademy.com/chain-of-continuous-thought/ LLM Reasoning with Chain of Continuous Thought by Meta AI
- https://aipapersacademy.com/chain-of-continuous-thought/ LLM Reasoning with Chain of Continuous Thought by Meta AI
# 23-12-2024
- https://newsletter.betterstack.com/p/how-dropbox-saved-millions-of-dollars How Dropbox Saved Millions of Dollars by Building a Load Balancer
# 22-12-2024
- https://www.youtube.com/watch?v=tOGK1nlHdFo Lenny & Marc Benioff (salesforce)
- https://www.vldb.org/pvldb/vol16/p3335-butrovich.pdf Tigger: A Database Proxy That Bounces With User-Bypass
- https://www.youtube.com/watch?v=vD-0dw4gUhw P99 CONF 2024 | The Next Chapter in the Sordid Love/Hate Relationship Btwn DBs & OSes by Andy #ebpf
# 21-12-2024
- https://cdn.openai.com/papers/practices-for-governing-agentic-ai-systems.pdf practices-for-governing-agentic-ai-systems.pdf
- https://www.responsive.dev/blog/kafka-streams-2024-year-in-review Kafka Streams Wrapped: 2024 in review
- https://medium.com/building-the-open-data-stack/a-guide-to-agentic-ai-architecture-c665f2ba30c2 A Guide to Agentic AI Architecture | Building Real-World, Real-Time AI
# 20-12-2024
- https://arcprize.org/blog/oai-o3-pub-breakthrough OpenAI o3 Breakthrough High Score on ARC-AGI-Pub
# 19-12-2024
- https://www.dataengineeringweekly.com/p/the-future-of-data-engineering-dews (4) The Future of Data Engineering: DEW's 2025 Predictions
# 17-12-2024
- https://towardsdatascience.com/top-10-data-ai-trends-for-2025-4ed785cafe16 Top 10 Data & AI Trends for 2025. Agentic AI, small data
- https://www.dataengineeringweekly.com/p/the-state-of-data-engineering-in The State of Data Engineering in 2024: Key Insights and Trends
# 16-12-2024
- https://thealliance.ai/blog/the-state-of-open-source-trust The State of Open Source AI Trust and Safety - End of 2024 Edition
- https://dataengineeringcentral.substack.com/p/aws-s3-tables-the-iceberg-cometh AWS S3 Tables?! The Iceberg Cometh
- https://www.kai-waehner.de/blog/2024/12/04/the-data-streaming-landscape-2025/ The Data Streaming Landscape 2025
# 15-12-2024
- https://meltware.com/2024/12/04/s3-tables A First Look at S3 (Iceberg) Tables
- https://gradientflow.substack.com/p/empowering-ai-agents-with-real-time Empowering AI Agents with Real-Time Data
- https://towardsdatascience.com/agentic-mesh-the-future-of-generative-ai-enabled-autonomous-agent-ecosystems-d6a11381c979 Agentic Mesh: The Future of Generative AI-Enabled Autonomous Agent Ecosystems. // i find this overthinking what exist today (it's called applications) but good to know
- https://karetech.medium.com/data-quality-the-path-to-striking-gold-in-your-lakehouse-24bec0fc29f6 Data Quality
- https://redmonk.com/kholterhoff/2024/12/12/why-message-queues-endure-a-history/ Why Message Queues Endure: A History
- https://grafana.com/opentelemetry-report/ OpenTelemetry: Challenges, priorities, adoption patterns, and solutions
- https://newsletter.pragmaticengineer.com/p/the-pulse-118 Particularly excited about Devin as AI agent to open PRs <3
- https://www.bigtechnology.com/p/scale-ais-alexandr-wangs-predictions Scale AI’s Alexandr Wang’s Predictions for AI In 2025: Geopolitical Turf Wars Escalate, AI Agents Progress, Data Beats Compute
- https://www.nist.gov/news-events/news/2024/08/nist-releases-first-3-finalized-post-quantum-encryption-standards NIST Releases First 3 Finalized Post-Quantum Encryption Standards | NIST
# 11-12-2024
- https://addyo.substack.com/p/the-70-problem-hard-truths-about The 70% problem: Hard truths about AI-assisted coding
# 06-12-2024
- https://www.streamingdata.tech/p/data-platforms-in-2030 Data Platforms in 2030
- https://www.streamingdata.tech/p/fluss-first-impression Fluss: First Impression
# 03-12-2024
- https://newsletter.pragmaticengineer.com/p/how-genai-changes-tech-hiring How GenAI is reshaping tech hiring
- https://towardsdatascience.com/your-data-quality-checks-are-worth-less-than-you-think-c8bd181a1327 "Nobody’s winning awards for generating pages and tickets for issues that couldn’t be resolved"
# 02-12-2024
- https://www.infoq.com/news/2024/11/effective-data-stream-processing/ Stream All the Things: Patterns of Effective Data Stream Processing
- https://seattledataguy.substack.com/p/thinking-like-an-owner-elevating Thinking Like an Owner: Elevating Your Data Team's Impact In 2025
# 01-12-2024
- https://mailchi.mp/fmvilas.me/schema-first-asyncapi-is-just-a-config-file Schema-first AsyncAPI is just a config file
- https://www.blackrock.com/corporate/literature/whitepaper/bii-megaforces-ai-november-2024.pdf BlackRock AI's big questions November 2024
# 24-11-2024
- https://vutr.substack.com/p/i-spent-4-hours-learning-the-architecture Architecture of BigQuery's storage engine
# 17-11-2024
- https://www.hotds.dev/p/humans-of-the-data-sphere-issue-2 Humans of the Data Sphere Issue #kafka #streaming
# 13-11-2024
- https://medium.com/@louise.de.leyritz/tracing-value-6-use-cases-for-data-lineage-fae59cd5a971 Tracing Value: 6 Use Cases for Data Lineage
- https://www.hashicorp.com/blog/rotated-vs-dynamic-secrets-which-should-you-use Rotated vs. dynamic secrets: Which should you use?
# 03-11-2024
- https://www.decodable.co/blog/revisiting-the-outbox-pattern Revisiting the Outbox Pattern #kafka
# 02-11-2024
- https://www.thenile.dev/blog/multi-tenant-rag Nile: Building successful multi-tenant RAG applications
- https://www.responsive.dev/blog/why-slatedb-for-kafka-streams RocksDB vs SlateDB for Stream Processing #kafka #cost
- https://www.databricks.com/customers/coinbase/streaming The boom of SOON | Databricks Customer Story
- https://www.linkedin.com/pulse/how-confluent-acquired-warpstream-220m-after-just-13-months-hxgyf How Confluent acquired WarpStream for $220m after just 13 months of operation
# 30-10-2024
- https://www.siliconcontinent.com/p/the-strange-kafka-world-of-the-eu The Strange Kafka World of the EU AI Act
# 26-10-2024
- https://yokota.blog/2021/08/26/understanding-protobuf-compatibility/ Understanding Protobuf Compatibility
- https://ai.meta.com/blog/meta-llama-quantized-lightweight-models/ Introducing quantized Llama models with increased speed and a reduced memory footprint
# 25-10-2024
- https://www.felicis.com/insight/unstructured-data-stack The three components of the unstructured data stack
- https://seattledataguy.substack.com/p/should-you-build-a-custom-data-orchestration Should You Build a Custom Data Orchestration System?
# 24-10-2024
- https://moderndata101.substack.com/p/the-power-combo-of-ai-agents The Power Combo of AI Agents and the Modular Data Stack: AI that Reasons
# 20-10-2024
- https://towardsdatascience.com/safeguarding-your-rag-pipelines-a-step-by-step-guide-to-implementing-llama-guard-with-llamaindex-6f80a2e07756 Safeguarding Your RAG Pipelines: A Step-by-Step Guide to Implementing Llama Guard with LlamaIndex
- https://towardsdatascience.com/how-to-choose-the-architecture-for-your-genai-application-6053e862c457 How to Choose the Architecture for Your GenAI Application
- https://docs.kleiber.me/2023-12-29-Kleiber-A-Primer-On-LLM-Security.pdf A Primer on LLM Security
# 19-10-2024
- https://medium.com/@community_md101/metrics-focused-data-strategy-with-model-first-data-products-d2e5d23de7b9 Metrics-Focused Data Strategy with Model-First Data Products
- https://kai-waehner.medium.com/the-shift-left-architecture-from-batch-and-lakehouse-to-data-streaming-d1ea7306ea30 The Shift Left Architecture — From Batch and Lakehouse to Data Streaming
- https://towardsdatascience.com/i-fine-tuned-the-tiny-llama-3-2-1b-to-replace-gpt-4o-7ce1e5619f3d I Fine-Tuned the Tiny Llama 3.2 1B to Replace GPT-4o
# 18-10-2024
- https://nabeelqu.substack.com/p/reflections-on-palantir Reflections on Palantir
- https://medium.nandos.dev/running-a-modern-data-platform-at-nandos-part-2-2-data-mesh-and-data-contracts-1d1937b6cac6 Running a Modern Data Platform at Nando’s #datamesh
# 09-10-2024
- https://towardsdatascience.com/how-to-choose-the-architecture-for-your-genai-application-6053e862c457 How to Choose the Architecture for Your GenAI Application
# 05-10-2024
- https://www.kai-waehner.de/blog/2024/10/04/what-is-microsoft-fabric-for-azure-cloud-beyond-the-buzz-and-how-it-competes-with-snowflake-and-databricks/ What is Microsoft Fabric for Azure Cloud and how it Competes with Snowflake and Databricks
# 29-09-2024
- https://pub.towardsai.net/not-rag-but-rag-fusion-understanding-next-gen-info-retrieval-477788da02e2 RAG Fusion: Understanding "Next-Gen" Info Retrieval
# 28-09-2024
- https://jack-vanlightly.com/blog/2024/9/26/table-format-interoperability-future-or-fantasy Table format interoperability, future or fantasy?
# 23-09-2024
- https://dropbox.tech/security/how-we-use-lakera-guard-to-secure-our-llms How we use Lakera Guard to secure our LLMs - Dropbox
- https://blog.flipkart.tech/flipkart-enhances-ai-safety-in-e-commerce-implementing-nvidia-nemo-guardrails-cb2f293b29c0 Flipkart Enhances AI Safety in E-Commerce: Implementing NVIDIA NeMo Guardrails
# 22-09-2024
- https://www.youtube.com/watch?v=-wCzn9gKoUk A Short Summary of the Last Decades of Data Management - Tables are eternal, NoSQL was a bad idea, Big data is dead, DuckDB
- https://www.youtube.com/watch?v=Sn6fVsOzrSU Current 2024 Keynote Day 1 - Data Streaming in the Age of AI #kafka
- https://www.youtube.com/watch?v=UakqL6Pj9xo Francois Chollet - LLMs won’t lead to AGI
# 21-09-2024
- https://www.dataengineeringweekly.com/p/evaluating-data-observability-tools Evaluating Data Observability Tools
- https://juhache.substack.com/p/rip-iceberg-catalogs RIP Iceberg Catalogs ? - by Julien Hurault
# 20-09-2024
- https://moderndata101.substack.com/p/semantics-and-data-product-enablement Semantics and Data Product Enablement
- https://jack-vanlightly.com/blog/2024/9/19/table-format-comparisons-change-queries-and-cdc Table format comparisons - Change queries and CDC
# 14-09-2024
- https://kostyay.com/grpc-5-years-later-is-it-still-worth-it-b181a3b2b73b gRPC: 5 Years Later, Is It Still Worth It?
- https://www.redpanda.com/blog/redpanda-one-multi-modal-streaming-data-engine Redpanda | Redpanda One
- https://jack-vanlightly.com/blog/2024/9/11/byoc-not-the-future-of-cloud-services-but-a-pillar-of-an-everywhere-platform BYOC, not “the future of cloud services” but a pillar of an everywhere platform
# 10-09-2024
- https://newsletter.pragmaticengineer.com/p/ai-tooling-part-3 AI Tooling for Software Engineers: Rolling it out company-wide (Part 3)
# 02-09-2024
- https://streamingdata.substack.com/p/streaming-first-archirecture Streaming-First Architecture
# 01-09-2024
- https://alirezasadeghi1.medium.com/the-history-and-evolution-of-open-table-formats-0f1b9ea10e1e The History and Evolution of Open Table Formats
# 31-08-2024
- https://medium.com/starrocks-engineering/how-to-accelerate-semi-structured-data-analytics-13b7ae32e34f How To Accelerate Semi-Structured Data Analytics
# 30-08-2024
- https://www.elastic.co/blog/elasticsearch-is-open-source-again Elasticsearch is Open Source, Again (AGPL)
# 29-08-2024
- https://materializedview.io/p/unpacking-the-buzz-around-clickhouse Unpacking the Buzz around ClickHouse
# 26-08-2024
- https://www.responsive.dev/blog/async-processing-for-kafka-streams Async Processing in Kafka Streams
# 25-08-2024
- https://medium.com/confluent/the-mysteries-of-kip-813-8fd2e85ac1d9 KIP-813: Shareable State Stores aka Read-only State Stores
- https://doordash.engineering/2024/08/13/doordash-engineers-with-kafka-self-serve/ DoorDash Empowers Engineers with Kafka Self-Serve
- https://martyoo.medium.com/stop-team-topologies-fd954ea26eca Stop Team Topologies. Reevaluating Team Topologies
# 24-08-2024
- https://supabase.com/blog/postgres-new postgres.new: In-browser Postgres with an AI interface
- https://www.warpstream.com/blog/dealing-with-rejection-in-distributed-systems Dealing with rejection and back-pressure (in distributed systems)
# 11-08-2024
- https://netflixtechblog.com/java-21-virtual-threads-dude-wheres-my-lock-3052540e231d Java 21 Virtual Threads - Dude, Where’s My Lock?
- https://www.timeplus.com/post/real-time-ddos-detection Real-Time AI-Powered DDoS Detection with Timeplus and OpenAI
- https://playbooks.hypergrowthpartners.com/p/devtools-website-design-principles DevTools Website Design Principles
# 04-08-2024
- https://www.osohq.com/post/kafka-sqlite-low-latency Building a resilient and low-latency service using Kafka and SQLite
- https://www.redpanda.com/blog/write-caching-performance-benchmark Redpanda adopting the same strategy as Apache Kafka regarding delayed fsyncs
# 03-08-2024
- https://aws.amazon.com/blogs/big-data/improve-apache-kafka-scalability-and-resiliency-using-amazon-msk-tiered-storage/ Improve Apache Kafka scalability and resiliency using Amazon MSK tiered storage
- https://www.mckinsey.com/capabilities/mckinsey-digital/our-insights/the-top-trends-in-tech?stcr=6025C6CA33D84B4FACD59ADC2A05E538&cid=other-eml-nsl-mip-mck&hlkid=67f3b99299784fce91b4af4207cbeebb&hctky=14255962&hdpid=7168a89b-3b02-450f-9ba3-5ceaef6f3881 McKinsey technology trends outlook 2024 | McKinsey
# 19-07-2024
- https://www.bigtechnology.com/p/the-end-of-investors-genai-honeymoon The End Of Investors’ GenAI Honeymoon
# 16-07-2024
- https://newsletter.mkt1.co/p/pricing-pages Why all B2B Startups need plans & pricing pages on their websites
# 15-07-2024
- https://streamingdata.substack.com/p/streaming-platforms-in-the-cloud-era Streaming Platforms in the Cloud Era, Warpstream #kafka
# 14-07-2024
- https://aws.amazon.com/blogs/aws/introducing-end-to-end-data-lineage-preview-visualization-in-amazon-datazone/ Introducing end-to-end data lineage (preview) visualization in Amazon DataZone
# 13-07-2024
- https://seattledataguy.substack.com/p/dont-lead-a-data-team-before-reading What it takes to Lead a Data Team
# 03-07-2024
- https://www.notion.so/blog/building-and-scaling-notions-data-lake Building and scaling Notion’s data lake: Kafka!
- https://www.decodable.co/blog/flink-sql-misconfiguration-misunderstanding-and-mishaps Flink SQL—Misconfiguration, Misunderstanding, and Mishaps
- https://jpcamara.com/2023/04/12/pgbouncer-is-useful.html PgBouncer is useful, important, and fraught with peril
- https://medium.com/@davorborcic/data-lineage-and-impact-analysis-8f16510cc089 Data Lineage and Impact Analysis.
- https://medium.com/@matvey.mtn/fixing-kafka-streams-uneven-tasks-distribution-at-logz-io-50e7ac071b5b Fixing Kafka Streams Uneven Tasks Distribution at Logz.io
# 24-06-2024
- https://towardsdatascience.com/demystify-data-backfilling-cf1713d7f7a3 Demystify Data Backfilling.
# 22-06-2024
- https://www.blef.fr/databricks-snowflake-and-the-future/ Databricks, Snowflake and the future
# 18-06-2024
- https://www.responsive.dev/blog/guide-to-kafka-streams-state Don't Panic: The Definitive Guide to Kafka Streams State
# 16-06-2024
- https://jack-vanlightly.com/blog/2024/6/10/a-cost-analysis-of-replication-vs-s3-express-one-zone-in-transactional-data-systems A Cost Analysis of Replication vs S3 Express One Zone in Transactional Data System
# 15-06-2024
- https://eng.lyft.com/druid-deprecation-and-clickhouse-adoption-at-lyft-120af37651fd Druid Deprecation and ClickHouse Adoption at Lyft
# 14-06-2024
- https://materializedview.io/p/musings-on-data-lakes-and-kafka-connect Musings on Data Lakes and Kafka Connect
# 08-06-2024
- https://en.wikipedia.org/wiki/Dead_Internet_theory Dead Internet theory
- https://pivotal.substack.com/p/how-to-price-a-data-asset How To Price A Data Asset
- https://towardsdatascience.com/why-data-is-not-the-new-oil-and-data-marketplaces-have-failed-us-b42dd87a0ba0 Why Data Is *Not* the New Oil and Data Marketplaces Have Failed Us
- https://sookocheff.com/post/compliance/the-developers-guide-to-fips-compliance/ The Developers Guide to FIPS 140 Compliance
- https://www.honeycomb.io/blog/investigating-kafka-tiered-storage Investigating Kafka Broker I/O When Using Tiered Storage
# 04-06-2024
- https://medium.com/@martin.hodges/why-do-i-need-a-service-mesh-as-well-as-a-cni-829b492398b7 Why do I need a Service Mesh as well as a CNI?
# 29-05-2024
- https://www.warpstream.com/blog/zero-disks-is-better-for-kafka Zero Disks is Better (for Kafka)
# 27-05-2024
- https://newrelic.com/blog/how-to-relic/tuning-apache-kafka-consumers Tuning Apache Kafka Consumers to maximize throughput and reduce costs
- https://blog.cloudflare.com/ai-gateway-is-generally-available AI Gateway is generally available: a unified interface for managing and scaling your generative AI workloads
- https://engineering.fb.com/2024/05/22/data-infrastructure/composable-data-management-at-meta/ Composable data management at Meta
# 20-05-2024
- https://dev.to/mrkandreev/what-is-rocksdb-and-its-role-in-streaming-3bla What is RocksDB (and its role in streaming)?
- https://medium.com/@adam.bellemare/preventing-and-fixing-bad-data-in-event-streams-part-1-27bf2a99b48e Preventing and Fixing Bad Data in Event Streams #kafka
- https://materializedview.io/p/nimble-and-lance-parquet-killers Nimble and Lance: The Parquet Killers
# 19-05-2024
- https://medium.com/israeli-tech-radar/how-to-save-90-on-bigquery-storage-a1ca99582c5c How to save 90% of BigQuery’s storage cost / Physical billing model and time travel
- https://www.meltwater.com/en/blog/how-deliveroo-uses-machine-learning-to-power-food-delivery How Deliveroo uses machine learning to power food delivery
- https://mikkeldengsoe.substack.com/p/data-about-data-from-1000-conversations Data about data from 1,000 conversations with data teams
# 15-05-2024
- https://devblogit.com/how-uber-uses-kafka/ Uber, Kafka, Dynamic Pricing
# 05-05-2024
- https://www.youtube.com/watch?v=JzT96Sju3aE Back Market: migration d'AWS vers GCP
- https://www.youtube.com/watch?v=tB78_gQ2Wy8 Lessons from Building a Large-scale, Multi-cloud Data Platform at Databricks
# 04-05-2024
- https://www.warpstream.com/blog/tiered-storage-wont-fix-kafka Tiered Storage Won’t Fix Kafka
# 03-05-2024
- https://www.blef.fr/how-to-build-a-data-team/?ref=data-news-newsletter How to build a data team
- https://www.alasdairb.com/posts/200-conversation-at-kafka-summit Conversations with 200+ people at Kafka Summit
- https://medium.com/@yingjunwu/why-stream-processing-is-a-terrible-market-yet-we-are-still-investing-in-it-43e66cef7847 Why Stream Processing is a Terrible Market (Yet We Are Still Investing in It)
- https://jack-vanlightly.com/blog/2024/5/2/hybrid-transactional-analytical-storage Hybrid Transactional/Analytical Storage
# 23-04-2024
- https://medium.com/@leal901/kafka-connect-a-love-hate-relationship-3fa69361f6e6 Kafka Connect: A Love/Hate Relationship
# 08-04-2024
- https://evaparish.com/blog/how-i-edit What I think about when I edit. (I'm a big fan of Writing Well)
# 06-04-2024
- https://romaricphilogene.substack.com/p/platform-tips-20-why-backstage-is Why Backstage is So Complex? Is There An Alternative?
- https://medium.com/pinterest-engineering/how-we-built-text-to-sql-at-pinterest-30bad30dabff How we built Text-to-SQL at Pinterest
# 03-04-2024
- https://medium.com/vvus/data-council-2024-the-future-data-stack-is-composable-and-other-hot-takes-b6c5f2429e22 Data Council 2024: The future data stack is composable
# 02-04-2024
- https://medium.com/exness-blog/streaming-data-platform-at-exness-overview-cb0ffca5844b Streaming Data Platform at Exness: Overview
# 01-04-2024
- https://assets.confluent.io/m/16b20efd116686d9/original/20240322-WP-Guide_Streaming_Data_Mesh.pd Confluent Guide Streaming Data Mesh
- https://elenaverna.substack.com/p/b2b-growth-irl-how-to-do-event-marketing?utm_source=tldrfounders B2B Growth, IRL: How to do event marketing that actually makes a difference.
# 31-03-2024
- https://medium.com/walmartglobaltech/building-walmarts-seamless-communication-leveraging-kafka-s-custom-partitioning-5d75a2ea61a0 Building Walmart’s Seamless Communication: Leveraging Kafka’s Custom Partitioning
# 26-03-2024
- https://engineering.depop.com/exploring-kafka-consumer-at-least-once-delivery-guarantees-expectations-vs-reality-36fd03e7a5e1 Exploring Kafka Consumer At-Least-Once Delivery Guarantees: Rebalancing causes, max.poll.records, Assignor!
# 24-03-2024
- https://joshaustin.tech/blog/kafka-as-an-antipattern/ Kafka As An Antipattern
# 23-03-2024
- https://jack-vanlightly.com/blog/2024/3/19/tableflow-the-stream-table-kafka-iceberg-duality Tableflow: the stream/table, Kafka/Iceberg duality
# 15-03-2024
- https://www.arroyo.dev/blog/why-arrow-and-datafusion We built a new SQL Engine on Arrow and DataFusion
# 10-03-2024
- https://www.youtube.com/watch?v=5t1vTLU7s40 Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI
- https://www.youtube.com/watch?v=IOJLFWXj4pA [DEVFEST Lille 2023] - Comment venir à bout d'un projet de migration ? Et si on utilisait Kafka ?
- https://blog.allegro.tech/2024/03/kafka-performance-analysis.html Unlocking Kafka's Potential: Tackling Tail Latency with eBPF
- https://www.warpstream.com/blog/kafka-kv-store Kafka as a KV Store: deduplicating millions of keys with just 128 MiB
- https://medium.com/paypal-tech/the-next-generation-of-data-platforms-is-the-data-mesh-b7df4b825522 The next generation of Data Platforms is the Data Mesh
- https://cwiki.apache.org/confluence/display/KAFKA/KIP-317%3A+Add+end-to-end+data+encryption+functionality+to+Apache+Kafka KIP-317: Add end-to-end data encryption functionality to Apache
# 06-03-2024
- https://seattledataguy.substack.com/p/the-state-of-data-engineering-part-b61 The State Of Data Engineering - Part 2
# 05-03-2024
- https://www.adventofdata.com/using-airflow-the-wrong-way/ Using Airflow the wrong way
# 20-02-2024
- https://materializedview.io/p/from-samza-to-flink-a-decade-of-stream From Samza to Flink: A Decade of Stream Processing
# 13-02-2024
- https://www.youtube.com/watch?v=uv52swYfStU Next Generation Data Mesh Catalogs
# 11-02-2024
- https://towardsdatascience.com/building-a-data-platform-in-2024-d63c736cccef Building a Data Platform in 2024. How to build a modern, scalable data platform
- https://piethein.medium.com/understanding-data-modelling-in-data-mesh-bf0dfcfd0583 Understanding Data Modelling in Data Mesh
# 05-02-2024
- https://svenbalnojan.medium.com/product-data-teams-101-bf0e42c2000d Product Data Teams 101
- https://blog.octo.com/data-as-a-product-pierre-angulaire-du-data-mesh Data-as-a-product: pierre angulaire du Data-Mesh
- https://towardsdatascience.com/the-data-mesh-registry-a-window-into-your-data-mesh-20dece35e05a The Data Mesh Registry — a Window into Your Data Mesh
# 04-02-2024
- https://medium.com/@dmitri.mahayana/idx-stock-real-time-data-prediction-with-flink-kafka-mongodb-526c6abf291f IDX Stock — Real Time Data Prediction with Flink-Kafka-MongoDB
- https://medium.com/decathlondigital/seamless-data-exchange-with-kafka-connect-and-strimzi-on-kubernetes-at-decathlon-e6f81d034535 Seamless data exchange with Kafka Connect and Strimzi on Kubernetes at Decathlon
- https://cnr.sh/essays/what-the-heck-data-mesh What the Heck is a Data Mesh?!
- https://www.montecarlodata.com/blog-data-contracts/ Data Contracts: 7 Critical Implementation Lessons Learned
- https://www.youtube.com/watch?v=0WAfevbtdeY (56) The State of Data Engineering Data Day Texas 2024
- https://towardsdatascience.com/dont-fix-bad-data-do-this-instead-d45262444cf2 Fix Data Quality at the beginning
- https://medium.com/swlh/growth-vs-marketing-bf421fa543af Growth vs Marketing. We need to stop equating the two
# 03-02-2024
- https://medium.com/capital-one-tech/introducing-data-mesh-2-0-a-new-era-of-data-governance-27170c7a75cb Data Mesh 2.0: Revolutionizing Data Governance | Capital One
# 29-01-2024
- https://www.linkedin.com/pulse/windowing-event-streams-bill-bejeck-jruye/ Windowing in event streams, Kafka Streams & Flink
# 15-01-2024
- https://medium.com/@debyroth340/identify-job-completion-in-multi-phase-kafka-consumers-33ee8a974963 Identify Job Completion in multi-phase Kafka consumers: always separate concerns
- https://blog.iggy.rs/posts/building-message-streaming-in-rust/ Iggy.rs - building message streaming in Rust
- https://medium.com/@axel.schwanke/data-mesh-in-practice-recommendations-from-roches-journey-e0e0d51c4a89 Data Mesh In Practice — Recommendations from Roche’s Journey
# 08-01-2024
- https://www.mostlymetrics.com/p/emergency-post-wtf-is-going-on-at Emergency post: WTF is going on at Carta?
# 01-01-2024
- https://jack-vanlightly.com/analyses/2023/11/15/neon-serverless-postgresql-asds-chapter-3 Neon - Serverless PostgreSQL
# 31-12-2023
- https://www.youtube.com/watch?v=gOJL3gjc8ak Improving our neuroplasticity
- https://zendesk.engineering/kafka-automating-root-ca-rotation-with-vault-9bbbe07c7c6e Kafka: Automating Root CA rotation with Vault
# 24-12-2023
- https://docs.google.com/presentation/d/11YgRsOTtJDzLA5FBsJ4fhx_t_PgTUwNWUvZgx7ZMpO4/edit#slide=id.g282cd05ef4b_1_373 5-minute Practical Streaming Techniques that can Save You Millions
# 23-12-2023
- https://www.infoq.com/presentations/eventual-consistent/ Eventual Consistency – Don’t Be Afraid!
- https://www.thenile.dev/blog/transaction-isolation-postgres Transaction Isolation in Postgres
# 21-12-2023
- https://clickhouse.com/blog/clickhouse-redpanda-architecture-with-goldsky Goldsky - A Gold Standard Architecture with ClickHouse and Redpanda
- https://blog.px.dev/detect-pii/ I shouldn't be seeing this: anonymize sensitive data while debugging
# 18-12-2023
- https://motherduck.com/blog/big-data-is-dead/ Big Data is Dead
# 10-12-2023
- https://arxiv.org/pdf/2310.08697.pdf The Data Lakehouse: Data Warehousing and More
# 09-12-2023
- https://dipankar-tnt.medium.com/onetable-interoperability-for-apache-hudi-iceberg-delta-lake-bb8b27dd288d OneTable: Interoperability for Hudi, Iceberg, Delta
# 04-12-2023
- https://medium.com/@tarasslipets/data-mesh-in-kafka-a-practical-guide-fec23bc25fa2 Data Mesh in Kafka: A Practical Guide
# 03-12-2023
- https://www.youtube.com/watch?v=kCc8FmEb1nY Let's build GPT: from scratch, in code, spelled out.
- https://www.infoq.com/news/2023/12/aws-reinvent-2023-recap/ Recap of AWS re:Invent 2023
- https://www.youtube.com/watch?v=uRkZ8foazHU The Science of Growth with Sean Ellis
- https://www.youtube.com/watch?v=zjkBMFhNj_g Intro to Large Language Models & LLM security
# 02-12-2023
- https://www.lennysnewsletter.com/p/lessons-from-going-freemium-a-decision Freemium: think carefully about the friction you want when onboarding users
# 30-11-2023
- https://towardsdatascience.com/rag-vs-finetuning-which-is-the-best-tool-to-boost-your-llm-application-94654b1eaba7 RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application?
# 26-11-2023
- https://www.youtube.com/watch?v=1vkb7BCMQd0 Making Friends with Machine Learning: The Entire Course / Cassie Kozyrkov
# 25-11-2023
- https://www.immuta.com/blog/the-top-5-barriers-to-data-sharing-and-how-to-overcome-them/ The Top 5 Barriers to Data Sharing and How to Overcome Them
# 22-11-2023
- https://www.youtube.com/watch?v=aN3-Yp_28rM AI Expert Explains Future Programming Jobs… and Python
# 12-11-2023
- https://twitter.com/zeeg/status/1720971040606793799 David Cramer: "Still can’t believe we all got tricked into using graphql"
# 10-11-2023
- https://medium.com/project44-techblog/experiments-in-kafka-compression-ea975a65be92 Experiments in Kafka Compression.
# 09-11-2023
- https://www.mensurdurakovic.com/hard-to-swallow-truths-they-wont-tell-you-about-software-engineer-job/ 10 hard-to-swallow truths they won't tell you about software engineer job
# 07-11-2023
- https://blog.cloudflare.com/post-mortem-on-cloudflare-control-plane-and-analytics-outage/ Post Mortem on Cloudflare Control Plane and Analytics Outage
# 06-11-2023
- https://piotrminkowski.com/2023/11/06/apache-kafka-on-kubernetes-with-strimzi/ Apache Kafka on Kubernetes with Strimzi
# 02-11-2023
- https://www.reforge.com/blog/product-specializations The Growing Specialization of Product Management
- https://medium.com/criteo-engineering/how-we-compute-data-lineage-at-criteo-b3f09fc5c577 How we compute data lineage at Criteo
# 31-10-2023
- https://medium.com/paypal-tech/scaling-kafka-to-support-paypals-data-growth-a0b4da420fab Scaling Kafka to Support PayPal’s Data Growth
# 30-10-2023
- https://dttung2905.medium.com/zero-trust-with-kafka-91376f7e162d Zero trust with Kafka
# 29-10-2023
- https://tcbakes.medium.com/intuits-data-mesh-concepts-214268257dd2 Intuit’s Data Mesh Concepts.
# 23-10-2023
- https://jack-vanlightly.com/blog/2023/10/2/the-advantages-of-queues-on-logs The advantages of queues on logs
# 22-10-2023
- https://www.restate.dev/blog/why-we-built-restate/ Why we built Restate Restate
- https://www.arroyo.dev/blog/rust-for-data-infra Rust is the best language for data infra
- https://queue.acm.org/detail.cfm?id=3321612 Online Event Processing - ACM Queue
- https://medium.com/@andrew_schofield/queues-for-kafka-29afa8aeed86 Queues for Kafka. 
# 12-10-2023
- https://towardsdatascience.com/building-a-data-mesh-on-the-kafka-ecosystem-399a5bd8799c Building a Data Mesh on the Kafka Ecosystem
- https://www.confluent.io/blog/building-a-realtime-service-marketplace-with-confluent-cloud/ Building a Real-Time Service Marketplace with Confluent Cloud
# 10-09-2023
- https://supabase.com/blog/supavisor-1-million Supavisor: Scaling Postgres to 1 Million Connections
# 03-09-2023
- https://medium.com/@RisingWave_Engineering/why-kafka-is-the-new-data-lake-dd6c1b6048e Why Kafka Is the New Data Lake?
# 02-09-2023
- https://www.confluent.io/blog/how-to-increase-throughput-on-kafka-connect-source-connectors/ Kafka Connect: How to Increase Throughput on Source Connectors
- https://blog.1password.com/passkey-crates/ We’re Open-Sourcing the Library that Powers 1Password’s Passwordless Authentication
# 30-08-2023
- https://slack.engineering/slacks-migration-to-a-cellular-architecture/ Slack's Migration to a Cellular Architecture (intra-AZ comm only)
# 28-08-2023
- https://www.vldb.org/pvldb/vol16/p3822-povzner.pdf Kora: A cloud native #kafka
- https://www.golem.cloud/post/why-wasm Why WASM?
# 27-08-2023
- https://medium.com/@gautamrajotya/data-lake-using-debezium-kafka-connect-apache-iceberg-sink-3d7aa32fa0c4 Data Lake using Debezium, Kafka Connect — Apache Iceberg Sink
# 24-08-2023
- https://blog.devgenius.io/kafka-streams-how-to-calculate-moving-average-for-stock-price-data-stream-in-real-time-9429617d5108 Kafka Streams — How to Calculate Moving Average for Stock Prices in Real-time
- https://medium.com/illuminations-mirror/parsing-complex-json-in-kafka-source-using-apache-seatunnel-c776fabadb48 Parsing Complex JSON in Kafka Source using Apache Seatunnel
- https://www.agileorgdesign.com/content/startup-structure-orgdesign-product-engg A Startup doesn't have to Grow into Product & Engineering
# 21-08-2023
- https://betterprogramming.pub/rethinking-stream-processing-and-streaming-databases-21076aaec375 Rethinking Stream Processing and Streaming Databases
- https://blog.redplanetlabs.com/2023/08/15/how-we-reduced-the-cost-of-building-twitter-at-twitter-scale-by-100x/ Rama, a new platform unifying computation and storage to build end-to-end backends in less code. Here, an example building Twitter at Twitter-scale
- https://jack-vanlightly.com/blog/2023/8/17/kafka-kip-966-fixing-the-last-replica-standing-issue Kafka KIP-966 - Fixing the Last Replica Standing issue
# 13-08-2023
- https://www.youtube.com/watch?v=zHzpoVgqgc4 Rethinking Distributed Programming with Unison Lang (with Rúnar Bjarnason)
- https://www.datadoghq.com/blog/engineering/introducing-husky/ Introducing Husky, Datadog's Third-Generation Event Store
- https://www.redpoint.com/infrared-report.pdf Redpoint InfraRed Report — Infratructure layer VS Software layer (infra = more profitable, more value, more critical)
- https://towardsdatascience.com/data-mesh-architecture-and-the-role-of-apis-json-schemas-3dc616650960 Data Mesh Architecture and the Role of APIs & JSON Schemas
- https://softwaremill.com/zookeeper-less-kafka/ ZooKeeper-less Kafka
# 12-08-2023
- https://redpanda-data.medium.com/raft-native-the-foundation-for-streaming-datas-best-future-6bf5baf1c1c Raft native: the foundation for streaming data’s best future?
- https://www.honeycomb.io/blog/deploys-wrong-way-change-user-experience Feature flags in production: the way to go
- https://www.honeycomb.io/blog/becoming-vp-of-engineering-pt1 On Becoming a VP of Engineering
- https://kylepoyar.substack.com/p/pinecones-journey-from-seed-to-10000 Pinecone’s journey from seed to 10,000 sign-ups per day
# 26-07-2023
- https://morganperry.substack.com/p/devtools-brew-20dockers-remarkable Docker's Remarkable Turnaround, from 10M$ to 100M$ ARR
# 10-07-2023
- https://themoah.medium.com/lessons-learned-from-running-kafka-ecosystem-at-a-petabyte-scale-c0f437962ba0 Lessons learned from running Kafka ecosystem at a petabyte scale
# 08-07-2023
- https://www.turingpost.com/p/llmshistory3 There Would Have Been No LLMs Without This
# 07-07-2023
- https://www.databricks.com/blog/introducing-materialized-views-and-streaming-tables-databricks-sql Introducing Materialized Views and Streaming Tables for Databricks SQL
# 04-07-2023
- https://opensource.googleblog.com/2023/06/rust-fact-vs-fiction-5-insights-from-googles-rust-journey-2022.html Rust fact vs. fiction: 5 Insights from Google's Rust journey in 2022
# 03-07-2023
- https://www.databricks.com/blog/introducing-english-new-programming-language-apache-spark Introducing English as the New Programming Language for Apache Spark
# 02-07-2023
- https://blogs.nvidia.com/blog/2022/03/25/what-is-a-transformer-model/ What Is a Transformer Model?
- https://web.archive.org/web/20230621114132/https://www.nytimes.com/2023/06/07/technology/ai-san-francisco-tech-industry.html The AI Boom Is Pulling Tech Entrepreneurs Back to San Francisco
- https://medium.com/lightspeed-venture-partners/eight-ai-startups-winning-the-race-for-tech-talent-571a18b03642 Eight AI Startups Winning the Race for Tech Talent
- https://dev.to/thedanicafine/so-you-want-to-speak-at-a-technical-conference-responding-to-a-cfp-54m6 Technical Conference: Responding to a CfP
- https://www.mckinsey.com/capabilities/mckinsey-digital/our-insights/the-economic-potential-of-generative-ai-the-next-productivity-frontier Economic potential of generative AI | McKinsey
- https://venturebeat.com/ai/how-businesses-can-break-through-the-chatgpt-hype-with-workable-ai/ How businesses can break through the ChatGPT hype with 'workable AI'
# 30-06-2023
- https://hackingsaas.substack.com/p/event-sourcing-for-saas-applications Event Sourcing for SaaS applications
# 27-06-2023
- https://engineering.razorpay.com/reducing-data-platform-cost-by-2m-d8f82285c4ae Reducing Data Platform Cost by $2M
# 26-06-2023
- https://nebula.stream/paper/zeuch_cidr20.pdf The NebulaStream Platform: Data and Application: Management for the Internet of Things
# 25-06-2023
- https://blog.gopenai.com/how-to-speed-up-llms-and-use-100k-context-window-all-tricks-in-one-place-ffd40577b4c The Secret Sauce behind 100K context window in LLMs: all tricks in one place
- https://github.com/ray-project/llm-numbers Numbers every LLM developer should know
- https://medium.com/lydtech-consulting/kafka-streams-state-store-30110bf4f24 Kafka Streams: State Store
- https://engineering.hellofresh.com/renaming-a-kafka-topic-d6ff3aaf3f03 Renaming a #ApacheKafka topic and MirrorMaker 2
# 24-06-2023
- https://medium.com/data-engineer-things/why-you-shouldnt-invest-in-vector-databases-c0cd3f59d23c Why You Shouldn’t Invest In Vector Databases? (because all major DBs support vectors)
- https://www.wired.com/story/generative-ai-deepfakes-disinformation-psychology/ Humans Aren’t Mentally Ready for an AI-Saturated ‘Post-Truth World’
- https://lwn.net/SubscriberLink/934940/3abb2d4086680b78/ PostgreSQL reconsiders its process-based model
- https://www.infoq.com/news/2023/06/scoped-values-java-21/ Enhancing Java Concurrency with Scoped Values in JDK 21 (Preview)
- https://devpod.sh/ DevPod - Open Source Dev-Environments-As-Code
# 19-06-2023
- https://strimzi.io/blog/2023/05/03/kafka-transactions/ Exactly-once semantics with Kafka transactions
# 18-06-2023
- https://blog.startupstash.com/crafting-the-right-product-led-growth-plg-strategy-for-your-startup-419be2e09376 Crafting The Right Product-led Growth (PLG) Strategy For Your Startup
- https://jack-vanlightly.com/blog/2023/5/15/kafka-vs-redpanda-performance-do-the-claims-add-up Kafka vs Redpanda Performance — Kafka outperforms Redpanda in real use-cases
- https://www.saastr.com/ceo-systems-5-lessons-learned-from-scaling-at-every-growth-phase-with-hashicorp-ceo-dave-mcjannet-pod-598-video/ 5 Lessons Learned from Scaling at Every Growth Phase with HashiCorp CEO
- https://medium.com/expedia-group-tech/how-expedia-reviews-engineering-is-using-event-streams-as-a-source-of-truth-d3df616cccd8 How Expedia Reviews Engineering Is Using Event Streams as a Source Of Truth
- https://www.youtube.com/watch?v=bZQun8Y4L2A State of GPT, ChatGPT, Reinforcement Leaning from Human Feedback (RLHF), Prompt Engineering
- https://medium.com/@hannes.rollin/six-reasons-why-data-mesh-will-fail-195886c89bdd Six Reasons Why Data Mesh Will Fail
- https://www.kai-waehner.de/blog/2023/01/09/the-daily-life-of-a-field-cto/ The Daily Life of a Field CTO - Kai Waehner
- https://dzone.com/articles/a-deep-dive-into-the-differences-between-kafka-and?utm_content=248957829&utm_medium=social&utm_source=twitter&hss_channel=tw-1058828554459205632 Deep Dive Into Kafka vs. Pulsar
- https://medium.com/engineered-publicis-sapient/event-driven-architecture-at-scale-2bd1ef580d71 Event-Driven Architecture at Scale Using Kafka, Challenges
- https://ruurtjan.medium.com/understanding-kafka-with-factorio-74e8fc9bf181 Understanding #Kafka with Factorio
- https://huggingface.co/blog/falcon The Falcon has landed in the Hugging Face ecosystem
- https://dmccreary.medium.com/lost-in-knowledge-space-14be123ea083 A Knowledge Space is your status in a graph of learning concepts
- https://www.lennysnewsletter.com/p/what-working-at-figma-taught-me-about What working at Figma taught me about customer obsession
# 12-06-2023
- https://www.confluent.io/blog/cloud-native-data-streaming-kafka-engine/ Kora: The Cloud Native Engine for Apache Kafka
# 11-06-2023
- https://dzone.com/articles/a-deep-dive-into-the-differences-between-kafka-and Deep Dive Into Kafka vs. Pulsar
- https://kai-waehner.medium.com/apache-kafka-apache-flink-match-made-in-heaven-45dde9481a3c Apache Kafka + Apache Flink, the good parts, and also comparing to Kafka Streams
- https://degoes.net/articles/splendid-scala-journey A Splendid Scala Journey, bye John
- https://www.mckinsey.com/~/media/mckinsey/business%20functions/people%20and%20organizational%20performance/our%20insights/the%20state%20of%20organizations%202023/the-state-of-organizations-2023.pdf McKinsey — The State of Organizations 2023
- https://medium.com/@abhishekranjandev/vector-databases-exploring-a-new-way-to-revolutionize-search-85cb1b1fc7b Vector Databases: Exploring a New Way to Search
- https://m.mage.ai/apache-flink-vs-apache-spark-a-detailed-comparison-for-data-processing-5e70e1d6c8ab Apache #Flink vs Apache #Spark: A detailed comparison for data processing
# 31-05-2023
- https://medium.com/@andrew_schofield/queues-for-kafka-29afa8aeed86 Queues for Kafka
# 08-05-2023
- https://www.datamesh-governance.com/ Data Mesh Governance by Example
- https://www.datamesh-architecture.com/ Data Mesh Architecture
- https://www.tamr.com/wp-content/uploads/2022/11/Data-Mastering-Holds-Promise-as-Underpinning-Technology-for-Data-Mesh-451-Research.pdf Data Mastering Holds Promise as Underpinning Technology for Data Mesh (451 Research)
# 04-05-2023
- https://www.semianalysis.com/p/google-we-have-no-moat-and-neither Google "We Have No Moat, And Neither Does OpenAI"
# 01-05-2023
- https://www.youtube.com/watch?v=bGRE-tBsqoE Détectez et corrigez automatiquement les problèmes les plus fréquents avec Apache Kafka
- https://www.arecadata.com/fake-data-kafka/ Effortless mock data generation for Kafka with LLMs
- https://testing.googleblog.com/2023/04/sensenmann-code-deletion-at-scale.html Google Testing Blog: Sensenmann: Code Deletion at Scale
- https://newsletter.pragmaticengineer.com/p/inside-figmas-engineering-culture?utm_source=substack&utm_medium=email Inside Figma’s Engineering Culture
- https://streamnative.io/blog/handling-100k-consumers-with-one-pulsar-topic Handling 100K Consumers with One Pulsar Topic. New 'Broadcast subscription'
- https://jack-vanlightly.com/blog/2023/4/24/why-apache-kafka-doesnt-need-fsync-to-be-safe Why Apache Kafka doesn't need fsync to be safe
- https://zenorocha.com/the-two-types-of-quality The two types of quality: things that works vs. things that inspire
- https://themoah.medium.com/lessons-learned-from-running-kafka-ecosystem-at-a-petabyte-scale-c0f437962ba0 Lessons learned from running Kafka ecosystem at a petabyte scale
- https://www.instaclustr.com/blog/apache-kafka-kraft-abandons-the-zookeeper-part-3-maximum-partitions-and-conclusions/ Apache Kafka® KRaft Abandons the Zoo(Keeper): Part 3—Maximum Partitions and Conclusions
- https://www.exhypothesi.com/clocks-and-causality/ Clocks and Causality - Ordering Events in Distributed Systems
- https://danielfrieling.medium.com/goodbye-chapter-leads-hello-engineering-managers-6e9d9d0aa8b7 Goodbye Chapter Leads, Hello Engineering Managers
# 27-04-2023
- https://engineering.instawork.com/unlocking-the-power-of-data-how-we-scaled-our-analytics-with-an-in-house-event-logging-platform-520d5b58f651 Unlocking the Power of Data: How we scaled our analytics with in-house Event Logging
# 11-04-2023
- https://joshua-robinson.medium.com/simplify-kafka-at-scale-with-confluent-tiered-storage-ae8c1a2c9c80 Simplify Kafka at Scale with Confluent Tiered Storage
# 03-04-2023
- https://medium.com/gojekengineering/sink-kafka-messages-to-clickhouse-using-clickhouse-kafka-ingestor-7898e3f5295b Sink Kafka Messages to ClickHouse
- https://www.infoq.com/news/2023/04/strategies-principles-ml-ops/ Strategies and Principles to Scale and Evolve MLOps
# 28-03-2023
- https://terminusdb.com/blog/what-is-a-data-product/ What is Data Product? Data Mesh?
# 24-03-2023
- https://redpanda.com/blog/web-user-interface-tools-kafka Conduktor as the best web UIs for managing Apache Kafka
- https://www.signadot.com/blog/testing-kafka-based-asynchronous-workflows-using-opentelemetry Testing Kafka-based Asynchronous Workflows Using OpenTelemetry
# 12-03-2023
- https://www.youtube.com/watch?v=XiCxj-bXu5M Ginni Rometty: IBM CEO on Leadership, Power, and Adversity
- https://semaphoreci.com/blog/trunk-based-development Trunk-Based Development
- https://cwiki.apache.org/confluence/display/KAFKA/KIP-848%3A+The+Next+Generation+of+the+Consumer+Rebalance+Protocol KIP-848: new Consumer Rebalance, moving complexity from Consumers to Group Coordinator
# 11-03-2023
- https://www.datasciencecentral.com/the-future-of-data-is-real-time/ The Future of Data is Real-Time
- https://medium.com/lydtech-consulting/migrating-from-activemq-to-kafka-cc53c42b752 Migrating from ActiveMQ to Kafka
- https://www.confluent.io/blog/multi-geo-replication-in-apache-kafka/ Multi-Geo Replication in Apache Kafka
- https://twitter.com/sidpalas/status/1634194026500096000 Improve Dockerfile tremendously (for nodejs here)
- https://bootcamp.uxdesign.cc/how-to-use-chatgpt-in-product-management-f96d8ac5ee6f How to use ChatGPT in product management
- https://twitter.com/compound248/status/1634105371198644224 What happened with Silicon Valley Bank
# 04-03-2023
- https://www.honeycomb.io/blog/incident-response-at-honeycomb How We Manage Incident Response
- https://hackernoon.com/build-vs-buy-what-we-learned-by-implementing-a-data-catalog-7b38377h Build vs Buy: What We Learned by Implementing a Data Catalog
- https://medium.com/insiden26/engineering-at-n26-a-tour-of-our-tech-stack-and-architecture-9e58ce96f889 Engineering at N26: a Tour of our Tech Stack and Architecture
# 20-02-2023
- https://medium.com/ebaytech/resiliency-and-disaster-recovery-with-kafka-dc8901c881c Resiliency and Disaster Recovery with Kafka
# 13-02-2023
- https://www.highlight.io/blog/scalable-data-processing-with-apache-kafka Scalable Data Processing with Apache Kafka on AWS MSK
# 11-02-2023
- https://medium.com/event-driven-utopia/operational-use-case-patterns-for-apache-kafka-and-flink-part-1-5a0f8742df90 Operational Use case Patterns for Apache Kafka and Flink — Part 1
- https://tech.ovoenergy.com/developer-experience-at-ovo/ Developer Experience at OVO
- https://www.bytewax.io/blog/real-time-ml What is Real-Time ML and Why Does Stream Processing Matter
# 05-02-2023
- https://lajili.com/posts/post-2/ ChatGPT -> real Web 3.0 -> more subtle advertising
# 04-02-2023
- https://aws.amazon.com/blogs/big-data/create-more-partitions-and-retain-data-for-longer-in-your-msk-serverless-clusters/?sc_channel=sm&sc_campaign=DB_Event&sc_publisher=LINKEDIN&sc_geo=GLOBAL&sc_outcome=awareness&trk=DB_Event&linkId=199922767 Finally AWS MSK Serverless is "unlocked" for real usage!
# 02-02-2023
- https://twitter.com/destraynor/status/1620478505720123392?s=12&t=18l5KEsrM7BFPpk5t2SGQQ ChatGPT + Intercom
# 31-01-2023
- https://automerge.org/blog/automerge-2/ Automerge 2.0: from JS to Rust
- https://medium.com/codex/supporting-cross-node-interactive-queries-in-kafka-streams-1b2972f84be2 Supporting Cross Node Interactive Queries In Kafka Streams
- https://medium.com/trendyol-tech/performance-of-kafka-consumers-1-billion-messages-51b3bacef583 #Performance of Kafka Consumers: 1 Billion messages, Python VS Go
# 29-01-2023
- https://medium.com/clear-street/switching-to-protobuf-from-avro-on-kafka-3f139c5abf88 Switching to Protobuf (from Avro) on Kafka
# 22-01-2023
- https://betterprogramming.pub/journey-of-a-frontend-monorepo-what-i-learned-d6a0d142803f Journey of a Frontend Monorepo: Here’s What I Learned
# 16-01-2023
- https://www.kineticedge.io/blog/kafka-raft/ Apache Kafka using Kraft and a dedicated controller quorum
- https://www.jesse-anderson.com/2023/01/analysis-of-confluent-buying-immerok/ Analysis of Confluent Buying Immerok + ksqlDB
# 15-01-2023
- https://blog.devgenius.io/evolutionary-from-batching-to-streaming-7a9a7942922 From Batching to Streaming
- https://evan-soohoo.medium.com/elon-musk-and-1000-poorly-batched-rpcs-ad5970536974 Elon Musk And >1000 Poorly Batched RPCs
- https://mbenedicto.medium.com/10-lessons-for-observability-what-every-vp-of-engineering-needs-to-know-1b46714b4d29 10 Lessons about Observability
# 11-01-2023
- https://jchyip.medium.com/fixing-too-much-wip-ba4d254048a3 Fixing “Too much WIP”
# 10-01-2023
- https://medium.com/agoda-engineering/adding-time-lag-to-monitor-kafka-consumer-2c626fa61cfc Adding Time Lag to Monitor Kafka Consumer
# 07-01-2023
- https://www.confluent.io/blog/cloud-kafka-meets-cloud-flink-with-confluent-and-immerok/ Unifying Kafka + Flink at Confluent.
- https://blog.cloudflare.com/using-apache-kafka-to-process-1-trillion-messages/?email=sderosiaux%40conduktor.io Using Apache Kafka to process 1 trillion inter-service messages
- https://medium.com/event-driven-utopia/operational-use-case-patterns-for-apache-kafka-and-flink-part-1-5a0f8742df90 From Apache Kafka and Flink to RedPanda + Decodable?
- https://dev.to/bleporini/openid-connect-authentication-with-apache-kafka-31-5747 OpenID Connect authentication with Apache Kafka and Auth0
- https://www.mckinsey.com/capabilities/mckinsey-digital/our-insights/every-company-is-a-software-company-six-must-dos-to-succeed?cid=other-eml-nsl-mip-mck&hlkid=fc71907dc37547c19aaee7959a5c988a&hctky=14255962&hdpid=7245674d-2291-47d7-872d-b41da7d86a46 Every company is a software company
# 06-01-2023
- https://medium.com/lydtech-consulting/securing-kafka-with-mutual-tls-and-acls-b235a077f3e3 Securing Kafka with Mutual TLS and ACLs
# 01-01-2023
- https://memphis.dev/blog/event-sourcing-outgrows-databases/ Event Sourcing & Databases
- https://engineering.grab.com/zero-trust-with-kafka Leveraging Vault to mTLS Kafka (on Strimzi) + Open Policy Agent to manage Policies (Authorization)
# 29-12-2022
- https://www.benkuhn.net/abyss/ Staring into the abyss as a core life skill
- https://blog.developer.adobe.com/wins-from-effective-kafka-monitoring-at-adobe-stability-performance-and-cost-savings-a3ecb701ee5b Wins from Effective Kafka Monitoring at Adobe: Stability, Performance, and Cost Savings
- https://www.mckinsey.com/capabilities/strategy-and-corporate-finance/our-insights/starting-strong-making-your-ceo-transition-a-catalyst-for-renewal?cid=mbe-pde-pro-mip-mck-oth-2212 Starting strong: Making your CEO transition a catalyst for renewal | McKinsey
- https://developer.confluent.io/podcast/the-present-and-future-of-stream-processing/ The Present and Future of Stream Processing -> More streaming!
- https://www.kai-waehner.de/blog/2022/11/16/when-to-choose-redpanda-instead-of-apache-kafka/ Redpanda or Apache Kafka?
- https://www.atlassian.com/engineering/why-we-chose-kafka Trello dropping RabbitMQ and picking #Kafka. Less outages, less cost.
- https://www.confluent.io/events/current-2022/buckle-up/ From Batch to Realtime
# 28-12-2022
- https://medium.com/google-cloud/dq-with-dataplex-c1f42195435d Data Governance with Dataplex, Google Cloud
- https://medium.com/wix-engineering/troubleshooting-kafka-for-2000-microservices-at-wix-986ee382fd1e Troubleshooting Kafka for 2000 Microservices at Wix, many good insights
- https://medium.com/codex/your-engineering-director-does-not-want-you-to-optimize-for-utilization-a48ad0368b8 Always limit your work in progress, always.
- https://netflixtechblog.medium.com/data-reprocessing-pipeline-in-asset-management-platform-netflix-46fe225c35c9 Data Pipeline using Kafka and a DLQ
- https://stateofapis.com/ "Kafka usage increased and more people are aware of it" <3 (2021 to 2022)
- https://bothsidesofthetable.com/high-functioning-vs-low-functioning-startup-boards-ae3ebe69cd9e Why Startup Boards. Good and bad boards. A space of discussion and decisions, not only updates.
- https://bytebaker.medium.com/we-migrated-to-rust-but-what-did-we-gain-1429d036d0c We migrated to Rust, but what did we gain? (a lot)
# 25-12-2022
- https://franklinlindemberg.medium.com/using-protobuf-with-apache-kafka-and-without-schema-registry-8535f43a2569 Using Protobuf without Schema Registry #kafka
- https://chrisheilmann.medium.com/microdosing-burnout-on-working-remote-and-in-a-different-time-zone-ae0b4d8dd5bb On working remote and in a different time zone: remote is nice but not easy
- https://betterprogramming.pub/building-a-high-performing-engineering-team-feb02c55283f Building a High-Performing Engineering Team: team player, accountability, fun, successes, clear communication, continuous improvements
- https://medium.com/coriers/should-you-use-apache-airflow-e71c6cf7c0c4 Should You Use Apache Airflow?. Why Data Engineers Love/Hate Airflow (scaling, xcom)
# 29-11-2022
- https://medium.com/@bb8s/kafka-producer-deep-dive-batching-messages-in-recordaccumulator-aeaf5905fee Kafka producer deep-dive: batching messages in RecordAccumulator
- https://medium.com/bazaar-tech/how-to-prioritise-technical-improvements-in-product-teams-da91e9a04156 How to Prioritise “Engineering Work” in Product Teams
- https://abseil.io/resources/swe-book/html/ch07.html Software Engineering at Google — GSM + QUANTS
- https://medium.com/@saurabhkaushik/develop-an-engineering-culture-for-speed-to-value-6e93d833a925 Develop an engineering culture for “Speed to Value"
- https://medium.com/wix-engineering/6-event-driven-architecture-patterns-part-1-93758b253f47 Event-Driven Architecture Patterns
- https://cwiki.apache.org/confluence/display/KAFKA/KIP-890%3A+Transactions+Server-Side+Defense #Kafka KIP-890: Transactions Server-Side Defense
# 27-11-2022
- https://stackoverflow.blog/2022/11/23/why-writing-by-hand-is-still-the-best-way-to-retain-information/ Why writing by hand is still the best way to retain information
# 24-11-2022
- https://medium.com/@eftal/keda-new-era-of-autoscaling-abf2d7f8aa85 KEDA: New Era of Autoscaling #kubernetes
# 23-11-2022
- https://mdwdotla.medium.com/using-rust-at-a-startup-a-cautionary-tale-42ab823d9454 Using Rust at a startup: A cautionary tale
- https://gradientflow.com/the-stream-processing-index/ Measuring the popularity of different stream processing tools. #kafka #flink #spark
# 20-11-2022
- https://diataxis.fr/ How to write good tech documentation Diátaxis
- https://productled.com/blog/how-to-build-a-product-led-sales-team How to Build a Product-Led Sales Team
# 19-11-2022
- https://blog.octo.com/en/un-schema-registry-pour-passer-a-lechelle/ Un schema registry pour passer à l'échelle #kafka
- https://www.lydtechconsulting.com/blog-kafka-schema-registry-integration-test.html Integration Testing with Kafka Schema Registry & Avro
- https://medium.com/lydtech-consulting/kafka-message-batch-consumer-retry-8e49bdb39f5c Kafka Message Batch Consumer Retry
- https://dev.to/floord/developer-advocates-need-to-be-better-event-citizens-42hh Developer Advocates need to be better event citizens
# 12-11-2022
- https://riferrei.com/in-the-land-of-the-sizing-the-one-partition-kafka-topic-is-king/ The one-partition Kafka topic thing
# 08-11-2022
- https://medium.com/opendoor-labs/how-we-improved-reliability-of-kafka-consumers-441ccec1416d How we improved reliability of Kafka consumers in Go
# 23-10-2022
- https://www.datadoghq.com/blog/dash-2022-new-feature-roundup/#data-streams-monitoring Dash 2022: Guide to Datadog's Newest Announcements #kafka
- https://www.datadoghq.com/state-of-aws-security/ The State of AWS Security in 2022. IAM, root users, access keys, public exposure of resources,  IMDSv2, no multiple AWS accounts
- https://redpanda.com/blog/redpanda-vs-kafka-total-cost-ownership-comparison Redpanda vs Apache Kafka: Total Cost of Ownership + Performance comparaison
- https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-data-driven-enterprise-of-2025 The data-driven enterprise of 2025 | McKinsey
- https://hbr.org/2022/07/a-better-way-to-put-your-data-to-work A Better Way to Put Your Data to Work
- https://www.mckinsey.com/capabilities/quantumblack/our-insights/how-to-unlock-the-full-value-of-data-manage-it-like-a-product Manage data like a product to unlock full value | McKinsey
- https://medium.com/@huynhquangthao/how-to-survive-the-kafka-rebalancing-protocol-6a6bbcf56784 Various ways to handle the Kafka rebalancing protocol
- https://www.ted.com/talks/tim_urban_inside_the_mind_of_a_master_procrastinator Tim Urban: Inside the mind of a master procrastinator | TED Talk
# 22-10-2022
- https://wix-ux.com/when-life-gives-you-lemons-write-better-error-messages-46c5223e1a2f How to write better error messages
- https://www.accel.com/noteworthy/accel-2022-euroscape-reset Accel 2022 Euroscape: The Reset #funding
- https://towardsdatascience.com/topology-of-a-data-product-team-75dc5471fccf Topology of a Data Product Team
- https://levelup.gitconnected.com/whats-the-difference-between-an-aggregate-and-a-bounded-context-85665c28411a #DDD Aggregates and Bounded Contexts
# 21-10-2022
- https://www.ben-evans.com/presentations Three Steps to the Future — Benedict Evans
- https://blog.cloudera.com/using-kafka-connect-securely-in-the-cloudera-data-platform/ Kafka Connect in the Cloudera Data Platform
- https://aws.amazon.com/blogs/big-data/use-msk-connect-for-managed-mirrormaker-2-deployment-with-iam-authentication/ Use MSK Connect for managed MirrorMaker 2 deployment with IAM authentication #kafka
- https://medium.com/@danthelion/implementing-data-contracts-82800b9186b Implementing Data Contracts through Kafka Schema Registry
- https://www.infoq.com/presentations/ebpf-resiliency/ eBPF, Cilium: Improve Resiliency, sidecarless service mesh
# 10-10-2022
- https://medium.com/contino-engineering/creating-your-internal-developer-platform-part-2-65ff217cecd6 Platform Engineering: Creating your Internal Developer Platform
# 09-10-2022
- https://www.conduktor.io/blog/introducing-the-conduktor-platform Introducing the Conduktor Platform, the best Kafka platform out there :) #kafka 
- https://medium.com/insiderengineering/apache-iceberg-reduced-our-amazon-s3-cost-by-90-997cde5ce931 Apache Iceberg Reduced Our Amazon S3 Cost by 90%
- https://hemantjain.medium.com/how-platform-engineering-differ-from-devops-and-sre-723c63716d96 How Platform Engineering Differ from DevOps and SRE
- https://www.fivetran.com/blog/nrr-doesnt-matter positive NRR = more revenue; but growth is governed by its number of customers only
- https://www.confluent.io/blog/current-2022-event-recap/ Current 2022 Recap #kafka
- https://medium.com/pinterest-engineering/optimizing-kafka-for-the-cloud-4e936643fde0 Pinterest: Optimizing Kafka for the cloud, using rack awareness / AZ
# 25-09-2022
- https://www.youtube.com/watch?v=YSLCz2CggL0 SaaS Access Control: a customer-centric approach
- https://cpojer.net/posts/mastering-tech-lead-management Mastering Tech Lead Management
- https://www.jeremiahlee.com/posts/failed-squad-goals/ Spotify’s Failed #SquadGoals
- https://medium.com/@OmarElgabry/squad-vs-platform-product-teams-f68e02edd199 Squad vs Platform & Product Teams
# 24-09-2022
- https://medium.com/wise-engineering/running-kafka-in-kubernetes-part-2-how-we-migrated-our-kafka-clusters-to-kubernetes-69174cea1559 Running Kafka in Kubernetes, Part 2: How we migrated our Kafka clusters to Kubernetes
- https://andrewwinnicki.medium.com/better-software-engineering-teams-structures-roles-responsibilities-and-comparison-with-common-fb5c3161c13d Better Software Engineering teams — Structures, roles, responsibilities and comparison with common approaches.
- https://www.youtube.com/watch?v=oEyZgL3sL84 Risks in Systems Design: Chaos Engineering in Apps & Cloud Security
# 20-09-2022
- https://blog.pragmaticengineer.com/pollen/ Inside Pollen’s Collapse: “$200M Raised” but Staff Unpaid
# 18-09-2022
- https://medium.com/wise-engineering/running-kafka-in-kubernetes-part-1-why-we-migrated-our-kafka-clusters-to-kubernetes-722101a2e751 Wise: Why we migrated our #Kafka clusters to Kubernetes
# 17-09-2022
- https://blog.devgenius.io/common-issues-in-data-platforms-3a735a4b7a42 Common Issues in Data platforms
- https://itnext.io/event-sourcing-explained-b19ccaa93ae4 Event Sourcing vs EDA vs CQRS
- https://medium.com/qe-unit/quality-engineering-or-die-trying-with-antoine-craske-306d4cac9e91 Quality Engineering or Die Trying
- https://medium.com/@rphilogene/17-best-devops-tools-to-use-in-2022-for-infrastructure-automation-and-monitoring-b3470cf9e00f 17 Best DevOps Tools to Use in 2022 for Infrastructure Automation and Monitoring
- https://levelup.gitconnected.com/top-10-distributed-tracing-tools-in-2022-b9ed12304e72 Top 10 Distributed Tracing Tools in 2022
# 11-09-2022
- https://www.confluent.io/blog/declarative-connectors-with-confluent-for-kubernetes/ Declarative Connectors with Confluent for Kubernetes (not fixing the previous pains)
- https://www.morling.dev/blog/ideation-kubernetes-native-kafka-connect/ An Ideation for Kubernetes-native #Kafka Connect => One JVM process and Kubernetes pod per task
- https://medium.com/lydtech-consulting/kafka-idempotent-consumer-transactional-outbox-74b304815550 Kafka Idempotent Consumer & Transactional Outbox
- https://prophetstor.medium.com/intelligent-autoscaling-of-kafka-consumers-with-workload-prediction-6074b8d7ff7c Autoscaling of #Kafka Consumers with Workload Prediction
- https://medium.com/qe-unit/zalandos-quality-engineering-journey-from-monolith-to-microservices-5a7288a3759f Zalando’s Quality Engineering Journey — From Monolith to Microservices
- https://softwaremill.com/implementing-raft-using-a-functional-effect-system/ Implementing Raft using #scala #zio #loom
- https://kai-waehner.medium.com/streaming-data-exchange-with-kafka-and-a-data-mesh-in-motion-d3e7d24bf576 Streaming Data Exchange with #Kafka and a Data Mesh in Motion 
# 10-09-2022
- https://github.com/withastro/astro withastro/astro: Build faster websites with Astro's next-gen island architecture
- https://slack.engineering/remote-development-at-slack/ Remote Development at Slack
# 09-09-2022
- https://medium.com/@hardiktaneja_99752/lessons-after-running-kafka-in-production-626974ffd700 Lessons after running #Kafka in production 
- https://medium.com/mcdonalds-technical-blog/behind-the-scenes-mcdonalds-event-driven-architecture-51a6542c0d86 Behind the scenes: McDonald’s event-driven architecture #kafka
# 02-09-2022
- https://medium.com/codex/implementing-a-clean-architecture-application-in-scala-part-1-1442f0438b03 Implementing a Clean Architecture Application in #Scala
- https://medium.com/@nadinCodeHat/http-based-microservices-is-a-bad-idea-670d3db29ca6 HTTP based Microservices is a bad idea -> #Kafka :)
- https://medium.com/data-monzo/the-many-layers-of-data-lineage-2eb898709ad3 The many layers of data lineage
# 26-08-2022
- https://stassajin.medium.com/how-to-hire-for-director-roles-bb0690f49a51 How to hire for Director+ roles?
- https://medium.com/qonto-way/do-you-need-elasticsearch-when-you-have-postgresql-94ef69f5570f Do you need ElasticSearch when you have PostgreSQL?
# 25-08-2022
- https://shahirdaya.medium.com/data-discovery-lineage-for-an-event-streaming-platform-26208ec2f9bd Apache Atlas for Data Discovery & Lineage #kafka
- https://medium.com/@darefamuyiwa/kafka-bidirectional-client-broker-compatibility-21c1b26e9d61 Kafka Bidirectional Client/Broker Compatibility
# 31-07-2022
- https://www.confluent.io/blog/data-flow-the-key-to-modern-data-pipelines/ Modern Data Flow: The Key to Modern Data Pipelines. ETL, ELT, Reverse ETL. Stream Processing. #kafka
- https://databricks.com/blog/2022/06/28/project-lightspeed-faster-and-simpler-stream-processing-with-apache-spark.html Project Lightspeed: Faster and Simpler Stream Processing With Apache Spark
- https://medium.com/rocksetcloud/streaming-analytics-with-ksql-vs-a-real-time-analytics-database-41459fd8f26b Streaming Analytics With KSQL vs. Rockset, a Real-Time Analytics Database 
- https://www.confluent.io/events/kafka-summit-london-2022/keep-your-cache-always-fresh-with-debezium/ Kafka: Keep Your Cache Always Fresh with Debezium
- https://rockset.com/blog/converged-indexing-the-secret-sauce-behind-rocksets-fast-queries/ Converged Index: Rockset's Fast Query Speed
- https://medium.com/shippeo-tech-blog/debezium-to-snowflake-lessons-learned-building-data-replication-in-production-a5430a9fe85b Debezium to Snowflake: Lessons learned building data replication in production
# 12-03-2022
- https://redpanda.com/blog/tiered-storage-architecture-shadow-indexing-deep-dive/ How we built Shadow Indexing, the subsystem powering Redpanda’s tiered storage
- https://medium.com/geekculture/kafka-in-f1-replaying-messages-53b3bd7d3a61 Kafka in F1 — Replaying messages
- https://medium.com/@kanchan.tewary/data-quality-data-catalogs-and-data-governance-99cb18a022c5 Data Quality, Data Catalogs and Data Governance
- https://bytes.swiggy.com/introduction-to-cdc-system-an-efficient-way-to-replicate-transactional-data-into-data-lake-c10f99c7a3fd Introduction to CDC System — An efficient way to replicate Transactional data into Data Lake
- https://stackoverflow.com/questions/71222496/how-to-achieve-high-availability-in-a-kafka-streams-app-during-deployment How to achieve high availability in a Kafka Streams app during deployment?
- https://medium.com/productboard-engineering/9-ingredients-of-excellence-tip-of-the-iceberg-159d4073eba0 9 ingredients of an excellent Engineering Manager
# 07-03-2022
- https://medium.com/@emergeit/realtime-data-streaming-with-apache-kafka-apache-pinot-apache-druid-and-apache-superset-e67161eb9666 Apache Kafka + Apache Pinot + Apache Druid + Apache Superset
- https://www.confluent.io/blog/ksqldb-0-23-1-features-updates/  ksqlDB 0.23.1 - GRACE PERIOD in! (default was 24h, which was huge)
- https://www.eweek.com/big-data-and-analytics/apache-kafka/ Apache Kafka Gains Adoption as Streaming Data Grows
# 06-03-2022
- https://medium.com/@StartupBusinesstips/8-common-go-to-market-mistakes-38435151a0ea 8 common Go-to-market mistakes.
- https://medium.com/meroxa/conduit-a-leap-forward-for-real-time-data-integration-67272fe50a84 Conduit, an alternative to Kafka Connect?
# 13-02-2022
- https://medium.com/devrev/10-product-led-growth-plg-principles-in-action-34dfbe72e981 10 Product-Led Growth (PLG) principles in action
# 31-01-2022
- https://www.confluent.io/blog/real-time-data-integrations-at-scale-with-confluent-q1-22-launch/ Announcing the Confluent Q1 ‘22
- https://userpilot.medium.com/how-to-build-and-structure-a-saas-product-marketing-team-9af811354dbc How To Build And Structure A SaaS Product Marketing Team
- https://medium.com/point-nine-news/how-to-hire-a-vp-marketing-cf15adbdb8d3 How to hire a VP Marketing. It's complicated.
- https://www.kai-waehner.de/blog/2022/01/04/when-not-to-use-apache-kafka/ When NOT to use Apache Kafka?  What is Kafka, What is NOT Kafka
- https://martinfowler.com/articles/data-monolith-to-mesh.html How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh
- https://www.confluent.io/blog/5-common-pitfalls-when-using-apache-kafka/ 5 Common Pitfalls When Using Apache Kafka
# 30-01-2022
- https://medium.com/positiveslope/10-forecasts-for-the-near-future-of-tech-61e73b51647c 10 Forecasts For The Near Future Of Tech
- https://userpilot.medium.com/2022-guide-to-saas-product-metrics-for-product-growth-managers-5c349ffdf9b 2022 Guide To SaaS Product Metrics For Product Growth Managers
- https://www.forbes.com/sites/ciocentral/2012/08/22/12-factors-to-consider-when-hiring-a-head-of-sales/?sh=2de411217c08 12 Factors To Consider When Hiring A Head of Sales
- https://askgib.substack.com/p/whats-your-favorite-interview-question PM Interview: What's your favorite question?
- https://www.honeycomb.io/blog/how-teams-collaborate-at-booking-com/ How Reliability and Product Teams Collaborate at Booking.com
- https://streamnative.io/blog/release/2022-01-25-moving-toward-a-zookeeperless-apache-pulsar/ ZooKeeper-Less Apache Pulsar
- https://cutlefish.substack.com/p/tbm-452-an-actionable-post-with-examples Product Management: Tree/Loop Prompts
- https://buttondown.email/nelhage/archive/two-reasons-kubernetes-is-so-complex/ Two reasons Kubernetes is so complex • Kubernetes is a cluster operating system
# 18-01-2022
- https://medium.com/geekculture/5-way-to-stay-technical-as-an-engineering-manager-bfa1c6d5a126 5 Ways to Stay Technical as an Engineering Manager
- https://userpilot.medium.com/2022-guide-to-saas-product-metrics-for-product-growth-managers-5c349ffdf9b 2022 Guide To SaaS Product Metrics For Product Growth Managers
# 12-01-2022
- https://cloud.google.com/blog/products/data-analytics/data-governance-and-operating-model-for-analytics-pt1 Data governance and operating model for analytics
# 11-01-2022
- https://moxie.org/2022/01/07/web3-first-impressions.html "My first impressions of web3" We're not there yet
# 09-01-2022
- https://engineering.grab.com/designing-products-and-services-based-on-jtbd Designing products and services based on Jobs to be Done
- https://dzone.com/articles/kafka-streams-tips-on-how-to-decrease-rebalancing Kafka-Streams - Tips on How to Decrease Re-Balancing Impact for Real-Time Event Processing On Highly Loaded Topics
- https://strimzi.io/blog/2021/12/17/kafka-segment-retention/ Deep dive into Apache Kafka storage internals: segments, rolling and retention
- https://sifted.eu/articles/europe-startup-stock-options-millionaires/ European tech companies should be minting more millionaires #stockoptions
- https://medium.com/yotpoengineering/scheduling-millions-of-messages-with-kafka-debezium-6d1a105160c Scheduling Millions Of Messages With Kafka & Debezium
- https://www.kdnuggets.com/2021/12/build-solid-data-team.html Building a solid data team
- https://qeunit.medium.com/how-atlassian-does-quality-assistance-f61e6a654b20 How Atlassian does Quality Assistance
- https://medium.com/pipedrive-engineering/product-usage-analytics-at-pipedrive-90b69ab9583a Product usage analytics at Pipedrive
- https://towardsdatascience.com/re-evaluating-kafka-issues-and-alternatives-for-real-time-395573418f27 Re-evaluating Kafka: issues and alternatives for real-time
- https://medium.com/interviewnoodle/engineering-manager-vs-tech-lead-which-is-better-d8896d7f3b10 Engineering manager vs. tech lead — which is better? (-> PM+EM+TL !)
- https://medium.com/leading-literally/im-an-engineering-manager-who-can-t-code-235ad35557b I’m an Engineering Manager who can’t code
# 08-01-2022
- https://sookocheff.com/post/time/vector-clocks/ Vector Clocks
- https://selectfrom.dev/5-megatrends-that-will-shift-the-data-and-analytics-market-bdd8639893e1 5 Megatrends That Will Shift the Data and Analytics Market
- https://blog.serenacapital.com/2021-european-saas-benchmark-65e3e1863906 2021 EUROPEAN SAAS BENCHMARK
- https://www.confluent.io/resources/kafka-summit-2020/learnings-from-the-field-lessons-from-working-with-dozens-of-small-large-deployments/ Learnings from the Field. Lessons from Working with Dozens of Small & Large Deployments #kafka
- https://medium.com/altitudehq/event-driven-for-reservation-with-kafka-b1c5ad2927fe Event Driven hotel reservations with Kafka
- https://www.confluent.io/blog/data-sharing-patterns-with-confluent-schema-registry/ Data Sharing Patterns with Confluent’s Schema Registry #kafka
- https://www.morling.dev/blog/kafka-where-art-thou/ How do you deal in #Kafka producers with brokers not being available?
# 04-01-2022
- https://www.chrisbehan.ca/posts/atomic-habits The Thinner Book: Atomic Habits by James Clear
# 26-12-2021
- https://nurkiewicz.com/slides/reactor-workshop Reactor Workshop
# 12-12-2021
- https://medium.com/edifyhouses/how-we-billed-500k-in-less-than-3-months-with-nocode-f259a6784451 How we billed +€500K in less than 3 months with #nocode
# 11-12-2021
- https://ishadeed.com/article/defensive-css/ Defensive CSS
# 05-12-2021
- https://www.confluent.io/blog/push-queries-v2-with-ksqldb-scalable-sql-query-subscriptions/ Push Queries v2 with ksqlDB 0.22: Scalable SQL Query Subscriptions
- https://www.confluent.io/blog/ksqldb-0-22-new-features-major-upgrades/ Announcing ksqlDB 0.22: new SOURCE TABLE, range-scan expressions optimizations
# 04-12-2021
- https://engineering.razorpay.com/the-platform-engineer-db2b21434911 The Platform Engineer
- https://bootcamp.uxdesign.cc/okrs-vs-kpis-understanding-measurements-for-your-saas-product-ac44451a0dc OKRs vs KPIs: understanding measurements for your SaaS product
- https://medium.com/senovovc/b2b-saas-the-right-organization-structure-at-the-right-stage-727c01e06996 B2B SaaS: the right Org Structure at the right Stage
- https://medium.com/@johnpcutler/15-things-you-should-know-about-product-managers-f488513d246 15 Things You Should Know About Product Managers
- https://felipevolpone.medium.com/consuming-over-1-billion-kafka-messages-per-day-at-ifood-2465e1ffa795 Consuming over 1 billion Kafka messages per day at Ifood
- https://medium.com/@antoinesakho/why-web3-needs-product-management-6afabf903df0 Why Web3 Needs Product Management
- https://www.honeycomb.io/blog/scaling-kafka-observability-pipelines/ Scaling Kafka at Honeycomb -> Confluent Tiered Storage -> Beefy AWS
- https://uxplanet.org/how-to-solve-a-product-design-challenge-22c4daa27117 How to solve a Product Design Challenge
- https://databricks.com/blog/2021/12/03/scala-at-scale-at-databricks.html Scala at Scale at Databricks
# 28-11-2021
- https://future.a16z.com/hire-vp-engineering/ How and Why To Hire a VP of Engineering (early)
# 14-11-2021
- https://www.youtube.com/watch?v=Dm0Cj7LsjgA Onboarding managers into an engineering team
- https://herbig.co/product-discovery/ Product Discovery: ​A Practical Guide for Agile Teams (2021)
- https://itnext.io/how-i-learned-to-onboard-effectively-in-an-engineer-manager-role-8ea76627e36c How I Learned to Onboard Effectively in an Engineer Manager Role
- https://medium.com/doctolib/get-a-strategic-vision-of-your-technical-debt-f0e1738ae4b2 Get a strategic vision of your technical debt
- https://betterprogramming.pub/9-things-every-new-engineering-manager-should-know-773b9c3b9667 9 Things Every New Engineering Manager Should Know
- https://blog.mission.dev/growing-your-leadership-skills-as-a-developer-47deb34f26d Growing your Leadership Skills as a Developer
- https://medium.com/@jordan_volz/whos-who-in-the-modern-data-stack-ecosystem-fall-2021-69d8b46b2e88 Who’s Who in the Modern Data Stack Ecosystem
# 13-11-2021
- https://medium.com/manomano-tech/why-do-all-tech-companies-converge-towards-the-same-product-organization-manomanos-case-d6f235743ae2 Why do all tech companies converge towards the same product organization?
- https://medium.com/manomano-tech/the-making-of-a-product-centric-organization-key-takeaways-from-a-3-year-journey-in-the-french-9d26658a5210 The making of a product-centric organization: key takeaways from the French scale-up ManoMano
- https://amplitude.com/blog/how-to-build-product-oriented-engineering-teams How to Build Product-Oriented Engineering Teams
- https://www.infoq.com/news/2021/11/rudra-rust-safety/ Static Analyzer Rudra Found Over 200 Memory Safety Issues in Rust Crates
# 08-11-2021
- https://medium.com/agileinsider/writing-great-key-results-for-your-okrs-f0213517c79e Writing great key results for your OKRs
- https://bootcamp.uxdesign.cc/what-does-your-product-org-look-like-eece7cbbdf1a What does your product org look like?
- https://medium.com/interviewnoodle/engineering-manager-as-an-architect-791362213a0b Engineering Manager as an Architect
- https://productcoalition.com/what-do-product-managers-do-ce076ad4a8e7 What Makes a Unicorn Product Manager 
- https://jkebertz.medium.com/should-staff-engineers-be-writing-code-1237abf891f4 Should Staff+ Engineers Be Writing Code?
- https://medium.com/google-cloud/everything-you-always-wanted-to-know-about-vpc-peering-but-were-afraid-to-ask-2b26267ba7d9 Everything You Always Wanted to Know About VPC Peering (Google Cloud)
- https://productcoalition.com/4-fundamental-mistakes-you-are-making-with-product-okrs-6ab36d3fadc0 Four Fundamental Mistakes You Are Making With Product OKRs
# 07-11-2021
- https://medium.com/leading-literally/mistakes-ive-made-as-an-engineering-manager-so-you-can-avoid-them-3391c5b63f66 Mistakes I’ve Made as an Engineering Manager — so you can avoid them
- https://queue.acm.org/detail.cfm?id=3454124 The SPACE of Developer Productivity
- https://medium.com/swlh/minimum-viable-product-manager-852e744f041d Minimum Viable Product Manager. Bringing up first time product managers
- https://blog.kronis.dev/articles/never-update-anything Never update anything
# 02-11-2021
- https://www.confluent.io/blog/how-kafka-streams-works-guide-to-stream-processing/ How Kafka Streams Works: A Guide to Stream Processing
- https://blog.coinbase.com/how-we-scaled-data-streaming-at-coinbase-using-aws-msk-4595f171266c How we scaled data streaming at Coinbase using AWS MSK
- https://medium.com/startup-grind/whats-a-cto-vs-vp-engineering-b24095d36d6a What’s a CTO vs. VP Engineering?
# 01-11-2021
- https://wotnot-io.medium.com/10-growth-hacking-strategies-for-saas-companies-f1fef859a2ed 10 Growth Hacking Strategies for SaaS Companies
- https://medium.com/graalvm/graalvm-21-3-is-here-java-17-native-image-performance-updates-and-more-ac4cbafcfc05 GraalVM 21.3 is here: Java 17, Native Image performance updates and more ������
- https://medium.com/swlh/a-startup-founders-framework-for-evaluating-mentor-advice-ed2a0949e76 A Startup Founder’s Framework for Evaluating Mentor Advice
- https://medium.com/point-nine-news/how-to-bulletproof-your-fundraising-deck-d18c0de6d93d How to bulletproof your fundraising deck
- https://www.cantorsparadise.com/learn-anything-faster-by-using-the-feynman-technique-6565a9f7eda7 Learn Anything Faster By Using The Feynman Technique
- https://entrepreneurshandbook.co/how-my-ceo-went-from-0-to-30-million-with-the-okr-strategy-53e2cfeba8b7 Implementing the OKR Strategy
- https://caseycaruso.medium.com/engineer-by-day-venture-capitalist-by-night-585929430c21 Engineer by Day, Venture Capitalist by Night #google #bessemer
- https://uxdesign.cc/the-po-vs-pm-madness-13ee6642077a The PO vs PM or PO + PM madness
- https://medium.com/@anupmarwadi/your-first-30-days-as-a-cto-d5ec5b58723e Your first 30-days as a CTO
- https://www.capitalone.com/tech/software-engineering/zio-roadmap/ Where the ZIO Roadmap is Headed Next
# 30-10-2021
- https://github.com/github/copilot-docs/blob/main/docs/jetbrains/gettingstarted.md#getting-started-with-github-copilot-in-jetbrains Github Copilot for IntelliJ
# 25-10-2021
- https://nmoryl.com/dont-hire-a-chief-of-staff-b65c16d56eac Don’t Hire a Chief of Staff. 
# 17-10-2021
- https://productcoalition.com/what-do-product-managers-do-ce076ad4a8e7 What Makes a Unicorn Product Managager
- https://blog.softwaremill.com/will-project-loom-obliterate-java-futures-fb1a28508232 Will Project Loom obliterate Java Futures? #fibers
- https://eventuallycoding.com/2021/07/06/les-salaires-dans-la-tech/ Les salaires dans la tech
- https://medium.com/event-driven-utopia/real-time-streaming-for-mortals-how-redpanda-and-materialize-making-it-a-reality-18ac0bdc6f43 Redpanda + Materialize as streaming database #kafka
# 16-10-2021
- https://venturebeat.com/2021/09/14/data-streaming-service-streamnative-raises-23-7m/ Data streaming service StreamNative takes in $23.7M #pulsar
- https://github.com/lampepfl/monadic-reflection Loom to use direct code style instead of a monadic flow #scala
# 10-10-2021
- https://www.loom.com/share/5efceb288b634a449041918bdba08202 Google Chrome - High WIP consequences — John Cutler
- https://achardypm.medium.com/introduction-to-roadmap-architecture-7dee6234a688 Introduction to Roadmap Architecture
- https://medium.com/serious-scrum/how-to-nail-a-product-owner-interview-4c475e4f8c74 How to Nail a Product Owner Interview
- https://medium.com/gsquad/what-does-a-healthy-engineering-team-look-like-59c998d0aed What Does a Healthy Engineering Team Look Like?
- https://medium.com/building-carta/how-to-be-a-successful-manager-of-managers-1b3954428312 How to be a successful manager of managers
- https://medium.com/technexthere/data-engineering-technologies-2021-8f46bb284474 Data Engineering Technologies in 2021
- https://medium.com/wix-engineering/5-database-technologies-used-by-2000-wix-microservices-e4769638b8c3 5 Database technologies used by 2000 Wix microservices
# 06-10-2021
- https://thedataguy.in/debezium-with-aws-msk-iam-authentication/ Debezium With AWS MSK IAM Authentication
- https://medium.com/technexthere/have-to-know-30-data-streaming-and-event-processing-technologies-in-2021-aaf02977de75 Top Data Streaming and Event Processing Technologies in 2021 (Conduktor!)
- https://forum.confluent.io/t/partitioning-gotchas-dont-use-avro-json-or-protobuf-for-keys-and-be-aware-of-client-hashing-differences/2718 Partitioning gotchas -- Don't use Avro, Json, or Protobuf for keys and be aware of client hashing differences
- https://netflixtechblog.com/towards-a-reliable-device-management-platform-4f86230ca623 Towards a Reliable Device Management Platform using Alpakka Kafka
- https://blog.crunchydata.com/blog/postgres-change-data-capture-with-debezium Change Data Capture in Postgres With Debezium
- https://canvatechblog.com/scaling-engineering-at-canva-ca10c6b5410a Scaling engineering at Canva
# 05-10-2021
- https://medium.com/race-conditions/kafka-the-afterthoughts-the-schema-management-7ea30e9518e4 Kafka the afterthoughts: message encoding and schema management
# 03-10-2021
- https://itnext.io/hydrating-a-data-lake-using-log-based-change-data-capture-cdc-with-debezium-apicurio-and-kafka-799671e0012f Hydrating a Data Lake using Log-based Change Data Capture (CDC) with Debezium, Apicurio, and Kafka Connect on AWS
- https://newsletter.pragmaticengineer.com/p/project-management-in-tech How Big Tech Runs Tech Projects and the Curious Absence of Scrum
- https://aws.amazon.com/blogs/aws/introducing-amazon-msk-connect-stream-data-to-and-from-your-apache-kafka-clusters-using-managed-connectors/ Amazon MSK Connect – Stream Data to and from Your Apache Kafka Clusters Using Managed Connectors
# 02-10-2021
- https://scalac.io/blog/what-is-apache-kafka-and-what-are-kafka-use-cases/ What is Apache Kafka, and what are Kafka use cases?
- https://medium.com/@balbinolucas/the-ultimate-guide-of-a-product-managers-day-to-day-activities-841ebe3df16b The Ultimate Guide of a Product Manager’s Day to Day Activities
- https://medium.com/management-matters/afc-7c2dff1c31d6 How to spread and save the company’s technical knowledge
- https://medium.com/technexthere/modern-streaming-database-technologies-in-2021-5a23181ab0c Modern Streaming Database Technologies in 2021
# 26-09-2021
- https://emaxklein.medium.com/10-micro-habits-for-better-leadership-1bb18a444378 10 Micro-Habits for Better Leadership
- https://medium.com/event-driven-utopia/understanding-materialized-views-3-stream-table-joins-with-cdc-77591d2d6fa0 Understanding Materialized Views — 3 : Stream-Table Joins with CDC
# 23-09-2021
- https://netflixtechblog.com/towards-a-reliable-device-management-platform-4f86230ca623 Kafka streams processing. Spring Kafka vs Alpakka
# 21-09-2021
- https://www.youtube.com/watch?v=dunoZF1rs7o Java 17 features
# 18-09-2021
- https://medium.com/teads-engineering/investigating-a-network-issue-encountered-with-kafka-on-aws-38148fc391 Investigating a network issue with Kafka on AWS
# 13-09-2021
- https://eng.uber.com/kafka-async-queuing-with-consumer-proxy/ Enabling Seamless Kafka Async Queuing with Consumer Proxy
# 12-09-2021
- https://tgrez.github.io/posts/2019-04-13-kafka-transactions.html Apache Kafka transactional.id impact, to fence producers
# 05-09-2021
- https://medium.com/event-driven-utopia/rise-of-the-streaming-databases-episode-1-materialize-36d0cfbfb730 Rise of the Streaming Databases: Materialize
- https://medium.com/whispering-data/the-state-of-data-engineering-in-2021-478f49e89873 The State of Data Engineering in 2021
- https://www.confluent.io/blog/ksqldb-architecture-and-advanced-features/ Guide to ksqlDB Architecture and Advanced Features
# 01-09-2021
- https://ariadne.space/2021/08/26/there-is-no-such-thing-as-a-glibc-based-alpine-image/ there is no such thing as a “glibc based alpine image” – Ariadne's Space
# 15-08-2021
- https://www.touilleur-express.fr/2021/08/14/lundi-12-juillet-chez-doctolib/ Retour sur la soirée du lundi 12 juillet chez Doctolib #aws #aurora
# 14-08-2021
- https://pganalyze.com/blog/postgres-create-index Postgres CREATE INDEX: Operator classes, index types & more
# 08-08-2021
- https://medium.com/@sgblank/a-path-to-the-minimum-viable-product-d54d5a500baf A Path to the Minimum Viable Product
# 07-08-2021
- https://www.infoq.com/articles/microservices-inside-out/ Turning Microservices Inside-Out
# 31-07-2021
- https://eng.uber.com/pinot-real-time-ingestion/ Pinot Real-Time Ingestion with Cloud Segment Storage
- https://www.crowdstrike.com/blog/how-crowdstrike-addressed-uneven-partition-lag-in-kafka/ How CrowdStrike Addressed Uneven Partition Lag in Kafka
# 30-07-2021
- https://gist.github.com/djspiewak/f4cfc08e0827088f17032e0e9099d292 cats-effect 3 and ZIO 2: comparative-benchmarks
# 25-07-2021
- https://medium.com/@jboogie/what-does-an-agile-product-roadmap-look-like-cf0dbe5be4ef What does an agile product roadmap look like?
- https://www.astronomer.io/blog/airflow-dbt-1 Airflow and dbt at scale
# 21-07-2021
- https://uxdesign.cc/we-gave-up-sketch-and-rebuilt-our-design-system-in-figma-a1dfc64948e5 We gave up Sketch and rebuilt our design system in Figma
# 18-07-2021
- https://vgallet.github.io/posts/kafka-features/ Kafka Features good to know
- https://github.com/slouc/concurrency-in-scala-with-ce Concepts of asynchronous and concurrent programming in Scala, based on the Cats Effect library.
# 17-07-2021
- https://leevs.dev/kafka-cost-reduction/ A Practical Guide for Kafka Cost Reduction
- https://blog.michalp.net/posts/scala/oauth2-app-p2/ OAuth2 Scala application with sttp-oauth2
- https://medium.com/whispir/how-our-cross-functional-teams-decide-what-to-build-at-whispir-e97757171e49 How Our Cross-Functional Teams Decide What to Build
- https://jefago.medium.com/establishing-a-product-organization-structure-5cb4fbc2153 Establishing a Product Organization Structure
# 10-07-2021
- https://strimzi.io/blog/2021/06/08/broker-tuning/ Optimizing Kafka broker configuration
# 04-07-2021
- https://www.youtube.com/watch?v=oKaQXxEa7a8 Part 3 - ZIO[_, Error, _] & Variance - Getting Started with #ZIO in #Scala3
- https://www.youtube.com/watch?v=0OTYAVWUnU4 Scala with ZIO: Introduction to Fibers
- https://www.youtube.com/watch?v=VVKBoSryJFg Tooling Talks Episode 2 - Scala 3, Metals, Scalafix - Meriam Lachkar
# 27-06-2021
- https://marcosbento.medium.com/confluent-an-ipo-breakdown-where-infrastructure-it-happens-32ee3dfd77f3 Confluent — An IPO breakdown
# 05-06-2021
- https://tech.ebayinc.com/engineering/resiliency-and-disaster-recovery-with-kafka/ Resiliency and Disaster Recovery with Kafka
- https://www.infoq.com/articles/saga-orchestration-outbox/ Saga Orchestration for Microservices Using the Outbox Pattern
- https://blog.arkey.fr/2020/11/30/off-heap-reconnaissance/ Off-Heap memory reconnaissance • Brice Dutheil
- https://gist.github.com/djspiewak/8c3c0eadabf16c2fddda796531c3d5ec Building Remote Teams
# 04-06-2021
- https://github.com/feltcoop/why-svelte Why Svelte is our choice for a large web project in 2020
- https://www.galiglobal.com/blog/2021/20210313-The-principal-role.html My thoughts about the Principal (Software Engineer) role
# 01-06-2021
- https://itnext.io/pulsar-advantages-over-kafka-7e0c2affe2d6 Pulsar Advantages Over Kafka
# 30-05-2021
- https://talawah.io/blog/extreme-http-performance-tuning-one-point-two-million/ Extreme HTTP Performance Tuning: 1.2M API req/s on a 4 vCPU EC2 Instance
- https://strimzi.io/blog/2021/05/07/deploying-kafka-with-lets-encrypt-certificates/ Deploying Kafka with Strimzi and Let's Encrypt certificates
- https://www.morling.dev/blog/exploring-zookeeper-less-kafka/ Exploring ZooKeeper-less Kafka - Gunnar Morling
- https://thinkbeforecoding.com/post/2018/01/25/functional-core Functional Core: Errors are events
# 15-05-2021
- https://cwiki.apache.org/confluence/display/KAFKA/KIP-698%3A+Add+Explicit+User+Initialization+of+Broker-side+State+to+Kafka+Streams KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams
# 05-05-2021
- https://www.confluent.io/blog/announcing-ksqldb-0-17-0-new-features-and-updates/ ksqlDB 0.17.0 - Pull Queries updates & lambda functions
# 30-04-2021
- https://scattered-thoughts.net/writing/internal-consistency-in-streaming-systems/ Internal VS Eventual consistency in streaming systems. Kafka Streams, ksqlDB, Flink
- https://medium.com/mobimeo-technology/how-kafka-helped-us-to-restructure-our-analytics-solution-2f2ee7efeec2 How Kafka helped us to restructure our Analytics solution
# 22-04-2021
- https://www.kai-waehner.de/blog/2021/04/20/comparison-open-source-apache-kafka-vs-confluent-cloudera-red-hat-amazon-msk-cloud/ Comparison of Open Source Apache Kafka vs Vendors including Confluent, Cloudera, Red Hat, Amazon MSK, and tools like Conduktor :)
- https://interviewdaemon.medium.com/system-design-whatsapp-788705bd4fb0 System Design: WhatsApp
# 19-04-2021
- https://kubernetes.io/blog/2021/04/19/introducing-indexed-jobs/ Introducing Indexed Jobs in Kubernetes
# 18-04-2021
- https://f.hubspotusercontent30.net/hubfs/5193039/Engineering%20Retrospectives/Kafka%20Migration%20and%20Lessons%20Learned%20-%20April%202021.pdf Kafka Migration, AWS, Lessons Learned @ Honeycomb
# 02-04-2021
- https://www.47deg.com/blog/arrow-0.13.0-release/ A good decision: many things deprecated in ArrowKt, and a better syntax overall 
# 28-03-2021
- https://medium.com/swlh/why-kafka-is-so-fast-bde0d987cd03 Why Kafka Is so Fast.
- https://www.morling.dev/blog/talking-to-postgres-through-java-16-unix-domain-socket-channels/ Talking to Postgres Through Java 16 Unix-Domain Socket Channels
- https://blog.twitter.com/engineering/en_us/topics/infrastructure/2020/kafka-as-a-storage-system.html Kafka as a storage system at Twitter
# 23-03-2021
- https://blog.dream11engineering.com/introducing-zio-http-2b66bb036fdc Introducing ZIO http
- https://medium.com/milkie-way/we-burnt-72k-testing-firebase-cloud-run-and-almost-went-bankrupt-part-1-703bb3052fae We Burnt $72K testing Firebase + Cloud Run and almost went Bankrupt
# 21-03-2021
- https://ssudan16.medium.com/exactly-once-processing-in-kafka-explained-66ecc41a8548 Exactly-Once Processing in Kafka
- https://medium.com/free-code-camp/books-that-every-engineering-manager-should-read-7a053e296d11 Engineering Manager Books
- https://medium.com/efesent-solutions/the-three-perspectives-of-a-software-engineering-manager-53fcf6ea525d Perspectives of a software engineering manager
# 20-03-2021
- https://guidoschmutz.wordpress.com/2021/03/20/last-week-in-stream-data-integration-stream-analytics-20-3-2021/ Last Week in Stream Data Integration & Stream Analytics – 20.3.2021 | Enjoy IT - SOA, Java, Event-Driven Computing and Integration
- https://developers.facebook.com/blog/post/2021/03/09/introducing-relay-hooks-improved-react-apis-relay/ Relay Hooks: Improved React APIs for Relay
- https://jamesward.com/2021/03/16/the-modern-java-platform-2021-edition/ The Modern Java Platform - 2021
# 16-03-2021
- https://blog.softwaremill.com/tapir-serverless-a-proof-of-concept-6b8c9de4d396 Tapir serverless: a proof of concept
# 15-03-2021
- https://medium.com/wix-engineering/4-microservices-caching-patterns-at-wix-b4dfee1ae22f 4 Microservices Caching Patterns at Wix (s3, kafka, dynamodb/cdc, varnish)
- https://medium.com/@Python_Primer/server-less-cloud-sql-backups-on-gcp-d3c3d43548ca Serverless Cloud SQL backups on GCP
# 14-03-2021
- https://www.confluent.io/blog/how-to-tune-rocksdb-kafka-streams-state-stores-performance/ Performance Tuning RocksDB for Kafka Streams’ State Stores
# 13-03-2021
- https://www.confluent.io/blog/integrate-kafka-and-jaeger-for-distributed-tracing-and-monitoring/ Integrate Kafka Clients with Jaeger for Distributed Tracing and Monitoring
- https://kornel.ski/rust-c-speed Speed of Rust vs C
# 08-03-2021
- https://www.youtube.com/watch?v=NY2ZkcYZj54 Scala 3
- https://www.youtube.com/watch?v=PaogLRrYo64 Structuring Services with ZIO and ZLayer
- https://www.infoq.com/articles/saga-orchestration-outbox/ Saga Orchestration for Microservices Using the Outbox Pattern
# 07-03-2021
- https://scalac.io/blog/streaming-microservices-with-zio-and-kafka/ How To Implement Streaming Microservices Using ZIO and Kafka
- https://typelevel.org/blog/2021/02/21/fibers-fast-mkay.html Eat Fibers
- https://coralogix.com/log-analytics-blog/the-coralogix-operator-a-tale-of-zio-and-kubernetes/ The Coralogix Operator: A Tale of ZIO and Kubernetes
- https://itnext.io/ingest-data-from-apache-kafka-into-azure-cosmos-db-cassandra-api-using-kafka-connect-11e054f82a05 Ingest data from Apache Kafka into Azure Cosmos DB Cassandra API using Kafka Connect
- https://blog.bitsrc.io/will-deno-catchup-with-nodejs-in-2021-7ab758429647 Deno / NodeJS in 2021
# 06-03-2021
- https://medium.com/expedia-group-tech/fully-reactive-stream-processing-727c4c4371e8 Reactive Stream Processing with Apache Kafka and Project Reactor
- https://www.confluent.io/blog/running-kafka-at-scale-at-pinterest/ How Pinterest Runs Kafka at Scale
- https://levelup.gitconnected.com/6-things-you-need-to-know-about-kafka-before-using-it-in-a-system-design-interview-1fc31451732c Kafka / System Design Interview 
- https://www.confluent.io/blog/ksqldb-0-15-reads-more-message-keys-supports-more-data-types/#multiple-key-columns Compound KEYs, group by & partition by multiple fields
# 28-02-2021
- https://www.oreilly.com/radar/what-you-need-to-know-about-product-management-for-ai/ What you need to know about product management for AI
# 27-02-2021
- https://www.scala-lang.org/2021/02/26/tuples-bring-generic-programming-to-scala-3.html Tuples bring generic programming (HList~) to Scala 3.
# 21-02-2021
- https://www.confluent.io/blog/42-ways-zookeeper-removal-improves-kafka/ 42 Ways Zookeeper Removal Improves Apache Kafka
# 20-02-2021
- https://www.confluent.io/blog/ksqldb-0-15-features-updates/ Announcing ksqlDB 0.15
- https://appddeevvmeanderings.blogspot.com/2021/02/zio-quick-read-extracting-executor-for.html ZIO executor, service, layers, http, blocking #scala
- https://sookocheff.com/post/architecture/making-modular-monoliths-work/ Making Modular Monoliths Work
# 13-02-2021
- https://www.confluent.io/blog/write-a-kafka-connect-connector-with-configuration-handling/ How to Write a Kafka Connector with Proper Configuration Handling
- https://levelup.gitconnected.com/fixing-debezium-connectors-when-they-break-on-production-49fb52d6ac4e Tips about Fixing Debezium Connectors
- https://medium.com/swlh/netty-nio-distilled-c1f053911950 Netty NIO Distilled
- https://medium.com/moveax/how-postgresql-replication-works-6288b3e6000e How PostgreSQL replication works
- https://www.wix.engineering/post/4-steps-for-kafka-rebalance-notes-from-the-field 4 Steps for Kafka Rebalance - Wix
# 03-02-2021
- https://hakibenita.com/postgresql-unused-index-size Save lots of space: you may need to create a *partial* INDEX on your Postgres table if you're not looking for NULL on large tables
# 01-02-2021
- https://webtransparency.cs.princeton.edu/dark-patterns/ Dark Patterns at Scale: Findings from a Crawl of 11K Shopping Websites
# 31-01-2021
- https://www.youtube.com/watch?v=4v_m7xtDCNk Kafka Streams Interactive Queries and gRPC
- https://learnk8s.io/terraform-gke Provisioning Kubernetes clusters on GCP with Terraform and GKE
# 26-01-2021
- https://portavita.github.io/2021-01-25-Why_Kafka_compression_might_save_you_thousands_of_dollars/ Apache Kafka compression: zstd: save space & time = money
- https://medium.com/wix-engineering/kafka-cron-using-wix-greyhound-64c7b99a1c3e Kafka Cron using wix/greyhound #scala #zio
- https://medium.com/google-cloud/google-pub-sub-lite-for-kafka-users-dec8a7cfc5e5 Pub/Sub Lite <-> Kafka
# 25-01-2021
- https://blog.softwaremill.com/sttp-client-3-is-here-bb9ebe925931 sttp client 3 is here!
# 19-01-2021
- https://www.elastic.co/blog/why-license-change-AWS Amazon: NOT OK - why we had to change Elastic licensing | Elastic Blog
# 15-01-2021
- https://strimzi.io/blog/2021/01/07/consumer-tuning/ Optimizing Kafka consumers
# 11-01-2021
- https://www.youtube.com/watch?v=iFeTUhYpPLs ZIO Cache, Compositional Caching by Adam Fraser
- https://mikemybytes.com/2021/01/11/single-partition-kafka-topics/ Single-partition Kafka topics
# 28-12-2020
- https://medium.com/cloud-belivers/olap-system-selection-choose-apache-kylin-or-clickhouse-718a972498bb OLAP: Apache Kylin or ClickHouse?
# 21-12-2020
- https://www.confluent.io/blog/apache-kafka-2-7-features-updates-improvements/ Apache Kafka 2.7 - Latest Features, Updates, and Improvements
- https://www.infoq.com/news/2020/12/aws-reinvent-2020/ Recap of AWS re:Invent 2020
# 16-12-2020
- https://www.scala-lang.org/blog/2020/12/15/scala-3-crossing-the-finish-line.html Scala 3 - Crossing the finish line (!!!!!)
# 14-12-2020
- https://towardsdatascience.com/enabling-a-powerful-search-capability-building-and-deploying-a-real-time-stream-processing-etl-a27ecb0ab0ae Building and Deploying a Real-Time Stream Processing ETL Engine with Kafka and ksqlDB #elasticsearch
# 12-12-2020
- https://www2.slideshare.net/DmitryKarlinsky1/demystifying-functional-effect-systems-in-scala/DmitryKarlinsky1/demystifying-functional-effect-systems-in-scala Demystifying functional effect systems in Scala: construction of a stacksafe fiber-capable IO monad
- https://blog.octo.com/en/technical-due-diligence-safeguarding-your-it-startup-investment/ Technical Due Diligence–Safeguarding your IT Startup Investment
- https://www.confluent.io/blog/kafka-lag-monitoring-and-metrics-at-appsflyer/ Apache Kafka Lag Monitoring  using Burrow
- https://medium.com/better-programming/integration-test-for-kafka-consumer-be76528b843a Integration Tests for Kafka Consumer (and Spring ������)
- https://engineering.linecorp.com/en/blog/kafka-based-job-queue-library-decaton-examples/ Kafka-based job queue library 'Decaton' examples
- https://fasterthanli.me/articles/aiming-for-correctness-with-types Aiming for correctness with types (JS/Go/Rust)
# 10-12-2020
- https://github.com/scala/scala/releases/tag/v2.13.4 Release Scala 2.13.4
# 08-12-2020
- https://www.infoq.com/news/2020/12/grafana-tempo-distributed-tracin/ Grafana Tempo, a Distributed Tracing System
# 05-12-2020
- https://cloud.google.com/blog/products/application-development/get-to-know-google-cloud-workflows Google Cloud Workflows: serverless mode, failover management, retries, timeout, security aspects. Looking good.
# 04-12-2020
- https://medium.com/@svroonland/processing-zio-effects-through-a-pipeline-c469e28dff62 Processing ZIO effects through a pipeline #scala
- https://blog.timescale.com/blog/timescaledb-vs-amazon-timestream-6000x-higher-inserts-175x-faster-queries-220x-cheaper/ TimescaleDB vs. Amazon Timestream: a total destroyer. 6000x faster inserts, 5-175x query speed
- https://aws.amazon.com/blogs/opensource/want-more-postgresql-you-just-might-like-babelfish/ AWS: Babelfish, a PostgreSQL compatiblity layer for Amazon Aurora
# 03-12-2020
- https://kubernetes.io/blog/2020/12/02/dont-panic-kubernetes-and-docker/ Don't Panic: Kubernetes and Docker
# 28-11-2020
- https://towardsdatascience.com/why-the-future-of-etl-is-not-elt-but-el-t-880f08aab74a The Future of ETL Is Not ELT, But EL(T)
# 20-11-2020
- https://www.scala-lang.org/blog/2020/11/19/scala-3-forward-compat.html Migrating to Scala 3 has never been so easy!
# 16-11-2020
- https://alexn.org/blog/2020/11/15/managing-database-migrations-scala.html Database Migrations using Flyway #Scala
# 15-11-2020
- https://medium.com/datadriveninvestor/if-youre-using-kafka-with-your-microservices-you-re-probably-handling-retries-wrong-8492890899fa Kafka: Aggregates and Retries
# 14-11-2020
- https://www.confluent.io/blog/spring-kafka-protobuf-part-1-event-data-modeling Apache Kafka and Protobuf Part 1: Event Data Modeling
# 13-11-2020
- https://www.youtube.com/watch?v=SJeAb-XEIe8 The Rise Of Loom And The Evolution Of Reactive Programming #scala #zio
- https://scalameta.org/metals/blog/2020/11/06/sbt-BSP-support.html sbt BSP support · Metals
# 12-11-2020
- https://www.youtube.com/watch?v=hvYqSz_BgUM Netty 5: Lessons Learned
- https://turkogluc.com/postgresql-capture-data-change-with-debezium/ CDC Pipelines for Postgres with Debezium Kafka Connector
# 11-11-2020
- https://hmemcpy.com/2020/08/running-postgres-integration-tests-easily-with-testcontainers-and-zio-test/ Running Postgres integration tests easily with TestContainers and ZIO Test
- https://medium.com/google-cloud/google-cloud-pub-sub-ordered-delivery-1e4181f60bc8 Google Cloud Pub/Sub Ordered Delivery
- https://blog.softwaremill.com/whats-coming-up-in-sttp-client-3-30d01ab42d1b sttp client 3: simplification & Improvements #scala
- https://softwaremill.com/kafka-pitfalls-kafka-architect/ Kafka pitfalls - Q&A with a Kafka Architect
# 10-11-2020
- https://www.scala-lang.org/2020/11/06/explicit-term-inference-in-scala-3.html From implicits to extension and given #scala
# 08-11-2020
- https://www.confluent.io/blog/pull-queries-in-preview-confluent-cloud-ksqdb/ Preview Feature: Pull Queries in Confluent Cloud ksqlDB. Sweet!
- https://github.com/erebe/personal-server A complete "tutorial" to configure a personal server (security, firewall, k3s, ingress, certificates, mail server, github actions, backups, vpn, pihole..)
- https://typelevel.org/blog/2020/10/30/concurrency-in-ce3.html Concurrency in Cats Effect 3 #scala
- https://www.slideshare.net/streamnative/low-latency-stream-processing-with-jet Low latency stream processing with Jet and Kafka (Hazelcast)
- https://www.slideshare.net/ConfluentInc/performance-tuning-rocksdb-for-kafka-streams-state-stores Performance Tuning RocksDB for Kafka Streams’ State Stores
- https://medium.com/helidon/can-java-microservices-be-as-fast-as-go-5ceb9a45d673 Benchmarking Java + Graal & Go. Java is better at multi-threading (and mem+), otherwise Go crunches it.
# 07-11-2020
- https://rmoff.net/2020/11/03/streaming-geopoint-data-from-kafka-to-elasticsearch/ Ways to stream geopoint data from Kafka to Elasticsearch
# 06-11-2020
- https://github.com/leobenkel/ZparkIO ZparkIO: Framework to use Spark and ZIO
- https://www.youtube.com/watch?v=xWCb54turxg Scala 3 Indentation; -Yindent-colons
- https://bszwej.medium.com/domain-driven-design-with-fp-in-scala-21b557f94aa5 Domain-Driven Design with FP in Scala
# 27-10-2020
- https://blog.softwaremill.com/designing-tapirs-websockets-support-ff1573166368 Designing tapir’s WebSockets support
# 23-10-2020
- https://medium.com/botify-labs/experience-working-with-600-tb-elasticsearch-cluster-b6b5a4fa9127 Experience working with 600+TB ElasticSearch cluster
- https://www.confluent.io/blog/bounding-ksqldb-memory-usage/ Interesting post about Memory Usage in ksqlDB and malloc issues
# 22-10-2020
- https://engineering.fb.com/networking-traffic/how-facebook-is-bringing-quic-to-billions/ QUIC + HTTP/3 impact at Facebook
# 18-10-2020
- https://build.thebeat.co/yet-another-kubernetes-dns-latency-story-2a1c00ebbb8d Yet Another Kubernetes DNS Latency Story. Node Local DNS Cache issues.
- https://medium.com/better-programming/accelerate-your-ci-cd-pipelines-with-kubernetes-in-docker-kind-109a67b39c82 CI/CD Pipelines With Kubernetes in Docker (KinD)
- https://jet-start.sh/blog/2020/10/06/enabling-full-text-search Using Hazelcast Jet + Debezium to sink into Elasticsearch
# 16-10-2020
- https://www.cybercite.fr/core-web-vitals-google.html Core Web Vitals: de nouvelles règles côté Google 2021 à prendre en compte pour le SEO
- https://www.confluent.io/blog/how-real-time-materialized-views-work-with-ksqldb/ How Real-Time Materialized Views Work with ksqlDB, with animations <3
- https://blog.kowalczyk.info/article/19f2fe97f06a47c3b1f118fd06851fad/lessons-learned-porting-50k-loc-from-java-to-go.html Lessons learned porting 50k loc from Java to Go
# 12-10-2020
- http://dtrace.org/blogs/bmc/2020/10/11/rust-after-the-honeymoon/ Rust tips
# 07-10-2020
- https://www.confluent.io/blog/ksqldb-0-12-0-features-updates/ ksqlDB 0.12.0: CREATE OR REPLACE <3
- https://www.confluent.io/blog/confluent-platform-6-0-delivers-the-most-powerful-event-streaming-platform-to-date/ Kafka: Tiered Storage, Self-Balancing clusters
- https://medium.com/swlh/how-to-consume-kafka-efficiently-in-golang-264f7fe2155b Consume Kafka Efficiently in Golang
- https://www.mongodb.com/blog/post/mongo-db-connector-for-apache-kafka-1-3-available-now MongoDB Connector for Apache Kafka 1.3
- https://github.com/rayokota/kcache An In-Memory Cache Backed by Apache Kafka
- https://medium.com/streamthoughts/whats-new-in-azkarra-streams-0-8-3ed1a4ab803d Azkarra Streams 0.8 for Kafka Streams: new cool stuff!
- https://blogit.michelin.io/measuring-kafka-uptime/ Measuring Kafka uptime
- https://medium.com/data-rocks/managing-kafka-connectors-at-scale-using-kafka-connect-manager-kcm-31d887de033c Kafka Connect Manager: auto create/update/delete connectors
- https://www.infoq.com/articles/event-driven-finding-seams/ From Monolith to Event-Driven
- https://medium.com/expedia-group-tech/be-vigilant-about-time-order-in-event-based-data-processing-cbfde600dd7d Time Ordering in Event-Based Data Processing
- https://www.paepper.com/blog/posts/how-to-properly-manage-ssh-keys-for-server-access/ Manage ssh keys for server access, dedicated certificates & roles
- https://blog.softwaremill.com/java-15-through-the-eyes-of-a-scala-programmer-edde1ea04492 Java 15 through the eyes of a Scala programmer. Java 15: Only simple cases are handled by new features.
# 04-10-2020
- https://cloud.google.com/pubsub/docs/ordering#go Gcloud Pub/Sub: Ordering messages & filtering messages.
- https://aws.amazon.com/blogs/aws/store-and-access-time-series-data-at-any-scale-with-amazon-timestream-now-generally-available/ Amazon Timestream database now GA
- https://www.infoq.com/presentations/java-11-production-story/ A Year with Java 11 in Production
- https://blog.softwaremill.com/annoying-things-in-scala-2-thatll-be-mostly-gone-in-scala-3-e1479a6d855c Things in Scala 2 that’ll be (mostly) gone in Scala 3
# 02-10-2020
- https://www.hownormalami.eu/ How normal am I? Interesting to try out by yourself
# 24-09-2020
- https://www.postgresql.org/about/news/2077/ PostgreSQL 13 Released!
- https://medium.com/bakdata/solving-my-weird-kafka-rebalancing-problems-c05e99535435 Kafka Rebalancing Problems
- https://medium.com/gumgum-tech/5-things-we-overlooked-when-putting-our-first-app-on-kubernetes-58583c1783e4 Things to know when using Kubernetes
# 22-09-2020
- https://build.affinity.co/how-we-used-postgres-extended-statistics-to-achieve-a-3000x-speedup-ea93d3dcdc61 Postgres extended statistics to achieve a 3000x speedup
- https://pganalyze.com/blog/postgres13-better-performance-monitoring-usability Postgres 13: Better Performance, Monitoring & More
- https://jet-start.sh/blog/2020/09/18/cdc-meets-stream-processing Hazelcast Jet meets Debezium for CDC #kafka
- https://medium.com/@cbenaveen/high-available-task-scheduling-design-using-kafka-and-kafka-streams-dcd81121d43b Using Kafka Streams to schedule tasks
- https://letsencrypt.org/2020/09/17/new-root-and-intermediates.html Saving bandwidth using ECDSA. Let's Encrypt's New Root and Intermediate Certificates
- https://github.com/svroonland/rezilience ZIO circuit breaker (+ retry, bulkhead) #scala
# 20-09-2020
- https://cloud.google.com/blog/products/containers-kubernetes/how-gvisor-protects-google-cloud-services-from-cve-2020-14386 New container escape, to obtain root privileges on the host node. Hopefully we have gVisor on GCP!
- https://medium.com/@codeboten/bpf-experiments-on-macos-9ad0cf21ea83 BPF Experiments on MacOS / TIL Remote-SSH using VSCode (doesn't work with a RPi :()
# 18-09-2020
- https://tech.ovoenergy.com/safe-expressive-code-with-refinement-types/ Expressive Code with Refinement Types #scala
- https://jamesmcm.github.io/blog/2020/07/25/intro-dod/ Data Oriented Design with Rust
- https://medium.com/wix-engineering/5-lessons-learned-from-my-continuing-awesome-journey-with-zio-66319d12ed7c Some tips using ZIO
- https://levelup.gitconnected.com/top-4-dying-programming-languages-of-2020-1a4149753e92 Top 4 Dying Programming Languages: "Still, [Scala] is not a very active language." He has no idea.
- https://www.scala-lang.org/blog/2020/09/15/scala-3-the-community-powered-release.html Scala 3 by fall 2020 ❤️
# 17-09-2020
- https://kotlinlang.org/docs/reference/whatsnew14.html#coroutine-debugger What's New in Kotlin 1.4: so many things! ������
- https://debezium.io/blog/2020/09/15/debezium-auto-create-topics/ Auto-creating Debezium Change Data Topics with custom config
- https://guidoschmutz.wordpress.com/2020/09/15/last-week-in-stream-data-integration-stream-analytics-14-9-2020/ Last Week in Stream Data Integration & Stream Analytics – 15.9.2020
- https://github.com/n8n-io/n8n An awesome visual Workflow Automation tool. Mix that to some ksqldb pull queries and..
# 16-09-2020
- https://medium.com/swlh/how-to-deploy-a-cloud-sql-db-with-a-private-ip-only-using-terraform-e184b08eca64 Private Cloud SQL with a bastion; using Terraform
- https://medium.com/better-programming/event-driven-architecture-as-a-strategy-dfb8370724c9 Event-Driven Architecture as a Strategy
# 15-09-2020
- https://medium.com/swlh/kubernetes-ingress-controller-overview-81abbaca19ec Kubernetes Ingress Controller Overview & Comparison
- https://codeburst.io/automating-kubernetes-best-practices-7a8276ff7b08 Kubernetes Best Practices with Polaris
# 09-09-2020
- https://medium.com/inlocotech/challenges-of-running-grpc-services-in-production-b3a113df2542 gRPC services in production, Envoy as side-car + DNS service discovery
- https://itnext.io/architecting-kubernetes-clusters-choosing-a-worker-node-size-b3729cc0c78f Architecting Kubernetes clusters — choosing a worker node size
# 08-09-2020
- https://blog.magrathealabs.com/go-vs-rust-writing-a-cli-tool-231accadcc88 Go vs Rust: Writing a CLI tool
# 07-09-2020
- https://medium.com/@bbau00/10-antipatterns-for-kubernetes-deployments-e97ce1199f2d Antipatterns for Kubernetes Deployments
# 05-09-2020
- https://blog.trailofbits.com/2019/07/08/fuck-rsa/ Seriously, stop using RSA
- https://gist.github.com/atoponce/07d8d4c833873be2f68c34f9afc5a78a Cryptographic Best Practices: "... you should stop using RSA and switch to elliptic curve software"
- https://itnext.io/contrasting-nats-with-apache-kafka-1d3bdb9aa767 NATS and Apache Kafka: differences, use-cases, guarantees
- https://medium.com/a-journey-with-go/go-multiple-errors-management-a67477628cf1 Go: Multiple Errors Management + goroutine cancellation on error
- https://github.com/rook/rook rook: Storage Orchestration for Kubernetes
- https://medium.com/firebase-developers/the-tradeoffs-between-performance-cost-and-security-with-firestore-ef72ba43f316 The trade-offs between performance, cost, and security with Firestore
# 02-09-2020
- https://leanpub.com/jvm-scala-book ebook: Things you need to know about JVM things that matter in Scala
- https://learnk8s.io/setting-cpu-memory-limits-requests Setting the right requests and limits in Kubernetes
# 31-08-2020
- https://casbin.org/en/ Casbin · An authorization library that supports access control models like ACL, RBAC, ABAC
- https://medium.com/swlh/building-a-realtime-dashboard-with-reactjs-go-grpc-and-envoy-7be155dfabfb Realtime "dashboard" with ReactJS, Go, gRPC, and Envoy (to convert http1 <-> http2)
# 30-08-2020
- https://www.youtube.com/watch?v=W2VB9HuzsMM Building a Telegram bot with Apache Kafka, ksqlDB, and Go. Another amazing walkthrough by Robin Moffatt
- https://medium.com/coralogix-engineering/kafka-streams-window-by-rocksdb-tuning-c06a858029eb Kafka Streams Window By & RocksDB Tuning
- https://www.fpcomplete.com/blog/different-levels-async-rust/ async or not async in Rust
# 29-08-2020
- https://www.confluent.io/blog/kafka-fastest-messaging-system/ Kafka vs. Pulsar vs. RabbitMQ: throughput & latency
- https://www.confluent.io/blog/testing-kafka-streams/ Testing Kafka Streams using TestContainers to save your from bugs TopologyTestDriver couldn't detect
- https://info.crunchydata.com/blog/why-postgresql-13-is-a-lucky-release PostgreSQL 13 has nice updates
- https://medium.com/@nandovillalba/why-i-think-gcp-is-better-than-aws-ea78f9975bda Why I think GCP is better than AWS. Agreed!
# 18-08-2020
- https://blog.rust-lang.org/2020/08/18/laying-the-foundation-for-rusts-future.html Laying the foundation for Rust's future
- https://proandroiddev.com/security-best-practices-symmetric-encryption-with-aes-in-java-7616beaaade9 Security Best Practices: Symmetric Encryption with AES in Java
# 14-08-2020
- https://fasterthanli.me/articles/frustrated-its-not-you-its-rust A nice and long story about Rust pecularities, to encourage beginners..?
- https://kubernetes.io/blog/2020/08/14/introducing-hierarchical-namespaces/ New "Hierarchical Namespaces" in #kubernetes to provide policy Inheritance between ns.
# 13-08-2020
- https://www.confluent.io/blog/kafka-consumer-multi-threaded-messaging/ One way of doing multi-threaded processing with a Kafka consumer (single threaded)
- https://www.confluent.io/blog/ksqldb-state-stores-in-recovery/ An interesting Incident about schemas with ksqlDB + State Store Recovery
# 11-08-2020
- https://romefrontend.dev/blog/2020/08/08/introducing-rome.html Introducing Rome #frontend
- https://justinhj.github.io/2020/08/02/whats-ap-with-zio-prelude.html zio-prelude and applicative's ap
# 07-08-2020
- https://cwiki.apache.org/confluence/display/KAFKA/KIP-441%3A+Smooth+Scaling+Out+for+Kafka+Streams KIP-441: A long KIP to prevent our Kafka Streams app to be "stuck" on some partitions while rebuilding its state, after a rebalance
- https://degoes.net/articles/zio-1.0 ZIO 1.0 Released | A game changer
- https://cwiki.apache.org/confluence/display/KAFKA/KIP-649%3A+Dynamic+Client+Configuration Apache Kafka: KIP-649: Dynamic Client Configuration. I truly hate config mutability at runtime; but that could be useful in large corps I suppose.
- https://www.youtube.com/watch?v=OwmHgL9F_9Q SF Scala <3: Reimagining Functional Type Classes
- https://www.youtube.com/watch?v=wlvKAT7SZIQ Parsing JSON Really Quickly: Lessons Learned (SIMD!)
# 06-08-2020
- https://artem.krylysov.com/blog/2020/07/28/lets-build-a-full-text-search-engine/ A nice "Let's build a Full-Text Search engine" in Go
# 05-08-2020
- https://docs.google.com/document/d/1MQQoJk4ewedYgFfgSA2axx3VhRwgj_0rO1tf3yezV0c/edit# What's new in Apache Kafka 2.6.0 (Draft) - Many good things!
- https://medium.com/swlh/how-i-scaled-a-software-systems-performance-by-35-000-6dacd63732df Fixing a whole system performances. ie: fix your cache!
- https://medium.com/@tomasz.zieleniewski/mental-and-technical-reasons-for-upgrading-java-from-8-to-14-2e43b37b99dd Java: from 8 to 14
- https://medium.com/sysf/getting-started-with-docker-1-b4dc83e64389 Anatomy of Docker.
# 02-08-2020
- https://dropbox.tech/infrastructure/how-we-migrated-dropbox-from-nginx-to-envoy A very interesting reading about How Dropbox is migrating from Nginx to Envoy
- https://medium.com/coralogix-engineering/kafka-streams-window-by-rocksdb-tuning-c06a858029eb Kafka Streams Window By & RocksDB Tuning
# 01-08-2020
- https://adamw.github.io/loom-pres/ Java: Project Loom & virtual threads
# 31-07-2020
- https://www.confluent.io/blog/ksqldb-0-10-updates-key-columns Many breaking changes in ksqlDB 0.10 about keys, but for the greater good!
# 29-07-2020
- https://jalammar.github.io/how-gpt3-works-visualizations-animations/ How GPT3 Works - Visualizations and Animations – Jay Alammar
# 25-07-2020
- https://www.confluent.io/blog/simplified-robust-exactly-one-semantics-in-kafka-2-5/ Apache Kafka’s Exactly-Once Semantics Are Now Easier & More Robust | aka: how to deal with UNKNOWN_PRODUCER_ID error!
# 23-07-2020
- https://medium.com/zendesk-engineering/an-investigation-into-kafka-log-compaction-5e520f4291f0 Some insights from the Kafka Log Compaction
# 21-07-2020
- https://www.youtube.com/watch?v=XTkhxRTH1nE ZIO + gRPC
- https://home.apache.org/~rhauch/kafka-2.6.0-rc1/RELEASE_NOTES.html Kafka 2.6.0 Releases notes <3
# 16-07-2020
- https://ziverge.com/blog/introduction-to-zio-kafka/ ZIO Kafka nice walkthrough
- https://github.com/ElasticHQ/elasticsearch-HQ elasticsearch-HQ: Monitoring and Management Web Application for ElasticSearch instances and clusters
- https://medium.com/blackrock-engineering/utilizing-oauth-for-kafka-security-5c1da9f3d3d Utilizing OAuth for Kafka Security
# 14-07-2020
- https://martin.kleppmann.com/2020/07/06/crdt-hard-parts-hydra.html CRDTs: The Hard Parts — Martin Kleppmann’s talks
# 06-05-2020
- https://cloud.google.com/blog/topics/anthos/anthos-service-mesh-deep-dive Anthos Service Mesh last updates
- https://blog.laputa.io/graceful-shutdown-in-kubernetes-85f1c8d586da Graceful shutdown in Kubernetes. It's not as simple as it looks.
- https://www.scala-lang.org/blog/2020/05/05/scala-3-import-suggestions.html Scala 3 will be a so good langage with many Scala 2.x flaws fixed
# 18-03-2020
- https://blog.cloudera.com/benchmarking-time-series-workloads-on-apache-kudu-using-tsbs/ Apache Kudu Time Series benchmarking against InfluxDB, ClickHouse. Nice results.
# 08-03-2020
- https://github.com/adamgfraser/solving-the-dependency-injection-problem-with-zio/blob/master/solving-the-dependency-injection-problem-with-zio.pdf Can't wait to try these ZLayers with ZIO
- https://superorganizers.substack.com/p/how-to-build-a-learning-machine### How to Make Yourself Into a Learning Machine - Superorganizers
- https://medium.com/@ghostdogpr/graphql-in-scala-with-caliban-part-2-c7762110c0f9 GraphQL in Scala with Caliban — Query optimization. Amazing job.
- https://www.ardanlabs.com/blog/2020/02/docker-images-part1-reducing-image-size.html Docker Images : Reducing Image Size
- https://medium.com/nick-tune-tech-strategy-blog/visualising-sociotechnical-architecture-with-ddd-and-team-topologies-48c6be036c40 Visualising Sociotechnical Architecture with DDD and Team Topologies
- https://www.scala-lang.org/2020/02/20/community-build.html Scala/Dotty community builds evolution. Love to see the JDK11/14 compat growing too.
# 05-03-2020
- https://community.letsencrypt.org/t/2020-02-29-caa-rechecking-bug/114591 Let's Encrypt: millions of certificates revoked due to "CAA Rechecking Bug"
# 26-02-2020
- https://cwiki.apache.org/confluence/display/KAFKA/KIP-557%3A+Add+emit+on+change+support+for+Kafka+Streams Discard idempotent updates in Kafka Streams: that's great news because so often needed (bye dedup processors)
- https://www.rea-group.com/blog/to-kill-a-mockingtest/ Mocking code is a bad smell. I also really dislike it.
- https://blog.mozilla.org/netpolicy/2020/02/25/the-facts-mozillas-dns-over-https-doh/ DNS over HTTPs (DoH)
# 22-02-2020
- https://github.com/adamgfraser/solving-the-dependency-injection-problem-with-zio/blob/master/solving-the-dependency-injection-problem-with-zio.pdf ZIO Layers: a new way to deal with Dependency Injection. Can't wait to test it!
# 21-02-2020
- https://debezium.io/blog/2020/02/10/event-sourcing-vs-cdc/ Event Sourcing, CQRS, Change Data Capture
- https://sysdig.com/blog/kubernetes-limits-requests/ Understanding Kubernetes limits and requests
- https://blog.softwaremill.com/will-project-loom-obliterate-java-futures-fb1a28508232 Will Project Loom obliterate Java Futures?
# 11-02-2020
- https://www.matthowlett.com/2020-01-14-confluent-schema-registry-protobuf.html Protobuf support in the Confluent Schema Registry.
- https://www.lightbend.com/blog/alpakka-kafka-flow-control-optimizations A smart fix to Kafka to avoid dumping data then fetch them again
# 10-02-2020
- https://dotty.epfl.ch/blog/2020/02/05/22nd-dotty-milestone-release.html Scala 3 will be awesome
# 07-02-2020
- https://idursun.com/posts/rust_zero_cost_abstractions_in_action/ Rust zero cost abstractions in action. And it's awesome.
# 03-02-2020
- https://www.jesseyates.com/2020/01/01/high-performance-kafka-producers.html A simple guide to quickly tune Kafka Producers
- https://debezium.io/blog/2020/01/22/outbox-quarkus-extension/ Quarkus & Debezium using Outbox pattern
- https://fp-tower.github.io/2020-01-27-introducing-error-reporting-in-optics/ error reporting in optics using Dotty
# 30-01-2020
- https://www.confluent.io/blog/streaming-machine-learning-with-tiered-storage/ An example using Kafka Tiered Storage to store ML models (which can be updated in real-time)
- https://github.com/LINCnil/Guide-RGPD-du-developpeur Guide RGPD pour les développeurs <3
- https://cloud.google.com/blog/products/data-analytics/what-to-consider-in-an-apache-kafka-to-pubsub-migration Apache Kafka or Pub/Sub? I love comparing-marketing post like this. Pub/Sub is completing its offer and is becoming even more useful. The only thing I hate was: no ad-hoc dynamic consume à la Kafka (you have to create subscriptions beforehand)
- https://tech.ovoenergy.com/scala-3-and-what-it-means-to-me/ A nice recap of the changes from Scala 2 to Scala 3 Dotty
- https://medium.com/@leventov/cronscheduler-a-reliable-java-scheduler-for-external-interactions-cb7ce4a4f2cd Issues with the current Java schedulers (clock drifts, freezing..)
# 28-01-2020
- https://cloud.google.com/blog/products/containers-kubernetes/config-connector-bridges-kubernetes-gcp-resources Config Connector: manage your GCP resources with YAML. Not sure it's a good idea.
# 23-01-2020
- https://www.confluent.io/blog/infinite-kafka-storage-in-confluent-platform/ Tiered storage for Kafka. (I hope the impl will be free to use & open-source)
- https://cloud.google.com/blog/products/identity-security/introducing-google-clouds-secret-manager Secret Manager: the new "Vault" of GCP to Store and manage sensitive data
# 22-01-2020
- https://engineeringblog.yelp.com/2020/01/streams-and-monk-how-yelp-approaches-kafka-in-2020.html Streams and Monk – How Yelp is Approaching Kafka in 2020
# 17-01-2020
- https://blog.christianposta.com/microservices/istio-as-an-example-of-when-not-to-do-microservices/ From microservices to monolith: istiod in sigh! That's a good idea.
- https://humanreadablemag.com/issues/1/articles/unionizing-for-pleasure-and-profit Type level programming is awesome #scala
- https://www.mostly.codes/blog/creating-scalajs-gcp-cloud-functions GCP Cloud Functions with Scala.js in 10 lines(ish) - And 600 lines after transpilation, hm!
# 15-01-2020
- https://www.youtube.com/watch?v=bbss7elSfxs Modern Data Driven Applications with ZIO Streams #scala
# 04-01-2020
- https://www.infoq.com/presentations/data-streaming-kafka-debezium/?utm_campaign=infoq_content&utm_source=twitter&utm_medium=feed&utm_term=architecture-design Practical Change Data Streaming Use Cases with Apache Kafka & Debezium
- https://medium.com/@BladeCoder/exploring-kotlins-hidden-costs-part-1-fbb9935d9b62 Exploring Kotlin’s hidden costs, always good to know.
# 03-01-2020
- https://geirsson.com/2019.html Scala tooling state-of-art in 2019
# 29-12-2019
- https://www.lihaoyi.com/post/StandardizingIOInterfacesforScalaLibraries.html Standardizing IO Interfaces for Scala Libraries | Streaming payload à la Unix
- https://www.youtube.com/watch?v=mkQLU7OzqYM Adding laws to Tagless Final algebras #scala
- https://www.youtube.com/watch?v=16slh29iN1g BPF performance analysis at Netflix
- https://www.youtube.com/watch?v=AdNJ3fydeao Rethinking reactivity, demostrating Svelte. Lots of code generation (meta programming-like), but still a crappy templating language to learn inside a language.
- https://www.youtube.com/watch?v=r-TLSBdHe1A "Performance Matters" by Emery Berger. coz / jcoz
# 27-12-2019
- https://github.com/GoogleCloudPlatform/terraformer The inverse of Terraform, from resources to .tf <3
# 26-12-2019
- https://medium.com/google-cloud/cloud-run-vs-cloud-functions-whats-the-lowest-cost-728d59345a2e Cloud Run VS Cloud Functions: What’s the lowest cost?
# 24-12-2019
- https://quarkus.io/guides/kafka-streams#kafka-streams-health-checks Quarkus & Kafka Streams with Healthchecks
# 23-12-2019
- http://degoes.net/articles/fp-glossary A Glossary of Functional Programming
# 22-12-2019
- https://developer.ibm.com/blogs/kubernetes-helm-3/ A very good post explaining diffs between Helm 2 and 3
# 21-12-2019
- https://lemire.me/blog/2019/12/19/xor-filters-faster-and-smaller-than-bloom-filters/ Xor Filters: Faster and Smaller Than Bloom Filters
# 20-12-2019
- https://www.0x65.dev/blog/2019-12-14/the-architecture-of-a-large-scale-web-search-engine-circa-2019.html The Architecture of a Large-Scale Web Search Engine, circa 2019. A must-read if you wanna discover many cloud-native tools
- https://sbt-kubeyml.vaslabs.org/ Generate kubectl yaml direclty from sbt, useful with ci/cd
- https://zeebe.io/blog/2018/12/writing-an-apache-kafka-connector-for-zeebe/ Kafka Connector for Zeebe
- https://developer.ibm.com/series/reactive-in-practice/ A (long) complete guide to event-driven systems development. Using Java/Lagom/Cassandra/Kafka/Kubernetes/VueJS
- https://developer.ibm.com/tutorials/java-modularity-5/ Pitfalls of Java 9+ JPMS (modularity)
- https://www.youtube.com/watch?v=qYDcbcOVurc Using TLA+ for fun and profit in the development of Elasticsearch . I need to buy a TLA+ book.
- https://blog.rust-lang.org/2019/12/19/Rust-1.40.0.html Rust 1.40.0
- https://www.youtube.com/watch?v=FTsAXJdrJbI Everything you wanted to know about Stack Traces and Heap Dumps
# 19-12-2019
- https://medium.com/@jducoeur/explicit-nulls-are-in-efe4aecbc78f? Explicit nulls are in Dotty. Looks more like Kotlin now :)
- https://www.scala-lang.org/2019/12/18/road-to-scala-3.html Scala 2 to Scala 3. Gonna be awesome.
- https://rmoff.net/2019/12/18/detecting-and-analysing-ssh-attacks-with-ksqldb/ A really great walkthrough by Robin through ksqlDB using Elasticsearch, Neo4j
- https://towardsdatascience.com/kafka-gotchas-c1da4c0b3e95 Kafka Gotchas: "bad" defaults, not really multitenant, non-Java libs always "late" and not as bullet-proof as Java's?
# 18-12-2019
- https://www.confluent.io/blog/apache-kafka-producer-improvements-sticky-partitioner/ Kafka Producer: Sticky Partitioner, for better perf (less latency)
# 16-12-2019
- https://www.confluent.io/blog/apache-kafka-2-4-latest-version-updates/ Apache Kafka 2.4 - Latest Version, KIPs & New Features. Awesome release: fetch from replicas, consumer incremental rebalance protocol, mm2, non-key joins in Streams, and lots of new metrics everywhere, and Scala 2.13 <3
# 15-12-2019
- https://www.youtube.com/watch?v=Uav5jWHNghY An impressive code session by Martin Kleppmann to find & write the correctness proofs of a "simple" distributed systems with Isabelle/HOL, and explains the difference with TLA+.
- https://jeremyrsmith.github.io/polynote-2019-slides/ Polynote: Solving the Scala Notebook Experience. Using FP and ZIO all the way down. Great.
- https://medium.com/@masroor.hasan/tracing-infrastructure-with-jaeger-on-kubernetes-6800132a677 How to deploy Jaeger on Kubernetes
- https://medium.com/@wigahluk/generalizing-functions-with-profunctors-7773a83557b5 From functions to Profunctors
# 13-12-2019
- https://www.youtube.com/watch?v=fs-TkRkFgDI (very) fast Scala Builds & Test using Bazel (parallism, smart resolutions, distributed cache, devbox)
- https://appddeevvmeanderings.blogspot.com/2019/11/scalajs-zio-query-management-using-zio.html Oh my! Combining zio, scala.js, react, query management
# 11-12-2019
- https://medium.com/streamthoughts/understanding-kafka-partition-assignment-strategies-and-how-to-write-your-own-custom-assignor-ebeda1fc06f3 Kafka partition assignment strategies + custom assignor
- https://gvisor.dev/ A user-space kernel to provide secured & sandboxed environments for containers
- https://www.confluent.io/blog/kafka-connect-tutorial-transfer-avro-schemas-across-schema-registry-clusters/ Copy Avro schemas + update Kafka records using Connect SMT to "sync" two distinct Kafka clusters
- https://aws.amazon.com/builders-library/implementing-health-checks/?did=ba_card&trk=ba_card A superbe article about the complexity of health checks
- https://medium.com/pinterest-engineering/using-kafka-to-throttle-qps-on-mysql-shards-in-bulk-write-apis-a326ae0f1ac1 Using Kafka to throttle QPS on MySQL shards in bulk write APIs
- https://blog.pragmaticengineer.com/the-product-minded-engineer/ The Product-Minded Software Engineer: it should be the norm ¯\_(ツ)\_/¯
# 10-12-2019
- https://sematext.com/blog/kubernetes-elasticsearch/ Running & Deploying Elasticsearch on Kubernetes
- https://github.com/ahmetb/cloud-run-faq#how-is-it-different-than-app-engine-flexible Google Cloud Run compared to AppEngine Flex, AWS Fargate, Azure CI, ... and everything about Cloud Run to know
# 05-12-2019
- https://ordepdev.me/posts/tales-from-running-kafka-streams-in-production Tales from running Kafka Streams in Production (rocksdb, memory mngmt, external calls, ...)
# 30-11-2019
- https://medium.com/streamthoughts/introducing-azkarra-streams-the-first-micro-framework-for-apache-kafka-streams-e13605f3a3a6 Azkarra Streams : a sweet wrapper above Kafka Streams to simplify code + provide a nice UI to admin, see the DAG, do IQ etc.
# 29-11-2019
- https://github.com/awslabs/djl New! awslabs/djl: An Engine-Agnostic Deep Learning Framework in Java
- https://www.youtube.com/watch?v=mJDbQ2gqo2g Our friend Tim Berglung at GOTO 2019: Processing Streaming Data with KSQL
- https://timpigden.github.io/_pages/zio-http4s/intro.html ZIO, Http4s, Auth, Codecs and zio-test
- https://www.youtube.com/watch?v=vRnYCLy7C0o Build Yourself an Effect System, like ZIO #scala
- https://scalac.io/build-your-own-kafka-in-zio-queues-fibers/ After Kafka in Bash (;-)), know Kafka in ZIO using Queues & Fibers
- https://scalac.io/write-command-line-application-with-zio/ How to write a command-line application with ZIO #scala
- https://medium.com/criteo-labs/migrate-a-service-getting-200kqps-from-jackson-to-circe-a475b2718206 From Jackson to Circe: less cpu, more memory
- https://www.youtube.com/watch?v=nD-p-cEKjHE set up sbt projects
- https://medium.com/@endofcake/terraform-vs-cloudformation-1d9716122623 Terraform vs CloudFormation: TF mostly wins except for the management of the state, CF handles it for us
- https://blog.softwaremill.com/migrating-to-sttp-client-2-x-and-tapir-0-12-x-7956e6c79c52 sttp client and tapir evolving #scala
# 28-11-2019
- http://book.mixu.net/distsys/single-page.html Distributed systems for fun and profit. Perfect for whoever starting or working with distributed systems (everyone?)
# 26-11-2019
- https://dev.to/awwsmm/20-reasons-to-move-on-from-java-8-1dio 20 Reasons to Move On to Java >8, a nice recap
# 25-11-2019
- https://cloudflow.io/docs/current/get-started/deploy-to-gke-cluster.html Cloudflow: a new take to quickly develop & deploy distributed stream processing on k8s (define "Streamlets" aka connector, write the dependencies graph in yaml, them deploy them as pods)
# 24-11-2019
- https://www.youtube.com/watch?v=JoQN4xoXY5Y Quickly Analysing A Heap Memory Leak
- https://www.youtube.com/watch?v=aQb2_WrmED0 Consul et Conseul Connect Service Mesh chez Criteo
# 23-11-2019
- https://www.youtube.com/watch?v=hvYqSz_BgUM Netty 5 incoming, lots of performance improvements!
- https://medium.com/opentracing/opentracing-on-kubernetes-get-yer-tracing-for-free-7a69cca03c8a TIL we can easily create "webhooks" on any kubernetes operations through a dedicated resource (to alter how pods deploy, add sidecar etc.)
- https://www.youtube.com/watch?v=m64SWl9bfvk Rate limiting, Queues Theory, Little's Lawn, API Adaptative Capacity (using back-pressure signals)
# 22-11-2019
- https://gluonhq.com/gluon-substrate-and-graalvm-native-image-with-javafx-support/ Gluon Substrate and GraalVM Native Image with JavaFX support. That's. Awesome.
# 21-11-2019
- https://www.confluent.io/blog/intro-to-ksqldb-sql-database-streaming ksqlDB: previously KSQL, now an "event streaming database". It adds pull queries ("classic" SQL point-in-time query) & connectors management
- https://github.com/joaomilho/Enterprise /? ������ The Enterprise™ programming language ?/;;;
- https://blog.jetbrains.com/idea/2019/11/meet-grazie-the-ultimate-spelling-grammar-and-style-checker-for-intellij-idea/ Grazie plugin: less typos in all our code (IntelliJ IDEA)
- https://www.youtube.com/watch?v=WKR384ZeBgk Arrow Meta: metaprogramming in the Kotlin Compiler. Generate code at compile-time. <3
- https://tv.octo.com/videos/fine-tuning-kafka-allons-voir-sous-le-capot/ FR: Fine Tuning Kafka, allons voir sous le capot ! Kafka 101, la perte de données, la conf producer/consumer, JProfiler et les brokers
- https://www.getrevue.co/profile/zio/issues/zio-news-issue-2-209078 ZIO is improving and spread everywhere <3
# 18-11-2019
- https://medium.com/better-practices/api-specifications-d87588ac874 Bringing law and order to APIs with OpenAPI Specifications
- https://medium.com/@andy.bryant/processing-guarantees-in-kafka-12dd2e30be0e Processing guarantees in Kafka, at-least, at-once, effectively-once
# 14-11-2019
- https://medium.com/streamthoughts/apache-kafka-rebalance-protocol-or-the-magic-behind-your-streams-applications-e94baf68e4f2 Kafka Rebalance Protocol
- https://itnext.io/introduction-to-event-streaming-with-kafka-and-kafdrop-73290625b1e2 Introduction to Event Streaming with Kafka and Kafdrop
- https://medium.com/@johnclarke_82232/mono-or-multi-repo-6c3674142dfc Mono- or Multi-repo?
- https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache1 Kafka 2.4 changelog. Awesome.
- https://www.youtube.com/watch?v=MU8NapbG1IQ Understanding Low Latency JVM GCs, Shenandoah, C4
# 13-11-2019
- https://vimeo.com/370819261 Scala Italy 2019 - John A De Goes - A Tour of Functional Design
- http://reasonablypolymorphic.com/blog/protos-are-wrong/ Protobuffers Are Wrong: lack of compositionality & laws
# 12-11-2019
- https://medium.com/swlh/advantages-and-disadvantages-of-kubernetes-the-business-perspective-5bb81e4eb4cb Advantages and Disadvantages of Kubernetes
- https://blog.bernd-ruecker.com/the-microservice-workflow-automation-cheat-sheet-fc0a80dc25aa The Microservices Workflow Automation Cheat Sheet
- https://eng.lyft.com/open-sourcing-amundsen-a-data-discovery-and-metadata-platform-2282bb436234 Open Sourcing Amundsen: A Data Discovery And Metadata Platform
# 10-11-2019
- https://www.youtube.com/watch?v=iwSCtxMbBLI Beyond ByteBuffers by Brian Goetz (Memory Access API in Java)
- https://ebaytech.berlin/microservices-and-kafka-part-2-b37dd08a7d8f Microservices and Kafka — Part 2 - eBay Tech Berlin
- https://ebaytech.berlin/microservices-and-kafka-part-1-614767d27b20 Microservices and Kafka — Part 1 - eBay Tech Berlin
- https://blog.7mind.io/constructive-test-taxonomy.html Unit, Functional, Integration Test? Another test taxonomy proposed..
- https://dzone.com/articles/whats-the-proper-kubernetes-health-check-for-a-kaf Proper Kubernetes Health Check for a Kafka Streams Application
- https://medium.com/faun/invoking-the-aws-cli-with-terraform-4ae5fd9de277 Invoking the AWS CLI with Terraform
# 08-11-2019
- https://contributors.scala-lang.org/t/pre-sip-make-classes-sealed-by-default/3767/2 PRE-SIP: Make classes `sealed` by default: YES! #scala
# 07-11-2019
- https://www.ibm.com/cloud/blog/announcements/kafka-monthly-digest-october-2019 Kafka Monthly Digest: October 2019 | IBM
- https://blog.rust-lang.org/2019/11/07/Async-await-stable.html Async-await on stable Rust
- https://tech.ovoenergy.com/monorepo-microservices-in-go/ Monorepo Microservices using Go, Helm, Terraform
# 06-11-2019
- https://www.youtube.com/watch?v=5fqhT82wghY Apache Pulsar 101: architecture, concepts et comparaison
- https://www.youtube.com/watch?v=CwqFpSByEI0 Infrastructure As Code, il n'y a pas que Terraform dans la vie: Pulumi
# 05-11-2019
- https://www.youtube.com/watch?v=71yhnTGw0hY John De Goes - 12 Steps To Better #Scala (Part I)
- https://dev.to/fppt/managing-delivery-networks-a-use-case-for-graph-databases-2jb0 Delivery Networks: A Use Case For Graph Databases #scala #tinkerpop #graph
- https://blog.softwaremill.com/scala-application-lifecycle-from-pure-scala-to-fs2-5f2861005603 Scala application lifecycle, from pure Scala to cats IO to FS2
- https://eventmodeling.org/posts/what-is-event-modeling/ Event Modeling: What is it?
# 04-11-2019
- https://www.confluent.io/blog/event-sourcing-cqrs-stream-processing-apache-kafka-whats-connection/ Event sourcing, CQRS, stream processing and Apache Kafka: What’s the connection?
- https://www.hillelwayne.com/talks/distributed-systems-tlaplus/ Designing Distributed Systems with TLA+
- https://blog.colinbreck.com/on-embracing-error-in-distributed-software-systems/ On Embracing Error in Distributed Software Systems
- https://www.confluent.io/blog/apache-kafka-purgatory-hierarchical-timing-wheels/ Apache Kafka, Purgatory, and Hierarchical Timing Wheels - Confluent
# 03-11-2019
- https://www.confluent.io/blog/building-a-microservices-ecosystem-with-kafka-streams-and-ksql/ Building a Microservices Ecosystem with Kafka Streams and KSQL
- https://medium.com/expedia-group-tech/ml-in-ksql-a44d455b0687 PMML + KSQL
- https://www.youtube.com/watch?v=06iRM1Ghr1k What is Apache Kafka®? (Confluent Lightboard)
- https://www.youtube.com/watch?v=NFB5hYTNYOE Develop seamless web services with Mu - Oli Makhasoeva
- https://docs.google.com/presentation/d/16VdLeGwpKWRjA4H9ojWCGBWzSPKEo7p5cQRA74__ew0/edit#slide=id.p SBT, monorepo et livraison (ScalaIO19)
- https://harrylaou.com/slides/AlgebrasInProgramming.pdf Algebras In Programming (ScalaIO19)
- https://medium.com/@rsinghal757/kadanes-algorithm-dynamic-programming-how-and-why-does-it-work-3fd8849ed73d Kadane’s Algorithm Dynamic Programming
# 02-11-2019
- https://medium.com/teads-engineering/give-meaning-to-100-billion-events-a-day-part-ii-how-we-use-and-abuse-redshift-to-serve-our-data-bc23d2ed3e07 Give meaning to 100 Billion events a day, Redshift based & user-facing webapps
- https://polynote.org/ Polynote | The polyglot Scala notebook
- https://blog.timescale.com/blog/building-columnar-compression-in-a-row-oriented-database/ Building columnar compression in a row-oriented database
- https://cwiki.apache.org/confluence/display/KAFKA/KIP-470%3A+TopologyTestDriver+test+input+and+output+usability+improvements KIP-470: TopologyTestDriver test input and output usability improvements. Good stuff, to avoid everyone to create their own helpers
- https://medium.com/@ayanonagon/the-y-combinator-no-not-that-one-7268d8d9c46 The Y Combinator (no, not that one)
- http://blog.wikipme.fr/startup-plus-difficile-a-scaler-cest-lhumain/ Startup : le plus difficile à scaler, c’est l’humain
- https://www.slideshare.net/MarilynKol/rduire-la-dette-motionnelle-dans-une-quipe-scrum/1 Réduire la dette émotionnelle dans une équipe Scrum
# 26-10-2019
- https://medium.com/netflix-techblog/open-sourcing-polynote-an-ide-inspired-polyglot-notebook-7f929d3f447 Open-sourcing Polynote: an IDE-inspired polyglot notebook
- https://services.google.com/fh/files/misc/state-of-devops-2019.pdf State of DevOps
# 25-10-2019
- https://www.youtube.com/watch?v=WoP8p7oDe84 Trains & KSQL (Robin Moffatt)
# 19-10-2019
- https://www.youtube.com/watch?v=USgfku1h7Hw John De Goes - Upgrade Your Future (Scala Russia 28.09.2019) - YouTub
- https://www.scala-lang.org/2019/10/17/dependency-management.html Better management of transitive dependencies and conflicts with sbt #scala
# 18-10-2019
- https://medium.com/swlh/performance-comparison-between-apache-pulsar-and-kafka-latency-79fb0367f407 Performance Comparison Between Apache Pulsar and Kafka: Latency. Spikes for Kafka, no for Pulsar.
- https://medium.com/@antoine.doeraene/a-little-bit-of-data-science-in-scala-5caba1ad8d9f A little bit of Data Science in Scala
# 17-10-2019
- https://www.youtube.com/watch?v=93uE_kWWQjs Kernel Recipes 2019 - ftrace: Where modifying a running kernel all started
- https://www.confluent.io/kafka-summit-san-francisco-2019/kafka-needs-no-keeper Kafka without Zookeeper explanations
- https://www.confluent.io/kafka-summit-san-francisco-2019/ksql-performance-tuning-for-fun-and-profit KSQL Performance Tuning for Fun and Profit, very good stuff
- https://www.confluent.io/kafka-summit-san-francisco-2019/why-stop-the-world-when-you-can-change-it-design-and-implementation-of-incremental-cooperative-rebalancing Why stop the world when you can change it? Design and implementation of Incremental Cooperative Rebalancing
- https://tokio.rs/blog/2019-10-scheduler/ Making the Tokio scheduler 10x faster #rust
# 10-10-2019
- https://www.youtube.com/watch?v=I3loMuHnYqw Adam Warski—Designing Programmer-Friendly APIs using Tapir library: excellent
# 08-10-2019
- https://medium.com/@cparageaud/aws-lambda-java-11-3-3-5492b13c1aba AWS Lambda : Java 11
- https://www.infoq.com/presentations/event-driven-benefits-pitfalls/ Opportunities and Pitfalls of Event-Driven Utopia- Excellent, get the same xp
# 07-10-2019
- https://www.youtube.com/watch?v=x5_MmZVLiSM Fabio Labella—How do Fibers Work? A Peek Under the Hood
- https://www.youtube.com/watch?v=PgQyCnqm4QQ Jorge Vicente Cantero—Design Challenges of Bloop
- https://www.confluent.io/blog/incremental-cooperative-rebalancing-in-kafka Incremental Cooperative Rebalancing in Apache Kafka
# 06-10-2019
- https://yokota.blog/2019/09/23/building-a-relational-database-using-kafka/ Building A Relational Database Using Kafka (+ Avro, Calcite, Omid, Avatica)
- https://databricks.com/blog/2019/09/16/adventures-in-the-tcp-stack-performance-regressions-vulnerability-fixes.html Troubleshooting TCP SACKs Vulnerability Fixes
- https://medium.com/@D11Engg/building-scalable-real-time-analytics-alerting-and-anomaly-detection-architecture-at-dream11-e20edec91d33 Building Scalable Real Time Analytics, classic Kafka way: Debezium, Connect, Streams/KSQL, Elasticsearch
- https://speakerdeck.com/kubukoz/flawless-testing-for-the-functional-folks Flawless testing for the functional folks #scala
- https://blog.softwaremill.com/from-transactional-to-type-safe-reasonable-transactions-a5019906245e From @Transactional to type-safe, reasonable transactions
- https://speakerdeck.com/nikkithean/kafka-on-kubernetes-keeping-it-simple Kafka on Kubernetes: Keeping It Simple
- https://speakerdeck.com/loicdivad/streaming-apps-and-poison-pills-handle-the-unexpected-with-kafka-streams Streaming Apps and Poison Pills: Handle the Unexpected with Kafka Streams
# 05-10-2019
- https://wikido.isoftdata.com/index.php?title=The_GROUPing_pitfall The SQL GROUPing pitfall
# 03-10-2019
- https://www.infoq.com/news/2019/09/cqrs-event-sourcing-production/ Day Two Problems When Using CQRS and Event Sourcing
# 15-09-2019
- https://www.confluent.io/blog/kafka-rebalance-protocol-static-membership Kafka Rebalance Protocol for the Cloud: Static Membership
- https://medium.com/better-programming/helm-3-fun-with-the-new-beta-8f91c70891ff Helm 3: Fun With the New Beta: no more "tiller"
- https://blog.colinbreck.com/on-eliminating-error-in-distributed-software-systems/ On Eliminating Error in Distributed Software Systems: Types! and FP. Simple as that.
# 12-09-2019
- https://lamport.azurewebsites.net/tla/paxos-algorithm.html Paxos Algorithm + TLA+ explained by Leslie Lamport
# 08-09-2019
- https://www.pulumi.com/blog/pulumi-1-0/ Pulumi 1.0 GA. Infrastructure as code FTW
# 05-09-2019
- https://www.cloudamqp.com/blog/2019-04-03-quorum-queues-internals-a-deep-dive.html CloudAMQP Quorum Queues
- https://nrinaudo.github.io/much-ado-about-testing/ Property based testing & Metamorphic testing
- https://www.infoq.com/presentations/microservices-ddd-bounded-contexts Bounded Contexts + Events + Commands
- https://www.infoq.com/presentations/ddd-functional-programming DDD, Event Sourcing
# 04-09-2019
- https://twitter.com/withoutboats/status/1027702531361857536 Rust: why async/await instead of do notation
- https://fp-tower.github.io/foundation/2-SideEffect.html Side Effect, IO, Futures, and Free monad
- https://www.youtube.com/watch?v=63x_G6vrwgs Ask Confluent #15: Attack of the Zombie Controller
# 30-08-2019
- https://blog.zenika.com/2019/08/30/cilium-firewall-pour-les-conteneurs/ Cilium : un firewall pour les conteneurs
- https://www.youtube.com/watch?v=KNqOWT0lOYY Temporal Modelling • Mathias Verraes
- https://vimeo.com/353579169 Travis Brown - Library design for Dotty: a preview of Cats and Circe in 2021
- https://www.youtube.com/watch?v=vGVJYoKIzjU John Hughes - Why Functional Programming Matters
- https://netdevconf.org/1.2/papers/ktls.pdf KTLS implementation (TLS management in kernel space)
# 28-08-2019
- https://medium.com/@bharatnc/kubernetes-garbage-collection-781223f03c17 Kubernetes Garbage Collection. TIL about "ownerReferences"
- https://levelup.gitconnected.com/kubernetes-merge-multiple-yaml-into-one-e8844479a73a Kubernetes: Merge Multiple YAML Files Into One. Kustomize.
- https://medium.com/@copyconstruct/monitoring-in-the-time-of-cloud-native-c87c7a5bfa3e A reference, about Monitoring and Observability
# 25-08-2019
- http://www.jonathanturner.org/2019/08/introducing-nushell.html Introducing nushell, an amazing new shell in Rust
- https://contributors.scala-lang.org/t/pre-sip-curried-varargs/3608 Pre SIP: Curried varargs in Scala
# 23-08-2019
- https://medium.com/@jondot/my-key-learnings-after-30-000-loc-in-rust-a553e6403c19 10 Key Learnings in Rust after 30,000 Lines of Code
- https://github.com/alexellis/inlets A better ngrok. Expose your local endpoints to the Internet
- https://engineering.linkedin.com/blog/2019/data-hub Data Hub: A Generalized Metadata Search & Discovery Tool | LinkedIn Engineering
- https://www.youtube.com/watch?v=m9cu4xUvrUs Resource composition in cats-effect with the Resource data type
# 20-08-2019
- https://www.confluent.io/blog/building-shared-state-microservices-for-distributed-systems-using-kafka-streams Kafka Streams and a Shared State Microservices REST API
# 18-08-2019
- https://www.confluent.io/blog/kafka-connect-improvements-in-apache-kafka-2-3 Kafka Connect Improvements in Apache Kafka 2.3
- https://video.ias.edu/VoevodskyMemConf-2018/0911-DanGrayson The mathematical work of Vladimir Voevodsky. Homotopy theory to type theory (HoTT)
# 17-08-2019
- https://instagram-engineering.com/static-analysis-at-scale-an-instagram-story-8f498ab71a0c Static Analysis at Scale in Instagram, using Pyre (for Python)
- https://medium.com/@mattia.battiston/why-i-love-trunk-based-development-641fcf0b94a0 Why I love Trunk Based Development (or pushing straight to master)
- https://medium.com/@ghostdogpr/wrapping-impure-code-with-zio-9265c219e2e Wrapping impure code with ZIO
- https://www.youtube.com/watch?v=VV9lPg3fNl8 GADTs in Dotty
- https://www.youtube.com/watch?v=v__IRT-QkwY Using Blocker in cats-effect for blocking IOs
- https://blog.ploeh.dk/2019/07/01/yes-silver-bullet/ "The only way to decrease the overall complexity is to reduce the accidental complexity."
# 15-08-2019
- https://www.youtube.com/watch?v=POUEz8XHMhE ZIO to rule them all
- https://medium.com/@steven.lemon182/why-our-team-cancelled-our-move-to-microservices-8fd87898d952 Why our team cancelled our move to microservices
- https://rmoff.net/2019/08/15/reset-kafka-connect-source-connector-offsets/ Reset Kafka Connect Source Connector Offsets
- https://stripe.com/en-fr/atlas/guides/andrew-chen-marketplaces Marketplaces
# 12-08-2019
- http://technosophos.com/2019/08/07/writing-a-kubernetes-controller-in-rust.html Writing a Kubernetes CRD Controller in Rust
# 09-08-2019
- https://jack-vanlightly.com/blog/2018/10/2/understanding-how-apache-pulsar-works Understanding How Apache Pulsar Works
- https://hal.archives-ouvertes.fr/hal-02114296/document Comparison Matrices of Semantic RESTful APIs Technologies
- https://martin.kleppmann.com/2019/06/27/hydra-interview.html Figuring out the future of distributed data systems (Martin Kleppmann)
- https://medium.com/@elizarov/callbacks-and-kotlin-flows-2b53aa2525cf Callbacks and Kotlin Flows
- https://dbmsmusings.blogspot.com/2019/06/correctness-anomalies-under.html Anomalies Under Serializable Isolation
- https://www.iteratorshq.com/blog/benchmarking-functional-error-handling-in-scala/ Benchmarking Functional Error Handling in Scala (Either[T], IO, ZIO..)
# 07-08-2019
- https://medium.com/@mattklein123/monorepos-please-dont-e9a279be011b Monorepos: Please don’t! It's not always pink. And far from it when it's a large company (>100)
# 05-08-2019
- https://tech.transferwise.com/achieving-high-availability-with-kafka-streams/ Achieving high availability with stateful Kafka Streams applications
# 02-08-2019
- https://cwiki.apache.org/confluence/display/KAFKA/KIP-500%3A+Replace+ZooKeeper+with+a+Self-Managed+Metadata+Quorum KIP-500: Replace ZooKeeper by "Kafka Controllers Quorum". It's official now!
- https://itnext.io/how-to-use-knative-pipelining-component-to-automate-an-application-build-and-deployment-on-442b0b1bebf Knative + Tekton integration
- http://eed3si9n.com/dependency-resolver-semantics semantics of dependency resolvers, comparison between maven, ivy, coursier
# 01-08-2019
- https://argumatronic.com/posts/2019-06-21-algebra-cheatsheet.html a Brief Guide to A Few Algebraic Structures
- https://www.slideshare.net/KaiWaehner/confluent-operator-as-cloudnative-kafka-operator-for-kubernetes Confluent Operator as Cloud-Native Kafka Operator for Kubernetes
# 30-07-2019
- https://banzaicloud.com/blog/kafka-on-istio-performance/ Kafka over Istio - benchmarks / GCP & EKS / plain, ssl, mtls
- https://www.youtube.com/watch?v=RtHA1YVLW5Y Cliff Click — A JVM Does That? ==> A LOT!
- https://www.confluent.io/online-talks/from-zero-to-hero-with-kafka-connect-on-demand From Zero to Hero with Kafka Connect!
# 28-07-2019
- https://www.youtube.com/watch?v=PQ5ykHwXJfA Understanding Low Latency JVM GCs: Shenandoah, ZGC, C4
# 25-07-2019
- https://speakerdeck.com/kubukoz/flawless-testing-for-the-functional-folks Flawless: a FP test lib, it's gonna be awesome
- https://lsug.github.io/workshop/scala/2019/07/21/workshop-run-scalac-run.html Using Bloop, GraalVM, and scalac profiling to reduce build time
- https://www.confluent.io/blog/fault-tolerance-distributed-systems-tracing-with-apache-kafka-jaeger Sending tracing spans into a kafka topic for later consumption by Jaeger
- https://medium.com/@george3d6/the-success-of-go-heralds-that-of-rust-73cb2e4c0500 "I think we could call Rust a superior language to Go in, quite literally, every single way possible." \o/
# 23-07-2019
- https://quarkus.io/blog/kafka-streams-applications-with-quarkus-and-microprofile/ Kafka Streams applications with Quarkus: auto-expose liveness check, metrics, native compilation. Very nice.
- https://jdk.java.net/jpackage/ TIL about jpackage in JDK 14+: package a Java app with its JRE.
- https://www.youtube.com/watch?v=GXJ0D2tfZCM Automerge: to deal with online collaboration without central servers
- https://www.infoq.com/presentations/graalvm-performance/ Performance GraalVM: it's not always what you want
- https://www.julian.com/blog/mental-model-examples "You are doing X. Why aren’t you doing Y instead? What would a mental model suggest is the best path forward?”
- https://blog.octo.com/en/cache-me-if-you-can-2/ A nice overview of the HTTP Caching system
- https://mixitconf.org/2019/the-internet-in-2030 The internet ... and the world in 2030
# 22-07-2019
- https://docs.confluent.io/5.3.0/release-notes.html Kafka 2.3.0 release notes + Connect + Streams + KSQL: huge!
- https://blog.pragmaticengineer.com/operating-a-high-scale-distributed-system/ Lots of good insights operating a distributed system
- https://objectcomputing.com/news/2019/07/18/unleashing-predator-precomputed-data-repositories Predator: Precomputed Data Repositories: aka compile-time repositories
# 21-07-2019
- https://github.com/scala/scala/releases/tag/v2.13.0?source=post_page--------------------------- Release Scala 2.13.0 · scala/scala: HUGE!
- https://medium.com/@linas.m/my-favorite-new-features-of-scala-2-13-standard-library-909a89b0da4 A bit about new stuff in Scala 2.13 stdlib
- https://blog.softwaremill.com/comparing-ethereum-and-the-libra-blockchain-64bec7dd70c0 Comparing Ethereum and the Libra blockchain
- https://fr.wikipedia.org/wiki/Effet_Dunning-Kruger Effet Dunning-Kruger: biais cognitif: "effet de surconfiance"
- https://www.lightbend.com/blog/scala-inliner-optimizer Scala Inliner and Optimizer
- https://debezium.io/blog/2019/02/19/reliable-microservices-data-exchange-with-the-outbox-pattern/ Data Exchange With the Outbox Pattern
- https://twitter.com/itrvd/status/1152580754393718786 ZStream upcoming in ZIO, very good stuff
# 17-07-2019
- https://www.lightbend.com/blog/use-kafka-streams-dynamically-controlled-streams An interesting take about Kafka Streams compared to Akka Streams, Flink, Spark
- https://blog.cloudera.com/blog/2019/07/yunikorn-a-universal-resource-scheduler/ YuniKorn: a "universal"/unified resource scheduler, run on Yarn or more interestingly on Kubernetes
- https://github.com/kubernetes-sigs/kube-batch A batch scheduler on kubernetes
# 11-07-2019
- https://medium.com/@dominik.tornow/the-kubernetes-scheduler-cd429abac02f Interesting insights around the Kubernetes Scheduler
# 09-07-2019
- https://medium.com/@ghostdogpr/combining-zio-and-akka-to-enable-distributed-fp-in-scala-61ffb81e3283 ZIO + Akka PubSub + Cluster Sharing for distributed computing
- http://natpryce.com/articles/000819.html Mistakes we made adopting event sourcing (and how we recovered)
- https://medium.com/@copyconstruct/distributed-tracing-weve-been-doing-it-wrong-39fc92a857df Very nice insights about Distributed Tracing  tools:  why we’ve been doing it "wrong"
- https://blog.colinbreck.com/rethinking-streaming-workloads-with-akka-streams-part-ii/#fnref2 I always like reading some Akka Streams processing. A very nice example of a pagination API converted to a generic "Source"
- https://www.youtube.com/watch?v=a3agLJQ6vt8 Structured Concurrency in Kotlin with coroutines
# 06-07-2019
- http://w.pitula.me/presentations/2019-07-lxscala/#/ From initial to final, tagged to tagless; why; lib vs apps
# 05-07-2019
- https://medium.com/nearprotocol/understanding-rust-lifetimes-e813bcd405fa Understanding Rust Lifetimes
- https://blog.jetbrains.com/scala/2019/07/02/functional-highlighting-for-functional-programming IntelliJ Scala is getting better at error highlighting
- https://itnext.io/kubernetes-ingress-controllers-how-to-choose-the-right-one-part-1-41d3554978d2 Kubernetes Ingress Controllers (nginx, aws alb..)
- https://medium.com/graalvm/safe-and-sandboxed-execution-of-native-code-f6096b35c360 Sandboxed execution of native code in GraalVM
# 04-07-2019
- https://www.buzzsprout.com/186154/1323595 Rolling Kafka Upgrades and Confluent Cloud ft. Gwen Shapira
- https://kafkaesque.io/7-reasons-we-choose-apache-pulsar-over-apache-kafka/ Stateless brokers (Pulsar), Separation of data and brokering (Pulsar), Queues & Topics
- https://www.youtube.com/watch?v=DBfmKE42PiY Kafka Streams, profiling, framegraphs
- https://www.youtube.com/watch?v=ryFAZZEZbyw OpenTracing -> OpenTelemetry
- https://medium.com/graalvm/isolates-and-compressed-references-more-flexible-and-efficient-memory-management-for-graalvm-a044cc50b67e GraalVM SubstrateVM has "Isolates" to provide a dedicated heap that can be teardown quickly. Useful to ensure isolation.
# 03-07-2019
- https://retrocomputing.stackexchange.com/questions/11533/why-did-moving-the-mouse-cursor-cause-windows-95-to-run-more-quickly "Moving the mouse cursor cause Windows 95 to run more quickly." Magic.
# 30-06-2019
- http://verraes.net/2019/05/ddd-msg-arch/ DDD and Messaging Architectures
- https://penberg.org/parakernel-hotos19.pdf I/O Is Faster Than the CPU – Let's Partition Resources and Eliminate (Most) OS Abstractions
# 26-06-2019
- https://gist.github.com/Matthias247/5e5e7430149bbb04eebf18cf31747fe0 Async/Await in rust: challenging
- https://www.confluent.io/blog/microservices-apache-kafka-domain-driven-design Microservices, Kafka, and DDD
# 24-06-2019
- https://www.defmacro.org/2019/03/26/startup-checklist.html Startup idea checklist
# 21-06-2019
- https://medium.com/solo-io/api-gateways-are-going-through-an-identity-crisis-d1d833a313d7 API Gateways, Management, Service Mesh
# 20-06-2019
- https://www.youtube.com/watch?v=li2aowPnezA Jun Rao, Confluent - Kafka Controller: A Deep Dive
- https://www.infoq.com/presentations/rust-tradeoffs/ How Rust Views Tradeoffs
# 18-06-2019
- https://blog.softwaremill.com/thread-shifting-in-cats-effect-and-zio-9c184708067b Thread shifting in cats-effect and ZIO – Reminds me of Kotlin coroutine withContext, great.
- http://degoes.net/articles/tagless-horror Why not use Tagless-Final in Scala
# 17-06-2019
- https://kubuszok.com/2019/io-monad-which-why-and-how/ IO monad: which, why and how. — A huge post tons of pointers
- https://medium.com/ssense-tech/csv-vs-parquet-vs-avro-choosing-the-right-tool-for-the-right-job-79c9f56914a8 CSV vs Parquet vs Avro
# 16-06-2019
- https://www.youtube.com/watch?v=OXP-sUS6ffE Lambda World 2018 - The Complexity Trap: Think Before You Leap
- https://www.slideshare.net/legendofklang/making-our-future-better The "new" Scala Future
# 15-06-2019
- https://julesh.com/2017/04/22/on-compositionality/ About compositionality and emergence
- https://www.youtube.com/watch?v=I1RAij4aX6Y Path-Dependent Types
- https://www.lightbend.com/blog/managing-streaming-and-queryable-state-in-spark-akka-streams-kafka-streams-flink Managing Streaming And Queryable State In Spark, Akka Streams, Kafka Streams, And Flink
- https://cloud.google.com/blog/products/networking/google-cloud-networking-in-depth-cloud-cdn Google Cloud networking in depth: Cloud CDN
- http://www.lihaoyi.com/post/HowtoworkwithHTTPJSONAPIsinScala.html How to work with HTTP JSON APIs in Scala
- https://www.teamten.com/lawrence/writings/why-i-dont-like-go.html Ten Reasons Why I Don't Like Golang | I wasn't aware of all the implicit conventions. I wonder if this has changed since 2016!
# 14-06-2019
- https://www.slideshare.net/Odersky/a-tour-of-scala-3 A Tour of Scala 3— It will be awesome to use <3
- https://medium.com/@olxc/the-evolution-of-a-scala-programmer-1b7a709fb71f The Evolution of a Scala Programmer – From beginning to typelevel & algebras masters
# 02-06-2019
- https://amplitude.engineering/dedupe-events-at-scale-f9e416e46ca9 Dedupe Events at Scale – Bloom Filters powered
- https://www.youtube.com/watch?v=tL6DtN0zhrQ Monitor Kafka Like a Pro - Good tips about monitoring Kafka brokers & clients
- https://www.youtube.com/watch?v=08eSR0vn4Vw ZIO to code a Concurrent Web Crawler purely functional <3
- http://verraes.net/2019/06/eventsourcing-patterns-migration-events-ghost-context/ Eventsourcing Patterns: Migration Events in a Ghost Context. LegacyCustomerWasImported. \o/
# 31-05-2019
- https://medium.com/free-code-camp/how-to-set-up-a-serious-kubernetes-terminal-dd07cab51cd4 Must have Kubernetes tools
# 30-05-2019
- https://www.infoq.com/fr/presentations/flowcon-2018-Arnaud-Lemaire Dette Technique Et Entropie Logicielle
- https://www.youtube.com/watch?v=pLISFJM22ro Et si on redémarrait l'agile ?
# 29-05-2019
- http://verraes.net/2019/05/eventsourcing-patterns-decision-tracking/ Eventsourcing Patterns: Decision Tracking
- https://www.youtube.com/watch?v=9xFfOhasiOE "CRDTs Illustrated" by Arnout Engelen
- https://www.ebayinc.com/stories/blogs/tech/monitoring-at-ebay-with-druid/ Monitoring at eBay with Druid
- https://queue.acm.org/detail.cfm?id=3321612 Online Event Processing - ACM Queue. Write into the logs then write into the DB using processors
# 28-05-2019
- https://www.confluent.io/blog/17-ways-to-mess-up-self-managed-schema-registry 17 Ways to Mess Up Self-Managed Schema Registry | "delete \_schemas" ahah !
# 19-05-2019
- https://cloudmark.github.io/A-Journey-To-Zio/ Using ZIO
# 16-05-2019
- https://www.youtube.com/watch?v=mGxcaQs3JWI Error Management: Future vs ZIO. I'm eager to use ZIO on something useful!
- https://www.lightbend.com/blog/sbt-1.3.0-release sbt 1.3.0-RC1 released. I miss working on a Scala project.
- https://www.ted.com/talks/simon_sinek_how_great_leaders_inspire_action?language=en Simon Sinek: How great leaders inspire action
- https://boyter.org/posts/file-read-challange/ Processing Large Files – Java, Go and 'hitting the wall'
- https://blog.cloudera.com/blog/2019/05/kafka-replication-the-case-for-mirrormaker-2/ MirrorMaker 2.0
- https://www.confluent.io/blog/introducing-cloud-native-experience-for-apache-kafka-in-confluent-cloud?mkt_tok=eyJpIjoiTlRnNU9XUXlaVGM0WTJJdyIsInQiOiI3V1FRSmtzMjk1aGxIZVVrbDZhYTRZTFZsR1wvclwvdmFjYWlJbEprSHI1M2dyTmxRZG5PUjZ5YTBjN2Rjc0RjbmI5d0VOR1luQ1JuMVFHUXBVOEo2U3lUbzhScTRlWXkzZFZnaUc0SysrZkFqTDBtekV6MG1JMXZtS3luWVYwNFczIn0%3D Kafka Serverless, awesome.
# 10-05-2019
- https://www.confluent.io/blog/journey-to-event-driven-part-4-four-pillars-of-event-streaming-microservices Four Pillars of Event Streaming Microservices
- https://medium.com/enfuse-io/a-diy-guide-to-kafka-connectors-38ad7cd82e02 Guide to Kafka Connectors deployments on Kubernetes
- https://www.youtube.com/watch?v=6n9Y5Ik4jGI Un peu de sociologie, appliquée à notre métier de développeur
# 07-05-2019
- http://pages.cs.wisc.edu/~rgrandl/papers/link.pdf Fast key-value stores: An idea whose time has come and gone
- https://tgrez.github.io/posts/2019-04-13-kafka-transactions.html Kafka transactions and fencing
# 02-05-2019
- https://www.youtube.com/watch?v=pRmwrp_99fA TLS 1.2 & 1.3
- https://blog.softwaremill.com/docker-support-in-new-java-8-finally-fd595df0ca54 Beware of Docker support in "old" Java 8
# 01-05-2019
- https://docs.google.com/document/d/1nFGazvrCvHMZJgFstlbzoHjpAVwv5DEdnaBr_5pKuHo/edit# Java Is Still Free
- https://github.com/google/flogger A Fluent Logging API for Java
# 27-04-2019
- https://medium.freecodecamp.org/optional-in-java-and-anti-patterns-using-it-7d87038362ba Optional datatype anti-patterns
# 25-04-2019
- https://medium.com/xebia-france/kafka-streams-a-road-to-autoscaling-via-kubernetes-417f2597439 Kafka-Streams: a road to autoscaling via Kubernetes
- https://medium.com/@wiemzin/concurrency-is-complicated-e44ddb5aa9ef Concurrency is complicated
- https://www.buzzsprout.com/episodes/1046878-diving-into-exactly-once-semantics-with-guozhang-wang Diving into Exactly Once Semantics with Guozhang Wang
# 23-04-2019
- https://blog.zenika.com/2019/04/23/zoom-sur-quarkus/ Zoom sur Quarkus
- https://www.slideshare.net/FlorentRamiere/apache-kafka-patterns-antipatterns Kafka anti-patterns
- https://www.slideshare.net/giridhar510/kafka-streams-fifth-elephant-2018 Kafka streams fifth elephant 2018
# 22-04-2019
- https://www.conflue