InfoQ
InfoQ
  • Видео 1 479
  • Просмотров 27 230 089
Effective Performance Engineering at Twitter-Scale
Video with transcript included on InfoQ: bit.ly/3VH33iq
Yao Yue recapitulates scaling a project at Twitter while summarizing some key lessons learned about effective performance engineering.
#DevOps #Performance #Scalability
...........................................................................................................
Follow InfoQ:
- Mastodon: techhub.social/@infoq
- Twitter: infoq
- LinkedIn: www.linkedin.com/company/infoq/
- Facebook: InfoQdotcom/
- Instagram: @infoqdotcom
Просмотров: 2 479

Видео

Architecting for High Availability in the Cloud with Cellular Architecture
Просмотров 1,6 тыс.21 день назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
Relational Data at the Edge
Просмотров 1,2 тыс.Месяц назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
How to Get Tech-Debt on the Roadmap
Просмотров 1,6 тыс.Месяц назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
Streamlining Cloud Development with Deno
Просмотров 972Месяц назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
Million Dollar Lines of Code: an Engineering Perspective on Cloud Cost Optimization
Просмотров 1,8 тыс.Месяц назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
JavaScript: Empowered by Rust
Просмотров 1 тыс.2 месяца назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
NIST 800-207A: Implementing Zero Trust Architecture
Просмотров 2,2 тыс.2 месяца назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
How Netflix Really Uses Java
Просмотров 47 тыс.2 месяца назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
Navigating AI, Platform Engineering, and Staff-Plus: InfoQ Dev Summit Preview
Просмотров 6952 месяца назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
Redesigning OLTP for a New Order of Magnitude
Просмотров 2,3 тыс.2 месяца назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
Generally AI Episode 5: Making Waves
Просмотров 4613 месяца назад
In this episode of the Generally AI podcast, hosts Roland and Anthony explore the fascinating world of audio waves by discussing the history of Fourier analysis and how the Fast Fourier Transform (FFT) revolutionized signal processing with its efficiency. They then shift to song recognition apps like Shazam and their underlying algorithms: breaking songs into snippets and using techniques such ...
AWS Lambda Under the Hood
Просмотров 3,9 тыс.3 месяца назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
How Netflix Ensures Highly-Reliable Online Stateful Systems
Просмотров 5 тыс.3 месяца назад
InfoQ Dev Summit Boston, a two-day conference of actionable advice from senior software developers hosted by InfoQ, will take place on June 24-25, 2024 Boston, Massachusetts. Deep-dive into 20 talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky. Regis...
Generally AI Episode 4: Sold Out!
Просмотров 4643 месяца назад
In this episode of Generally AI, Roland and Anthony explore the theme of "sold out" and delve into the world of GPUs, hot sauce, and beer. The hosts cover CUDA-enabled GPUs and parallel programming patterns. Then they explore the parallels between the scarcity of GPUs and Sriracha hot sauce; the historical context of GPU shortages; and how beer and college students can model supply chain dynami...
Generally AI Episode 3: The Founders of CS and AI
Просмотров 5034 месяца назад
Generally AI Episode 3: The Founders of CS and AI
Managing 238M Memberships at Netflix
Просмотров 3,8 тыс.4 месяца назад
Managing 238M Memberships at Netflix
The Rise of the Serverless Data Architectures
Просмотров 1,7 тыс.4 месяца назад
The Rise of the Serverless Data Architectures
From Open Source to SaaS: the Journey of ClickHouse
Просмотров 1,2 тыс.4 месяца назад
From Open Source to SaaS: the Journey of ClickHouse
Reliable Architectures through Observability
Просмотров 2,5 тыс.4 месяца назад
Reliable Architectures through Observability
Generally AI Episode 2: AI-Generated Speech and Music
Просмотров 5694 месяца назад
Generally AI Episode 2: AI-Generated Speech and Music
Sam Partee on Retrieval Augmented Generation (RAG)
Просмотров 6494 месяца назад
Sam Partee on Retrieval Augmented Generation (RAG)
How to Build a Reliable Kafka Data Processing Pipeline, Focusing on Contention, Uptime and Latency
Просмотров 1,9 тыс.4 месяца назад
How to Build a Reliable Kafka Data Processing Pipeline, Focusing on Contention, Uptime and Latency
Shreya Rajpal on Guardrails for Large Language Models
Просмотров 6224 месяца назад
Shreya Rajpal on Guardrails for Large Language Models
Amazon DynamoDB Distributed Transactions at Scale
Просмотров 1,7 тыс.4 месяца назад
Amazon DynamoDB Distributed Transactions at Scale
Banking on Thousands of Microservices
Просмотров 2,4 тыс.5 месяцев назад
Banking on Thousands of Microservices
Generally AI Episode 1: Large Language Models
Просмотров 1,2 тыс.5 месяцев назад
Generally AI Episode 1: Large Language Models
Needle in a 930M Member Haystack: People Search AI @LinkedIn
Просмотров 1,2 тыс.5 месяцев назад
Needle in a 930M Member Haystack: People Search AI @LinkedIn
2023 Year in Review: AI/LLMs, Tech Leadership, Platform Engineering, and Architecture + Data
Просмотров 7435 месяцев назад
2023 Year in Review: AI/LLMs, Tech Leadership, Platform Engineering, and Architecture Data
Hard Problems in Front-End Platforms
Просмотров 1,3 тыс.5 месяцев назад
Hard Problems in Front-End Platforms

Комментарии

  • @juliocesartorrescama5661
    @juliocesartorrescama5661 День назад

    starts at 30:06

  • @James-mk8jp
    @James-mk8jp День назад

    Slack is slow as sh*t great job keith

  • @shaikabdussalaam5431
    @shaikabdussalaam5431 2 дня назад

    You really have a " hands-on" approach of teaching this. : )

  • @hrishabhg
    @hrishabhg 6 дней назад

    Great talk , lot of computer fundamentals😀

  • @hanamohammadabdalla4102
    @hanamohammadabdalla4102 7 дней назад

    Keep it going .

  • @davidporter6041
    @davidporter6041 7 дней назад

    It's a testament to the Twitter eng team that it remained as stable as it did during the layoffs and more recent ... rework

  • @eyad880
    @eyad880 8 дней назад

    It's funny how Twitter performance improved when she got laid off

    • @arhyth
      @arhyth 7 дней назад

      improved? can't even reliably fetch older tweets now unless you sit on it. but at least we get a thousand spammy replies unrelated to any trending tweet LOL

  • @mohamedfouad1309
    @mohamedfouad1309 9 дней назад

    Wow, great presentation

  • @rmbl349
    @rmbl349 10 дней назад

    Thx, I can see all the new shiny projects I get because chicken engieers start to feel the necessity to switch to graphql because netflix did. Thx for the microservice money @netflix

  • @Besi812
    @Besi812 14 дней назад

    I say thinks that i don't know what I think. 100% true

  • @kienphan6436
    @kienphan6436 15 дней назад

    Great talk thank you

  • @ForeverNils
    @ForeverNils 17 дней назад

    1:10 20 deploys per day?? wow. 120 micro services .... is it ok?

  • @ForeverNils
    @ForeverNils 17 дней назад

    hard to listen annoying "a" and "am", why can't you speak normally?

  • @raman1911
    @raman1911 19 дней назад

    But... we have a problem 🙂

  • @cheeto4950
    @cheeto4950 20 дней назад

    I built this in google sheets :)

  • @ares1647
    @ares1647 22 дня назад

    I keep coming back to this video, absolutely amazing presentation and information is invaluable.

  • @yannikolmohake3694
    @yannikolmohake3694 28 дней назад

    🔥

  • @Kabodanki
    @Kabodanki Месяц назад

    That dude explaining his divorce near the mic is annoying

  • @Ondraasha
    @Ondraasha Месяц назад

    Nothing revolutionary. Just a pragmatic approach. Well done.

  • @r_j_p_
    @r_j_p_ Месяц назад

    Truth revealed. "Netflix is basically a Java Shop". Not Nodejs, not Rust, not Golang. Good ole Java. How the fanboys will howl!

  • @Masmikh
    @Masmikh Месяц назад

    I judged too soon. And I am sorry for that. You presentation was awesome!. One of the best on this matter actually.

  • @ryanquinn1257
    @ryanquinn1257 Месяц назад

    FALCOR mentioned! Cool look at what path I’m starting to go down

  • @aravindram1480
    @aravindram1480 Месяц назад

    What does this guy upto now. His presentation is freaking boring

  • @tesilab994
    @tesilab994 Месяц назад

    Crockford missed a simple epiphany with falling through on case statements. He went from advocating them as useful, to deprecating them as causing errors. But a simple rule would be to allow multiple case statements provided they all shared one body terminating in break at the end. That would clearly be purposeful.

  • @ssg6499
    @ssg6499 Месяц назад

    Revisiting java after a decade, it has become shockingly functional! Nice to see a convergence in styles from varied programming perspectives.

  • @cestlacroix
    @cestlacroix Месяц назад

    great video

  • @caspera3193
    @caspera3193 Месяц назад

    Meh, seems totally feasible to do with 3 engineers

  • @k_tully
    @k_tully Месяц назад

    Excellent work.

  • @user-xg5oq2ks6z
    @user-xg5oq2ks6z Месяц назад

    Primeagen never mentioned that Java is used at Netflix

    • @Kunal-k-u-m-a-r
      @Kunal-k-u-m-a-r Месяц назад

      he is not the only employee at netflix

    • @PhucNguyen-yv8pg
      @PhucNguyen-yv8pg Месяц назад

      Actually he did say Netflix uses java in his DSA course

    • @ricardopieper11
      @ricardopieper11 Месяц назад

      He did say multiple times they use Java at Netflix, he even worked with Groovy at some point.

    • @daltonyon
      @daltonyon Месяц назад

      I hear he saying multiple times that netflix uses Java

    • @gillesashley9314
      @gillesashley9314 29 дней назад

      Well, but is there really any big tech company who do not use Java?

  • @arhyth
    @arhyth Месяц назад

    for a second i thought i was listening to erik meijer :)

  • @carnelyve866
    @carnelyve866 Месяц назад

    Can't wait for them to deprecate all of this in a few years and have the rest of the industry scrambling for help for copying them thinking they were netflix.

  • @deconcoder
    @deconcoder Месяц назад

    Given that the view count here is lower than a typical review of a new hose bib in the plumbing department at home depot, I guess the FP conquest of all programming via Monad Consciousness is still not ready for Rapture.

  • @borisjoffe
    @borisjoffe Месяц назад

    dhh said they spent tons of time optimizing cloud costs and it was still overpriced - that's why the switched to their own servers. The fact that it's so easy to make mistakes costing millions is a serious problem with the cloud. If you look at the basic economics, cloud companies have to make a profit, so they're going to charge more for a server. And the layers of virtualization hurt performance compared to a bare server. So for many companies with steady traffic, on-premise is simpler and cheaper. For services with very variable demand, the cloud can be more cost effective

    • @mihaisagungureanu3070
      @mihaisagungureanu3070 6 дней назад

      It's a new way of working. Don't forget you CAN set budgets and stop the phenomenon when it hits the limits. The cloud sliced and diced the resources to the single "write" on the storage. That's what you pay for. You need to think on the same abstraction level when you code.

    • @borisjoffe
      @borisjoffe 5 дней назад

      ​@@mihaisagungureanu3070 Setting budgets is definitely good, but for most companies and most applications, using ultra-specific cloud tools, Kubernetes, Docker, cloud functions, etc is just overkill and increases vendor lock-in. A cheap fixed-price per month server with nginx, your app backend, and a database is enough for most companies

  • @user-ds9kf7rs5t
    @user-ds9kf7rs5t Месяц назад

    Very insightful presentation. Is Schema Registry, Schema Lenses are also open-sourced?

  • @KamilHussainShaikh
    @KamilHussainShaikh Месяц назад

    Thank you for the easy and clear explanation with an example 🥳

  • @_thehunter_
    @_thehunter_ Месяц назад

    fuck deno

  • @hechen236
    @hechen236 Месяц назад

    good talk 👍

  • @gogira
    @gogira Месяц назад

    jafa

  • @fahadshek8259
    @fahadshek8259 Месяц назад

    2024 watching 🙂

  • @hechen236
    @hechen236 Месяц назад

    Interesting talk 👍

  • @ChristopherHaws90
    @ChristopherHaws90 Месяц назад

    A SQL Engine is essentially an OS

  • @hechen236
    @hechen236 Месяц назад

    Nice talk 👍

  • @canismajorisvy
    @canismajorisvy Месяц назад

    thanks for this talk!

  • @FlaviusAspra
    @FlaviusAspra Месяц назад

    So what's the single character we're talking about at 20:00?

    • @piengeng
      @piengeng Месяц назад

      typo on the company's url?

    • @AntonioDoesMetal
      @AntonioDoesMetal Месяц назад

      It was a typo in the url for the word “company” as the other person mentioned. This means that when the function download_update_metadata ran its response code was never 200 because it was a bad URL. So it fell back to doing a full download and file based hash every single time in the wake condition

  • @rob2theworld
    @rob2theworld Месяц назад

    Where is the course?

    • @infoq
      @infoq Месяц назад

      You can find the mini-book here: www.infoq.com/minibooks/java-dynamic-proxies/

  • @nceevij
    @nceevij Месяц назад

    One of the best presentation on Distributed System .

  • @era2755
    @era2755 Месяц назад

    If they were really concerned about system resources, they wouldn't use Java in the first place.

    • @BB-uy4bb
      @BB-uy4bb Месяц назад

      Thats a stupid comment. It’s a trade of like everything, certainly you can improve resources usage if you go e.g. on c++, but creating and maintaining 3k c++ microservices is nearly impossible, while spring boot is a widely used, easy to develop and maintain, stable and still has a decent performance

    • @arjitmishra100
      @arjitmishra100 Месяц назад

      what a stupid take. Majority of Apache big data library are in java. Kafka is in java. Writing bad programs is not java specific.

    • @gammalgris2497
      @gammalgris2497 Месяц назад

      If you care for specific code properties then you should be careful which libraries and frameworks you use. In the worst case you have to ditch the one or other and make your own according to your specific requirements.

  • @Dom-zy1qy
    @Dom-zy1qy 2 месяца назад

    Really interesting talk, but I really wasn't expecting *everything* to be java across netflix. Although I can imagine that comes with a lot of benefits when working on such a large product.

    • @illyam689
      @illyam689 2 месяца назад

      They only tell you what they want you to know, so maybe they have other workloads running on different stacks. Nevertheless, the stability of a well crafted Java-based system is hardly unparalleled

    • @carnelyve866
      @carnelyve866 Месяц назад

      Java is unbeatable for serious programming.

  • @illyam689
    @illyam689 2 месяца назад

    Now every company will think to have the same problems as Netflix and will copy this exact architecture :D

  • @valboolin3538
    @valboolin3538 2 месяца назад

    Дегтярёв