Hi Sumit, I think different systems have their own ways of handling reads and writes, and there's a good chance they've developed custom caching mechanisms that work best for their specific needs. For example, Redpanda, which is similar to Kafka, has created its own caching system using available RAM. So, to answer your question, it really depends on the system.
All disk read/write must go through page cache ? Is this true for db operations too like on databases like mysql or Apache Pinot ?
Hi Sumit, I think different systems have their own ways of handling reads and writes, and there's a good chance they've developed custom caching mechanisms that work best for their specific needs. For example, Redpanda, which is similar to Kafka, has created its own caching system using available RAM. So, to answer your question, it really depends on the system.
Kakfa just uses the OS page cache to manage caching for them.
If you interested in Redpanda information, you can check the link here: https://redpanda.com/blog/what-makes-redpanda-fast
I was waiting for this. Pls more kafka
Thank you for your support. My Kafka series will include two more articles, so stay tuned.
Love this series .