That might be opus 4.7 behaviour because I also get that all the time in the past few weeks. Also complex code base, but likely an order of magnitude simpler than yours.

This rings true to me. Rust is great but in environments where you need a lot of unsafe anyway, it’s still not memory safe, and adds complexity otherwise.

That explains why `sync` and `worker` have so similar results in almost all runs. The benchmarks from Tomas Vondra (https://vondra.me/posts/tuning-aio-in-postgresql-18/) showed some significant differences.

Yeah, I don't think "fixing" is really the right term here, since this brings a different set of tradeoffs. You don't leak timestamps, you get ok page locality, but you lose the ability to sort by the IDs. I do see how this might be a good choice for a general PK default (i.e. by default, don't leak stuff).

It's Postgres specific but there is https://github.com/xataio/pgroll which takes the automation a step further.

This is very interesting, thanks for offering to answer questions. I'm curious of two things:

* Are you also considering going the Postgres extension route, like Citus? It is after all the best attempt at sharding Postgres so far.

* If you are willing to share, why not doing this from inside Planetscale? I assume it was at least considered over the years.

It will be a proxy layer. Since Vitess has proven itself with this approach, I don't see a reason to try anything drastically different. As for Planetscale, I've posted my thoughts on X and LI :).

Other relevant talks/blogs that I found really useful for understanding Postgres locks are:

* Unlocking the Postgres Lock Manager by Bruce Momjian: https://momjian.us/main/writings/pgsql/locking.pdf

* Anatomy of table-level locks by Gulcin Yildirim Jelinek: https://xata.io/blog/anatomy-of-locks

From the newish Go-based Postgres CDC tools, I know about:

* pgstream: https://github.com/xataio/pgstream

* pg_flo: https://github.com/pgflo/pg_flo

Are there others? Each of them has slightly different angles and messaging, but it is interesting to see.

https://github.com/artie-labs/reader is another I know of

No support for streaming PG changes

It’s in the works from my understanding. I helped build the Redpanda Connect one and it’s quite easy to use

A couple of spicy things:

> OtterTune. Dana, Bohan, and I worked on this research project and startup for almost a decade. And now it is dead. I am disappointed at how a particular company treated us at the end, so they are forever banned from recruiting CMU-DB students. They know who they are and what they did.

Ouch.

> Lastly, I want to give a shout-out to ByteBase for their article Database Tools in 2024: A Year in Review. In previous years, they emailed me asking for permission to translate my end-of-year database articles into Chinese for their blog. This year, they could not wait for me to finish writing this one, so they jocked my flow and wrote their own off-brand article with the same title and premise.

Also sounds like he's preparing a new company:

> I hope to announce our next start-up soon (hint: it’s about databases).

How do they enforce the ban? Do universities have non-compete clauses for PhD students?

I assume it's not that kind of ban, but more like he'll recommend his students to avoid the company.

Pretty much. Plus, from my perspective - if a company is willing to screw over your advisor/professor, you know that they won't hesitate to screw you over too.

I think that just means they aren’t allowed at career fairs etc.

Anyone know what company he may be talking about?

Inspect element on https://web.archive.org/web/20240827031455/https://ottertune...

For more context:

> I'm to sad to announce that @OtterTuneAI is officially dead. Our service is shutdown and we let everyone go today (1mo notice). I can't got into details of what happened but we got screwed over by a PE Postgres company on an acquisition offer. https://x.com/andy_pavlo/status/1801687420330770841

Because that was a little too subtle and I was sufficiently curious:

view-source:https://web.archive.org/web/20240827031455/https://ottertune...

scroll until you see ASCII art

needed that. https://en.wikipedia.org/wiki/EnterpriseDB note the PE's

Oh wow, didnt know pe-postgres-company had any negative rep.

Anyone care to explain how a company can screw another company via a acquisition offer?

Well, there's a leading Postgres company which is owned by not one but two PE firms...

Georgescu's voters don't see themselves as pro-Russian. They think of themselves as "patriots", anti-LGBT, and anti-establishment. They also think that we are helping Ukraine too much, at the expense of domestic issues.

These are the messages that were used on TikTok, an open pro-Russia message would have been buried quickly.