Skip to content

perf: Try to load previous seqNr if missing, in validation (backport 1.5) - #1229

Merged
patriknw merged 1 commit into
release-1.5from
wip-validate-load-1.5-patriknw
Oct 18, 2024
Merged

patriknw merged 1 commit into
release-1.5from
wip-validate-load-1.5-patriknw

Conversation

@patriknw

Copy link
Copy Markdown
Contributor

Backport of #1197

  • perf: Try to load previous seqNr if missing, in validation

  • makes it more safe to evict from memory, but keep more in database

  • a step towards lazy loading of offsets, but full lazy loading would require many more changes due to the concurrency model used in the R2dbcOffsetStore

  • otherwise it will use timestampOf, which are be more costly for gRPC projections

  • it still falls back to timestampOf as last resort

  • different sql for SqlServer

(cherry picked from commit e956248)

* perf: Try to load previous seqNr if missing, in validation

* makes it more safe to evict from memory, but keep more in database
* a step towards lazy loading of offsets,
  but full lazy loading would require many more changes due to the concurrency model used in the R2dbcOffsetStore
* otherwise it will use timestampOf, which are be more costly for gRPC projections
* it still falls back to timestampOf as last resort

* different sql for SqlServer

(cherry picked from commit e956248)
@patriknw
patriknw merged commit 218f0c7 into release-1.5 Oct 18, 2024
@patriknw
patriknw deleted the wip-validate-load-1.5-patriknw branch October 18, 2024 13:12
@patriknw patriknw added this to the 1.5.9 milestone Oct 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant