perf: Enhance objects using constant sql queries count to get rid of N+1 queries by Koc · Pull Request #2857 · nextcloud/tables

Koc · 2026-07-29T00:14:04Z

In our organization we operate a large amount of tables/views, so there are performance bottleneck here:

PERFORMANCE: Controller OCA\\Tables\\Controller\\Api1Controller::index executed 1883 queries in 20.1 seconds
PERFORMANCE: Controller OCA\\Tables\\Controller\\TableController::index executed 1887 queries in 16.6 seconds

Replaced TableService::enhanceTable() in a loop with a single call of the enhanceTables()
Replaced ViewService::enhanceView() in a loop with a single call of theenhanceViews()
Added batch helpers in mappers/services and UserHelper for row/column counts, share counts and owner display names.

🖼️ Screenshots

Here profiler results for GET /apps/tables/table endpoint for 18 tables and 9 views:

🏚️ Before	🏡 After
121 queries	29 queries

🏁 Checklist

⛑️ Tests (unit and/or integration) are included or not needed
🔙 Backport requests are created or not needed: /backport to stableX.X
📅 Milestone is set
🌸 PR title is meaningful (if it should be in the changelog: is it meaningful to users?)

🤖 AI (if applicable)

The content of this PR was partly or fully generated using AI

Koc · 2026-08-30T15:39:42Z

@enjeck I've fixed conflicts introduced by #2781 and code review comments, please, check one more time.

enjeck

a question:

blizzz

Some questions, and view ordering got lost it seems

blizzz · 2026-09-16T12:14:04Z

+			$qb->select('v.*', 't.ownership')
+				->from($this->table, 'v')
+				->innerJoin('v', 'tables_tables', 't', 't.id = v.table_id')
+				->where($qb->expr()->in('v.table_id', $qb->createNamedParameter($tableIdsChunk, IQueryBuilder::PARAM_INT_ARRAY)));


The order by statements are missing:

$qb->addOrderBy('v.sidebar_order', 'ASC'); $qb->addOrderBy('v.id', 'ASC');

blizzz · 2026-09-16T12:16:12Z

+	 * @param array<int, int|null> $tableRowsCounts
+	 */
+	private function enhanceViews(array $views, string $userId, array $tableRowsCounts = []): void {
+		if (empty($views)) {


this does not have the isFederated guard anymore. Intentional? It puts the responsibility to check about it to the caller, like in enhanceView() currently.

blizzz · 2026-09-16T12:21:22Z

+
+		try {
+			$excluded = !$this->circleHelper->isCirclesEnabled() ? [ShareReceiverType::CIRCLE] : [];
+			$shares = $this->mapper->findAllSharesForNodes('table', $tableIds, $userId, $excluded);


Does this still find all shares for a table manager, i.e. indirect shares?

blizzz · 2026-09-16T12:25:37Z

-			} catch (PermissionError) {
-				$table->setRowsCount(0);
+		// if the table is shared with me, there are no other shares
+		// will avoid showing the shared icon in the FE nav


is this intentional? Sounds strange?

…N+1 queries Signed-off-by: Kostiantyn Miakshyn <molodchick@gmail.com>

…N+1 queries (code review) Signed-off-by: Kostiantyn Miakshyn <molodchick@gmail.com>

Koc force-pushed the feature/optimize-enhance-tables branch 2 times, most recently from 9b6bd68 to 4033598 Compare July 29, 2026 00:28

Koc marked this pull request as ready for review July 29, 2026 18:08

Koc requested review from blizzz and enjeck as code owners July 29, 2026 18:08

Koc changed the title ~~perf: Call enhanceTables for a multiple tables at once to get rid of N+1 queries~~ perf: Enhance objects for a multiple tables at once to get rid of N+1 queries Jul 29, 2026

Koc changed the title ~~perf: Enhance objects for a multiple tables at once to get rid of N+1 queries~~ perf: Enhance objects using constant sql queries count to get rid of N+1 queries Jul 29, 2026

Koc force-pushed the feature/optimize-enhance-tables branch 2 times, most recently from 29cbb47 to 44e315b Compare July 29, 2026 21:57

enjeck reviewed Aug 7, 2026

View reviewed changes

Comment thread lib/Db/ShareMapper.php

Comment thread lib/Service/ViewService.php Outdated

Comment thread lib/Db/RowSleeveMapper.php Outdated

Comment thread lib/Controller/Api1Controller.php Outdated

Koc force-pushed the feature/optimize-enhance-tables branch 2 times, most recently from 2686136 to e9b83fb Compare August 9, 2026 14:30

Koc requested a review from enjeck August 9, 2026 14:46

samin-z self-requested a review August 10, 2026 15:48

Koc force-pushed the feature/optimize-enhance-tables branch from e9b83fb to b286459 Compare August 24, 2026 00:51

enjeck reviewed Aug 25, 2026

View reviewed changes

Comment thread lib/Db/ShareMapper.php Outdated

Comment thread lib/Controller/Api1Controller.php

Comment thread lib/Service/ShareService.php

Comment thread lib/Controller/Api1Controller.php

Comment thread lib/Db/ColumnMapper.php

Comment thread lib/Db/ViewMapper.php Outdated

Koc force-pushed the feature/optimize-enhance-tables branch 2 times, most recently from 306f894 to f5cb044 Compare August 27, 2026 23:58

nextcloud-command added the AI assisted label Aug 27, 2026

Koc force-pushed the feature/optimize-enhance-tables branch 2 times, most recently from a7383f5 to c9e19d1 Compare August 30, 2026 14:27

enjeck reviewed Sep 4, 2026

View reviewed changes

Comment thread lib/Db/RowSleeveMapper.php Outdated

enjeck force-pushed the feature/optimize-enhance-tables branch from 263e65c to ba01275 Compare September 4, 2026 04:44

Koc force-pushed the feature/optimize-enhance-tables branch from ba01275 to ecef56b Compare September 4, 2026 08:27

Koc requested a review from enjeck September 4, 2026 09:05

Koc force-pushed the feature/optimize-enhance-tables branch 2 times, most recently from 7243f39 to e845c15 Compare September 12, 2026 15:42

blizzz requested changes Sep 16, 2026

View reviewed changes

Koc force-pushed the feature/optimize-enhance-tables branch from e845c15 to ecef56b Compare September 16, 2026 22:53

Koc added 4 commits September 17, 2026 00:54

perf: Enhance objects using constant sql queries count to get rid of …

49b5a97

…N+1 queries Signed-off-by: Kostiantyn Miakshyn <molodchick@gmail.com>

perf: Enhance objects using constant sql queries count to get rid of …

693d6a5

…N+1 queries (code review) Signed-off-by: Kostiantyn Miakshyn <molodchick@gmail.com>

perf: Enhance objects using constant sql queries count to get rid of …

269e4a2

…N+1 queries (code review) Signed-off-by: Kostiantyn Miakshyn <molodchick@gmail.com>

perf: Enhance objects using constant sql queries count to get rid of …

abc0f82

…N+1 queries (code review) Signed-off-by: Kostiantyn Miakshyn <molodchick@gmail.com>

Koc force-pushed the feature/optimize-enhance-tables branch from ecef56b to abc0f82 Compare September 16, 2026 22:54

Navigation Menu

perf: Enhance objects using constant sql queries count to get rid of N+1 queries - #2857

perf: Enhance objects using constant sql queries count to get rid of N+1 queries#2857
Koc wants to merge 4 commits into
mainfrom
feature/optimize-enhance-tables

Koc commented Jul 29, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Koc commented Aug 30, 2026 •

edited

Loading

Uh oh!

enjeck left a comment

Uh oh!

Uh oh!

blizzz left a comment

Uh oh!

blizzz Sep 16, 2026

Uh oh!

blizzz Sep 16, 2026

Uh oh!

blizzz Sep 16, 2026

Uh oh!

blizzz Sep 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

Koc commented Jul 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🖼️ Screenshots

🏁 Checklist

🤖 AI (if applicable)

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Koc commented Aug 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

enjeck left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

blizzz left a comment

Choose a reason for hiding this comment

Uh oh!

blizzz Sep 16, 2026

Choose a reason for hiding this comment

Uh oh!

blizzz Sep 16, 2026

Choose a reason for hiding this comment

Uh oh!

blizzz Sep 16, 2026

Choose a reason for hiding this comment

Uh oh!

blizzz Sep 16, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Koc commented Jul 29, 2026 •

edited

Loading

Koc commented Aug 30, 2026 •

edited

Loading